Currently you have (millions of) people whose labor is not being used for either the benefit of themselves or their families, if they start working for themselves and their families instead of enriching some slave holder there will be a disproportionate impact upon poverty compared to other interventions that could be made.