There wouldn't be enough natural predators to keep them in check, and the way they multiply, the devastation that happens on the fruit is dangerous.