Make sure you treat them again in the spring because they can put out a few generations in a season and multiply quickly. I’ve gotten some pure neem oil off of amazon and mixed it with mild soaps (like those dr bronners castille ones) and water and sprayed some plants with it with some success. That should protect the pollinators since neem only kills when it is eaten. The problem is you really have to saturate the leaves. The systemic non-organic insecticidal soaps work well too, but they probably harm the bees. The systemic ones allow you to just spray the tops of the leaves and then it works its way through the plant. Neem you would have to spray on both sides...kind of a PITA.