Those fruit flies are breeding somewhere. Put the fruit in the fridge, clean the whole area, and if they persist, look for where else you can keep clean that they are breeding. If you find a slimy gunk, that is where the eggs were laid, and you can keep that cleaned often to not have them lay eggs there anymore.