As a slightly avid swimmer...
I mean, me and the water fight for 45 minutes or an hour, usually, that's maybe not swimming. I don't know what that is, but that's what I do.
Bandaids in the pool are just a thing. They will eventually drift over to those little catcher doohickies on the sides, but that takes a long time and they're going to attach themselves to your heel or something much earlier than that.
And as far as I know, all of the noxious chemicals they put into pool water, mostly chlorine, render them fairly inert.
That doesn't make them any less gross or creepy, though... I feel for you and understand.