I pass the collection basket around at my Church. I've done it for years. I was on our parish ministry council for years. I've never heard of one person complain about feeling bad they were unable to give at that time. I've never heard of one person feel left out for this reason.
Nobody can see how much you put in, only if you put anything in. Do you think the same criticism you have couldn't apply to a offering basket at the entrance? If you are very concerned about other people, you could watch and see who does and does not give.
Giving is also not totally anonymous. There is a basic commitment to give you fill out at my Church to become a member. Obviously you can give more than that, or less if you can't. But it is a named commitment.
It can also serve as a reminder for other people to give. It gives children a chance to give and participate in the service. My Church, until a recent surge in attendance, struggled with finances off and on. If we made even less of an effort to make opportunities for people to give our situation may have been even worse.
Do you feel the same way about a special offerings taken at the end of liturgy? Or only the one in the middle?
It is a fair point you make, but I disagree.