I don't trust WoS either.

Let's say I use WoS, and i wallet connect to App A. Now not only WoS can rug me, but App A either. Somehow wallet connect can give a bigger attack vector, because after wallet connect, wrong security measures either on WoS or App A side can result in the loss of my funds.

App A and WoS could be replaced with any wallet, and any App.

I think what is important, that this does not mean App A is bad. It just means, adding wallet connect adds more security concerns. And maybe App A has better security measures than the wallet itself, but who knows.