I was using a ledger, but I just moved my coins off that to my phone's bluewallet. I compare the address on the screen to the address in the bluewallet app. I have a passport on the way, which actually bypasses the entire clipboard issue by allowing you to scan QR codes.
Discussion
Not 100% sure I understand your setup, but seems like probably one of these:
If it’s bluewallet on your phone plus Ledger: If your phone is sufficiently compromised, you can’t trust the address shown in bluewallet, or the QR code you’re scanning..
If it’s desktop plus bluewallet on your phone: if your desktop is sufficiently compromised, you can’t trust the address there, or a QR code scanned from there…
I don't think blue wallet itself can become compromised unless blue wallet pushes an update through the app store themselves. If they did and I was given fake addresses in the app then no amount of checking the address, whether server or on a screen, is going to catch it.