NSON is pretty fast: https://github.com/nbd-wtf/go-nostr/tree/master/nson

But when you compare the speed gains of using anything other than JSON (even if you use the fastest possible binary encoding) with the time it takes to verify a signature then you see how pointless all these efforts are.