I use iPhone and Pixels with Calyx and GrapheneOS. I was using Pixel as daily driver for the reasons you mentioned, but switched to iPhone for Damus. It’s totally doable to switch and not use Google services, however it’s a big adjustment coming from iPhone where everything just works without tinkering with it.