I tried to write my own activitypub server for the same reason, and because mastodon is bloated af. The protocol was just too complicated and it required me to run a server which most people wont be able to do and therefore will never be sovereign. its just a bad design.