of course, but then I can take my follows and say GFY admin, I'm gonna start my own shit and we part ways right?

I actually never went down the mastadon route, but my understanding is that the admin could just say - we don't like your opinion bye bye - and you'd lose essentially your social graph on that server. Is that right?