If Elon can ban you it’s because you’ve granted him that power. Whether you did this explicitly or not does not matter the end result is the same.