I only visit other peoples servers to look around. I wont build anywhere but on my own creative worlds because I know where my world will be tomorrow. One thing I learned many years ago is that nothing on a server is permanent. One day your stuff is there and the next day the server (and all of your work ) is gone. I would rather control my own world and only visit others.
Fore some strange reason , I got banned for just looking around a server a year or 2 ago. I never picked a fruit or even swung a pic or axe on that server.
The server owner must have just been having a bad day.
Wait till they go from Alpha to Beta.. probably take a server wipe. Happened in many many of these building type survival games. I guess you can just not upgrade your server and play alone. X/