Is it the bandwidth or the VPS that is expensive?

You can get an enormous dedicated server for 120 euros/month: https://www.hetzner.com/dedicated-rootserver/matrix-px