The SSL requirement for the custom electrum server needs to be removed. If basically locks most in to your server, still allowing you to track all transactions.

Most who want to use a custom server want to use their node on their local network.