The latency is not much of an issue if you are on a fast connection. But if you feel that it is an issue, you can disable tor.