Have you tried Ubuntu Studio? It uses the low latency kernel and has a lot of things already set up for audio production. You could run it from a thumb drive or spare hard drive to see if it fixes your issues without messing with your current system.