Have you tried Ubuntu Studio? It uses the low latency kernel and has a lot of things already set up for audio production. You could run it from a thumb drive or spare hard drive to see if it fixes your issues without messing with your current system.
Discussion
I have not. But I was just reading about it on some forums after doing a quick search.