Got it to work with qwen2.5:14b but it's just too slow unfortunately.
Discussion
Smaller models work fine with system stuff like opening the browser quickly but they're quickly overwhelmed and start to hallucinate. Unfortunately bigger models don't for into VRAM.