there is a growing number of VPS services appearing that offer servers with GPUs. a 24gb 4090 GPU can do several requests per minute easily.
not saying it's not a lot more expensive than CPU only VPS services but you can opt out of the big providers and still provide service. i have been using a Qwen model lately for some of my work and when jetbrains finally caves in and allows Junie to use on-site GPU powered LLMs i won't be using cloud LLMs at all anymore.
it's also quite overstated how much utility you get from LLMs for coding. they are good at some things, and other things need to have their work checked carefully, and other things they are useless at.