I dont know of you're familiar with ollama.ai? I used it recently (model cpdebooga) for a coding task of it really sped up my work.

Offline, open source