A few days ago, I ran the leaked Meta Llama LLM entirely on my phone/PC without any Meta servers. You should look into it; it's very interesting stuff.