From all this AI saga, all I want is a general-purpose open-source LLM that is efficient enough to run locally on a phone, > 10 tokens/sec and smart enough to handle basic tasks like answering questions and reading PDFs with contextual understanding.
No AGI, nothing, just a model, Light enough to run on a device locally, yet smart enough to handle essential tasks, that’s all I need, I'm a simple man.
I want that too, plus the possibility to talk to the LLM without having the voice data stored on some evil corp's servers. Voice opens up so many possibilities like truly learning new languages without having to relocate to a new country.
Yeah. Seen you need Personal.AI it’s an awesome small language model that you train from scratch … Talk to my AI here https://3xethical.personal.ai/messaging/profile. #AI
Llama 3.2 3b fine-tuned model running locally on device offline, at around 10 tokens/sec. 👀 
