This is how you run LLMs in a privacy preserving sovereign way on your mobile device:
🔸 Install the *ChatterUI* #foss app via Obtanium/Github.
🔸 Go to *HuggingFace* site and download an open-source LLM of your choice (gguf).
🔸 Open the app and import the model.
All your chats will run locally on your device. No accounts required, no internet connection. Tons of customizations.
Many models to choose from, even small mobile-efficient ones from Gemma 2, Llama 3.2, DeekSeek—all will run on your mobile device with decent tokens/s.
#privacy #grapheneos #opsec


