Still amazed how I can run an LLM with no internet connection on my phone 🤯

Here I’m running Phi-3.5-Mini on an iPhone using LLM Farm getting 9.62 t/s.

Links:

https://huggingface.co/microsoft/Phi-3.5-mini-instruct

https://apps.apple.com/app/llm-farm/id6461209867