Yesterday I downloaded a local LLM app to my iPhone 15 Pro Phi3 mini was throwing 15 tokens / sec. Don't get sidetracked by Apple, everyone is going the same place, and very soon.
Discussion
Which App?
Thanks! You inspired me to search github for an android equivalent app. Found this one but I have not tested it, still downloading Q4_K_M
search terms I used