1B & 3B models 👀
These should be able to run on iPhones models going back 5 years or so to around iPhone X
How can I run them locally on an iPhone ?
Please Login to reply.
Download gguf quantizations of the models (q4 minimum) and use software like MLCchat or Layla.ai. I'm not sure what software is available on iPhone, personally.
Thanks 💜🫂 MLC Chat is available on iOS
