Replying to Avatar node

Does it run directly on a cellphone or it runs on a local server and you connect to it?
Avatar
komori 11mo ago

You can run ~1b-7b 4-bit models locally on an iPhone with MLX Swift.

https://github.com/ml-explore/mlx-swift-examples/tree/main/Applications/LLMEval

Reply to this note

Please Login to reply.

Discussion

Avatar
node 11mo ago

Good to know! Thanks