If you're good with Linux it's easy to setup, I even compiled it entirely on my Android phone.

Reply to this note

Please Login to reply.

Discussion

Nice! Ill love to try, what repo are you using?

Standard LLaMA open source implementation, it's come a loooong way now!

https://github.com/ggerganov/llama.cpp

I need to play more with llms😬

Nice i build it, but then i need the model, can you share me your one to download it?

Can you point out a build setup for android?. I'd love to put it on my phone