Replying to Avatar Pablo Xannybar

For real this is 100% local on standard consumer smartphone hardware! No cloud.
Avatar
Gzuuus 2y ago

Fuk will love to try it, some guide around to do that?

Reply to this note

Please Login to reply.

Discussion

11
f9OfwT 2y ago

I installed it in 2 minutes on linux!

Check this out: https://github.com/antimatter15/alpaca.cpp#building-from-source-macoslinux

11
f9OfwT 2y ago

Sorry this one was he using i guess

https://github.com/ggerganov/llama.cpp#usage

64
6484df04... 2y ago

It uses fortran! take me back!

Avatar
Pablo Xannybar 2y ago

If you're good with Linux it's easy to setup, I even compiled it entirely on my Android phone.

Avatar
Gzuuus 2y ago

Nice! Ill love to try, what repo are you using?

Avatar
Pablo Xannybar 2y ago

Standard LLaMA open source implementation, it's come a loooong way now!

https://github.com/ggerganov/llama.cpp

Avatar
Gzuuus 2y ago

I need to play more with llms😬

Avatar
Gzuuus 2y ago

Nice i build it, but then i need the model, can you share me your one to download it?

Avatar
deeznuts 2y ago

Can you point out a build setup for android?. I'd love to put it on my phone