Nice! Ill love to try, what repo are you using?
Standard LLaMA open source implementation, it's come a loooong way now!
https://github.com/ggerganov/llama.cpp
Please Login to reply.
I need to play more with llms😬
Nice i build it, but then i need the model, can you share me your one to download it?
Can you point out a build setup for android?. I'd love to put it on my phone
