This is the model if you want to run it on your actual hardware.
He said some links, but If you want to host your own, You can try it out, I am using one premium version of colab but it also works fine on free version. Just open the link click on run button. If it failed, run it again. It will work.
https://colab.research.google.com/github/realiefan/NostrAi/blob/main/llama-2-13b-chat.ipynb
Discussion
No replies yet.