You can run it on your PC or even on phone browser using Colab. You will have your own personal AI chat, hosted by you.

I mean you can give it a try:

Click on this link, and in the runtime tab in side bar, there will be a 'run all' button. Click on it, and it may fail once, but then restart it again, and it will work.

I will post the more refined process later, I am creating some shortcuts for this and also doing some fine tuning.

https://colab.research.google.com/github/realiefan/NostrAi/blob/main/llama-2-13b-chat.ipynb