Ok, Iām currently running this model on my phone with one-click deployment. Iām also discussing fine-tuning with my friend.
Do you want an open-source AI assistant on the Nostrnet.work dashboard? I could train it using the Nostr project GitHub repos during fine-tuning.
First, I will share my Colab notebook today, so you all can test it out. 
nostr:note1ju22sjyahvnmp9wrcfz6apgwj0v46ymn9c5h3em2dxntnlm3q9lqenmqg4
Iefan is it running on the phone hardware itself or colab cloud servers?
You can run it on a phone or a Raspberry Pi, but it requires downloading numerous packages and other dependencies. Currently, I'm working on a one-click deployment for Colab, enabling you to run it for free, it will be just for testing. I am just creating a blueprint right now.
Excited to try it out š
This is really really cool. What are you training it with? Would a dataset from a relay be useful, jus lmk. Excited to see where this goes. š±š“šļøš¦
Currently it's using Llama 2, 16 Billion parameter model. It's already extremely smart, we just have to fine tune it with nostr related data.
