Avatar
komori
72783495e40cbf440889b04d6ed97c1bbc1d68164de210724075468bc1a69549
Husband | Father | Absurdist | Coder | Metalhead | Bitcoin | Monero | Freedom | Privacy | Portugal 🔗 XMR “The opinions that are held with passion are always those for which no good ground exists; indeed the passion is the measure of the holder’s lack of rational conviction. Opinions in politics and religion are almost always held passionately.” — Bertrand Russell

Interesting. 📱

#damus #yakihonne #nos #nostur #wherostr #primal #nostr #ios

From a reliable source.

Oh, I see. By dataset I was thinking of the [WoT filtered] raw data after cleaning/curation and post-processing.

Yes, you can. These notebooks use smaller models only to take advantage of the Tesla T4 (free tier). You can mod the notebook and use it locally. You can use their bigger models or any other that you want when you feel more comfortable with the different model templates. https://docs.unsloth.ai/get-started/all-our-models

If you don’t mind me giving you a suggestion. An easy way to get started is by using Unsloth’s Google Colab notebooks. Just by inspecting the code of some of their many notebooks you can get a solid starting point about the fine-tunneling steps, including the dataset formats. https://unsloth.ai

Replying to Avatar someone

Wanna see what Nostr does to AI?

Check out the pics. The red ones are coming from default Llama 3.1. The green ones are after training with Nostr notes.

If you want to download the current version of the LLM:

https://huggingface.co/some1nostr/Nostr-Llama-3.1-8B

The trainings are continuing and current version is far from complete. After more trainings there will be more questions where it flipped its opinion..

These are not my curation, it is coming from a big portion of Nostr (I only did the web of trust filtration).

Isn’t it better to use an uncensored base model for the training? Will you opensource the dataset?

Replying to Avatar someone

Wanna see what Nostr does to AI?

Check out the pics. The red ones are coming from default Llama 3.1. The green ones are after training with Nostr notes.

If you want to download the current version of the LLM:

https://huggingface.co/some1nostr/Nostr-Llama-3.1-8B

The trainings are continuing and current version is far from complete. After more trainings there will be more questions where it flipped its opinion..

These are not my curation, it is coming from a big portion of Nostr (I only did the web of trust filtration).

Did you use a system prompt in these examples?

đź‘€

nostr:note1c4tkz3qz0scdrzhmq6u89chkpdu0gflfl3e47r4qnd7yux4l2yes33mwja

#asknostr is there any open source mobile client that gives more control over the metadata you share with relays? Like showing the raw data, creating new templates, encrypted data as custom event kind, encrypted social graphs, relay policy management…

rStar-Math: Small LLMs Can Master Math Reasoning

with Self-Evolved Deep Thinking

https://arxiv.org/pdf/2501.04519

#llm #slm #ai #math #microsoft #research

I don't have a purple account and I'm using it right now. Just clone the repository and compile. https://github.com/damus-io/notedeck