Download all the notes.

Take the "content" field from the notes and change the name to "text":

Previously:

{"id":".....................", "pubkey": ".................", "content": "gm, pv, bitcoin fixes this!", .......}

{"id":".....................", "pubkey": ".................", "content": "second note", .......}

Converted into jsonl file:

{"text": "gm, pv, bitcoin fixes this!" }

{"text": "second note" }

Used Unsloth and ms-swift to train. Unsloth needed to convert from base to instruct. This is a little advanced. If you don't want to do that and just start with instruct model, you can use ms-swift or llama-factory.

You will do lora, pretraining. I used 32 as lora rank but you can choose another number.