Llama3 is trainable with consumer hardware! I just fine-tuned it a bit and made Emu.

Emu has slightly better alignment than Llama3 in these domains:

- bitcoin

- health

- permaculture

- herbs

https://huggingface.co/some1nostr/Emu-70B-Llama3

I will continue trainings and alignings. Emu has worse Nostr knowledge than Ostrich, because all the training on Llama2 based models had to restart, since Llama3 is such a big leap!