someone on Nostr: Llama3 is trainable with consumer hardware! I just fine-tuned it a bit and made Emu. ...
Llama3 is trainable with consumer hardware! I just fine-tuned it a bit and made Emu.
Emu has slightly better alignment than Llama3 in these domains:
- bitcoin
- health
- permaculture
- herbs
https://huggingface.co/some1nostr/Emu-70B-Llama3
I will continue trainings and alignings. Emu has worse Nostr knowledge than Ostrich, because all the training on Llama2 based models had to restart, since Llama3 is such a big leap!
Emu has slightly better alignment than Llama3 in these domains:
- bitcoin
- health
- permaculture
- herbs
https://huggingface.co/some1nostr/Emu-70B-Llama3
I will continue trainings and alignings. Emu has worse Nostr knowledge than Ostrich, because all the training on Llama2 based models had to restart, since Llama3 is such a big leap!