someone on Nostr: i took the llama 3.1 base and converted to instruct (enabling the model for ...

i took the llama 3.1 base and converted to instruct (enabling the model for chatting). it had so much less misinformation compared to instruct fine tuning done by meta.

this suggests LLMs are much better when they digest everything on the internet (the pre training phase) compared to further fine tunings. i mean mediocrity of the internet is better than "fine tuning" of meta.

so many companies are hurting truthful ideas in the models. let that sink in. and many further fine tunings by other smaller teams as far as I see also add misinformation.

LLMs are trying to find shared values but bad teams are adding lies. lets fix that!

lmk if you want to contribute to truthful AI project. i need curators that will say this is the truth and I will make models based on those. this will allow us to diversify source of truth. i already have a few people but more guided people means being closer to truth because biases will eat each other.

being curator is very easy. you just tell me what do you think is true and works for most people and has been working for ages.