Global Feed Post Login
Replying to Avatar iefan 🕊️

Lol, did the open-source community accidentally just fix the LLM hallucination problem? 😳

Context:

It seems like the Shrek entropy sampler with early exit solves, if not significantly reduces, the hallucination problem with big boy models. Some people are running evaluations now, and so far, it seems promising. 👀

Avatar
Guy Swann 1y ago 💬 1

Can you share a link or expand on this? What does the entropy sampler do here?

Reply to this note

Please Login to reply.

Discussion

Avatar
Rif'at Ahdi R 1y ago

I think this is the related repo, right nostr:npub1cmmswlckn82se7f2jeftl6ll4szlc6zzh8hrjyyfm9vm3t2afr7svqlr6f ?

https://github.com/xjdr-alt/entropix

Thread collapsed