Global Feed Post Login
Replying to Avatar iefan 🕊️

Lol, did the open-source community accidentally just fix the LLM hallucination problem? 😳

Context:

It seems like the Shrek entropy sampler with early exit solves, if not significantly reduces, the hallucination problem with big boy models. Some people are running evaluations now, and so far, it seems promising. 👀

Avatar
jb55 1y ago 💬 1

> Shrek entropy sampler

Reply to this note

Please Login to reply.

Discussion

Avatar
iefan 🕊️ 1y ago 💬 1

I did some testing with multiple types of models, also with the Llama 1b model. I haven't seen the official benchmarks yet, but improvements are very noticeable even on very small models.

System prompts:

nostr:nevent1qqs0mr006vwv866frr6mzheqmmdhlflyv6yptmlvfz249esuzj87fhgpzdmhxue69uhhwmm59e6hg7r09ehkuef0qgsvdac80utfn4gvly4fv54la0l6cp0udpptnm3ezzyajkdc44w53lgrqsqqqqqpr2mdyd

Thread collapsed