Global Feed Post Login
Replying to Avatar iefan 🕊️

Lol, did the open-source community accidentally just fix the LLM hallucination problem? 😳

Context:

It seems like the Shrek entropy sampler with early exit solves, if not significantly reduces, the hallucination problem with big boy models. Some people are running evaluations now, and so far, it seems promising. 👀

Avatar
BootyDust 1y ago

What's the Shrek entropy sampler? Is this related to your earlier note? @nostr:nevent1qqsq72y32j707ugtgu26h77marmzrsu0t6dtfpw500q6j49fp3hzckgppemhxue69uhkummn9ekx7mp0qgsvdac80utfn4gvly4fv54la0l6cp0udpptnm3ezzyajkdc44w53lgrqsqqqqqpm0mux9

Reply to this note

Please Login to reply.

Discussion

Avatar
iefan 🕊️ 1y ago

It's a very early development. Feel free to test it out firsthand. I'll share updates once official benchmarks become available.

nostr:nevent1qqs2u86x8d05tkpjtmxc9jfq2rwqh99q4zau5gwfpsw853ahgcxe7mspzamhxue69uhhyetvv9ujuvrcvd5xzapwvdhk6tczyrr0wpmlz6va2r8e92t990ltl7kqtlrgg2u7uwgs38v4nw9dt4y06qcyqqqqqqgc3zyjv

Thread collapsed