Global Feed Post Login
Replying to Avatar Winter Jo :neocat_comfy: :v_enby: ❄️

Apple did the research; LLMs cannot do formal reasoning. Results change by as much as 10% if something as basic as the names change.

https://garymarcus.substack.com/p/llms-dont-do-formal-reasoning-and

Avatar
⚑ Dee Kay βš‘πŸ‡ΈπŸ‡ͺπŸ‡¬πŸ‡§πŸ‡¨πŸ‡ΏπŸ‡§πŸ‡·πŸ‡¦πŸ‡Ή 1y ago

No surprise at all.

But isn't the new openai (strawberry) trying to get around this with very slow iterative results?

Reply to this note

Please Login to reply.

Discussion

No replies yet.