Replying to Avatar mike

I was testing posting in a chapter of Pride and Prejudice, which the AI summarised well, because it had context.

But, then I asked it to summarise "I have no Mouth" without posting in any context, so it had to do it from memory, which it got the general plot close, but many of the detail is wrong, but not stupid wrong, just plausible prediction that is incorrect.

Despite this, a 5GB model running on my MacBook being able to do this without connecting to the Internet, I find amazing, despite the hallucinations of the second example.
Avatar
YODL 2w ago 💬 1

Yeah, it's this distinction between local, no internet, parameter count stuff that I'd like to understand better. Plus a bunch of other stuff. Would honestly need a 20 minute conversation to get it clear at this point. I've had it explained to me a couple places here and there on nostr and yet anytime I try to speak about it later I realize I know nothing

Reply to this note

Please Login to reply.

Discussion

Avatar
mike 2w ago 💬 1

If you're genuinely interested, the best video I've seen, from a highly respected researcher, is this one I've linked to below.

It's 3 and a half hours, but the first two hours are the most informative.

If it's TL;DR, then I'm happy to try to explain what little I know if you have any questions.

https://www.youtube.com/watch?v=7xTGNNLPyMI

Avatar
YODL 2w ago

Thanks. I'll find the time to watch this. Overdue!