Does #AI fetches content from the web or does it only learns the meaning of words from web data it crawls ?
#askNostr
Discussion
it eats a ton of content from the web beforehand and then it can regurgitate variations on it that are gramatically correctly formed but many times, it will hallucinate because it's just digital pattern matching
What I watched (on youtube :-) is chatGPT 3.00 creates around 12000 dimensional vector space where each word (token) is a vector .. as it goes through the embedding run on vast loads of internet text, it assigns a unique vector to every word .. in essence it is just learning the meaning of the words from the text it ingests ..
Having learnt the meaning of words ; when we give it a prompt , it simply finds the next appropriate word to complete a conversation ..
The expectation is - if it knows the exact meaning of the words then the sentences it forms would be factually accurate ...
In essence , it is just like a child learning the language ; it doesn't really plagurize anything
Is that a right understanding ?
yep, that's why they call them models, that's how we do it also
wholly molly .. they are literally creating a human brain ! 🧠 ..
how long before these things start creating a real body for themselves .. and they might not even be needed to do that because most of us are anyway living in the digital space now :-)
brains don't make bodies, bodies make brains
there is no ecosystem of supply of freely available computation resources out there, unlike nature, who has all kinds of cycles of carbon and water and sunshine and heat
if you ask me, the demand for power is already hitting a ceiling with these things and at some point they have to limit themselves to the economic value they produce
apparently all the big AI dorks are talking about rolling out big nuclear reactor infrastructure to run their stupid models on, but i think that it's a bubble
i personally find no utility in this tech, and it makes all the content i read and see online more dull than i can explain about how dull it is
there is no economic value in it, and the gravity is going to become the dominant force very soon
the insanity of government bureaucracies these days though, i mean, really, they all put politics above economics and they just keep on getting more outrageously unrealistic about what they expect to happen
it's all gotta come crashing down sooner or later, and i sure as fuck don't plan on being dependent on the infrastructure on that day... i would guess 2-5 years from now this all collapses
That is so true .. isnt it crazy that they blamed bitcoin for environment and now they are literally pushing a nuclear energy through main stream .. apparently microsoft bought an island to set one up ..
I had the same thought process on the utility of these models ..but my son ( who is a dev) keeps telling me how easy it has gotten for him to code ..even in languages that he had never learnt .. so it thinks LLMs are there to code ..not tp write songs :-) ..
tehy are utter shit at writing code too
i think they might be useful for translating a given algorithm between two languages but even then some languages are so shitty (eg rust, c++) that as it is already the established translator to binary code is already heinously inefficient and prone to error
also, the naked power grab in all of this, i mean, oh, nah, we can't have power for poor people to light their homes and get them actually clean water
but we must have power for the robots that make our manipulations "cheaper"
really, that's what it's all about, they want the AI to be able to completely outwit the crowd of humans but the humans are cheaper and more efficient at actually making a happy world, it's those pigs and their tricks that are the problem
and i'm pretty sure they are in a panic because there is an evac fleet on its way here now that will pick up everyone but them and their faithful (sic) servants at which point all hell breaks loose and almost nobody left on this planet will survive
i mean, why else are they grasping like this? obviously they know something that is extremely threatening to the survival of everything