Nostr Web Client

An interesting way to think of AI:

It's just an insanely good compression algorithm. However, rather than being able to extract all of the images and text it is trained on word for word like we normally do with compressed files, it stores a highly generalized relationship between one set of words and another, and one set of pixels and another. So you can't pull an exact image like you can from a zip file, but you can pull the *idea* of a cat, the *style* of Wes Anderson, and the common patterns of a landscape. It's a compression of ideas and context as a collective, rather than the compression of the exact group of individual images that can be later recalled.

#AI_Unchained

Gigi 2y ago

Words are just lossy compression, as is understanding.

That's why there is no difference between maximum signal, perfect encryption, and randomness.

What appears random from an outside perspective might as well be maximally informative if you have the key to decrypt it (aka make sense of it, aka understand it).

That's why any proper encryption algorithm has to produce a random string of bits, otherwise you could find a pattern and attack at. Same for compression (otherwise you could compress it further).

Words are hashes, and hashes are inherently lossy (number of possible outputs = smaller than number of all possible inputs). Consequently, making sense of lossy artifacts (decompressing them) requires "filling in the gaps", aka intelligence and creativity.

The question is how to go from that to wisdom.

Reply to this note

Please Login to reply.

Discussion

OgFOMK ArTS 2y ago

Very heavy-duty .

The difference between compression, encryption and random generation is planning.

The difference between ( compression, encryption and random generation (work)) is skill.

The wisdom is knowing that by imitation the goal is set for reproduction but then the wisdom is that reproduction may not be enough and there needs to be initiation and further investigation.

When I was a toddler I remember having dreams/nightmares of random chaos and then waking up to clarity. I remember laughing when adults laughed even though I didn't understand the joke. All of my activities were honed or learned by experience.

Or were they.

Maybe my skilful actions were unlocked?

Gigi 2y ago

Planning is just a meta-model, a compressed view of the world, the past, the present, and possible futures.

That's why the layered approach to intelligence works. It's the same stuff all the way up and down, just different levels of analysis.

Jimmy 2y ago

Words are a very crappy way of compressing information, that is why humans invented math and dynamical systems theory. That way you can compress a practically infinite dimensional data set into a finite set of parameters of a corresponding model of a dynamical system. Fundamental science is about finding better way to desribe nature, balancing accuracy and complexity hence improving on compression.