Agreed but I’m more of a robert sapolsky fan on the subject. Sam’s silly idea of maximizing well-being to solve for morality is very low level. I would go as far to say the consciousness is emergent as a result of our brain grappling with language which separates the body that acts in the world out of instinct and the individual in the mind that is constantly questioning things.
Discussion
Could AGI be conscious despite not having human language? They operate with high dimensional embeddings - likely in the same way humans do (under the hood) - the end result of which being the resulting human language.
So is it language itself, of the _computation_ of a “language?”
I think consciousness is the contradiction between individual short-term goals and what a species is, which is individual self sacrifice for collective long-term survival. Like how they say, the betas outsmarted the alphas to domesticate the species and that was beneficial for women. I guess what do you mean by conscious? Like conscious in the sense that it is a selfish agent? Cause the future of AGI is definitely agent interplay as I’m sure you agree
No. That we want a conscious AI I think is a very silly idea. Humans are conscious and collectively were fucking useless. There’s only a handful of us that actually make useful discoveries and my guess is that’s because it’s hard to motivate people with a capitalistic status game as a reward for innovation or evolution. I want a stable society for my great great grandbabies so I don’t give a shit about money.
Well I’m not sure about the “wanting” a conscious AI - I’m just wondering why humans find themselves in a place that we experience what it is to be alive - and IF machines could do the same or if there is some kind of barrier (which I don’t have reason to believe exists)
Honestly if an AI can bring about world peace for my grand babies, bring it on! Although that’s a stretch…
I just think we’ll get there one day whether we want it or not
Yeah, I think world peace has a lot to do with getting away from this idea of individual agency. Like I don’t make any major decisions without consulting my wife. I’ve always had a problem with how we tally votes in an individualist way. It seems right on its face, this is an algorithm I came up with, but nobody ever thinks it’s useful: https://drive.google.com/file/d/1Tu6i2Zm1UxBIzmNE6-q_bRbdmoVraPSm/view?usp=drivesdk
Oddly enough I have an aversion to clicking on links these days… fr
Host that stuff on nostr so we can zap it.