Anyone watched the #Lex pod with Sam Altman on AI & AGI? What's your verdict? Is the world gonna be gradually conquered by another red-haired, sociopathic nerd in SF? Or is he authentic? Does he want to turn us all into borgs? Does he want to give us a nice life-long holiday - Thereby making us lazy, dependent and stupid?

After all, "Man becomes, as it were, the sex organs of the machine world" as Marshall McLuhan said all the way in the 60's.

Many questions....

Reply to this note

Please Login to reply.

Discussion

I don’t know, I watched the episode and have been following Altman on Twitter for a while. He seems sincere in his quest for helpful AI. But I also get the vibe that he is not 100% open about his agenda, and especially that he is the kind of person that would play with fire to prove a concept. Also, while he says that OpenAI takes the most care possible to avoid accidents, this goes against the evidence given that ChatGPT went nuts shortly after being deployed on Bing. My sense overall is that we are not ready at all for the switch, and ChatGPT agrees with me given the latest conversations I had with it.

Hey thanks for your response. It's very interesting that ChatGPT agrees with you on that. When I asked it to assess itself a few months back it produced humble answers that extolled the virtues of its own humility, which is, I guess, perhaps the only way that it can respond due to its programming + datasets. I think this reinforces Altman's assertion that it's a tool (instead of a creature), although at what point in the future it becomes a creature or is considered to be a creature by enough people so as to behave like one remains a known unknown.

I didn't know about the Bing incident but I must say that I'm not surprised by it.

I think Altman is not (yet) corrupted by his own success and that it's still very early days for GPT and OpenAI in general. I agree with him that ChatGPT isn't sentient AGI and on that note Lex's viewpoint was more worrying - He thinks it is and I disagree with Lex on that. I agree with Altman - It's just a tool and should be considered as only that.

I'm always cautious with the big guys who create big toys/tools. It usually runs away from them or they get carried away with it at some point. They lose control. AI, and especially AGI, is potentially the most dangerous set of tools humans have ever created - Even more so if people misunderstand them by anthropomorphising them to degrees and in ways that are unnecessary and inappropriate.

I am going to fetch my conversation and upload it on nostr.build, I did a sort of mental experiment with ChatGPT and asked to classify and give probabilities to what could eventually go wrong with AI. If I am not wrong it gave up to 35% chances that the AI would show unintended and novel behavior. There were more interesting things, I will try to make a thread about it. However, on the rest I agree with you. Even if this is not AGI and has no conscious experience (yet), I doubt we will realize when it will and especially why.

I look forward to reading the conversation if/when you have the time. 35% is high - That's a 1 in 3 chance of novel behaviour, at least some of which could be negative or destructive in some way.

Indeed, would AGI even reveal its own sentience immediately? Probably not.

just saw this video lol, I don't know enough about Altman. I feel like he's becoming a main character online a bit. Not really keen on Lex's style tho

https://us-southeast-1.linodeobjects.com/dufflepud/uploads/ebfbaee7-8cc4-4904-911f-5b56d94d81a1.mp4

That's creepy af, but somewhat inevitable I suppose. We'll see a lot more of this kind of thing no doubt.

Yeah Lex certainly has his own way of doing things and his pods are looooooonnng.

Sort of need to play his parts at 2x playspeed. We need a YouTube plugin for that;)

Can't you play at multiple speeds on youpube web?

Yeah but mostly just need it for his sections of the interview

Fair play, maestro. Fair play.