One way I think about it is akin to Russian roulette: 1/6 chance you die. Not a big chance. Most likely you won't. Overwhelmingly likely you won't. Therefore, just go for it. Right?
Discussion
Where did you get the 1/6 odds?
I was referring to playing Russian Roulette, usually done with a revolver that holds 6 bullets. What the exact odds are for AI disaster, I do not know. But even if the odds are small, it's still a big deal.
AI just seems like it will never be anything more than an NPC. A really smart NPC sure but nothing more. It's so obviously unaware of what it is doing when I use it.
A baby is pretty NPC ish. A half-built car doesn't drive. Things that are developing don't stay the same forever.
But you can see the potential for intelligence in a young child. These AI models have tons and tons of information but still don’t show any comprehension. By the way, what they are calling AI today would not be considered AI by early theorists of AI. They criticized people who tried to claim that just because this machine had a lot of information, doesn’t mean it is conscious or aware. Them calling it AI despite it not actually being self aware is an admission of defeat imo. I think for a while people said that “thank you” and “please” are bad to say to AI lol I guess it could be because if you give it the option to say yes or no then it doesn’t know what to do.