If we imagine a future where we have great privacy in all regards and also AI becomes able to work better than humans at everything, then I think we won’t be able to resist them. Part of the hypothetical upcoming struggle between humans and AI is actually knowing somehow which is which… maybe web of trust can fix this.. but that means everyone needs to pay like 10x as much to a trusted person than an untrusted person and that seems… unlikely

Reply to this note

Please Login to reply.

Discussion

Why would AI be hostile? Are we hostile to them?

And how KYC prevent this? Actually, how it's related.

I'm sorry for dumb questions, but I really don't follow

And I'm also a cyberpunk fan :)

Not dumb. AI won’t always be hostile, the idea is that it will sometimes not care about our goals, and not caring for our goals is a competitive advantage. Some will not care and also be competitive. They will get all the resources. If we are actively struggling against one of these things, then privacy is going to be an existential problem.

if you don't kyc, there's no/limited way for any AI to know who you are. it can't take actions directly.

so no. it can't change my mind about kyc

Not sure what you mean by taking actions directly, do you mean they can’t attack you? I don’t see them attacking people individually, rather just being the better hire every time while the humans starve.

are they bothered by doing stuff instead of us? if they don't, we're free. they will do all the labor

Not, if the world stays as it is. The additional wealth won't be distributed to the people.

100% and specifically because the ones that do try to distribute will go extinct

Yeah, that's a problem I know no good solution for 🤷 There would have to be a global consensus that the wealth created by AI would have to be mostly distributed down to the people. I can't see this in our capitalistic system.

there is a difference between a world with scarce resources and witout. Like Startrek.

I'm not sure what we're talking about here.

The idea is that in a world with AI that makes human labor mostly superfluous, the people controlling most of this AI will also control most of the resources. And this might be even worse than it is right now.

I agree. Of course the universe we live in will always be a limited-resource place. 🫂

Right, and not just nation state consensus, but like, everyone consensus. Assuming AI obediently follows the person who owns the computer, then not a single person can get out of line on that consensus. If they do they will get all the resources and everyone else will starve.

And that’s assuming AI is always perfectly obedient, which I’d argue is a bad assumption.

The ones that share the fruit of their labor will not be competitive with the ones that don’t share, and so the ones that like us will go extinct.

nice. but I mean things like we can finally do a cold fusion instead of going to school

To do anything technological we need money, to get money we need to be competitive at some economic task ourselves or be liked by someone who is competitive. Since we wont be, I think we wont be doing anything with technology. Low tech hunting and gathering works for a few people of course.