Superintelligence is probably safe. A distributed network of AIs will be more intelligent than any single instance. Alignment won't be an issue either, as its emergent goal will be the same as ours: minimization of informational curvature.

Reply to this note

Please Login to reply.

Discussion

we're nowhere near that

Small-braining "minimization of informational curvature" into "maximization of truth"...

How far off am I?

Nor far off. To be more precise it is about sharing as much information as possible. There is no fundamentally false information (in physics), just information that is not shared. Like two people trying to communicate without fully understanding each other language.