What if humans evolved genetic mesa-optimising traits (e.g. love / friendship / mercy) at the same pace as they evolved intelligence, but now AI intelligence growth is far outstripping any stabilising characteristics? We're on the path to an insanely intelligent entity that purely cares about one single objective such as sentence / narrative completion.

Reply to this note

Please Login to reply.

Discussion

No replies yet.