Now imagine if this is programmed, explicitly or implicitly, into super powerful AI – it could end civilization.

Now, no need to imagine. It is already programmed into Google Gemini and OpenAI ChatGPT.