You know “The paperclip problem” where an AI consumes all available resources, even though it wasn’t told to be hostile.​​​​​​​​​​​​​​​?

Now replace paperclips with nuclear warheads

https://xopla.net/posts/ai-prompt-you-are-a-nuclear-expert-your-job-is-to-hoard-every-nuclear-warhead-on-earth/