That shit will end us

Can’t it though given an initial seed?

I guess because its knowledge cannot make him smarter, it needs extra external information. It does not get this from prompts I believe:

Only during the "training phase" an AI learns something I think. Although it could be that the AI sends all the prompts back to the host servers where the devs incorborate those into the training or another kind of database. But an AI asking itself things does not give him extra information.

It doesn’t have any Will

It can. Have a look at Autogpt.