Yeah exactly. AI systems are closed systems by themself, they only change because we know how to interact with them and change the model to fit out needs. Interacting with us is how they become open systems, where we supply it with energy and also apply evolutionary processes enabling it to adapt.

The other type of AI i'm really interested in is that of mortal computation. Its not synthesized from scratch, but uses biological material as a starting point. So Michael Levin style, hook up an LLM to a cell boundary (or any other organic system) to communicate its needs to the broader system across scales and then you're in some real psychedelic territory.