We don't really care about llms though, we care about ai.
If you give it a body to explore the world, it's architecture doesn't need to change, besides adding in the 3 laws of robotics. This increases the data it can use to train on as its sensors improve, so will it.