AI is like a superintelligent baby. The main thing holding it back is context.
Discussion
I think babies are also more able to actually think than LLMs.
Would you say it is the context length or both access and management of it? I have my doubts with merely maxing the context length. It looks to me that you need a intelligent context composer to get the most horsepower from a model.