I am hearing lots of people saying that we are hitting a plateau with LLMs. They keep getting better but their pace has significantly slowed down to the point that they might never actually fulfill the level of "intelligence" people are expecting. Thoughts?
Discussion
in terms of intelligence, they are still improving imo, they won a silver medal in math olympics..
but focusing on intelligence is a scam. math is not their actual strength imo. they are more like language masters. many people asked if 3.9 or 3.11 is bigger and LLMs responded as 3.11 is bigger, thinking it as if something like a version or chapter in a book maybe.
but for sure some are going for ASI. installing many 'logic' into it thinking some day it will start to reason like a human. and that is scary to some. conscious people has to build alternatives.
what i mean by scam is those benchmarks that make you focus on skills are missing the misinformation that are pushed behind the scenes. that is actual battle area and imo more scary than ASI because it is hurting today.