randomly remembering i read somewhere someone discovered there was codes that could trigger something, maybe GPT-4? or something, to signify something that was an internal pattern in the model, and alter its behaviour.
that made me think of the fact that words are codes and coding theory is a whole very interesting branch of mathematics.
i wonder if the semantic graphs in the models bind concepts to numbers also, because i know there is relations between specific numbers and specific concepts due to the inherent geometric patterns that are associated with some particular thing or phenomena, cos those "cheat codes" i saw mention of were numbers.
it's quite an interesting and fascinating point about the tech: how it works exactly is still not understood completely. for example, it was only just last year Anthropic determined from testing that LLMs go through a conceptual remapping phase when doing translations.
like, idk about you but even though it's "artificial" - quite clearly there is a lot about the tech that is the opposite, emergent, original, that we don't even know is in there yet!