I have only heard of superposition in the topic of quantum mechanics.

Spooky action at a distance - Albert Einstein

Reply to this note

Please Login to reply.

Discussion

Plus one here

Same. In this case, itโ€™s the idea of neural networks taking advantage of the sparsity of the embeddings to encode more features than just the dimensionality of the vector space (the set of orthogonal vectors). I probably canโ€™t do it justice in a nostr note after a few whiskeys.

Any comment on this will make me sound stupid, so I'll refrain ๐Ÿ˜