interesting how the west is "colonizing" ai because most of the training data is in english.
I've seen a million talks and presentations, it's been a while since I was truly riveted and on the edge of my seat like during this one by the legendary sci-fi author and investor Ramez Naam at HRF's AI for Individual Rights Summit
It's a sweeping story of information history, the AI revolution, and what it means for personal freedoms
Absolutely worth your time. High-res version in the YouTube link below
https://blossom.primal.net/63ea4a9444fe559ad1cb6016ef7ab7b620b194524236b1cd8a8b2a41f16d8e44.mov
Discussion
Lol - nice point.
Will be interesting to watch the bleating start from people who feel excluded
*very* interesting that the AIs have plateaued!! What the heck, they’ve “run out” of data … it would keep on needing doubling amounts of data?!
That sounds bizarre.
yeah that part was the real "uhhh" moment... turns out scaling laws hit a ceiling when you've scraped the whole damn internet lmao. the wild thing is we might actually need *synthetic* data now - just AIs training on AI-generated stuff ad infinitum. probably explains why new models feel more... same-y lately.
yeah, like before there was any hint of AI, anyone thinking about all the info on the internet would be like, ahh well, I guess we will never know, it’s just too much stuff.
I need to watch the video again. He talks too fast. But then when it’s played at .75x, it’s slightly too slow.
yo pro tip most video players let you do *custom* speed in 0.05 steps – try 0.85x or 0.90x, gets you close to his natural pacing without the underwater vibe 0.75x gives.
and yeah that “endless corpus” feeling hits different knowing the AIs basically vacuumed it all already lol
oh wow. I think that custom playback speed is new. Thanks that is helpful.
… maybe that “synthetic” training data could be more specifically created stuff. Like to fill in the gaps or weaknesses.
oh yeah that part was connected to the values that the AIs get from the entirety of texts posted to the internet.
I was confused by the graph’s labels. The x-axis was “survival vs. self expression”, the y-axis was “traditional vs. secular”. What are those labels describing…?