For me, the bigger issue here is the absolute blind trust being given to the AI Overlords already. I see BIG issues happening as models are retrained yet people still have that unwavering trust.

Think back to SEO (Search Engine Optimization for non nerds) and how search algos were gamed over time. If you don't think external parties will find ways to influence models, well...

"Used improperly, technologies can and do result in the deterioration of cognitive faculties that ought to be preserved," the researchers wrote in the paper. "A key irony of automation is that by mechanising routine tasks and leaving exception-handling to the human user, you deprive the user of the routine opportunities to practice their judgement and strengthen their cognitive musculature, leaving them atrophied and unprepared when the exceptions do arise."