I'm skeptical of any claims that these models are entirely misunderstood creations that just do things willy nilly with not a single company or developer having some idea that something is fishy. I understand the whole black box theory, but I'm just saying I'm skeptical of it. There is truth to it, but it's also a super easy scapegoat for shenanigans.
Discussion
And at the very least the tools should tell users explicitly that what theyre being told could be completely false. But that doesn't look as good so that isnt the case for any I've used. My first instinct would be to wonder what the fucking point is. And that IS what people should know. You have to verify sources. Most people won't and it will have massive consequences. I've already seen people IRL settle debates with these tools as if they are stone cold fact. That's wild knowing what I know.