There's been examples of this from lawyers in court cases in the UK IIRC. It's rapidly becoming a problem.

I recently asked chatgpt about the history of OP_RETURN. It told me 3 distinct things, *all 3* of which were wrong, and gave me a link to a github commit that did not exist.

It's not always, or usually, shit; the problem is that is exactly equally as confident when it is shit, as when it is good. Confidence really matters to the average human (see: con-artists).