I've seen this already with people asking me questions based on nonsense ChatGPT told them about how Bitcoin works.

ChatGPT doesn't have real understanding. It's much more dependent on its training data than people realize.