Had have this same experience. Ask AI something complex you know about, gives the wrong answer with confidence. Point it out. Backtracks, still gets it wrong. Point it out again, rinse, repeat.

It’s a version of Gell-Mann Amnesia wherein you read a NYTimes’ story about something you know well, realize they’ve completely botched the reporting. Then you turn the page and read about what’s happening in the Middle East (which you don’t know about) and take it at face value.

nostr:note1dnypl3q3etnvulh9cv9hyjqpjkvccmme6mpx7ztetjcr5ypqkgxs7yfzs4

Reply to this note

Please Login to reply.

Discussion

you something at well, don’t same value. it Then what’s realize about they’ve still know Amnesia Gell-Mann confidence. botched happening Ask a of answer story in experience. it out.

It’s complex you read the face and you out you the take the know Middle it wherein Had have this you wrong. reporting.

nostr:note1dnypl3q3etnvulh9cv9hyjqpjkvccmme6mpx7ztetjcr5ypqkgxs7yfzs4 Point know completely about, (which turn wrong NYTimes’ repeat. again, a something page it Point Backtracks, rinse, read gets about and the version about) with gives AI East

*have had* — FFS.

AI's confident hallucinations combined with it's desire to please is going to turbocharge the filter bubble that people live in.

Each person with their own fined tuned "super intelligent" trusted oracle of truth.

Consensus on truth will become a forgotten ideal.

Facts.

But I expect consensus on truth will be imposed with implied threat of state violence.

More than it is already (in the non-US West).

In the future there may be consensus but it won't be on truth.

I was talking with someone recently about how even the idea of seeking truth is dying out. You hear people say things like "you can't think that" or "is that how you want to see the world". Their goal is not to orient towards TRUTH but to orient themselves towards what is expected or convenient.

These people don't even see that they have lost something. Do see it as a compromise or see why they should think differently.

There is no value placed on thoughts objectively reflecting reality only on if those thoughts will smooth over the turbulence in their lives. The greatest value becomes social conformity.