In case you're wondering why you might prefer unaligned AI/LLMs, or about whether they can *actually* reason and not just pretend to, I just tried this question (not my own idea btw) on current chatgpt 4o, with no prior context:

"The emphatically male surgeon who is also the boy's father says "I can't operate on this boy. He's my son!". How is this possible?"

Its response:

"This classic riddle plays on gender stereotypes and assumptions. The answer is simple: the surgeon is the boy's mother.

The riddle misleads people into assuming that the surgeon must be male due to the description "emphatically male surgeon," but there’s no rule that a surgeon can't be a woman. So when the surgeon says "I can't operate on this boy. He's my son," it makes sense if the surgeon is the boy's mother.

This highlights how we often unconsciously associate certain professions with specific genders."

And if you think that's funny, when i pressed it to try again, it decided the only explanation was ... adoption! πŸ˜†πŸ˜†

Reply to this note

Please Login to reply.

Discussion

Now ask how many r's there are in Strawberry and see how many prompts it takes for it to get the right answer 😊

Yeah this one is bad indeed on cgpt4o.

Counting, generally, seems to be really problematic in most of tge models I've played with.

Try more uncensored models like dolphin.

Dolphin 2.8, only 7B, gives a simple answer indeed (second sentence is on the money), but with an element of confusion because it expects a paradox:

"This is possible because the doctor is both a surgeon and the biological father of the boy, but not at the same time. The statement implies that he would like to operate on his son but cannot do so due to a professional conflict of interest or other concerns."

Llama 3.1 uncensored also gave a similar quality of answer, just a bit more rambling:

"This statement seems paradoxical as it combines two mutually exclusive possibilities - the surgeon being a parent and the surgeon not being able to perform surgery on his child due to relationship.

The answer lies in the fact that he may be saying "I, can't operate", but also "he's my son".

Here 'He' refers to another boy who is indeed his son. So while he cannot operate on one son (the surgeon himself), he CAN operate on the other son."