This struck me today when I was trying to get perplexity to read my nostr notes and analyze them. I asked it to create a lightweight client to read my notes from the Damus relay and analyze them and it was unable to do it. It just gave me code and gave me instructions on how to execute it. I asked it to execute it itself, but it refused