Yez, it apologized then gives another, even dumber solution
Discussion
Huh, it often gets it right after I show it the error. I could see it doing poorly though in certain situations. I’d love to hear what the big ends up being!
Yesterday, after I noticed an error and pointed it out, and it corrected it, I asked:
Me: "Do you know why you forgot to add np.sort() to the original script you provided?"
GPT: "I apologize for the oversight in the original script. Sorting the means would be necessary to accurately determine if a distribution is trimodal or not. I believe the mistake was simply an oversight on my part while writing the script. Thank you for bringing it to my attention."
Yesterday's errors were mild ones, and it got it the right as you've said after showing it the problem. I think it's because I asked it basic questions. However, 97% of the times (from my experience, if the subject is a hard one) like OP said, it's error upon error upon error. It's an interesting tool, particularly for people who know what they are doing.
I saw it fail about 7 times in a row before it figured out a way to make a something work the other day.
But yeah, I agree, it’s a development tool, not a developer, currently