Experience Report: What Number Is This?
This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).
A software tester explores ChatGPT's behavior by asking it to identify a number in a diagram that clearly isn't a number. The experiment reveals multiple AI failure patterns including hallucination, overconfidence, and inconsistent responses. The bot incorrectly identifies a neural network diagram as the number 8, then provides contradictory explanations when challenged. This demonstrates the importance of testing AI systems with simple, unexpected inputs to uncover reliability issues before trusting them with complex tasks.
Sort: