I am trying to come up with basic math problems ChatGPT cannot solve, and so far I have been unable to.
Here are the questions I asked it, all of which were written by me: It got all of them right. Only for the first one it didn't give the answer I was looking for right away, but there was some ambiguity in my question, and after being more clear it gave the answer I was looking for. Is anyone here able to come up with a simple math problem that would be easy for a human to solve but which ChatGPT4 gets wrong? |
Administrator
|
me:
You have 3 glasses, 2 small and 1 big. The small ones have water and the big one doesn't. Then you pour the water from the small glasses into the big glass. How many glasses of water do you have now? ChatGPT: After pouring the water from the two small glasses into the big glass, you will still have 3 glasses, but now the big glass will have water in it, and the two small glasses will be empty. So, you will have 3 glasses of water in total. |
Did you use ChatGPT 3 or 4?
This is the answer it gave when I asked it the same question, using ChatGPT4:
|
I found a problem it consistently gets wrong:
"A draw contains an unsorted collection of black, navy, white, and brown coloured socks. If socks are taken at random, one at a time, what is the minimum number which must be taken to be certain of finding five matching pairs?" https://mathschallenge.net/view/unsorted_socks It gives a different wrong answer every time. But it gives its reasoning which is almost correct, it just contains a few stupid non sequiturs in some of its steps, which result in a wrong answer. I find it horrifying that it is this hard to find a problem it gives a wrong answer to. And I wouldn't call this problem "easy" for the average person to solve. |
Free forum by Nabble | Edit this page |