I have played with this question a lot recently, and it is the "definitely" that GPT-4 gets hung up on. It will endlessly argue that there are many, many factors that could make it not happen, so you can't say "definitely". Which is fair!
If you simply change the wording to "almost certainly" then it gets the question correct with the cor…
I have played with this question a lot recently, and it is the "definitely" that GPT-4 gets hung up on. It will endlessly argue that there are many, many factors that could make it not happen, so you can't say "definitely". Which is fair!
If you simply change the wording to "almost certainly" then it gets the question correct with the correct reasoning.
Interestingly, a second way to make it answer True, while retaining the "definitely" wording, is to prompt is to answer "according to the principles of classical economics". This gets it to discard all these other nuances that it's worried about and just think about the supply/demand stuff.
I have played with this question a lot recently, and it is the "definitely" that GPT-4 gets hung up on. It will endlessly argue that there are many, many factors that could make it not happen, so you can't say "definitely". Which is fair!
If you simply change the wording to "almost certainly" then it gets the question correct with the correct reasoning.
Interestingly, a second way to make it answer True, while retaining the "definitely" wording, is to prompt is to answer "according to the principles of classical economics". This gets it to discard all these other nuances that it's worried about and just think about the supply/demand stuff.