I think the AI didn't like the use of "definitely" (or maybe that's just me, because it set my teeth on edge). That assumes the absence of any other outside factors, because lots of things could possibly happen that would have the overall result of lower wages. The question should reflect that (or maybe there's a universal rule for the test about assuming nothing else changes, which would help). Or the question should say probably, or it will cause upward pressure, etc.
I have played with this question a lot recently, and it is the "definitely" that GPT-4 gets hung up on. It will endlessly argue that there are many, many factors that could make it not happen, so you can't say "definitely". Which is fair!
If you simply change the wording to "almost certainly" then it gets the question correct with the correct reasoning.
Interestingly, a second way to make it answer True, while retaining the "definitely" wording, is to prompt is to answer "according to the principles of classical economics". This gets it to discard all these other nuances that it's worried about and just think about the supply/demand stuff.
Interesting that it got the lowest score on what was, in my opinion, the easiest question (licensing requirements & prices).
I think the AI didn't like the use of "definitely" (or maybe that's just me, because it set my teeth on edge). That assumes the absence of any other outside factors, because lots of things could possibly happen that would have the overall result of lower wages. The question should reflect that (or maybe there's a universal rule for the test about assuming nothing else changes, which would help). Or the question should say probably, or it will cause upward pressure, etc.
I have played with this question a lot recently, and it is the "definitely" that GPT-4 gets hung up on. It will endlessly argue that there are many, many factors that could make it not happen, so you can't say "definitely". Which is fair!
If you simply change the wording to "almost certainly" then it gets the question correct with the correct reasoning.
Interestingly, a second way to make it answer True, while retaining the "definitely" wording, is to prompt is to answer "according to the principles of classical economics". This gets it to discard all these other nuances that it's worried about and just think about the supply/demand stuff.