As anyone who has been to iQ Trivia would know, every quiz has a homework question. It’s something easy to find, unambiguous, but something you wouldn’t likely know unless you looked it up.
The idea, naturally, is that you are expected to look it up and given an advantage for being on our mailing list. And for the most part it works just fine.
Once in a while people acting in good faith wind up getting the homework question wrong, and if that happens at a significant scale we will generally change the homework question. Even if the question is right, we don’t want people to have to research it in great depth or fact check or be caught out by the first source that they find.
But now AI is emerging as a tool being used by more and more people, and some people are asking AI chatbots the homework question, and then complaining that they got the homework question wrong.
So now we’ve had to issue this advisory.
DO NOT USE AI ON THE HOMEWORK QUESTION.
Not because it’s cheating. It’s not. And you are supposed to look up the homework question.
But AI frequently gets things wrong.
As an example, last week we tested the homework question at one of our quizzes on an AI chatbot, asking it what four teams won the Stanley Cup in the 1980s. You can look that up yourself and you should find the answer quite easily on Wikipedia or on a number of other sources.
But the chatbot came back with an interesting answer.

And then followed up with a pretty firm statement that was demonstrably false.

(When asked a follow up question about the Calgary Flames who won in 1989 and which one of our hosts is old enough to distinctly remember, it went on to say that the Flames did not win in the 80s, and that their only win was in 1989. But anyone who didn’t know that may have taken the initial statement at face value and lost out on a point.)
The homework question isn’t meant to be hard to research. If it is, we will generally change it.
Now we don’t know the ins and outs of how AI works or why it makes mistakes. We once tried using AI to write trivia questions and they were a combination of about 1/4th straight up factually inaccurate, and the remainder overwhelmingly questions that are technically correct, but extremely dull. That’s not what we aim to do, so we’re not going to use AI in putting together quizzes.
And you shouldn’t use AI in doing your homework.
Have an interesting week.