13 October 2022

How open should a question be?

People often say or imply that when teaching mathematics 'open questions' are simply better than 'closed questions'. Instead of asking students a closed question like “What is $3 \times 4$?”, which has only one right answer, it is supposed to be better to ask them to “Tell me some products that make 12”, because this more open question has multiple possible correct answers. The more possible correct answers there are, the more ways there are for students to be right, and that feels more positive and inclusive. Open questions promote students’ creativity and individuality. But is it as simple as 'the more open the better'? Should we be sorry whenever we use a closed question?

Any question can always be made more open, but is that always an improvement? In the “Tell me some products that make 12” question above, why specify ‘products’? Instead, we could say “Tell me some calculations that make 12”, and that would be even more open. Or we could go even further and say “The answer is 12, what could the question be?” (see Ball & Ball, 2011, p. 20, for the '42' version of this). Perhaps the ultimate open question would be something like “Make up a question and an answer of your own choosing.” Is that the best possible question of all?

It seems to me that these questions can’t simply be getting better and better the more open we make them. Whether these questions are good or bad must surely depend on the teacher’s purposes in asking them. Let’s think about these questions in turn and how they might be more or less useful for different purposes.

1. Tell me some products that make 12.

This could be a nice way to start thinking about factor pairs. One student says “$3 \times 4$”; another says “$6 \times 2$”. Perhaps, after a slightly longer pause, another student says “$1 \times 12$”. Now what do you do? If you continue to wait, then, after perhaps an even longer pause, you may be offered things like “$4 \times 3$” or “$24 \times \frac{1}{2}$” or even “$(-6) \times (-2)$” or perhaps (possibly?) “$n \times \frac{12}{n}$”. Is any of that helpful? I think it depends on your didactical purposes. Answers like these could lead to drawing rectangles of equal area (12) but different semi-perimeters, and explorations into equable rectangles (see Foster, 2021), and perhaps even aligning all these rectangles on a grid, with a common vertex at (0, 0), to create points at the diagonally-opposite vertex that lie on the curve $y=\frac{12}{x}$.

But, if you are defining factors as positive integers (so 3 is a factor of 12, but $\frac{2}{3}$ isn't), then most of these pairs are going to end up being non-examples of that, and we have drifted from the original purpose of thinking about factor pairs. Non-examples can be really important for nailing down what something is, but if you want to think about factors then we need to be working on the positive integers. So, although opening things up can feel accepting and positive, it can also be confusing for students and distracting from your intentions. If you want to focus on factors, maybe there is nothing wrong with being upfront about this, and saying what you mean by ‘factor’. Then you can ask, “Tell me a factor of 12”, and then ask for another one, and another one, and you still have multiple possible right answers - but this time there is a finite number of them. This means that, additionally, you can work on trying to justify how we can be sure that we’ve got them all. Being less inclusive about possible allowed numbers shuts down some possibilities (we can no longer have $-6$ or $\frac{1}{2}$) but opens up others: Now we can ask "Could there be any more? How can you be sure?" So, 'less open' doesn't necessarily mean fewer possibilities - it's just different.

2. Tell me some calculations that make 12.

With this question, asking for ‘calculations’ enormously broadens out the possibilities that students could offer. Is that a good thing or a bad thing? If your learners are lower primary, they might be highly likely to offer additions and subtractions, and this could be a useful way in to number bonds to 12. Even with secondary-age students, simple responses like $10 + 2$ could lead you to explore the partitions of 12; i.e., How many ways are there of making 12 from summing positive integers? There are lots of interesting things to explore here. The total of 12 can be made by summing pairs of positive integers in 6 ways ($1+11$, $2+10$, $3+9$, $4+8$, $5+7$ and $6+6$) and by summing three positive integers at a time in 12 ways ($1+1+10$, $1+2+9$, ...). But how does this pattern continue - and what happens with other numbers than 12? (See Foster, 2011, pp. 110-112, for the details.)

But, if this is where you want to be heading, it might be preferable to ask a more closed question like "How can you express 12 as a sum of positive integers?" Otherwise, you might end up with things like $\frac{120}{10}$ or $2 \times 2 \times 3$ or $1+2 \times 4 + 3$ or $\sqrt{144}$, which could take you in all sorts of other directions (e.g., decimals, fractions, prime factorisation, priority of operations, powers). I have often seen teachers ask very open questions, even though they have something quite specific in mind. Whatever the students respond with, they praise it and write it up on the board - but actions speak louder than the board pen, and the students are watching to see what the teacher is eventually going to do. No matter how much the teacher says, "These are all great ideas ...", the students know that they should ignore everything before the 'but', and so "... but today we're going to focus on..." is the point at which the teacher appears to come clean about what they really wanted right from the beginning. The person who said $10 + 2$ was 'right' and everyone else was 'nice try'.

So, I'm not convinced that open questions that lead to lots of possibilities are really all that inclusive if the teacher's response to all of the ideas except one is just to write it on the board and ignore it. But what is the alternative if you are using hyper-open questions? Allowing different students to work on totally different '12'-related problems splits the class into groups doing mathematics that may be as unrelated to each other as it is to the work being done by the students in the classroom down the corridor. And it can be hard to ensure that everyone has a suitably accessible and worthwhile challenge that will lead to learning something useful. The possibilities for sharing and building on each other's contributions later are quite limited if all that the different tasks have in common is that they have something to do with the number 12.

So, for me, prompt #2, although undeniably more 'open' than prompt #1, is more likely to close down the possibilities for purposeful sense-making of mathematics. Whereas adding constraints to #2, such as "It must include a cube root", or, for sixth formers, "It must include a logarithm", or "It must include an imaginary number", might make this more interesting and purposeful, depending on the teacher's intentions. Provided that there aren't too many, constraints often lead to creativity, whereas total freedom may not inspire anything.

3. The answer is 12, what could the question be?

Now we have broadened out beyond even ‘calculations’. Students might say “What is the order of rotational symmetry of a dodecagon?” or “What is the maximum total you can get with two ordinary dice?” or “How many millimetres are there in 1.2 cm?” This might feel like a nice creative task for getting students to reflect on different ways in which 12 can appear in mathematics, but you could end up with quite a few less-mathematical responses, or low-level mathematical responses, like “What number bus goes to the sports centre?” or “How old is Amit’s sister?” or "What are the last two digits of the school phone number?" or "How many days of Christmas are there in the song?" (see https://en.wikipedia.org/wiki/12_(number) for all things 'twelve'). By the time we reach a question as open as #3, we have really abdicated all responsibility for setting the direction of travel of the lesson, and ‘anything goes’ now. I guess I could maybe imagine asking this question as a lesson 'filler', or as a revision task: "Make up a question on each topic we've studied this term - and make all the answers '12'." But I don't think I could use this task to introduce anything new or focused on any particular content area, as it is too hard to predict what might happen with it. But maybe others are more expert at doing this than I am?

More 'mathematical' can mean more closed

Tony Gardiner (n.d., p. 31) has written that ‘While there are exceptions, it is generally true to say that good problems in school mathematics are almost never open-ended!" He advocates open-middled problems, where there is a closed start and end but multiple possible routes through. I think that teachers worry about using closed questions because they think they are too straightforward. But it is a big mistake to think that closed questions are likely to be simple or trivial. Most of the famous hard unsolved problems in mathematics are closed - even binary yes/no (e.g., Is the Riemann hypothesis true?) (see Foster, 2015).

Often we can make an open question more challenging by closing it, and that's usually a highly mathematical thing to do. The question we considered above, "Tell me a factor of 12", is open, but this should naturally lead to the desire to find them all by closing the question to: "What are the factors of 12?" This is now closed, because there is only one right answer (i.e., 1, 2, 3, 4, 6, 12). In a sense, giving just 5 of these is not $\frac{5}{6}$ correct, but wrong. This is not 'multiple answers' any more, because the question asks for all of them. It is as closed as the question "How many factors does 12 have?" (Answer: 6). Similarly, the closed question "Solve $x^2=9$" has one right answer, consisting of the two solutions $x=-3$ or $3$, whereas the open question "Find any solution to $x^2=9$" has two possible right answers, $x=-3$ or $x=3$. This may seem like splitting hairs, but the closed question is far more powerful - and mathematical - because we not only find all of the solutions but we know that there can't be any more, so we are finished and have complete knowledge of the situation (see Foster, 2022).

Thinking in this way, many of the open questions used in school can be viewed as merely poorly-specified or incomplete closed questions. As an example, consider the question: "I'm thinking of two numbers. Their sum is 12. What are the numbers?" We could respond "Impossible - insufficient information!", or we could give a few example pairs (which are effectively of the form "If one number is this, then the other number would be that"). Or we could plot all possible example pairs on the line $x+y=12$, which feels like as complete an answer as is possible. But is it that the question is open or merely that the (single) answer to this closed question happens to be an infinite solution set? (Note 1)

A more clear-cut example might be: "A number rounded to 1 decimal place is 3.1. What might the number have been?" This is open, and, again, in this case, there are infinitely many possible answers. The corresponding closed question would be "Which numbers round to 3.1 to 1 decimal place?", and here the answer would be all $x$ in the interval $3.05 \le x < 3.15$. There's a sense in which this is 'the complete answer'. But, I think it doesn't quite capture everything that might emerge from the open question. For example, someone might respond to the open version by saying $\pi$, and, although that is of course included in the range specified in the closed version, I might not have explicitly considered $\pi$ (or even the possibility of any irrational numbers) when writing down the 'complete' answer. The double inequality expresses the whole range of possibilities without necessarily examining it in detail.

To me there is certainly an important difference between a closed question like "Which numbers round to 3.1 to 1 decimal place?" and a closed question like "What is 3.08 rounded to 1 decimal place?", but the difference isn't about open/closed, as, for me, both are equally closed. The difference here is that the first question is an inverse question, and inverse questions are always harder and more interesting than direct questions (e.g., factorising versus multiplying, square rooting versus squaring, integrating versus differentiating).

Open questions are often essentially 'Give me an example of...', example-generation questions (see Watson & Mason, 2006), and I think these are extremely valuable when used to complement closed 'Characterise all the possibilities' kinds of questions. We need both. But making open questions more closed can be just as valuable mathematically and didactically as making closed questions more open.

Questions to reflect on

1. What do you think about the value of 'open' questions? When do you use them or avoid them? Why?

2. When is it good to be more open? When is it good to be more closed?


1. I guess one way to treat this as open would be to offer multiple ways of specifying the solution set (e.g., $2x+2y=24$, $y=12-x$, $x+y-12=0$, $y=-x+12$, $\frac{x+y}{2}=6$, etc.)


Ball, B. & Ball, D. (2011). Rich task maths 1. Association of Teachers of Mathematics. 

Foster, C. (2011). Resources for teaching mathematics 11–14. London: Continuum.

Foster, C. (2015). Fitting shapes inside shapes: Closed but provocative questions. Mathematics in School, 44(2), 12–14. https://www.foster77.co.uk/Foster,%20Mathematics%20In%20School,%20Fitting%20shapes%20inside%20shapes.pdf

Foster, C. (2021). Area and perimeter. Teach Secondary, 10(6), 13. https://www.foster77.co.uk/Foster,%20Teach%20Secondary,%20Area%20and%20perimeter.pdf

Foster, C. (2022). Starting with completing the square. Mathematics in School.

Gardiner, T. (n.d.). Beyond the soup kitchen: Thoughts on revising the Mathematics “Strategies/Frameworks” for England. https://www.cimt.org.uk/journal/gardiner.pdf

Watson, A., & Mason, J. (2006). Mathematics as a constructive activity: Learners generating examples. Routledge.

No comments:

Post a Comment

Teaching specific tactics for problem solving

This is my final blogpost, as my year as President of the Mathematical Association draws to a close, so I've allowed myself to go on at ...