In Defence of “True or False”

July 5, 2011

Hello again, and thanks for dropping by. I appear to be blogging on the theme of questions in eLearning. This month, I’ll be talking about True or False questions – and what they can – and cannot – do. If you’d prefer to see more about developing content, downloads, supporting materials, integration for blended models, etc. please do let me know. I’m on questions at the moment because they appear to be poorly represented in eLearning blogs in general. Anyway, let’s get on.

What this post is about

The use, proper and poor, of that old cherry – the True or False? question. In this post, I’ll provide some advice and strategies for using True or False questions in your eLearning project. I hope to show there is more to True or False questions than many people assume (essentially – stating bald facts or bald lies to identify whether your learners can distinguish between them); and hopefully inspire some new thinking in the use of this question type.

What it is not about

This is not a post intended to give specific true or false questions.

Here is a Summary

Here begins the post

Recently, I was discussing True or False questions- from IRL (in-real-life) tests, actually – where the person I was talking to mentioned a third person who claims:
“True or false questions are useless! All one has to do is answer true – and you will pass. Because the statements used ALWAYS tend toward truth.” 

There may well be truth in this statement (or falsity!), but it is too much to deal with in one post – there are too many issues. Here are just some:

  • What is your passing grade (that allows someone to answer “True” for every question and still pass)?
  • What is your content (that the only manner in which to phrase the questions is such that they tend toward truth)?
  • What is the context (that you are using “True or False” questions as a form of assessment)?
  • What is your goal for your learners (that “True or False” questions are being used – is there a specific reason?)?
  • What is your learner’s goal (how does the use of “True or False” questions help them to achieve their aims, by applying the knowledge they are hopefully learning from your content)?
  • How is it that all your questions actually do tend toward truth (I must admit, in developing these questions I instinctively tend toward the opposite – there is no good reason for this, perhaps I am a man of falsehoods, I know not)?
So, let’s start by taking a look at the anatomy of a True or False Question.
At its heart, a True or False question is a simple multiple choice format. There is a statement, from which the learner selects an option.
Going a little deeper, a True or False question is a statement that either reflects a true state of events, or is a bald faced lie.
That’s it. In practice, it will look like this:
Statement: Some state of existence in the world.
  • True?
  • False?
The learner reads the statement, then selects True or False as a response, to indicate whether they believe that the statement does actually reflect some state of existence in the world, or does not.
So what’s wrong with it?
In many cases, it’s seen as far too simplistic (and because it is seen as simplistic, it is used simplistically). This is often true. Here’s an example. Imagine you read the Peter and Jane story to your learner (this is a story for children, along the lines of:
This is Peter. This is Jane. Peter and Jane are at the beach. Peter and Jane will build a sandcastle. Peter has a bucket. Jane has a shovel.)
Quite often – too often – the True or false question will be used to test the learner’s ability to remember a bald fact. For example:
True or false? Peter has a shovel.
Of course, we know Peter does not have a shovel.  The learner, irritated, clicks False and if they receive feedback, it annoys them that they are being told they were right (God help us all if they were wrong), which adds a delay (read: frustration) to their learning. I know not all statements of bald fact are this easy.
However, another issue creeps in: recognition (as opposed to understanding). When you make a statement that repeats (whether exactly to elicit “True” or incorrectly to elicit “False”), you run the risk of the learner recognising the statement. This is a memory of the language – not of the actual content, or meaning. The learner will not remember the importance of Peter’s bucket – they will simply recognise that the sentence they read did not say that Peter had a shovel. This is an important distinction, because in learning, we aim for retention of knowledge and understanding – not recognition of phrasing.
So, what’s right with it?
The True or False question can be a great way of asking a learner to demonstrate their understanding of a complex situation. This may appear to be a far cry from Peter and Jane, but it applies quite well. (I use the term “complex” here to mean a series or combination of simple statements, that combine to become complex). The True or False question can be used to take disparate concepts and join them together. Some applications include:
  • Between topics within a learning unit
  • As a pre-test to determine whether a learner can connect two objectives (i.e. apply knowledge they should have in a relevant context)
  • After a complex topic (i.e. where several concepts have been discussed) to determine whether a learner can put the concepts together, and understand their outcome
(This really is, just a few. There are many more applications, which I would tease out if there were a book as opposed to a blog to be written).
So what do these options mean in real life? 
Between topics within a unit – as part of a quiz, the True or False question can be used to link some concept in the previous topic to a concept in the next topic (e.g. In the last topic, we learned that Peter had a bucket and Jane had a shovel. We might also have learned that they intend to build a sandcastle – the mechanics of which will be dealt with in the next topic. So we might ask: True or False? A typical sandcastle cannot be built using a bucket and shovel.). If you’re using a True or False question in this way, it cannot be an assessment item. You can’t assess someone based on such a question without  presenting the information first, it’s simply not fair. However, if you aren’t assessing learners, this is an excellent way to focus their attention on what is coming next and to identify the key information from the previous topic that will be employed in the next topic.  Furthermore, if you are using feedback immediately after the question, it can be used as a learning event in itself (if you are comfortable with this, and your course is organised in such a way as to allow the learner to learn from the feedback). In short, you can ask about two disparate concepts, and use the feedback to demonstrate to the learner how they are connected. A note of caution – be careful with this approach. The learner should – based on the preceding content  – have some idea of the connection between the concepts. If something new is introduced out of the blue, the learner will lose faith in you. However, if the concepts have been dealt with thoroughly, a True or False question that challenges learners to connect them can be really useful in focusing their attention or making them think about the concepts in a new way.
As a pre-test, True or False questions can be used in a similar fashion -by asking about 2 seemingly disparate aspects to a complex procedure or body of knowledge to see if learners can connect them. For example: True or False? If Peter uses a shovel and Jane uses a bucket, they can build a sandcastle. In this example, it is true. We know from the story that this isn’t the way things worked out – but the learner should be able to extrapolate from the 2 actors and the 2 tools, the outcome should be achievable. This has been simplified – it’s not always the case that the statement will be true (see my final advice), but in this specific context, we are on safe ground. However, if one were training in health and safety, it might be the case that Peter and Jane need certificates to use the equipment they have. In such a situation, the very same question could be false – because only Peter has the certificate for use of a bucket and only Jane has the certificate for use of the shovel. Suddenly, something very simple has become quite complex in itself.
This leads me to the third point – the use of True or False questions after a complex subject, the use of True or False questions can be really effective. To build them, you need to phrase the statement very carefully, then ask whether it is true or false. Taking our previous example:
True or False? If Peter uses the bucket and Jane uses another bucket, they can build a sandcastle without a shovel at all.
Well, is this true or false? If we have only stated the facts as listed above, we cannot mark a learner down for saying it is false. All they know is that Peter and Jane have a bucket and a shovel and with these tools, they will build a sandcastle.
However, we may have explained the purpose of the bucket and shovel- to collect (shovel) and hold (bucket) sand. We may have gone further and explained the characteristics of a bucket and shovel, which means the learner should be able to identify that one bucket can be used to pick up sand – and the other can be used to hold it. If the learner is expected to be at a level whereby they can understand all this – then they should get this question right. We are testing their ability to recognise that one of the buckets can be used as a shovel, because it has characteristics that allow this. To get even more subtle – if the only way to build a sandcastle was to use a bucket and upend it into the sand – then the vice versa case is false – we cannot use 2 shovels to build a sandcastle, because a shovel (by its characteristics) cannot collect the amount of sand we require to be upended to create our sandcastle.
I hope these examples have provided some food for thought, and will extend the use of the True or False question type.
Some Final Advice/Thoughts. When using True or False questions:
The statement you write should contain all the information they need to answer true or false – based on their defined level of expertise and experience. As you may – or may not – have noticed, I hate “trick” questions. The truth (or falsity) of the statement you make should rely on itself alone.  You must remove all possibility where a learner thinks “Well, in this context, it might be true, but in general it is false”. The learner is attending to the question, and so must be able to answer the question based on the merits of the question provided (this may not be the case with all question types – but with True or False, I believe it is the case)
Your statement must be quite finely honed.  As an extension of the above – you must be careful to remove all uncertainty to the statement you make. Ensuring this will usually require a second pair of eyes to make sure there is nothing in your statement that might confuse them. This is really an issue for the editorial process, but it is important to point out.
Mix it up. Some statements are true, some are false. So, make some of your own statements false. My experience would echo the statement at the start of this post – that most True or False questions tend toward truth. However, if you do decide to tend toward false:
Don’t play with complex constructions that make the statement false (i.e. double, triple, negative falsehoods)
Don’t go with simple, bald false statements (see the earlier point about recognition vs understanding)
Make sure the false statement appears to be likely, but don’t try to trick the learner in this regard. Questions can be aloof from the learner and the general content;  a True or False question needn’t attempt to ‘catch a learner out’ by being especially inviting in any way. Remember – you have taught the content – the question can now be used to connect, combine or otherwise construct knowledge based on the individual parts.
If you use feedback – immediate feedback – True or False questions can be an opportune way to tease out differences. For example, if you have covered two disparate concepts that can be brought together in one True or False question, the feedback to the question can be used to provide further insight (the method or other technologies that Peter and Jane could use to build a sandcastle; how sandcastles can be seen as a metaphor for something else; etc.)
Here ends the post.
Thanks for reading. Please do leave a comment or email me if you’d like to talk about this more.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: