In the U.S., 26 percent of all adults have some type of disability and 14 percent of public school students received special education services under the Individuals with Disabilities Education Act. And 21.9 percent of U.S. residents speak a language other than English at home, which may pose a challenge to some taking tests in English.
Add to these inclusivity challenges those in different cultures and geographies and for those who find it difficult to study at home due to lack of devices, connectivity and/or space and you can see that inclusivity is much more than a few “corner” cases.
The inclusivity challenge
When you look at the results of school leaving exams or admission exams for young people, there is a consistent theme. Results and scores often favor those in cities over rural areas, often favor people with family or parental wealth, and often dis-favor people born outside the country where exams are run.
This issue is controversial in the U.S. in relation to the SAT and ACT tests used for university admission, but it also applies in many other countries.
There is an argument that tests just measure how things are and that the main issue is the quality of education. However, most accept that we need to improve education but also need to work hard to make sure tests and exams are fully inclusive.
The digital education promise
The promise of digital education and assessment is that it can provide good quality education for all. It can support the work that teachers do and amplify, personalize, and extend it so that all learners can reach their potential.
Many of us working in digital education are doing so because of that promise. A key reason I founded Questionmark was to bring the benefits of computers to education, and Gavin and Mark Lynch founded Learnosity for similar reasons.
Computerized assessment has a huge role to play in digital education—in fact digital education is probably only possible with effective assessment. The most critical role is that it gives the data to allow improvement of learning. You can only manage what you can measure.
If you’re interested in learning more about this, take a look at the World Bank’s 2018 report “Learning to Realize Education’s Promise”. One of its key recommendations is to “Assess learning to make it a serious goal”. The report suggests there is a huge risk of “schooling without learning”—that is, time spent learning without achieving useful skills. Assessment gives the data to teachers, learners, parents, and managers to measure learning and allow improvement of education and learning.
Assessment also does much more. By giving retrieval practice, it helps learners retain knowledge and reduces learning loss. Among other benefits, it also motivates learning and accredits what people have learned.
If education itself is to be inclusive and a driver of equity, then so must assessment technology.
What does inclusivity mean in digital assessment?
Fairness and inclusivity does not come automatically with digital assessment—you need to work for it.
Accessibility is a core focus at Learnosity. The team works hard to not only ensure that assessment software is compliant with accessibility standards, but also that it’s practically usable. So, for example, a learner who has their own familiar screen reader can use it directly and doesn’t have to use a strange one. Gavin likes to say “accessibility isn’t hard … it’s really hard”. I know from long experience that he’s right. Since joining Learnosity, I’ve seen some of our activity around accessibility and it’s impressive. For example, if any accessibility bug is raised there is a team of people at hand to quickly react to it.
Another important area for inclusivity is device support. Not everyone has a modern device. Not everyone has reliable Internet connectivity at home. It’s important that software supports a wide range of devices and has approaches like offline assessment delivery or paper options to cope with such challenges. It is important that digital learning and assessment are accessible to resource-poor learners.
There are lots of other areas where you need to work on inclusivity in assessments: support for different languages, avoiding cultural bias, dealing with people who suffer from “test anxiety”, making sure that proctoring respects privacy, and much more. Inclusivity is a journey, not a destination.
Aiming higher in assessment
In our presentation, we encouraged everyone to think more about inclusivity in assessment. If you are an end user of assessment, then we encourage you to demand that your suppliers invest in accessibility and inclusivity. And if you are a vendor yourself, we encourage you to aim for the very best.
If you’re interested in seeing our full presentation, you can check it out here.
John Kleeman is founder of Questionmark. Following Learnosity’s acquisition of Questionmark, he joined the Learnosity team as EVP Industry Relations and Business Development.