Exams

Next year’s exams could be statistically contentious if we don’t act now

11 Aug 2021, 14:02

The DfE will refund schools for exam fees and costs.

Clear conversations about next year’s exams are needed right away, writes Sharon Witherspoon

The last two years have been a rollercoaster when it comes to exams.

While last year the government abandoned their poorly considered plans to use an algorithm to award individual grades, this year they took a different approach and delegated responsibility to teachers and exam boards.

But then it took them until late February to make the decision about how grades would be assessed.

Instead, earlier guidance about assessment would have helped ensure more consistency in the evidence available for grading, and saved both teachers and students a lot of stress and uncertainty.

As it was, teachers were sometimes scrambling to identify pieces of evidence from each student’s work and there was no way to ensure that students at different schools were being assessed on the same types of work or in the same way.

Had the government set out in early autumn what would happen if exams had to be cancelled again, they could have encouraged more consistency in the work to be assessed and teachers would have had a wider range of evidence to use.

Having a “plan B” would also have meant there were more “data points” for teachers to use in their assessments, and there might have been more consistency between schools.

This would have created more of a level playing field in assessment.

‘Attainment gap has widened’

The importance of consistency is highlighted by the fact that this year the attainment gap has widened for students on free school meals, from areas of high deprivation and Black candidates.

Results rose more in private schools than in other types of schools.

Some of this will reflect real differences in learning loss, but in the absence of consistency in assessment processes and evidence between schools, we cannot be sure.

This underlines the real need to start a proper conversation about next year’s exams now.

There are contentious statistical and wider issues to consider. It is important that there is broad agreement about how best to proceed.

I see two clear priorities for the future.

‘Full transparency from exam boards’

First, there should be a full and transparent account of what statistical evidence was used by exam boards to select which schools would be subject to further scrutiny.

Though Ofqual has provided some information on this, further details are promised for “later this year”.

There were also several news stories in the run-up to results day about parents – especially at private schools – pressurising teachers over grades.

So it is important to understand how results were queried at private and state schools to understand the extent to which the scrutiny process tackled this issue.

‘Open discussion needed for next year’

Second  – and even more important – there needs to be open discussion about how exams and assessment will work next year.

The return to exams will help ensure consistency of grading between schools, but it will not address the hours of education lost due to the pandemic, and how this varies between students and schools.

The government has announced steps to ensure exams take some account of learning loss (for instance by giving a choice of topics to answer).

These steps are welcome. But exams are statistically ‘norm referenced’, which means the cut-offs between different grades are partly set by prior decisions about what grading results should look like.

Is the plan to revert in one fell swoop to 2019 grade profiles, or to adjust them more slowly? Public debate about this should start now.

The cohort of 18-year-olds is growing. That, combined with aspirations for more students to attend university (particularly given the small number of available degree-level apprenticeships), means that decisions will need to be taken that intersect statistics and policy.

The public – including teachers – needs to be part of that conversation.

More from this theme

Exams

Deprived schools more likely to see progress 8 scores fall

Analysis comes as Covid impact and potential Labour changes may spell end to measure in its current form

Freddie Whittaker
Exams

Progress 8 pause: Heads call for wider review

But some heads have warned the sector could creep back to GCSE pass grades being the accountability 'king'

Samantha Booth
Exams

No school progress measure for next two years

The Department for Education had explored alternative options, but concluded there is 'no replacement' for progress 8 measure

Samantha Booth
Exams

Unions: ‘Clunky’ advanced British standard risks ‘blunt choice’ for pupils

Ministers accused of 'putting the cart before the horse' with 16-19 reform plans

Freddie Whittaker
Exams

DfE puts 40 staff on Advanced British Standard ‘vanity project’

Government criticised for committing 'platoon of civil servants' to policy unlikely to come to fruition

Freddie Whittaker
Exams

Cyber attack: Exam boards told to introduce new security measures

Ofqual chief Sir Ian Bauckham said regulator will undertake 'rigorous' checks on exam board plans to move tests on-screen

Samantha Booth

Your thoughts

Leave a Reply

Your email address will not be published. Required fields are marked *