Exams

Next year’s exams could be statistically contentious if we don’t act now

11 Aug 2021, 14:02

The DfE will refund schools for exam fees and costs.

Clear conversations about next year’s exams are needed right away, writes Sharon Witherspoon

The last two years have been a rollercoaster when it comes to exams.

While last year the government abandoned their poorly considered plans to use an algorithm to award individual grades, this year they took a different approach and delegated responsibility to teachers and exam boards.

But then it took them until late February to make the decision about how grades would be assessed.

Instead, earlier guidance about assessment would have helped ensure more consistency in the evidence available for grading, and saved both teachers and students a lot of stress and uncertainty.

As it was, teachers were sometimes scrambling to identify pieces of evidence from each student’s work and there was no way to ensure that students at different schools were being assessed on the same types of work or in the same way.

Had the government set out in early autumn what would happen if exams had to be cancelled again, they could have encouraged more consistency in the work to be assessed and teachers would have had a wider range of evidence to use.

Having a “plan B” would also have meant there were more “data points” for teachers to use in their assessments, and there might have been more consistency between schools.

This would have created more of a level playing field in assessment.

‘Attainment gap has widened’

The importance of consistency is highlighted by the fact that this year the attainment gap has widened for students on free school meals, from areas of high deprivation and Black candidates.

Results rose more in private schools than in other types of schools.

Some of this will reflect real differences in learning loss, but in the absence of consistency in assessment processes and evidence between schools, we cannot be sure.

This underlines the real need to start a proper conversation about next year’s exams now.

There are contentious statistical and wider issues to consider. It is important that there is broad agreement about how best to proceed.

I see two clear priorities for the future.

‘Full transparency from exam boards’

First, there should be a full and transparent account of what statistical evidence was used by exam boards to select which schools would be subject to further scrutiny.

Though Ofqual has provided some information on this, further details are promised for “later this year”.

There were also several news stories in the run-up to results day about parents – especially at private schools – pressurising teachers over grades.

So it is important to understand how results were queried at private and state schools to understand the extent to which the scrutiny process tackled this issue.

‘Open discussion needed for next year’

Second  – and even more important – there needs to be open discussion about how exams and assessment will work next year.

The return to exams will help ensure consistency of grading between schools, but it will not address the hours of education lost due to the pandemic, and how this varies between students and schools.

The government has announced steps to ensure exams take some account of learning loss (for instance by giving a choice of topics to answer).

These steps are welcome. But exams are statistically ‘norm referenced’, which means the cut-offs between different grades are partly set by prior decisions about what grading results should look like.

Is the plan to revert in one fell swoop to 2019 grade profiles, or to adjust them more slowly? Public debate about this should start now.

The cohort of 18-year-olds is growing. That, combined with aspirations for more students to attend university (particularly given the small number of available degree-level apprenticeships), means that decisions will need to be taken that intersect statistics and policy.

The public – including teachers – needs to be part of that conversation.



More from this theme

Exams

Key stage 2 SATS: 59% achieve ‘expected standard’ as maths and writing plunge

Results drop to lowest levels since 2016 after Covid disruption, but silver lining as reading improves

Freddie Whittaker
Exams, Schools

‘Shambles’: Heads wait hours for SATs results as Capita portal crashes

Leaders waiting since 7.30am say delays 'completely unacceptable', as national statistics website also goes down

Freddie Whittaker
Exams

Scaled scores for 2022 key stage 2 SATs announced

DfE publishes marks pupils need to meet the 'expected' standard

Freddie Whittaker
Exams

Ex-DfE adviser and ESFA boss appointed in Ofqual board shake-up

New board members to bring 'invaluable insight', says regulator chair

Samantha Booth
Exams

Private schools over-inflated GCSEs during Covid, analysis suggests

But academics say it's 'still not clear' why private schools issued more generous grades than expected

Freddie Whittaker
Exams

AQA staff vote in favour of strike action over pay

Unison considering 'next steps' after 71% vote for industrial action it claims could disrupt exam results

Freddie Whittaker

Your thoughts

Leave a Reply

Your email address will not be published.