News

‘Time is running out’: Exams fiasco data promised by Ofqual to ‘rebuild trust’ delayed

exams Ofqual
Exclusive


The publication of data from last year’s grading fiasco, promised by Ofqual to “rebuild trust in exams”, has been delayed.

Academics say the setback means “time is running out” for the data to be any use in preventing possible chaos this year.

While due consideration must be given to data protection, time is running out for the data to be of any use this year

The regulator pledged in December to use the the Office for National Statistics’ (ONS) Secure Research Service to publish the source data used to award grades last year. More “transparency” would help Ofqual “learn” from last year’s chaos.

Accredited researchers could then forensically analyse the data, including looking at the relationship between results and university applications and attainment data, as well as the model used.

The regulator initially said it expected researchers would be able to apply to access the data from “early 2021”. In March it said the plan was to send data to the ONS in April or early May “at the latest” as it sorted data protection issues.

But Schools Week can reveal the release has been delayed again over “further data protection issues”.

‘Imperative’ to review what happened last year

Sir Peter Lampl, the founder and executive chair of the Sutton Trust and chair of the Education Endowment Foundation, said: “While due consideration must be given to data protection, time is running out for the data to be of any use this year.”

It was “imperative” to analyse and review what happened last year. “Knowing how different groups and schools were affected should play an important part in mitigating against this happening in 2021.”

Ofqual exams
Sir Peter Lampl

Ofqual said it was “working towards” making the data available “before this summer’s results”.

A spokesperson said: “It’s important to get this right. While we anticipated that this would take some time, there is some further work that we need to do to ensure that pupils’ data is shared securely.”

Professor Julius Weinberg, who is leading an expert board advising on the project, said last year it could affect “fundamental change”.

It was about “trusting others” to interrogate data, allowing independent researchers to “hold the system to account” and “being confident and open”.

“Ultimately openness and accountability will, I hope, rebuild the trust that young people, their parents, teachers and others should have in the exam system.”

Ofqual heavily criticised over communication

The regulator was heavily criticised for keeping details of its ill-fated algorithm secret in the run up to last summer’s exams.

Robert Halfon, the chair of the education select committee, said Ofqual “buried its head in the sand” in the run-up to results day. He also accused the regulator of “hiding away in the Ofqual attic” over a lack of communication.

Roger Taylor, Ofqual’s former chair, told the committee last September that it was “absolutely essential that independent researchers” have access to data from last year “in a secure way that will enable those lessons to be learned”.

Ofqual said the planned release would include data used to develop the standardisation model, including centre-assessed grades, calculated grades and final grades. It would date back to 2017 to allow comparisons and would include linked data from the Department for Education and UCAS, with support from Ofsted.

Two reports from Ofqual’s new expert data-sharing advisory board are also delayed.

One is expected to look at “factors affecting centre-assessed grades” (CAGs) compared with examined grades. The other is the difference between CAGs and calculated grades in 2020 as well as the characteristics of those students “with larger gaps”.

Weinberg, the board’s chair, said in December he hoped to report in May. Ofqual said the reports would now be published in “the coming weeks”.

Several evaluations and analyses on summer 2020, including a 340-page technical report, have already been published, a spokeperson said. “The data-sharing project is a long-term project and we will move forward as soon as we can.”



Your thoughts

Leave a Reply

Your email address will not be published. Required fields are marked *

One comment

  1. “The regulator pledged in December to use the the Office for National Statistics’ (ONS) Secure Research Service to publish the source data.”

    That’s true – on 7 December, Ofqual posted this on their website: https://www.gov.uk/government/news/code-used-to-calculate-qualification-grades-in-summer-2020

    But only after pressure from the Select Committee hearing on 2 September 2020, as evidenced in the questions and answers 986 and 987, which include these words from Roger Taylor:

    “…And that information is contained in the data submitted by schools and the process of standardisation. It is absolutely essential that independent researchers have access to that in a secure way that will enable those lessons to be learned…”

    https://committees.parliament.uk/oralevidence/790/pdf/

    Ofqual were also “reminded” to publish the data at the Select Committee hearing on 9 March 2021, This is question 1325:

    Q1325

    Ian Mearns: I thought I would mention it because the then chair, back on 2 September, said this data would be available. I would hope that Ofqual would, therefore, get about doing that so people can look at the data that was promised to us five or six months ago.

    Simon Lebus: I am afraid I only came into the role on 4 January.

    And this is question 1331

    Q1331

    Ian Mearns: Simon, going back to my previous point, would you let us know when you intend to publish that data, please?

    Simon Lebus: Sorry, the data about last summer?

    Ian Mearns: About last year.

    Simon Lebus: Yes, of course.

    Ian Mearns: Obviously, there are a number of people out there wanting
    to have a good look at this.

    Simon Lebus: Sorry, can I just confirm exactly the data you want?

    Ian Mearns: The source data. The then chair, on 2 September, committed to release all last summer’s source data for deep forensic analysis, and a post on the Ofqual website said on 7 December it is expected that, “researchers will be able to apply to access this data from early 2021”.

    Ian Bauckham: We remain committed to doing that, and I will write to you, Chair and the Committee, after this hearing to confirm precise timescales for doing so.

    https://committees.parliament.uk/oralevidence/1837/pdf/