Ofsted

This evidence must inform the inquiry into Ofsted’s reliability

A new paper reveals new insights into inspection outcomes and suggests Ofsted should make its training material more widely available

A new paper reveals new insights into inspection outcomes and suggests Ofsted should make its training material more widely available

Christian Bokhove

20 Oct 2023, 5:00

There was something of a social media storm when some of Ofsted’s training material recently leaked online. Teachers and school leaders were able to see for the first-time what Ofsted really thinks – albeit partially and out of context – and many felt accessing such materials would help them to navigate the inspection process.

This episode demonstrates widespread demand for inside knowledge about what inspectors look for when they judge a school. Of course, the individuals with the greatest knowledge in this regard are the inspectors themselves. And due to Ofsted’s model of employing school leaders as inspectors (“OIs”), some schools are privy to more inside information than others.

Powerful knowledge

But does this actually give the schools in which OIs work an advantage in the inspection process? Until today’s release of our new academic paper as part of our project funded by the Nuffield Foundation, there was no evidence on this issue. So, we worked with Schools Week on data they obtained from Ofsted via a Freedom of Information request.

The data shows that schools with an OI on their books do better in their Ofsted inspections. In particular, schools that employ an OI are less likely to be downgraded to ‘Requires Improvement’ or ‘Inadequate’ during full inspections and more likely to be judged as potentially improving towards ‘Outstanding’ during short inspections of ‘Good’ schools.

This only affects a small amount of Ofsted’s work; around 2 per cent of schools inspected in 2022/23 employed an OI. However, the new chief inspector has said he wants Ofsted to employ more inspectors who are also working in schools so this is likely to become an increasingly important issue.

Possible explanations

One fairly benign explanation of our findings is that Ofsted simply employs the best school leaders as inspectors or provide them with genuinely valuable training. This would make it unsurprising that their schools do slightly better in inspections. We can’t rule this out entirely.

However, our findings hold even when we compare schools with similar prior exam results, absence rates and Ofsted grades. This makes the ‘best leaders’ hypothesis a less likely explanation.

Some other potential explanations are more controversial. Perhaps OIs get access to ‘insider knowledge’ about what Ofsted really wants. This is the sort of information that other school leaders can only access when it is leaked. As Martyn Oliver has himself noted, it is not uncommon for multi-academy trusts to advertise for former HMIs to come and work for them.

Schools with an inspector on their books do better

An even more controversial potential explanation relates to networks. Ofsted operate a regional model and most OIs inspect within the region in which they are based. This means that an OI could be familiar with the inspector who comes to judge their school, which could colour the latter’s judgment.

Our data doesn’t help us to distinguish between the potential explanations set out above. That is why we are calling on Ofsted to make data about inspectors and inspections available to qualified researchers in a secure setting. It shouldn’t be necessary to make a Freedom of Information request to get such data (and, even then, for it to be provided in a deliberately unhelpful manner).

Likewise, it seems obvious that if Ofsted are going to provide training to some school leaders then a version of this training at least should be accessible to all school leaders. Indeed, ASCL have argued that Ofsted should make all its training materials universally available.

The bigger picture

This work builds upon our previous research into inspection consistency and reliability, where we have found that permanent members of Ofsted staff (HMIs) award more lenient judgements than contracted inspectors (OIs), even where the school have similar exam results and pupil intakes.

Any process with human judgment at its core will have fundamental limitations. As we noted in our recent submission to the Education Select Committee, school inspections will never be 100 per cent reliable; it would be unreasonable to expect them to be.

But they need to be is reliable enough. And at the moment, we really can’t come to a judgment about that.

This article and the paper it is based upon were co-authored with John Jerrim, professor of education and social statistics and Sam Sims, lecturer, both of IOE, UCL’s Faculty of Education and Society

Latest education roles from

Internal Quality Assurance Employability and Distance Learning

Internal Quality Assurance Employability and Distance Learning

Capital City College Group

Distance Learning Tutor

Distance Learning Tutor

Capital City College Group

Event Support Team Leader

Event Support Team Leader

MidKent College

E-Sport Technician

E-Sport Technician

MidKent College

Digital Technician

Digital Technician

MidKent College

Student Welfare Officer

Student Welfare Officer

MidKent College

Sponsored posts

Sponsored post

Navigating NPQ Funding Cuts: Discover Leader Apprenticeships with NPQs

Recent cuts to NPQ funding, as reported by Schools Week, mean 14,000 schools previously eligible for scholarships now face...

SWAdvertorial
Sponsored post

How do you tackle the MIS dilemma?

With good planning, attention to detail, and clear communication, switching MIS can be a smooth and straightforward process, but...

SWAdvertorial
Sponsored post

How can we prepare learners for their future in an ever-changing world?

By focusing their curriculums on transferable skills, digital skills, and sustainability, schools and colleges can be confident that learners...

SWAdvertorial
Sponsored post

Inspiring Education Leaders for 10 Years

The 10th Inspiring Leadership Conference is to be held on 13 and 14 June 2024 at the ICC in...

SWAdvertorial

More from this theme

Ofsted

Councils ‘hamstrung’ from supporting school leaders, review claims

But Ruth Perry's sister criticises council review for 'failing to ask key questions'

Lucas Cumiskey
Ofsted

Ofsted ‘not fit for purpose’, finds ‘alternative big listen’

Organisers of sector-led survey say inspectorate facing ‘existential crisis’

Freddie Whittaker
Ofsted

ASCL: Base Ofsted report cards on ‘slim set of statutory standards’

The heads' union sets out key principles of how Labour's proposed report card should work if they win next...

Lucas Cumiskey
Ofsted

‘Don’t scapegoat leaders over bad Ofsteds’, says top trust boss

United Learning chief's blueprint for Ofsted reform also calls for end of ungraded inspections and 'simplified' primary visits

Lucas Cumiskey

Your thoughts

Leave a Reply

Your email address will not be published. Required fields are marked *