The National Education Union has been accused of pushing its anti-Ofsted agenda through a supposedly “independent inquiry” after it published a biased survey heavily critical of the inspectorate.
The poll, published by the Beyond Ofsted inquiry on Wednesday, said 92 per cent of teachers agreed Ofsted was not a “reliable and trusted arbiter of standards”.
It attracted national press coverage, with journalists told the research was conducted by the UCL Institute of Education.
However, when asked by Schools Week, the inquiry – which was set up and is funded by the union – admitted the survey was self-selecting. This is considered a common type of research bias because respondents choose to take part, making it unrepresentative.
Emails from the union, which wants to abolish Ofsted, urged members to complete the survey. Social media posts encouraging participation also included the tag #replaceOfsted
Seventy-nine per cent of the 6,708 survey respondents identified as National Education Union (NEU) members.
Stuart Lock, the chief executive officer at Advantage Schools, said self-selecting samples made by campaigning groups ”dressed up as independent” muddied the waters and did not help the sector or Ofsted to improve, “and hence don’t help colleagues in schools or their pupils”.
Beyond Ofsted launched in April to “consider input from a wide range of well-informed voices” to “develop a set of principles for underpinning a better inspection system and proposals for an alternative approach”. Its website states it is sponsored by the union.
Full report due later this month
It is chaired by Lord Jim Knight, a former schools minister, with a board of 16 – several of whom are vocal Ofsted critics.
The survey findings were released on Wednesday as a preview to the full report, due later this month.
It found 62 per cent of teachers did not think their most recent inspection accurately reflected their school, including a majority of those in ‘good’ and ‘outstanding’ schools.
While not the same question, 91 per cent of leaders responding to Ofsted’s own post-inspection survey data stated judgments made by inspectors were justified.
In the Beyond Ofsted survey, almost 75 per cent of respondents described their experience with the watchdog as negative.
But Ofsted’s own survey found just 16 per cent of state-funded schools disagreed the benefit of inspection outweighed any negative aspects.
Steve Caldwell, the deputy head of Helsby Hillside Primary School in Cheshire, said it was “all too easy to fall into the trap of agreeing with the inquiry’s findings because of our own negative views about Ofsted.
“Ofsted does need reform, but desperately clinging to headlines from poorly designed surveys is not the way to do it. It makes our arguments look weak, and makes us easier to dismiss and ignore. We need a much more robust approach than this.”
An NEU social media post in May called for school leaders to step down from serving as inspectors and remove references to Ofsted in school.
NEU encouraged members to take part
The same post said “support the inquiry and complete the survey. It’s time to look #BeyondOfsted”, alongside an anti-Ofsted slogan asking “how do we #replaceOfsted?”
Schools Week found examples of the inquiry’s researchers sending survey links to people who posted critical Ofsted comments on social media.
Professor Kathy Rastle, from Royal Holloway, University of London, said independence was hard to establish “given that the survey was hosted on a website that argues that Ofsted has ‘lost trust’” with staff and pupils.
“Inquiries of this nature are most valuable when they are independent. That means that they come at the problem in an unbiased way and take steps to ensure a representative set of views.”
Professor John Jerrim, of the UCL Institute of Education (IOE), added such examples “stop Ofsted doing more research into the key issue of inspection reliability or consistency.
“Why make data, etc, that could be used for this purpose available to researchers, when the dice are going to be loaded against them?”
However a spokesperson for the inquiry said they were “satisfied with the integrity of the research and are confident that will be evident when the full report is published”.
They added that researchers Professors Jane Perryman and Alice Bradbury made efforts to ensure the survey was distributed as widely as possible. Results from both NEU and non-NEU members were “broadly similar”, they said.
Knight told Schools Week there was no way he would be an NEU “stooge”.
A union spokesperson said it was a “serious research exercise conducted by established academics” and that the findings were independent of the union