DfE rapped over use of Sats data after intervention by Warwick Mansell

Writing in the Guardian, Warwick Mansell is reporting that his own analysis into SATs results, and whether academies improve them more effectively than non-academies, has resulted in a rebuke for the DfE’s use of statistics…

…statistical analysis by your correspondent, sent to the statistics authority, suggested that these differences in results gains may not have been anything to do with whether the schools were academies or not. Rather, they seemed to be part of a general trend, for all schools, whereby those starting off with poor results in 2012-13 closed the gap on those that had been formerly been ahead.

And non-academies starting with the same – generally poor – test results as sponsored academies in 2013 actually registered faster improvements in 2014, we found. There was no sign of this analysis in the DfE release.

UKSA agreed with us, saying last week the DfE should in future state that the data as presented could not be used – by ministers and others – to imply a “causal link” between academy status and improvements in test results…

So, a victory for this column in the cause of informed debate, perhaps. Whether it will be taken on board by the DfE remains to be seen, however, with a spokesman saying only that the UKSA’s view had been “noted”…

More at: Department for Education rapped over use of Sats data

 

Hats off to Warwick Mansell for a sterling piece of work here but a bit worrying that the press had to point out the potential flaws in the DfE’s original interpretation.

Any additional thoughts or insights?

Please share in the comments or via Twitter…

Don’t forget you can sign up to receive our daily email bulletin every morning (around 7 am) with all the latest schools news stories. Your details will never be given to anyone else and you can unsubscribe at any stage. Just follow this link

Cost of private school soars to almost £300,000 with fees more than trebling since 1990
Call for 'superhead' Liam Nolan to resign after school placed in special measures
Categories: Academies, Local authorities and Policy.

Comments

  1. TW

    A bit worrying???  – Five years and counting of the DfE’s corruption of  public standards to produce a torrent of blatant lies and propaganda and it’s ‘a bit’ worrying?  Sheesh!

  2. TW

    A bit worrying???  – Five years and counting of the DfE’s corruption of  public standards to produce a torrent of blatant lies and propaganda and it’s ‘a bit’ worrying?  Sheesh!

  3. Channel 4 Factcheck warned in January 2012 that a healthy dose of cynicism was needed whenever ministers made claims about academies.  The DfE’s response was to tweet that Channel 4 had given them the thumbs up.
    It’s called the Goebbels’ approach – repeat a lie often enough and it becomes ‘truth’.  The lie has, of course, been promoted in most of the media which, apart from a few such as Warwick Mansell, Channel 4 Factcheck and FullFact, churn Gov’t pronouncements uncritically.
    http://www.localschoolsnetwork.org.uk/2012/01/academies-raise-standards-twitters-dfe-not-exactly-says-factcheck/

Let us know what you think...