Skip to main content

NIF levels and what they tell us

Last week it was PISA and this week we have had the National Improvement Framework (NIF) data published in Scotland. Taken at face value, we don't come out of this process very well, and the Scottish Government and Ministers have received pelters from other politicians and the media as a result. It almost made me feel sorry for them. But then again if you want to use such spurious data to justify your 'controversial' steps to improvement, perhaps I am being a little too generous at Christmas time. 'Beware what you wish for' applies to politicians as much as it does to the rest of us. My last post was about all my concerns regarding the PISA results and how they are used by politicians and others to justify re-shaping the curriculum and other structural changes. I do not intend to revisit those arguments here, but what of the NIF data?

Each school and local authority in Scotland was asked to state how many children had achieved the expected levels in P1, P4, P7 and S3, using 'teachers professional judgements'. This information was submitted to local authorities in June and was then submitted by them to Scottish Government early in the new session. When this information was put together, there had been no publication of 'benchmarks' but I am sure that some Local Authorities, like my own, asked schools and teachers to show the type of evidence they were using to support their judgements. Trouble is, there is no agreed method of doing this across schools or Local authorities. So some have undoubtedly been hard on themselves and their judgements, and others less so. The data produced as a result, possibly says more about procedures and structures prevalent in different Local Authorities and the NIF, than it ever could about attainment in learning. A bit like PISA, we are not comparing apples with apples, in fact we may not even be comparing fruit with another piece of fruit!

But, it would seem that to many, data is data and can be used to come to big judgements about the state of Scottish education as a result. If only it were that simple. Its not, and never will be. The performance of schools and an education system is a complex organic process, influenced heavily by contexts. Taking a narrow focus, or using snapshots, can only ever be a tiny part of an overall process of judging the health and performance of such systems. The total picture needs assessment data that is wide-ranging and captures the totality of everything a system is trying to achieve. At individual school level, I do not judge the quality of teachers or teaching and learning using one measure or one piece of evidence. There are a whole holistic suite of pieces of evidence I collect on a daily, weekly, monthly and yearly basis that give me confidence in knowing the strengths and development needs of the schools I lead. Some of it is recorded and formal, but much more of it is not recorded and is a lot more informal in nature. Lots of it, I couldn't present in a graph or a chart, or as a percentage a number or a level,  because its about relationships and the security of trust I have with individuals. Assessment of a system is equally complex and nuanced, and you also have to ask yourself what is it we are measuring and why? The old maxim of 'valuing what you measure, rather than measuring what you value' comes to mind again. Scottish education is not just about attainment, important though that is. Which is why I believe we really need to have a new conversation around what we understand about 'education' and what we see the role of schools to be, before we can then re-evaluate our curriculum and structures to see if they match what we truly aspire to. Or do we just want to improve the data, no matter how spurious, and insignificant, that may be.

I am sick of hearing about 'the bar being raised'. I have never gone into school, or worked towards lowering, metaphorical bars. I have the highest of aspirations for all learners in the schools I lead and in the system we are part of. But, I am a realist and I know we are where we are, not where somebody else thinks we should be. I understand that sustainable and meaningful growth takes time and commitment. It is not achieved just by someone saying we have 'raised expectations' or we are 'raising the bar'. If you keep doing that, all that happens is that schools and teachers get further and further away from the new height, but they still have to play the game of appearing to get closer and closer. Its an illusion, and does our learners no good whatsoever. I predict that the NIF data will improve next year, and that nobody will be that bothered about the reasons why it has improved. Government will use this to show how their strong actions and policies are beginning to work, and why we need more of the same. Perhaps the press coverage might even sway towards the positive, rather than constantly seeking a negative slant.

School and system development is messy and sometimes you have to go back before you move forward again. It is not this idealised process that some think,  where it is portrayed as a continuous linear process of unfettered improvement and growth. We make mistakes. We learn. We constantly evaluate ourselves against our vision and values. We reflect and are self-critical. We plan and make changes, some of which work, some of which don't. We collaborate with others as we seek to embed meaningful change. I can detail the actions we have taken every year to improve what we do. The benefits and impacts of those changes often take time to manifest themselves in our learners. But, we are constantly trying to get better, and we are committed to working with anyone who genuinely wants to help us do that. Please stop asking me and others to demonstrate impact after a few months of a change being implemented.

I would urge anyone, either within education, or those looking at us from outside, to not get too down about what such data as we have seen published this last two weeks appears to show. Equally do not get too congratulatory or carried away when it appears to improve. As Andy Hargreaves said earlier this year 'what data doesn't do is tell you what you need to do.' Good robust data should be used to inform sound, well thought out and reasoned actions, and not to promote more knee-jerk reactions and policy making. The search for more and more data seems to be the latest fad, trend or 'silver bullet' current within education, as the HMIE might say 'so what?' They are also starting to say 'this is not about proving, but about improving'. I agree, if data doesn't inform or help you get better, why are you bothering? We need to be critical consumers of data, as we are with research, and by doing that we will protect ourselves, and more importantly our learners, from the consequences of blind acceptance of interpretations of that data made by people who accept everything and question very little, especially if it supports a view or stance they have already taken.



Comments

Popular posts from this blog

The Power Within

I sent a tweet the other day which seemed to generate a deal of resonance with some on my PLN. What I said was that meaningful school development can only come from within and cannot be imposed from outside. Now 140 characters on Twitter does have benefits but, as anyone who tweets regularly knows, it also has huge limitations in what you can say. So what I would like to do here is offer some further explanation of what I was trying to convey in my tweet.

For many years well meaning and informed people have increased our understanding and have made constructive suggestions  on how schools can develop and move forward. We also know that there have been lots of other suggestions made by less informed but vocal contributors to this debate! As all in education and schools know, everyone has an opinion or view on what should be going on in our schools. The media loves to feed on all of this and much of it stokes the fires of debate and gives oxygen to some of the wilder suggestions.

As som…

Why we might need more tortoises and fewer hares in education

We have heard Aesop's fable of 'The Tortoise and the Hare.' In this tale with a message, a tortoise challenges an arrogant hare to a race. The hare quickly leaves the tortoise behind. Being so confident,  he decides to have a sleep midway through the race. When the hare wakes, he finds the tortoise, who has kept slowly moving forward, has arrived before him, and has won. A common interpretation of the message of this fable is 'slow and steady wins the race.'

Thinking of schools and education, I believe we celebrate hares too much, and tortoises not enough. School systems are full of people racing to do lots of things, as quickly as possible. Education is not a race. Education is a relentless process of personal enlightenment, growth and development. There is no end point. In that case, it is through adopting the dispositions and characteristics of the tortoise in Aesop's fable that we are most likely to keep making strong, steady progress. Such a relentless ap…

Improving versus proving

During the first two months of 2019 I have been able to attend a number of professional learning events across Scotland. What has been impressive about these events is, not only the breadth and range of development activity taking place across the system, but also the commitment, professionalism and determination of people to getting better at what they do.

What such events also provide, is the opportunity to develop my own thinking and understanding, through listening to the experiences of others and engage in a dialogue around the issues, experiences and insights of different participants. I believe that professional learning with the greatest impacts, should produce changes in facilitators and leaders, not just the participants.

This week I was facilitating a session on parental engagement, on behalf of Connect the parent/teacher organisation in Scotland. This session was with school leaders, and others who had responsibility for this particular area of school development. What I …