By Dr Gary Jones on Thursday, 01 December 2016
Category: Expert Insights

We must design some ethical guidelines around using and conducting research in schools

I've recently begun to think about whether the school research/evidence community has a shared understanding of the similarities and differences between research, quality improvement and evidence-based practice (EBP).

This is a critical issue because if schools and school leaders are not fully aware of the similarities and differences, there's a real danger that significant ethical issues could go unnoticed. This could mean that pupils might be disadvantaged by well meaning (but ultimately flawed) attempts at research masquerading as quality improvement or EBP.

So here's my guide to helping school leaders explore the ethical implications of developing a research-based or evidence-based school.

What do we mean by research, quality improvement and evidence-based practice?

 

Without wanting to get too far into the scientifics, here are some broad definitions to help get a handle on the three aspects of education research:

Research is the process of creating new generalisable knowledge, including developing and testing hypotheses.

Quality Improvement has been defined as systematic, data-guided activities designed to bring about immediate improvements.

EBP has been defined as making decisions through the conscientious, explicit and judicious use of the best available evidence from multiple sources to increase the likelihood of a favourable outcome.

Rodney Hicks summarised these succinctly in relation to healthcare in his article, Maintaining Ethics is Quality Improvement. His definition could be re-purposed for education to read something like: quality improvement seeks to improve the individual school or multi-academy trust, research generates new knowledge, and EBP allows educators to have and use the best available evidence when making a decision.

Here is a summary of the different activities which might be done in research, quality improvement and EBP so you can further see the differences.

Research

Activities could include: Participation in an Education Endowment Foundation randomised control trials; working with a university on a study to into teachers' use of new technology; a member of staff conducting doctoral research under the supervision of a higher education provider.

Quality improvement

Activities could include: Interviewing colleagues about examination performance in a department and producing an action plan; changing pupil enrolment systems; an internal school trial to provide a new approach to individual exam support.

EBP

Activities could include: Undertaking a review of existing evidence – research, school, stakeholders and personal experience – on graded lesson observations and making a decision on whether to move to a non-graded approach; undertaking a review of existing evidence on the effectiveness of marking homework and adopting a new school-wide policy.

How research, quality improvement and EPB overlap

These three terms drive each other in many ways. For example, research and evidence-based practice both inform quality improvement, but research may be driven by questions that arise from quality improvement and EBP.

But there also some clear overlaps between the methods associated with research and those with quality improvement. Hicks argues that in healthcare some quality improvement efforts have a clear purpose, scope, data-collection method and sophisticated approaches to data analysis – just as you would see in research.

Even in education in the UK, we have the Education Endowment Foundation's The DIY Evaluation Guide which uses the language of research – for example, interventions, measures pre-tests, post-tests random allocation, matched control groups, effect-sizes, analysis and reporting of results.

This brings up some key ethical issues because research is closely regulated, whereas quality improvement in education so far is not. As Lynn et al state in their essay on quality improvement in healthcare: "Ethical issues arise in QI (quality improvements) because attempts to improve quality may inadvertently cause harm, waste scarce resources, or affect some patients unfairly."

The issue is laid more starkly when you look at BERA's guidelines.

BERA's Ethical Guidelines for the conduct of research

BERA's guide to the ethical conduct of research outlines the researcher's responsibilities to: participants; sponsors; the community of educational researchers; educational professionals; policy makers and the general public.

Let's just focus on the responsibilities to participants to begin with. To what extent have the following issues – extracts from the guidance on research – been considered when you have designed a quality improvement activity?

Researchers must take steps to minimise the effects of designs that advantage or are perceived to advantage one group of participants over others.

If these issues have been considered, addressed and been subject to some form of internal review, for a quality improvement scheme, that is great. On the other hand, if these issues have been dismissed or ignored, then there is a real risk that pupils may be harmed by badly designed quality improvement activities.

We cannot put this down to ignorance or claim we don't know how to put ethical frameworks in place: BERA has clear ethical guidelines for research and there is extensive literature in the health sector on the ethical considerations of quality improvement, with clear guidelines as to how to proceed.

Much of the so-called research or EBP in schools could actually be classified as quality improvement. Unfortunately, within this, there is a real risk that teachers aren't aware of the ethical implications of such activities, which may place pupils at avoidable risk – and we cannot claim ignorance to this any longer.

This article originally ran on Dr Jones' Evidence Based Educational Leadership blog. You can find it here.

You may also be interested to read our Beginner's Guide to Doctor Gary Jones.

Related Posts

Leave Comments