A collection of key reading. Updated as new learning takes place.
Last updated: April 2022
Critical engagement with research
Standards of evidence
Australian Education Research Organisation. No date.
Tool
‘Rigorous evidence is defined as evidence produced using research methods (whether qualitative, quantitative or mixed methods) that isolate the specific impact of a particular educational approach. Relevant evidence is defined as evidence produced in contexts that are similar to one’s own. Evidence is also relevant when it is derived from a large number of studies conducted over a wide range of contexts, as this suggests that the educational approach is not dependent on any particular contextual factor.’
Evidence Rubric for educators and teachers
Australian Education Research Organisation. No date.
Tool
‘The Evidence rubric assists education practitioners and policymakers in:
– self-assessing how confident they can be that a certain approach is effective in their context
– deciding how to implement the approach given their level of confidence
– collecting evidence that may increase their confidence in the effectiveness of the approach.’
Research reflection guide
Australian Education Research Organisation. No date.
Tool
‘First identify a piece of research evidence on a particular approach that you are considering implementing. Then, answer the series of guiding questions below that will prompt you to consider: what the research says; how relevant the research is to your context; whether you should implement the approach; and what you can do to ensure successful implementation.’
Hidden gems – investigating the way research is used in schools
Toon. No date.
Blog
‘It is a common misconception that in order to use research evidence in their work, an educator just needs to find the right piece of research to tell them what to do in their classroom.
Usually, the perfect piece of research evidence does not exist. Instead, educators need to identify, understand, interpret and apply evidence from research to their classroom practice.’
Landmark research integrity survey finds questionable practices are surprisingly common
de Vrieze. 2021.
Blog
‘More than half of Dutch scientists regularly engage in questionable research practices, such as hiding flaws in their research design or selectively citing literature, according to a new study. And one in 12 admitted to committing a more serious form of research misconduct within the past 3 years: the fabrication or falsification of research results.’
What Can We Do About Our Bias?
Benson. 2019.
Blog
‘Step 4: Normalize (Advanced level). Take steps to reduce the time and energy others have to spend challenging your blind spots and recruiting you to address the damage that you’ve contributed to. For example: actively seek out information and perspectives that challenge your own. Invite the best representatives of positions you don’t agree with to productive disagreements. Actively attempt to falsify your own beliefs.’
Cognitive bias cheat sheet
Benson. 2016.
Blog and poster
‘Cognitive biases are just tools, useful in the right contexts, harmful in others. They’re the only tools we’ve got, and they’re even pretty good at what they’re meant to do. We might as well get familiar with them and even appreciate that we at least have some ability to process the universe with our mysterious brains.’
How you can dampen the effects of publication bias?
Ramaiah. 2021.
Article
‘Studies that show negative findings are systematically rejected because they are typically judged to have been poorly designed. The result is that the literature is skewed towards positive representations of the efficacy of given treatments and programmes, with no countervailing evidence to challenge it.’
The Open Door: How to be a Research-Sensitive School
Abercrombie. Haslam. 2021.
Paper
‘Research evidence has an impact on the culture of the school, shaping ideas of the right way of going about daily tasks. This is closely linked with the school’s moral purpose, of achieving the best outcomes for
children. By being evidence-informed, the choices made within the school are seen to be based on firm foundations, rather than the latest whim or fad.’
Thinking critically about educational claims
That’s a claim
Website and posters
‘A good choice is one that uses the best information available at the time. For education choices, this includes using the best available evidence of intervention effects. Good choices don’t guarantee good outcomes, but they make good outcomes more likely.’
Could education research be leading the profession astray?
Ramaiah. 2021.
Article
‘Questionable research practices” are ubiquitous in scientific research… To produce findings that get published in these journals, scientists engage in a wide range of methodological and statistical gymnastics to contort their results into a form that makes them publishable.’
Facts Are More Important Than Novelty: Replication in the Education Sciences
Makel. Plucker. 2014.
Paper
‘If education research is to be relied upon to develop sound policy and practice, then conducting replications on important findings is essential to moving toward a more reliable and trustworthy understanding of educational environments.’
Making Education Research Relevant
Willingham. Daniel. 2021.
Paper
‘In theory, the goals of edu research are to build knowledge & improve decision-making & outcomes for teachers & students. In practice, edu research is shaped by the practices & priorities of researchers, not teachers or school/system leaders.’
Using Evidence in the Classroom: What Works and Why?
Nelson, O’Beirne. NfER. 2014.
Paper
‘The evidence needs to be contextualised for practice and presented in clear, accessible formats, using media which is accessible and includes practical guidelines for implementation, rather than simply being produced in its raw form.’
Evidence-informed teaching: evaluation of progress in England
DfE. 2017.
Paper
‘Use the term ‘evidence-informed’ teaching. This term emphasises that teaching, as a complex, situated professional practice, draws on a range of evidence and professional judgment, rather than being based on a particular form of evidence.’
Decolonising research
What is decolonising methodology?
Warwick University. 2018.
Webpage
‘Decolonisation sensitises us to the existence of dominant discourses and the influence of dominant groups in what / who we research. It makes an appeal to be critical and reflexive throughout the research process. It provides a timely reminder that our assumptions about rationality derive from a literature that developed at a particular time and place.’
Decolonising research methodology must include undoing its dirty history
Ndlovu-Gatsheni. 2017.
Blog
‘What is at issue is re-search as a terrain of pitting the interests of the “re-searcher” against those of the “re-searched.” The core concern is about how re-search is still steeped in the Euro-North America-centric worldview. Re-searching continues to give the “re-searcher” the power to define. The “re-searched” appear as “specimens” rather than people.’
Psychology’s replication crisis is running out of excuses
Yong. 2018.
Blog
‘In considering “non-weird countries” together, it’s lumping together people from cultures as diverse as Mexico, Japan, and South Africa. “Cross-cultural research must be informed with thorough analyses of each and all of the cultural contexts involved.”
Whose Psychology Is It Anyway? Making Psychological Research More Representative
Reynolds, Cheon, Roberts. 2021.
Audio
‘There’s an automaticity when research is done in WEIRD contexts, that the results will apply everywhere. If research is done in non-WEIRD contexts, the results aren’t seen as universally applicable. The context is expected to be made explicit, whereas in non-weird contexts, it isn’t.’
Decolonising research
Abdi, Nvé Díaz, Jimenez and Calliou. 2020.
Video
‘I’m just very interested in how indigenous peoples talk about knowledge and and how their knowledge is not seen as as sort of anti-science but rather a form of science, a form of inclusive science that is millennia old and tested and just as scientific as everything else.’
An interview with Professor Linda Tuhiwai Smith: Decolonising Methodologies, 20 years on
Tuhiwai Smith. Benson. Salem. 2020.
Audio
‘You can’t claim that algorithms are neutral… embedded in them is inequality, iniquity, embedded in them is racism and sexism, and a denial of existence of multiple identities.’
Toward a psychology of Homo sapiens: Making psychological science more representative of the human population
Rad. Martingano. Ginges. 2018.
Paper
‘It is important that research distinguishes between exploratory & confirmatory analyses, & uses appropriate analytical techniques. However, even the most perfect methods will not yield much if we gather data from such a narrow slice of humanity.’
Conducting research
The cascade model of teachers’ continuing professional development in Kenya: A time for change?
Bett. 2016.
Paper
‘Action research puts the teacher at the centre, questioning matters within [their] context with an intention of improving them… Action research deals with teachers’ values, which are often magnified through the process of continuous self-reflection.’
Teachers engaging in action research: challenging some assumptions
Peters. 2004.
Paper
‘Teachers ‘found it difficult to learn the process quickly enough to be able to implement it with any confidence… This finding is congruent with the experiences of McTaggert et al (1997) who discovered that action research was a difficult process for teachers to learn and sustain because of its complexity and lack of congruence with the hectic nature of life in classrooms.’
Action research in Singapore: where are we now?
Hairon. 2017.
Paper
‘The laundry list of things that teachers have to do on a teaching day can be inexhaustible… The realities of school life essentially militate how teachers prioritise the deluge of work that needs to be attended to in the current instance over professional development activities, such as engagement in action research, which will most likely bear fruit some time later.’
Ethical Guidelines for Education Research
BERA. 2018.
Paper
‘We recommend that at all stages of a project – from planning through conduct to reporting – educational researchers undertake wide consultation to identify relevant ethical issues, including listening to those in the research context/site(s), stakeholders and sponsors. This means that ethical decision-making becomes an actively deliberative, ongoing and iterative process of assessing and reassessing the situation and issues as they arise.’