A collection of key reading. Updated as new learning takes place.
Critical engagement with research
Standards of evidence
Australian Education Research Organisation. No date.
Tool
‘Rigorous evidence is defined as evidence produced using research methods (whether qualitative, quantitative or mixed methods) that isolate the specific impact of a particular educational approach. Relevant evidence is defined as evidence produced in contexts that are similar to one’s own. Evidence is also relevant when it is derived from a large number of studies conducted over a wide range of contexts, as this suggests that the educational approach is not dependent on any particular contextual factor.’
Evidence Rubric for educators and teachers
Australian Education Research Organisation. No date.
Tool
‘The Evidence rubric assists education practitioners and policymakers in:
– self-assessing how confident they can be that a certain approach is effective in their context
– deciding how to implement the approach given their level of confidence
– collecting evidence that may increase their confidence in the effectiveness of the approach.’
Research reflection guide
Australian Education Research Organisation. No date.
Tool
‘First identify a piece of research evidence on a particular approach that you are considering implementing. Then, answer the series of guiding questions below that will prompt you to consider: what the research says; how relevant the research is to your context; whether you should implement the approach; and what you can do to ensure successful implementation.’
Hidden gems – investigating the way research is used in schools
Toon. No date.
Blog
‘It is a common misconception that in order to use research evidence in their work, an educator just needs to find the right piece of research to tell them what to do in their classroom.
Usually, the perfect piece of research evidence does not exist. Instead, educators need to identify, understand, interpret and apply evidence from research to their classroom practice.’
The ‘educational research’ issue in English education
Dennis. 2020.
Blog
‘Education and teaching is not just one thing at a time. It can be many different things and even contradictory things.’
How I research… parts 1-6
Wright. 2021.
Blog
‘When I’m facing a big reading list, I want to get stuck in quickly to the topic positively and get some ideas bouncing around. Lively and short texts are a good way to do that. Once I’m in the zone I’ll tend to tackle meatier tomes.’
Landmark research integrity survey finds questionable practices are surprisingly common
de Vrieze. 2021.
Blog
‘More than half of Dutch scientists regularly engage in questionable research practices, such as hiding flaws in their research design or selectively citing literature, according to a new study. And one in 12 admitted to committing a more serious form of research misconduct within the past 3 years: the fabrication or falsification of research results.’
What Can We Do About Our Bias?
Benson. 2019.
Blog
‘Step 4: Normalize (Advanced level). Take steps to reduce the time and energy others have to spend challenging your blind spots and recruiting you to address the damage that you’ve contributed to. For example: actively seek out information and perspectives that challenge your own. Invite the best representatives of positions you don’t agree with to productive disagreements. Actively attempt to falsify your own beliefs.’
Cognitive bias cheat sheet
Benson. 2016.
Blog and poster
‘Cognitive biases are just tools, useful in the right contexts, harmful in others. They’re the only tools we’ve got, and they’re even pretty good at what they’re meant to do. We might as well get familiar with them and even appreciate that we at least have some ability to process the universe with our mysterious brains.’
Seven types of bias teachers are vulnerable to
Lockyer. 2015.
Blog
‘Consider for the moment the last three important decisions you made. What or who had a bias on those decisions?’
Confirmation bias
Noor. 2020.
Blog
‘Confirmation Bias is the tendency to look for information that supports, rather than rejects, one’s preconceptions, typically by interpreting evidence to confirm existing beliefs while rejecting or ignoring any conflicting data’
How you can dampen the effects of publication bias?
Ramaiah. 2021.
Article
‘Studies that show negative findings are systematically rejected because they are typically judged to have been poorly designed. The result is that the literature is skewed towards positive representations of the efficacy of given treatments and programmes, with no countervailing evidence to challenge it.’
The 7 deadly sins…of data analysis
Weiner. 2020.
Blog
Pride = Thinking you know better than the data.
Lust = Relations with unclean, but enticing data.
The debunking handbook
Lewandowsky. 2020.
Paper
‘It is important to protect people against being misinformed, either by making them resilient against misinformation before it is encountered or by debunking it after people have been exposed.’
On Problems with Educational Research
Kayfabe. 2021.
Blog
‘We need to consider the conditions under which the evidence was obtained, and whether that is reasonable to apply to the conditions in which we are working.’
Evidence in to action – winning hearts and minds
Weston. 2013.
Blog
‘It turns out that the dissemination of evidence is a process that is laced with emotions, relationships, trust and values.’
The many challenges of evidence-based teaching
Weston. 2012.
Blog
‘People are failing to implement new ideas due to ideology, trust, time, resources, habit, or one of many other reasons. Simply announcing new ideas is insufficient.’
Metascience: the one idea that could revolutionise educational research?
Ramaiah. 2020.
Blog
‘The whole cathedral is built on an edifice of misrepresentations and mythology.’
Can you really find research to back up any opinion?
Scutt. 2021.
Article
‘Given varied research findings, confirmation bias becomes crucial. We tend to uncritically accept research that confirms our existing beliefs while seeking fault in research that contradicts them.’
Research: Is all our evidence all it’s cracked up to be?
Fletcher-Wood. 2021.
Article
‘To use evidence well, we must acknowledge the merits – and the limits – of good ideas.’
The Open Door: How to be a Research-Sensitive School
Abercrombie. Haslam. 2021.
Paper
‘Research evidence has an impact on the culture of the school, shaping ideas of the right way of going about daily tasks. This is closely linked with the school’s moral purpose, of achieving the best outcomes for
children. By being evidence-informed, the choices made within the school are seen to be based on firm foundations, rather than the latest whim or fad.’
Thinking critically about educational claims
That’s a claim
Website and posters
‘A good choice is one that uses the best information available at the time. For education choices, this includes using the best available evidence of intervention effects. Good choices don’t guarantee good outcomes, but they make good outcomes more likely.’
Introduction to research: Judging the quality and trustworthiness of research evidence
Jones. Netolicky. 2019.
Article and poster
Could education research be leading the profession astray?
Ramaiah. 2021.
Article
‘Questionable research practices” are ubiquitous in scientific research… To produce findings that get published in these journals, scientists engage in a wide range of methodological and statistical gymnastics to contort their results into a form that makes them publishable.’
Facts Are More Important Than Novelty: Replication in the Education Sciences
Makel. Plucker. 2014.
Paper
‘If education research is to be relied upon to develop sound policy and practice, then conducting replications on important findings is essential to moving toward a more reliable and trustworthy understanding of educational environments.’
Building evidence into education
Goldacre. 2013.
Paper
‘Evidence based practice… is about empowering teachers, and setting a profession free from governments, ministers and civil servants who are often overly keen on sending out edicts, insisting that their new idea is the best in town.’
Appraising Evidence Claims
Gough. 2021.
Paper
‘For research evidence to inform decision making then it needs to be accessible to policy, practice, and individual decision makers. Research evidence can inform and researchers can advise but cannot alone make the decision.’
Making Education Research Relevant
Willingham. Daniel. 2021.
Paper
‘In theory, the goals of edu research are to build knowledge & improve decision-making & outcomes for teachers & students. In practice, edu research is shaped by the practices & priorities of researchers, not teachers or school/system leaders.’
Using Evidence in the Classroom: What Works and Why?
Nelson, O’Beirne. NfER. 2014.
Paper
‘The evidence needs to be contextualised for practice and presented in clear, accessible formats, using media which is accessible and includes practical guidelines for implementation, rather than simply being produced in its raw form.’
Evidence-informed pedagogy
Kirschner. Surma. 2020.
Article
‘Evidence-informed practice is still based on empirical evidence, but acknowledges the fact that it’s harder for real classroom practice to determine what works for whom under which circumstances.’
Evidence-informed teaching: evaluation of progress in England
DfE. 2017.
Paper
‘Use the term ‘evidence-informed’ teaching. This term emphasises that teaching, as a complex, situated professional practice, draws on a range of evidence and professional judgment, rather than being based on a particular form of evidence.’
Decolonising research
Decolonising research methodology must include undoing its dirty history
Ndlovu-Gatsheni. 2017.
Blog
‘What is at issue is re-search as a terrain of pitting the interests of the “re-searcher” against those of the “re-searched.” The core concern is about how re-search is still steeped in the Euro-North America-centric worldview. Re-searching continues to give the “re-searcher” the power to define. The “re-searched” appear as “specimens” rather than people.’
Psychology’s replication crisis is running out of excuses
Yong. 2018.
Blog
‘In considering “non-weird countries” together, it’s lumping together people from cultures as diverse as Mexico, Japan, and South Africa. “Cross-cultural research must be informed with thorough analyses of each and all of the cultural contexts involved.”
Whose Psychology Is It Anyway? Making Psychological Research More Representative
Reynolds, Cheon, Roberts. 2021.
Audio
‘There’s an automaticity when research is done in WEIRD contexts, that the results will apply everywhere. If research is done in non-WEIRD contexts, the results aren’t seen as universally applicable. The context is expected to be made explicit, whereas in non-weird contexts, it isn’t.’
Decolonising research
Abdi, Nvé Díaz, Jimenez and Calliou. 2020.
Video
‘I’m just very interested in how indigenous peoples talk about knowledge and and how their knowledge is not seen as as sort of anti-science but rather a form of science, a form of inclusive science that is millennia old and tested and just as scientific as everything else.’
What does a decolonised research culture look like?
Cin. Mkwananzi. 2020.
Blog
‘The time has come for researchers to start those uncomfortable conversations on how we can make research collaboration inclusive, respectful and equal.’
Psychology Still Skews Western and Affluent. Can It Be Fixed?
Schulson. 2020.
Blog
“It’s the issue that we all like to talk about, but nobody likes to actually change.”
An interview with Professor Linda Tuhiwai Smith: Decolonising Methodologies, 20 years on
. 2020.
Audio
‘You can’t claim that algorithms are neutral… embedded in them is inequality, iniquity, embedded in them is racism and sexism, and a denial of existence of multiple identities.’
Toward a psychology of Homo sapiens: Making psychological science more representative of the human population
. 2018.
Paper
‘It is important that research distinguishes between exploratory & confirmatory analyses, & uses appropriate analytical techniques. However, even the most perfect methods will not yield much if we gather data from such a narrow slice of humanity.’
Most people are not WEIRD
Henrich. Heine. Norenzayan. 2010.
Paper
‘Researchers and policy-makers should recognise that populations vary considerably in the extent to which they display certain biases, patterns & preferences.’
Conducting research
Education Research Is Still Too Dense. We Need More Teacher-Researcher Partnerships.
Simmers. 2021.
Blog
‘Get comfortable with asking questions such as “What research are we drawing on here?” or “What evidence do we have that this would work in our setting?”
Building bridges for teachers as researchers
Chudasama. 2020.
Paper
‘My role is a coordinating one, concerned with boundary spanning and building bridges to encourage practitioner research and link teacher-researchers across schools and with the wider research community’
What does “evidence-based practice” look like in practice?
Flood. 2018.
Blog
‘Making use of key teachers as opinion-formers and research-translators has, in part, bridged the gap between academic research and class teachers.’
Ethical Guidelines for Education Research
BERA. 2018.
Paper
‘We recommend that at all stages of a project – from planning through conduct to reporting – educational researchers undertake wide consultation to identify relevant ethical issues, including listening to those in the research context/site(s), stakeholders and sponsors. This means that ethical decision-making becomes an actively deliberative, ongoing and iterative process of assessing and reassessing the situation and issues as they arise.’
