Peace Field Peers Agree: Evidence-Based Practice Is Key

evidence based practice peacebuilding

The idea of evidence-based work is important to OEF: one of our core values is a commitment to be “relentlessly empirical” in the design and assessment of our strategies and impact in peacebuilding. In this, we’re part of a larger discussion around evidence-based practice in peacebuilding that can sometimes be contentious. In an ongoing effort to better understand the field, OEF and Alliance for Peacebuilding released a report last month detailing the findings of a survey of professional peacebuilders on their ideas about evidence-based practice in peacebuilding. The results suggest that despite the debate, the field as a whole has a pretty developed understanding of what evidence is needed, where it exists, and where it’s lacking.

The basic idea of evidence-based practice isn’t exciting - it’s just the idea of learning what works and doing that. In some form, it’s been the basis of human society since the foundation of civilization. Humans used willow bark to treat pain for thousands of years before its key compounds were identified and aspirin was synthesized, and for almost a hundred years after that until its mechanism was understood. The tension, of course, comes in when a field as a whole debates the idea of evidence-based practice because that will by its nature create winners and losers. The details of what kinds of evidence count, and who gets to make those decisions, become important and they become political. This is particularly true once issues of resources come into play, and in the peacebuilding field the recent (and largely positive) emphasis on improved monitoring, evaluation, and learning that funders have requested means that issues of resources are directly in play.

Because of that, it’s perhaps not surprising that the tenor of the discussion around evidence can at some times be a little tense, something exacerbated by the rise in the last 10-15 years of the “randomistas,” or proponents of the use of experimental methods (or “Randomized Controlled Trials”) as the pre-eminent type of evidence supporting evidence-based practice. This approach turns the idea of evidence into a methods debate, an argument about essentially the philosophy of knowledge but one that has real monetary impact. If a funder requires a specific form of evidence, then programs without that evidence will struggle to get funding. This raises the stakes of a discussion where there’s already fairly strong (and opposing perspectives). As such, it’s perhaps not surprising to see arguments around evidence-based practice in peacebuilding take fairly strong and argumentative positions - from the founding Executive Director of the International Initiative for Impact Evaluation and RCT proponent arguing that “Most interventions don’t work, most interventions aren’t evaluated and most evaluations are not used. As a result, billions of dollars of money from governments and individual donations is wasted on ineffective programmes” to arguments that “the limitations of randomista economics have given rise to a particular way of thinking characterized by piecemeal analysis, ad hoc resort to theory, indifference to history and context, and methodological fundamentalism.”

Against that backdrop, we went into our research expecting to find passionate disagreement between different sectors of the peacebuilding field around evidence-based practice, and we largely didn’t. Instead, we found significant consensus. The respondents to our survey largely valued the idea of evidence-based practice in the abstract, and in practice they defined the idea of evidence not by any one specific method (in the most part), but instead by multiple sources of evidence using multiple methods. In fact, about twenty percent of the responses rejected the idea that methods-as-methods mattered much at all, and instead argued for the need for quality evidence more broadly: evidence that appeared to grapple effectively with issues of bias and the various sources of misanalysis and misinformation that could easily crop up in assessments and research.

Using that definition, participants also felt that the field had a good understanding of what peace looks like: they felt that there was a good amount of evidence describing, in general, the conditions necessary for sustainable peace. In contrast, only three of the conditions asked about had evidence suggesting we know how to deliver them. That is, the field may know what peace looks like - but how to get there from here is, for the most part, something where more research is needed. It’s significant, perhaps, that two of the three specific items where people thought evidence existed were part of the Women, Peace, and Security Agenda - increasing women’s engagement in economic and political life broadly, and in peacemaking specifically. There is an argument that there is no conceptual area where the gap between what the world knows needs to be done (and how to do it) and where we are as a global society is quite as large as it is with the WPS agenda specifically, and this survey does support that argument.

We went into this survey expecting to highlight differences within the field for deeper discussion. Instead, we found that the field actually has fairly strong agreement over core issues. We care about evidence, and we want good evidence of all kinds to inform our work. That finding provides, for us, some optimism that we have a strong foundation to build from as a field.

Read more about the survey and its findings here.

  • Getting to Peace Using Open Source Data

    The world is complex enough when everyone is operating with the same set of underlying facts on any given topic. When those facts are hidden or manipulated, overcoming intractable conflict becomes nearly impossible. Sharing open source data among adversarial governments, within governments, and between “Third Siders” and conflict parties gives us a greater chance than ever before to manage complexity and get to peace. Read More
  • ONN Director Laura Rockwood at European Parliament's Korea Delegation Meeting

    On 1 July 2021, Open Nuclear Network (ONN) Director Laura Rockwood participated in a meeting organised by the Delegation for Relations with the Korean Peninsula (DKOR) of the European Parliament. The discussions focused on prospects for denuclearisation of the Korean Peninsula and recent relevant developments. Read More
  • peacebuilding requires learning, communication, standards, and transparency

    Key Themes From Evidence-based Practice Digital Workshop

    Findings from the recent global study and report from One Earth Future and the Alliance for Peacebuilding was at the center of a digital workshop event on May 14th that was hosted in partnership with the Better Evidence Project at George Mason University. We breakdown some of the main takeaways and conclusions from the event's discussions. Read More
  • networked coordination an effective approach to peacebuilding

    Using Coordination as a Key to Peacebuilding

    The challenges of peacebuilding involve maximizing the contribution of multiple technical experts in an often quickly changing environment, and one where participants may not always trust all other participants or where they may be concerned about maintaining their individual authority to make decisions. OEF's Conor Seyle shares how a coordinated approach to peacebuilding can be most effective in these conditions. Read More
  • Chadian president Idriss Deby killed

    Risk of Instability on the Rise for Chad and the Sahel Region

    Following the announcement by the Chadian government on April 20 that president Adriss Deby had died after 30 years in power, OEF analyst Matthew Frank breaks down the poltical situation in Chad and discusses what OEF's CoupCast data shows about the risk for further instability in the country and throughout the greater Sahel region. Read More
  • the important of using evidence to make decisions in peacebuilding

    How Do We Get to an Earth Without War?

    OEF's Executive Director and Chief Operating Office, Jon Bellish talks about OEF's commitment to Relentless Empiricism as core to its belief in and support of iterative problem-solving and careful, analytical design. He discusses how OEF relies on evidence to cut through complexities in order to solve concrete problems at the root of armed conflict, and bring new, collaborative forms of governance into being in its place. Read More