Multiple dimensions of evaluation in fragility, conflict and violence

This chapter explores the complexities of evaluating in conflict-affected and fragile contexts, highlighting the political nature and potential to exacerbate violence.

Key content

Key takeaways from the resource include:

Introduction

This chapter by Aronsson and Hassnain (2021) critically reflects on the multiple dimensions of evaluation in fragility, conflict, and violence (FCV), especially in light of global challenges such as the COVID-19 pandemic. It aims to achieve transformational change within the broader frame of the Sustainable Development Goals (SDGs). The authors discuss the political, complex, and potentially violence-exacerbating nature of evaluations in FCV contexts, emphasizing the need for robust monitoring and evaluation systems and the importance of collaboration with local communities.

A frame for evaluation in FCV

The chapter sets the stage by highlighting the critical need for evaluation in FCV contexts, where a significant portion of the world’s poor reside. It underscores the challenges posed by the unpredictability and complexity of these environments, which complicate efforts to achieve the SDGs, particularly SDG 16 on peace, justice, and strong institutions.

Key challenges of evaluation

• Defining how change happens: Evaluations in FCV contexts often lack strong theoretical foundations and a robust evidence base, making it difficult to determine what works.
• Fluidity: The unpredictable and transitional nature of FCV contexts complicates comparative analysis and consistent data collection.
• Risk of violence: The threat of violence can limit face-to-face interactions and data collection efforts.
• Trust: Evaluations are fundamentally political and contested, making it difficult to agree on indicators and tools.
• Learning: Rapidly changing contexts and low trust levels hinder learning and data sharing.

The guiding statements

The authors provide guiding statements for evaluators in FCV contexts, emphasizing the importance of context, safety, realistic approaches, ethical protocols, adaptive management, participatory monitoring, conflict analysis, and the use of mixed methods and technology.

A pedagogy for FCV evaluation training

The chapter discusses a participatory workshop conducted at the 2019 IDEAS Global Assembly, which gathered evaluation experts to explore methods and theoretical implications for evaluation in FCV environments. The workshop validated the challenges and guidelines presented, leading to the development of a toolbox for evaluation in FCV contexts.

Further thoughts on evaluation in wicked environments

The authors argue that evaluation in FCV contexts is inherently more complex due to the fluid, violent, and unstable nature of these environments. They highlight the need for dynamic evaluation approaches, such as Feinstein’s learning loop, and stress the importance of a comprehensive understanding of the context.

The COVID-19 global pandemic and FCV evaluation

The chapter examines the impact of the COVID-19 pandemic on FCV contexts, noting that the economic downturn in lower- and middle-income countries is likely to lead to increased violence and instability. It discusses how different regions have responded to the pandemic and the implications for evaluation practices.

Violent extremism and evaluation methods

The authors explore a case study of evaluating countering violent extremism (CVE) programs in Europe, highlighting the need for realistic evaluation approaches that consider gender perspectives and local contexts. They discuss the importance of multi-method data collection and the challenges of evaluating exit programs for female jihadists.

Conclusion

The chapter concludes by emphasizing the importance of integrating sensitivity into the design and implementation of evaluations in FCV contexts. It highlights the need for comprehensive tools and resources, a deep understanding of the context, and flexibility from both evaluators and donors. The authors call for a shift in focus from projects to strategies and policies, recognizing the challenges of achieving transformational change in FCV environments.