C4D: Learning-based

Action-learning; adaptive; capacity development; critical reflection

In a learning-based approach RM&E is integrated into the whole programme cycle and involves all staff and stakeholders. This principle draws on some of the core principles of action learning and participatory action research (PAR), including iterative reflection on implementation for continual improvement. Involving a broad group of stakeholders in R,M&E requires attention to capacity development and learning processes and events.

Where do we start?

It can be useful to begin by Reviewing R,M&E (meta evaluation) with a focus on previous efforts in order to understand: what worked well? what didn't work well? who was involved? how can the current initiative build on that? 

To consider how learning fits into a new R,M&E initiative begin by Deciding on the purpose, and more specifically how the primary intended users intended to use R,M&E can help to clarify the expectations in terms of learning from R,M&E, and how this balances with accountability-focused purposes.

Develop R,M&E capacity, which should begin with an assessment of existing capacities, can also be a starting point for implementing the learning-based principle. It is especially useful to think about how capacity building processes can support participatory approaches to R,M&E. 

Incorporating and implementing learning-based approaches in practice

Manage (and commission) an evaluation  or evaluation system 

Understand and engage stakeholders: 

To effectively implement the C4D Evaluation Framework, a receptive organisational and community context and culture is required. Staff of organisations at all levels and relevant community members need to be willing to engage in constant reflection and learning from R,M&E in order to continually develop and improve organisational systems and C4D initiatives. This is dependent upon meaningful stakeholder engagement in the beginning and continuing throughout implementation.

Establish decision making processes:

Decision making processes and structures (such as an ongoing technical working group) should emphasise leadership and responsibilities for knowledge management, exchange and utilisation to ensure continuous learning, mutual understanding and creative ideas and thinking.  

Decide who will conduct the R,M&E: 

In contexts where it is difficult to find available, local evaluators with the skills and knowledge to be able to undertake C4D evaluation and studies, partnerships with capacity building components can be considered.

Develop Planning Documents (Evaluation Plans and MnE Frameworks): 

Learning events, structures and processes (inclusive of all partners and community groups involved in implementation) should be built into M&E Frameworks and Evaluation/Research Plans. M&E Frameworks should be flexible enough to accommodate emergent issues. Some organisations are starting to refer to 'Monitoring, Learning and Evaluation Frameworks' to emphasise the importance of considering how frameworks can support learning in addition to producing information. 

Document management processes and agreements: 

Recruiting consultants with expertise in both C4D and the specific program area can be challenging. It is even more difficult when seeking local or regionally based consultants. Consider what kinds of expertise are required, what kinds are desirable, and what kinds are easily translatable from similar fields and approaches. Also consider whether capacity building and mentoring partnerships can be incorporated to fill gaps. See also Decide who will conduct the research/evaluation (or other study or monitoring). 

Reviewing R,M&E (meta evaluation): 

Including review or meta-evaluation processes in C4D R,M&E systems is a key part of being learning-based, using critical reflection processes, and it contributes to capacity development. The aim is to continually strengthen and improve R,M&E processes so that they better meet the needs of the people and organisations involved and help to create more sustainable, learning-oriented C4D organisations and initiatives.

Develop R,M&E capacity:

Including capacity development processes in C4D R,M&E systems is a key part of being learning-based. This process should begin with a preliminary assessment of R,M&E capacities of local groups and institutions. What sort of ongoing training, support or mentoring might be needed? What sorts of local research training institutions are available? How can this best be delivered?

Define

Develop initial description: 

This process should be seen as open to revision as the R,M&E proceeds and new learnings emerge that have implications for the focus of the M&E.  

Developing a program theory/logic model:  

Program Theories and logic models can be used at various stages of the program cycle. In a learning-based approach, these would be developed over time as more knowledge becomes available:

• The design stage of the strategic planning process should include the development of a theory of change. For example, this might be one of the last tasks of a situation analysis.
  • This may be revisited mid-cycle, especially in more complex and unpredictable initiatives where it is more likely it is that you will need to revise and build on your theory of change as you learn more.
• In evaluation studies and final evaluations program theories should inform the design of evaluations. Revising (or, where none exist, creating) a program theory may be one of the first tasks of the evaluation.

Frame 

Deciding on the purpose: 

The approach advocated by the C4D Evaluation Framework is to use R,M&E processes for adaptive and learning-based process, so that findings can be fed into ongoing C4D activities. This is because most C4D activities are complicated or complex (to understand the nature of your activity see Complexity). 

Describe (to answer descriptive questions) 

Use measures, indicators or metrics: 

Indicator selection should be focused on the type of ‘summary’ information that can tell us whether or not the intervention is ‘on track’ in terms of its implementation and anticipated results. Where the intervention content or implementation needs to be very adaptive and/or the results cannot be fully defined in advance (such as in complex situations), different indicators may need to be selected at different times during the intervention period. The indicators should help to answer the ‘key learning questions’ that are posed at various times.

Data management: 

Related to the participatory approach, it is important to consider whether stakeholders may need capacity building support to be able to effectively manage data.

Understand causes (to  answer questions about  causes and contributions)  

Investigate Causal Attribution and Contribution: 

The learning needs may determine which combination of strategies will be most useful. While designs creating a counterfactual (strategy 1) are best in situations where strong hypotheses (theories) are known and need to be tested and proven, they are not as well suited in more exploratory situations.

A combination of Strategy 2: Check the results support causal attribution and Strategy 3: Investigate possible alternative explanations (strategy 3) can be used where there is a need to learn about and better understandings of causes and changes. 

Report and support use 

Supporting use: 

This task contributes to a learning-based approach through taking seriously the tasks associated with supporting the use of findings in future programs and phases.

Challenges and strategies

People often assume that 'learning' is just a given part of any R,M&E that has recommendations and lessons learned section of the report, and assume that no special attention or planning is required.  

Being learning-based is both an approach, and a set of deliberate processes and strategies. It's an approach that requires more flexible, adaptive systems to allow for initiatives to grow and change as more understanding is developed. Deliberate processes and strategies, such as Reviewing R,M&E (meta evaluation), Developing R,M&E capacity, and thorough processes to Generalise findings, Develop recommendations, and support use are key to a committed learning-based approach. Examples may include learning-committees, annual reviews etc.

People sometimes assume that being 'learning-based' demonstrates a lack of commitment to accountability.  

The C4D Evaluation Framework would suggest that learning is a form of accountability. In most cases these two purposes can be balanced. See the Decide purpose task to work through the options.  

How can we be adaptive and emergent in our approach using Results Frameworks?  

It is quite hard to be adaptive and emergent when using Results Frameworks. Although they can be adjusted at certain times, they require heavy planning and are difficult to use for truly adaptive and emergent implementation. There are other options. See  Develop Planning Documents (Evaluation Plans and M&E Frameworks) for details of options compatible with adaptive and emergent approaches.