It is important to develop an estimate of the resources that are available for evaluation and what will be required to do the evaluation well.
The resources needed for an evaluation include:
- existing data
- funding to engage an external evaluator or evaluation team or pay for specific tasks to be undertaken and for materials and travel
- time, expertise and willingness to be involved of staff, partners, technical experts and the wider community, whether as part of the evaluation team, the evaluation governance processes and/or key informants and data sources
When considering what data are already available, look carefully at the quality of existing data and what format it is in.
Also, clarify the skills and availability of any people who will need to be involved in the evaluation.
There are five main ways of developing an estimate of the budget for an external evaluation:
- Calculating a percentage of the program or project budget – sometimes 5%-10%. This is a very crude rule of thumb. Large programs with simple evaluation might need a lot less; small programs with large evaluations – for example, detailed testing and documentation of an innovation – will need much more. It is also better to target evaluation resources across programs where they will be most useful.
- Developing an estimate of days needed and then multiplying by the average daily rate of an external evaluator. This is only useful for simple evaluations, especially those using a small team and a standardised methodology such as a few days of document review, a brief field visit for interviews and then a short period for report write up.
- Using the average budget for evaluations of a similar type and scope. This can be a useful starting point for budget allocation providing that the amounts have been shown to be adequate in the past – otherwise this will perpetuate the problems of underestimates.
- Developing a draft design and then costing it, including collection and analysis of primary data. This can be done as a separate project before the actual evaluation is contracted.
- Consider the following options if ongoing evaluation input is needed such as for a Developmental Evaluation: retainer fee contracts; stepwise funding; or, speculate and allow for contingencies. More information about these options can be found in this interview with Michael Quinn Patton.
Allow time to secure resources (for example, including them in an annual or project budget, or seeking someone with particular expertise). If the resources required for the evaluation are more than the resources available, additional resources will need to be found and/or strategies used to reduce the resources required, such as reducing the scope of the evaluation.
Possible Products
- Estimated cost of an evaluation (ideally including in-kind, cash, internal and external costs)
- Justification for expenditure on evaluation
- Statement of available evaluation resources (including budget)
Further information & Resources
- Estimate evaluation resources needed – provides further guidance and resources
- Strategies for reducing the costs of an evaluation
- Sample evaluation budgets
- Examples of justification of increased evaluation budget
- Examples of identified resources for evaluation
You are currently here:
+ - 2. Scope the evaluation
- Clarify what will be evaluated
- Describe the theory of change
- Identify who are the primary intended users of the evaluation and what will they use it for
- Develop agreed key evaluation questions
- Decide the timing of the evaluation
- Decide whether the evaluation will be done by an external team, an internal team or a hybrid of both
- Determine the evaluator qualities
- Identify what resources are available for the evaluation and what will be needed
Comments
Insightful information there.Thanks
Add new comment
Login Login and comment as BetterEvaluation member or simply fill out the fields below.