Guide production of quality report(s)

Evaluation, by definition, answers evaluative questions, that is, questions about ‘quality’ (how good something is) and ‘value’ (taking into account the specific situation such as the resources used to produce the results and the needs it was supposed to address). Evaluative reasoning is required to synthesize dimensions of quality and value to formulate defensible (i.e., well reasoned and well evidenced) answers to the evaluative questions.

The structure of an evaluation report can do a great deal to encourage the succinct reporting of direct answers to evaluative questions, backed up by enough detail about the evaluative reasoning and methodology to allow the reader to follow the logic and clearly see the evidence base.

The following recommendations will help to set clear expectations for evaluation reports that are strong on evaluative reasoning:

  1. The executive summary must contain direct and explicitly evaluative answers to the key evaluation questions (KEQs) used to guide the whole evaluation.
  2. Explicitly evaluative language must be used when presenting findings (rather than value-neutral language that merely describes findings). Examples should be provided.
  3. Use of clear and simple data visualization to present easy-to-understand ‘snapshots’ of how the intervention has performed on the various dimensions of merit.
  4. Structuring of the findings section using KEQs as subheadings (rather than types and sources of evidence, as is frequently done).
  5. There must be clarity and transparency about the evaluative reasoning used, with the explanations clearly understandable to both non-evaluators and readers without deep content expertise in the subject matter. These explanations should be broad and brief in the main body of the report, with more detail available in annexes.
  6. If evaluative rubrics are relatively small in size, these should be included in the main body of the report. If they are large, a brief summary of at least one or two should be included in the main body of the report, with all rubrics included in full in an annex.

A hallmark of great evaluative reasoning is how succinctly and clearly key points can be conveyed without glossing over important details.

[Source: Davidson J. Evaluative reasoning. UNICEF Methodological Brief 4 on Impact Evaluation. Florence: UNICEF]

Products

  • Evaluation report
  • Products tailored to different audiences: Evaluation summary, Policy Brief, Newsletter, Conference presentation etc.

Further information & Resources

IDRC-specific information: 
If you are an IDRC member, please login to see information specific to IDRC.
You are currently here:
Click here to view full menu

Comments

There are currently no comments. Be the first to comment on this page!

Add new comment

Login Login and comment as BetterEvaluation member or simply fill out the fields below.