Synthesise data from a single evaluation

To develop evaluative judgments, the evaluator draws data from the evaluation and systematically synthesises and values the data.

There are a range of methods that can be used for synthesis and valuing.

Methods

Processes

  • Consensus conference

    A consensus conference is a formal public meeting, which gives the general public the chance to contribute to and be involved in the assessment of an issue or proposal.

  • Expert panel

    Expert panels are used when specialized input and opinion is required for an evaluation.

Techniques

  • Cost-benefit analysis

    This method compares the total costs of a programme/project with its benefits, using a common metric (most commonly monetary units), which enables you to calculate the net cost or benefit associated with the programme. 

  • Cost effectiveness analysis

    Cost-effectiveness analysis (CEA) compares the relative costs of the outcomes of two or more courses of action and is considered an alternative to cost-benefit analysis (CBA). 

  • Cost utility analysis

    Cost utility analysis (CUA) develops an overall measure of utility or value based on the preferences of individuals.

    CUA is useful for evaluating, and comparing, programs that aim to reach the same goal in non-monetary terms.

  • Lessons learnt

    Lessons learnt can take the form of describing what should or should not be done, or describing the outcome of different processes.

  • Multi-criteria analysis

    A multi-criteria analysis (MCA) is a form of appraisal that measures variables such as material costs, time savings and project sustainability as well as the social and environmental impacts in addition to monetary impacts.

  • Numeric weighting

    Numeric weighting involves developing numeric scales in order to rate performance against each evaluation criterion and then adding them up for a total score.

  • Qualitative weight and sum

    Using qualitative ratings (such as symbols) to identify performance in terms of essential, important and unimportant criteria.

    "In QWS:

  • Rubrics

    A rubric is a framework that sets out criteria and standards for different levels of performance and describes what performance would look like at each level.

  • Value for money

    Value for money is a term used in different ways, including as a synonym for cost-effectiveness, and as systematic approach to considering these issues throughout planning and implementation, not only in evaluation.

Approaches

  • Social return on investment

    Social Return on Investment (SROI) is a systematic way of incorporating social, environmental, economic and other values into decision-making processes.

'Synthesise data from a single evaluation' is referenced in:

Back to top