Designing initiative evaluation: A systems-orientated framework for evaluating social change efforts

This guide from the W. K. Kellogg Foundation outlines a systems-oriented framework for initiative and cluster evaluation and includes four general designs that can be used.

Each of the designs has separate sections on: designing; planning and engaging in data collection; and making meaning from the data and shaping practice.

Excerpt

"Project evaluation and initiative evaluation serve different purposes and involve different stakeholders. A project evaluation focuses on the specific project of a grantee and serves the needs of the project leaders and participants.

On the other hand, an initiative evaluation looks across projects and their meaning within the initiative as a whole. It serves the learning needs of WKKF, particularly program staff, as well as initiative grantees. It also informs the broader funder and practitioner fields in which WKKF works. Project evaluators are selected by each grantee whereas the initiative evaluator is selected by the WKKF initiative leaders." (W. K. Kellogg Foundation, 2007)

Contents

• General Orientation to Initiative Evaluation 1
  • Cluster and Initiative Grantmaking at WKKF 1
  • The Complementary Nature of Project and Initiative Evaluation 2
  • Phases of Initiative Evaluation 4
  • Systems Perspective and Initiative Evaluation 5
• A Framework for Initiative Evaluation 7
• Four Evaluation Designs for Initiative Evaluation 10
  • Overview 10
    • Design Considerations and Foci 11
  • Exploratory Evaluation Design14
    • A. Introduction14
    • B. Designing an Exploratory Evaluation14
    • C. Planning and Engaging in Data Collection 16
    • D. Making Meaning from Data and Shaping Practice 17
  • Predictive Evaluation Design 19
    • A. Introduction19
    • B. Designing a Predictive Evaluation 20
    • C. Planning and Engaging in Data Collection 21
    • D. Making Meaning from Data and Shaping Practice 22
  • Self-organizing Evaluation Design 25
    • A. Introduction25
    • B. Designing a Self-organizing Evaluation 26
    • C. Planning and Engaging in Data Collection 28
    • D. Making Meaning from Data and Shaping Practice 29
  • Initiative Renewal Evaluation Design31
    • A. Introduction31
    • B. Designing an Initiative Renewal Evaluation32
    • C. Planning and Engaging in Data Collection 35
    • D. Making Meaning from Data and Shaping Practice 37
  • Summary of Features of the Four Evaluation Designs38