Peer-assessment

Peer assessment can provide additional benefits beyond self-assessment – in particular, the opportunity for peer learning through the review process.

Example(s)

UKES in collaboration with EES is conducting a pilot of voluntary evaluator peer review (VEPR) (UKES 2014). The approach does not seek to judge a candidates' evaluation capabilities or competence, but rather their willingness to submit to a professional review structured around a capabilities framework.”

Applicants are those with:

  • Evidence of minimum two years equivalent work in evaluation and/or evaluation related activities
  • Significant involvement (based on role e.g. purchaser, provider or manager) in a diverse portfolio of evaluation projects
  • Evidence of relevant academic qualifications and previous professional development initiatives

The following process is used:

  • The applicant nominates two preferred peer reviewers from the VEPR reviewer 'pool'
  • The applicant submits a completed application nominating (1) 2-3 areas of evaluation practice on which they wish to focus and (2) two recent projects on which to focus the review (note: this may require commissioners' and/or colleagues' permission)
  • A standardised review process will be based on a set of questions that require the applicant to address selected capabilities in the society's capability framework, based on their current and recent practice, within a review meeting of approximately two hours (ideally face-to-face)
  • Applicant and reviewers consult to compile a list of agreed questions for the applicant to address
  • Applicant submits short written answers to each question of the two reviewers
  • The review takes place either face-to-face or via Skype or teleconference
  • Where satisfactory, reviewed applicants' names listed on an online VEPR Index (see below) on the society's website, as evidence of a 'satisfactory' review
  • Listing on the VEPR Index lapses automatically after three years unless renewed via a further VEPR.

Advice

Advice for USING this option

  • Guidelines on how to give and receive feedback during peer review should be discussed or formalised before beginning a review process. This can include a set of agreed questions for the review, or identification of competencies to be addressed.
  • Organisations, evaluation associations and societies may consider creating a peer-review assessment tool and supporting members to take this up on a voluntary basis.
This page is a Stub (a minimal version of a page). You can help expand it. Click on Contribute Content or Contact Us to suggest additional resources, share your experience using the method, or volunteer to expand description.

Sources

Peersman, G. and Rogers, P. (2017). Pathways to advance professionalisation within the context of the Australasian Evaluation Society. Melbourne: ANZSOG/BetterEvaluation. Retrieved from:  https://www.betterevaluation.org/en/resources/pathways-advance-professio...

UKES (2014). Voluntary Evaluator Peer Review. An introduction to the proposed UKES Pilot. https://www.europeanevaluation.org/Voluntary%20Evaluator%20Peer%20Review. 

Cite this page

BetterEvaluation (2018). Peer-assessment. Retrieved from http://betterevaluation.org/evaluation-options/Peer-assessment

Updated: 2nd August 2018 - 5:45pm
This Option is useful for:
A special thanks to this page's contributors
Author
Deputy Director/BetterEvaluation Project & Associate Professor/ANZSOG, The Australia and New Zealand School of Government (ANZSOG).
Melbourne, Australia.
Author
Director of BetterEvaluation/ Professor of Public Sector Evaluation, Australia and New Zealand School of Government.
Melbourne.

Comments

There are currently no comments. Be the first to comment on this page!

Add new comment

Login Login and comment as BetterEvaluation member or simply fill out the fields below.