Expert panels in evaluation: An update from the field using the DATA model

In this practice note, the authors apply the Describe, Analyse, Theorise, Act (DATA) model to reflect on the use and utility of expert panels in evaluation.

They carry out interviews with evaluators and collect insights from peer-reviewed literature and their own professional observations. Connections are made to larger evaluation discourses regarding reflection, expert opinion, expertise, epistemic authority, and lived experience.

The study found that

"expert panels are generally underutilised in evaluation due to a lack of awareness among evaluators as well as the perceived complexity associated with this method. However, the literature and interviews were clear that, when managed properly, expert panels can add tremendous value to an evaluation. There is therefore merit for more seriously considering panels in future evaluations."

In the Act section of the article, the authors provide recommendations for the "evaluation community (professional associations, universities, researchers, professors, etc.)" and evaluation managers to help guide decision-making about whether to include an expert panel in an evaluation's design.