Alice Macfarlan

Profile image

I'm interested in the reporting of evaluation and visualising data

Contributed by this member

Blog

Resource

Method

  • Reviewing documents produced as part of the implementation of the evaluand can provide useful background information and be beneficial in understanding the alignment between planned and actual implementation.
  • Face-to-face questionnaires are conducted by an interviewer asking questions of a respondent in person.
  • Email Questionnaires are surveys or questionnaires that are distributed online via email.
  • Mentoring is a process where people are able to share their professional and personal experiences in order to support their development and growth in all spheres of life.
  • Interactive mapping involves using maps that allow zooming in and out, panning around, identifying specific features, querying underlying data such as by topic or a specific indicator (e.g., socioeconomic status), generating reports and oth
  • Data cleaning involves the detection and removal (or correction) of errors and inconsistencies in a data set or database due to data corruption or inaccurate entry. 
  • Measures of Central Tendency provide a summary measure that attempts to describe a whole set of data with a single value that represents the middle or centre of its distribution.
  • Big data refers to data that are so large and complex that traditional methods of collection and analysis are not possible. 
  • Data backup refers to onsite and offsite, automatic and manual processes to guard against the risk of data being lost or corrupted. 
  • Processes to protect electronic and hard copy data in all forms, including questionnaires, interview tapes and electronic files from being accessed without authority or damaged.
  • Timelines and time-ordered matrices are useful ways of displaying and analysing time-related data.
  • A framework matrix is a way of summarizing and analyzing qualitative data in a table of rows and columns.
  • A data use calendar is produced to guide the collection of data and reporting requirements, as well as ensuring that analysis and evaluation data is actively used.
  • Questionnaires can be mailed out to a sample of the population, enabling the researcher to connect with a wide range of people.
  • An in-depth interview is a type of interview with an individual that aims to collect detailed information beyond initial and surface-level answers.
  • Graphic recording is the translation of conversations into images and text on large sheets of paper during meetings and events.
  • Non-participant Observation involves observing participants without actively participating.
  • Lessons learnt can take the form of describing what should or should not be done, or describing the outcome of different processes.
  • An internet questionnaire allows the collection of data through an electronic set of questions that are posted on the web. 
  • A feedback workshop is a meeting that brings together evaluators and key stakeholders in which the findings of an evaluation are discussed.
  • Correlation is ​a statistical measure ranging from +1.0 to -1.0, represented by 'r', that indicates how strongly two or more variables are related and whether that relationship is positive or negative.
  • Key informant interviews involve interviewing people who have particularly informed perspectives on an aspect of the program being evaluated.
  • Analytical generalisation involves making projections about the likely transferability of findings from an evaluation, based on a theoretical analysis of the factors producing outcomes and the effect of context.
  • Measures of dispersion provide information about how much variation there is in the data, including the range, inter-quartile range and the standard deviation.
  • An important aspect of data quality is to ensure data is collected consistently across different sites and different data collectors.
  • Effective data transfer involves processes to move data between systems, including between software packages, to avoid the need to rekey data. 
  • Putting systems in place to store de-identified data so that they can be accessed for verification purposes or for further analysis and research in the future, researchers can extend the range of the data collection efforts and encourage fu
  • A community of practice allows a group of people with a common interest or concern to share and learn through a series of interactions, thus reflecting the social nature of human learning.
  • There are a number of ways that documents can be made more accessible to people who are blind or have low vision.
  • A key to creating effective and accessible reporting documents is using effective techniques to emphasise important information.
  • Questionnaires and surveys can be conducted through mobile phones which are able to connect to the internet.
  • Evaluation journals play an important role in documenting, developing, and sharing theory and practice. They are an important component in strengthening evaluation capacity.
  • Multiple lines and levels of evidence (MLLE) is a systematic approach to causal inference that involves bringing together different types of evidence (lines of evidence) and considering the strength of the evidence in terms of different ind

Approach

  • An impact evaluation approach based on identifying and investigating the most successful cases and seeing if their results can justify the cost of the intervention (such as a training course).
  • An impact evaluation approach based on identifying and investigating the most successful cases and seeing if their results can justify the cost of the intervention (such as a training course).

Theme

  • Footprint evaluation aims to embed consideration of environmental sustainability in all evaluations and monitoring systems, not only those with explicit environmental objectives.
  • Footprint evaluation aims to embed consideration of environmental sustainability in all evaluations and monitoring systems, not only those with explicit environmental objectives.