Search

Primary tabs

Show search hints
Did you mean
results make

Search results

  1. August 2013 Events

    Page

     

    Here are some past events of interest to the evaluation community. Please don't hesitate to suggest an event.

    Find upcoming and also other past events on the right hand side.

  2. ToC table

    Page
    Process Inadequate practice Adequate practice Better practice
    1. Process for developing the theory of change Brainstorm with Post-It notes or just repackage planning documents
  3. Browse Questions

    Page
    Browse through these frequently asked questions (and our answers!) for some helpful thoughts on this new website, as well as evaluation theory and practice.

    High-level Questions

  4. Formalise accountability processes on ethical practice

    Page

    Accountability principle

    Include appropriate mechanisms and procedures for reporting on ethical aspects of the research and complying with this ethical protocol.

    Click here to find out how to put this into practice

    Application

    Formalise the free, prior informed consent with a form for participants to sign. Consider including a check list to make sure each element of the evaluation has been discussed and understood by the participant.

    Develop a photo /video consent form if taking photos and footage of community members that may have not signed a consent form to participate in the evaluation. Explain how the photos and footage will be used before asking for consent.

    Contracts with evaluation commissioners must allow communities access to, and ownership of, data collected and created as a result of the evaluation, including all reports created.

    Consider the use of an ethics committee or independent assessment of the ethical approach of an evaluation. Check in regularly with the committee or assessor if changes have been made to the evaluation process or team members. Where available, include a community-based ethics group.

    Prioritise self-determination, community agency and self-governance Please look at all the other themes – they are equally important Key themes Barriers Limited scope from commissioner Power and privilege Limited cultural understanding Can’t find community protocols Time restrictions No cultural mentor No tools or templates Data gate keeping Resource constraints Communicate transparently, build trust and obtain individual and community consent Strengths-based recognition of cultures, acknowledging communities and individuals Share benefits and apply two-way learning Formalise accountability processes on ethical practice Facilitate control and data sovereignty COURAGE, INTEGRITY, & CULTURAL HUMILITY

    Acknowledgements

    We would like to acknowledge and thank Maria Stephens, an Arrabi/Binning woman who speaks the Iwaidja language. She generously provided her artwork for this page.

  5. Approaches

    Page

    Approaches (on this site) refer to an integrated package of options (methods or processes). For example, 'Randomized Controlled Trials' (RCTs) use a combination of the options random sampling, control group and standardised indicators and measures.

  6. 9 Steps in Planning and Managing Evaluations of development research

    Page

    What is this guide about?

    This is an interactive guide for those commissioning evaluations of development research projects and programming. “Commissioners” are those who ask for an evaluation, who are responsible for making sure it happens and is well-honed to the needs of those who will use the evaluation.

    Also Available In: Français
  7. Using BetterEvaluation material

    Page

    BetterEvaluation resources can be easily adapted to help support evaluation training, from structuring coursework to creating organisation specific materials.  

  8. Data sovereignty

    Page

  9. Download the Rainbow Framework

    Page

    There are a few different downloads available for the Rainbow Framework.

  10. Prioritise self-determination, community agency and self-governance

    Page

    Empowerment Principle

    Aboriginal and Torres Strait Islander peoples have the right to self-determination and to be encouraged and empowered in decision-making processes. Evaluators must listen and advise to the benefit of communities above all else.

    Click here to find out how to put this into practice

    Application

    This involves time, ongoing negotiation, consultation and informing custodians about the implications of participating in the evaluation.

    Seek what is important and what needs to be evaluated from the community – take a ground up perspective to understand community priorities. Even top down projects should include community-led evaluation, together with what funders want to know.

    Ensure you have an established relationship with a community before you commence the evaluation. If you do not have an established relationship, consider partnering with someone who does.

    Before commencing the evaluation, ensure communities have a full understanding of the intent of the evaluation and that their input is valued and welcomed. Discuss and identify how the evaluation will benefit them, including the ownership of data.

    Include community members in the co-design phase of the evaluation.  Accept that you may need to return to the evaluation commissioner with a revised approach.

    In consultation with community members, choose the most appropriate method(s) to collect and/or retrieve data. For a list of examples refer to the BE Rainbow Framework [link here].

    Include community members in the collection and retrieval of data and analysis of numeric and textual data patterns.

    Build community capacity and if needed capability to engage in data collection in ways that are meaningful to the community.

    Diversity Principle

    Recognise the diversity and uniqueness of First Nations Cultures, Peoples and Individuals.

    Click here to find out how to put this into practice

    Application

    Recognise the unique cultural identities of each Aboriginal and or Torres Strait Islander community and their unique practices and processes. Take the time to look, listen and learn about the specific cultural context you are entering before commencing any evaluation.

    Recognition of individual communities requires explicitly sharing and explaining individual Indigenous cultural materials rather than perpetuating a homogenous view of Aboriginal and or Torres Strait Islander peoples.

    Stereotypes and quietly held beliefs require unpacking. Put aside assumptions about communities and their governance structures before and during the evaluation. Be aware that your cultural lens will impact on your understanding.

    Understand that there are different governance structures and roles within a community. At the outset of, and throughout the evaluation, make sure you are talking to the right person or people.

    When synthesising data from other evaluations, be aware that findings from other communities may not be relevant. Aboriginal and or Torres Strait Islander communities represent over 300 different nations. This includes differences in language, culture and societal structure. Homogenising data can skew results.

    If utilising findings from different communities, validate this first with the community that is central to the evaluation. 

    There may be opportunities to generalise findings across programs or sites within the community that is central to the evaluation. Ensure you test and validate this approach with the community. There may be different language groups and cultures represented within one site.

    Inclusion Principle

    Involve Aboriginal and or Torres Strait Islander people in all levels of the evaluation, from design phase right through to analysis and communicating findings.

    Click here to find out how to put this into practice

    Application

    Build trust with participants by demonstrating to them the value and benefit of the information they will share as part of the evaluation.

    Prioritise the use of participatory methods as they have benefits to achieving a higher ethical standard on inclusion and can allow you to build relationships and trust with community members, particularly where multiple monitoring points provide an ongoing connection.

    Consider if there are alternative explanations for causes and ensure causal questions are directed to community members. They are the experts of their communities and may see something you have missed.

    When understanding what may have happened without the program being evaluated, ensure that the community can critique any assumptions you have made. Do not use the word ‘intervention’ when questioning causal attribution. The word ‘intervention’ can have other connotations for community.

    Prioritise self-determination, community agency and self-governance Please look at all the other themes – they are equally important Key themes Barriers Limited scope from commissioner Power and privilege Limited cultural understanding Can’t find community protocols Time restrictions No cultural mentor No tools or templates Data gate keeping Resource constraints Communicate transparently, build trust and obtain individual and community consent Strengths-based recognition of cultures, acknowledging communities and individuals Share benefits and apply two-way learning Formalise accountability processes on ethical practice Facilitate control and data sovereignty COURAGE, INTEGRITY, & CULTURAL HUMILITY

    Acknowledgements

    We would like to acknowledge and thank Maria Stephens, an Arrabi/Binning woman who speaks the Iwaidja language. She generously provided her artwork for this page.

Pages