TERMS OF REFERENCE - External Evaluators

OUR PAST AND PRESENT AS BUILDING BRICK TOWARDS OUR FUTURE

Protection International Indonesia

1. Background

In many parts of the world the defence of human rights evokes pressure, threats and attacks from state- and non-state actors. Protection International (PI) works with local human rights movements to develop strategies and programmes that prevent and counter such repression. PI supports individuals, organisations, networks, and communities whose right to defend human rights is being violated through threats, judicial harassment, stigmatisation, or other forms of repression.

PI seeks to contribute to the recognition of human rights defenders (HRDs) as legitimate actors for social change and to an environment where they can exercise their right to defend universally accepted human rights. PI supports human rights defenders to protect themselves through a comprehensive and tailored approach, which is founded on three pillars: (1) empower defenders to manage their protection themselves, (2) promote authorities’ fulfilment of their responsibility to protect, and (3) engage other individuals and institutions with a positive stake in the protection of human rights defenders do more or do better—and those with a negative stake to respect the rights of HRDs.

PI is registered as an international non-profit association (AISBL) in Belgium with a Global Team based in Brussels and two Hubs in Mesoamerica and Africa. Another hub will be set up in Southeast Asia this year. At the country level, PI operates through partnerships with local NGOs or independently as locally registered organisations. PI currently has a permanent field presence in nine countries. In addition, PI also has the ability to provide services to external stakeholders in nearly any country and participates in global and regional advocacy initiatives.

PI’s work in Indonesia started in 2010 with the Protection Desk (PD*) Indonesia under the supervision of the PI Head Office in Brussels (Belgium). In April 2015, PD Indonesia received the national legal status as a foundation, under the name Yayasan Perlindungan Insani Indonesia (Foundation for Human Protection in Indonesia/YPII) under the supervision of a Board of Directors composed of Indonesian partners.  

As part of PI’s organisational strategy towards decentralisation, PI is further evaluating our organizational work to better understand the complex situation for HRDs in the Southeast Asia region. In order to ensure PI’s positive impact and presence, we would like to explore and understand the impact of PI’s support to human rights defenders at risk in Indonesia.

(*) A “PD” is a technical support structure for HRDs. It plays the strategic role of supporting local and national organisations which protect HRDs. PDs aim to share and develop HRDs’ skills, as well as provide a space to create and exchange expertise in the field of security and protection. 

 

2. Purpose

The main purpose of this evaluation is to provide a better understanding of the organizational impact of PI’s presence in Indonesia, which includes the work that the team in Indonesia has carried to the benefit of the HRDs community, organizational partners and other relevant key stakeholders.

The expected results are concrete insights and recommendations on the effectiveness of PI’s operations and impact in the field of protection of HRDs in Indonesia.

 

3. Scope and objectives

The scope of PI’s evaluation is two-fold: to assess PI’s impact and ability to improve protection of defenders; and to evaluate internal organisational structures and practices. The evaluation will be carried out to fulfil the following objectives:

  1. Impact evaluation: measuring positive and negative, primary and secondary long-term effects produced by PI interventions, directly or indirectly, intended or unintended.
  2. Organizational capacity:
  • ongoing business and operational activities including, but not limited to, setting and implementing administrative policies, hiring and managing personnel, obtaining funding, leadership, supervising program and fiscal operations, coordination, communications and management of resources, and long-term planning.
  • mapping the strengths and weaknesses in relation to coordination between the national foundation, national daily management and global management.
  1. Strategic recommendation: identify major bottlenecks and outline enabling environments for PI to support HRDs as well as provide a roadmap on how PI could more effectively respond to HRDs’ needs related to security and protection.

 

4. Methodology

It is expected that the consultants adopt an Adaptive Community-Based Participatory (CBPR) approach in order to integrate Indonesian HRDs’ opinions and circumstantial complexity into the results of this evaluation process. This approach requires the use of ethnographic methodologies and human-centric design. Systems thinking is then required to understand the interconnectedness between CBPR, national and global context of HRDs. Furthermore, PI is looking for realist evaluators to identify the underlying generative mechanisms that explain ‘how’ the outcomes were caused and the influence of context.  A realist impact evaluation is applied through this set of questions: “What works, for whom, in what respects, to what extent, in what contexts, and how?”.

A pulse interactive survey will be circulated that works to assess PI’s added value within the HRDs ecosystem in Indonesia. The survey will be circulated to the network of HRDs including activist scholars, community-based movements, government officials and CSOs. In particular, the impact evaluation will be carried out in collaboration with PI partner organisations and HRDs that we support.

Direct field visits (or remote ethnography due to COVID-19 restrictions) and participatory focus groups with HRDs and partner organisations are expected. In-depth interviews with key stakeholders such as partner organisations, INGOs working on protection issues, government representatives, donors and policy makers, should also be carried out.

The research on impact shall be framed against existing protection practices and approaches for human rights defenders at risk, through a situated approach rather than an abstract one, taking into account PI’s Theory of Change. 

The evaluation of organizational capacity, including internal structures, shall involve a review of PI’s relevant documentation, interviews with PI Indonesia staff, PI Brussels management, PI Indonesia’s founding members and Board members when available. The time horizon of the organisational evaluation shall cover the past five years with attention to PI’s Global Strategy 2019-23.

One, comprehensive evaluation report will be elaborated which includes the broader scope on the impact of PI. A comprehensive set of actionable recommendations will be an important part of the evaluation report.

An internal PI support team will be established to support the external consultants with information as well as logistical assistance. The team will also provide opportunities for feedback during the evaluation process.

  • Evaluation criteria include:
    • Relevance
    • Efficiency
    • Effectiveness
    • Impact
    • Sustainability
    • Accountability (in theory and practice)
    • Gender & diversity
    • Transparency and clarity

 

PI will provide the evaluators with information on an evaluation framework and indicators, which have been internally elaborated.

 

  • Guiding questions for both parts of the evaluation include:
    • What is PI Indonesia’s place in the protection regime for human rights defenders? What is its unique contribution?
    • How do human rights defenders, other groups and organisations supporting HRDs perceive and relate to PI Indonesia?
    • How has PI Indonesia shaped (effective/lasting) partnerships with other organisations (e.g. local partners, HRD groups, INGOs, funders)?
    • How do its various activities (capacity building initiatives, advocacy, research, online presence, fundraising and financial management) serve its objectives?
    • How does PI Indonesia’s organisational structure serve its objectives? Is it efficient and effective?
    • How can PI Indonesia’s internal processes (on decision-making, finances, accountability, governance) be strengthened?

 

Other key strategic learning questions shall be developed as part of the evaluation proposal with an enabling and forward-looking approach.

 

5. Deliverables

One evaluation report will be delivered which includes:

  • An outline of the evaluation (in English) to be undertaken for approval of PI.
  • A preliminary assessment (in English) detailing the initial findings of the consultants’ research and fieldwork, for feedback from the internal evaluation support team.
  • An in-depth evaluation (in English) that contains the following:

1. The purpose and objective(s) of the evaluation

2. Explanation of the methodology used and the scope (and limitations) of the evaluation

3. Presentation and analysis of findings

4. Clear conclusions, with reference to the research questions

5. A comprehensive, and concretely applicable set of actionable recommendations

6A list of persons interviewed (via positions), places visited, questionnaires, interview guide or topic list

7. If relevant, statistical elaboration and analysis

8. Difficulties faced during the evaluation

 

6. Timeline and cost projection

  • Starting date: as soon as possible
  • Timeline:
    • Outline to be presented within two calendar weeks after signature of the contract
    • Preliminary assessment presented by 28 April 2021 and the final version of the complete evaluation report is due by 3 May 2021 at the latest.

 

7. Required Qualifications of the evaluators:

  • Prior experience in conducting participatory evaluations and interactive surveys, realist evaluator is desirable;
  • Experience with international human rights NGOs;
  • Consultant(s) focusing on objective 1 shall have a long-standing experience in organisational development;
  • Consultant(s) shall have a good understanding of human rights defenders’ protection issues;
  • Cultural sensitivity and ability to mitigate cultural barriers
  • No conflicts of interest (eg. no personal relations with PI staff)
  • Fluent in English and ability to work in Indonesian and English;
  • Understanding of the specific needs of a multicultural organisation;
  • Availability to travel (COVID-19 permitting).

In the event that a team of evaluators is selected, the consultants will be responsible for coordinating internally and ensure that the final evaluation report is fully harmonised.

 

8. Application process:

Interested evaluators or teams shall send an offer before 18 April 2021 to recruitment [at] protectioninternational.org detailing:

  1. A brief explanation of the understanding of the two parts of the evaluation and the proposed methodology (max 4 pages). This shall include a description on how the team will function;
  2. CVs of the proposed consultants;
  3. Contact details of two references;
  4. Detailed budget and calendar of activities;
  5. Example of prior report on similar work would be an added value (if any).

For further information please contact Claudia Lotzwig at clotzwig [at] protectioninternational.org