End-term evaluation of Rights, Evidence, Action Programme

Introduction

RNW Media and CHOICE for Youth and Sexuality are looking for an external evaluator to conduct an end-term evaluation of our Rights, Evidence, Action (REA) programme. This terms of reference contains:

  1. Background information
  2. Purpose and scope of the evaluation
  3. Design and methodology
  4. Governance and accountability
  5. Profile of the evaluator
  6. Key deliverables and timeline
  7. Application process

 

  1. Background

RNW Media

At RNW Media, we support young people who want to speak freely and make their own informed choices about their futures. They work with them to develop online platforms that provide young people with information in areas where this information is often restricted or taboo. These online communities are safe places where they can engage with each other and have online conversations about what really matters to them – both personally and politically.

We use a positive, aspirational approach and work in three regions on two themes. The theme that is relevant for the present end-term evaluation focuses on realizing sexual and reproductive health and rights (SRHR). We focus on unmet needs relating to reproductive health and access to safe abortion, intimate partner violence, gender-based violence and LGBT rights.

CHOICE for Youth and Sexuality

CHOICE is a youth-led organization with years of experience building the lobby and advocacy capacity of youth-led organizations in Africa, Asia and the Caribbean. They advocate for the sexual and reproductive health and rights of young people worldwide and support them to meaningfully participate on issues that affect their lives and to voice and claim their rights. CHOICE works with partners on the basis of equality and mutual learning experiences. CHOICE implements an International Advocacy Program which combines youth-led international advocacy for SRHR with building the capacity of less experienced youth advocates on the job.

The Rights, Evidence, Action programme

Rights, evidence, action – amplifying youth voices (REA) is a three-year programme (2016-2019)    supported by an AmplifyChange strategic grant. The REA programme works at the intersection of digital media, sexual and reproductive health and rights (SRHR), and advocacy to influence attitudes, social norms and policies in favour of the SRHR of young people, including Lesbian, Gay, Bisexual, and Transgender (LGBT) youth, in Kenya, Nigeria, Uganda and India.

The REA programme is a collaboration between RNW Media (Love Matters) and CHOICE for Youth and Sexuality. RNW Media’s digital media approach complements CHOICE’s youth-led advocacy activities. RNW Media brings its digital expertise and Love Matters platforms in India, Kenya and Nigeria to provide young people with pleasure-positive and evidence- and rights-based information and address stigma. Our interventions also help create safe online and offline spaces for young people to discuss love, sex and everything in between. Together, we work with four youth-led partner organisations, Equality Triangle Initiative (ETI, Nigeria), Reach a Hand Uganda (RAHU), the Network for Adolescent and Youth for Africa (NAYA, Kenya) and The YP Foundation (India), to advocate for all young people’s SRHR within national, regional and international forums, like the United Nations.

REA supports young people’s participation and amplifies their voices in political and digital media spaces. We listen to young people through their clicks, likes, posts, conversations and survey responses—using natural language processing and analytics. With the data we collect, we can develop insights on young people’s views and key interests. We then turn and use those insights to support evidence-based advocacy.

  1. Purpose and Scope

RNW Media and CHOICE wish to conduct an end-term evaluation for the REA programme to assess programme performance against the five OECD DAC criteria: effectiveness, efficiency, relevance, impact and sustainability. Moreover, the goal of the evaluation is to capture the lessons learned with the aim to replicate successes and improve future interventions.

Effectiveness & Efficiency

  • To what extent has the programme been effective and efficient in achieving its objectives as outlined by the Theory of Change?
  • Which factors influenced the achievement (or non-achievement) of these objectives?
  • To what extent has the partnership between RNW Media, CHOICE and their respective partners been effective in relation to the complementarity of their roles?

Relevance

  • What is the relevance of the ToC and results achieved in relation to the evolving context of the respective countries and needs of young people?

Impact & Sustainability

  • What range of outcomes (intended and unintended) has REA contributed to?
  • To what extent did REA strengthen civil society to advance the rights of young people’s SRHR including young LGBT and challenge discrimination and negative social attitudes?
  • To what extent have youth advocates and CSOs been capacitated to: 1) maintain and strengthen their organisational structure; 2) monitor and influence policy development and implementation on national and global level; 3) maintain online platforms and channels after the programme’s end to ensure young people continue to have access to SRHR information?
  • To what extent has the advocacy work carried out by REA partners been effective?
  • Assessment on the sustainability of the generated impact upon the end of the programme;

 

  1. Design and Methodology

The evaluator is expected to use a mixed-method approach to collect and analyse data. The suggested methodology of the end-term evaluation includes, but is not limited to:

  • Survey measurement of [knowledge and attitude] levels among young people reached by our digital interventions, as compared to baseline measurements from 2017;
  • Qualitative outcome assessment through outcome harvesting or an alternative appropriate methodology;
  • Key informant interviews and/or focus group discussions;
  • Desk review of relevant documents.

As part of the application, the consultant is invited to suggest evaluation methods proven to be well suited for the evaluation of (digital) campaigns and advocacy programmes, and allowing to capture and answer the specified evaluation questions. Final specification of evaluation design, methodology and evaluation plan will be established in close consultation with the PMEL specialists at RNW Media and CHOICE.

  1. Governance and accountability

The evaluator(s) will report to the evaluation steering committee, who will:

  • Further specify the strategic focus of the evaluation in cooperation with the evaluator(s);
  • Make any necessary decisions related to the evaluation along the way;
  • Provide feedback on (draft) deliverables of the evaluator(s);
  • Approve on the content and quality of the final deliverable.

Members of the REA programme team will serve as a main point of contact for the evaluator(s), who will:

  • Serve as a first point of contact and sounding board for the evaluator(s);
  • Facilitate the evaluator(s), for example by linking him/her to other RNW Media and CHOICE staff;
  • Monitoring progress of the evaluation and escalate to the steering committee if required;
  • Pre-review any of the deliverables;
  • Advise the steering committee.
  1. Profile of the evaluator

The following criteria will be used to shortlist potential evaluators:

Required:

  • Demonstrable experience in evaluating (digital) campaigns and advocacy programmes;
  • Thematic knowledge of sexual and reproductive health and rights;
  • Demonstrable experience in working with young people;
  • Demonstrable experience in mixed-method research methodology;
  • Demonstrable experience in managing a multi-country evaluation;
  • Demonstrable experience in translating findings into actionable learnings;
  • Fluency in English.

Desired:

  • Relevant contextual knowledge of our project countries;
  • Knowledge of/experience with international advocacy mechanisms (particularly UN mechanisms in Geneva)
  • Knowledge of/experience with digital marketing methods;

 

  1. Key deliverables and timeline

The evaluator should submit the following key deliverables:

  1. An inception report in English outlining the evaluator’s approach, proposed methodology, an initial desk review due before the field work takes place, detailed plan of action which contains a detailed description of evaluation design and methodology, including a clear division of tasks and responsibilities between the evaluator and RNW Media, required information and support from RNW Media.
  2. A bi-weekly progress update in which the evaluator briefly summarizes the work that has been done so far and how the evaluation progresses in relation to the project planning.
  3. Draft evaluation report (in English) – subject for feedback;
  4. A final report (in English);
  5. Presentation of the report findings to RNW Media and CHOICE staff.

Suggested timeline

Contracting of the evaluator: July

Start of inception phase: August

Data collection and analysis: Mid-August

Submission of final report: October 31st

 

  1. Application process

Any questions about this ToR can be directed to:

Roos Geut (Programme officer REA): [email protected]

Proposals should be submitted by the 10th of May through:

Roos Geut (Programme officer REA): [email protected]

Proposals should contain at least:

  • Your understanding of and reflections on the assignment;
  • A description of your proposed approach;
  • Any suggestions for changes in or additions to the proposed methodology;
  • A detailed budget (not exceeding EUR 30,000 including consultant’s fee, relevant taxes, travel, communication and other study-related costs);
  • An up-to-date CV of the evaluator(s);
  • A short overview of how the evaluator/evaluation team meets the required profile;
  • An example piece of work from a similar assignment.

We kindly invite interested parties to include a tentative more detailed timeline in their proposal, which should at least specify most important milestones (such as end of the inception phase, submission of the draft report, et cetera). A detailed planning at activity level can be developed as part of the inception phase in cooperation with RNW Media and CHOICE. We encourage people under 30 to apply.