Mercy Corps is hiring a
Final Evaluation of TAGHIR-SIDA Programme
ِSep 8, 2022 – Sep 30, 2022 (estimated 23 days)
Ninewa Governorate: Mosul, Sinjar, and Tel-Kaif Districts
About Mercy Corps
Mercy Corps works in places of transition, where conflict, disaster, political upheaval, or economic collapse present opportunities to build more secure, productive, and just communities. Providing emergency relief in times of crisis, we move quickly to help communities recover and build resilience to future shocks and promote sustainable change by supporting community-led and market-driven initiatives. Recognizing both the great potential and the complex challenges faced by the Middle East, since 1989 Mercy Corps has been implementing a range of humanitarian assistance and development programs tailored to the specific needs of the region and of those communities where we work. Mercy Corps has worked across Iraq’s 18 governorates since 2003, implementing relief and development programming, more than a third of which has focused on the specific needs of refugees and displaced persons.
Mercy Corps’ Promoting Resilience for Returnees and Host Communities in Ninewa (TAGHIR) programme, funded by SIDA and implemented in partnership with Mercy Hands, is a three-year initiative to facilitate a peaceful environment and the well-being of returnees and host communities in heavily conflict-affected districts of Ninewa governorate (Mosul, Tel-Kaif and Sinjar) through psychosocial resilience, social cohesion, and livelihood restoration.
The TAGHIR program employs a multi-sectoral approach that goes beyond addressing immediate humanitarian needs and focuses on long-term engagement to provide a sense of stability, community, ownership, and hope for the future. The programme is centered on a community-driven approach facilitated through the establishment of Adolescent and Youth Friendly Spaces (AYFS), which serve as the hubs for program activities and are operated by Mercy Hands (MH), MH is a local partner which was identified and contracted by MC. All of the coaches and participants of the AYFS are from diverse backgrounds, and the inclusion of women, girls and people with disabilities is ensured across all activities. These activities are designed around the following three outcomes:
Outcome 1: Improved psychosocial well-being for vulnerable adolescents and youth aged.
Outcome 2: Increased social cohesion between communities, including greater inclusion of women and youth.
Outcome 3: Increased economic resilience of youth through enhanced livelihood opportunities.
The primary objective of the Final Evaluation is to determine the program's overall impact, including the program's relevance, effectiveness, efficiency, impact, and sustainability, as well as to identify specific areas for improvement and learning from expected and unexpected program outcomes. The evaluation's findings will be shared with key stakeholders (program, donor, and HQ staff of Mercy Corps) to inform future programming and support the development of objectives and strategies for multi-sectoral programming in Iraq. Mercy Corps strongly recommended that data be collected in person,with the full support of the Mercy Corps’ MEL team in Ninewa.
The service provider is expected to deliver a comprehensive evaluation report no later than 28 August 2022 with a first draft submitted for review on 27 September 2022. Note that these are estimated and/or anticipated deadlines.
Existing Program Information
The proposal narrative results framework, indicator plan showing 90 indicators (which outlines data collection for each indicator), program target achievement sheet and program work plan will be shared with the service provider. As requested, and/or needed, other information such as donor reports, learning research reports and other review results will be shared with the service provider to support a better understanding of program interventions and results.
Following OECD-DAC (the Organization for Economic Co-operation and Development's (OECD) Development Assistance Committee (DAC) evaluation criteria, The final evaluation should evaluate the program for its relevance, effectiveness, efficiency, impact, and sustainability.
The following are illustrative evaluation questions, which will be further refined with the service provider. These criteria provide a normative framework used to determine the merit or worth of an intervention (policy, strategy, programme, project or activity). They serve as the basis upon which evaluative judgements are made.
To what extent are the objectives of the program still valid? Are the activities and outputs of the program consistent with the overall goal and the attainment of its objectives? Are the activities and outputs of the program consistent with the intended impacts and effects?
Which program interventions/activities have benefited the targeted participants the least and the most? What were the reasons? What are the recommendations for future similar interventions? Please include gender, age, people with specific needs (PSN) or with disabilities (PWD) and geographic analysis.
What can the TAGHIR program do in terms of adding new activities or refining its existing ones to make sure its activities are inclusive for PWD and PSN.
To improve programme relevance, which program interventions/activities should be modified, expanded, added, or eliminated? Why? Please include gender, age, and geographic analysis.
To what extent were each of the objectives achieved or are likely to be achieved? What were the major factors influencing the achievement or nonachievement of each of the objectives?
The extent to which the intervention objectives and design respond to beneficiaries, global, country, and partner/institution needs, policies, and priorities, and continue to do so if circumstances change.
During the program’s life cycle, how well did Mercy Corps adopt the implementation methodology to contextual developments/changes? What other considerations or approaches could Mercy Corps have taken to enhance efficiency and performance?
To what extent did the objectives achieve the intended goal? Was this done in accordance with the Theory of Change? What were the major factors influencing the achievement or nonachievement of the objectives? What are the recommendations for future similar interventions?
How effective and appropriate were the program management processes in supporting delivery?
What can be done to improve monitoring systems, mechanisms, and processes?
To what extent did the aid use the least costly resources possible to achieve the desired impact?
Were activities cost-efficient? Were objectives achieved on time? Was the program implemented in the most efficient way compared to alternatives?
Was the method for obtaining results effective? Did the actual or anticipated results (outputs and outcomes) justify the costs? Were the resources (financial, human, operational, time, etc.) used efficiently?
To what extent did the program take advantage of the opportunity to adjust resource usage for improved outcomes/greater impact, especially considering changing circumstances? Was the program able to take advantage of these options?
Did the program's activities overlap and/or duplicate those of other similar interventions (funded by the government or other donors)? How did the UN agencies, national institutions, development partners, and other key stakeholders collaborate on the program?
What has happened as a result of the program? What real difference has the activity made to the program participants? How many people have been affected? Was there a difference between family level and individual level impact and what rate of program participants have been impacted.
What is the long-term impact of participation in a programme on the programme participants psychosocial wellbeing, social cohesion and livelihood? Please include gender, age, and location analyses.
What are some of the program's unintended positive and negative outcomes/impacts?
To what extent did the program work as a humanitarian-development nexus programme and engage/coordinate at different operational levels?
To what extent did the TAGHIR program employ a human rights-based approach?
To what extent did/will the benefits of a program continue after donor funding has ceased?
What were the major factors which influenced the achievement of sustainability of the program participants?
What are the practices and recommendations for maintaining the sustainability of the program participants?
How and to what extent did the program activities consider longer-term needs and durable solutions?
Which interventions—between entrepreneurship activities (start-up business grants, scale-up business grants, Business Management training, Village Savings and Loan Association VSLA, Solar Power Irrigation System SPIS), and job placement —are more sustainable and have more potential for growth and job creation?
How and to what extent did this intervention consider longer-term peacebuilding and reconciliation?
To what extent did the program support innovation to improve intended outcomes and subsequently potential scale-up?
What key factors will require attention in order to improve prospects of sustainability of program outcomes and the potential for replication of specific program interventions?
To what extent are the capacities strengthened at the individual, household and community levels (including contributing factors and constraints)?
Key Deliverables and Timeline
The firm is expected to meet the following deliverables, with an estimated time indicated (though firms should propose the amount of time they believe necessary to achieve the deliverables noted):
DELIVERABLE**:** Following desk review of relevant program documents including proposals, implementation plans, strategy documents, and existing databases/datasets, consultant will develop an Inception Report, outlining evaluation design (including the reduced list of questions to be answered), methodologies, data analysis plan, and including creation of all evaluation tools, as well as work plan with GANTT chart.
DELIVERABLE: Provide feedback on Inception Report, evaluation tools and all the deliverables of the inception phase - one round of consolidated feedback and revisions
DELIVERABLE: Inception report along with all deliverables of the inception phase including the evaluation instruments and their translation Arabic and Kurdish (Kurmanji) is finalized with MC’s feedback incorporated.
DELIVERABLE: Oversee data collection and analysis (data should be disaggregated by gender, location, and ethnicity, PWD), including hiring (if needed) and training of enumerators as well as pre-testing data collection instruments.
DELIVERABLE: Encode and analyze all collected data, and share the complete dataset, as well as analysis tables, with the Mercy Corps’ Iraq MEL team. (Mercy Corps can support with translation needs as necessary - please note the responsible party in the bid documentation)
DELIVERABLE: Prepare Draft Evaluation Report, including Executive Summary
DELIVERABLE: Prepare detailed consolidated feedback on Draft Evaluation Report (one rounds of feedback and revisions anticipated)
DELIVERABLE: Finalize Evaluation Report, incorporating Mercy Corps feedback. Prepare a separate slide deck summarizing key findings and lessons learned.
DELIVERABLE: Conduct presentation (in English) of findings/learning event for key Mercy Corps personnel
Inception Report: Sep 10, 2022
Study instruments finalized and translated: Sep 12, 2022
Draft Evaluation Report: Sep 25, 2022
Presentation of findings: Sep 29, 2022
Final Evaluation Report and slide deck: Sep 30, 2022
Final Report Format
The final report should not exceed 40 pages, not including annexes and appendices. The content of the written report should be coherently structured with a logical flow. Data and information should be presented, analyzed, and interpreted clearly and systematically, with a clear line of evidence supporting the conclusions and recommendations.The final report should be shared in an electronic copy (PDF and Word submitted by email)
The basic structure of the report should resemble the following:
Team composition and Management
Limitations and Exclusions
All the collected data and provided reports will be the property of Mercy Corps and should not be shared or published without approval.
Mercy Corps will not be liable for any disputes arising between the service provider and TAGHIR program staff, partner, program participants or program management.
Each tool/report submitted to Mercy Corps will go through one round of reviews/revision processes before being finalized and used by service providers.
All materials must be delivered in Microsoft Word and Adobe Acrobat PDF format.
At the start of the program, the service provider must sign a data-sharing agreement with Mercy Corps, which states that any data on programme documents or internal Mercy Corps data must not be shared unless Mercy Corps has given prior approval.
Mercy Corps reserves the right to reject any tools that are considered inappropriate or unnecessary.
All materials must be approved by Mercy Corps before being disseminated and used by the service provider.
The Service Provider must adhere to Mercy Corps' COVID-19 guidelines and follow the COVID-19 protocols for mass gathering.
Mercy Corps reserves the right to ask the Service Provider to provide a Suitable replacement for a staff member whose services do not meet Mercy Corps' expectations.
The service provider must obtain specific permits (at the checkpoint) in order to travel throughout Ninewa Governorate, which includes three districts (Sinjar, Mosul and Tal-kaif).
Mercy Corps will not be responsible for any access issues that the service provider and his/her team may encounter.
The service provider must provide transportation for his or her team who are working in the field. Non-Mercy Corps employees will not be authorized to use Mercy Corps vehicles.
The study design is to be determined by the MSA firm in consultation with Mercy Corps and/or the donor (all donor communications will be handled by Mercy Corps - the service provider will not communicate directly with the donor).
The preference for this work would be that the service provider has an established team in Iraq and that they can manage the data collection entirely independently (and MC would only support providing contact information and liaising where necessary with our program stakeholders). This is not always an option, however, and we do not anticipate that the timeline will allow for the service provider to hire and build a team from scratch. In this case, MC can support data collection using our existing enumerators. (The service provider should train Mc’s enumerator on the tools and data collections while MC MEL team can support with translation to Arabic or Kurdish if needed). If the service provider requires MC support with enumerator training, data collection, etc. we would expect this to be reflected in a lower overall price of the evaluation as this is time and labour-intensive. The proposal submitted by the service provider should include both budget and methodology information that will clarify how they intend to complete this work and what support Mercy Corps would thus need to provide.
International travel for the purpose of the consultancy may not be possible and would require advance approval from Mercy Corps in accordance with our latest COVID-19 policies and precautions. If approved, associated costs would be the responsibility of the consultant. Mercy Corps can also provide tablets that can be used for data collection if needed, using ODK - ONA is used to store data online. Mercy Corps also has existing contacts for enumerators in the country, though any costs for this should be included in firm budgets. Preference may be given to firms with teams based in Iraq. The consultant will be responsible for arranging their own accommodation, but Mercy Corps can provide guidance and recommendations if needed. The consultant will be responsible for arranging their own airfare and in-country transportation. Mercy Corps can support access to field/implementation sites.
Mercy Corps MEL and economic recovery teams will be available to work directly with the consultant throughout the duration of the evaluation to answer any questions as they emerge.
Interested applicants should submit a technical and financial proposal to Mercy Corps (not more than 20 pages) including the following:
Mercy Corps will evaluate technical and financial proposals and award the assignment based on technical and financial feasibility following the scoring in the table below. Mercy Corps reserves the right to accept or reject one or all proposals received without assigning any reason and is not bound to accept the lowest or the highest bidder. Only those shortlisted will be contacted. Any subcontracting under this evaluation consultancy will not be accepted.
Technical proposal, including methodology and its responsiveness to SOW
Technical expertise and experience of assessment team (based on CVs provided)
One similar sample report
Percentages of contracted amount
After completing and submitting the inception note and data collection results
After submitting the final evaluation report and completing the presentation with Mercy Corps and donor
Application closing date: 23.59, Sunday 04 September 2022