Syrian Arab Republic: Dutch End of Project Evaluation

Organization: World Vision
Country: Syrian Arab Republic
Closing date: 15 Jan 2016

A call for expression of interest

World Vision Turkey/Northern Syria calls for expressions of interest for conducting an external evaluation of Flexible Emergency Relief Assistance to Vulnerable People in Project in Northern Syria. The overall objective of the project is to contribute to improved quality of life and health among IDP and conflict affected host communities in Aleppo, Governorate by March 2016.

The evaluation is scheduled to begin by the beginning of February commencing with desk review and development of context appropriate evaluation framework. Final report is expected by 30 March, 2016. Expressions of interest should include a proposed budget for the evaluation, including transportation, any tax obligations, etc.

The external evaluator (Team Leader) must have experience or significant knowledge of the humanitarian response mechanisms especially in conflict contexts. Master’s degree in Demography, public health, health statistics or developmental studies and preferably with strong background in statistics.

Application process

Interested candidates or consultancy companies should send:

• CVs of the Evaluation Team

• Three-page technical proposal for implementation which includes

i. Methodology, including anticipated challenges and actions to redress them

ii. Proposed timeframe

iii. Sample work plan

iv. Sample of previous work

• Consultancy fees required

• Reference from at least one prior NGO client

Detailed ToRs for the Evaluation can be requested from gaziantep_procurement@wvi.org

Deadline of expression of interest

Forward expression of interest to gaziantep_procurement@wvi.org and in the email subject line please indicate: Dutch Evaluation ToR and applications will be accepted until 15 January, 2016.

Terms of reference

Dutch End of Project Evaluation

Project Name Flexible Emergency Relief Assistance to Vulnerable People in Northern Syria

Project Goal Contribute to improved quality of life and health among IDP and conflict affected host communities in Aleppo, Governorate by 2016

i. Project objectives Reduced incidence of water related and water borne diseases in IDP camps and host communities.

ii. Improved food safety and security of IDPs through timely, effective and coordinated provision of life-saving food supplies.

iii. Improved access to primary and secondary health care services for vulnerable IDPs and host communities.

iv. Improved living conditions of IDP and conflict affected host community members through timely, effective and coordinated provision of basic life-saving non-food items.

Project sectors Health, WASH, Food Assistance, NFI

Project locations Initially targeted locations: Aleppo Governorate, Jarabulus and Manbij

Current locations: Aleppo Governorate, Azaz District

Number of targeted beneficiaries 120,000 beneficiaries (host community members and IDPs)

Donor Government of Netherlands

Project Duration Initial lifespan: Dutch I Started April 2014 projected ending March 2015

Extended lifespan: Dutch II Started April 2015 ending March 2016

Background and Context

The year 2015 to date has been marked by an intensification of the conflict. Humanitarian needs inside Syria and in neighboring countries continue to rise as the crisis deepens. Since late 2014, the estimate of People in Need (PiN) in at least one sector has grown from 12.2 million to 13.5 million, according to the Humanitarian Needs Overview. The negative impacts of the conflict have been witnessed in most parts of the country, coupled with deteriorating livelihoods, water, sanitation and healthcare services which have contributed to a heightened risk of malnutrition among women and children. The HNO estimate of the number of people in besieged areas has risen from 212,000 in December 2014 to 360,000 in September 2015, though the estimate of people in need in “hard-to-reach” areas has decreased slightly, from 4.8 million to 4.49 million while 6.5 million people are internally displaced. As the conflict intensifies, people in need are expected to increase exponentially. Recent months have seen a marked increase in the number of Syrians seeking refuge in neighbouring countries and the current number of refugee stands at 4,287,293[1] people.

Project background

Inoder to address the immediate and growing needs of the population affected by the Syrian crisis, World Vision launched a humanitarian assistance project through financial support from the Dutch government in Jarabulus and Manbij, Aleppo governorate focusing on health, WASH, food assistance and NFIs. Due to persistent security challenges which threatened operations, the project was moved to Azaz district, north western side of Allepo governorate. A basic rapid assessment was conducted with key informants in Azaz district for identification of urgent humanitarian assistance needs. As a result, the project targeted WASH, health, food and NFI sectors in the following locations of Azaz city and the country side targeting 120,000 internally displaced populations and host community members.

Objectives and scope of the evaluation

The purpose of the evaluation is to assess the performance of the project against the objectively verifiable indicators outlined in the project’s log frame and to assess the Dutch Grant level of achievement against objectives and expected results. The evaluation is expected to enrich learning in terms of implementation approaches in remotely managed contexts. The scope for the summative evaluation is determined using OECD-DAC[2] criteria for evaluating humanitarian projects.

Specific objectives of the evaluation

· To assess the degree to which the project met its objectives and outcomes based on the log frame

· To determine the effectiveness, efficiency, relevance, coverage and lessons learnt from the project.

· To identify and assess key internal and external factors (positive and negative) that have contributed affected, or impeded Dutch Grant’s achievements and how World Vision has managed these factors.

· To inform management, implementing staff and donors on project achievements, challenges and recommendations.

· To identify lessons learnt and best practices to inform follow-on appeals/revisions and to improve future emergency response strategies.

Key evaluation questions

Relevance and appropriateness

To what extent did the programme address the problems identified in the needs assessment report?
Were project goals, Objectives, Indicators, and activities aligned with local needs and priorities?
Are the activities and outputs of the programme consistent with the overall goal and objectives of the project?
How appropriate were the chosen interventions and programme design to the situation of different groups (children, young people, men, and women)?
How flexible was the project in adapting to the rapidly changing needs of the context?

Coverage

· Did World Vision prioritised and targeted geographical locations based on humanitarian need and how were project beneficiaries identified?

· Did World Vision reach the most vulnerable women, men, boys and girls in geographical locations where needs were greatest?

Efficiency

· Was the project implemented based on the best use of existing internal and external resources and capacity?

· How effective was the project approach in demonstrating value for money (3Es)?

· Were program objectives realistic and achievable within the timeframe and was the project implemented on schedule?

· Were project resources/inputs (funds, expertise, time etc.) economically converted to results/outputs i.e. been delivered as agreed? Were program resources used to maximize service/support provision to affected communities? What cost effective alternatives could have been used?

Effectiveness

· To what extent have stated objectives and planned results (impact, outcome, outputs) been met? What factors inhibited or accelerated the meeting of objectives and results?

· How timely and effective was the project in responding to urgent humanitarian needs amongst displaced populations?

· Assess the effectiveness of flexibility approach in the context and with specific outcomes?

· How effective has been World Vision’s approach in the implementation and management of project activities? What are the limitations and what could have been done better?

· How appropriate and effective was World Vision’s approach to remote monitoring of activities including mechanisms to obtain feedback from beneficiaries? What can be done to strengthen remote monitoring mechanisms?

· What mechanisms were in place to ensure accountability to beneficiaries and how effective were these mechanisms? What can be done to improve accountability mechanisms in remotely managed contexts?

· What were the intended, unintended, positive or negative effects the project had?

Coordination

· How well the project did engaged and maintained relationships with key stakeholders in Syria?

· To what extend did the coordination positively influenced the projects and contributed to the achievement of planned results? What could have been done better and differently?

Lessons learnt and best practices: Key lessons at project and sector level

· What are lessons or aspects of the project can be replicated in other contexts? How do the lessons relate to any innovative aspects of the project that were highlighted in the project proposal?

· What new initiatives, approaches/ways should be included in future projects?

Evaluation process and methods

While the consultant will use experience to recommend the evaluation process and methodology, it is expected that a variety of methods will be used. The evaluation methods should be clearly outlined and their appropriateness, relative to the evaluation’s primary purpose and focus and these should be explained pointing out the strengths and weaknesses of the methods. The consultant will develop a detailed evaluation methodology which will be approved by World Vision’s MEAL Manager.

A likely methodology during the assignment will be as follows:

· Review the relevant project documents, project proposal, log frame, periodic project monitoring reports, minutes of meetings and other relevant documents including secondary literature.

· Identify data to be collected, likely constraints to the evaluation and how these will be addressed

· Field visits to project locations subject to security situation

· Key informant interviews with local sector specialists for Health, WASH and Food

· Household survey and gender disaggregated FGDs in all project locations

Expected outputs

i. Develop and design the evaluation framework, utilizing quality tools based on previous studies and best practice.

ii. Develop a detailed work plan for the evaluation which will be reviewed by the World Vision Management and implement the Evaluation according to the work-plan.

iii. Develop Evaluation methodology based on best practice and to be approved and validated by WV MEAL Manager

iv. Initial debrief/findings presentation to WV at least one week after data collection has been completed

v. Evaluation report in line with agreed reporting structure - A draft of the report must be submitted to the World Vision Programs team for review and approval at least 1 week before the publication date agreed in the work plan.

vi. Final Evaluation report

The final project evaluation report should have the following format:

i) Executive Summary

ii) Background

iii) Methodology

iv) Findings and Analysis

a. Relevance/appropriateness

b. Effectiveness

c. Efficiency

d. Coverage

e. Project best practices and lessons learnt

f. Coordination

v) Recommendations

vi) Conclusion

vii) Annexes

The final report will be shared with the Dutch Government. A brief of programme achievements will be shared with other NGOs and WVZ country emergency responses.

Evaluation Timeline

Proposed timeframe for this evaluation is starting 1st February 2016 and expected to have the First Draft of the Evaluation Report by 5^th March 2016. The Final Evaluation Report incorporating all the feedback from World Vision leadership and the selected consultant is expected by 30^th March 2016.

Qualifications

The external evaluator (Team Leader) must have experience or significant knowledge of the humanitarian Response mechanisms especially in conflict contexts. Master’s degree in Demography, public health, health statistics or developmental studies and preferably with strong background in statistics.

How to apply:

Applicants Competencies

i. Five years of field-based experience in conducting health project evaluations in emergencies

ii. Strong skills in quantitative and qualitative evaluation methods is required

iii. Technical capacity in report writing and aptitude for conducting evaluation sessions.

iv. Experience in evaluating projects managed in remote and/or in insecure context would be an asset.

v. Knowledge of the country and local languages is an advantage.

Additional Information and Conditions of Contract

All costs for conducting the evaluation should be included in the proposal, including transportation, any tax obligations, etc.

The contract will include details of a results based payment system: 10% at inception, 65% after the approval of data collection tools and Evaluation framework; final payment after the receipt of a satisfactory final report.

Application process