| Title: | Consultant as Mid-Term Evaluator |
| Project: | Preventing and Minimizing Child Labor in Identified Hazardous Sectors in Jordan |
| Project duration: | November 2019 up to Dec 2021 |
| Place of work: | The project targets the governorates of Amman, Mafraq and Irbid. |
| Date of issue: | 15/08/2022 |
Organisational Context:
Tamkeen for Legal Aid and Human Rights is a local non-governmental organization which was founded to combat the urgent needs of a growing migrant worker population in Jordan. It primarily tackles issues of labour protection, migration, and human trafficking, and is committed to finding remedies to address the various types of abuses taking place among them. Tamkeen implements a three-step approach to achieving its mission: i) prevention; ii) protection; and iii) prosecution, which allows targeted groups to receive long-standing aid, education regarding their legal rights, and assistance to those who have suffered abuse.
Project Context:
Tamkeen, in collaboration and support by the Regional Development and Protection Program for Lebanon, Jordan and Iraq (RDPP II), began the implementation of a two-year program called “Preventing and Minimizing Child Labor in Identified Hazardous Sectors in Jordan” to address short and long-term structural issues facing child labor in Jordan. The project aims to strengthen national capacities towards an enhanced protective and preventive environment for children by ensuring that relevant stakeholders are able to identify and respond to child labor issues.
As of July 2022, the program will have passed 2 years out of its 2.5-year timeframe*. The objectives of the project are: 1) to increase national capacities towards preventing and protecting child labor by focusing on hazardous sectors, including begging; 2) to protect and strengthen the livelihood channels in the targeted areas; and 3) to develop and re-implement the existing 2011 National Strategy to Combat Child Labor (NFCL).
Intended audience and use of the Mid Term Evaluation:
The intended recipients of this evaluation are Tamkeen and RDPP, who will receive all project deliverables. Tamkeen will be able to reflect on lessons learned from the mid-year project activities and use recommendations for how to improve program performance; whereas RDPP will use the information for its overall program evaluation and guidance.
The evaluation is also intended to identify strengths and weaknesses, as well as opportunities and risks, of the project and develop recommendations for any necessary changes in the overall implementation and orientation of the project by evaluating its effectiveness and delivery to date. Consequently, the evaluation will provide detailed recommendations for the remaining project period and help assess early signs of success or failure to propose necessary adjustments.
Purpose, objectives and scope of the Mid Term Evaluation:
The primary purpose of the evaluation is learning; evaluating the evidence of outcome changes; and possible impact changes.
The consultant will particularly focus on effectiveness, appropriateness, relevance, coherence, coverage, and coordination. The key objectives of this mid-term evaluation are to evaluate evidence of:
- The degree to which the project’s theory of change is working and if the project is affecting the effects of the project on the conditions and coping strategies of the target population
- The internal and external factors that have contributed to those effects.
- The unintended effects that might have also occurred as a result of the project.
- The conclusions that can be drawn about the project’s theory of change and overall effectiveness, as well as lessons learned and how these lessons could be used to inform future activities/projects.
In order to achieve these objectives, the consultant will work with relevant Project Management team members to refine and agree on the most appropriate strategies and methodology to source relevant evidence.
- Effectiveness
a. Are Tamkeen’s interventions broadly on course to achieve their purpose and outcome and impact level objectives of the program?
b. Which outcomes have outputs contributed to most, and from these, what activities stand out as pivotal to contribution at the outcome level?
c. What are the factors that have led to successful activity implementation? What are the obstacles to achievement of activity implementation and overall objectives of the project?
d. What, if any, changes could be made to the program to ensure more ambitious outcomes or outputs are not neglected? - Appropriateness and relevance
- What are the most significant changes in the program context that affected implementation and outcomes? Did the project successfully adapt to changes in the operating context? Have beneficiary needs changed? Do beneficiaries feel that the assistance provided by the project meets their most important needs? How do beneficiaries feel about the assistance given?
- Has the assistance provided by Tamkeen met the needs of the target actors and beneficiary groups?
- What, if any, changes are needed to make the program more appropriate and relevant? (Should be based primarily on lessons learned by the project team that could be applied to other aspects of the program).
- Coherence and sustainability
- What, if any, longer-term impact is the present program likely to have? What is the evidence-base for the achievement of longer-term outcomes/objectives?
- What, if any, changes could be made to the program to ensure short-term assistance meets longer-term needs?
- Coverage
- Have all the targeted populations benefitted equitably from the activities? Where? How? Are any subgroups left behind?
- Has the project’s choice of geographical spread been appropriate and justified? Have the activities reached the target groups? Have they affected these groups/individuals differently?
- Coordination
- To what extent have the activities been coordinated with local stakeholders/responders?
- To what extent have the sector-based activities been coordinated with the humanitarian community?
- Are there internal coordination challenges that impact the program? How have these been addressed? (Should be based primarily on lessons learnt by the project teams that could be applied to other aspects of the project).
The midterm evaluation should also complement the above with measuring the following Impact and Outcome Level indicators which were assessed at the baseline:
Impact Strengthen the national capacities towards enhanced protective and preventive environment related to child labor
Outcome
Impact: Strengthen the national capacities towards enhanced protective and preventive environment related to child labor
Outcome Impact and Outcome-Level indicators:
- Percentage of change of children in targeted communities engaged in child labor
- Percentage change in perceived safety/protection by targeted beneficiaries in their communities
- Percentage of legal assisted cases successfully resolved out of mediation & court representations cases
- Number of identified child labor cases referred and responded to
- Number of identified child labor cases as human trafficking victims, referred and responded to
- Number of entities finding training/capacity building relevant
- Percentage of change in community perceived availability & access to child labor services in the targeted areas
- Number of improved and endorsed National Strategy and Action Plan by Government
- Number of coalition members who refer to improved National Strategy and Action Plan in their advocacy activities
- Number of coalition members who adopt the improved National Strategy and its Action Plan in their own organizations’ strategies
The primary purpose of the evaluation is learning; evaluating the evidence of outcome changes; and possible impact changes.
The consultant will particularly focus on effectiveness, appropriateness, relevance, coherence, coverage, and coordination. The key objectives of this mid-term evaluation are to evaluate evidence of:
- The degree to which the project’s theory of change is working and if the project is affecting the effects of the project on the conditions and coping strategies of the target population
- The internal and external factors that have contributed to those effects.
- The unintended effects that might have also occurred as a result of the project.
- The conclusions that can be drawn about the project’s theory of change and overall effectiveness, as well as lessons learned and how these lessons could be used to inform future activities/projects.
In order to achieve these objectives, the consultant will work with relevant Project Management team members to refine and agree on the most appropriate strategies and methodology to source relevant evidence. - Effectiveness
a. Are Tamkeen’s interventions broadly on course to achieve their purpose and outcome and impact level objectives of the program?
b. Which outcomes have outputs contributed to most, and from these, what activities stand out as pivotal to contribution at the outcome level?
c. What are the factors that have led to successful activity implementation? What are the obstacles to achievement of activity implementation and overall objectives of the project?
d. What, if any, changes could be made to the program to ensure more ambitious outcomes or outputs are not neglected? - Appropriateness and relevance
a. What are the most significant changes in the program context that affected implementation and outcomes? Did the project successfully adapt to changes in the operating context? Have beneficiary needs changed? Do beneficiaries feel that the assistance provided by the project meets their most important needs? How do beneficiaries feel about the assistance given?
b. Has the assistance provided by Tamkeen met the needs of the target actors and beneficiary groups?
c. What, if any, changes are needed to make the program more appropriate and relevant? (Should be based primarily on lessons learned by the project team that could be applied to other aspects of the program). - Coherence and sustainability
a. What, if any, longer-term impact is the present program likely to have? What is the evidence-base for the achievement of longer-term outcomes/objectives?
b. What, if any, changes could be made to the program to ensure short-term assistance meets longer-term needs? - Coverage
a. Have all the targeted populations benefitted equitably from the activities? Where? How? Are any subgroups left behind?
b. Has the project’s choice of geographical spread been appropriate and justified? Have the activities reached the target groups? Have they affected these groups/individuals differently? - Coordination
a. To what extent have the activities been coordinated with local stakeholders/responders?
b. To what extent have the sector-based activities been coordinated with the humanitarian community?
c. Are there internal coordination challenges that impact the program? How have these been addressed? (Should be based primarily on lessons learnt by the project teams that could be applied to other aspects of the project).
The midterm evaluation should also complement the above with measuring the following Impact and Outcome Level indicators which were assessed at the baseline:
Impact Strengthen the national capacities towards enhanced protective and preventive environment related to child labor
Outcome
Impact and Outcome-Level indicators: 1. Percentage of change of children in targeted communities engaged in child labor
- Percentage change in perceived safety/protection by targeted beneficiaries in their communities
- Percentage of legal assisted cases successfully resolved out of mediation & court representations cases
- Number of identified child labor cases referred and responded to
- Number of identified child labor cases as human trafficking victims, referred and responded to
- Number of entities finding training/capacity building relevant
- Percentage of change in community perceived availability & access to child labor services in the targeted areas
- Number of improved and endorsed National Strategy and Action Plan by Government
- Number of coalition members who refer to improved National Strategy and Action Plan in their advocacy activities
- Number of coalition members who adopt the improved National Strategy and its Action Plan in their own organizations’ strategies
The consultant is also expected to review the following aspects of the program:
- Program design
- Assess the value added of the program design approach
- Review the problems addressed by the program, underlying assumptions, and effects on achieving program goals
- Assess the effectivity of interaction and co-operation amongst implementing partners
- Review the program Theory of Change (ToC) and determine if it provides the most effective route towards expected results
- Assess the extent to which cross-cutting issues were integrated into program design
- Assess the sustainability considerations in program design
- Recommend areas for improvement in the design of the program
- Program implementation
- Examine if, how, and why the implementation strategy contributes to the achievement of expected program goals
- Assess the general implementation and management of project components in terms of inputs, activities, adherence to budgets, and major factors that have facilitated or hindered the progress of the program’s implementation
- Review of program coordination and management arrangements, such as the monitoring and evaluation of activities, financial management, risk identification and management system and communication
- Program progress in relation to Outputs, Outcomes, and Impacts
- Achievements to date of program outputs and outcomes as compared with end-of-project targets outlined in the program MEAL framework
- Assess the likelihood of achieving program targets within remaining program implementation period
- Review aspects of the program that have already been successful, identify ways in which the program can further work on these benefits
- Identify barriers to achieving the program objectives and targets in the remainder of the implementation period
- Identify significant unexpected effects, and how to mitigate them
- Sustainability
- Is a sustainability strategy in place?
- Assess the extent to which the activities and their benefits will continue after the end of funding
- Examine the extent to which the benefits of the program are sustainable
- Learning
- Identify good practices and lessons learned
- Document the main challenges of the program and recommendations on how to overcome the challenges
- Assess and document the degree to which program team has adapted to external changes, what they learned, and how to make adaptivity more effective
Methodology:
The consultant is requested to propose a methodology to be used to carry out the review. The proposed methodology should address the concerns and questions outlined within the ToR and specify the review issues, questions, data collection methods, rounds and timing of data collection, and analysis to be conducted. It should encompass both qualitative and quantitative methods. It should also allow for consultation with relevant stakeholders. The evaluation will consist of the following activities:
- Document review: the reviewing of relevant program documents, such as:
- Program proposal
- Financial documents
- Annual work plans
- MEAL framework
- Program activity reports or deliverables
- To be determined during the first meeting.
- Minutes of meetings (for relative activities)
- Field visits: conducting fieldwork around program activities that have been, and will continue to, be undertaken during the implementation period. The consultant will contact the relevant stakeholders to coordinate for them.
- Interviews: interviews will be carried out during the field visits. The appropriate data collection materials will be developed by the consultant and reviewed by the project management team for approval.
The consultant will develop the methodology and tools of evaluation and finalize them in consultation with Tamkeen’s project management team, where the office is based in Amman. It is expected that, if necessary, the consultant will cooperate with the team whenever necessary to carry out the fieldwork and manage necessary contacts.
Key Informants for interviews will be be negotiated and determined with Tamkeen’s staff during the first meeting.
Finally, Tamkeen will be seeking to abide by specific principles of evaluation, which are:
- Independence: measures should be put in place to prevent bias.
- Usefulness: Evaluation findings must be articulated clearly and in a way that maximizes the potential for these findings to inform decision-making.
- Representativeness: Evaluations should strive to include a wide range of beneficiaries, including from different genders, age groups, ethnic groups and locations as relevant to the project.
- Gender sensitivity: Evaluations must be gender sensitive and also, where possible, try to assess the intended or unintended effects of the project on gender relations.
Logistics and support:
Tamkeen will support the evaluation through the following contributions:
- Compilation of background documentation and relevant data sets;
- Contact lists for internal interviewees, cooperation and planning;
- Logistical support for field visits, including travel costs;
- Meetings with the MEAL Officer.
The consultant is responsible for the timely delivery of the below deliverables.
All deliverables should be written in clear and plain English and made accessible to non-technical experts.
- Inception report
The inception report should be agreed with Tamkeen during inception, and should include:- A comprehensive description of the consultants understanding of the ToR and indicate any deficiency in the ToR, with proposed amendments
- A detailed methodology, which includes the data collection plan, data analysis plan, and tools to be used in the review
- A complete work plan for the review period
- A proposal for the final report layout
- Draft report
The draft report is expected to be completed by the end of the 6th week after inception of the review. The draft report will be presented and discussed with Tamkeen’s team, as well as RDPP. Inputs from the discussions shall be incorporated into the final report. - Final report
The final report should be submitted on the 8th week after receiving feedback on the draft report. The report will include all the details outlined in the ToR, focusing on the main findings and conclusions, lessons learned, and recommendations.
Payment Schedule:
The consultant shall be paid the consultancy fees upon completion of the following milestones:
- 30% after submission and presentation of the first progress report by 20th August 2022
- 30% after submission of the draft report by 15 September 2022
- 40% after submission of the final report by 30 September 2022
Submission Requirements:
Deadlines
• Potential consultants wishing to submit a proposal should submit according to the below requirements by the deadline of 31st July 2022.
• Incomplete, late, non-compliant applications will not be considered or replied to.
Components to submit
| Component | Content | Format |
| 1 | Technical Proposal, highlighting: Your experience and expertise in the areas required and outlined within the ToR;The consultant’s understanding of the requirements;A proposed methodological approachA detailed work plan (Gantt chart plus narrative), aligned with the above timeframe | 1 word or PDF document. |
| 2 | Financial Proposal | 1 word or PDF document |
| 3 | CVs of personnel who will be involved, outlining their relevant experience | 1 PDF document |
Essential skills, experience and qualifications:
The consultant should have:
- Prior experience in evaluations programs of a similar nature and scope;
- Sound knowledge of human rights issues, particularly in the Jordanian context;
- Sound knowledge on program development;
- Academic degree in social sciences and other related fields;
- Fluency in Arabic to be able to conduct necessary fieldwork and data collection;
- Ability to produce high quality analytical reports in English with limited editorial oversight;
- Excellent communication skills;
- Availability to undertake work in the provided timeline.
How to apply:
- Applications should be sent electronically to Nour Shtayyeh at nour@tamkeen-jo.org and copied to Dina Safarini at dina@amkeen-jo.org by no later than 31st July, 2022;
- Any need for clarifications on the Terms of Reference should be directed to Nour Shtayyeh using the above email address