Terms of Reference for mid-term Project Evaluation
Big Lottery Fund grant for the project
‘Improved Education for Deafblind People’
(1st April 2014-31st March 2017)
Project ID: 0010103727
I) Introduction
These Terms of Reference for an external mid-term project evaluation related to the Big Lottery Fund (BIG) grant for the project ‘Improved Education for Deafblind People (2014-2017)’ in partnership with Sense International and the delivery partners in Kenya, Tanzania and Uganda (please refer to partnership agreement for partner details).
A mid-term project evaluation is important, in accordance with the project business plan submitted to BIG and for the purposes of programme monitoring, evaluation and to respond to any recommendations where possible within the lifetime of the grant agreement and beyond for Sense International.
II) Objectives of the Evaluation
Objectives:
a) To assess the extent to which the project Outcomes and Milestones have been met at the mid-term of the project through a wide-ranging consultation process.
b) To measure the project against a set of assessment criteria of Relevance; Effectiveness; Efficiency; Sustainability and; Impact.
1.Relevance:
Are the actions/activities undertaken relevant to the project objectives?
Do the actions/activities undertaken respond to the needs of the target population?
2.Effectiveness
Do the achievements meet the expected results of the project at this stage?
To what extent has project delivery provided value for money?
3.Efficiency
Has the project managed to obtain the expected results on time and with the budget forecast intended at the mid-way point?
To what extent has the budget execution contributed to achieving the objectives?
4.Sustainability
What kind of strategies is the project implementing to achieve sustainability?
Will the project activities be sustainable after the project ends?
5.Impact
To what extent has the project built the capacity of civil society?
To what extent has the project managed to impact the target population?
c) To document lessons learned to date.
d) To account to beneficiaries, partners and BIG for the achievements and challenges.
e) To make recommendations for the remainder of the project period and for future projects and strategy, including needs for potential future investment.
It is proposed that the evaluation will cover the first year and 7 months of project implementation, from 1st April 2014 - 31st October 2015.
Target Audience for Evaluation Report:
a) The Big Lottery Fund as the grant-making body.
b) Sense International.
c) Deafblind children and families through an accessible summary.
d) Local authorities, governments and schools
Planned Output:
The mid-term evaluation report in soft and hard copy in English up to 60 pages, including annexes, in Arial point 12.
For example, a suggested format for the evaluation could be:
· Contents page
· Abbreviations and acronyms page
· Executive summary
· A short introduction to the project
· The evaluation methodology
· Findings of the evaluation
· Recommendations
· Conclusion
· Annexes (e.g. reference documents, itinerary, consultations etc.)
BIG Project Outcomes and Milestones
The evaluation should assess progress to date against Outcomes and associated Milestones. The Outcomes are as follows (please see Project Monitoring format and Project Reports for full list of Milestones relating to each Outcome):
Outcome 1:
An improved appropriate and quality education system serving deaf blind children in East Africa, benefiting from new appropriate curricula, specially trained teachers, enhanced regional training and resource hubs as a platform to pilot Community Based Education.
Outcome 2:
More vulnerable deaf blind children are identified and referred for educational and rehabilitative support, as a result of an improved environment with increased awareness and understanding of the needs of deaf blind children and their families.
Outcome 3:
Deafblind children in East Africa benefit from appropriate and quality primary education in a school, home and community based setting, delivered in a partnership of families and education professionals, leading to improved educational achievement.
Outcome 4:
Shared learning, advocacy and joint work with governments of Kenya, Tanzania and Uganda leads to increased government awareness and engagement in providing resources for community based education for Deafblind children.
III) Proposed Methodology (for further discussion)
a) Briefing:
At the start of the evaluation process, Sense International representatives would hold a briefing session (in-person or by phone) with the evaluator to agree the overall evaluation methodology and confirm key issues to be addressed.
Due to the nature of the evaluation process, travel for consultations is envisaged and the evaluator should plan adequate visits meticulously with appropriate methods to collect and analyse relevant information.
b) Desk-based review:
Initial preparation by the evaluator is likely to consist of a desk based review of the main reference documents.
Main reference documents:
· Original project proposal, business plan and associated documents.
· Revised budget
· Year 1 semi-annual and annual reports, and year 2 semi-annual report submitted to BIG
· Any other documents of relevance to be confirmed in discussion with evaluator.
c) Evaluation:
A participatory approach involving the consultation of a broad cross-section of stakeholders is suggested for the evaluation. This could combine a range of evaluation methods, including structured and semi-structured interviews, focus groups and participatory workshops with project partners and beneficiaries as appropriate. Consultation should cover the following groups
· Deafblind and multiply disabled people with family members.
· Teachers and educators.
· Parents and professionals.
· Government administrators/officials where appropriate.
· Local partners from Kenya, Tanzania and Uganda.
· Sense International Kenya, Tanzania and Uganda representatives.
· Sense International UK representatives.
d) Report Writing and Feedback:
In writing the mid-term evaluation report, the evaluator should build in time for feedback on the draft evaluation report. Following this feedback the evaluator would then submit the final report after incorporating the feedback into the final document.
IV) Proposed Timeframe (for further discussion)
The mid-term evaluation process needs to be undertaken during November 2015, including the desk research, field research and draft report writing. We expect the feedback process and final report to be completed by early December 2015.
V) Proposed itinerary (tentative dates, for further discussion)
· 23rd October 2015 - Deadline for expressions of interest.
· 31st October 2015 - Evaluator selected and contract drawn up.
· Early November 2015 (approx. 2 days) - documentation and pre-reading shared with consultant evaluator, preliminary phone call scheduled.
· November (approx. 17 days) – field visits to project partners in Kenya, Tanzania, and Uganda.
· End November (approx. 5 days) report writing.
· 30th November 2015 - tentative deadline for draft evaluation report.
· 4th December 2015 -deadline for feedback.
· 10th December 2015 – evaluator to submit final evaluation report.
This equates to a total of 24 days to be discussed with the evaluator.
VII) Financial arrangements
Fees, as agreed with evaluator
20% of total to be paid - on signing contract, production of agreed itinerary.
80% of total to be paid - on production of final draft report.
In addition, we will cover the costs of travel, accommodation and subsistence (at specified rate) for the evaluator to visit partners in project locations.
VIII) Expertise and expectations of Evaluator
· Significant knowledge and experience of project evaluation.
· Knowledge of the countries involved.
· Excellent written English.
· Understanding of disability, including multiple disabilities and deafblindness.
· Expertise evaluating multi-country projects funded by European institutional donors desirable.
· Ability to travel to Kenya, Tanzania and Uganda within the given timeframe.
HOW TO APPLY:
For the application, please e-mail your CV and brief responses to the below tostevie.kent@senseinternational.org.uk by the 23rd October 2015:
1) Your experience of project evaluation for statutory funded projects
2) Your experience of research and evaluation methods
3) Your proposed methodology for this evaluation
4) Your understanding of the disability and development field
5) Any understanding you may have of the work of Sense International in East Africa or other work relevant to multiple disability.
6) Your availability to travel to school partners and other key project stakeholders for evaluation consultations in Kenya, Uganda and Tanzania during November 2015.
7) An indication of your consultancy fee expectation for an estimated duration of 24 days work for the evaluation consultation process and production of the final evaluation report.
