Appendix A4 Mid-term Evaluation Report (February 2003) Introduction
|
|  Yüklə 1.47 Mb.
|
Appendix B9 Standard GEF Monitoring and Evaluation PlanAppendix B9: Standard M&E Plan and Budget for FSP and MSPPlease note that some parts of this Annex reads as an explanation of the purpose of certain events or reports (e.g., "the purpose and objective of the Inception Workshop . . ."), and go into the UNDP-GEF M&E manual (duly referenced) or into the Project Management Manual (produced for each project as an input to the Project Inception Workshop, and adapted from standard UNDP-GEF text and format). Part iv - Monitoring and Evaluation Plan Project monitoring and evaluation will be conducted in accordance with established UNDP and GEF procedures and will be provided by the project team and the UNDP Country Office (UNDP-CO) with support from UNDP/GEF. The Logical Framework Matrix in Annex 1 provides performance and impact indicators for project implementation along with their corresponding means of verification. These will form the basis on which the project's Monitoring and Evaluation system will be built. The following sections outline the principle components of the Monitoring and Evaluation Plan and indicative cost estimates related to M&E activities. The project's Monitoring and Evaluation Plan will be presented and finalized at the Project's Inception Report following a collective fine-tuning of indicators, means of verification, and the full definition of project staff M&E responsibilities. 1. Monitoring and Reporting 1.1. Project Inception Phase A Project Inception Workshop will be conducted with the full project team, relevant government counterparts, co-financing partners, the UNDP-CO and representation from the UNDP-GEF Regional Coordinating Unit, as well as UNDP-GEF (HQs) as appropriate. A fundamental objective of this Inception Workshop will be to assist the project team to understand and take ownership of the project’s goals and objectives, as well as finalize preparation of the project's first annual workplan on the basis of the project's logframe matrix. This will include reviewing the logframe (indicators, means of verification, assumptions), imparting additional detail as needed, and on the basis of this exercise finalize the Annual Work Plan (AWP) with precise and measurable performance indicators, and in a manner consistent with the expected outcomes for the project. Additionally, the purpose and objective of the Inception Workshop (IW) will be to: (i) introduce project staff with the UNDP-GEF expanded team which will support the project during its implementation, namely the CO and responsible Regional Coordinating Unit staff; (ii) detail the roles, support services and complementary responsibilities of UNDP-CO and RCU staff vis a vis the project team; (iii) provide a detailed overview of UNDP-GEF reporting and monitoring and evaluation (M&E) requirements, with particular emphasis on the Annual Project Implementation Reviews (PIRs) and related documentation, the Annual Project Report (APR), Tripartite Review Meetings, as well as mid-term and final evaluations. Equally, the IW will provide an opportunity to inform the project team on UNDP project related budgetary planning, budget reviews, and mandatory budget rephasings. The IW will also provide an opportunity for all parties to understand their roles, functions, and responsibilities within the project's decision-making structures, including reporting and communication lines, and conflict resolution mechanisms. The Terms of Reference for project staff and decision-making structures will be discussed again, as needed, in order to clarify for all each parties responsibilities during the project's implementation phase. 1.2. Monitoring responsibilities and events A detailed schedule of project reviews meetings will be developed by the project management, in consultation with project implementation partners and stakeholder representatives and incorporated in the Project Inception Report. Such a schedule will include: (i) tentative time frames for Tripartite Reviews, Steering Committee Meetings, (or relevant advisory and/or coordination mechanisms) and (ii) project related Monitoring and Evaluation activities. Day to day monitoring of implementation progress will be the responsibility of the Project Coordinator, Director or CTA (depending on the established project structure) based on the project's Annual Workplan and its indicators. The Project Team will inform the UNDP-CO of any delays or difficulties faced during implementation so that the appropriate support or corrective measures can be adopted in a timely and remedial fashion. The Project Coordinator and the Project GEF Technical Advisor will fine-tune the progress and performance/impact indicators of the project in consultation with the full project team at the Inception Workshop with support from UNDP-CO and assisted by the UNDP-GEF Regional Coordinating Unit.. Specific targets for the first year implementation progress indicators together with their means of verification will be developed at this Workshop. These will be used to assess whether implementation is proceeding at the intended pace and in the right direction and will form part of the Annual Workplan. The local implementing agencies will also take part in the Inception Workshop in which a common vision of overall project goals will be established. Targets and indicators for subsequent years would be defined annually as part of the internal evaluation and planning processes undertaken by the project team. Measurement of impact indicators related to global benefits will occur according to the schedules defined in the Inception Workshop and tentatively outlined in the indicative Impact Measurement Template at the end of this Annex. The measurement, of these will be undertaken through subcontracts or retainers with relevant institutions (e.g. vegetation cover via analysis of satellite imagery, or populations of key species through inventories) or through specific studies that are to form part of the projects activities (e.g. measurement carbon benefits from improved efficiency of ovens or through surveys for capacity building efforts) or periodic sampling such as with sedimentation. Periodic monitoring of implementation progress will be undertaken by the UNDP-CO through quarterly meetings with the project proponent, or more frequently as deemed necessary. This will allow parties to take stock and to troubleshoot any problems pertaining to the project in a timely fashion to ensure smooth implementation of project activities. UNDP Country Offices and UNDP-GEF RCUs as appropriate, will conduct yearly visits to projects that have field sites, or more often based on an agreed upon scheduled to be detailed in the project's Inception Report / Annual Workplan. to assess first hand project progress. Any other member of the Steering Committee can also accompany, as decided by the SC. A Field Visit Report will be prepared by the CO and circulated no less than one month after the visit to the project team, all SC members, and UNDP-GEF. Annual Monitoring will occur through the Tripartite Review (TPR). This is t he highest policy-level meeting of the parties directly involved in the implementation of a project. The project will be subject to Tripartite Review (TPR) at least once every year. The first such meeting will be held within the first twelve months of the start of full implementation. The project proponent will prepare an Annual Project Report (APR) and submit it to UNDP-CO and the UNDP-GEF regional office at least two weeks prior to the TPR for review and comments. The APR will be used as one of the basic documents for discussions in the TPR meeting. The project proponent will present the APR to the TPR, highlighting policy issues and recommendations for the decision of the TPR participants. The project proponent also informs the participants of any agreement reached by stakeholders during the APR preparation on how to resolve operational issues. Separate reviews of each project component may also be conducted if necessary. Terminal Tripartite Review (TTR) The terminal tripartite review is held in the last month of project operations. The project proponent is responsible for preparing the Terminal Report and submitting it to UNDP-CO and LAC-GEF's Regional Coordinating Unit. It shall be prepared in draft at least two months in advance of the TTR in order to allow review, and will serve as the basis for discussions in the TTR. T he terminal tripartite review considers the implementation of the project as a whole, paying particular attention to whether the project has achieved its stated objectives and contributed to the broader environmental objective. It decides whether any actions are still necessary, particularly in relation to sustainability of project results, and acts as a vehicle through which lessons learnt can be captured to feed into other projects under implementation of formulation. The TPR has the authority to suspend disbursement if project performance benchmarks are not met. Benchmarks are provided in Annex …/will be developed at the Inception Workshop, based on delivery rates, and qualitative assessments of achievements of outputs. 1.3. Project Monitoring Reporting The Project Coordinator in conjunction with the UNDP-GEF extended team will be responsible for the preparation and submission of the following reports that form part of the monitoring process. Items (a) through (f) are mandatory and strictly related to monitoring, while (g) through (h) have a broader function and the frequency and nature is project specific to be defined throughout implementation. (a) Inception Report (IR) A Project Inception Report will be prepared immediately following the Inception Workshop. It will include a detailed Firs Year/ Annual Work Plan divided in quarterly time-frames detailing the activities and progress indicators that will guide implementation during the first year of the project. This Work Plan would include the dates of specific field visits, support missions from the UNDP-CO or the Regional Coordinating Unit (RCU) or consultants, as well as time-frames for meetings of the project's decision making structures. The Report will also include the detailed project budget for the first full year of implementation, prepared on the basis of the Annual Work Plan, and including any monitoring and evaluation requirements to effectively measure project performance during the targeted 12 months time-frame. The Inception Report will include a more detailed narrative on the institutional roles, responsibilities, coordinating actions and feedback mechanisms of project related partners. In addition, a section will be included on progress to date on project establishment and start-up activities and an update of any changed external conditions that may effect project implementation. When finalized the report will be circulated to project counterparts who will be given a period of one calendar month in which to respond with comments or queries. Prior to this circulation of the IR, the UNDP Country Office and UNDP-GEF’s Regional Coordinating Unit will review the document.
The APR is a UNDP requirement and part of UNDP’s Country Office central oversight, monitoring and project management. It is a self -assessment report by project management to the CO and provides input to the country office reporting process and the ROAR, as well as forming a key input to the Tripartite Project Review. An APR will be prepared on an annual basis prior to the Tripartite Project Review, to reflect progress achieved in meeting the project's Annual Work Plan and assess performance of the project in contributing to intended outcomes through outputs and partnership work. The format of the APR is flexible but should include the following:
The PIR is an annual monitoring process mandated by the GEF. It has become an essential management and monitoring tool for project managers and offers the main vehicle for extracting lessons from ongoing projects. Once the project has been under implementation for a year, a Project Implementation Report must be completed by the CO together with the project. The PIR can be prepared any time during the year (July-June) and ideally prior to the TPR. The PIR should then be discussed in the TPR so that the result would be a PIR that has been agreed upon by the project, the executing agency, UNDP CO and the concerned RC. The individual PIRs are collected, reviewed and analysed by the RCs prior to sending them to the focal area clusters at the UNDP/GEF headquarters. The focal area clusters supported by the UNDP/GEF M&E Unit analyse the PIRs by focal area, theme and region for common issues/results and lessons. The TAs and PTAs play a key role in this consolidating analysis. The focal area PIRs are then discussed in the GEF Interagency Focal Area Task Forces in or around November each year and consolidated reports by focal area are collated by the GEF Independent M&E Unit based on the Task Force findings. The GEF M&E Unit provides the scope and content of the PIR. In light of the similarities of both APR and PIR, UNDP/GEF has prepared a harmonized format for reference. Please refer to Annex H-3.
Short reports outlining main updates in project progress will be provided quarterly to the local UNDP Country Office and the UNDP-GEF regional office by the project team. See format attached.
As and when called for by UNDP, UNDP-GEF or the Implementing Partner, the project team will prepare Specific Thematic Reports, focusing on specific issues or areas of activity. The request for a Thematic Report will be provided to the project team in written form by UNDP and will clearly state the issue or activities that need to be reported on. These reports can be used as a form of lessons learnt exercise, specific oversight in key areas, or as troubleshooting exercises to evaluate and overcome obstacles and difficulties encountered. UNDP is requested to minimize its requests for Thematic Reports, and when such are necessary will allow reasonable timeframes for their preparation by the project team.
During the last three months of the project the project team will prepare the Project Terminal Report. This comprehensive report will summarize all activities, achievements and outputs of the Project, lessons learnt, objectives met, or not achieved, structures and systems implemented, etc. and will be the definitive statement of the Project’s activities during its lifetime. It will also lay out recommendations for any further steps that may need to be taken to ensure sustainability and replicability of the Project’s activities.
Technical Reports are detailed documents covering specific areas of analysis or scientific specializations within the overall project. As part of the Inception Report, the project team will prepare a draft Reports List, detailing the technical reports that are expected to be prepared on key areas of activity during the course of the Project, and tentative due dates. Where necessary this Reports List will be revised and updated, and included in subsequent APRs. Technical Reports may also be prepared by external consultants and should be comprehensive, specialized analyses of clearly defined areas of research within the framework of the project and its sites. These technical reports will represent, as appropriate, the project's substantive contribution to specific areas, and will be used in efforts to disseminate relevant information and best practices at local, national and international levels.
Project Publications will form a key method of crystallizing and disseminating the results and achievements of the Project. These publications may be scientific or informational texts on the activities and achievements of the Project, in the form of journal articles, multimedia publications, etc. These publications can be based on Technical Reports, depending upon the relevance, scientific worth, etc. of these Reports, or may be summaries or compilations of a series of Technical Reports and other research. The project team will determine if any of the Technical Reports merit formal publication, and will also (in consultation with UNDP, the government and other relevant stakeholder groups) plan and produce these Publications in a consistent and recognizable format. Project resources will need to be defined and allocated for these activities as appropriate and in a manner commensurate with the project's budget. 2. Independent Evaluation The project will be subjected to at least two independent external evaluations as follows:-
An independent Mid-Term Evaluation will be undertaken at the end of the second year of implementation. The Mid-Term Evaluation will determine progress being made towards the achievement of outcomes and will identify course correction if needed. It will focus on the effectiveness, efficiency and timeliness of project implementation; will highlight issues requiring decisions and actions; and will present initial lessons learned about project design, implementation and management. Findings of this review will be incorporated as recommendations for enhanced implementation during the final half of the project’s term. The organization, terms of reference and timing of the mid-term evaluation will be decided after consultation between the parties to the project document. The Terms of Reference for this Mid-term evaluation will be prepared by the UNDP CO based on guidance from the Regional Coordinating Unit and UNDP-GEF.
An independent Final Evaluation will take place three months prior to the terminal tripartite review meeting, and will focus on the same issues as the mid-term evaluation. The final evaluation will also look at impact and sustainability of results, including the contribution to capacity development and the achievement of global environmental goals. The Final Evaluation should also provide recommendations for follow-up activities. The Terms of Reference for this evaluation will be prepared by the UNDP CO based on guidance from the Regional Coordinating Unit and UNDP-GEF. |