The World Bank Report No: ISR13012 Implementation Status & Results Armenia Second Education Quality and Relevance (APL 2) (P107772) Public Disclosure Copy Operation Name: Second Education Quality and Relevance (APL 2) (P107772) Project Stage: Implementation Seq.No: 9 Status: ARCHIVED Archive Date: 15-Jan-2014 Country: Armenia Approval FY: 2009 Product Line: IBRD/IDA Region: EUROPE AND CENTRAL ASIA Lending Instrument: Adaptable Program Loan Implementing Agency(ies): Key Dates Board Approval Date 12-May-2009 Original Closing Date 30-Nov-2014 Planned Mid Term Review Date 12-Nov-2012 Last Archived ISR Date 23-Jun-2013 Effectiveness Date 02-Oct-2009 Revised Closing Date 30-Nov-2014 Actual Mid Term Review Date 14-Dec-2012 Project Development Objectives Project Development Objective (from Project Appraisal Document) The proposed Project Development Objectives are: (i) enhance school learning in general education and improve the school readiness of children entering primary education; and (ii) support the integration of Armenian Tertiary Education system into the European Higher Education Area. Has the Project Development Objective been changed since Board Approval of the Project? Yes No Component(s) Component Name Component Cost Enhancing the Quality of General Education 15.73 Supporting Tertiary Education Reforms in the Context of Bologna Agenda 6.02 Project Management, Monitoring & Evaluation 3.25 Overall Ratings Previous Rating Current Rating Public Disclosure Copy Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Satisfactory Moderately Satisfactory Overall Risk Rating Low Moderate Implementation Status Overview Overall progress towards achievement of the Project Development Objectives is rated as Moderately Satisfactory. Two out of the three outcome indicators present a positive trend (improved Early Development Index of students in preschools and kindergartens receiving grants; and standings of Armenia in the Bologna Scorecard), while the other indicator (performance of Armenian students in TIMSS 2011) will need to be revised due to reliability issues. At present, most of the core project activities are on track towards achieving the intended end of the program targets. These include, among others, promoting school readiness and equal opportunities at the start of General Education; enhancing the quality of education through improved teacher in-service training and professional development; continuing support to the integration of ICT in the teaching and learning process; supporting the Page 1 of 7 The World Bank Report No: ISR13012 implementation of the high-school reform; establishing and strengthening the National Quality Assurance System; developing the capacity of the Ministry of Education and Science to implement a sustainable financing system for higher education; and reforming pre-service teacher education. As of November 2013, 61 percent of the credit funds have been disbursed. Public Disclosure Copy Locations No Location data has been entered Results Project Development Objective Indicators Indicator Name Core Unit of Measure Baseline Current End Target Improved EDI scores of students in KG and Text Value No baseline 50 percent improvement in EDI scores are higher in schools receiving the grants with regard to children’s development as a treatment group as opposed students in the control group. result of pre-school to control group and this attendance. The difference of difference is statistically the results of children significant. intreatment and control groups are also tangible indicating higher development in children attending preschools. Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments Based on survey results of the Baker Tilly monitoring survey (2012). Improved examination and tests scores in Text Value TIMSS 2007: 488 Science; TIMSS 2011: 412 science; 5% improvement in UEE project-targeted schools (TIMSS 2011 and 499 Mathematics 467 mathematics. average scores (Armenian UEE) language, Math)) Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments Data from 2011 TIMSS. The unusual strong increase in Public Disclosure Copy TIMSS scores between 2003 and 2007 and the unusual strong decrease in TIMSS scores between 2007 and 2011 indicate that there are technical issues with the baseline of the project (TIMSS 2007). Due to this fact,the Bank is expecting a request from Government to revise this indicator. Page 2 of 7 The World Bank Report No: ISR13012 Standings of Armenia in the Bologna Text Value QA: 1 red, 2 yellows, 1 light Advances in both Quality 75% of 1 ratings in QA, Scorecard improving from Orange and Yellow green. Recognition: 1 yellow, Assurance (QF) and recognition and degree to Green 1 orange, 1 light green Recognition (R). QA: 3 yellow system are green. and 1 green; R: 1 yellow, 1 Public Disclosure Copy yellow, 1 orange, 1 green. Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments The European Higher Education Area in 2012: Bologna Process Implementation Report. European Higher Education Area. Intermediate Results Indicators Indicator Name Core Unit of Measure Baseline Current End Target % of teachers intensively using ICT and other Text Value Study on ICT use in schools, 50.5% 60% new materials in the classroom 2008, 45% of teachers intensively using ICT and other materials in the classroom. Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments Follow on survey carried out by NACET on the basis of questionnaires reviewed by the Bank. Intensive use defined in base of the survey as (i) a cumulative figure from good and better ICT skills, (ii) usage of ICT in classroom Public Disclosure Copy several times and more often in a month and more often and (iii) teacher's development of electronic materials for their classes. % of teachers taking part in pedagogical Text Value No baseline 57.5 % Increased proportion. development programs Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments By November 2013, 57.5 % of total teachers had received training for attestation Page 3 of 7 The World Bank Report No: ISR13012 purposes. This activity is funded now by the Ministry of Education and Science budget. Public Disclosure Copy % of teachers still using exclusively the Text Value No baseline 32% Reduced proportion presentation/recitation mode of teaching Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments According to study results carried out by the consulting firm in 2013. This refers to the teachers whom use exclusively the presentation/ recitation mode of teaching. % of high school students who visited the Text Value No baseline 70% 30% of High School Students. resource center (laboratory and library) in the Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 previous month Comments There are 2.24 visits per student in high schools in the period of October - December-2012. A new survey cycle has been started from October - December 2013. Results not yet available. % of daily lessons which take place at the Text Value No baseline 20% Number of students visiting resource center and lessons taking place at the resource center increases. Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments Based on results for the period September-December 2012. Revised results will be available by end of December 2013. Number of public and private universities Text Value 0 3 public and 2 private 5 public universities and 7 Public Disclosure Copy evaluated against the newly developed QA universities. private universities standards, criteria, procedures and guidelines Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments 7 more public universities and 3 more private are in the process. Page 4 of 7 The World Bank Report No: ISR13012 Number of public and private universities# that Text Value 0 2 public. All remaining public and 5 have operational internal QA Units in place private universities. according to the new QA standards Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Public Disclosure Copy Comments 18 public and 3 private universities are in process of establishment/improvement of internal QA units. MoES updates the Higher Education Strategy Text Value 0 TEMIS not yet operational Higher Education Strategy using the information/data collected through updated based on TEMIS information/data collected through TEMIS. Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments Development of TEMIS completed. The pre commission testing of the system has been successfully conducted. Installation of TEMIS in sites is completed. Altogether 205 representatives of Professional Institutions has been trained on the use of TEMIS. Universities produce a strategic plan and self- Text Value 0 TEMIS not yet operational 5 public universities and 2 assessment reports using the information/data private universities. collected through TEMIS Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Comments Development of TEMIS completed. The pre commission testing of the system has been successfully conducted. Installation of TEMIS in sites is completed. Public Disclosure Copy Altogether 205 representatives of Professional Institutions has been trained on the use of TEMIS. Number of teacher education curricula Text Value 0 Teacher training curricula Teacher training curricula comparable to a typical Bologna program drafted and under revision by approved. the Ministry of Education and Science. Date 02-Feb-2009 03-Dec-2013 30-Nov-2014 Page 5 of 7 The World Bank Report No: ISR13012 Comments All teacher education curricula for bachelor and master studies have been revised by the assistance of Oulu Public Disclosure Copy University of Finland and submitted to PIU. Teacher training curricula not yet approved by the Ministry of Education and Science. System for learning assessment at the primary Yes/No Value No level Date 12-May-2009 03-Dec-2013 30-Nov-2014 Comments READ Armenia Trust Fund (linked to the project) is supporting the enhancement of student assessments in Armenia. Utility of the learning assessment system Number Value 0.00 0.00 0.00 Sub Type Supplemental Number of universities that completed Number Value 0.00 0.00 3.00 implementation of CIF grants. Date 02-Apr-2013 03-Dec-2013 Comments Baseline set at the project Initial disbursements made to At least 2 public and 1 private restructuring date as this is a 10 universities according to universities. new indicator added to the the signed Grant Agreements. result framework at restructuring. One round of CIF proposal selection completed Yes/No Value No Yes Yes and initial disbursements made Date 02-Apr-2013 03-Dec-2013 Comments Baseline set at the project 14 proposals received for CIF restructuring date as this is a pilot stage. Evaluation of CIF new indicator added to the grant proposals completed. Public Disclosure Copy result framework at Grant Agreements signed restructuring. with the 10 selected proposals. Data on Financial Performance (as of 02-Dec-2013) Financial Agreement(s) Key Dates Project Ln/Cr/Tf Status Approval Date Signing Date Effectiveness Date Original Closing Date Revised Closing Date P107772 IDA-45650 Effective 12-May-2009 05-Jun-2009 02-Oct-2009 30-Nov-2014 30-Nov-2014 Page 6 of 7 The World Bank Report No: ISR13012 Disbursements (in Millions) Project Ln/Cr/Tf Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P107772 IDA-45650 Effective XDR 17.00 17.00 0.00 10.39 6.61 61.00 Public Disclosure Copy Disbursement Graph Key Decisions Regarding Implementation The Project was restructured in April 2013 to (a) introduce changes to the component two of the project and (b) make adjustments to the Project Results Framework. The Project Development Objectives of the project were not changed. Restructuring History CD Decision on 07-Jul-2012, CD Decision on 07-Jul-2013 Public Disclosure Copy Related Projects There are no related projects. Page 7 of 7