The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Odisha Higher Education Program for Excellence and Equity (P160331) SOUTH ASIA | India | Education Global Practice | Requesting Unit: SACIN | Responsible Unit: HSAED IBRD/IDA | Program-for-Results Financing | FY 2018 | Team Leader(s): Kurt Larsen, Sangeeta Dey Seq No: 8 | ARCHIVED on 30-Aug-2021 | ISR47256 | Created by: Sangeeta Dey on 10-Jun-2021 | Modified by: Kurt Larsen on 25-Aug-2021 Program Development Objectives PDO Table Program Development Objective (from Program Appraisal Document) The development objective of the Program is to improve the quality of and students' equitable access to selected institutions and enhance governance of the higher education system in Odisha. Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Implementation Status and Key Decisions The program’s performance this year has been affected by the COVID-19 lockdown situation since mid-March 2020. The program has been restructured twice, first in October 2020 with a cancellation of US$ 11.3million on account of program savings due to the depreciation of the INR compared to the USD since the start of the program. The second restructuring was completed in January 2021 to adjust the program to the changed reality impacted by the COVID pandemic with another cancellation of US$ 35million, revision of two of the PDO indicators on equitable access and quality to align with the new reality of COVID 19 and the new National Education Policy to strengthen the likelihood of achieving the PDO, and a corresponding revision to two disbursement linked indicators (DLIs). The third PDO indicator on governance has made notable progress with the revised regulations of the Governing Bodies (GBs) issued by the Higher Education Department (HED) and implemented at the government aided colleges, and the revised rules for faculty recruitment and promotion in government colleges notified in the Odisha Gazette in February 2021. The progress in achieving the PDOs is Moderately Satisfactory. Despite the lockdown situation, the program has been able to achieve the following, including a solution to address the challenges posed by COVID-19 and to implement the National Education Policy, 2020: (i) revision of 25% of the syllabus units has been completed to include blended learning to inculcate self-study skills in students, (ii) achievement of an important policy related DLI result pertaining to revision of faculty recruitment and promotion rules for government colleges issued through a government order and notified in the Odisha Gazette, (iii) achievement of DLI result on financial management (online accounting system), which is a result of ongoing efforts by the HED to mandate all government aided colleges to enter their accounting data online to increase transparency and efficiency, (iv) notable progress on the work of Centers of Excellence (CoEs), and few of them are ready to file patents for their research innovations. However, based on the slow progress on the civil works and faculty training, the rating of Implementation Progress continues to be Moderately Satisfactory. The program has achieved a disbursement rate of 75% of the restructured loan amount of US$72.7million. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P160331 IBRD-87820 Effective USD 119.00 72.70 46.30 54.48 18.22 75% Key Dates (by loan) 8/30/2021 Page 1 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P160331 IBRD-87820 Effective 31-Aug-2017 07-Nov-2017 07-Dec-2017 30-Nov-2022 30-Nov-2022 Program Action Plan Program related: Consultants for M&E, capacity building and faculty development recruited to the PMU Action Description Completion Measurement: Contracts signed Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 31-May-2017 Completed Completion Measurement PMU is staffed Comments Program related: HED MIS operational Action Description Completion Measurement: MIS reports available Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 31-Aug-2018 Completed Completion Measurement MIS Functional Comments Program related: Needs assessment for short-term faculty training programs completed Action Description Completion Measurement: Needs assessment report published on the HED website Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 31-Mar-2019 Completed Completion Measurement Report received Comments FM and Procurement: Executive order issued by the HED mandating the use of online FM system at the all government-aided colleges in Action Description Odisha Completion Measurement: Executive Order published on the HED website Source DLI# Responsibility Timing Timing Value Status 8/30/2021 Page 2 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Fiduciary Systems Client Due Date 31-Mar-2018 Completed Completion Measurement Executive order completed Comments FM and Procurement: Model Finance Rules for colleges developed and recommended for adoption Action Description Completion Measurement: Executive order issued recommending Model Finance Rules for adoption and made available on the HED website Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 31-Oct-2018 Completed Completion Measurement Executive order issued recommending Model Finance Rules for adoption and made available on the HED website HED has constituted a Committee to develop the model Finance Rules for Colleges. The Committee is chaired by the Comments retired FA cum Special Secretary HED and the work is in progress. FM and Procurement: Procurement Manual prepared by the GoO adopted by the HED Action Description Completion Measurement: Manual disseminated to all colleges in the state Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 31-Aug-2018 Completed Completion Measurement Manual received Comments FM and Procurement: FM and Procurement training to nominated staff of selected institutions Action Description Completion Measurement: Training on use of manuals to all colleges in the state Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 07-Dec-2019 Completed Completion Measurement Training on use of manuals to all colleges in the state Comments Training has been done for round colleges. It has not yet been done for all round 2 colleges Action Description Governance and Accountability: Strengthening the vigilance cell in the HED 8/30/2021 Page 3 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Completion Measurement: Strengthening the vigilance cell in the HED to handle procurement complaints Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 31-Mar-2018 Completed Completion Measurement Strengthening the vigilance cell in the HED to handle procurement complaints Comments This is planned to be done soonest Social and environment actions: MoUs for HEIs should incorporate at least two to three specific actions to improve enrolment, retention and on-time Action Description graduation for the SC, ST and female students completion measurement: PMU Annual Report Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 07-Dec-2017 Completed Systems Completion Measurement PMU Annual Report Comments Social and Environment actions: HEIs should ensure functional GRM cells, Equal Opportunity Cells and Women Harassment Redressal Cells with Action Description adequate students and faculty representation in selected institutions Completion Measurement:PMU annual Report Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Recurrent Yearly Completed Systems Completion Measurement PMU annual report Comments Social and Environment Actions: Inclusion of the Environment Audit and Management Plan as part of the MoUs of selected universities/colleges Action Description Completion Measurement: Inclusion in MoUs with universities/colleges Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 07-Dec-2017 Completed Systems Completion Measurement Inclusion in MoUs with universities/colleges Comments 8/30/2021 Page 4 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Social and Environment Actions: Inclusion of EHS aspects in bidding documents of the construction agencies Action Description Completion Measurement: Inclusion in bid documents of the construction agencies Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 30-Sep-2018 In Progress Systems Completion Measurement Inclusion of EHS aspects in bidding documents of the construction agencies Comments The bidding documents are being prepared Social and Environment Actions: Capacity building of relevant staff of universities, colleges, the HED, and construction agencies to ensure awareness Action Description of and adherence to the existing legal and regulatory provisions. Completion Measurement: PMU A.R. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Recurrent Yearly In Progress Systems Completion Measurement Awareness and training done Comments The civil works have not started yet Social and Environment Actions: Strengthening insttl. and monitoring systems of HED/HEIs to adequately capture env. dimension thro' designation of Action Description an Env. Officer in PMU and assigning EHS functions to Bldg mgt Committee with HEIs. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 07-Dec-2017 Completed Systems Completion Measurement Staff in place Comments Risks Systematic Operations Risk-rating Tool 8/30/2021 Page 5 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Moderate Macroeconomic -- Moderate Substantial Sector Strategies and Policies -- Moderate Moderate Technical Design of Project or Program -- Moderate Moderate Institutional Capacity for Implementation and -- Moderate Moderate Sustainability Fiduciary -- Substantial Substantial Environment and Social -- Moderate Moderate Stakeholders -- Moderate Moderate Other -- Substantial Substantial Overall -- Moderate Moderate RiskComments Comments The SORT ratings for political and governance, and macroeconomic have changed. Political and governance: The continued political leadership of the state with the same Chief Minister continuing in his fourth term is providing stability in political leadership and governance in the state. The bureaucracy leadership in the Higher Education Department is also focused on project implementation and in finding solutions to address the challenges that have resulted due to the pandemic. Hence the risk rating has been reduced from Substantial to Moderate. The Macroeconomic situation has become fragile globally due to the pandemic. In Odisha too, like the rest of India, economic vulnerability and poverty has increased manifold. With higher education institutions closed over a prolonged period of time, it might take more years for the sector to contribute to the economy with graduate youth qualifying with the relevant skills and knowledge required by the job market and business enterprises. A more fragile macroeconomic situation might also imply that there is less resources for the higher education sector. The rating has thus been elevated from Moderate to Substantial. The 'Other' area continues to be substantial owing to the risks posed by COVID-19 and the continuing challenges it poses to project implementation. The uncertainty regarding the duration and the impact of COVID-19 on the sector makes it a substantial risk for the project and for the years to come. Some key initiatives being undertaken to ensure continuity of higher education and strengthening governance in the sector are introduction of blended learning for students (made a DLI under the restructuring), online training for faculty in collaboration with national Universities and increased emphasis on online financial accounting through the CAPA system(which achieved its DLR target for the first time in FY 21). The fiduciary risk rating continues to be substantial. Although there has been a cancellation of part program funds, which now makes the disbursement rate at 75%, the expenditures under the program are low (at 21% of the total program cost). The reason for this is the delay in the civil works which is the high value activity. Through a joint decision by the HED-PMU and the task team the expenditure reports are being shared with the Bank team on a more regular basis. Starting from the October-December 2020 period, quarterly expenditure reports are shared for closer monitoring of the expenditures. At the upcoming mission in August, there will be a detailed review of disbursements vs expenditures and strategies to maintain the balance till the end of the program period. Results PDO Indicators by Objectives / Outcomes Improve the students' equitable access to selected institutions IN01008646 ►Blended learning and self-study approach adopted in the selected HEIs (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target No blended learning 75% of selected HEIs No blended learning No blended learning Value implemented implementing the implemented implemented blended learning and 8/30/2021 Page 6 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) self-study approach modules Date 10-Dec-2020 10-Dec-2020 10-Dec-2020 31-Mar-2022 "Blended learning" is defined as learning instruction that promotes self-study for a portion of the curriculum Comments through the provision of study materials and tutorial classes. IN01008649 ►Improved student outcomes. 1) Percentage of on-time graduation rate of students in undergraduate degree programs in selected colleges (total students) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 60.00 0.00 0.00 64.00 Date 01-Aug-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 This indicator is a measure of quality and efficiency of the higher education sector. It was scheduled for monitoring from 2021 onwards. Given unforeseen delays in coursework and examination schedules with the Comments closure of colleges and universities since March 2020, this DLI target will be revised from 5 percent to 2 percent improvement annually in OTG. IN01008650 ►Improved student outcomes. 2) Percentage of on-time graduation rate of students in undergraduate degree programs in selected colleges (SC) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 51.00 0.00 0.00 55.00 Date 01-Aug-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 Comments IN01008652 ►Improved student outcomes. 3) Percentage of on-time graduation rate of students in undergraduate degree programs in selected colleges (ST) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 42.00 0.00 0.00 46.00 Date 01-Aug-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 Comments IN01008653 ►Improved student outcomes. 4) Percentage of on-time graduation rate of students in undergraduate degree programs in selected colleges (women) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 67.00 0.00 0.00 71.00 Date 01-Aug-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 Comments Improve the quality of selected institutions IN01008648 ►Students benefiting from direct interventions to enhance learning (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 501,544.00 501,544.00 530,000.00 8/30/2021 Page 7 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Date 01-Apr-2018 20-Nov-2020 20-Nov-2020 01-Nov-2022 Comments IN01008651 Students benefiting from direct interventions to enhance learning - Female (Number, Corporate Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 260,803.00 260,803.00 275,000.00 Enhance governance of the higher education system in Odisha IN01008647 ►Strengthened governance in faculty management (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Personnel Information Management System No reforms Value No reforms implemented No reforms implemented (PIMS) upgraded and implemented used as e-database for faculty management Date 10-Dec-2020 10-Dec-2020 10-Dec-2020 31-Mar-2022 Comments Intermediate Results Indicators by Results Areas Results Area 1: Improving quality of and students' equitable access to selected institutions IN01008654 ►Number of project beneficiaries (students) disaggregated by gender (core) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 661,700.00 780,144.00 780,144.00 827,200.00 Date 01-Apr-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 Comments IN01008657 Number of project beneficiaries (female) (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 333,600.00 371,004.00 371,004.00 417,000.00 Date 01-Aug-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 IN01008658 ►Annual performance milestones met by the HED and selected institutions (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target -HED achieved two APMs -HED achieved two -HED achieved two 5 milestones each for Value namely Career Counseling APMs namely Career APMs namely Career the selected colleges, Cells & MIS functional. 8/30/2021 Page 8 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) -Out 137 colleges, 71 Counseling Cells & MIS Counseling Cells & MIS Universities and HED achieved 5 APMs, 53 functional. functional. to be achieved achieved 4 APMs, 10 -Out 137 colleges, 71 -Out 137 colleges, 71 achieved 3 APMs & 3 achieved 5 APMs, 53 achieved 5 APMs, 53 achieved 2 APMs. achieved 4 APMs, 10 achieved 4 APMs, 10 -Only one university achieved 3 APMs & 3 achieved 3 APMs & 3 achieved 3 APMs (as on achieved 2 APMs. achieved 2 APMs. 31st March 2020) -Only one university -Only one university achieved 3 APMs (as on achieved 3 APMs (as 31st March 2020 on 31st March 2020 Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 March 31, 2020 update: 80% of HEIs have achieved 60% of the milestones vs target of 75% of HEIs to Comments achieve 60% of milestones. IN01008660 ►Percentage of sanctioned posts filled with regular faculty in selected institutions (Core) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 74.00 94.60 94.60 95.00 Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 Comments March 31, 2020 update: 639 out of 833 selected new faculty have been deployed in the colleges. IN01008661 ►Number (cumulative) of faculty and administrators in degree colleges and state universities who completed a short-term training program (by gender) (Core) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 250.00 4,106.00 4,106.00 6,000.00 Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 Comments IN01008662 Number (cumulative) of female faculty and administrators in degree colleges and state universities who complete a short-term training program (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 85.00 841.00 841.00 1,500.00 Date 01-Aug-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 IN01008663 ►Evaluation of the curriculum implementation (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Round 1 CBCS Round 1 CBCS curriculum has been curriculum has been reviewed and modified 2nd revision of CBCS Value Evaluation to be done reviewed and modified for Odisha’s context, curriculum evaluated for Odisha’s context, and and is being is being implemented. implemented. Date 04-Dec-2017 10-Dec-2020 10-Dec-2020 31-Mar-2020 8/30/2021 Page 9 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Choice Based Credit System (CBCS) curriculum has been reviewed and modified for Odisha's context and Comments is being implemented. IN01008664 ►Improved satisfaction levels of beneficiaries (students and faculty) in selected institutions (core) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Student and faculty Student and faculty satisfaction survey satisfaction survey conducted during conducted during September to September to December December 2019 for 2019 for institutions institutions selected in selected in round 2. round 2. 7077 students and 1761 7077 students and 1761 At least 60% of the faculties of 67 Colleges faculties of 67 Colleges selected HEIs improve and 471 students and Value n.a. and 471 students and at least in 50% of their 139 faculties of 5 139 faculties of 5 satisfaction survey Universities attended the Universities attended parameters survey. The individual the survey. The institutional reports have individual institutional been shared with the reports have been HEIs with menu of shared with the HEIs options for an action plan with menu of options for to respond to the an action plan to findings. respond to the findings. Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 Comments Results Area 2: Enhancing governance of the higher education system IN01008655 ►The HED's MIS strengthened up to the specified standards (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value n.a. MIS functional MIS functional MIS functional. Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 31-Mar-2019 Comments IN01008656 ►Percentage of selected government-aided colleges that completed data entry using online FM system (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 33.00 33.00 60.00 Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 31-Mar-2022 March 31, 2020 update: 26 out of 109 aided colleges(24%) have updated their financial and accounting data Comments on the CAPA system IN01008659 ►Governance benchmarking score card exercise (Text, Custom) 8/30/2021 Page 10 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Baseline Actual (Previous) Actual (Current) End Target HEIs have responded HEIs have responded with their 4 priority with their 4 priority action action points to be points to be included in Value n.a. included in the annual exercise carried out the annual performance performance milestones milestones for 2020-21 for 2020-21 (part of DLI (part of DLI 3) 3) Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 31-Mar-2021 The 10 action points from the findings of the governance benchmarking exercise have been communicated and colleges have given back their four priority action areas to be included in the 2020-21 annual Comments performance milestones. Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 DLI1: Blended Learning and self-study approach adopted in the selected HEIs (Output, 2.00, 0%) Baseline Actual (Previous) Actual (Current) 2022 75% of selected No reforms implanted Reforms not HEIs implementing Value Reforms not implemented implemented the blended learning modules plan Date -- 10-Dec-2020 10-Dec-2020 -- Comments ►DLI 3 Improved student outcomes. 1) Percentage of on-time graduation rate of students in undergraduate degree programs in selected colleges (total students) (Process, 2.00, 0%) Baseline Actual (Previous) Actual (Current) 2022 Value 60.00 0.00 0.00 -- Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 -- Comments ►DLI 4 DLI3: Annual performance milestones met by the HED and selected institutions (Process, 6.00, 67%) Baseline Actual (Previous) Actual (Current) 2022 DLR 3.5(a): HED- PMU achieve 5 The HED achieved two The HED achieved two annual milestones APMs. At the institution APMs. At the institution 0% of institutions achieving level, out 137 colleges, level, out 137 colleges, 71 DLR 3.5(b): Value annual performance 71 achieved 5 APMs, 53 achieved 5 APMs, 53 5 annual milestones milestones achieved 4 APMs, 10 achieved 4 APMs, 10 each for the achieved 3 APMs and 3 achieved 3 APMs and 3 selected colleges, achieved 2 APMs. achieved 2 APMs. Universities. 80% of the selected institutions achieve 8/30/2021 Page 11 of 12 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) at least 60% of institution-based annual milestones Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 -- The HED has achieved two APMs: Career Counseling Cells and a functional MIS. At the institution level, out 137 colleges, 71 achieved 5 APMs, 53 achieved 4 APMs, 10 achieved 3 APMs and 3 achieved 2 APMs. Only Comments one university achieved 3 APMs (as on 31st March 2020). ►DLI 5 DLI4: Strengthened governance of faculty management (Intermediate Outcome, 3.50, 0%) Baseline Actual (Previous) Actual (Current) 2022 Personnel Information Management No Reforms No Reforms Value No reforms System (PIMS) upgraded and used as e-database for faculty management Date -- 10-Dec-2020 10-Dec-2020 -- Comments ►DLI 7 DLI5: Improved fiduciary management in selected institutions: Percentage of selected institutions that completed data entry using online FM system (Online accounting system) (Output, 2.00, 200%) Baseline Actual (Previous) Actual (Current) 2022 Value 0.00 33.00 33.00 60.00 Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 -- November 20, 2020 update : 36 out of 109 (33%) aided colleges have updated their data online in CAPA. Due Comments to the closure of colleges, this activity is lagging behind. ►DLI 8 DLI5: Part 2: Enhanced procurement management (Output, 2.00, 0%) Baseline Actual (Previous) Actual (Current) 2022 Value 0.00 55.00 55.00 60.00 Date 04-Dec-2017 20-Nov-2020 20-Nov-2020 -- November 20, 2020 update: 75 colleges out of 137 (55%) completed their procurement contracts within the validity period. Comments During restructuring, this DLI will be modified to include civil works contracts. 8/30/2021 Page 12 of 12