The World Bank Report No: ISR3294 Implementation Status & Results Indonesia Public Disclosure Copy Health Professional Education Quality Project (P113341) Operation Name: Health Professional Education Quality Project (P113341) Project Stage: Implementation Seq.No: 3 Status: ARCHIVED Last Modified Date: 23-May-2011 Country: Indonesia Approval FY: 2010 Product Line: IBRD/IDA Region: EAST ASIA AND PACIFIC Lending Instrument: Specific Investment Loan Implementing Agency(ies): Ministry of National Education Key Dates Board Approval Date 24-Sep-2009 Original Closing Date 31-Dec-2014 Planned Mid Term Review Date Last Archived ISR Date 27-Dec-2010 Effectiveness Date 09-Dec-2009 Revised Closing Date 31-Dec-2014 Actual Mid Term Review Date Project Development Objectives Project Development Objective (from Project Appraisal Document) The specific Project Development Objectives are to strengthen quality assurance policies governing the education of health professionals in Indonesia. This will be achieved by: 1) rationalizing and assuring competency-focused accreditation of public and private health professional training institutions; 2) developing national competency standards and testing procedures for certification and licensing of health professionals; and 3) building institutional capacity to employ results-based grants for encouraging the use of accreditation and certification standards in the development of medical school quality. Has the Project Development Objective been changed since Board Approval of the Project? Yes No Component(s) Component Name Component Cost Component 1 Strengthening Policies and Procedures for School Accreditation 7.18 Component 2 Certification of graduates using a national competency-based examination 12.90 Component 3 Results-based FAP for Medical Schools 61.40 Public Disclosure Copy Project Management 5.24 Overall Ratings Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Satisfactory Satisfactory Overall Risk Rating Implementation Status Overview During the 3rd Implementation Review Mission for HPEQ (Health Professional Education Quality) Project conducted between 28 March and 12 April 2011, the mission found that most of the 2010 key performance indicators were achieved. The most significant progress was the consensuses reached for the inter-ministerial coordination issues found during the Page 1 of 7 The World Bank Report No: ISR3294 previous Implementation Review Mission. The issues regarding the process to accredit nursing and midwifery Diploma3 level education institutions, and on the process to certify the competencies of both professions have been resolved. Meanwhile the issue on the body of authority to validate the standards for nurses and midwives still needs further discussions Public Disclosure Copy among stakeholders. The preparation for establishing the independent accreditation board and the competency testing certification body (NACEHealthPro), which are the key indicators for the year of 2011, are ongoing. The preparation activities include the development of legal documents as the basis for the charters. The selection of medical schools for the Financial Assistance Package (FAP) grant scheme and also the contract signing for the awarded medical schools has been completed before the end of last year which is ahead of schedule. The implementation of the grants, however, was slightly delayed due to unavailability of budget in the first quarter of 2011 but in April 2011 the funds disbursement to grantees has started. The mission found that the capacity to implement the grant varies widely among the grantees especially in financial and procurement management. Results Project Development Objective Indicators Indicator Baseline Current End Target Indicator Name Value Value Value Establishment of the independent National Accreditation Agency (NAA) No No No Date Date Date 09-Dec-2009 18-May-2011 31-Dec-2014 Type Unit of Measure Comment Comment Comment Custom Indicator Yes/No The Joint Commission of National Commitment building among Charter of the NAA is established Accreditation Board for Higher multistakeholders and the legal in 2011 Education (BAN-PT) and review and academic papers are Indonesian Medical Council (KKI) being developed Indicator Baseline Current End Target Indicator Name Value Value Value Establishment of the National Agency for Competence Examination of No No No Health Professionals (NACE HealthPro) Date Date Date 31-Dec-2009 18-May-2011 31-Dec-2014 Type Unit of Measure Comment Comment Comment Public Disclosure Copy Custom Indicator Yes/No Consortium of College of The name of the body is now The Charter of NACE HealthPro i/ Indonesian Doctors (KDI) and agreed to be called Lembaga LPUK is established in 2011 Association of Medical Education Pengembangan Uji Kompetensi or Institutions (AIPKI) is the current Board of Competency Testing engagement Development (LPUK). The Business plan is being fimalized Page 2 of 7 The World Bank Report No: ISR3294 Indicator Baseline Current End Target Public Disclosure Copy Indicator Name Value Value Value Health Professional Schools (medical, dental, nursing, and midwifery) that have gone through the accreditation process and publicize the Date Date Date results 18-May-2011 31-Dec-2014 Type Unit of Measure Comment Comment Comment Custom Indicator Percentage Accreditation instrument is just Medical 100%, Dental 100%, being pilot-tested/tried out Nursing 48%, Midwifery 18% Indicator Baseline Current End Target Indicator Name Value Value Value Graduates of health professional schools passing the national competency testing at first attempt Date Date Date 31-Dec-2009 03-Jan-2011 31-Dec-2014 Type Unit of Measure Comment Comment Comment Custom Indicator Percentage Medical 71.67%, Dental 81.69% Medical 84%, Dental 83%, Nursing 65%, Midwifery 65% Indicator Baseline Current End Target Indicator Name Value Value Value Graduates of Medical Schools passing the national competency test at 71.67 73.75 84.00 the first attempt Type Unit of Measure Sub-Type Custom Indicator Percentage Supplemental Indicator Baseline Current End Target Indicator Name Value Value Value Public Disclosure Copy Graduates of Dental Schools passing national competency test at the 81.69 79.95 83.00 first attempt Type Unit of Measure Sub-Type Custom Indicator Percentage Supplemental Page 3 of 7 The World Bank Report No: ISR3294 Indicator Baseline Current End Target Public Disclosure Copy Indicator Name Value Value Value Mean Test Score of Graduates from FAP Recipient Schools who take the National Competency Testing Date Date Date 18-May-2011 Type Unit of Measure Comment Comment Comment Custom Indicator Percentage Not yet available for FAP grants has just been implemented Intermediate Results Indicators Indicator Baseline Current End Target Indicator Name Value Value Value Responsibility for policies on prefessional accreditation, certification, No No No and school licensure are clear and accepted by key stakeholders for Date Date Date each of four health professions 31-Dec-2009 18-May-2011 31-Dec-2014 Type Unit of Measure Comment Comment Comment Custom Indicator Yes/No Medical and Dental : Indonesian Under development GoI has established a formal entity Medical Council (KKI) established with responsibility for oversight of in 2006 Nursing and Midwifery : a accreditation standards, formal entity with responsibility for competency-based examination of oversight of accreditation each nursing and midwifery standards, competency-based profession examination for each profession, nursing and midwifery is not yet established Public Disclosure Copy Page 4 of 7 The World Bank Report No: ISR3294 Indicator Baseline Current End Target Public Disclosure Copy Indicator Name Value Value Value Education and competency standards are agreed by all stakeholders No No No and published Date Date Date 31-Dec-2009 18-May-2011 31-Dec-2014 Type Unit of Measure Comment Comment Comment Custom Indicator Yes/No Medical and Dental: Standards of Standards for Medical and Dental Standards of Competencies and Competencies and Standards of are being reviewed; for Nurses and Standards of Education for four Education released by Indonesian Midwives have finalized drafts and professions are agreed by all Medical Council (KKI) in 2006 waiting for validation stakeholders and published Nursing: Drafts of both standards are available Midwifery : Standards of Competencies released by MOH in 2007 and Draft standard of education available Indicator Baseline Current End Target Indicator Name Value Value Value The National Accreditation Agency (NAA) has independent and No No No adequate budget to conduct accreditation Date Date Date 31-Dec-2009 31-Dec-2014 Type Unit of Measure Comment Comment Comment Custom Indicator Yes/No A Joint Commission between the An independent NAA has adequate National Accreditation Agency for budget to cinduct accreditation Higher Education and Indonesian Medical Council is the current arrangement Indicator Baseline Current End Target Public Disclosure Copy Indicator Name Value Value Value The National Accreditation Agency NAA has access to adequate numbers of suitably trained assessors Date Date Date 31-Dec-2014 Type Unit of Measure Comment Comment Comment Custom Indicator Percentage Numbers of trained assessors for each profession: Medical : 60 Dental : 30 Nursing : 105 Midwifery : 105 Page 5 of 7 The World Bank Report No: ISR3294 Indicator Baseline Current End Target Public Disclosure Copy Indicator Name Value Value Value A charter supporting the establishment of the NACEHealth Pro No No No (National Agency for Competency Examination of health Professionals) Date Date Date including its tasks and responsibilitis, and working arrangements 31-Dec-2009 19-Oct-2010 31-Dec-2014 Type Unit of Measure Comment Comment Comment Custom Indicator Yes/No Current arrangement for Under development The charter has been established competency testing: Consortium of by the end of 2011 College of Indonesian Doctors (KDI) and the Association of Medical Schools (AIPKI) Indicator Baseline Current End Target Indicator Name Value Value Value Number or percentage of medical schools receiving finance support to 41.00 strengthen the program Date Date Date 30-Nov-2010 Type Unit of Measure Comment Comment Comment Custom Indicator Number 42 medical schools passed the proposal review and 41 of them have signed the contract to receive the grant Data on Financial Performance (as of 11-Apr-2011) Financial Agreement(s) Key Dates Project Loan No. Status Approval Date Signing Date Effectiveness Date Closing Date P113341 IBRD-77370 Effective 24-Sep-2009 01-Oct-2009 09-Dec-2009 31-Dec-2014 Public Disclosure Copy Disbursements (in Millions) Project Loan No. Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P113341 IBRD-77370 Effective USD 77.82 77.82 0.00 11.95 65.87 15.00 Disbursement Graph Page 6 of 7 The World Bank Report No: ISR3294 Public Disclosure Copy Key Decisions Regarding Implementation For FAP implementation the mission team has requested the CPCU (Central Project Coordinating Unit) to map existing capacity of grantees and to provide supports based on each specific need. Also, the mission team requests the CPCU to prioritize the recruitment of individual consultants for financial and procurement management to replace the functions of the PMC (Project Management Consultant) by June 2011. The Fourth Implementation Review is scheduled to be conducted in October 2011 Restructuring History There has been no restructuring to date. Public Disclosure Copy Related Projects P122774-Additional Financing for Health Professional Education Quality Project Page 7 of 7