The World Bank
       Health Professionals Education and Training for Health System Reforms (P131825)




                                                                                         REPORT NO.: RES33266




                                              RESTRUCTURING PAPER

                                                       ON A

                                       PROPOSED PROJECT RESTRUCTURING

                                                           OF
                 HEALTH PROFESSIONALS EDUCATION AND TRAINING FOR HEALTH SYSTEM REFORMS
                                            APPROVED ON MAY 6, 2014
                                                           TO

                                         SOCIALIST REPUBLIC OF VIETNAM



HEALTH, NUTRITION & POPULATION

EAST ASIA AND PACIFIC




                               Regional Vice President:     Victoria Kwakwa
                                      Country Director:     Ousmane Dione
                        Senior Global Practice Director:    Timothy Grant Evans
                           Practice Manager/Manager:        Toomas Palu
                                    Task Team Leader:       Sang Minh Le
       The World Bank
       Health Professionals Education and Training for Health System Reforms (P131825)



ABBREVIATIONS AND ACRONYMS


CK1                  Level 1 specialist
CPMU                 Central Project Management Unit
MOH                  Ministry of Health
PHC                  Primary Health Care
           The World Bank
           Health Professionals Education and Training for Health System Reforms (P131825)




 Note to Task Teams: The following sections are system generated and can only be edited online in the Portal.




BASIC DATA


Product Information

Project ID                                                      Financing Instrument
P131825                                                         Investment Project Financing

Original EA Category                                            Current EA Category
Partial Assessment (B)                                          Partial Assessment (B)

Approval Date                                                   Current Closing Date
06-May-2014                                                     31-Dec-2020


Organizations

Borrower                                                        Responsible Agency
Socialist Republic of Vietnam                                   Ministry of Health



Project Development Objective (PDO)
Original PDO
The PDOs are to improve the quality of health professionals' education, strengthen management competencies in the
health sector, and improve the competencies of Primary Health Care teams at the grass-roots level.
OPS_TABLE_PDO_CURRENTPDO
Summary Status of Financing
                                                                                         Net
Ln/Cr/Tf                  Approval        Signing Effectiveness           Closing Commitment Disbursed Undisbursed

IDA-54410             06-May-2014     17-Jul-2014    30-Oct-2014 31-Dec-2020               86.00        7.81    68.64
TF-A1658              28-Mar-2017 28-Mar-2017 28-Mar-2017 30-Nov-2018                       8.68        4.20     4.48

Policy Waiver(s)

Does this restructuring trigger the need for any policy waiver(s)?
No
       The World Bank
       Health Professionals Education and Training for Health System Reforms (P131825)




Note to Task Teams: End of system generated content, document is editable from here.
       The World Bank
       Health Professionals Education and Training for Health System Reforms (P131825)



I. PROJECT STATUS AND RATIONALE FOR RESTRUCTURING


1. Project status
   (a) The implementation progress and achievement of PDO has been rated unsatisfactory for more than one year.
       Only the Component strengthening management capacities in the health sector is making progress toward
       achievement of the PDO, while other Components are moving at a much slower pace. This slow progress results
       from a lack of empowerment and capacity of the Central Project Management Unit (CPMU) and a challenging
       regulatory and institutional environment.
   (b) The Component improving the quality of health professionals education has been affected by a shift the focus
       from Quality Assurance system to introduction of competency based education programs. The development,
       review and approval of school grants took longer than anticipated, resulting in a reduction in the number of
       grant recipients as well as reduced resource and timeframe for grant implementation. Only US$ 17 million are
       committed under the school grants program, and approximately US$ 2 million have been transferred to grant
       recipients, while US$12 million is unprogrammed under this component.
   (c) The Component improving competencies of primary healthcare (PHC) teams has been expanding training
       programs at the grassroots level and making some progress towards PDO recently. However, delays in
       procurement of equipment will affect the provision of training service to PHC teams in targeted areas.
   (d) While increasing slowly, disbursement remains low at 14.1%. After the US$20 million cancellation in March
       2017, only 10.2% of the IDA resources have been disbursed. Disbursement from the EU grant of EUR 7.43
       million has reached approximately 48.4%.
2. Rationale for restructuring
   (a) In March of 2017, US$20 million was cancelled from the Project. A review of the Project’s indicators was
       undertaken with a view to determine, given the cancellation, whether the targets, as originally envisaged, were
       still attainable. During the March 2017 review, the World Bank and the MOH agreed on the need to formally
       revise the Results Framework, and a working draft was discussed at that time. It was agreed that a logical time
       to make a final determination on how to revise the indicators would be during the Mid-Term Review (MTR),
       planned for January 2018, along with a review to identify any other necessary changes and to restructure the
       Project. The MTR in January 2018, reviewed and confirmed that while the Development Objectives and Finance
       Agreement did not require any changes, the Results Framework would need to be revised due to the changing
       focus arising from Government’s health professionals education reform and the delays in implementation.
   (b) Following are the main issues relating to the original Results Framework:
       (i) Relevance: Two of the PDO indicators and three intermediate result indicators were formulated to measure
             achievement and progress of the development of the quality assurance system. However, as the Project
             commenced implementation, the Ministry of Health (MOH) shifted the focus from quality assurance to the
             introduction of competency-based education programs. No measurement was included which captures the
             tremendous effort, which has gone into strengthening the policy framework and institutional capacity for
             health professionals education reform, made by MOH since the project effectiveness.
       (ii) Attainability: Due to the delays in implementation and cost increases, it will be impossible to attain the
            cumulative target values set for most of intermediate result indicators associated with Component 2,
            including the sub-component providing basic equipment to PHC teams. However, more health staff at the
            grassroots level can be included in the training programs for PHC teams because the training courses are
            now shorter and less expensive than expected.
       The World Bank
       Health Professionals Education and Training for Health System Reforms (P131825)



II. DESCRIPTION OF PROPOSED CHANGES


  The Results Framework for the Project will be changed. A formal request for reaffirming the revised Result Framework
  was received from Ministry of Health on June 29, 2018. The Project Operational Manual will be updated and adopted
  by Ministry of Health to reflect proposed changes in the Result Framework. The World Bank Country Director notified
  Ministry of Health of using revised Result Framework to monitor and evaluate the project from July 2018 onward.
  The following describes proposed changes in the Result Framework:
    (a) The indicators associated with Component 1 will be replaced as follows:
        (i) The two original PDO indicators “Number of health professional programs that have completed the Peer
              Review Assessment” and “Percentage of first takers who have passed the standardized examination for
              their area of study” will be removed.
        (ii) The addition of a single PDO indicator “Number of Grant recipient schools successfully implementing their
              competency-based curriculum”.
              The Quality Assurance Council within Ministry of Health will evaluate the implementation of competency
              based curriculum (CBC) at grant recipient schools. An evaluation checklist will be developed and a passing
              score will be established by the Council to decide whether grant recipient schools implement their CBC
              successfully. During the Midterm Review Workshop on January 19, 2018, Grant recipients and council
              members agreed about this indicator, target and evaluation method. It is expected that the checklist and
              methodology will be finalized by the end of 2018.
        (iii) The three original intermediate result indicators “Number of trained assessors”, “Examination blueprint
              ready”, and “Item Bank ready” will be removed.
        (iv) A single intermediate result indicator “Number of grant recipients completing 70% of activities in their
              annual workplan in each year” will be added.
    (b) One PDO indicator and two intermediate result indicators associated with Component 2 will be changed as
        follows:
        (i) One original PDO indicator “Number of managers that have completed at least one management course”
              will be revised to “Number of managers and inspectors that have completed at least one management
              course”; the end-target value will be reduced from 4000 to 2300.
        (ii) Two original intermediate result indicators “Number of management trainers enrolled in a graduate
              program” and “Number of students enrolled in a management course” will be removed.
        (iii) A single intermediate result indicator “Number of young volunteer doctors that have completed the CK1
              training program” will be added.
    (c) All indicators associated with Component 3 will be revised, namely:
        (i) The original PDO indicator “Percentage of commune health station staff per province that have improved
              their clinical skills in the management of selected conditions by at least 25% after training ” will be revised
              as “Percentage of commune health station staff that have improved their knowlege and clinical skills in the
              management of selected conditions by at least 20% after training”.
        (ii) Target value of the original intermediate result indicator “number of health staff enrolled in a training
              program” will be increased from 8,500 to 15,000.
        (iii) The original intermediate result indicator “Number of commune health stations provided with a set of basic
              equipment” will be revised to “Number of training institutions, clinical training sites and commune health
              stations provided with a set of basic equipment”; the target value will be reduced from 2,300 to 982.
    (d) A new intermediate result indicator, to measure strides in strengthening the policy framework and institutional
        capacity for health professionals education reform will be added: “Number of technical documents approved”.
        The World Bank
        Health Professionals Education and Training for Health System Reforms (P131825)



  Note to Task Teams: The following sections are system generated and can only be edited online in the Portal.




III. SUMMARY OF CHANGES

                                                                      Changed                       Not Changed
Change in Results Framework                                              ✔
Change in Implementing Agency                                                                             ✔
Change in DDO Status                                                                                      ✔
Change in Project's Development Objectives                                                                ✔
Change in Components and Cost                                                                             ✔
Change in Loan Closing Date(s)                                                                            ✔
Cancellations Proposed                                                                                    ✔
Reallocation between Disbursement Categories                                                              ✔
Change in Disbursements Arrangements                                                                      ✔
Change in Disbursement Estimates                                                                          ✔
Change in Overall Risk Rating                                                                             ✔
Change in Safeguard Policies Triggered                                                                    ✔
Change of EA category                                                                                     ✔
Change in Legal Covenants                                                                                 ✔
Change in Institutional Arrangements                                                                      ✔
Change in Financial Management                                                                            ✔
Change in Procurement                                                                                     ✔
Change in Implementation Schedule                                                                         ✔
Other Change(s)                                                                                           ✔
Change in Economic and Financial Analysis                                                                 ✔
Change in Technical Analysis                                                                              ✔
Change in Social Analysis                                                                                 ✔
Change in Environmental Analysis                                                                          ✔
                                    The World Bank
                                    Health Professionals Education and Training for Health System Reforms (P131825)



        IV. DETAILED CHANGE(S)

OPS_DETAILEDCHANGES_RESULTS_TABLE




          RESULTS FRAMEWORK

          Project Development Objective Indicators
PDO_IND_TABLE




                        Number of health professional programs that have completed the Peer Review Assessment (PRA).
                        Unit of Measure: Text
                        Indicator Type: Custom

                                     Baseline                 Actual (Current)           End Target              Action
                                                                                         6 medicine; 3 nursing
                                                                                         (4 year program), 5
                        Value none                            none                                               Marked for Deletion
                                                                                         nursing (3 yr program),
                                                                                         1 pharmacy
                        Date         30-Sep-2014              31-Jan-2018                31-Dec-2020
                      Percentage of first takers who have passed the standardized examination for their area of study (medicine, nursing,
                      or pharmacy).
                      Unit of Measure: Percentage
                      Indicator Type: Custom

                                     Baseline                 Actual (Current)           End Target              Action
                        Value 0.00                            0.00                       80.00                   Marked for Deletion

                        Date         30-Sep-2014              31-Jan-2018                31-Dec-2020
                        Number of managers and inspectors that have completed at least one management course.
                        Unit of Measure: Number
                        Indicator Type: Custom

                                     Baseline                 Actual (Current)           End Target              Action
                        Value 0.00                            305.00                     2300.00                 Revised

                        Date         30-Sep-2014              08-Jun-2018                31-Dec-2020
                      Percentage of young volunteer physicians who worked in disadvantage districts during the year following
                      completion of CK1 training.
                      Unit of Measure: Percentage
                      Indicator Type: Custom

                                     Baseline                 Actual (Current)           End Target              Action
                        Value 0.00                            100.00                     90.00                   No Change

                        Date         30-Sep-2014              31-Jan-2018                31-Dec-2020
                       The World Bank
                       Health Professionals Education and Training for Health System Reforms (P131825)



               Percentage of commune health station staff that have improved their knowlege and clinical skills in management of
               selected conditions by at least 20% after training.
               Unit of Measure: Percentage
               Indicator Type: Custom

                        Baseline                 Actual (Current)           End Target              Action
               Value 0.00                        3.00                       80.00                   Revised

               Date     30-Sep-2014              08-Jun-2018                31-Dec-2020
               Number of Grant recipient schools successfully implementing their competency based curriculum
               Unit of Measure: Number
               Indicator Type: Custom

                        Baseline                 Actual (Current)           End Target              Action
               Value 0.00                        0.00                       12.00                   New

               Date     30-Sep-2014              08-Jun-2018                31-Dec-2020



Intermediate Indicators
IO_IND_TABLE




               Number of trained assessors.
               Unit of Measure: Text
               Indicator Type: Custom

                          Baseline                Actual (Current)           End Target             Action
                                                                             60 medicine; 30
               Value      0                       0                                                 Marked for Deletion
                                                                             nursing; 6 pharmacy
               Date       30-Sep-2014             31-Jan-2018                30-Sep-2018
               Examination blueprint ready
               Unit of Measure: Text
               Indicator Type: Custom

                          Baseline                Actual (Current)           End Target             Action
               Value      0                       0                          blueprint ready        Marked for Deletion

               Date       30-Sep-2014             31-Jan-2018                30-Sep-2015
               Item Bank ready.
               Unit of Measure: Text
               Indicator Type: Custom

                          Baseline                Actual (Current)           End Target             Action
        The World Bank
        Health Professionals Education and Training for Health System Reforms (P131825)



Value      0                       0                            item bank ready         Marked for Deletion

Date       30-Sep-2014             31-Jan-2018                  30-Sep-2015
Number of management trainers enrolled in a graduate program.
Unit of Measure: Number
Indicator Type: Custom

           Baseline                 Actual (Current)            End Target              Action
Value      0.00                    0.00                         14.00                   Marked for Deletion

Date       30-Sep-2014             31-Jan-2018                  30-Sep-2018
Number of students enrolled in a management course.
Unit of Measure: Number
Indicator Type: Custom

           Baseline                 Actual (Current)            End Target              Action
Value      0.00                    48.00                        4500.00                 Marked for Deletion

Date       30-Sep-2014             31-Jan-2018                  31-Dec-2020
Number of health staff enrolled in a training program.
Unit of Measure: Number
Indicator Type: Custom

           Baseline                 Actual (Current)            End Target              Action
Value      0.00                    1959.00                      15000.00                Revised

Date       30-Sep-2014             08-Jun-2018                  30-Sep-2018
Number of traning institutions, clinical training sites and commune health stations provided with a set of basic
equipment
Unit of Measure: Number
Indicator Type: Custom

           Baseline                 Actual (Current)            End Target              Action
Value      0.00                    0.00                         982.00                  Revised

Date       30-Sep-2014             08-Jun-2018                  30-Sep-2017
Number of grant recipients completing 70% of activities in their annual workplan in each year
Unit of Measure: Number
Indicator Type: Custom

           Baseline                 Actual (Current)            End Target              Action
         The World Bank
         Health Professionals Education and Training for Health System Reforms (P131825)



 Value      0.00                    0.00                        12.00                  New

 Date       30-Sep-2014             08-Jun-2018                 31-Dec-2018
 Number of young volunteer doctors have completed CK1 training program
 Unit of Measure: Number
 Indicator Type: Custom

            Baseline                Actual (Current)            End Target             Action
 Value      0.00                    14.00                       300.00                 New

 Date       30-Sep-2014             08-Jun-2018                 31-Dec-2020
 Number of technical documents approved
 Unit of Measure: Number
 Indicator Type: Custom

            Baseline                Actual (Current)            End Target             Action
 Value      0.00                    15.00                       20.00                  New

 Date       30-Sep-2014             08-Jun-2018                 31-Dec-2020




Note to Task Teams: End of system generated content, document is editable from here.