Developing an evaluation framework for competency-based training programs using a modified Delphi method

Objectives: This study developed an evaluation framework for competency-based training programs to support the implementation of competency-based medical education (CBME) in Taiwan. Methods: Our research team used the logic model to draft an evaluation framework for training programs that align with the Accreditation Council for Graduate Medical Education’s Program Director Guide to Common Program Requirements in the United States. In addition, we referenced various documents, including the 112th-year hospital and teaching hospital accreditation standards in Taiwan, evaluations from the Ministry of Health and Welfare’s Residency Review Committee, and guidelines from the Ministry of Health and Welfare’s General Medical Training Program for Physicians after graduation. This study collected opinions from 23 domestic medical education experts by using the modified Delphi method. After each survey, the appropriateness and consistency of each indicator were evaluated. These indicators were then revised and refined in accordance with feedback from the expert panelists. Results: The evaluation framework for competency-based training programs comprises the following 10 dimensions including a total of 56 indicators: “Project Proposal Layout and Format,” “Training Objectives and Framework,” “Faculty,” “Educational Resources,” “Clinical Learning Environment,” “Medical and Professional Skills Training Approaches,” “Holistic Care Training Approaches,” “Assessment and Feedback Channels,” “Counseling and Remediation Pathways,” and “Others.” Conclusions: The study developed an evaluation framework for competency-based training programs, reaching a consensus with expert panelists from various institutions. This evaluation framework can enhance program evaluations within institutions, thereby facilitating the advancement and implementation of CBME.