A National Process to Enhance the Validity of Entrustment Decisions for Dutch Pediatric Residents

Maaike P. Smit, Matthijs de Hoog, Hein J. L. Brackel, Olle ten Cate, Reinoud J. B. J. Gemke

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Background: Postgraduate medical education (PGME) has become increasingly individualized, and entrustable professional activities (EPAs) have been adopted to operationalize this. At the same time, the process and content to determine residents' progress using high-stakes summative entrustment decisions by clinical competency committees (CCCs) is not yet well established. Objective: We evaluated the experiences with a structured process for assessment of EPAs to attain uniform summative entrustment decisions for a national sample of pediatric residents. Methods: An EPA-based national PGME program for pediatric residents was introduced in the Netherlands, including a process of uniform summative entrustment decisions, termed the Evaluation and Assessment of Residents by Supervisors (EARS) procedure. To evaluate the program, we assessed survey data and information from invitational conferences. Results: Beginning in January 2017, 125 pediatric residents in all 8 Dutch residency regions started training in the EARS program. The program enabled robust summative entrustment decisions. Preliminary data suggested that faculty, despite increased preparation time, appreciated the comprehensive appraisal of resident qualifications. The EPA-based program was well accepted by residents. Fifty-one percent (57 of 112) had at least 2 EARS procedures per year, and for 75% (84 of 112) the level of supervision was often or always adjusted to their level of training. Conclusions: A national EPA-based program provided a structured process for summative entrustment decisions by CCCs and enabled individualized stepwise progression of residents toward unsupervised practice. Broader application of these concepts may require adaptations to accommodate different health care systems and specialties.
Original languageEnglish
Pages (from-to)158-164
JournalJournal of graduate medical education
Volume11
Issue number4
DOIs
Publication statusPublished - 2019

Cite this

Smit, Maaike P. ; de Hoog, Matthijs ; Brackel, Hein J. L. ; ten Cate, Olle ; Gemke, Reinoud J. B. J. / A National Process to Enhance the Validity of Entrustment Decisions for Dutch Pediatric Residents. In: Journal of graduate medical education. 2019 ; Vol. 11, No. 4. pp. 158-164.
@article{0694c4eaf4cc4af1a30bfe9a78fe1f21,
title = "A National Process to Enhance the Validity of Entrustment Decisions for Dutch Pediatric Residents",
abstract = "Background: Postgraduate medical education (PGME) has become increasingly individualized, and entrustable professional activities (EPAs) have been adopted to operationalize this. At the same time, the process and content to determine residents' progress using high-stakes summative entrustment decisions by clinical competency committees (CCCs) is not yet well established. Objective: We evaluated the experiences with a structured process for assessment of EPAs to attain uniform summative entrustment decisions for a national sample of pediatric residents. Methods: An EPA-based national PGME program for pediatric residents was introduced in the Netherlands, including a process of uniform summative entrustment decisions, termed the Evaluation and Assessment of Residents by Supervisors (EARS) procedure. To evaluate the program, we assessed survey data and information from invitational conferences. Results: Beginning in January 2017, 125 pediatric residents in all 8 Dutch residency regions started training in the EARS program. The program enabled robust summative entrustment decisions. Preliminary data suggested that faculty, despite increased preparation time, appreciated the comprehensive appraisal of resident qualifications. The EPA-based program was well accepted by residents. Fifty-one percent (57 of 112) had at least 2 EARS procedures per year, and for 75{\%} (84 of 112) the level of supervision was often or always adjusted to their level of training. Conclusions: A national EPA-based program provided a structured process for summative entrustment decisions by CCCs and enabled individualized stepwise progression of residents toward unsupervised practice. Broader application of these concepts may require adaptations to accommodate different health care systems and specialties.",
author = "Smit, {Maaike P.} and {de Hoog}, Matthijs and Brackel, {Hein J. L.} and {ten Cate}, Olle and Gemke, {Reinoud J. B. J.}",
year = "2019",
doi = "10.4300/JGME-D-18-01006",
language = "English",
volume = "11",
pages = "158--164",
journal = "Journal of graduate medical education",
issn = "1949-8357",
publisher = "University of Finance and Management",
number = "4",

}

A National Process to Enhance the Validity of Entrustment Decisions for Dutch Pediatric Residents. / Smit, Maaike P.; de Hoog, Matthijs; Brackel, Hein J. L.; ten Cate, Olle; Gemke, Reinoud J. B. J.

In: Journal of graduate medical education, Vol. 11, No. 4, 2019, p. 158-164.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - A National Process to Enhance the Validity of Entrustment Decisions for Dutch Pediatric Residents

AU - Smit, Maaike P.

AU - de Hoog, Matthijs

AU - Brackel, Hein J. L.

AU - ten Cate, Olle

AU - Gemke, Reinoud J. B. J.

PY - 2019

Y1 - 2019

N2 - Background: Postgraduate medical education (PGME) has become increasingly individualized, and entrustable professional activities (EPAs) have been adopted to operationalize this. At the same time, the process and content to determine residents' progress using high-stakes summative entrustment decisions by clinical competency committees (CCCs) is not yet well established. Objective: We evaluated the experiences with a structured process for assessment of EPAs to attain uniform summative entrustment decisions for a national sample of pediatric residents. Methods: An EPA-based national PGME program for pediatric residents was introduced in the Netherlands, including a process of uniform summative entrustment decisions, termed the Evaluation and Assessment of Residents by Supervisors (EARS) procedure. To evaluate the program, we assessed survey data and information from invitational conferences. Results: Beginning in January 2017, 125 pediatric residents in all 8 Dutch residency regions started training in the EARS program. The program enabled robust summative entrustment decisions. Preliminary data suggested that faculty, despite increased preparation time, appreciated the comprehensive appraisal of resident qualifications. The EPA-based program was well accepted by residents. Fifty-one percent (57 of 112) had at least 2 EARS procedures per year, and for 75% (84 of 112) the level of supervision was often or always adjusted to their level of training. Conclusions: A national EPA-based program provided a structured process for summative entrustment decisions by CCCs and enabled individualized stepwise progression of residents toward unsupervised practice. Broader application of these concepts may require adaptations to accommodate different health care systems and specialties.

AB - Background: Postgraduate medical education (PGME) has become increasingly individualized, and entrustable professional activities (EPAs) have been adopted to operationalize this. At the same time, the process and content to determine residents' progress using high-stakes summative entrustment decisions by clinical competency committees (CCCs) is not yet well established. Objective: We evaluated the experiences with a structured process for assessment of EPAs to attain uniform summative entrustment decisions for a national sample of pediatric residents. Methods: An EPA-based national PGME program for pediatric residents was introduced in the Netherlands, including a process of uniform summative entrustment decisions, termed the Evaluation and Assessment of Residents by Supervisors (EARS) procedure. To evaluate the program, we assessed survey data and information from invitational conferences. Results: Beginning in January 2017, 125 pediatric residents in all 8 Dutch residency regions started training in the EARS program. The program enabled robust summative entrustment decisions. Preliminary data suggested that faculty, despite increased preparation time, appreciated the comprehensive appraisal of resident qualifications. The EPA-based program was well accepted by residents. Fifty-one percent (57 of 112) had at least 2 EARS procedures per year, and for 75% (84 of 112) the level of supervision was often or always adjusted to their level of training. Conclusions: A national EPA-based program provided a structured process for summative entrustment decisions by CCCs and enabled individualized stepwise progression of residents toward unsupervised practice. Broader application of these concepts may require adaptations to accommodate different health care systems and specialties.

UR - https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85071515960&origin=inward

UR - https://www.ncbi.nlm.nih.gov/pubmed/31428274

U2 - 10.4300/JGME-D-18-01006

DO - 10.4300/JGME-D-18-01006

M3 - Article

VL - 11

SP - 158

EP - 164

JO - Journal of graduate medical education

JF - Journal of graduate medical education

SN - 1949-8357

IS - 4

ER -