Simulation-Based Training in Medical Education: Immediate Growth or Cautious Optimism?

Article Type
Changed
Wed, 12/01/2021 - 07:40
Display Headline
Simulation-Based Training in Medical Education: Immediate Growth or Cautious Optimism?

For years, professional athletes have used simulation-based training (SBT), a combination of virtual and experiential learning that aims to optimize technical skills, teamwork, and communication.1 In SBT, critical plays and skills are first watched on video or reviewed on a chalkboard, and then run in the presence of a coach who offers immediate feedback to the player. The hope is that the individual will then be able to perfectly execute that play or scenario when it is game time. While SBT is a developing tool in medical education—allowing learners to practice important clinical skills prior to practicing in the higher-stakes clinical environment—an important question remains: what training can go virtual and what needs to stay in person?

In this issue, Carter et al2 present a single-site, telesimulation curriculum that addresses consult request and handoff communication using SBT. Due to the COVID-19 pandemic, the authors converted an in-person intern bootcamp into a virtual, Zoom®-based workshop and compared assessments and evaluations to the previous year’s (2019) in-person bootcamp. Compared to the in-person class, the telesimulation-based cohort were equally or better trained in the consult request portion of the workshop. However, participants were significantly less likely to perform the assessed handoff skills optimally, with only a quarter (26%) appropriately prioritizing patients and less than half (49%) providing an appropriate amount of information in the patient summary. Additionally, postworkshop surveys found that SBT participants were more satisfied with their performance in both the consult request and handoff scenarios and felt more prepared (99% vs 91%) to perform handoffs in clinical practice compared to the previous year’s in-person cohort.

We focus on this work as it explores the role that SBT or virtual training could have in hospital communication and patient safety training. While previous work has highlighted that technical and procedural skills often lend themselves to in-person adaptation (eg, point-of-care ultrasound), this work suggests that nontechnical skills training could be adapted to the virtual environment. Hospitalists and internal medicine trainees perform a myriad of nontechnical activities, such as end-of-life discussions, obtaining informed consent, providing peer-to-peer feedback, and leading multidisciplinary teams. Activities like these, which require no hands-on interactions, may be well-suited for simulation or virtual-based training.3

However, we make this suggestion with some caution. In Carter et al’s study,2 while we assumed that telesimulation would work for the handoff portion of the workshop, interestingly, the telesimulation-based cohort performed worse than the interns who participated in the previous year’s in-person training while simultaneously and paradoxically reporting that they felt more prepared. The authors offer several possible explanations, including alterations in the assessment checklist and a shift in the facilitators from peer observers to faculty hospitalists. We suspect that differences in the participants’ experiences prior to the bootcamp may also be at play. Given the onset of the pandemic during their final year in undergraduate training, many in this intern cohort were likely removed from their fourth-year clinical clerkships,4 taking from them pivotal opportunities to hone and refine this skill set prior to starting their graduate medical education.

As telesimulation and other virtual care educational opportunities continue to evolve, we must ensure that such training does not sacrifice quality for ease and satisfaction. As the authors’ findings show, simply replicating an in-person curriculum in a virtual environment does not ensure equivalence for all skill sets. We remain cautiously optimistic that as we adjust to a postpandemic world, more SBT and virtual-based educational interventions will allow medical trainees to be ready to perform come game time.

References

1. McCaskill S. Sports tech comes of age with VR training, coaching apps and smart gear. Forbes. March 31, 2020. https://www.forbes.com/sites/stevemccaskill/2020/03/31/sports-tech-comes-of-age-with-vr-training-coaching-apps-and-smart-gear/?sh=309a8fa219c9
2. Carter K, Podczerwinski J, Love L, et al. Utilizing telesimulation for advanced skills training in consultation and handoff communication: a post-COVID-19 GME bootcamp experience. J Hosp Med. 2021;16(12)730-734. https://doi.org/10.12788/jhm.3733
3. Paige JT, Sonesh SC, Garbee DD, Bonanno LS. Comprensive Healthcare Simulation: Interprofessional Team Training and Simulation. 1st ed. Springer International Publishing; 2020. https://doi.org/10.1007/978-3-030-28845-7
4. Goldenberg MN, Hersh DC, Wilkins KM, Schwartz ML. Suspending medical student clerkships due to COVID-19. Med Sci Educ. 2020;30(3):1-4. https://doi.org/10.1007/s40670-020-00994-1

Article PDF
Author and Disclosure Information

1Division of Hospital Medicine, Department of Internal Medicine, Virginia Commonwealth University Health, Richmond, Virginia; 2Section of Hospital Medicine, San Francisco VA Medical Center, San Francisco, California; 3Department of Medicine, University of California, San Francisco, San Francisco, California;

Disclosures
The authors reported no conflicts of interest.

Issue
Journal of Hospital Medicine 16(12)
Publications
Topics
Page Number
767
Sections
Author and Disclosure Information

1Division of Hospital Medicine, Department of Internal Medicine, Virginia Commonwealth University Health, Richmond, Virginia; 2Section of Hospital Medicine, San Francisco VA Medical Center, San Francisco, California; 3Department of Medicine, University of California, San Francisco, San Francisco, California;

Disclosures
The authors reported no conflicts of interest.

Author and Disclosure Information

1Division of Hospital Medicine, Department of Internal Medicine, Virginia Commonwealth University Health, Richmond, Virginia; 2Section of Hospital Medicine, San Francisco VA Medical Center, San Francisco, California; 3Department of Medicine, University of California, San Francisco, San Francisco, California;

Disclosures
The authors reported no conflicts of interest.

Article PDF
Article PDF
Related Articles

For years, professional athletes have used simulation-based training (SBT), a combination of virtual and experiential learning that aims to optimize technical skills, teamwork, and communication.1 In SBT, critical plays and skills are first watched on video or reviewed on a chalkboard, and then run in the presence of a coach who offers immediate feedback to the player. The hope is that the individual will then be able to perfectly execute that play or scenario when it is game time. While SBT is a developing tool in medical education—allowing learners to practice important clinical skills prior to practicing in the higher-stakes clinical environment—an important question remains: what training can go virtual and what needs to stay in person?

In this issue, Carter et al2 present a single-site, telesimulation curriculum that addresses consult request and handoff communication using SBT. Due to the COVID-19 pandemic, the authors converted an in-person intern bootcamp into a virtual, Zoom®-based workshop and compared assessments and evaluations to the previous year’s (2019) in-person bootcamp. Compared to the in-person class, the telesimulation-based cohort were equally or better trained in the consult request portion of the workshop. However, participants were significantly less likely to perform the assessed handoff skills optimally, with only a quarter (26%) appropriately prioritizing patients and less than half (49%) providing an appropriate amount of information in the patient summary. Additionally, postworkshop surveys found that SBT participants were more satisfied with their performance in both the consult request and handoff scenarios and felt more prepared (99% vs 91%) to perform handoffs in clinical practice compared to the previous year’s in-person cohort.

We focus on this work as it explores the role that SBT or virtual training could have in hospital communication and patient safety training. While previous work has highlighted that technical and procedural skills often lend themselves to in-person adaptation (eg, point-of-care ultrasound), this work suggests that nontechnical skills training could be adapted to the virtual environment. Hospitalists and internal medicine trainees perform a myriad of nontechnical activities, such as end-of-life discussions, obtaining informed consent, providing peer-to-peer feedback, and leading multidisciplinary teams. Activities like these, which require no hands-on interactions, may be well-suited for simulation or virtual-based training.3

However, we make this suggestion with some caution. In Carter et al’s study,2 while we assumed that telesimulation would work for the handoff portion of the workshop, interestingly, the telesimulation-based cohort performed worse than the interns who participated in the previous year’s in-person training while simultaneously and paradoxically reporting that they felt more prepared. The authors offer several possible explanations, including alterations in the assessment checklist and a shift in the facilitators from peer observers to faculty hospitalists. We suspect that differences in the participants’ experiences prior to the bootcamp may also be at play. Given the onset of the pandemic during their final year in undergraduate training, many in this intern cohort were likely removed from their fourth-year clinical clerkships,4 taking from them pivotal opportunities to hone and refine this skill set prior to starting their graduate medical education.

As telesimulation and other virtual care educational opportunities continue to evolve, we must ensure that such training does not sacrifice quality for ease and satisfaction. As the authors’ findings show, simply replicating an in-person curriculum in a virtual environment does not ensure equivalence for all skill sets. We remain cautiously optimistic that as we adjust to a postpandemic world, more SBT and virtual-based educational interventions will allow medical trainees to be ready to perform come game time.

For years, professional athletes have used simulation-based training (SBT), a combination of virtual and experiential learning that aims to optimize technical skills, teamwork, and communication.1 In SBT, critical plays and skills are first watched on video or reviewed on a chalkboard, and then run in the presence of a coach who offers immediate feedback to the player. The hope is that the individual will then be able to perfectly execute that play or scenario when it is game time. While SBT is a developing tool in medical education—allowing learners to practice important clinical skills prior to practicing in the higher-stakes clinical environment—an important question remains: what training can go virtual and what needs to stay in person?

In this issue, Carter et al2 present a single-site, telesimulation curriculum that addresses consult request and handoff communication using SBT. Due to the COVID-19 pandemic, the authors converted an in-person intern bootcamp into a virtual, Zoom®-based workshop and compared assessments and evaluations to the previous year’s (2019) in-person bootcamp. Compared to the in-person class, the telesimulation-based cohort were equally or better trained in the consult request portion of the workshop. However, participants were significantly less likely to perform the assessed handoff skills optimally, with only a quarter (26%) appropriately prioritizing patients and less than half (49%) providing an appropriate amount of information in the patient summary. Additionally, postworkshop surveys found that SBT participants were more satisfied with their performance in both the consult request and handoff scenarios and felt more prepared (99% vs 91%) to perform handoffs in clinical practice compared to the previous year’s in-person cohort.

We focus on this work as it explores the role that SBT or virtual training could have in hospital communication and patient safety training. While previous work has highlighted that technical and procedural skills often lend themselves to in-person adaptation (eg, point-of-care ultrasound), this work suggests that nontechnical skills training could be adapted to the virtual environment. Hospitalists and internal medicine trainees perform a myriad of nontechnical activities, such as end-of-life discussions, obtaining informed consent, providing peer-to-peer feedback, and leading multidisciplinary teams. Activities like these, which require no hands-on interactions, may be well-suited for simulation or virtual-based training.3

However, we make this suggestion with some caution. In Carter et al’s study,2 while we assumed that telesimulation would work for the handoff portion of the workshop, interestingly, the telesimulation-based cohort performed worse than the interns who participated in the previous year’s in-person training while simultaneously and paradoxically reporting that they felt more prepared. The authors offer several possible explanations, including alterations in the assessment checklist and a shift in the facilitators from peer observers to faculty hospitalists. We suspect that differences in the participants’ experiences prior to the bootcamp may also be at play. Given the onset of the pandemic during their final year in undergraduate training, many in this intern cohort were likely removed from their fourth-year clinical clerkships,4 taking from them pivotal opportunities to hone and refine this skill set prior to starting their graduate medical education.

As telesimulation and other virtual care educational opportunities continue to evolve, we must ensure that such training does not sacrifice quality for ease and satisfaction. As the authors’ findings show, simply replicating an in-person curriculum in a virtual environment does not ensure equivalence for all skill sets. We remain cautiously optimistic that as we adjust to a postpandemic world, more SBT and virtual-based educational interventions will allow medical trainees to be ready to perform come game time.

References

1. McCaskill S. Sports tech comes of age with VR training, coaching apps and smart gear. Forbes. March 31, 2020. https://www.forbes.com/sites/stevemccaskill/2020/03/31/sports-tech-comes-of-age-with-vr-training-coaching-apps-and-smart-gear/?sh=309a8fa219c9
2. Carter K, Podczerwinski J, Love L, et al. Utilizing telesimulation for advanced skills training in consultation and handoff communication: a post-COVID-19 GME bootcamp experience. J Hosp Med. 2021;16(12)730-734. https://doi.org/10.12788/jhm.3733
3. Paige JT, Sonesh SC, Garbee DD, Bonanno LS. Comprensive Healthcare Simulation: Interprofessional Team Training and Simulation. 1st ed. Springer International Publishing; 2020. https://doi.org/10.1007/978-3-030-28845-7
4. Goldenberg MN, Hersh DC, Wilkins KM, Schwartz ML. Suspending medical student clerkships due to COVID-19. Med Sci Educ. 2020;30(3):1-4. https://doi.org/10.1007/s40670-020-00994-1

References

1. McCaskill S. Sports tech comes of age with VR training, coaching apps and smart gear. Forbes. March 31, 2020. https://www.forbes.com/sites/stevemccaskill/2020/03/31/sports-tech-comes-of-age-with-vr-training-coaching-apps-and-smart-gear/?sh=309a8fa219c9
2. Carter K, Podczerwinski J, Love L, et al. Utilizing telesimulation for advanced skills training in consultation and handoff communication: a post-COVID-19 GME bootcamp experience. J Hosp Med. 2021;16(12)730-734. https://doi.org/10.12788/jhm.3733
3. Paige JT, Sonesh SC, Garbee DD, Bonanno LS. Comprensive Healthcare Simulation: Interprofessional Team Training and Simulation. 1st ed. Springer International Publishing; 2020. https://doi.org/10.1007/978-3-030-28845-7
4. Goldenberg MN, Hersh DC, Wilkins KM, Schwartz ML. Suspending medical student clerkships due to COVID-19. Med Sci Educ. 2020;30(3):1-4. https://doi.org/10.1007/s40670-020-00994-1

Issue
Journal of Hospital Medicine 16(12)
Issue
Journal of Hospital Medicine 16(12)
Page Number
767
Page Number
767
Publications
Publications
Topics
Article Type
Display Headline
Simulation-Based Training in Medical Education: Immediate Growth or Cautious Optimism?
Display Headline
Simulation-Based Training in Medical Education: Immediate Growth or Cautious Optimism?
Sections
Disallow All Ads
Correspondence Location
Michelle Brooks, MD; Email: michelle.brooks@vcuhealth.org; Twitter: @Michellebr00ks.
Content Gating
Gated (full article locked unless allowed per User)
Alternative CME
Disqus Comments
Default
Use ProPublica
Hide sidebar & use full width
render the right sidebar.
Conference Recap Checkbox
Not Conference Recap
Clinical Edge
Display the Slideshow in this Article
Gating Strategy
First Page Free
Medscape Article
Display survey writer
Reuters content
Disable Inline Native ads
WebMD Article
Article PDF Media
Image
Teambase ID
18001F30.SIG
Disable zoom
Off