User login
Clinical Progress Note: Vascular Access Appropriateness Guidance for Pediatric Hospitalists
Hospitalized pediatric patients often require vascular access for necessary therapies, such as antibiotics. However, vascular access devices (VADs) are also associated with harm, ranging from insertion complications to life-threatening bloodstream infections or thrombosis.1 Pediatric hospitalists often guide VAD placement. There is a paucity of evidence to guide VAD selection based on the relative benefits and risks.2 The Michigan Appropriateness Guide for Intravenous Catheters in Pediatrics (miniMAGIC)2 offers the first set of standards. Like its adult predecessor guideline (MAGIC) published in 2015, it provides guidance on appropriate VAD selection based on current evidence and expertise from a multidisciplinary panel.2 The guideline informs device selection, device characteristics, and insertion technique for the pediatric population (term neonates to adolescents) and across a wide range of clinical indications.2 This review highlights key recommendations for pediatric hospitalists to help their decision-making.
METHODS USED IN PREPARING THE GUIDELINE
miniMAGIC was developed using the RAND/UCLA Appropriateness Method, a method proven to reduce inappropriate (ie, overused or underused) healthcare interventions.3 It combines rigorous evidence review with multidisciplinary expert opinion on real-world clinical scenarios to provide recommendations about an intervention’s appropriateness.3 This is particularly useful for clinical scenarios that lack high-quality evidence to guide decision-making. The RAND/UCLA method deems an intervention appropriate if the benefits outweigh the risks by a wide enough margin that proceeding is worthwhile, and it does not take cost into account.2 The method design consists of five phases: (1) defining the scope and key terms, (2) reviewing and synthesizing the literature, (3) selecting an expert panel, (4) developing case scenarios, and (5) conducting two rounds of appropriateness ratings by the expert panel for each clinical scenario.3 The guideline’s scope included term neonates (aged 0-30 days), infants (aged 31 days-1 year), children (aged 1-12 years), and adolescents (aged 12-18 years). Infants receiving care in the neonatal intensive care unit or special care nursery were excluded. Other specialized populations addressed based on setting or diagnosis were general hospitalized patients and patients with congenital cardiac disease, critical illness, oncologic and hematologic conditions, and long-term VAD-dependent conditions.3
A total of 133 studies or clinical practice guidelines (CPGs) met the eligibility criteria for the systematic review.4 Although the systematic review was conducted per the RAND/UCLA method using two independent reviewers who evaluated the methodologic quality, transparency, and relevancy of each article, there was no formal assessment of evidence quality. The recommendations were based primarily on observational studies and CPGs because there were few randomized controlled trials or systematic reviews on VAD selection for pediatric patients in the literature. Pediatric evidence was limited for certain scenarios or populations (eg, term neonates, midline catheters, difficult venous access, long-term VAD), so adult and/or neonatal evidence was included when applicable.
The panel included 14 pediatric clinical experts from cardiology, vascular access, critical care, hematology/oncology, emergency medicine, general surgery, hospital medicine, anesthesia, interventional radiology, pharmacology, and infectious diseases. The panel also included nonvoting panel members such as the panel facilitators, a methodologist, and a patient representative.
RESULTS OF THE CLINICAL REVIEW
We review four common clinical scenarios encountered by pediatric hospitalists and summarize key recommendations (Table
Peripherally Inserted Central Catheter
Patients may require peripherally inserted central catheters (PICCs) to facilitate a longer duration of intravenous (IV) therapy, such as delivery of antibiotics, or frequent blood draws. The need for prolonged vascular access is decreasing, as studies show many infections in children previously treated with prolonged IV antibiotics can be safely and equally effectively managed with early transition to oral therapy.5-8 These studies highlight the higher rate of complications and risks associated with PICCs, including thrombosis, infection, and mechanical issues, as well as the added healthcare utilization needed to evaluate and manage the complications. PICC-associated complication rates also increase with duration.4
However, there are some clinical scenarios that still warrant prolonged therapy and/or access; PICC recommendations are summarized in the Appendix Figure. The miniMAGIC panel deemed PICC lines appropriate for any nonperipheral therapy of any length. For peripherally compatible therapy, the panel rated PICC placement as inappropriate for therapy lasting less than 8 days, regardless of patient age. PICC placement in infants, children, and adolescents was rated appropriate for therapy with a duration exceeding 14 days, but the panel was uncertain about therapy expected to last between 8 and 14 days. Recognizing the additional challenges with maintaining peripheral IV catheter access in neonates, PICCs were deemed appropriate for neonates needing peripheral therapy lasting longer than 7 days.
The panel rated PICC placement appropriate for frequent blood draws (defined as more than one time per day) for more than 7 days in neonates or infants and more than 14 days in children and adolescents. But regardless of patient age, the PICC caliber must be at least 3F.
The miniMAGIC panel found that a single lumen is appropriate in most cases, highlighting that multilumen catheters increase the risk for infection, occlusion, and venous thrombosis.4 Multilumen catheters were rated as inappropriate in the case of reserving a lumen for blood products and blood sampling. When reserving a lumen for lipids and parenteral nutrition (PN), the panel was uncertain given the lack of evidence regarding the risks/benefits of the complications associated with the infusions themselves versus those of the device. Regardless, collaboration with a pharmacist and vascular access specialist is recommended to aid in choosing the most appropriate device characteristics.
Midline Catheters
Midline catheters are inserted in a peripheral vein, but the catheter tip terminates in the proximal extremity. Compared with peripheral IV catheters, midline catheters last longer and have lower rates of phlebitis. In addition, midline catheter placement does not require sedation or fluoroscopy and has lower rates of infection compared with PICC lines.9 Although there is good evidence in adults, and multiple panelists reported success in using midline catheters in various age groups, the evidence for their safe and efficacious use in pediatrics is limited, particularly for infants. Midline catheters were rated as appropriate for peripheral therapy lasting less than 8 days in neonates and less than 15 days in children and adolescents. Use in infants was deemed uncertain based on lack of published evidence. Midline catheters were also rated as appropriate for frequent blood draws of less than 8 days in neonates and less than 15 days in adolescents, but uncertain for children and infants.
Difficult Access and Insertion Procedure
The panel rated three or more attempts for peripheral IV catheter insertion by a single clinician as inappropriate and recommended early escalation to a more experienced inserter after 0 to 2 attempts by a single provider. The goal is to preserve insertion sites and reduce patient discomfort. If a patient loses access when only 1 day of therapy remains, the provider should transition to oral or intramuscular therapy when appropriate, particularly if there are no advanced insertion staff available or after two or more attempts at re-insertion are unsuccessful. There is high-quality evidence that supports vessel visualization (primarily ultrasound) with peripheral IV catheter and PICC placement.2 In the case of two or more unsuccessful attempts at peripheral IV catheter placement by an advanced inserter using technology assistance (ultrasound), PICC placement is considered appropriate by the panel to avoid delays in treatment and limit patient discomfort associated with repeat attempts.
Long-term Vascular Access
Children with medical complexity or chronic illness may require long-term (>2 months) or very-long-term (>1 year) vascular access. Common themes for VAD selection in this heterogeneous population include a focus on vessel preservation and complication prevention.2 The panel strongly recommended that clinicians partner with the patient and caregivers in the decision-making process. Shared decision-making is necessary to meet both the short-term and evolving needs of the of the patient and family. The panel also believed the frequency of hospitalization should not be used as a criterion for VAD selection since acute hospitalization is an unreliable proxy for disease severity in pediatric chronic disease conditions.2 Rather, the infusate characteristics and length/intermittency of therapy should be primary influencers of VAD selection. In general, the panel rated cuffed tunneled central VADs (CVADs) as appropriate for all age groups for long-term PN, long-term continuous infusions, and long-term intermittent therapies. For continuous non-PN infusions, appropriate ratings were given to PICCs for infants and children and total implanted venous devices (TIVDs) in children and adolescents. For intermittent (but at least daily) access, TIVDs and PICC lines were both rated as appropriate for children and adolescents but uncertain for neonates and infants. Peripheral devices were deemed inappropriate for all long-term complex therapies. For children and adolescents needing intermittent, regular peripheral treatments (eg, steroids or antibiotics), peripheral IVs and TIVDs were rated appropriate for short duration (<7 days) therapies. PICCs and midlines for this indication were uncertain because of the lack of evidence. For medium-duration intermittent therapies (8-14 days), PICCs, tunneled cuffed CVADs, and TIVDs were rated as appropriate. A recently released mobile application can help guide the clinician through many varied clinical scenarios and indications.10
LIMITATIONS AND GAPS
The guideline recommendations were more often reliant on clinical practice guidelines and expert panel opinion given the lack of high-quality pediatric evidence for most scenarios. The panel members were from the United States and Australia, so the recommendations may not be generalizable to care systems in other countries. Although the panel included experts from many specialties that care for patient populations needing VADs, not all subspecialty populations were considered, particularly those with long-term vascular access–dependent conditions who may be commonly hospitalized. Scenarios with disagreement or uncertainty highlight gaps in need of future study (eg, midline catheter use and device selection for blood draws).
CONCLUSIONS AND APPLICATION
miniMAGIC is the first appropriateness guideline to help standardize the safe use of VADs in children. Although some gaps remain, the authors intend it to be a living document that will need revisions as new evidence is published. A mobile health application facilitates use of the recommendations, providing quick, point-of-care decision support based on clinical features.10 Pediatric hospitalists should collaborate with their institutions to examine their current VAD use in hospitalized children and identify opportunities for practice change and standardization. Use of these recommendations may help hospitalists improve the care of hospitalized children by decreasing unnecessary PICC placement and better partner with patients and caregivers to limit discomfort surrounding VAD placement.
1. Ullman AJ, Marsh N, Mihala G, Cooke M, Rickard CM. Complications of central venous access devices: a systematic review. Pediatrics. 2015;136(5):e1331-e1344. https://doi.org/10.1542/peds.2015-1507
2. Ullman AJ, Bernstein SJ, Brown E, et al. The Michigan appropriateness guide for intravenous catheters in pediatrics: miniMAGIC. Pediatrics. 2020;145(Suppl 3):S269-S284. https://doi.org/10.1542/peds.2019-3474I
3. Ullman AJ, Chopra V, Brown E, et al. Developing appropriateness criteria for pediatric vascular access. Pediatrics. 2020;145(Suppl 3):S233-S242. https://doi.org/10.1542/peds.2019-3474G
4. Paterson RS, Chopra V, Brown E, et al. Selection and insertion of vascular access devices in pediatrics: a systematic review. Pediatrics. 2020;145(Suppl 3):S243-S268. https://doi.org/10.1542/peds.2019-3474H
5. Keren R, Shah SS, Srivastava R, et al. Comparative effectiveness of intravenous vs oral antibiotics for postdischarge treatment of acute osteomeyelitis in children. JAMA Pediatr. 2015;169(2):120-128. https://doi.org/10.1001/jamapediatrics.2014.2822
6. Shah SS, Srivastava R, Wu S, et al. Intravenous versus oral antibiotics for postdischarge treatment of complicated pneumonia. Pediatrics. 2016;138(6):e20161692. https://doi.org/10.1542/peds.2016-1692
7. Rangel SJ, Anderson BR, Srivastava R, et al. Intravenous versus oral antibiotics for the prevention of treatment failure in children with complicated appendicitis: has the abandonment of peripherally inserted catheters been justified? Ann Surg. 2017;266(2):361-368. https://doi.org/10.1097/SLA.0000000000001923
8. Desai S, Aronson PL, Shabanova V, et al. Parenteral antibiotic therapy duration in young infants with bacteremic urinary tract infections. Pediatrics. 2019;144(3):e20183844. https://doi.org/10.1542/peds.2018-3844
9. Anderson J, Greenwell A, Louderback J, Polivka BJ, Herron Behr J. Comparison of outcomes of extended dwell/midline peripheral intravenous catheters and peripherally inserted central catheters in children. J Assoc Vasc Access. 2016;21(3):158-164. https://doi.org/10.1016/j.java.2016.03.007
10. miniMAGIC: the Michigan Appropriateness Guide for Intravenous Catheters in Pediatrics app. Version 1.0.0. Alliance for Vascular Access Teaching and Research.
11. Shaughnessy EE, Morton K, Shah SS. Vascular access in hospitalized children. Pediatrics. 2020;145(Suppl 3):S298-S299. https://doi.org/10.1542/peds.2019-3474P
Hospitalized pediatric patients often require vascular access for necessary therapies, such as antibiotics. However, vascular access devices (VADs) are also associated with harm, ranging from insertion complications to life-threatening bloodstream infections or thrombosis.1 Pediatric hospitalists often guide VAD placement. There is a paucity of evidence to guide VAD selection based on the relative benefits and risks.2 The Michigan Appropriateness Guide for Intravenous Catheters in Pediatrics (miniMAGIC)2 offers the first set of standards. Like its adult predecessor guideline (MAGIC) published in 2015, it provides guidance on appropriate VAD selection based on current evidence and expertise from a multidisciplinary panel.2 The guideline informs device selection, device characteristics, and insertion technique for the pediatric population (term neonates to adolescents) and across a wide range of clinical indications.2 This review highlights key recommendations for pediatric hospitalists to help their decision-making.
METHODS USED IN PREPARING THE GUIDELINE
miniMAGIC was developed using the RAND/UCLA Appropriateness Method, a method proven to reduce inappropriate (ie, overused or underused) healthcare interventions.3 It combines rigorous evidence review with multidisciplinary expert opinion on real-world clinical scenarios to provide recommendations about an intervention’s appropriateness.3 This is particularly useful for clinical scenarios that lack high-quality evidence to guide decision-making. The RAND/UCLA method deems an intervention appropriate if the benefits outweigh the risks by a wide enough margin that proceeding is worthwhile, and it does not take cost into account.2 The method design consists of five phases: (1) defining the scope and key terms, (2) reviewing and synthesizing the literature, (3) selecting an expert panel, (4) developing case scenarios, and (5) conducting two rounds of appropriateness ratings by the expert panel for each clinical scenario.3 The guideline’s scope included term neonates (aged 0-30 days), infants (aged 31 days-1 year), children (aged 1-12 years), and adolescents (aged 12-18 years). Infants receiving care in the neonatal intensive care unit or special care nursery were excluded. Other specialized populations addressed based on setting or diagnosis were general hospitalized patients and patients with congenital cardiac disease, critical illness, oncologic and hematologic conditions, and long-term VAD-dependent conditions.3
A total of 133 studies or clinical practice guidelines (CPGs) met the eligibility criteria for the systematic review.4 Although the systematic review was conducted per the RAND/UCLA method using two independent reviewers who evaluated the methodologic quality, transparency, and relevancy of each article, there was no formal assessment of evidence quality. The recommendations were based primarily on observational studies and CPGs because there were few randomized controlled trials or systematic reviews on VAD selection for pediatric patients in the literature. Pediatric evidence was limited for certain scenarios or populations (eg, term neonates, midline catheters, difficult venous access, long-term VAD), so adult and/or neonatal evidence was included when applicable.
The panel included 14 pediatric clinical experts from cardiology, vascular access, critical care, hematology/oncology, emergency medicine, general surgery, hospital medicine, anesthesia, interventional radiology, pharmacology, and infectious diseases. The panel also included nonvoting panel members such as the panel facilitators, a methodologist, and a patient representative.
RESULTS OF THE CLINICAL REVIEW
We review four common clinical scenarios encountered by pediatric hospitalists and summarize key recommendations (Table
Peripherally Inserted Central Catheter
Patients may require peripherally inserted central catheters (PICCs) to facilitate a longer duration of intravenous (IV) therapy, such as delivery of antibiotics, or frequent blood draws. The need for prolonged vascular access is decreasing, as studies show many infections in children previously treated with prolonged IV antibiotics can be safely and equally effectively managed with early transition to oral therapy.5-8 These studies highlight the higher rate of complications and risks associated with PICCs, including thrombosis, infection, and mechanical issues, as well as the added healthcare utilization needed to evaluate and manage the complications. PICC-associated complication rates also increase with duration.4
However, there are some clinical scenarios that still warrant prolonged therapy and/or access; PICC recommendations are summarized in the Appendix Figure. The miniMAGIC panel deemed PICC lines appropriate for any nonperipheral therapy of any length. For peripherally compatible therapy, the panel rated PICC placement as inappropriate for therapy lasting less than 8 days, regardless of patient age. PICC placement in infants, children, and adolescents was rated appropriate for therapy with a duration exceeding 14 days, but the panel was uncertain about therapy expected to last between 8 and 14 days. Recognizing the additional challenges with maintaining peripheral IV catheter access in neonates, PICCs were deemed appropriate for neonates needing peripheral therapy lasting longer than 7 days.
The panel rated PICC placement appropriate for frequent blood draws (defined as more than one time per day) for more than 7 days in neonates or infants and more than 14 days in children and adolescents. But regardless of patient age, the PICC caliber must be at least 3F.
The miniMAGIC panel found that a single lumen is appropriate in most cases, highlighting that multilumen catheters increase the risk for infection, occlusion, and venous thrombosis.4 Multilumen catheters were rated as inappropriate in the case of reserving a lumen for blood products and blood sampling. When reserving a lumen for lipids and parenteral nutrition (PN), the panel was uncertain given the lack of evidence regarding the risks/benefits of the complications associated with the infusions themselves versus those of the device. Regardless, collaboration with a pharmacist and vascular access specialist is recommended to aid in choosing the most appropriate device characteristics.
Midline Catheters
Midline catheters are inserted in a peripheral vein, but the catheter tip terminates in the proximal extremity. Compared with peripheral IV catheters, midline catheters last longer and have lower rates of phlebitis. In addition, midline catheter placement does not require sedation or fluoroscopy and has lower rates of infection compared with PICC lines.9 Although there is good evidence in adults, and multiple panelists reported success in using midline catheters in various age groups, the evidence for their safe and efficacious use in pediatrics is limited, particularly for infants. Midline catheters were rated as appropriate for peripheral therapy lasting less than 8 days in neonates and less than 15 days in children and adolescents. Use in infants was deemed uncertain based on lack of published evidence. Midline catheters were also rated as appropriate for frequent blood draws of less than 8 days in neonates and less than 15 days in adolescents, but uncertain for children and infants.
Difficult Access and Insertion Procedure
The panel rated three or more attempts for peripheral IV catheter insertion by a single clinician as inappropriate and recommended early escalation to a more experienced inserter after 0 to 2 attempts by a single provider. The goal is to preserve insertion sites and reduce patient discomfort. If a patient loses access when only 1 day of therapy remains, the provider should transition to oral or intramuscular therapy when appropriate, particularly if there are no advanced insertion staff available or after two or more attempts at re-insertion are unsuccessful. There is high-quality evidence that supports vessel visualization (primarily ultrasound) with peripheral IV catheter and PICC placement.2 In the case of two or more unsuccessful attempts at peripheral IV catheter placement by an advanced inserter using technology assistance (ultrasound), PICC placement is considered appropriate by the panel to avoid delays in treatment and limit patient discomfort associated with repeat attempts.
Long-term Vascular Access
Children with medical complexity or chronic illness may require long-term (>2 months) or very-long-term (>1 year) vascular access. Common themes for VAD selection in this heterogeneous population include a focus on vessel preservation and complication prevention.2 The panel strongly recommended that clinicians partner with the patient and caregivers in the decision-making process. Shared decision-making is necessary to meet both the short-term and evolving needs of the of the patient and family. The panel also believed the frequency of hospitalization should not be used as a criterion for VAD selection since acute hospitalization is an unreliable proxy for disease severity in pediatric chronic disease conditions.2 Rather, the infusate characteristics and length/intermittency of therapy should be primary influencers of VAD selection. In general, the panel rated cuffed tunneled central VADs (CVADs) as appropriate for all age groups for long-term PN, long-term continuous infusions, and long-term intermittent therapies. For continuous non-PN infusions, appropriate ratings were given to PICCs for infants and children and total implanted venous devices (TIVDs) in children and adolescents. For intermittent (but at least daily) access, TIVDs and PICC lines were both rated as appropriate for children and adolescents but uncertain for neonates and infants. Peripheral devices were deemed inappropriate for all long-term complex therapies. For children and adolescents needing intermittent, regular peripheral treatments (eg, steroids or antibiotics), peripheral IVs and TIVDs were rated appropriate for short duration (<7 days) therapies. PICCs and midlines for this indication were uncertain because of the lack of evidence. For medium-duration intermittent therapies (8-14 days), PICCs, tunneled cuffed CVADs, and TIVDs were rated as appropriate. A recently released mobile application can help guide the clinician through many varied clinical scenarios and indications.10
LIMITATIONS AND GAPS
The guideline recommendations were more often reliant on clinical practice guidelines and expert panel opinion given the lack of high-quality pediatric evidence for most scenarios. The panel members were from the United States and Australia, so the recommendations may not be generalizable to care systems in other countries. Although the panel included experts from many specialties that care for patient populations needing VADs, not all subspecialty populations were considered, particularly those with long-term vascular access–dependent conditions who may be commonly hospitalized. Scenarios with disagreement or uncertainty highlight gaps in need of future study (eg, midline catheter use and device selection for blood draws).
CONCLUSIONS AND APPLICATION
miniMAGIC is the first appropriateness guideline to help standardize the safe use of VADs in children. Although some gaps remain, the authors intend it to be a living document that will need revisions as new evidence is published. A mobile health application facilitates use of the recommendations, providing quick, point-of-care decision support based on clinical features.10 Pediatric hospitalists should collaborate with their institutions to examine their current VAD use in hospitalized children and identify opportunities for practice change and standardization. Use of these recommendations may help hospitalists improve the care of hospitalized children by decreasing unnecessary PICC placement and better partner with patients and caregivers to limit discomfort surrounding VAD placement.
Hospitalized pediatric patients often require vascular access for necessary therapies, such as antibiotics. However, vascular access devices (VADs) are also associated with harm, ranging from insertion complications to life-threatening bloodstream infections or thrombosis.1 Pediatric hospitalists often guide VAD placement. There is a paucity of evidence to guide VAD selection based on the relative benefits and risks.2 The Michigan Appropriateness Guide for Intravenous Catheters in Pediatrics (miniMAGIC)2 offers the first set of standards. Like its adult predecessor guideline (MAGIC) published in 2015, it provides guidance on appropriate VAD selection based on current evidence and expertise from a multidisciplinary panel.2 The guideline informs device selection, device characteristics, and insertion technique for the pediatric population (term neonates to adolescents) and across a wide range of clinical indications.2 This review highlights key recommendations for pediatric hospitalists to help their decision-making.
METHODS USED IN PREPARING THE GUIDELINE
miniMAGIC was developed using the RAND/UCLA Appropriateness Method, a method proven to reduce inappropriate (ie, overused or underused) healthcare interventions.3 It combines rigorous evidence review with multidisciplinary expert opinion on real-world clinical scenarios to provide recommendations about an intervention’s appropriateness.3 This is particularly useful for clinical scenarios that lack high-quality evidence to guide decision-making. The RAND/UCLA method deems an intervention appropriate if the benefits outweigh the risks by a wide enough margin that proceeding is worthwhile, and it does not take cost into account.2 The method design consists of five phases: (1) defining the scope and key terms, (2) reviewing and synthesizing the literature, (3) selecting an expert panel, (4) developing case scenarios, and (5) conducting two rounds of appropriateness ratings by the expert panel for each clinical scenario.3 The guideline’s scope included term neonates (aged 0-30 days), infants (aged 31 days-1 year), children (aged 1-12 years), and adolescents (aged 12-18 years). Infants receiving care in the neonatal intensive care unit or special care nursery were excluded. Other specialized populations addressed based on setting or diagnosis were general hospitalized patients and patients with congenital cardiac disease, critical illness, oncologic and hematologic conditions, and long-term VAD-dependent conditions.3
A total of 133 studies or clinical practice guidelines (CPGs) met the eligibility criteria for the systematic review.4 Although the systematic review was conducted per the RAND/UCLA method using two independent reviewers who evaluated the methodologic quality, transparency, and relevancy of each article, there was no formal assessment of evidence quality. The recommendations were based primarily on observational studies and CPGs because there were few randomized controlled trials or systematic reviews on VAD selection for pediatric patients in the literature. Pediatric evidence was limited for certain scenarios or populations (eg, term neonates, midline catheters, difficult venous access, long-term VAD), so adult and/or neonatal evidence was included when applicable.
The panel included 14 pediatric clinical experts from cardiology, vascular access, critical care, hematology/oncology, emergency medicine, general surgery, hospital medicine, anesthesia, interventional radiology, pharmacology, and infectious diseases. The panel also included nonvoting panel members such as the panel facilitators, a methodologist, and a patient representative.
RESULTS OF THE CLINICAL REVIEW
We review four common clinical scenarios encountered by pediatric hospitalists and summarize key recommendations (Table
Peripherally Inserted Central Catheter
Patients may require peripherally inserted central catheters (PICCs) to facilitate a longer duration of intravenous (IV) therapy, such as delivery of antibiotics, or frequent blood draws. The need for prolonged vascular access is decreasing, as studies show many infections in children previously treated with prolonged IV antibiotics can be safely and equally effectively managed with early transition to oral therapy.5-8 These studies highlight the higher rate of complications and risks associated with PICCs, including thrombosis, infection, and mechanical issues, as well as the added healthcare utilization needed to evaluate and manage the complications. PICC-associated complication rates also increase with duration.4
However, there are some clinical scenarios that still warrant prolonged therapy and/or access; PICC recommendations are summarized in the Appendix Figure. The miniMAGIC panel deemed PICC lines appropriate for any nonperipheral therapy of any length. For peripherally compatible therapy, the panel rated PICC placement as inappropriate for therapy lasting less than 8 days, regardless of patient age. PICC placement in infants, children, and adolescents was rated appropriate for therapy with a duration exceeding 14 days, but the panel was uncertain about therapy expected to last between 8 and 14 days. Recognizing the additional challenges with maintaining peripheral IV catheter access in neonates, PICCs were deemed appropriate for neonates needing peripheral therapy lasting longer than 7 days.
The panel rated PICC placement appropriate for frequent blood draws (defined as more than one time per day) for more than 7 days in neonates or infants and more than 14 days in children and adolescents. But regardless of patient age, the PICC caliber must be at least 3F.
The miniMAGIC panel found that a single lumen is appropriate in most cases, highlighting that multilumen catheters increase the risk for infection, occlusion, and venous thrombosis.4 Multilumen catheters were rated as inappropriate in the case of reserving a lumen for blood products and blood sampling. When reserving a lumen for lipids and parenteral nutrition (PN), the panel was uncertain given the lack of evidence regarding the risks/benefits of the complications associated with the infusions themselves versus those of the device. Regardless, collaboration with a pharmacist and vascular access specialist is recommended to aid in choosing the most appropriate device characteristics.
Midline Catheters
Midline catheters are inserted in a peripheral vein, but the catheter tip terminates in the proximal extremity. Compared with peripheral IV catheters, midline catheters last longer and have lower rates of phlebitis. In addition, midline catheter placement does not require sedation or fluoroscopy and has lower rates of infection compared with PICC lines.9 Although there is good evidence in adults, and multiple panelists reported success in using midline catheters in various age groups, the evidence for their safe and efficacious use in pediatrics is limited, particularly for infants. Midline catheters were rated as appropriate for peripheral therapy lasting less than 8 days in neonates and less than 15 days in children and adolescents. Use in infants was deemed uncertain based on lack of published evidence. Midline catheters were also rated as appropriate for frequent blood draws of less than 8 days in neonates and less than 15 days in adolescents, but uncertain for children and infants.
Difficult Access and Insertion Procedure
The panel rated three or more attempts for peripheral IV catheter insertion by a single clinician as inappropriate and recommended early escalation to a more experienced inserter after 0 to 2 attempts by a single provider. The goal is to preserve insertion sites and reduce patient discomfort. If a patient loses access when only 1 day of therapy remains, the provider should transition to oral or intramuscular therapy when appropriate, particularly if there are no advanced insertion staff available or after two or more attempts at re-insertion are unsuccessful. There is high-quality evidence that supports vessel visualization (primarily ultrasound) with peripheral IV catheter and PICC placement.2 In the case of two or more unsuccessful attempts at peripheral IV catheter placement by an advanced inserter using technology assistance (ultrasound), PICC placement is considered appropriate by the panel to avoid delays in treatment and limit patient discomfort associated with repeat attempts.
Long-term Vascular Access
Children with medical complexity or chronic illness may require long-term (>2 months) or very-long-term (>1 year) vascular access. Common themes for VAD selection in this heterogeneous population include a focus on vessel preservation and complication prevention.2 The panel strongly recommended that clinicians partner with the patient and caregivers in the decision-making process. Shared decision-making is necessary to meet both the short-term and evolving needs of the of the patient and family. The panel also believed the frequency of hospitalization should not be used as a criterion for VAD selection since acute hospitalization is an unreliable proxy for disease severity in pediatric chronic disease conditions.2 Rather, the infusate characteristics and length/intermittency of therapy should be primary influencers of VAD selection. In general, the panel rated cuffed tunneled central VADs (CVADs) as appropriate for all age groups for long-term PN, long-term continuous infusions, and long-term intermittent therapies. For continuous non-PN infusions, appropriate ratings were given to PICCs for infants and children and total implanted venous devices (TIVDs) in children and adolescents. For intermittent (but at least daily) access, TIVDs and PICC lines were both rated as appropriate for children and adolescents but uncertain for neonates and infants. Peripheral devices were deemed inappropriate for all long-term complex therapies. For children and adolescents needing intermittent, regular peripheral treatments (eg, steroids or antibiotics), peripheral IVs and TIVDs were rated appropriate for short duration (<7 days) therapies. PICCs and midlines for this indication were uncertain because of the lack of evidence. For medium-duration intermittent therapies (8-14 days), PICCs, tunneled cuffed CVADs, and TIVDs were rated as appropriate. A recently released mobile application can help guide the clinician through many varied clinical scenarios and indications.10
LIMITATIONS AND GAPS
The guideline recommendations were more often reliant on clinical practice guidelines and expert panel opinion given the lack of high-quality pediatric evidence for most scenarios. The panel members were from the United States and Australia, so the recommendations may not be generalizable to care systems in other countries. Although the panel included experts from many specialties that care for patient populations needing VADs, not all subspecialty populations were considered, particularly those with long-term vascular access–dependent conditions who may be commonly hospitalized. Scenarios with disagreement or uncertainty highlight gaps in need of future study (eg, midline catheter use and device selection for blood draws).
CONCLUSIONS AND APPLICATION
miniMAGIC is the first appropriateness guideline to help standardize the safe use of VADs in children. Although some gaps remain, the authors intend it to be a living document that will need revisions as new evidence is published. A mobile health application facilitates use of the recommendations, providing quick, point-of-care decision support based on clinical features.10 Pediatric hospitalists should collaborate with their institutions to examine their current VAD use in hospitalized children and identify opportunities for practice change and standardization. Use of these recommendations may help hospitalists improve the care of hospitalized children by decreasing unnecessary PICC placement and better partner with patients and caregivers to limit discomfort surrounding VAD placement.
1. Ullman AJ, Marsh N, Mihala G, Cooke M, Rickard CM. Complications of central venous access devices: a systematic review. Pediatrics. 2015;136(5):e1331-e1344. https://doi.org/10.1542/peds.2015-1507
2. Ullman AJ, Bernstein SJ, Brown E, et al. The Michigan appropriateness guide for intravenous catheters in pediatrics: miniMAGIC. Pediatrics. 2020;145(Suppl 3):S269-S284. https://doi.org/10.1542/peds.2019-3474I
3. Ullman AJ, Chopra V, Brown E, et al. Developing appropriateness criteria for pediatric vascular access. Pediatrics. 2020;145(Suppl 3):S233-S242. https://doi.org/10.1542/peds.2019-3474G
4. Paterson RS, Chopra V, Brown E, et al. Selection and insertion of vascular access devices in pediatrics: a systematic review. Pediatrics. 2020;145(Suppl 3):S243-S268. https://doi.org/10.1542/peds.2019-3474H
5. Keren R, Shah SS, Srivastava R, et al. Comparative effectiveness of intravenous vs oral antibiotics for postdischarge treatment of acute osteomeyelitis in children. JAMA Pediatr. 2015;169(2):120-128. https://doi.org/10.1001/jamapediatrics.2014.2822
6. Shah SS, Srivastava R, Wu S, et al. Intravenous versus oral antibiotics for postdischarge treatment of complicated pneumonia. Pediatrics. 2016;138(6):e20161692. https://doi.org/10.1542/peds.2016-1692
7. Rangel SJ, Anderson BR, Srivastava R, et al. Intravenous versus oral antibiotics for the prevention of treatment failure in children with complicated appendicitis: has the abandonment of peripherally inserted catheters been justified? Ann Surg. 2017;266(2):361-368. https://doi.org/10.1097/SLA.0000000000001923
8. Desai S, Aronson PL, Shabanova V, et al. Parenteral antibiotic therapy duration in young infants with bacteremic urinary tract infections. Pediatrics. 2019;144(3):e20183844. https://doi.org/10.1542/peds.2018-3844
9. Anderson J, Greenwell A, Louderback J, Polivka BJ, Herron Behr J. Comparison of outcomes of extended dwell/midline peripheral intravenous catheters and peripherally inserted central catheters in children. J Assoc Vasc Access. 2016;21(3):158-164. https://doi.org/10.1016/j.java.2016.03.007
10. miniMAGIC: the Michigan Appropriateness Guide for Intravenous Catheters in Pediatrics app. Version 1.0.0. Alliance for Vascular Access Teaching and Research.
11. Shaughnessy EE, Morton K, Shah SS. Vascular access in hospitalized children. Pediatrics. 2020;145(Suppl 3):S298-S299. https://doi.org/10.1542/peds.2019-3474P
1. Ullman AJ, Marsh N, Mihala G, Cooke M, Rickard CM. Complications of central venous access devices: a systematic review. Pediatrics. 2015;136(5):e1331-e1344. https://doi.org/10.1542/peds.2015-1507
2. Ullman AJ, Bernstein SJ, Brown E, et al. The Michigan appropriateness guide for intravenous catheters in pediatrics: miniMAGIC. Pediatrics. 2020;145(Suppl 3):S269-S284. https://doi.org/10.1542/peds.2019-3474I
3. Ullman AJ, Chopra V, Brown E, et al. Developing appropriateness criteria for pediatric vascular access. Pediatrics. 2020;145(Suppl 3):S233-S242. https://doi.org/10.1542/peds.2019-3474G
4. Paterson RS, Chopra V, Brown E, et al. Selection and insertion of vascular access devices in pediatrics: a systematic review. Pediatrics. 2020;145(Suppl 3):S243-S268. https://doi.org/10.1542/peds.2019-3474H
5. Keren R, Shah SS, Srivastava R, et al. Comparative effectiveness of intravenous vs oral antibiotics for postdischarge treatment of acute osteomeyelitis in children. JAMA Pediatr. 2015;169(2):120-128. https://doi.org/10.1001/jamapediatrics.2014.2822
6. Shah SS, Srivastava R, Wu S, et al. Intravenous versus oral antibiotics for postdischarge treatment of complicated pneumonia. Pediatrics. 2016;138(6):e20161692. https://doi.org/10.1542/peds.2016-1692
7. Rangel SJ, Anderson BR, Srivastava R, et al. Intravenous versus oral antibiotics for the prevention of treatment failure in children with complicated appendicitis: has the abandonment of peripherally inserted catheters been justified? Ann Surg. 2017;266(2):361-368. https://doi.org/10.1097/SLA.0000000000001923
8. Desai S, Aronson PL, Shabanova V, et al. Parenteral antibiotic therapy duration in young infants with bacteremic urinary tract infections. Pediatrics. 2019;144(3):e20183844. https://doi.org/10.1542/peds.2018-3844
9. Anderson J, Greenwell A, Louderback J, Polivka BJ, Herron Behr J. Comparison of outcomes of extended dwell/midline peripheral intravenous catheters and peripherally inserted central catheters in children. J Assoc Vasc Access. 2016;21(3):158-164. https://doi.org/10.1016/j.java.2016.03.007
10. miniMAGIC: the Michigan Appropriateness Guide for Intravenous Catheters in Pediatrics app. Version 1.0.0. Alliance for Vascular Access Teaching and Research.
11. Shaughnessy EE, Morton K, Shah SS. Vascular access in hospitalized children. Pediatrics. 2020;145(Suppl 3):S298-S299. https://doi.org/10.1542/peds.2019-3474P
© 2021 Society of Hospital Medicine
Trends in Use of Postdischarge Intravenous Antibiotic Therapy for Children
In recent years, mounting evidence has emerged questioning the practice of using prolonged intravenous antibiotic therapy to treat certain serious bacterial infections in children, including complicated appendicitis, osteomyelitis, and complicated pneumonia. Historically, treatment of these conditions was often completed intravenously after hospital discharge using peripherally inserted central catheters (PICCs). Line infections, clots, mechanical problems, and general discomfort complicate PICCs, which led to their removal in more than 20% of children in one study.1 Oral antibiotics avoid these complications and are less burdensome to families.2 Recently, a series of multicenter studies showed no difference in outcomes between oral and postdischarge intravenous antibiotic therapy (PD-IV) for complicated appendicitis, osteomyelitis, and complicated pneumonia.3-5
Despite a growing body of evidence suggesting that oral therapy ought to be the default treatment strategy rather than PD-IV, the extent to which practices have changed is unknown. In this study, we measured national trends in PD-IV use and variation by hospital for complicated appendicitis, osteomyelitis, and complicated pneumonia.
METHODS
We performed a retrospective cohort study of children discharged from hospitals that contributed data to the Pediatric Health Information System (PHIS) database from January 2000 through December 2018. PHIS is an administrative database of children’s hospitals managed by the Children’s Hospital Association (Lenexa, Kansas) and contains deidentified patient-level demographic data, discharge diagnosis and procedure codes, and detailed billing information, including medical supply charges.
The cohorts were defined using International Classification of Diseases, 9th and 10th Revisions (ICD-9 and ICD-10) discharge diagnosis and procedure codes. Patients admitted through September 2015 were identified using ICD-9 codes and patients admitted from October 2015 through December 2018 were identified using ICD-10 codes. The Centers for Medicaid & Medicare Services crosswalk was used to align ICD-9 and ICD-10 codes.6 Inclusion and exclusion criteria identifying cohorts of children hospitalized for complicated appendicitis, osteomyelitis, or complicated pneumonia were based on prior studies using the PHIS database.3-5 These studies augmented the PHIS administrative dataset with local chart review to identify patients from 2009-2012 with the following inclusion and exclusion criteria: Patients with complicated appendicitis were defined by a diagnosis code for acute appendicitis and a procedure code for appendectomy, with postoperative length of stay lasting between 3 and 7 days. Patients with osteomyelitis had a diagnosis code of acute or unspecified osteomyelitis with a hospital length of stay between 2 and 14 days. Patients with complicated pneumonia were defined by a diagnosis code for both pneumonia and pleural effusion with one of these as the primary diagnosis. Patients were excluded if they were older than 18 years or if they were younger than 2 months for osteomyelitis and complicated pneumonia or younger than 3 years for appendicitis. For all three conditions, children with a complex chronic condition7 were excluded. Only the index encounter meeting inclusion and exclusion criteria for each patient was included. PD-IV therapy was defined using procedure codes and hospital charges during the index hospitalization. This definition for PD-IV therapy has been validated among children with complicated pneumonia, demonstrating positive and negative predictive values for PICC exposure of 85% and 99%, respectively.8
Trends in the percentage of patients receiving PD-IV were adjusted for age, race, insurance type, intensive care unit days, and hospital-level case mix index with use of Poisson regression. Calculated risk ratios represent the change in PD-IV across the entire 19-year study period for each condition (as opposed to an annual rate of change). An inflection point for each condition was identified using piecewise linear regression in which the line slope has one value up to a point in time and a second value after that point. The transition point is determined by maximizing model fit.
Some hospitals were added to the database throughout the time period and therefore did not have data for all years of the study. To account for the possibility of a group of high– or low–PD-IV use hospitals entering the cohort and biasing the overall trend, we performed a sensitivity analysis restricted to hospitals continuously contributing data to PHIS every year between 2004 (when a majority of hospitals joined PHIS) and 2018. Significance testing for individual hospital trends was conducted among continuously contributing hospitals, with each hospital tested in the above Poisson model independently.
For the most recent year of 2018, we reported the distribution of adjusted percentages of PD-IV at the individual hospital level. Only hospitals with at least five patients for a given condition are included in the percent PD-IV calculations for 2018. To examine the extent to which an individual hospital might be a low– or high–PD-IV user across conditions, we divided hospitals into quartiles based on PD-IV use for each condition in 2017-2018 and calculated the percent of hospitals in the lowest- and highest-use quartiles for all three conditions. All statistics were performed using Stata 15 (StataCorp).
RESULTS
Among 52 hospitals over a 19-year study period, there were 60,575 hospitalizations for complicated appendicitis, 24,753 hospitalizations for osteomyelitis, and 13,700 hospitalizations for complicated pneumonia. From 2000 to 2018, PD-IV decreased from 13% to 2% (RR, 0.15; 95% CI, 0.14-0.16) for complicated appendicitis, from 61% to 22% (RR, 0.41; 95% CI, 0.39-0.43) for osteomyelitis, and from 29% to 19% (RR, 0.63; 95% CI, 0.58-0.69) for complicated pneumonia (Figure 1). The inflection points occurred in 2009 for complicated appendicitis, 2009 for complicated pneumonia, and 2010 for osteomyelitis. The sensitivity analysis included 31 hospitals that contributed data to PHIS for every year between 2004-2018 and revealed similar findings for all three conditions: Complicated appendicitis had an RR of 0.15 (95% CI, 0.14-0.17), osteomyelitis had an RR of 0.34 (95% CI, 0.32-0.36), and complicated pneumonia had an RR of 0.55 (95% CI, 0.49-0.61). Most individual hospitals decreased PD-IV use (complicated appendicitis: 21 decreased, 8 no change, 2 increased; osteomyelitis: 25 decreased, 6 no change; complicated pneumonia: 14 decreased, 16 no change, 1 increased). While overall decreases in PD-IV were observed for all three conditions, considerable variation remained in 2018 for use of PD-IV (Figure 2), particularly for osteomyelitis (median, 18%; interquartile range [IQR] 9%-40%) and complicated pneumonia (median, 13%; IQR, 3%-30%). In 2017-2018, 1 out of 52 hospitals was in the lowest PD-IV–use quartile for all three conditions, and three hospitals were in the highest-use quartile for all three conditions.
DISCUSSION
Over a 19-year period, we observed a national decline in use of PD-IV for three serious and common bacterial infections. The decline in PD-IV is notable given that it has occurred largely in the absence of nationally coordinated guidelines or improvement efforts. Despite the overall declines, substantial variation in the use of PD-IV for these conditions persists across children’s hospitals.
The observed decrease in PD-IV use is a natural example of deimplementation, the abandonment of medical practices found to be harmful or ineffective.9 What is most compelling about the deimplementation of PD-IV for these infectious conditions is the seemingly organic motivation that propelled it. Studies of physician practice patterns for interventions that have undergone evidence reversals demonstrate that physicians might readily implement new interventions with an early evidence base but be less willing to deimplement them when more definitive evidence later questions their efficacy.10 Therefore, concerted improvement efforts backed by national guidelines are often needed to reduce the use of a widely accepted medical practice. For example, as evidence questioning the efficacy of steroid use in bronchiolitis mounted,11 bronchiolitis guidelines recommended against steroid use12 and a national quality improvement effort led to reductions in exposure to steroids among patients hospitalized with bronchiolitis.13 Complicated intra-abdominal infection guidelines acknowledge oral antibiotic therapy as an option,14 but no such national guidelines or improvement projects exist for osteomyelitis or complicated pneumonia PD-IV.
What is it about PD-IV for complicated appendicitis, osteomyelitis, and complicated pneumonia that fostered the observed organic deimplementation? Our findings that few hospitals were in the top or bottom quartile of PD-IV across all three conditions suggest that the impetus to decrease PD-IV was not likely the product of a broad hospital-wide practice shift. Most deimplementation frameworks suggest that successful deimplementation must be supported by high-quality evidence that the intervention is not only ineffective, but also harmful.15 In this case, the inflection point for osteomyelitis occurred in 2009, the same year that the first large multicenter study suggesting efficacy and decreased complications of early oral therapy for osteomyelitis was published.16 A direct link between a publication and inflection points for complicated pneumonia and appendicitis is less clear. It is possible that growth of the field of pediatric hospital medicine,17 with a stated emphasis on healthcare value,18 played a role. Greater understanding of the drivers and barriers to deimplementation in this and similar contexts will be important.
Our study has some important limitations. While inclusion and exclusion criteria were consistent over the study period, practice patterns (ie, length of stay in uncomplicated patients) change and could alter the case-mix of patients over time. Additionally, the PHIS database largely comprises children’s hospitals, and the trends we observed in PD-IV may not generalize to community settings.
The degree of deimplementation of PD-IV observed across children’s hospitals is impressive, but opportunity for further improvement likely remains. We found that marked hospital-level variation in use of PD-IV still exists, with some hospitals almost never using PD-IV and others using it for most patients. While the ideal amount of PD-IV is probably not zero, a portion of the observed variation likely represents overuse of PD-IV. To reduce costs and complications associated with antibiotic therapy, national guidelines and a targeted national improvement collaborative may be necessary to achieve further reductions in PD-IV.
1. Jumani K, Advani S, Reich NG, Gosey L, Milstone AM. Risk factors for peripherally inserted central venous catheter complications in children. JAMA Pediatr. 2013;167(5):429-435. https://doi.org/10.1001/jamapediatrics.2013.775
2. Krah NM, Bardsley T, Nelson R, et al. Economic burden of home antimicrobial therapy: OPAT versus oral therapy. Hosp Pediatr. 2019;9(4):234-240. https://doi.org/10.1542/hpeds.2018-0193
3. Keren R, Shah SS, Srivastava R, et al. Comparative effectiveness of intravenous vs oral antibiotics for postdischarge treatment of acute osteomyelitis in children. JAMA Pediatr. 2015;169(2):120-128. https://doi.org/10.1001/jamapediatrics.2014.2822
4. Rangel SJ, Anderson BR, Srivastava R, et al. Intravenous versus oral antibiotics for the prevention of treatment failure in children with complicated appendicitis: has the abandonment of peripherally inserted catheters been justified? Ann Surg. 2017;266(2):361-368. https://doi.org/10.1097/SLA.0000000000001923
5. Shah SS, Srivastava R, Wu S, et al. Intravenous versus oral antibiotics for postdischarge treatment of complicated pneumonia. Pediatrics. 2016;138(6):e20161692. https://doi.org/10.1542/peds.2016-1692
6. Roth J. CMS’ ICD-9-CM to and from ICD-10-CM and ICD-10-PCS Crosswalk or General Equivalence Mappings. National Bureau of Economic Research. May 11, 2016. Accessed June 6, 2018. http://www.nber.org/data/icd9-icd-10-cm-and-pcs-crosswalk-general-equivalence-mapping.html
7. Feudtner C, Hays RM, Haynes G, Geyer JR, Neff JM, Koepsell TD. Deaths attributed to pediatric complex chronic conditions: national trends and implications for supportive care services. Pediatrics. 2001;107(6):E99. https://doi.org/10.1542/peds.107.6.e99
8. Coon ER, Srivastava R, Stoddard G, Wilkes J, Pavia AT, Shah SS. Shortened IV antibiotic course for uncomplicated, late-onset group B streptococcal bacteremia. Pediatrics. 2018;142(5):e20180345. https://doi.org/10.1542/peds.2018-0345
9. Niven DJ, Mrklas KJ, Holodinsky JK, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255. https://doi.org/10.1186/s12916-015-0488-z
10. Niven DJ, Rubenfeld GD, Kramer AA, Stelfox HT. Effect of published scientific evidence on glycemic control in adult intensive care units. JAMA Intern Med. 2015;175(5):801-809. https://doi.org/10.1001/jamainternmed.2015.0157
11. Fernandes RM, Bialy LM, Vandermeer B, et al. Glucocorticoids for acute viral bronchiolitis in infants and young children. Cochrane Database Syst Rev. 2013(6):CD004878. https://doi.org/10.1002/14651858.CD004878.pub4
12. Ralston SL, Lieberthal AS, Meissner HC, et al. Clinical practice guideline: the diagnosis, management, and prevention of bronchiolitis. Pediatrics. 2014;134(5):e1474-e1502. https://doi.org/10.1542/peds.2014-2742
13. Ralston SL, Garber MD, Rice-Conboy E, et al. A multicenter collaborative to reduce unnecessary care in inpatient bronchiolitis. Pediatrics. 2016;137(1):10. https://doi.org/10.1542/peds.2015-0851
14. Solomkin JS, Mazuski JE, Bradley JS, et al. Diagnosis and management of complicated intra-abdominal infection in adults and children: guidelines by the Surgical Infection Society and the Infectious Diseases Society of America. Clin Infect Dis. 2010;50(2):133-164. https://doi.org/10.1086/649554
15. Norton WE, Chambers DA, Kramer BS. Conceptualizing de-implementation in cancer care delivery. J Clin Oncol. 2019;37(2):93-96. https://doi.org/10.1200/JCO.18.00589
16. Zaoutis T, Localio AR, Leckerman K, Saddlemire S, Bertoch D, Keren R. Prolonged intravenous therapy versus early transition to oral antimicrobial therapy for acute osteomyelitis in children. Pediatrics. 2009;123(2):636-642. https://doi.org/10.1542/peds.2008-0596
17. Fisher ES. Pediatric hospital medicine: historical perspectives, inspired future. Curr Probl Pediatr Adolesc Health Care. 2012;42(5):107-112. https://doi.org/10.1016/j.cppeds.2012.01.001
18. Landrigan CP, Conway PH, Edwards S, Srivastava R. Pediatric hospitalists: a systematic review of the literature. Pediatrics. 2006;117(5):1736-1744. https://doi.org/10.1542/peds.2005-0609
In recent years, mounting evidence has emerged questioning the practice of using prolonged intravenous antibiotic therapy to treat certain serious bacterial infections in children, including complicated appendicitis, osteomyelitis, and complicated pneumonia. Historically, treatment of these conditions was often completed intravenously after hospital discharge using peripherally inserted central catheters (PICCs). Line infections, clots, mechanical problems, and general discomfort complicate PICCs, which led to their removal in more than 20% of children in one study.1 Oral antibiotics avoid these complications and are less burdensome to families.2 Recently, a series of multicenter studies showed no difference in outcomes between oral and postdischarge intravenous antibiotic therapy (PD-IV) for complicated appendicitis, osteomyelitis, and complicated pneumonia.3-5
Despite a growing body of evidence suggesting that oral therapy ought to be the default treatment strategy rather than PD-IV, the extent to which practices have changed is unknown. In this study, we measured national trends in PD-IV use and variation by hospital for complicated appendicitis, osteomyelitis, and complicated pneumonia.
METHODS
We performed a retrospective cohort study of children discharged from hospitals that contributed data to the Pediatric Health Information System (PHIS) database from January 2000 through December 2018. PHIS is an administrative database of children’s hospitals managed by the Children’s Hospital Association (Lenexa, Kansas) and contains deidentified patient-level demographic data, discharge diagnosis and procedure codes, and detailed billing information, including medical supply charges.
The cohorts were defined using International Classification of Diseases, 9th and 10th Revisions (ICD-9 and ICD-10) discharge diagnosis and procedure codes. Patients admitted through September 2015 were identified using ICD-9 codes and patients admitted from October 2015 through December 2018 were identified using ICD-10 codes. The Centers for Medicaid & Medicare Services crosswalk was used to align ICD-9 and ICD-10 codes.6 Inclusion and exclusion criteria identifying cohorts of children hospitalized for complicated appendicitis, osteomyelitis, or complicated pneumonia were based on prior studies using the PHIS database.3-5 These studies augmented the PHIS administrative dataset with local chart review to identify patients from 2009-2012 with the following inclusion and exclusion criteria: Patients with complicated appendicitis were defined by a diagnosis code for acute appendicitis and a procedure code for appendectomy, with postoperative length of stay lasting between 3 and 7 days. Patients with osteomyelitis had a diagnosis code of acute or unspecified osteomyelitis with a hospital length of stay between 2 and 14 days. Patients with complicated pneumonia were defined by a diagnosis code for both pneumonia and pleural effusion with one of these as the primary diagnosis. Patients were excluded if they were older than 18 years or if they were younger than 2 months for osteomyelitis and complicated pneumonia or younger than 3 years for appendicitis. For all three conditions, children with a complex chronic condition7 were excluded. Only the index encounter meeting inclusion and exclusion criteria for each patient was included. PD-IV therapy was defined using procedure codes and hospital charges during the index hospitalization. This definition for PD-IV therapy has been validated among children with complicated pneumonia, demonstrating positive and negative predictive values for PICC exposure of 85% and 99%, respectively.8
Trends in the percentage of patients receiving PD-IV were adjusted for age, race, insurance type, intensive care unit days, and hospital-level case mix index with use of Poisson regression. Calculated risk ratios represent the change in PD-IV across the entire 19-year study period for each condition (as opposed to an annual rate of change). An inflection point for each condition was identified using piecewise linear regression in which the line slope has one value up to a point in time and a second value after that point. The transition point is determined by maximizing model fit.
Some hospitals were added to the database throughout the time period and therefore did not have data for all years of the study. To account for the possibility of a group of high– or low–PD-IV use hospitals entering the cohort and biasing the overall trend, we performed a sensitivity analysis restricted to hospitals continuously contributing data to PHIS every year between 2004 (when a majority of hospitals joined PHIS) and 2018. Significance testing for individual hospital trends was conducted among continuously contributing hospitals, with each hospital tested in the above Poisson model independently.
For the most recent year of 2018, we reported the distribution of adjusted percentages of PD-IV at the individual hospital level. Only hospitals with at least five patients for a given condition are included in the percent PD-IV calculations for 2018. To examine the extent to which an individual hospital might be a low– or high–PD-IV user across conditions, we divided hospitals into quartiles based on PD-IV use for each condition in 2017-2018 and calculated the percent of hospitals in the lowest- and highest-use quartiles for all three conditions. All statistics were performed using Stata 15 (StataCorp).
RESULTS
Among 52 hospitals over a 19-year study period, there were 60,575 hospitalizations for complicated appendicitis, 24,753 hospitalizations for osteomyelitis, and 13,700 hospitalizations for complicated pneumonia. From 2000 to 2018, PD-IV decreased from 13% to 2% (RR, 0.15; 95% CI, 0.14-0.16) for complicated appendicitis, from 61% to 22% (RR, 0.41; 95% CI, 0.39-0.43) for osteomyelitis, and from 29% to 19% (RR, 0.63; 95% CI, 0.58-0.69) for complicated pneumonia (Figure 1). The inflection points occurred in 2009 for complicated appendicitis, 2009 for complicated pneumonia, and 2010 for osteomyelitis. The sensitivity analysis included 31 hospitals that contributed data to PHIS for every year between 2004-2018 and revealed similar findings for all three conditions: Complicated appendicitis had an RR of 0.15 (95% CI, 0.14-0.17), osteomyelitis had an RR of 0.34 (95% CI, 0.32-0.36), and complicated pneumonia had an RR of 0.55 (95% CI, 0.49-0.61). Most individual hospitals decreased PD-IV use (complicated appendicitis: 21 decreased, 8 no change, 2 increased; osteomyelitis: 25 decreased, 6 no change; complicated pneumonia: 14 decreased, 16 no change, 1 increased). While overall decreases in PD-IV were observed for all three conditions, considerable variation remained in 2018 for use of PD-IV (Figure 2), particularly for osteomyelitis (median, 18%; interquartile range [IQR] 9%-40%) and complicated pneumonia (median, 13%; IQR, 3%-30%). In 2017-2018, 1 out of 52 hospitals was in the lowest PD-IV–use quartile for all three conditions, and three hospitals were in the highest-use quartile for all three conditions.
DISCUSSION
Over a 19-year period, we observed a national decline in use of PD-IV for three serious and common bacterial infections. The decline in PD-IV is notable given that it has occurred largely in the absence of nationally coordinated guidelines or improvement efforts. Despite the overall declines, substantial variation in the use of PD-IV for these conditions persists across children’s hospitals.
The observed decrease in PD-IV use is a natural example of deimplementation, the abandonment of medical practices found to be harmful or ineffective.9 What is most compelling about the deimplementation of PD-IV for these infectious conditions is the seemingly organic motivation that propelled it. Studies of physician practice patterns for interventions that have undergone evidence reversals demonstrate that physicians might readily implement new interventions with an early evidence base but be less willing to deimplement them when more definitive evidence later questions their efficacy.10 Therefore, concerted improvement efforts backed by national guidelines are often needed to reduce the use of a widely accepted medical practice. For example, as evidence questioning the efficacy of steroid use in bronchiolitis mounted,11 bronchiolitis guidelines recommended against steroid use12 and a national quality improvement effort led to reductions in exposure to steroids among patients hospitalized with bronchiolitis.13 Complicated intra-abdominal infection guidelines acknowledge oral antibiotic therapy as an option,14 but no such national guidelines or improvement projects exist for osteomyelitis or complicated pneumonia PD-IV.
What is it about PD-IV for complicated appendicitis, osteomyelitis, and complicated pneumonia that fostered the observed organic deimplementation? Our findings that few hospitals were in the top or bottom quartile of PD-IV across all three conditions suggest that the impetus to decrease PD-IV was not likely the product of a broad hospital-wide practice shift. Most deimplementation frameworks suggest that successful deimplementation must be supported by high-quality evidence that the intervention is not only ineffective, but also harmful.15 In this case, the inflection point for osteomyelitis occurred in 2009, the same year that the first large multicenter study suggesting efficacy and decreased complications of early oral therapy for osteomyelitis was published.16 A direct link between a publication and inflection points for complicated pneumonia and appendicitis is less clear. It is possible that growth of the field of pediatric hospital medicine,17 with a stated emphasis on healthcare value,18 played a role. Greater understanding of the drivers and barriers to deimplementation in this and similar contexts will be important.
Our study has some important limitations. While inclusion and exclusion criteria were consistent over the study period, practice patterns (ie, length of stay in uncomplicated patients) change and could alter the case-mix of patients over time. Additionally, the PHIS database largely comprises children’s hospitals, and the trends we observed in PD-IV may not generalize to community settings.
The degree of deimplementation of PD-IV observed across children’s hospitals is impressive, but opportunity for further improvement likely remains. We found that marked hospital-level variation in use of PD-IV still exists, with some hospitals almost never using PD-IV and others using it for most patients. While the ideal amount of PD-IV is probably not zero, a portion of the observed variation likely represents overuse of PD-IV. To reduce costs and complications associated with antibiotic therapy, national guidelines and a targeted national improvement collaborative may be necessary to achieve further reductions in PD-IV.
In recent years, mounting evidence has emerged questioning the practice of using prolonged intravenous antibiotic therapy to treat certain serious bacterial infections in children, including complicated appendicitis, osteomyelitis, and complicated pneumonia. Historically, treatment of these conditions was often completed intravenously after hospital discharge using peripherally inserted central catheters (PICCs). Line infections, clots, mechanical problems, and general discomfort complicate PICCs, which led to their removal in more than 20% of children in one study.1 Oral antibiotics avoid these complications and are less burdensome to families.2 Recently, a series of multicenter studies showed no difference in outcomes between oral and postdischarge intravenous antibiotic therapy (PD-IV) for complicated appendicitis, osteomyelitis, and complicated pneumonia.3-5
Despite a growing body of evidence suggesting that oral therapy ought to be the default treatment strategy rather than PD-IV, the extent to which practices have changed is unknown. In this study, we measured national trends in PD-IV use and variation by hospital for complicated appendicitis, osteomyelitis, and complicated pneumonia.
METHODS
We performed a retrospective cohort study of children discharged from hospitals that contributed data to the Pediatric Health Information System (PHIS) database from January 2000 through December 2018. PHIS is an administrative database of children’s hospitals managed by the Children’s Hospital Association (Lenexa, Kansas) and contains deidentified patient-level demographic data, discharge diagnosis and procedure codes, and detailed billing information, including medical supply charges.
The cohorts were defined using International Classification of Diseases, 9th and 10th Revisions (ICD-9 and ICD-10) discharge diagnosis and procedure codes. Patients admitted through September 2015 were identified using ICD-9 codes and patients admitted from October 2015 through December 2018 were identified using ICD-10 codes. The Centers for Medicaid & Medicare Services crosswalk was used to align ICD-9 and ICD-10 codes.6 Inclusion and exclusion criteria identifying cohorts of children hospitalized for complicated appendicitis, osteomyelitis, or complicated pneumonia were based on prior studies using the PHIS database.3-5 These studies augmented the PHIS administrative dataset with local chart review to identify patients from 2009-2012 with the following inclusion and exclusion criteria: Patients with complicated appendicitis were defined by a diagnosis code for acute appendicitis and a procedure code for appendectomy, with postoperative length of stay lasting between 3 and 7 days. Patients with osteomyelitis had a diagnosis code of acute or unspecified osteomyelitis with a hospital length of stay between 2 and 14 days. Patients with complicated pneumonia were defined by a diagnosis code for both pneumonia and pleural effusion with one of these as the primary diagnosis. Patients were excluded if they were older than 18 years or if they were younger than 2 months for osteomyelitis and complicated pneumonia or younger than 3 years for appendicitis. For all three conditions, children with a complex chronic condition7 were excluded. Only the index encounter meeting inclusion and exclusion criteria for each patient was included. PD-IV therapy was defined using procedure codes and hospital charges during the index hospitalization. This definition for PD-IV therapy has been validated among children with complicated pneumonia, demonstrating positive and negative predictive values for PICC exposure of 85% and 99%, respectively.8
Trends in the percentage of patients receiving PD-IV were adjusted for age, race, insurance type, intensive care unit days, and hospital-level case mix index with use of Poisson regression. Calculated risk ratios represent the change in PD-IV across the entire 19-year study period for each condition (as opposed to an annual rate of change). An inflection point for each condition was identified using piecewise linear regression in which the line slope has one value up to a point in time and a second value after that point. The transition point is determined by maximizing model fit.
Some hospitals were added to the database throughout the time period and therefore did not have data for all years of the study. To account for the possibility of a group of high– or low–PD-IV use hospitals entering the cohort and biasing the overall trend, we performed a sensitivity analysis restricted to hospitals continuously contributing data to PHIS every year between 2004 (when a majority of hospitals joined PHIS) and 2018. Significance testing for individual hospital trends was conducted among continuously contributing hospitals, with each hospital tested in the above Poisson model independently.
For the most recent year of 2018, we reported the distribution of adjusted percentages of PD-IV at the individual hospital level. Only hospitals with at least five patients for a given condition are included in the percent PD-IV calculations for 2018. To examine the extent to which an individual hospital might be a low– or high–PD-IV user across conditions, we divided hospitals into quartiles based on PD-IV use for each condition in 2017-2018 and calculated the percent of hospitals in the lowest- and highest-use quartiles for all three conditions. All statistics were performed using Stata 15 (StataCorp).
RESULTS
Among 52 hospitals over a 19-year study period, there were 60,575 hospitalizations for complicated appendicitis, 24,753 hospitalizations for osteomyelitis, and 13,700 hospitalizations for complicated pneumonia. From 2000 to 2018, PD-IV decreased from 13% to 2% (RR, 0.15; 95% CI, 0.14-0.16) for complicated appendicitis, from 61% to 22% (RR, 0.41; 95% CI, 0.39-0.43) for osteomyelitis, and from 29% to 19% (RR, 0.63; 95% CI, 0.58-0.69) for complicated pneumonia (Figure 1). The inflection points occurred in 2009 for complicated appendicitis, 2009 for complicated pneumonia, and 2010 for osteomyelitis. The sensitivity analysis included 31 hospitals that contributed data to PHIS for every year between 2004-2018 and revealed similar findings for all three conditions: Complicated appendicitis had an RR of 0.15 (95% CI, 0.14-0.17), osteomyelitis had an RR of 0.34 (95% CI, 0.32-0.36), and complicated pneumonia had an RR of 0.55 (95% CI, 0.49-0.61). Most individual hospitals decreased PD-IV use (complicated appendicitis: 21 decreased, 8 no change, 2 increased; osteomyelitis: 25 decreased, 6 no change; complicated pneumonia: 14 decreased, 16 no change, 1 increased). While overall decreases in PD-IV were observed for all three conditions, considerable variation remained in 2018 for use of PD-IV (Figure 2), particularly for osteomyelitis (median, 18%; interquartile range [IQR] 9%-40%) and complicated pneumonia (median, 13%; IQR, 3%-30%). In 2017-2018, 1 out of 52 hospitals was in the lowest PD-IV–use quartile for all three conditions, and three hospitals were in the highest-use quartile for all three conditions.
DISCUSSION
Over a 19-year period, we observed a national decline in use of PD-IV for three serious and common bacterial infections. The decline in PD-IV is notable given that it has occurred largely in the absence of nationally coordinated guidelines or improvement efforts. Despite the overall declines, substantial variation in the use of PD-IV for these conditions persists across children’s hospitals.
The observed decrease in PD-IV use is a natural example of deimplementation, the abandonment of medical practices found to be harmful or ineffective.9 What is most compelling about the deimplementation of PD-IV for these infectious conditions is the seemingly organic motivation that propelled it. Studies of physician practice patterns for interventions that have undergone evidence reversals demonstrate that physicians might readily implement new interventions with an early evidence base but be less willing to deimplement them when more definitive evidence later questions their efficacy.10 Therefore, concerted improvement efforts backed by national guidelines are often needed to reduce the use of a widely accepted medical practice. For example, as evidence questioning the efficacy of steroid use in bronchiolitis mounted,11 bronchiolitis guidelines recommended against steroid use12 and a national quality improvement effort led to reductions in exposure to steroids among patients hospitalized with bronchiolitis.13 Complicated intra-abdominal infection guidelines acknowledge oral antibiotic therapy as an option,14 but no such national guidelines or improvement projects exist for osteomyelitis or complicated pneumonia PD-IV.
What is it about PD-IV for complicated appendicitis, osteomyelitis, and complicated pneumonia that fostered the observed organic deimplementation? Our findings that few hospitals were in the top or bottom quartile of PD-IV across all three conditions suggest that the impetus to decrease PD-IV was not likely the product of a broad hospital-wide practice shift. Most deimplementation frameworks suggest that successful deimplementation must be supported by high-quality evidence that the intervention is not only ineffective, but also harmful.15 In this case, the inflection point for osteomyelitis occurred in 2009, the same year that the first large multicenter study suggesting efficacy and decreased complications of early oral therapy for osteomyelitis was published.16 A direct link between a publication and inflection points for complicated pneumonia and appendicitis is less clear. It is possible that growth of the field of pediatric hospital medicine,17 with a stated emphasis on healthcare value,18 played a role. Greater understanding of the drivers and barriers to deimplementation in this and similar contexts will be important.
Our study has some important limitations. While inclusion and exclusion criteria were consistent over the study period, practice patterns (ie, length of stay in uncomplicated patients) change and could alter the case-mix of patients over time. Additionally, the PHIS database largely comprises children’s hospitals, and the trends we observed in PD-IV may not generalize to community settings.
The degree of deimplementation of PD-IV observed across children’s hospitals is impressive, but opportunity for further improvement likely remains. We found that marked hospital-level variation in use of PD-IV still exists, with some hospitals almost never using PD-IV and others using it for most patients. While the ideal amount of PD-IV is probably not zero, a portion of the observed variation likely represents overuse of PD-IV. To reduce costs and complications associated with antibiotic therapy, national guidelines and a targeted national improvement collaborative may be necessary to achieve further reductions in PD-IV.
1. Jumani K, Advani S, Reich NG, Gosey L, Milstone AM. Risk factors for peripherally inserted central venous catheter complications in children. JAMA Pediatr. 2013;167(5):429-435. https://doi.org/10.1001/jamapediatrics.2013.775
2. Krah NM, Bardsley T, Nelson R, et al. Economic burden of home antimicrobial therapy: OPAT versus oral therapy. Hosp Pediatr. 2019;9(4):234-240. https://doi.org/10.1542/hpeds.2018-0193
3. Keren R, Shah SS, Srivastava R, et al. Comparative effectiveness of intravenous vs oral antibiotics for postdischarge treatment of acute osteomyelitis in children. JAMA Pediatr. 2015;169(2):120-128. https://doi.org/10.1001/jamapediatrics.2014.2822
4. Rangel SJ, Anderson BR, Srivastava R, et al. Intravenous versus oral antibiotics for the prevention of treatment failure in children with complicated appendicitis: has the abandonment of peripherally inserted catheters been justified? Ann Surg. 2017;266(2):361-368. https://doi.org/10.1097/SLA.0000000000001923
5. Shah SS, Srivastava R, Wu S, et al. Intravenous versus oral antibiotics for postdischarge treatment of complicated pneumonia. Pediatrics. 2016;138(6):e20161692. https://doi.org/10.1542/peds.2016-1692
6. Roth J. CMS’ ICD-9-CM to and from ICD-10-CM and ICD-10-PCS Crosswalk or General Equivalence Mappings. National Bureau of Economic Research. May 11, 2016. Accessed June 6, 2018. http://www.nber.org/data/icd9-icd-10-cm-and-pcs-crosswalk-general-equivalence-mapping.html
7. Feudtner C, Hays RM, Haynes G, Geyer JR, Neff JM, Koepsell TD. Deaths attributed to pediatric complex chronic conditions: national trends and implications for supportive care services. Pediatrics. 2001;107(6):E99. https://doi.org/10.1542/peds.107.6.e99
8. Coon ER, Srivastava R, Stoddard G, Wilkes J, Pavia AT, Shah SS. Shortened IV antibiotic course for uncomplicated, late-onset group B streptococcal bacteremia. Pediatrics. 2018;142(5):e20180345. https://doi.org/10.1542/peds.2018-0345
9. Niven DJ, Mrklas KJ, Holodinsky JK, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255. https://doi.org/10.1186/s12916-015-0488-z
10. Niven DJ, Rubenfeld GD, Kramer AA, Stelfox HT. Effect of published scientific evidence on glycemic control in adult intensive care units. JAMA Intern Med. 2015;175(5):801-809. https://doi.org/10.1001/jamainternmed.2015.0157
11. Fernandes RM, Bialy LM, Vandermeer B, et al. Glucocorticoids for acute viral bronchiolitis in infants and young children. Cochrane Database Syst Rev. 2013(6):CD004878. https://doi.org/10.1002/14651858.CD004878.pub4
12. Ralston SL, Lieberthal AS, Meissner HC, et al. Clinical practice guideline: the diagnosis, management, and prevention of bronchiolitis. Pediatrics. 2014;134(5):e1474-e1502. https://doi.org/10.1542/peds.2014-2742
13. Ralston SL, Garber MD, Rice-Conboy E, et al. A multicenter collaborative to reduce unnecessary care in inpatient bronchiolitis. Pediatrics. 2016;137(1):10. https://doi.org/10.1542/peds.2015-0851
14. Solomkin JS, Mazuski JE, Bradley JS, et al. Diagnosis and management of complicated intra-abdominal infection in adults and children: guidelines by the Surgical Infection Society and the Infectious Diseases Society of America. Clin Infect Dis. 2010;50(2):133-164. https://doi.org/10.1086/649554
15. Norton WE, Chambers DA, Kramer BS. Conceptualizing de-implementation in cancer care delivery. J Clin Oncol. 2019;37(2):93-96. https://doi.org/10.1200/JCO.18.00589
16. Zaoutis T, Localio AR, Leckerman K, Saddlemire S, Bertoch D, Keren R. Prolonged intravenous therapy versus early transition to oral antimicrobial therapy for acute osteomyelitis in children. Pediatrics. 2009;123(2):636-642. https://doi.org/10.1542/peds.2008-0596
17. Fisher ES. Pediatric hospital medicine: historical perspectives, inspired future. Curr Probl Pediatr Adolesc Health Care. 2012;42(5):107-112. https://doi.org/10.1016/j.cppeds.2012.01.001
18. Landrigan CP, Conway PH, Edwards S, Srivastava R. Pediatric hospitalists: a systematic review of the literature. Pediatrics. 2006;117(5):1736-1744. https://doi.org/10.1542/peds.2005-0609
1. Jumani K, Advani S, Reich NG, Gosey L, Milstone AM. Risk factors for peripherally inserted central venous catheter complications in children. JAMA Pediatr. 2013;167(5):429-435. https://doi.org/10.1001/jamapediatrics.2013.775
2. Krah NM, Bardsley T, Nelson R, et al. Economic burden of home antimicrobial therapy: OPAT versus oral therapy. Hosp Pediatr. 2019;9(4):234-240. https://doi.org/10.1542/hpeds.2018-0193
3. Keren R, Shah SS, Srivastava R, et al. Comparative effectiveness of intravenous vs oral antibiotics for postdischarge treatment of acute osteomyelitis in children. JAMA Pediatr. 2015;169(2):120-128. https://doi.org/10.1001/jamapediatrics.2014.2822
4. Rangel SJ, Anderson BR, Srivastava R, et al. Intravenous versus oral antibiotics for the prevention of treatment failure in children with complicated appendicitis: has the abandonment of peripherally inserted catheters been justified? Ann Surg. 2017;266(2):361-368. https://doi.org/10.1097/SLA.0000000000001923
5. Shah SS, Srivastava R, Wu S, et al. Intravenous versus oral antibiotics for postdischarge treatment of complicated pneumonia. Pediatrics. 2016;138(6):e20161692. https://doi.org/10.1542/peds.2016-1692
6. Roth J. CMS’ ICD-9-CM to and from ICD-10-CM and ICD-10-PCS Crosswalk or General Equivalence Mappings. National Bureau of Economic Research. May 11, 2016. Accessed June 6, 2018. http://www.nber.org/data/icd9-icd-10-cm-and-pcs-crosswalk-general-equivalence-mapping.html
7. Feudtner C, Hays RM, Haynes G, Geyer JR, Neff JM, Koepsell TD. Deaths attributed to pediatric complex chronic conditions: national trends and implications for supportive care services. Pediatrics. 2001;107(6):E99. https://doi.org/10.1542/peds.107.6.e99
8. Coon ER, Srivastava R, Stoddard G, Wilkes J, Pavia AT, Shah SS. Shortened IV antibiotic course for uncomplicated, late-onset group B streptococcal bacteremia. Pediatrics. 2018;142(5):e20180345. https://doi.org/10.1542/peds.2018-0345
9. Niven DJ, Mrklas KJ, Holodinsky JK, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255. https://doi.org/10.1186/s12916-015-0488-z
10. Niven DJ, Rubenfeld GD, Kramer AA, Stelfox HT. Effect of published scientific evidence on glycemic control in adult intensive care units. JAMA Intern Med. 2015;175(5):801-809. https://doi.org/10.1001/jamainternmed.2015.0157
11. Fernandes RM, Bialy LM, Vandermeer B, et al. Glucocorticoids for acute viral bronchiolitis in infants and young children. Cochrane Database Syst Rev. 2013(6):CD004878. https://doi.org/10.1002/14651858.CD004878.pub4
12. Ralston SL, Lieberthal AS, Meissner HC, et al. Clinical practice guideline: the diagnosis, management, and prevention of bronchiolitis. Pediatrics. 2014;134(5):e1474-e1502. https://doi.org/10.1542/peds.2014-2742
13. Ralston SL, Garber MD, Rice-Conboy E, et al. A multicenter collaborative to reduce unnecessary care in inpatient bronchiolitis. Pediatrics. 2016;137(1):10. https://doi.org/10.1542/peds.2015-0851
14. Solomkin JS, Mazuski JE, Bradley JS, et al. Diagnosis and management of complicated intra-abdominal infection in adults and children: guidelines by the Surgical Infection Society and the Infectious Diseases Society of America. Clin Infect Dis. 2010;50(2):133-164. https://doi.org/10.1086/649554
15. Norton WE, Chambers DA, Kramer BS. Conceptualizing de-implementation in cancer care delivery. J Clin Oncol. 2019;37(2):93-96. https://doi.org/10.1200/JCO.18.00589
16. Zaoutis T, Localio AR, Leckerman K, Saddlemire S, Bertoch D, Keren R. Prolonged intravenous therapy versus early transition to oral antimicrobial therapy for acute osteomyelitis in children. Pediatrics. 2009;123(2):636-642. https://doi.org/10.1542/peds.2008-0596
17. Fisher ES. Pediatric hospital medicine: historical perspectives, inspired future. Curr Probl Pediatr Adolesc Health Care. 2012;42(5):107-112. https://doi.org/10.1016/j.cppeds.2012.01.001
18. Landrigan CP, Conway PH, Edwards S, Srivastava R. Pediatric hospitalists: a systematic review of the literature. Pediatrics. 2006;117(5):1736-1744. https://doi.org/10.1542/peds.2005-0609
© 2020 Society of Hospital Medicine
Variation in Printed Handoff Documents
Handoffs among hospital providers are highly error prone and can result in serious morbidity and mortality. Best practices for verbal handoffs have been described[1, 2, 3, 4] and include conducting verbal handoffs face to face, providing opportunities for questions, having the receiver perform a readback, as well as specific content recommendations including action items. Far less research has focused on best practices for printed handoff documents,[5, 6] despite the routine use of written handoff tools as a reference by on‐call physicians.[7, 8] Erroneous or outdated information on the written handoff can mislead on‐call providers, potentially leading to serious medical errors.
In their most basic form, printed handoff documents list patients for whom a provider is responsible. Typically, they also contain demographic information, reason for hospital admission, and a task list for each patient. They may also contain more detailed information on patient history, hospital course, and/or care plan, and may vary among specialties.[9] They come in various forms, ranging from index cards with handwritten notes, to word‐processor or spreadsheet documents, to printed documents that are autopopulated from the electronic health record (EHR).[2] Importantly, printed handoff documents supplement the verbal handoff by allowing receivers to follow along as patients are presented. The concurrent use of written and verbal handoffs may improve retention of clinical information as compared with either alone.[10, 11]
The Joint Commission requires an institutional approach to patient handoffs.[12] The requirements state that handoff communication solutions should take a standardized form, but they do not provide details regarding what data elements should be included in printed or verbal handoffs. Accreditation Council for Graduate Medical Education Common Program Requirements likewise require that residents must become competent in patient handoffs[13] but do not provide specific details or measurement tools. Absent widely accepted guidelines, decisions regarding which elements to include in printed handoff documents are currently made at an individual or institutional level.
The I‐PASS study is a federally funded multi‐institutional project that demonstrated a decrease in medical errors and preventable adverse events after implementation of a standardized resident handoff bundle.[14, 15] The I‐PASS Study Group developed a bundle of handoff interventions, beginning with a handoff and teamwork training program (based in part on TeamSTEPPS [Team Strategies and Tools to Enhance Performance and Patient Safety]),[16] a novel verbal mnemonic, I‐PASS (Illness Severity, Patient Summary, Action List, Situation Awareness and Contingency Planning, and Synthesis by Receiver),[17] and changes to the verbal handoff process, in addition to several other elements.
We hypothesized that developing a standardized printed handoff template would reinforce the handoff training and enhance the value of the verbal handoff process changes. Given the paucity of data on best printed handoff practices, however, we first conducted a needs assessment to identify which data elements were currently contained in printed handoffs across sites, and to allow an expert panel to make recommendations for best practices.
METHODS
I‐PASS Study sites included 9 pediatric residency programs at academic medical centers from across North America. Programs were identified through professional networks and invited to participate. The nonintensive care unit hospitalist services at these medical centers are primarily staffed by residents and medical students with attending supervision. At 1 site, nurse practitioners also participate in care. Additional details about study sites can be found in the study descriptions previously published.[14, 15] All sites received local institutional review board approval.
We began by inviting members of the I‐PASS Education Executive Committee (EEC)[14] to build a collective, comprehensive list of possible data elements for printed handoff documents. This committee included pediatric residency program directors, pediatric hospitalists, education researchers, health services researchers, and patient safety experts. We obtained sample handoff documents from pediatric hospitalist services at each of 9 institutions in the United States and Canada (with protected health information redacted). We reviewed these sample handoff documents to characterize their format and to determine what discrete data elements appeared in each site's printed handoff document. Presence or absence of each data element across sites was tabulated. We also queried sites to determine the feasibility of including elements that were not presently included.
Subsequently, I‐PASS site investigators led structured group interviews at participating sites to gather additional information about handoff practices at each site. These structured group interviews included diverse representation from residents, faculty, and residency program leadership, as well as hospitalists and medical students, to ensure the comprehensive acquisition of information regarding site‐specific characteristics. Each group provided answers to a standardized set of open‐ended questions that addressed current practices, handoff education, simulation use, team structure, and the nature of current written handoff tools, if applicable, at each site. One member of the structured group interview served as a scribe and created a document that summarized the content of the structured group interview meeting and answers to the standardized questions.
Consensus on Content
The initial data collection also included a multivote process[18] of the full I‐PASS EEC to help prioritize data elements. Committee members brainstormed a list of all possible data elements for a printed handoff document. Each member (n=14) was given 10 votes to distribute among the elements. Committee members could assign more than 1 vote to an element to emphasize its importance.
The results of this process as well as the current data elements included in each printed handoff tool were reviewed by a subgroup of the I‐PASS EEC. These expert panel members participated in a series of conference calls during which they tabulated categorical information, reviewed narrative comments, discussed existing evidence, and conducted simple content analysis to identify areas of concordance or discordance. Areas of discordance were discussed by the committee. Disagreements were resolved with group consensus with attention to published evidence or best practices, if available.
Elements were divided into those that were essential (unanimous consensus, no conflicting literature) and those that were recommended (majority supported inclusion of element, no conflicting literature). Ratings were assigned using the American College of Cardiology/American Heart Association framework for practice guidelines,[19] in which each element is assigned a classification (I=effective, II=conflicting evidence/opinion, III=not effective) and a level of evidence to support that classification (A=multiple large randomized controlled trials, B=single randomized trial, or nonrandomized studies, C=expert consensus).
The expert panel reached consensus, through active discussion, on a list of data elements that should be included in an ideal printed handoff document. Elements were chosen based on perceived importance, with attention to published best practices[1, 16] and the multivoting results. In making recommendations, consideration was given to whether data elements could be electronically imported into the printed handoff document from the EHR, or whether they would be entered manually. The potential for serious medical errors due to possible errors in manual entry of data was an important aspect of recommendations made. The list of candidate elements was then reviewed by a larger group of investigators from the I‐PASS Education Executive Committee and Coordinating Council for additional input.
The panel asked site investigators from each participating hospital to gather data on the feasibility of redesigning the printed handoff at that hospital to include each recommended element. Site investigators reported whether each element was already included, possible to include but not included currently, or not currently possible to include within that site's printed handoff tool. Site investigators also reported how data elements were populated in their handoff documents, with options including: (1) autopopulated from administrative data (eg, pharmacy‐entered medication list, demographic data entered by admitting office), (2) autoimported from physicians' free‐text entries elsewhere in the EHR (eg, progress notes), (3) free text entered specifically for the printed handoff, or (4) not applicable (element cannot be included).
RESULTS
Nine programs (100%) provided data on the structure and contents of their printed handoff documents. We found wide variation in structure across the 9 sites. Three sites used a word‐processorbased document that required manual entry of all data elements. The other 6 institutions had a direct link with the EHR to enable autopopulation of between 10 and 20 elements on the printed handoff document.
The content of written handoff documents, as well as the sources of data included in them (present or future), likewise varied substantially across sites (Table 1). Only 4 data elements (name, age, weight, and a list of medications) were universally included at all 9 sites. Among the 6 institutions that linked the printed handoff to the EHR, there was also substantial variation in which elements were autoimported. Only 7 elements were universally autoimported at these 6 sites: patient name, medical record number, room number, weight, date of birth, age, and date of admission. Two elements from the original brainstorming were not presently included in any sites' documents (emergency contact and primary language).
Data Elements | Sites With Data Element Included at Initial Needs Assessment (Out of Nine Sites) | Data Source (Current or Anticipated) | ||
---|---|---|---|---|
Autoimported* | Manually Entered | Not Applicable | ||
| ||||
Name | 9 | 6 | 3 | 0 |
Medical record number | 8 | 6 | 3 | 0 |
Room number | 8 | 6 | 3 | 0 |
Allergies | 6 | 4 | 5 | 0 |
Weight | 9 | 6 | 3 | 0 |
Age | 9 | 6 | 3 | 0 |
Date of birth | 6 | 6 | 3 | 0 |
Admission date | 8 | 6 | 3 | 0 |
Attending name | 5 | 4 | 5 | 0 |
Team/service | 7 | 4 | 5 | 0 |
Illness severity | 1 | 0 | 9 | 0 |
Patient summary | 8 | 0 | 9 | 0 |
Action items | 8 | 0 | 9 | 0 |
Situation monitoring/contingency plan | 5 | 0 | 9 | 0 |
Medication name | 9 | 4 | 5 | 0 |
Medication name and dose/route/frequency | 4 | 4 | 5 | 0 |
Code status | 2 | 2 | 7 | 0 |
Labs | 6 | 5 | 4 | 0 |
Access | 2 | 2 | 7 | 0 |
Ins/outs | 2 | 4 | 4 | 1 |
Primary language | 0 | 3 | 6 | 0 |
Vital signs | 3 | 4 | 4 | 1 |
Emergency contact | 0 | 2 | 7 | 0 |
Primary care provider | 4 | 4 | 5 | 0 |
Nine institutions (100%) conducted structured group interviews, ranging in size from 4 to 27 individuals with a median of 5 participants. The documents containing information from each site were provided to the authors. The authors then tabulated categorical information, reviewed narrative comments to understand current institutional practices, and conducted simple content analysis to identify areas of concordance or discordance, particularly with respect to data elements and EHR usage. Based on the results of the printed handoff document review and structured group interviews, with additional perspectives provided by the I‐PASS EEC, the expert panel came to consensus on a list of 23 elements that should be included in printed handoff documents, including 15 essential data elements and 8 additional recommended elements (Table 2).
|
Essential Elements |
Patient identifiers |
Patient name (class I, level of evidence C) |
Medical record number (class I, level of evidence C) |
Date of birth (class I, level of evidence C) |
Hospital service identifiers |
Attending name (class I, level of evidence C) |
Team/service (class I, level of evidence C) |
Room number (class I, level of evidence C) |
Admission date (class I, level of evidence C) |
Age (class I, level of evidence C) |
Weight (class I, level of evidence C) |
Illness severity (class I, level of evidence B)[20, 21] |
Patient summary (class I, level of evidence B)[21, 22] |
Action items (class I, level of evidence B) [21, 22] |
Situation awareness/contingency planning (class I, level of evidence B) [21, 22] |
Allergies (class I, level of evidence C) |
Medications |
Autopopulation of medications (class I, level of evidence B)[22, 23, 24] |
Free‐text entry of medications (class IIa, level of evidence C) |
Recommended elements |
Primary language (class IIa, level of evidence C) |
Emergency contact (class IIa, level of evidence C) |
Primary care provider (class IIa, level of evidence C) |
Code status (class IIb, level of evidence C) |
Labs (class IIa, level of evidence C) |
Access (class IIa, level of evidence C) |
Ins/outs (class IIa, level of evidence C) |
Vital signs (class IIa, level of evidence C) |
Evidence ratings[19] of these elements are included. Several elements are classified as I‐B (effective, nonrandomized studies) based on either studies of individual elements, or greater than 1 study of bundled elements that could reasonably be extrapolated. These include Illness severity,[20, 21] patient summary,[21, 22] action items[21, 22] (to do lists), situation awareness and contingency plan,[21, 22] and medications[22, 23, 24] with attention to importing from the EHR. Medications entered as free text were classified as IIa‐C because of risk and potential significance of errors; in particular there was concern that transcription errors, errors of omission, or errors of commission could potentially lead to patient harms. The remaining essential elements are classified as I‐C (effective, expert consensus). Of note, date of birth was specifically included as a patient identifier, distinct from age, which was felt to be useful as a descriptor (often within a one‐liner or as part of the patient summary).
The 8 recommended elements were elements for which there was not unanimous agreement on inclusion, but the majority of the panel felt they should be included. These elements were classified as IIa‐C, with 1 exception. Code status generated significant controversy among the group. After extensive discussion among the group and consideration of safety, supervision, educational, and pediatric‐specific considerations, all members of the group agreed on the categorization as a recommended element; it is classified as IIb‐C.
All members of the group agreed that data elements should be directly imported from the EHR whenever possible. Finally, members agreed that the elements that make up the I‐PASS mnemonic (illness severity, patient summary, action items, situation awareness/contingency planning) should be listed in that order whenever possible. A sample I‐PASS‐compliant printed handoff document is shown Figure 1.
DISCUSSION
We identified substantial variability in the structure and content of printed handoff documents used by 9 pediatric hospitalist teaching services, reflective of a lack of standardization. We found that institutional printed handoff documents shared some demographic elements (eg, name, room, medical record number) but also varied in clinical content (eg, vital signs, lab tests, code status). Our expert panel developed a list of 15 essential and 8 recommended data elements for printed handoff documents. Although this is a large number of fields, the majority of the essential fields were already included by most sites, and many are basic demographic identifiers. Illness severity is the 1 essential field that was not routinely included; however, including this type of overview is consistently recommended[2, 4] and supported by evidence,[20, 21] and contributes to building a shared mental model.[16] We recommend the categories of stable/watcher/unstable.[17]
Several prior single‐center studies have found that introducing a printed handoff document can lead to improvements in workflow, communication, and patient safety. In an early study, Petersen et al.[25] showed an association between use of a computerized sign‐out program and reduced odds of preventable adverse events during periods of cross‐coverage. Wayne et al.[26] reported fewer perceived inaccuracies in handoff documents as well as improved clarity at the time of transfer, supporting the role for standardization. Van Eaton et al.[27] demonstrated rapid uptake and desirability of a computerized handoff document, which combined autoimportation of information from an EHR with resident‐entered patient details, reflecting the importance of both data sources. In addition, they demonstrated improvements in both the rounding and sign‐out processes.[28]
Two studies specifically reported the increased use of specific fields after implementation. Payne et al. implemented a Web‐based handoff tool and documented significant increases in the number of handoffs containing problem lists, medication lists, and code status, accompanied by perceived improvements in quality of handoffs and fewer near‐miss events.[24] Starmer et al. found that introduction of a resident handoff bundle that included a printed handoff tool led to reduction in medical errors and adverse events.[22] The study group using the tool populated 11 data elements more often after implementation, and introduction of this printed handoff tool in particular was associated with reductions in written handoff miscommunications. Neither of these studies included subanalysis to indicate which data elements may have been most important.
In contrast to previous single‐institution studies, our recommendations for a printed handoff template come from evaluations of tools and discussions with front line providers across 9 institutions. We had substantial overlap with data elements recommended by Van Eaton et al.[27] However, there were several areas in which we did not have overlap with published templates including weight, ins/outs, primary language, emergency contact information, or primary care provider. Other published handoff tools have been highly specialized (eg, for cardiac intensive care) or included many fewer data elements than our group felt were essential. These differences may reflect the unique aspects of caring for pediatric patients (eg, need for weights) and the absence of defined protocols for many pediatric conditions. In addition, the level of detail needed for contingency planning may vary between teaching and nonteaching services.
Resident physicians may provide valuable information in the development of standardized handoff documents. Clark et al.,[29] at Virginia Mason University, utilized resident‐driven continuous quality improvement processes including real‐time feedback to implement an electronic template. They found that engagement of both senior leaders and front‐line users was an important component of their success in uptake. Our study utilized residents as essential members of structured group interviews to ensure that front‐line users' needs were represented as recommendations for a printed handoff tool template were developed.
As previously described,[17] our study group had identified several key data elements that should be included in verbal handoffs: illness severity, a patient summary, a discrete action list, situation awareness/contingency planning, and a synthesis by receiver. With consideration of the multivoting results as well as known best practices,[1, 4, 12] the expert panel for this study agreed that each of these elements should also be highlighted in the printed template to ensure consistency between the printed document and the verbal handoff, and to have each reinforce the other. On the printed handoff tool, the final S in the I‐PASS mnemonic (synthesis by receiver) cannot be prepopulated, but considering the importance of this step,[16, 30, 31, 32] it should be printed as synthesis by receiver to serve as a text‐reminder to both givers and receivers.
The panel also felt, however, that the printed handoff document should provide additional background information not routinely included in a verbal handoff. It should serve as a reference tool both at the time of verbal handoff and throughout the day and night, and therefore should include more comprehensive information than is necessary or appropriate to convey during the verbal handoff. We identified 10 data elements that are essential in a printed handoff document in addition to the I‐PASS elements (Table 2).
Patient demographic data elements, as well as team assignments and attending physician, were uniformly supported for inclusion. The medication list was viewed as essential; however, the panel also recognized the potential for medical errors due to inaccuracies in the medication list. In particular, there was concern that including all fields of a medication order (drug, dose, route, frequency) would result in handoffs containing a high proportion of inaccurate information, particularly for complex patients whose medication regimens may vary over the course of hospitalization. Therefore, the panel agreed that if medication lists were entered manually, then only the medication name should be included as they did not wish to perpetuate inaccurate or potentially harmful information. If medication lists were autoimported from an EHR, then they should include drug name, dose, route, and frequency if possible.
In the I‐PASS study,[15] all institutions implemented printed handoff documents that included fields for the essential data elements. After implementation, there was a significant increase in completion of all essential fields. Although there is limited evidence to support any individual data element, increased usage of these elements was associated with the overall study finding of decreased rates of medical errors and preventable adverse events.
EHRs have the potential to help standardize printed handoff documents[5, 6, 33, 34, 35]; all participants in our study agreed that printed handoff documents should ideally be linked with the EHR and should autoimport data wherever appropriate. Manually populated (eg, word processor‐ or spreadsheet‐based) handoff tools have important limitations, particularly related to the potential for typographical errors as well as accidental omission of data fields, and lead to unnecessary duplication of work (eg, re‐entering data already included in a progress note) that can waste providers' time. It was also acknowledged that word processor‐ or spreadsheet‐based documents may have flexibility that is lacking in EHR‐based handoff documents. For example, formatting can more easily be adjusted to increase the number of patients per printed page. As technology advances, printed documents may be phased out in favor of EHR‐based on‐screen reports, which by their nature would be more accurate due to real‐time autoupdates.
In making recommendations about essential versus recommended items for inclusion in the printed handoff template, the only data element that generated controversy among our experts was code status. Some felt that it should be included as an essential element, whereas others did not. We believe that this was unique to our practice in pediatric hospital ward settings, as codes in most pediatric ward settings are rare. Among the concerns expressed with including code status for all patients were that residents might assume patients were full‐code without verifying. The potential inaccuracy created by this might have severe implications. Alternatively, residents might feel obligated to have code discussions with all patients regardless of severity of illness, which may be inappropriate in a pediatric population. Several educators expressed concerns about trainees having unsupervised code‐status conversations with families of pediatric patients. Conversely, although codes are rare in pediatric ward settings, concerns were raised that not including code status could be problematic during these rare but critically important events. Other fields, such as weight, might have less relevance for an adult population in which emergency drug doses are standardized.
Limitations
Our study has several limitations. We only collected data from hospitalist services at pediatric sites. It is likely that providers in other specialties would have specific data elements they felt were essential (eg, postoperative day, code status). Our methodology was expert consensus based, driven by data collection from sites that were already participating in the I‐PASS study. Although the I‐PASS study demonstrated decreased rates of medical errors and preventable adverse events with inclusion of these data elements as part of a bundle, future research will be required to evaluate whether some of these items are more important than others in improving written communication and ultimately patient safety. In spite of these limitations, our work represents an important starting point for the development of standards for written handoff documents that should be used in patient handoffs, particularly those generated from EHRs.
CONCLUSIONS
In this article we describe the results of a needs assessment that informed expert consensus‐based recommendations for data elements to include in a printed handoff document. We recommend that pediatric programs include the elements identified as part of a standardized written handoff tool. Although many of these elements are also applicable to other specialties, future work should be conducted to adapt the printed handoff document elements described here for use in other specialties and settings. Future studies should work to validate the importance of these elements, studying the manner in which their inclusion affects the quality of written handoffs, and ultimately patient safety.
Acknowledgements
Members of the I‐PASS Study Education Executive Committee who contributed to this manuscript include: Boston Children's Hospital/Harvard Medical School (primary site) (Christopher P. Landrigan, MD, MPH, Elizabeth L. Noble, BA. Theodore C. Sectish, MD. Lisa L. Tse, BA). Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine (Jennifer K. O'Toole, MD, MEd). Doernbecher Children's Hospital/Oregon Health and Science University (Amy J. Starmer, MD, MPH). Hospital for Sick Children/University of Toronto (Zia Bismilla, MD. Maitreya Coffey, MD). Lucile Packard Children's Hospital/Stanford University (Lauren A. Destino, MD. Jennifer L. Everhart, MD. Shilpa J. Patel, MD [currently at Kapi'olani Children's Hospital/University of Hawai'i School of Medicine]). National Capital Consortium (Jennifer H. Hepps, MD. Joseph O. Lopreiato, MD, MPH. Clifton E. Yu, MD). Primary Children's Medical Center/University of Utah (James F. Bale, Jr., MD. Adam T. Stevenson, MD). St. Louis Children's Hospital/Washington University (F. Sessions Cole, MD). St. Christopher's Hospital for Children/Drexel University College of Medicine (Sharon Calaman, MD. Nancy D. Spector, MD). Benioff Children's Hospital/University of California San Francisco School of Medicine (Glenn Rosenbluth, MD. Daniel C. West, MD).
Additional I‐PASS Study Group members who contributed to this manuscript include April D. Allen, MPA, MA (Heller School for Social Policy and Management, Brandeis University, previously affiliated with Boston Children's Hospital), Madelyn D. Kahana, MD (The Children's Hospital at Montefiore/Albert Einstein College of Medicine, previously affiliated with Lucile Packard Children's Hospital/Stanford University), Robert S. McGregor, MD (Akron Children's Hospital/Northeast Ohio Medical University, previously affiliated with St. Christopher's Hospital for Children/Drexel University), and John S. Webster, MD, MBA, MS (Webster Healthcare Consulting Inc., formerly of the Department of Defense).
Members of the I‐PASS Study Group include individuals from the institutions listed below as follows: Boston Children's Hospital/Harvard Medical School (primary site): April D. Allen, MPA, MA (currently at Heller School for Social Policy and Management, Brandeis University), Angela M. Feraco, MD, Christopher P. Landrigan, MD, MPH, Elizabeth L. Noble, BA, Theodore C. Sectish, MD, Lisa L. Tse, BA. Brigham and Women's Hospital (data coordinating center): Anuj K. Dalal, MD, Carol A. Keohane, BSN, RN, Stuart Lipsitz, PhD, Jeffrey M. Rothschild, MD, MPH, Matt F. Wien, BS, Catherine S. Yoon, MS, Katherine R. Zigmont, BSN, RN. Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine: Javier Gonzalez del Rey, MD, MEd, Jennifer K. O'Toole, MD, MEd, Lauren G. Solan, MD. Doernbecher Children's Hospital/Oregon Health and Science University: Megan E. Aylor, MD, Amy J. Starmer, MD, MPH, Windy Stevenson, MD, Tamara Wagner, MD. Hospital for Sick Children/University of Toronto: Zia Bismilla, MD, Maitreya Coffey, MD, Sanjay Mahant, MD, MSc. Lucile Packard Children's Hospital/Stanford University: Rebecca L. Blankenburg, MD, MPH, Lauren A. Destino, MD, Jennifer L. Everhart, MD, Madelyn Kahana, MD, Shilpa J. Patel, MD (currently at Kapi'olani Children's Hospital/University of Hawaii School of Medicine). National Capital Consortium: Jennifer H. Hepps, MD, Joseph O. Lopreiato, MD, MPH, Clifton E. Yu, MD. Primary Children's Hospital/University of Utah: James F. Bale, Jr., MD, Jaime Blank Spackman, MSHS, CCRP, Rajendu Srivastava, MD, FRCP(C), MPH, Adam Stevenson, MD. St. Louis Children's Hospital/Washington University: Kevin Barton, MD, Kathleen Berchelmann, MD, F. Sessions Cole, MD, Christine Hrach, MD, Kyle S. Schultz, MD, Michael P. Turmelle, MD, Andrew J. White, MD. St. Christopher's Hospital for Children/Drexel University: Sharon Calaman, MD, Bronwyn D. Carlson, MD, Robert S. McGregor, MD (currently at Akron Children's Hospital/Northeast Ohio Medical University), Vahideh Nilforoshan, MD, Nancy D. Spector, MD. and Benioff Children's Hospital/University of California San Francisco School of Medicine: Glenn Rosenbluth, MD, Daniel C. West, MD. Dorene Balmer, PhD, RD, Carol L. Carraccio, MD, MA, Laura Degnon, CAE, and David McDonald, and Alan Schwartz PhD serve the I‐PASS Study Group as part of the IIPE. Karen M. Wilson, MD, MPH serves the I‐PASS Study Group as part of the advisory board from the PRIS Executive Council. John Webster served the I‐PASS Study Group and Education Executive Committee as a representative from TeamSTEPPS.
Disclosures: The I‐PASS Study was primarily supported by the US Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evaluation (1R18AE000029‐01). The opinions and conclusions expressed herein are solely those of the author(s) and should not be constructed as representing the opinions or policy of any agency of the federal government. Developed with input from the Initiative for Innovation in Pediatric Education and the Pediatric Research in Inpatient Settings Network (supported by the Children's Hospital Association, the Academic Pediatric Association, the American Academy of Pediatrics, and the Society of Hospital Medicine). A. J. S. was supported by the Agency for Healthcare Research and Quality/Oregon Comparative Effectiveness Research K12 Program (1K12HS019456‐01). Additional funding for the I‐PASS Study was provided by the Medical Research Foundation of Oregon, Physician Services Incorporated Foundation (Ontario, Canada), and Pfizer (unrestricted medical education grant to N.D.S.). C.P.L, A.J.S. were supported by the Oregon Comparative Effectiveness Research K12 Program (1K12HS019456 from the Agency for Healthcare Research and Quality). A.J.S. was also supported by the Medical Research Foundation of Oregon. The authors report no conflicts of interest.
- Handoff strategies in settings with high consequences for failure: lessons for health care operations. Int J Qual Health Care. 2004;16(2):125–132. , , , , .
- Managing discontinuity in academic medical centers: strategies for a safe and effective resident sign‐out. J Hosp Med. 2006;1(4):257–266. , , , , .
- Development and implementation of an oral sign‐out skills curriculum. J Gen Intern Med. 2007;22(10):1470–1474. , , .
- Hospitalist handoffs: a systematic review and task force recommendations. J Hosp Med. 2009;4(7):433–440. , , , , , .
- A systematic review of the literature on the evaluation of handoff tools: implications for research and practice. J Am Med Inform Assoc. 2014;21(1):154–162. , , .
- Review of computerized physician handoff tools for improving the quality of patient care. J Hosp Med. 2013;8(8):456–463. , , , , .
- Answering questions on call: pediatric resident physicians' use of handoffs and other resources. J Hosp Med. 2013;8(6):328–333. , , , , .
- Effectiveness of written hospitalist sign‐outs in answering overnight inquiries. J Hosp Med. 2013;8(11):609–614. , , , .
- Sign‐out snapshot: cross‐sectional evaluation of written sign‐outs among specialties. BMJ Qual Saf. 2014;23(1):66–72. , , .
- An experimental comparison of handover methods. Ann R Coll Surg Engl. 2007;89(3):298–300. , , , .
- Pilot study to show the loss of important data in nursing handover. Br J Nurs. 2005;14(20):1090–1093. , , , .
- The Joint Commission. Hospital Accreditation Standards 2015: Joint Commission Resources; 2015:PC.02.02.01.
- Accreditation Council for Graduate Medical Education. Common Program Requirements. 2013; http://acgme.org/acgmeweb/tabid/429/ProgramandInstitutionalAccreditation/CommonProgramRequirements.aspx. Accessed May 11, 2015.
- Establishing a multisite education and research project requires leadership, expertise, collaboration, and an important aim. Pediatrics. 2010;126(4):619–622. , , , .
- Changes in medical errors after implementation of a handoff program. N Engl J Med. 2014;371(19):1803–1812. , , , et al.
- US Department of Health and Human Services. Agency for Healthcare Research and Quality. TeamSTEPPS website. Available at: http://teamstepps.ahrq.gov/. Accessed July 12, 2013.
- I‐PASS, a mnemonic to standardize verbal handoffs. Pediatrics. 2012;129(2):201–204. , , , , , .
- The Team Handbook. 3rd ed. Middleton, WI: Oriel STAT A MATRIX; 2010. , , .
- ACC/AHA Task Force on Practice Guidelines. Methodology Manual and Policies From the ACCF/AHA Task Force on Practice Guidelines. Available at: http://my.americanheart.org/idc/groups/ahamah‐public/@wcm/@sop/documents/downloadable/ucm_319826.pdf. Published June 2010. Accessed January 11, 2015.
- Effect of illness severity and comorbidity on patient safety and adverse events. Am J Med Qual. 2012;27(1):48–57. , , , et al.
- Consequences of inadequate sign‐out for patient care. Arch Intern Med. 2008;168(16):1755–1760. , , , , .
- Rates of medical errors and preventable adverse events among hospitalized children following implementation of a resident handoff bundle. JAMA. 2013;310(21):2262–2270. , , , et al.
- Medication discrepancies in resident sign‐outs and their potential to harm. J Gen Intern Med. 2007;22(12):1751–1755. , , , , .
- Avoiding handover fumbles: a controlled trial of a structured handover tool versus traditional handover methods. BMJ Qual Saf. 2012;21(11):925–932. , , , .
- Using a computerized sign‐out program to improve continuity of inpatient care and prevent adverse events. Jt Comm J Qual Improv. 1998;24(2):77–87. , , , , .
- Simple standardized patient handoff system that increases accuracy and completeness. J Surg Educ. 2008;65(6):476–485. , , , et al.
- Organizing the transfer of patient care information: the development of a computerized resident sign‐out system. Surgery. 2004;136(1):5–13. , , , .
- A randomized, controlled trial evaluating the impact of a computerized rounding and sign‐out system on continuity of care and resident work hours. J Am Coll Surg. 2005;200(4):538–545. , , , , .
- Template for success: using a resident‐designed sign‐out template in the handover of patient care. J Surg Educ. 2011;68(1):52–57. , , .
- Read‐back improves information transfer in simulated clinical crises. BMJ Qual Saf. 2014;23(12):989–993. , , , , , .
- Interns overestimate the effectiveness of their hand‐off communication. Pediatrics. 2010;125(3):491–496. , , , , .
- Improving patient safety by repeating (read‐back) telephone reports of critical information. Am J Clin Pathol. 2004;121(6):801–803. , , , , , .
- Content overlap in nurse and physician handoff artifacts and the potential role of electronic health records: a systematic review. J Biomed Inform. 2011;44(4):704–712. , , , , .
- Clinical summarization capabilities of commercially‐available and internally‐developed electronic health records. Appl Clin Inform. 2012;3(1):80–93. , , , .
- An analysis and recommendations for multidisciplinary computerized handoff applications in hospitals. AMIA Annu Symp Proc. 2011;2011:588–597. , .
Handoffs among hospital providers are highly error prone and can result in serious morbidity and mortality. Best practices for verbal handoffs have been described[1, 2, 3, 4] and include conducting verbal handoffs face to face, providing opportunities for questions, having the receiver perform a readback, as well as specific content recommendations including action items. Far less research has focused on best practices for printed handoff documents,[5, 6] despite the routine use of written handoff tools as a reference by on‐call physicians.[7, 8] Erroneous or outdated information on the written handoff can mislead on‐call providers, potentially leading to serious medical errors.
In their most basic form, printed handoff documents list patients for whom a provider is responsible. Typically, they also contain demographic information, reason for hospital admission, and a task list for each patient. They may also contain more detailed information on patient history, hospital course, and/or care plan, and may vary among specialties.[9] They come in various forms, ranging from index cards with handwritten notes, to word‐processor or spreadsheet documents, to printed documents that are autopopulated from the electronic health record (EHR).[2] Importantly, printed handoff documents supplement the verbal handoff by allowing receivers to follow along as patients are presented. The concurrent use of written and verbal handoffs may improve retention of clinical information as compared with either alone.[10, 11]
The Joint Commission requires an institutional approach to patient handoffs.[12] The requirements state that handoff communication solutions should take a standardized form, but they do not provide details regarding what data elements should be included in printed or verbal handoffs. Accreditation Council for Graduate Medical Education Common Program Requirements likewise require that residents must become competent in patient handoffs[13] but do not provide specific details or measurement tools. Absent widely accepted guidelines, decisions regarding which elements to include in printed handoff documents are currently made at an individual or institutional level.
The I‐PASS study is a federally funded multi‐institutional project that demonstrated a decrease in medical errors and preventable adverse events after implementation of a standardized resident handoff bundle.[14, 15] The I‐PASS Study Group developed a bundle of handoff interventions, beginning with a handoff and teamwork training program (based in part on TeamSTEPPS [Team Strategies and Tools to Enhance Performance and Patient Safety]),[16] a novel verbal mnemonic, I‐PASS (Illness Severity, Patient Summary, Action List, Situation Awareness and Contingency Planning, and Synthesis by Receiver),[17] and changes to the verbal handoff process, in addition to several other elements.
We hypothesized that developing a standardized printed handoff template would reinforce the handoff training and enhance the value of the verbal handoff process changes. Given the paucity of data on best printed handoff practices, however, we first conducted a needs assessment to identify which data elements were currently contained in printed handoffs across sites, and to allow an expert panel to make recommendations for best practices.
METHODS
I‐PASS Study sites included 9 pediatric residency programs at academic medical centers from across North America. Programs were identified through professional networks and invited to participate. The nonintensive care unit hospitalist services at these medical centers are primarily staffed by residents and medical students with attending supervision. At 1 site, nurse practitioners also participate in care. Additional details about study sites can be found in the study descriptions previously published.[14, 15] All sites received local institutional review board approval.
We began by inviting members of the I‐PASS Education Executive Committee (EEC)[14] to build a collective, comprehensive list of possible data elements for printed handoff documents. This committee included pediatric residency program directors, pediatric hospitalists, education researchers, health services researchers, and patient safety experts. We obtained sample handoff documents from pediatric hospitalist services at each of 9 institutions in the United States and Canada (with protected health information redacted). We reviewed these sample handoff documents to characterize their format and to determine what discrete data elements appeared in each site's printed handoff document. Presence or absence of each data element across sites was tabulated. We also queried sites to determine the feasibility of including elements that were not presently included.
Subsequently, I‐PASS site investigators led structured group interviews at participating sites to gather additional information about handoff practices at each site. These structured group interviews included diverse representation from residents, faculty, and residency program leadership, as well as hospitalists and medical students, to ensure the comprehensive acquisition of information regarding site‐specific characteristics. Each group provided answers to a standardized set of open‐ended questions that addressed current practices, handoff education, simulation use, team structure, and the nature of current written handoff tools, if applicable, at each site. One member of the structured group interview served as a scribe and created a document that summarized the content of the structured group interview meeting and answers to the standardized questions.
Consensus on Content
The initial data collection also included a multivote process[18] of the full I‐PASS EEC to help prioritize data elements. Committee members brainstormed a list of all possible data elements for a printed handoff document. Each member (n=14) was given 10 votes to distribute among the elements. Committee members could assign more than 1 vote to an element to emphasize its importance.
The results of this process as well as the current data elements included in each printed handoff tool were reviewed by a subgroup of the I‐PASS EEC. These expert panel members participated in a series of conference calls during which they tabulated categorical information, reviewed narrative comments, discussed existing evidence, and conducted simple content analysis to identify areas of concordance or discordance. Areas of discordance were discussed by the committee. Disagreements were resolved with group consensus with attention to published evidence or best practices, if available.
Elements were divided into those that were essential (unanimous consensus, no conflicting literature) and those that were recommended (majority supported inclusion of element, no conflicting literature). Ratings were assigned using the American College of Cardiology/American Heart Association framework for practice guidelines,[19] in which each element is assigned a classification (I=effective, II=conflicting evidence/opinion, III=not effective) and a level of evidence to support that classification (A=multiple large randomized controlled trials, B=single randomized trial, or nonrandomized studies, C=expert consensus).
The expert panel reached consensus, through active discussion, on a list of data elements that should be included in an ideal printed handoff document. Elements were chosen based on perceived importance, with attention to published best practices[1, 16] and the multivoting results. In making recommendations, consideration was given to whether data elements could be electronically imported into the printed handoff document from the EHR, or whether they would be entered manually. The potential for serious medical errors due to possible errors in manual entry of data was an important aspect of recommendations made. The list of candidate elements was then reviewed by a larger group of investigators from the I‐PASS Education Executive Committee and Coordinating Council for additional input.
The panel asked site investigators from each participating hospital to gather data on the feasibility of redesigning the printed handoff at that hospital to include each recommended element. Site investigators reported whether each element was already included, possible to include but not included currently, or not currently possible to include within that site's printed handoff tool. Site investigators also reported how data elements were populated in their handoff documents, with options including: (1) autopopulated from administrative data (eg, pharmacy‐entered medication list, demographic data entered by admitting office), (2) autoimported from physicians' free‐text entries elsewhere in the EHR (eg, progress notes), (3) free text entered specifically for the printed handoff, or (4) not applicable (element cannot be included).
RESULTS
Nine programs (100%) provided data on the structure and contents of their printed handoff documents. We found wide variation in structure across the 9 sites. Three sites used a word‐processorbased document that required manual entry of all data elements. The other 6 institutions had a direct link with the EHR to enable autopopulation of between 10 and 20 elements on the printed handoff document.
The content of written handoff documents, as well as the sources of data included in them (present or future), likewise varied substantially across sites (Table 1). Only 4 data elements (name, age, weight, and a list of medications) were universally included at all 9 sites. Among the 6 institutions that linked the printed handoff to the EHR, there was also substantial variation in which elements were autoimported. Only 7 elements were universally autoimported at these 6 sites: patient name, medical record number, room number, weight, date of birth, age, and date of admission. Two elements from the original brainstorming were not presently included in any sites' documents (emergency contact and primary language).
Data Elements | Sites With Data Element Included at Initial Needs Assessment (Out of Nine Sites) | Data Source (Current or Anticipated) | ||
---|---|---|---|---|
Autoimported* | Manually Entered | Not Applicable | ||
| ||||
Name | 9 | 6 | 3 | 0 |
Medical record number | 8 | 6 | 3 | 0 |
Room number | 8 | 6 | 3 | 0 |
Allergies | 6 | 4 | 5 | 0 |
Weight | 9 | 6 | 3 | 0 |
Age | 9 | 6 | 3 | 0 |
Date of birth | 6 | 6 | 3 | 0 |
Admission date | 8 | 6 | 3 | 0 |
Attending name | 5 | 4 | 5 | 0 |
Team/service | 7 | 4 | 5 | 0 |
Illness severity | 1 | 0 | 9 | 0 |
Patient summary | 8 | 0 | 9 | 0 |
Action items | 8 | 0 | 9 | 0 |
Situation monitoring/contingency plan | 5 | 0 | 9 | 0 |
Medication name | 9 | 4 | 5 | 0 |
Medication name and dose/route/frequency | 4 | 4 | 5 | 0 |
Code status | 2 | 2 | 7 | 0 |
Labs | 6 | 5 | 4 | 0 |
Access | 2 | 2 | 7 | 0 |
Ins/outs | 2 | 4 | 4 | 1 |
Primary language | 0 | 3 | 6 | 0 |
Vital signs | 3 | 4 | 4 | 1 |
Emergency contact | 0 | 2 | 7 | 0 |
Primary care provider | 4 | 4 | 5 | 0 |
Nine institutions (100%) conducted structured group interviews, ranging in size from 4 to 27 individuals with a median of 5 participants. The documents containing information from each site were provided to the authors. The authors then tabulated categorical information, reviewed narrative comments to understand current institutional practices, and conducted simple content analysis to identify areas of concordance or discordance, particularly with respect to data elements and EHR usage. Based on the results of the printed handoff document review and structured group interviews, with additional perspectives provided by the I‐PASS EEC, the expert panel came to consensus on a list of 23 elements that should be included in printed handoff documents, including 15 essential data elements and 8 additional recommended elements (Table 2).
|
Essential Elements |
Patient identifiers |
Patient name (class I, level of evidence C) |
Medical record number (class I, level of evidence C) |
Date of birth (class I, level of evidence C) |
Hospital service identifiers |
Attending name (class I, level of evidence C) |
Team/service (class I, level of evidence C) |
Room number (class I, level of evidence C) |
Admission date (class I, level of evidence C) |
Age (class I, level of evidence C) |
Weight (class I, level of evidence C) |
Illness severity (class I, level of evidence B)[20, 21] |
Patient summary (class I, level of evidence B)[21, 22] |
Action items (class I, level of evidence B) [21, 22] |
Situation awareness/contingency planning (class I, level of evidence B) [21, 22] |
Allergies (class I, level of evidence C) |
Medications |
Autopopulation of medications (class I, level of evidence B)[22, 23, 24] |
Free‐text entry of medications (class IIa, level of evidence C) |
Recommended elements |
Primary language (class IIa, level of evidence C) |
Emergency contact (class IIa, level of evidence C) |
Primary care provider (class IIa, level of evidence C) |
Code status (class IIb, level of evidence C) |
Labs (class IIa, level of evidence C) |
Access (class IIa, level of evidence C) |
Ins/outs (class IIa, level of evidence C) |
Vital signs (class IIa, level of evidence C) |
Evidence ratings[19] of these elements are included. Several elements are classified as I‐B (effective, nonrandomized studies) based on either studies of individual elements, or greater than 1 study of bundled elements that could reasonably be extrapolated. These include Illness severity,[20, 21] patient summary,[21, 22] action items[21, 22] (to do lists), situation awareness and contingency plan,[21, 22] and medications[22, 23, 24] with attention to importing from the EHR. Medications entered as free text were classified as IIa‐C because of risk and potential significance of errors; in particular there was concern that transcription errors, errors of omission, or errors of commission could potentially lead to patient harms. The remaining essential elements are classified as I‐C (effective, expert consensus). Of note, date of birth was specifically included as a patient identifier, distinct from age, which was felt to be useful as a descriptor (often within a one‐liner or as part of the patient summary).
The 8 recommended elements were elements for which there was not unanimous agreement on inclusion, but the majority of the panel felt they should be included. These elements were classified as IIa‐C, with 1 exception. Code status generated significant controversy among the group. After extensive discussion among the group and consideration of safety, supervision, educational, and pediatric‐specific considerations, all members of the group agreed on the categorization as a recommended element; it is classified as IIb‐C.
All members of the group agreed that data elements should be directly imported from the EHR whenever possible. Finally, members agreed that the elements that make up the I‐PASS mnemonic (illness severity, patient summary, action items, situation awareness/contingency planning) should be listed in that order whenever possible. A sample I‐PASS‐compliant printed handoff document is shown Figure 1.
DISCUSSION
We identified substantial variability in the structure and content of printed handoff documents used by 9 pediatric hospitalist teaching services, reflective of a lack of standardization. We found that institutional printed handoff documents shared some demographic elements (eg, name, room, medical record number) but also varied in clinical content (eg, vital signs, lab tests, code status). Our expert panel developed a list of 15 essential and 8 recommended data elements for printed handoff documents. Although this is a large number of fields, the majority of the essential fields were already included by most sites, and many are basic demographic identifiers. Illness severity is the 1 essential field that was not routinely included; however, including this type of overview is consistently recommended[2, 4] and supported by evidence,[20, 21] and contributes to building a shared mental model.[16] We recommend the categories of stable/watcher/unstable.[17]
Several prior single‐center studies have found that introducing a printed handoff document can lead to improvements in workflow, communication, and patient safety. In an early study, Petersen et al.[25] showed an association between use of a computerized sign‐out program and reduced odds of preventable adverse events during periods of cross‐coverage. Wayne et al.[26] reported fewer perceived inaccuracies in handoff documents as well as improved clarity at the time of transfer, supporting the role for standardization. Van Eaton et al.[27] demonstrated rapid uptake and desirability of a computerized handoff document, which combined autoimportation of information from an EHR with resident‐entered patient details, reflecting the importance of both data sources. In addition, they demonstrated improvements in both the rounding and sign‐out processes.[28]
Two studies specifically reported the increased use of specific fields after implementation. Payne et al. implemented a Web‐based handoff tool and documented significant increases in the number of handoffs containing problem lists, medication lists, and code status, accompanied by perceived improvements in quality of handoffs and fewer near‐miss events.[24] Starmer et al. found that introduction of a resident handoff bundle that included a printed handoff tool led to reduction in medical errors and adverse events.[22] The study group using the tool populated 11 data elements more often after implementation, and introduction of this printed handoff tool in particular was associated with reductions in written handoff miscommunications. Neither of these studies included subanalysis to indicate which data elements may have been most important.
In contrast to previous single‐institution studies, our recommendations for a printed handoff template come from evaluations of tools and discussions with front line providers across 9 institutions. We had substantial overlap with data elements recommended by Van Eaton et al.[27] However, there were several areas in which we did not have overlap with published templates including weight, ins/outs, primary language, emergency contact information, or primary care provider. Other published handoff tools have been highly specialized (eg, for cardiac intensive care) or included many fewer data elements than our group felt were essential. These differences may reflect the unique aspects of caring for pediatric patients (eg, need for weights) and the absence of defined protocols for many pediatric conditions. In addition, the level of detail needed for contingency planning may vary between teaching and nonteaching services.
Resident physicians may provide valuable information in the development of standardized handoff documents. Clark et al.,[29] at Virginia Mason University, utilized resident‐driven continuous quality improvement processes including real‐time feedback to implement an electronic template. They found that engagement of both senior leaders and front‐line users was an important component of their success in uptake. Our study utilized residents as essential members of structured group interviews to ensure that front‐line users' needs were represented as recommendations for a printed handoff tool template were developed.
As previously described,[17] our study group had identified several key data elements that should be included in verbal handoffs: illness severity, a patient summary, a discrete action list, situation awareness/contingency planning, and a synthesis by receiver. With consideration of the multivoting results as well as known best practices,[1, 4, 12] the expert panel for this study agreed that each of these elements should also be highlighted in the printed template to ensure consistency between the printed document and the verbal handoff, and to have each reinforce the other. On the printed handoff tool, the final S in the I‐PASS mnemonic (synthesis by receiver) cannot be prepopulated, but considering the importance of this step,[16, 30, 31, 32] it should be printed as synthesis by receiver to serve as a text‐reminder to both givers and receivers.
The panel also felt, however, that the printed handoff document should provide additional background information not routinely included in a verbal handoff. It should serve as a reference tool both at the time of verbal handoff and throughout the day and night, and therefore should include more comprehensive information than is necessary or appropriate to convey during the verbal handoff. We identified 10 data elements that are essential in a printed handoff document in addition to the I‐PASS elements (Table 2).
Patient demographic data elements, as well as team assignments and attending physician, were uniformly supported for inclusion. The medication list was viewed as essential; however, the panel also recognized the potential for medical errors due to inaccuracies in the medication list. In particular, there was concern that including all fields of a medication order (drug, dose, route, frequency) would result in handoffs containing a high proportion of inaccurate information, particularly for complex patients whose medication regimens may vary over the course of hospitalization. Therefore, the panel agreed that if medication lists were entered manually, then only the medication name should be included as they did not wish to perpetuate inaccurate or potentially harmful information. If medication lists were autoimported from an EHR, then they should include drug name, dose, route, and frequency if possible.
In the I‐PASS study,[15] all institutions implemented printed handoff documents that included fields for the essential data elements. After implementation, there was a significant increase in completion of all essential fields. Although there is limited evidence to support any individual data element, increased usage of these elements was associated with the overall study finding of decreased rates of medical errors and preventable adverse events.
EHRs have the potential to help standardize printed handoff documents[5, 6, 33, 34, 35]; all participants in our study agreed that printed handoff documents should ideally be linked with the EHR and should autoimport data wherever appropriate. Manually populated (eg, word processor‐ or spreadsheet‐based) handoff tools have important limitations, particularly related to the potential for typographical errors as well as accidental omission of data fields, and lead to unnecessary duplication of work (eg, re‐entering data already included in a progress note) that can waste providers' time. It was also acknowledged that word processor‐ or spreadsheet‐based documents may have flexibility that is lacking in EHR‐based handoff documents. For example, formatting can more easily be adjusted to increase the number of patients per printed page. As technology advances, printed documents may be phased out in favor of EHR‐based on‐screen reports, which by their nature would be more accurate due to real‐time autoupdates.
In making recommendations about essential versus recommended items for inclusion in the printed handoff template, the only data element that generated controversy among our experts was code status. Some felt that it should be included as an essential element, whereas others did not. We believe that this was unique to our practice in pediatric hospital ward settings, as codes in most pediatric ward settings are rare. Among the concerns expressed with including code status for all patients were that residents might assume patients were full‐code without verifying. The potential inaccuracy created by this might have severe implications. Alternatively, residents might feel obligated to have code discussions with all patients regardless of severity of illness, which may be inappropriate in a pediatric population. Several educators expressed concerns about trainees having unsupervised code‐status conversations with families of pediatric patients. Conversely, although codes are rare in pediatric ward settings, concerns were raised that not including code status could be problematic during these rare but critically important events. Other fields, such as weight, might have less relevance for an adult population in which emergency drug doses are standardized.
Limitations
Our study has several limitations. We only collected data from hospitalist services at pediatric sites. It is likely that providers in other specialties would have specific data elements they felt were essential (eg, postoperative day, code status). Our methodology was expert consensus based, driven by data collection from sites that were already participating in the I‐PASS study. Although the I‐PASS study demonstrated decreased rates of medical errors and preventable adverse events with inclusion of these data elements as part of a bundle, future research will be required to evaluate whether some of these items are more important than others in improving written communication and ultimately patient safety. In spite of these limitations, our work represents an important starting point for the development of standards for written handoff documents that should be used in patient handoffs, particularly those generated from EHRs.
CONCLUSIONS
In this article we describe the results of a needs assessment that informed expert consensus‐based recommendations for data elements to include in a printed handoff document. We recommend that pediatric programs include the elements identified as part of a standardized written handoff tool. Although many of these elements are also applicable to other specialties, future work should be conducted to adapt the printed handoff document elements described here for use in other specialties and settings. Future studies should work to validate the importance of these elements, studying the manner in which their inclusion affects the quality of written handoffs, and ultimately patient safety.
Acknowledgements
Members of the I‐PASS Study Education Executive Committee who contributed to this manuscript include: Boston Children's Hospital/Harvard Medical School (primary site) (Christopher P. Landrigan, MD, MPH, Elizabeth L. Noble, BA. Theodore C. Sectish, MD. Lisa L. Tse, BA). Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine (Jennifer K. O'Toole, MD, MEd). Doernbecher Children's Hospital/Oregon Health and Science University (Amy J. Starmer, MD, MPH). Hospital for Sick Children/University of Toronto (Zia Bismilla, MD. Maitreya Coffey, MD). Lucile Packard Children's Hospital/Stanford University (Lauren A. Destino, MD. Jennifer L. Everhart, MD. Shilpa J. Patel, MD [currently at Kapi'olani Children's Hospital/University of Hawai'i School of Medicine]). National Capital Consortium (Jennifer H. Hepps, MD. Joseph O. Lopreiato, MD, MPH. Clifton E. Yu, MD). Primary Children's Medical Center/University of Utah (James F. Bale, Jr., MD. Adam T. Stevenson, MD). St. Louis Children's Hospital/Washington University (F. Sessions Cole, MD). St. Christopher's Hospital for Children/Drexel University College of Medicine (Sharon Calaman, MD. Nancy D. Spector, MD). Benioff Children's Hospital/University of California San Francisco School of Medicine (Glenn Rosenbluth, MD. Daniel C. West, MD).
Additional I‐PASS Study Group members who contributed to this manuscript include April D. Allen, MPA, MA (Heller School for Social Policy and Management, Brandeis University, previously affiliated with Boston Children's Hospital), Madelyn D. Kahana, MD (The Children's Hospital at Montefiore/Albert Einstein College of Medicine, previously affiliated with Lucile Packard Children's Hospital/Stanford University), Robert S. McGregor, MD (Akron Children's Hospital/Northeast Ohio Medical University, previously affiliated with St. Christopher's Hospital for Children/Drexel University), and John S. Webster, MD, MBA, MS (Webster Healthcare Consulting Inc., formerly of the Department of Defense).
Members of the I‐PASS Study Group include individuals from the institutions listed below as follows: Boston Children's Hospital/Harvard Medical School (primary site): April D. Allen, MPA, MA (currently at Heller School for Social Policy and Management, Brandeis University), Angela M. Feraco, MD, Christopher P. Landrigan, MD, MPH, Elizabeth L. Noble, BA, Theodore C. Sectish, MD, Lisa L. Tse, BA. Brigham and Women's Hospital (data coordinating center): Anuj K. Dalal, MD, Carol A. Keohane, BSN, RN, Stuart Lipsitz, PhD, Jeffrey M. Rothschild, MD, MPH, Matt F. Wien, BS, Catherine S. Yoon, MS, Katherine R. Zigmont, BSN, RN. Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine: Javier Gonzalez del Rey, MD, MEd, Jennifer K. O'Toole, MD, MEd, Lauren G. Solan, MD. Doernbecher Children's Hospital/Oregon Health and Science University: Megan E. Aylor, MD, Amy J. Starmer, MD, MPH, Windy Stevenson, MD, Tamara Wagner, MD. Hospital for Sick Children/University of Toronto: Zia Bismilla, MD, Maitreya Coffey, MD, Sanjay Mahant, MD, MSc. Lucile Packard Children's Hospital/Stanford University: Rebecca L. Blankenburg, MD, MPH, Lauren A. Destino, MD, Jennifer L. Everhart, MD, Madelyn Kahana, MD, Shilpa J. Patel, MD (currently at Kapi'olani Children's Hospital/University of Hawaii School of Medicine). National Capital Consortium: Jennifer H. Hepps, MD, Joseph O. Lopreiato, MD, MPH, Clifton E. Yu, MD. Primary Children's Hospital/University of Utah: James F. Bale, Jr., MD, Jaime Blank Spackman, MSHS, CCRP, Rajendu Srivastava, MD, FRCP(C), MPH, Adam Stevenson, MD. St. Louis Children's Hospital/Washington University: Kevin Barton, MD, Kathleen Berchelmann, MD, F. Sessions Cole, MD, Christine Hrach, MD, Kyle S. Schultz, MD, Michael P. Turmelle, MD, Andrew J. White, MD. St. Christopher's Hospital for Children/Drexel University: Sharon Calaman, MD, Bronwyn D. Carlson, MD, Robert S. McGregor, MD (currently at Akron Children's Hospital/Northeast Ohio Medical University), Vahideh Nilforoshan, MD, Nancy D. Spector, MD. and Benioff Children's Hospital/University of California San Francisco School of Medicine: Glenn Rosenbluth, MD, Daniel C. West, MD. Dorene Balmer, PhD, RD, Carol L. Carraccio, MD, MA, Laura Degnon, CAE, and David McDonald, and Alan Schwartz PhD serve the I‐PASS Study Group as part of the IIPE. Karen M. Wilson, MD, MPH serves the I‐PASS Study Group as part of the advisory board from the PRIS Executive Council. John Webster served the I‐PASS Study Group and Education Executive Committee as a representative from TeamSTEPPS.
Disclosures: The I‐PASS Study was primarily supported by the US Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evaluation (1R18AE000029‐01). The opinions and conclusions expressed herein are solely those of the author(s) and should not be constructed as representing the opinions or policy of any agency of the federal government. Developed with input from the Initiative for Innovation in Pediatric Education and the Pediatric Research in Inpatient Settings Network (supported by the Children's Hospital Association, the Academic Pediatric Association, the American Academy of Pediatrics, and the Society of Hospital Medicine). A. J. S. was supported by the Agency for Healthcare Research and Quality/Oregon Comparative Effectiveness Research K12 Program (1K12HS019456‐01). Additional funding for the I‐PASS Study was provided by the Medical Research Foundation of Oregon, Physician Services Incorporated Foundation (Ontario, Canada), and Pfizer (unrestricted medical education grant to N.D.S.). C.P.L, A.J.S. were supported by the Oregon Comparative Effectiveness Research K12 Program (1K12HS019456 from the Agency for Healthcare Research and Quality). A.J.S. was also supported by the Medical Research Foundation of Oregon. The authors report no conflicts of interest.
Handoffs among hospital providers are highly error prone and can result in serious morbidity and mortality. Best practices for verbal handoffs have been described[1, 2, 3, 4] and include conducting verbal handoffs face to face, providing opportunities for questions, having the receiver perform a readback, as well as specific content recommendations including action items. Far less research has focused on best practices for printed handoff documents,[5, 6] despite the routine use of written handoff tools as a reference by on‐call physicians.[7, 8] Erroneous or outdated information on the written handoff can mislead on‐call providers, potentially leading to serious medical errors.
In their most basic form, printed handoff documents list patients for whom a provider is responsible. Typically, they also contain demographic information, reason for hospital admission, and a task list for each patient. They may also contain more detailed information on patient history, hospital course, and/or care plan, and may vary among specialties.[9] They come in various forms, ranging from index cards with handwritten notes, to word‐processor or spreadsheet documents, to printed documents that are autopopulated from the electronic health record (EHR).[2] Importantly, printed handoff documents supplement the verbal handoff by allowing receivers to follow along as patients are presented. The concurrent use of written and verbal handoffs may improve retention of clinical information as compared with either alone.[10, 11]
The Joint Commission requires an institutional approach to patient handoffs.[12] The requirements state that handoff communication solutions should take a standardized form, but they do not provide details regarding what data elements should be included in printed or verbal handoffs. Accreditation Council for Graduate Medical Education Common Program Requirements likewise require that residents must become competent in patient handoffs[13] but do not provide specific details or measurement tools. Absent widely accepted guidelines, decisions regarding which elements to include in printed handoff documents are currently made at an individual or institutional level.
The I‐PASS study is a federally funded multi‐institutional project that demonstrated a decrease in medical errors and preventable adverse events after implementation of a standardized resident handoff bundle.[14, 15] The I‐PASS Study Group developed a bundle of handoff interventions, beginning with a handoff and teamwork training program (based in part on TeamSTEPPS [Team Strategies and Tools to Enhance Performance and Patient Safety]),[16] a novel verbal mnemonic, I‐PASS (Illness Severity, Patient Summary, Action List, Situation Awareness and Contingency Planning, and Synthesis by Receiver),[17] and changes to the verbal handoff process, in addition to several other elements.
We hypothesized that developing a standardized printed handoff template would reinforce the handoff training and enhance the value of the verbal handoff process changes. Given the paucity of data on best printed handoff practices, however, we first conducted a needs assessment to identify which data elements were currently contained in printed handoffs across sites, and to allow an expert panel to make recommendations for best practices.
METHODS
I‐PASS Study sites included 9 pediatric residency programs at academic medical centers from across North America. Programs were identified through professional networks and invited to participate. The nonintensive care unit hospitalist services at these medical centers are primarily staffed by residents and medical students with attending supervision. At 1 site, nurse practitioners also participate in care. Additional details about study sites can be found in the study descriptions previously published.[14, 15] All sites received local institutional review board approval.
We began by inviting members of the I‐PASS Education Executive Committee (EEC)[14] to build a collective, comprehensive list of possible data elements for printed handoff documents. This committee included pediatric residency program directors, pediatric hospitalists, education researchers, health services researchers, and patient safety experts. We obtained sample handoff documents from pediatric hospitalist services at each of 9 institutions in the United States and Canada (with protected health information redacted). We reviewed these sample handoff documents to characterize their format and to determine what discrete data elements appeared in each site's printed handoff document. Presence or absence of each data element across sites was tabulated. We also queried sites to determine the feasibility of including elements that were not presently included.
Subsequently, I‐PASS site investigators led structured group interviews at participating sites to gather additional information about handoff practices at each site. These structured group interviews included diverse representation from residents, faculty, and residency program leadership, as well as hospitalists and medical students, to ensure the comprehensive acquisition of information regarding site‐specific characteristics. Each group provided answers to a standardized set of open‐ended questions that addressed current practices, handoff education, simulation use, team structure, and the nature of current written handoff tools, if applicable, at each site. One member of the structured group interview served as a scribe and created a document that summarized the content of the structured group interview meeting and answers to the standardized questions.
Consensus on Content
The initial data collection also included a multivote process[18] of the full I‐PASS EEC to help prioritize data elements. Committee members brainstormed a list of all possible data elements for a printed handoff document. Each member (n=14) was given 10 votes to distribute among the elements. Committee members could assign more than 1 vote to an element to emphasize its importance.
The results of this process as well as the current data elements included in each printed handoff tool were reviewed by a subgroup of the I‐PASS EEC. These expert panel members participated in a series of conference calls during which they tabulated categorical information, reviewed narrative comments, discussed existing evidence, and conducted simple content analysis to identify areas of concordance or discordance. Areas of discordance were discussed by the committee. Disagreements were resolved with group consensus with attention to published evidence or best practices, if available.
Elements were divided into those that were essential (unanimous consensus, no conflicting literature) and those that were recommended (majority supported inclusion of element, no conflicting literature). Ratings were assigned using the American College of Cardiology/American Heart Association framework for practice guidelines,[19] in which each element is assigned a classification (I=effective, II=conflicting evidence/opinion, III=not effective) and a level of evidence to support that classification (A=multiple large randomized controlled trials, B=single randomized trial, or nonrandomized studies, C=expert consensus).
The expert panel reached consensus, through active discussion, on a list of data elements that should be included in an ideal printed handoff document. Elements were chosen based on perceived importance, with attention to published best practices[1, 16] and the multivoting results. In making recommendations, consideration was given to whether data elements could be electronically imported into the printed handoff document from the EHR, or whether they would be entered manually. The potential for serious medical errors due to possible errors in manual entry of data was an important aspect of recommendations made. The list of candidate elements was then reviewed by a larger group of investigators from the I‐PASS Education Executive Committee and Coordinating Council for additional input.
The panel asked site investigators from each participating hospital to gather data on the feasibility of redesigning the printed handoff at that hospital to include each recommended element. Site investigators reported whether each element was already included, possible to include but not included currently, or not currently possible to include within that site's printed handoff tool. Site investigators also reported how data elements were populated in their handoff documents, with options including: (1) autopopulated from administrative data (eg, pharmacy‐entered medication list, demographic data entered by admitting office), (2) autoimported from physicians' free‐text entries elsewhere in the EHR (eg, progress notes), (3) free text entered specifically for the printed handoff, or (4) not applicable (element cannot be included).
RESULTS
Nine programs (100%) provided data on the structure and contents of their printed handoff documents. We found wide variation in structure across the 9 sites. Three sites used a word‐processorbased document that required manual entry of all data elements. The other 6 institutions had a direct link with the EHR to enable autopopulation of between 10 and 20 elements on the printed handoff document.
The content of written handoff documents, as well as the sources of data included in them (present or future), likewise varied substantially across sites (Table 1). Only 4 data elements (name, age, weight, and a list of medications) were universally included at all 9 sites. Among the 6 institutions that linked the printed handoff to the EHR, there was also substantial variation in which elements were autoimported. Only 7 elements were universally autoimported at these 6 sites: patient name, medical record number, room number, weight, date of birth, age, and date of admission. Two elements from the original brainstorming were not presently included in any sites' documents (emergency contact and primary language).
Data Elements | Sites With Data Element Included at Initial Needs Assessment (Out of Nine Sites) | Data Source (Current or Anticipated) | ||
---|---|---|---|---|
Autoimported* | Manually Entered | Not Applicable | ||
| ||||
Name | 9 | 6 | 3 | 0 |
Medical record number | 8 | 6 | 3 | 0 |
Room number | 8 | 6 | 3 | 0 |
Allergies | 6 | 4 | 5 | 0 |
Weight | 9 | 6 | 3 | 0 |
Age | 9 | 6 | 3 | 0 |
Date of birth | 6 | 6 | 3 | 0 |
Admission date | 8 | 6 | 3 | 0 |
Attending name | 5 | 4 | 5 | 0 |
Team/service | 7 | 4 | 5 | 0 |
Illness severity | 1 | 0 | 9 | 0 |
Patient summary | 8 | 0 | 9 | 0 |
Action items | 8 | 0 | 9 | 0 |
Situation monitoring/contingency plan | 5 | 0 | 9 | 0 |
Medication name | 9 | 4 | 5 | 0 |
Medication name and dose/route/frequency | 4 | 4 | 5 | 0 |
Code status | 2 | 2 | 7 | 0 |
Labs | 6 | 5 | 4 | 0 |
Access | 2 | 2 | 7 | 0 |
Ins/outs | 2 | 4 | 4 | 1 |
Primary language | 0 | 3 | 6 | 0 |
Vital signs | 3 | 4 | 4 | 1 |
Emergency contact | 0 | 2 | 7 | 0 |
Primary care provider | 4 | 4 | 5 | 0 |
Nine institutions (100%) conducted structured group interviews, ranging in size from 4 to 27 individuals with a median of 5 participants. The documents containing information from each site were provided to the authors. The authors then tabulated categorical information, reviewed narrative comments to understand current institutional practices, and conducted simple content analysis to identify areas of concordance or discordance, particularly with respect to data elements and EHR usage. Based on the results of the printed handoff document review and structured group interviews, with additional perspectives provided by the I‐PASS EEC, the expert panel came to consensus on a list of 23 elements that should be included in printed handoff documents, including 15 essential data elements and 8 additional recommended elements (Table 2).
|
Essential Elements |
Patient identifiers |
Patient name (class I, level of evidence C) |
Medical record number (class I, level of evidence C) |
Date of birth (class I, level of evidence C) |
Hospital service identifiers |
Attending name (class I, level of evidence C) |
Team/service (class I, level of evidence C) |
Room number (class I, level of evidence C) |
Admission date (class I, level of evidence C) |
Age (class I, level of evidence C) |
Weight (class I, level of evidence C) |
Illness severity (class I, level of evidence B)[20, 21] |
Patient summary (class I, level of evidence B)[21, 22] |
Action items (class I, level of evidence B) [21, 22] |
Situation awareness/contingency planning (class I, level of evidence B) [21, 22] |
Allergies (class I, level of evidence C) |
Medications |
Autopopulation of medications (class I, level of evidence B)[22, 23, 24] |
Free‐text entry of medications (class IIa, level of evidence C) |
Recommended elements |
Primary language (class IIa, level of evidence C) |
Emergency contact (class IIa, level of evidence C) |
Primary care provider (class IIa, level of evidence C) |
Code status (class IIb, level of evidence C) |
Labs (class IIa, level of evidence C) |
Access (class IIa, level of evidence C) |
Ins/outs (class IIa, level of evidence C) |
Vital signs (class IIa, level of evidence C) |
Evidence ratings[19] of these elements are included. Several elements are classified as I‐B (effective, nonrandomized studies) based on either studies of individual elements, or greater than 1 study of bundled elements that could reasonably be extrapolated. These include Illness severity,[20, 21] patient summary,[21, 22] action items[21, 22] (to do lists), situation awareness and contingency plan,[21, 22] and medications[22, 23, 24] with attention to importing from the EHR. Medications entered as free text were classified as IIa‐C because of risk and potential significance of errors; in particular there was concern that transcription errors, errors of omission, or errors of commission could potentially lead to patient harms. The remaining essential elements are classified as I‐C (effective, expert consensus). Of note, date of birth was specifically included as a patient identifier, distinct from age, which was felt to be useful as a descriptor (often within a one‐liner or as part of the patient summary).
The 8 recommended elements were elements for which there was not unanimous agreement on inclusion, but the majority of the panel felt they should be included. These elements were classified as IIa‐C, with 1 exception. Code status generated significant controversy among the group. After extensive discussion among the group and consideration of safety, supervision, educational, and pediatric‐specific considerations, all members of the group agreed on the categorization as a recommended element; it is classified as IIb‐C.
All members of the group agreed that data elements should be directly imported from the EHR whenever possible. Finally, members agreed that the elements that make up the I‐PASS mnemonic (illness severity, patient summary, action items, situation awareness/contingency planning) should be listed in that order whenever possible. A sample I‐PASS‐compliant printed handoff document is shown Figure 1.
DISCUSSION
We identified substantial variability in the structure and content of printed handoff documents used by 9 pediatric hospitalist teaching services, reflective of a lack of standardization. We found that institutional printed handoff documents shared some demographic elements (eg, name, room, medical record number) but also varied in clinical content (eg, vital signs, lab tests, code status). Our expert panel developed a list of 15 essential and 8 recommended data elements for printed handoff documents. Although this is a large number of fields, the majority of the essential fields were already included by most sites, and many are basic demographic identifiers. Illness severity is the 1 essential field that was not routinely included; however, including this type of overview is consistently recommended[2, 4] and supported by evidence,[20, 21] and contributes to building a shared mental model.[16] We recommend the categories of stable/watcher/unstable.[17]
Several prior single‐center studies have found that introducing a printed handoff document can lead to improvements in workflow, communication, and patient safety. In an early study, Petersen et al.[25] showed an association between use of a computerized sign‐out program and reduced odds of preventable adverse events during periods of cross‐coverage. Wayne et al.[26] reported fewer perceived inaccuracies in handoff documents as well as improved clarity at the time of transfer, supporting the role for standardization. Van Eaton et al.[27] demonstrated rapid uptake and desirability of a computerized handoff document, which combined autoimportation of information from an EHR with resident‐entered patient details, reflecting the importance of both data sources. In addition, they demonstrated improvements in both the rounding and sign‐out processes.[28]
Two studies specifically reported the increased use of specific fields after implementation. Payne et al. implemented a Web‐based handoff tool and documented significant increases in the number of handoffs containing problem lists, medication lists, and code status, accompanied by perceived improvements in quality of handoffs and fewer near‐miss events.[24] Starmer et al. found that introduction of a resident handoff bundle that included a printed handoff tool led to reduction in medical errors and adverse events.[22] The study group using the tool populated 11 data elements more often after implementation, and introduction of this printed handoff tool in particular was associated with reductions in written handoff miscommunications. Neither of these studies included subanalysis to indicate which data elements may have been most important.
In contrast to previous single‐institution studies, our recommendations for a printed handoff template come from evaluations of tools and discussions with front line providers across 9 institutions. We had substantial overlap with data elements recommended by Van Eaton et al.[27] However, there were several areas in which we did not have overlap with published templates including weight, ins/outs, primary language, emergency contact information, or primary care provider. Other published handoff tools have been highly specialized (eg, for cardiac intensive care) or included many fewer data elements than our group felt were essential. These differences may reflect the unique aspects of caring for pediatric patients (eg, need for weights) and the absence of defined protocols for many pediatric conditions. In addition, the level of detail needed for contingency planning may vary between teaching and nonteaching services.
Resident physicians may provide valuable information in the development of standardized handoff documents. Clark et al.,[29] at Virginia Mason University, utilized resident‐driven continuous quality improvement processes including real‐time feedback to implement an electronic template. They found that engagement of both senior leaders and front‐line users was an important component of their success in uptake. Our study utilized residents as essential members of structured group interviews to ensure that front‐line users' needs were represented as recommendations for a printed handoff tool template were developed.
As previously described,[17] our study group had identified several key data elements that should be included in verbal handoffs: illness severity, a patient summary, a discrete action list, situation awareness/contingency planning, and a synthesis by receiver. With consideration of the multivoting results as well as known best practices,[1, 4, 12] the expert panel for this study agreed that each of these elements should also be highlighted in the printed template to ensure consistency between the printed document and the verbal handoff, and to have each reinforce the other. On the printed handoff tool, the final S in the I‐PASS mnemonic (synthesis by receiver) cannot be prepopulated, but considering the importance of this step,[16, 30, 31, 32] it should be printed as synthesis by receiver to serve as a text‐reminder to both givers and receivers.
The panel also felt, however, that the printed handoff document should provide additional background information not routinely included in a verbal handoff. It should serve as a reference tool both at the time of verbal handoff and throughout the day and night, and therefore should include more comprehensive information than is necessary or appropriate to convey during the verbal handoff. We identified 10 data elements that are essential in a printed handoff document in addition to the I‐PASS elements (Table 2).
Patient demographic data elements, as well as team assignments and attending physician, were uniformly supported for inclusion. The medication list was viewed as essential; however, the panel also recognized the potential for medical errors due to inaccuracies in the medication list. In particular, there was concern that including all fields of a medication order (drug, dose, route, frequency) would result in handoffs containing a high proportion of inaccurate information, particularly for complex patients whose medication regimens may vary over the course of hospitalization. Therefore, the panel agreed that if medication lists were entered manually, then only the medication name should be included as they did not wish to perpetuate inaccurate or potentially harmful information. If medication lists were autoimported from an EHR, then they should include drug name, dose, route, and frequency if possible.
In the I‐PASS study,[15] all institutions implemented printed handoff documents that included fields for the essential data elements. After implementation, there was a significant increase in completion of all essential fields. Although there is limited evidence to support any individual data element, increased usage of these elements was associated with the overall study finding of decreased rates of medical errors and preventable adverse events.
EHRs have the potential to help standardize printed handoff documents[5, 6, 33, 34, 35]; all participants in our study agreed that printed handoff documents should ideally be linked with the EHR and should autoimport data wherever appropriate. Manually populated (eg, word processor‐ or spreadsheet‐based) handoff tools have important limitations, particularly related to the potential for typographical errors as well as accidental omission of data fields, and lead to unnecessary duplication of work (eg, re‐entering data already included in a progress note) that can waste providers' time. It was also acknowledged that word processor‐ or spreadsheet‐based documents may have flexibility that is lacking in EHR‐based handoff documents. For example, formatting can more easily be adjusted to increase the number of patients per printed page. As technology advances, printed documents may be phased out in favor of EHR‐based on‐screen reports, which by their nature would be more accurate due to real‐time autoupdates.
In making recommendations about essential versus recommended items for inclusion in the printed handoff template, the only data element that generated controversy among our experts was code status. Some felt that it should be included as an essential element, whereas others did not. We believe that this was unique to our practice in pediatric hospital ward settings, as codes in most pediatric ward settings are rare. Among the concerns expressed with including code status for all patients were that residents might assume patients were full‐code without verifying. The potential inaccuracy created by this might have severe implications. Alternatively, residents might feel obligated to have code discussions with all patients regardless of severity of illness, which may be inappropriate in a pediatric population. Several educators expressed concerns about trainees having unsupervised code‐status conversations with families of pediatric patients. Conversely, although codes are rare in pediatric ward settings, concerns were raised that not including code status could be problematic during these rare but critically important events. Other fields, such as weight, might have less relevance for an adult population in which emergency drug doses are standardized.
Limitations
Our study has several limitations. We only collected data from hospitalist services at pediatric sites. It is likely that providers in other specialties would have specific data elements they felt were essential (eg, postoperative day, code status). Our methodology was expert consensus based, driven by data collection from sites that were already participating in the I‐PASS study. Although the I‐PASS study demonstrated decreased rates of medical errors and preventable adverse events with inclusion of these data elements as part of a bundle, future research will be required to evaluate whether some of these items are more important than others in improving written communication and ultimately patient safety. In spite of these limitations, our work represents an important starting point for the development of standards for written handoff documents that should be used in patient handoffs, particularly those generated from EHRs.
CONCLUSIONS
In this article we describe the results of a needs assessment that informed expert consensus‐based recommendations for data elements to include in a printed handoff document. We recommend that pediatric programs include the elements identified as part of a standardized written handoff tool. Although many of these elements are also applicable to other specialties, future work should be conducted to adapt the printed handoff document elements described here for use in other specialties and settings. Future studies should work to validate the importance of these elements, studying the manner in which their inclusion affects the quality of written handoffs, and ultimately patient safety.
Acknowledgements
Members of the I‐PASS Study Education Executive Committee who contributed to this manuscript include: Boston Children's Hospital/Harvard Medical School (primary site) (Christopher P. Landrigan, MD, MPH, Elizabeth L. Noble, BA. Theodore C. Sectish, MD. Lisa L. Tse, BA). Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine (Jennifer K. O'Toole, MD, MEd). Doernbecher Children's Hospital/Oregon Health and Science University (Amy J. Starmer, MD, MPH). Hospital for Sick Children/University of Toronto (Zia Bismilla, MD. Maitreya Coffey, MD). Lucile Packard Children's Hospital/Stanford University (Lauren A. Destino, MD. Jennifer L. Everhart, MD. Shilpa J. Patel, MD [currently at Kapi'olani Children's Hospital/University of Hawai'i School of Medicine]). National Capital Consortium (Jennifer H. Hepps, MD. Joseph O. Lopreiato, MD, MPH. Clifton E. Yu, MD). Primary Children's Medical Center/University of Utah (James F. Bale, Jr., MD. Adam T. Stevenson, MD). St. Louis Children's Hospital/Washington University (F. Sessions Cole, MD). St. Christopher's Hospital for Children/Drexel University College of Medicine (Sharon Calaman, MD. Nancy D. Spector, MD). Benioff Children's Hospital/University of California San Francisco School of Medicine (Glenn Rosenbluth, MD. Daniel C. West, MD).
Additional I‐PASS Study Group members who contributed to this manuscript include April D. Allen, MPA, MA (Heller School for Social Policy and Management, Brandeis University, previously affiliated with Boston Children's Hospital), Madelyn D. Kahana, MD (The Children's Hospital at Montefiore/Albert Einstein College of Medicine, previously affiliated with Lucile Packard Children's Hospital/Stanford University), Robert S. McGregor, MD (Akron Children's Hospital/Northeast Ohio Medical University, previously affiliated with St. Christopher's Hospital for Children/Drexel University), and John S. Webster, MD, MBA, MS (Webster Healthcare Consulting Inc., formerly of the Department of Defense).
Members of the I‐PASS Study Group include individuals from the institutions listed below as follows: Boston Children's Hospital/Harvard Medical School (primary site): April D. Allen, MPA, MA (currently at Heller School for Social Policy and Management, Brandeis University), Angela M. Feraco, MD, Christopher P. Landrigan, MD, MPH, Elizabeth L. Noble, BA, Theodore C. Sectish, MD, Lisa L. Tse, BA. Brigham and Women's Hospital (data coordinating center): Anuj K. Dalal, MD, Carol A. Keohane, BSN, RN, Stuart Lipsitz, PhD, Jeffrey M. Rothschild, MD, MPH, Matt F. Wien, BS, Catherine S. Yoon, MS, Katherine R. Zigmont, BSN, RN. Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine: Javier Gonzalez del Rey, MD, MEd, Jennifer K. O'Toole, MD, MEd, Lauren G. Solan, MD. Doernbecher Children's Hospital/Oregon Health and Science University: Megan E. Aylor, MD, Amy J. Starmer, MD, MPH, Windy Stevenson, MD, Tamara Wagner, MD. Hospital for Sick Children/University of Toronto: Zia Bismilla, MD, Maitreya Coffey, MD, Sanjay Mahant, MD, MSc. Lucile Packard Children's Hospital/Stanford University: Rebecca L. Blankenburg, MD, MPH, Lauren A. Destino, MD, Jennifer L. Everhart, MD, Madelyn Kahana, MD, Shilpa J. Patel, MD (currently at Kapi'olani Children's Hospital/University of Hawaii School of Medicine). National Capital Consortium: Jennifer H. Hepps, MD, Joseph O. Lopreiato, MD, MPH, Clifton E. Yu, MD. Primary Children's Hospital/University of Utah: James F. Bale, Jr., MD, Jaime Blank Spackman, MSHS, CCRP, Rajendu Srivastava, MD, FRCP(C), MPH, Adam Stevenson, MD. St. Louis Children's Hospital/Washington University: Kevin Barton, MD, Kathleen Berchelmann, MD, F. Sessions Cole, MD, Christine Hrach, MD, Kyle S. Schultz, MD, Michael P. Turmelle, MD, Andrew J. White, MD. St. Christopher's Hospital for Children/Drexel University: Sharon Calaman, MD, Bronwyn D. Carlson, MD, Robert S. McGregor, MD (currently at Akron Children's Hospital/Northeast Ohio Medical University), Vahideh Nilforoshan, MD, Nancy D. Spector, MD. and Benioff Children's Hospital/University of California San Francisco School of Medicine: Glenn Rosenbluth, MD, Daniel C. West, MD. Dorene Balmer, PhD, RD, Carol L. Carraccio, MD, MA, Laura Degnon, CAE, and David McDonald, and Alan Schwartz PhD serve the I‐PASS Study Group as part of the IIPE. Karen M. Wilson, MD, MPH serves the I‐PASS Study Group as part of the advisory board from the PRIS Executive Council. John Webster served the I‐PASS Study Group and Education Executive Committee as a representative from TeamSTEPPS.
Disclosures: The I‐PASS Study was primarily supported by the US Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evaluation (1R18AE000029‐01). The opinions and conclusions expressed herein are solely those of the author(s) and should not be constructed as representing the opinions or policy of any agency of the federal government. Developed with input from the Initiative for Innovation in Pediatric Education and the Pediatric Research in Inpatient Settings Network (supported by the Children's Hospital Association, the Academic Pediatric Association, the American Academy of Pediatrics, and the Society of Hospital Medicine). A. J. S. was supported by the Agency for Healthcare Research and Quality/Oregon Comparative Effectiveness Research K12 Program (1K12HS019456‐01). Additional funding for the I‐PASS Study was provided by the Medical Research Foundation of Oregon, Physician Services Incorporated Foundation (Ontario, Canada), and Pfizer (unrestricted medical education grant to N.D.S.). C.P.L, A.J.S. were supported by the Oregon Comparative Effectiveness Research K12 Program (1K12HS019456 from the Agency for Healthcare Research and Quality). A.J.S. was also supported by the Medical Research Foundation of Oregon. The authors report no conflicts of interest.
- Handoff strategies in settings with high consequences for failure: lessons for health care operations. Int J Qual Health Care. 2004;16(2):125–132. , , , , .
- Managing discontinuity in academic medical centers: strategies for a safe and effective resident sign‐out. J Hosp Med. 2006;1(4):257–266. , , , , .
- Development and implementation of an oral sign‐out skills curriculum. J Gen Intern Med. 2007;22(10):1470–1474. , , .
- Hospitalist handoffs: a systematic review and task force recommendations. J Hosp Med. 2009;4(7):433–440. , , , , , .
- A systematic review of the literature on the evaluation of handoff tools: implications for research and practice. J Am Med Inform Assoc. 2014;21(1):154–162. , , .
- Review of computerized physician handoff tools for improving the quality of patient care. J Hosp Med. 2013;8(8):456–463. , , , , .
- Answering questions on call: pediatric resident physicians' use of handoffs and other resources. J Hosp Med. 2013;8(6):328–333. , , , , .
- Effectiveness of written hospitalist sign‐outs in answering overnight inquiries. J Hosp Med. 2013;8(11):609–614. , , , .
- Sign‐out snapshot: cross‐sectional evaluation of written sign‐outs among specialties. BMJ Qual Saf. 2014;23(1):66–72. , , .
- An experimental comparison of handover methods. Ann R Coll Surg Engl. 2007;89(3):298–300. , , , .
- Pilot study to show the loss of important data in nursing handover. Br J Nurs. 2005;14(20):1090–1093. , , , .
- The Joint Commission. Hospital Accreditation Standards 2015: Joint Commission Resources; 2015:PC.02.02.01.
- Accreditation Council for Graduate Medical Education. Common Program Requirements. 2013; http://acgme.org/acgmeweb/tabid/429/ProgramandInstitutionalAccreditation/CommonProgramRequirements.aspx. Accessed May 11, 2015.
- Establishing a multisite education and research project requires leadership, expertise, collaboration, and an important aim. Pediatrics. 2010;126(4):619–622. , , , .
- Changes in medical errors after implementation of a handoff program. N Engl J Med. 2014;371(19):1803–1812. , , , et al.
- US Department of Health and Human Services. Agency for Healthcare Research and Quality. TeamSTEPPS website. Available at: http://teamstepps.ahrq.gov/. Accessed July 12, 2013.
- I‐PASS, a mnemonic to standardize verbal handoffs. Pediatrics. 2012;129(2):201–204. , , , , , .
- The Team Handbook. 3rd ed. Middleton, WI: Oriel STAT A MATRIX; 2010. , , .
- ACC/AHA Task Force on Practice Guidelines. Methodology Manual and Policies From the ACCF/AHA Task Force on Practice Guidelines. Available at: http://my.americanheart.org/idc/groups/ahamah‐public/@wcm/@sop/documents/downloadable/ucm_319826.pdf. Published June 2010. Accessed January 11, 2015.
- Effect of illness severity and comorbidity on patient safety and adverse events. Am J Med Qual. 2012;27(1):48–57. , , , et al.
- Consequences of inadequate sign‐out for patient care. Arch Intern Med. 2008;168(16):1755–1760. , , , , .
- Rates of medical errors and preventable adverse events among hospitalized children following implementation of a resident handoff bundle. JAMA. 2013;310(21):2262–2270. , , , et al.
- Medication discrepancies in resident sign‐outs and their potential to harm. J Gen Intern Med. 2007;22(12):1751–1755. , , , , .
- Avoiding handover fumbles: a controlled trial of a structured handover tool versus traditional handover methods. BMJ Qual Saf. 2012;21(11):925–932. , , , .
- Using a computerized sign‐out program to improve continuity of inpatient care and prevent adverse events. Jt Comm J Qual Improv. 1998;24(2):77–87. , , , , .
- Simple standardized patient handoff system that increases accuracy and completeness. J Surg Educ. 2008;65(6):476–485. , , , et al.
- Organizing the transfer of patient care information: the development of a computerized resident sign‐out system. Surgery. 2004;136(1):5–13. , , , .
- A randomized, controlled trial evaluating the impact of a computerized rounding and sign‐out system on continuity of care and resident work hours. J Am Coll Surg. 2005;200(4):538–545. , , , , .
- Template for success: using a resident‐designed sign‐out template in the handover of patient care. J Surg Educ. 2011;68(1):52–57. , , .
- Read‐back improves information transfer in simulated clinical crises. BMJ Qual Saf. 2014;23(12):989–993. , , , , , .
- Interns overestimate the effectiveness of their hand‐off communication. Pediatrics. 2010;125(3):491–496. , , , , .
- Improving patient safety by repeating (read‐back) telephone reports of critical information. Am J Clin Pathol. 2004;121(6):801–803. , , , , , .
- Content overlap in nurse and physician handoff artifacts and the potential role of electronic health records: a systematic review. J Biomed Inform. 2011;44(4):704–712. , , , , .
- Clinical summarization capabilities of commercially‐available and internally‐developed electronic health records. Appl Clin Inform. 2012;3(1):80–93. , , , .
- An analysis and recommendations for multidisciplinary computerized handoff applications in hospitals. AMIA Annu Symp Proc. 2011;2011:588–597. , .
- Handoff strategies in settings with high consequences for failure: lessons for health care operations. Int J Qual Health Care. 2004;16(2):125–132. , , , , .
- Managing discontinuity in academic medical centers: strategies for a safe and effective resident sign‐out. J Hosp Med. 2006;1(4):257–266. , , , , .
- Development and implementation of an oral sign‐out skills curriculum. J Gen Intern Med. 2007;22(10):1470–1474. , , .
- Hospitalist handoffs: a systematic review and task force recommendations. J Hosp Med. 2009;4(7):433–440. , , , , , .
- A systematic review of the literature on the evaluation of handoff tools: implications for research and practice. J Am Med Inform Assoc. 2014;21(1):154–162. , , .
- Review of computerized physician handoff tools for improving the quality of patient care. J Hosp Med. 2013;8(8):456–463. , , , , .
- Answering questions on call: pediatric resident physicians' use of handoffs and other resources. J Hosp Med. 2013;8(6):328–333. , , , , .
- Effectiveness of written hospitalist sign‐outs in answering overnight inquiries. J Hosp Med. 2013;8(11):609–614. , , , .
- Sign‐out snapshot: cross‐sectional evaluation of written sign‐outs among specialties. BMJ Qual Saf. 2014;23(1):66–72. , , .
- An experimental comparison of handover methods. Ann R Coll Surg Engl. 2007;89(3):298–300. , , , .
- Pilot study to show the loss of important data in nursing handover. Br J Nurs. 2005;14(20):1090–1093. , , , .
- The Joint Commission. Hospital Accreditation Standards 2015: Joint Commission Resources; 2015:PC.02.02.01.
- Accreditation Council for Graduate Medical Education. Common Program Requirements. 2013; http://acgme.org/acgmeweb/tabid/429/ProgramandInstitutionalAccreditation/CommonProgramRequirements.aspx. Accessed May 11, 2015.
- Establishing a multisite education and research project requires leadership, expertise, collaboration, and an important aim. Pediatrics. 2010;126(4):619–622. , , , .
- Changes in medical errors after implementation of a handoff program. N Engl J Med. 2014;371(19):1803–1812. , , , et al.
- US Department of Health and Human Services. Agency for Healthcare Research and Quality. TeamSTEPPS website. Available at: http://teamstepps.ahrq.gov/. Accessed July 12, 2013.
- I‐PASS, a mnemonic to standardize verbal handoffs. Pediatrics. 2012;129(2):201–204. , , , , , .
- The Team Handbook. 3rd ed. Middleton, WI: Oriel STAT A MATRIX; 2010. , , .
- ACC/AHA Task Force on Practice Guidelines. Methodology Manual and Policies From the ACCF/AHA Task Force on Practice Guidelines. Available at: http://my.americanheart.org/idc/groups/ahamah‐public/@wcm/@sop/documents/downloadable/ucm_319826.pdf. Published June 2010. Accessed January 11, 2015.
- Effect of illness severity and comorbidity on patient safety and adverse events. Am J Med Qual. 2012;27(1):48–57. , , , et al.
- Consequences of inadequate sign‐out for patient care. Arch Intern Med. 2008;168(16):1755–1760. , , , , .
- Rates of medical errors and preventable adverse events among hospitalized children following implementation of a resident handoff bundle. JAMA. 2013;310(21):2262–2270. , , , et al.
- Medication discrepancies in resident sign‐outs and their potential to harm. J Gen Intern Med. 2007;22(12):1751–1755. , , , , .
- Avoiding handover fumbles: a controlled trial of a structured handover tool versus traditional handover methods. BMJ Qual Saf. 2012;21(11):925–932. , , , .
- Using a computerized sign‐out program to improve continuity of inpatient care and prevent adverse events. Jt Comm J Qual Improv. 1998;24(2):77–87. , , , , .
- Simple standardized patient handoff system that increases accuracy and completeness. J Surg Educ. 2008;65(6):476–485. , , , et al.
- Organizing the transfer of patient care information: the development of a computerized resident sign‐out system. Surgery. 2004;136(1):5–13. , , , .
- A randomized, controlled trial evaluating the impact of a computerized rounding and sign‐out system on continuity of care and resident work hours. J Am Coll Surg. 2005;200(4):538–545. , , , , .
- Template for success: using a resident‐designed sign‐out template in the handover of patient care. J Surg Educ. 2011;68(1):52–57. , , .
- Read‐back improves information transfer in simulated clinical crises. BMJ Qual Saf. 2014;23(12):989–993. , , , , , .
- Interns overestimate the effectiveness of their hand‐off communication. Pediatrics. 2010;125(3):491–496. , , , , .
- Improving patient safety by repeating (read‐back) telephone reports of critical information. Am J Clin Pathol. 2004;121(6):801–803. , , , , , .
- Content overlap in nurse and physician handoff artifacts and the potential role of electronic health records: a systematic review. J Biomed Inform. 2011;44(4):704–712. , , , , .
- Clinical summarization capabilities of commercially‐available and internally‐developed electronic health records. Appl Clin Inform. 2012;3(1):80–93. , , , .
- An analysis and recommendations for multidisciplinary computerized handoff applications in hospitals. AMIA Annu Symp Proc. 2011;2011:588–597. , .
© 2015 Society of Hospital Medicine