Brian Pate, MD

Although bronchiolitis is the leading cause of hospitalization for US infants,[1] there is a lack of basic prospective data about the expected inpatient clinical course and ongoing uncertainty about when a hospitalized child is ready for discharge to home.[2] This lack of data about children's readiness for discharge may result in variable hospital length‐of‐stay (LOS).[3, 4, 5]

One specific source of variability in discharge readiness and LOS variability may be the lack of consensus about safe threshold oxygen saturation values for discharge in children hospitalized with bronchiolitis.[6, 7] In 2006, the Scottish Intercollegiate Guidelines Network recommended a discharge room air oxygen (RAO2) saturation threshold of 95%.[8] The same year, the American Academy of Pediatrics (AAP) bronchiolitis clinical practice guideline stated that oxygen is not needed for children with RAO2 saturations 90% who are feeding well and have minimal respiratory distress.[9] There is a need for prospective studies to help clinicians make evidenced‐based discharge decisions for this common condition.

We performed a prospective, multicenter, multiyear study[10, 11, 12] to examine the typical inpatient clinical course of and to develop hospital discharge guidelines for children age <2 years hospitalized with bronchiolitis. We hypothesized that children would not worsen clinically and would be safe to discharge home once their respiratory status improved and they were able to remain hydrated.

METHODS

RESULTS

There were 1916 children hospitalized with bronchiolitis with data on all factors used to define clinical improvement and clinical worsening. The median number of days from the beginning of difficulty breathing until admission was 2 days (IQR, 15.5 days; range, 18 days) and from the beginning of difficulty breathing until clinical improvement was 4 days (IQR, 37.5 days; range, 133 days) (Figure 1). The variance for days to admission was significantly less than the variance for days to clinical improvement (P<0.001).

Figure 1

In this observational study, clinicians discharged 214 (11%) of the 1916 children before meeting the definition of clinical improvement. Thus, 1702 (89%; 95% CI: 87%‐90%) children reached the clinical improvement criteria, had a LOS >1 day, and had data on all factors (Figure 2).

Figure 2

Of the 1702 children who met the clinical improvement criteria, there were 76 children (4%; 95% CI: 3%5%) who worsened (Figure 2). The worsening occurred within a median of 1 day (IQR, 13 days) of clinical improvement. Forty‐six (3%) of the children required transfer to the ICU (1 required intubation, 1 required continuous positive airway pressure, and 4 had apnea), 23 (1%) required oxygen, and 17 (1%) required IV fluids. Eight percent of children met multiple criteria for worsening. A comparison between children who did and did not worsen is shown in Table 1. In general, children who worsened after improvement were younger and born earlier. These children also presented in more severe respiratory distress, had moderate or severe retractions, oxygen saturation <85% at hospitalization, inadequate oral intake, and apnea documented during the hospitalization. Neither viral etiology nor site of care influenced whether the children worsened after improving. However, stratified analysis of children based on initial location of admission (ie, ICU or ward) showed that among the children admitted to the ICU from the emergency department (ED), 89% met the improvement criteria and 19% clinically worsened. In contrast, among children admitted to the ward from the ED, 89% met the improvement criteria, and only 2% clinically worsened. Stratified multivariable models based on the initial location of admission from the ED (ie, ICU or ward) were not possible due to small sample sizes after stratification. None of these children had relapse events requiring rehospitalization within either 24 hours or 7 days of discharge.

On multivariable analysis (Table 2), independent risk factors for worsening after reaching the clinical improvement criteria were young age, preterm birth, and presenting to care with more severe bronchiolitis represented by severe retractions, inadequate oral intake, or apnea. To further evaluate the improvement criteria in the current analysis, multiple sensitivity analyses were conducted. The frequency of clinical worsening after reaching the improvement criteria was stable when we examined different RA02 criteria in sensitivity analyses: (1) excluding RA02 as a criterion for improvement: 90% met improvement criteria and 4% experienced clinical worsening, (2) changing the average RA02 threshold for clinical improvement to 94%: 62% met improvement criteria and 6% experienced clinical worsening, and (3) changing the average RA02 threshold for clinical improvement to 95%: 47% met improvement criteria and 5% experienced clinical worsening. Furthermore, stratifying by age <2 months and restricting to more stringent definitions of bronchiolitis (ie, age <1 year or age <1 year+no history of wheezing) also did not materially change the results (see Supporting Figure 1 in the online version of this article).

We compared the 214 children who were discharged prior to reaching clinical improvement with the 1702 children who reached the clinical improvement criteria. The 214 children were less likely to be age <2 months (22% vs 30%; P=0.02). These 2 groups (214 vs 1702) were similar with respect to severe retractions (2% vs 4%; P=0.13), median respiratory rate (48 vs 48; P=0.42), oxygen saturation <90% (15% vs 11%; P=0.07), inadequate oral intake (50% vs 43%; P=0.13), and rates of relapse events requiring rehospitalization within both 24 hours (0.6% vs 0.6%; P=0.88) and 7 days (1% vs 1%; P=0.90) of discharge.

DISCUSSION

In this large, multicenter, multiyear study of children hospitalized with bronchiolitis, we found that children present to a hospital in a relatively narrow time frame, but their time to recovery in the hospital is highly variable. Nonetheless, 96% of children continued to improve once they had: (1) improving or stable retractions rated as none/mild, (2) a decreasing or stable RR by age, (3) estimated average RAO2 saturation 90% and lowest RAO2 saturation of 88%, and (4) were hydrated. The 4% of children who worsened after clinically improving were more likely to be age <2 months, born <37 weeks, and present with more severe distress (ie, severe retractions, inadequate oral intake, or apnea). Based on the low risk of worsening after clinical improvement, especially among children admitted to the regular ward (2%), we believe these 4 clinical criteria could be used as discharge criteria for this common pediatric illness with a predominantly monophasic clinical course.

Variability in hospital LOS for children with bronchiolitis exists in the United States[3] and internationally.[4, 5] Cheung and colleagues analyzed administrative data from over 75,000 children admitted for bronchiolitis in England between April 2007 and March 2010 and found sixfold variation in LOS between sites. They concluded that this LOS variability was due in part to providers' clinical decision making.[5] Srivastava and colleagues[23] addressed variable clinician decision making in bronchiolitis and 10 other common pediatric conditions by embedding discharge criteria developed by expert consensus into admission order sets. They found that for children with bronchiolitis, the embedded discharge criteria reduced the median LOS from 1.91 to 1.87 days. In contrast to the single‐center data presented by White and colleagues,[24] the prospective, multicenter MARC‐30 data provide a clear understanding of the normal clinical course for children hospitalized with bronchiolitis, determine if children clinically worsen after clinical improvement, and provide data about discharge criteria for children hospitalized with bronchiolitis. Although there is a lack of rigorous published data, the lower tract symptoms of bronchiolitis (eg, cough, retractions) are said to peak on days 5 to 7 of illness and then gradually resolve.[25] In the present study, we found that the time from the onset of difficulty breathing until hospital admission is less variable than the time from the onset of difficulty breathing until either clinical improvement or discharge. Although 75% of children have clinically improved within 7.5 days of difficulty breathing based on the IQR results, the remaining 25% may have a more prolonged recovery in the hospital of up to 3 weeks. Interestingly, prolonged recovery times from bronchiolitis have also been noted in children presenting to the ED[26] and in an outpatient population.[27] It is unclear why 20% to 25% of children at different levels of severity of illness have prolonged recovery from bronchiolitis, but this group of children requires further investigation.

Given the variability of recovery times, clinicians may have difficulty knowing when a child is ready for hospital discharge. One of the main stumbling blocks for discharge readiness in children with bronchiolitis is the interpretation of the oxygen saturation value.[6, 8, 9, 20, 28] However, it should be considered that interpreting the oxygen saturation in a child who is clinically improving in the hospital setting is different than interpreting the oxygen saturation of a child in the ED or the clinic whose clinical course is less certain.[22] In the hospital setting, using the oxygen saturation value in in the AAP guideline,[9] 4% of children clinically worsened after they met the improvement criteria, a clinical pattern observed previously with supplemental oxygen.[28] This unpredictability may explain some of the variation in providers' clinical decision making.[5] The children who worsened, and therefore deserve more cautious discharge planning, were young (<2 months), premature (<37 weeks gestational age), and presented in more severe distress. Those children admitted to the ICU from the ED worsened more commonly than children admitted to the ward (19% vs 2%). Interestingly, the viral etiology of the child's bronchiolitis did not influence whether a child worsened after reaching the improvement criteria. Therefore, although children with RV bronchiolitis have a shorter hospital LOS than children with RSV bronchiolitis,[11] the pattern of recovery did not differ by viral etiology.

In addition to unsafe discharges, clinicians may be concerned about the possibility of readmissions. Although somewhat controversial, hospital readmission is being used as a quality of care metric.[29, 30, 31] One response to minimize readmissions would be for clinicians to observe children for longer than clinically indicated.[32] However, shorter LOS is not necessarily associated with increased readmission rates.[33] Given that the geometric mean of hospital charges per child with bronchiolitis increased from $6380 in 2000 to $8530 in 2009,[34] the potential for safely reducing hospital LOS by using the discharge criteria proposed in the current study instead of other criteria[8] may net substantial cost savings. Furthermore, reducing LOS would decrease the time children expose others to these respiratory viruses and possibly reduce medical errors.[35]

Our study has some potential limitations. Because the study participants were all hospitalized, these data do not inform admission or discharge decisions from either the ED or the clinic; but other data address those clinical scenarios.[22] Also, the 16 sites that participated in this study were large, urban teaching hospitals. Consequently, these results are not necessarily generalizable to smaller community hospitals. Although numerous data points were required to enter the analytic cohort, only 9% of the sample was excluded for missing data. There were 214 children who did not meet our improvement criteria by the time of discharge. Although the inability to include these children in the analysis may be seen as a limitation, this practice variability underscores the need for more data about discharging hospitalized children with bronchiolitis. Last, site teams reviewed medical records daily. More frequent recording of the clinical course would have yielded more granular data, but the current methodology replicates how data are generally presented during patient care rounds, when decisions about suitability for discharge are often considered.

CONCLUSION

We documented in this large multicenter study that most children hospitalized with bronchiolitis had a wide range of time to recovery, but the vast majority continued to improve once they reached the identified clinical criteria that predict a safe discharge to home. The children who worsened after clinical improvement were more likely to be younger, premature infants presenting in more severe distress. Although additional prospective validation of these hospital discharge criteria is warranted, these data may help clinicians make more evidence‐based discharge decisions for a common pediatric illness with high practice variation, both in the United States[3] and in other countries.[4, 5]

Although bronchiolitis is the leading cause of hospitalization for US infants,[1] there is a lack of basic prospective data about the expected inpatient clinical course and ongoing uncertainty about when a hospitalized child is ready for discharge to home.[2] This lack of data about children's readiness for discharge may result in variable hospital length‐of‐stay (LOS).[3, 4, 5]

One specific source of variability in discharge readiness and LOS variability may be the lack of consensus about safe threshold oxygen saturation values for discharge in children hospitalized with bronchiolitis.[6, 7] In 2006, the Scottish Intercollegiate Guidelines Network recommended a discharge room air oxygen (RAO2) saturation threshold of 95%.[8] The same year, the American Academy of Pediatrics (AAP) bronchiolitis clinical practice guideline stated that oxygen is not needed for children with RAO2 saturations 90% who are feeding well and have minimal respiratory distress.[9] There is a need for prospective studies to help clinicians make evidenced‐based discharge decisions for this common condition.

We performed a prospective, multicenter, multiyear study[10, 11, 12] to examine the typical inpatient clinical course of and to develop hospital discharge guidelines for children age <2 years hospitalized with bronchiolitis. We hypothesized that children would not worsen clinically and would be safe to discharge home once their respiratory status improved and they were able to remain hydrated.

METHODS

RESULTS

There were 1916 children hospitalized with bronchiolitis with data on all factors used to define clinical improvement and clinical worsening. The median number of days from the beginning of difficulty breathing until admission was 2 days (IQR, 15.5 days; range, 18 days) and from the beginning of difficulty breathing until clinical improvement was 4 days (IQR, 37.5 days; range, 133 days) (Figure 1). The variance for days to admission was significantly less than the variance for days to clinical improvement (P<0.001).

Figure 1

In this observational study, clinicians discharged 214 (11%) of the 1916 children before meeting the definition of clinical improvement. Thus, 1702 (89%; 95% CI: 87%‐90%) children reached the clinical improvement criteria, had a LOS >1 day, and had data on all factors (Figure 2).

Figure 2

Of the 1702 children who met the clinical improvement criteria, there were 76 children (4%; 95% CI: 3%5%) who worsened (Figure 2). The worsening occurred within a median of 1 day (IQR, 13 days) of clinical improvement. Forty‐six (3%) of the children required transfer to the ICU (1 required intubation, 1 required continuous positive airway pressure, and 4 had apnea), 23 (1%) required oxygen, and 17 (1%) required IV fluids. Eight percent of children met multiple criteria for worsening. A comparison between children who did and did not worsen is shown in Table 1. In general, children who worsened after improvement were younger and born earlier. These children also presented in more severe respiratory distress, had moderate or severe retractions, oxygen saturation <85% at hospitalization, inadequate oral intake, and apnea documented during the hospitalization. Neither viral etiology nor site of care influenced whether the children worsened after improving. However, stratified analysis of children based on initial location of admission (ie, ICU or ward) showed that among the children admitted to the ICU from the emergency department (ED), 89% met the improvement criteria and 19% clinically worsened. In contrast, among children admitted to the ward from the ED, 89% met the improvement criteria, and only 2% clinically worsened. Stratified multivariable models based on the initial location of admission from the ED (ie, ICU or ward) were not possible due to small sample sizes after stratification. None of these children had relapse events requiring rehospitalization within either 24 hours or 7 days of discharge.

On multivariable analysis (Table 2), independent risk factors for worsening after reaching the clinical improvement criteria were young age, preterm birth, and presenting to care with more severe bronchiolitis represented by severe retractions, inadequate oral intake, or apnea. To further evaluate the improvement criteria in the current analysis, multiple sensitivity analyses were conducted. The frequency of clinical worsening after reaching the improvement criteria was stable when we examined different RA02 criteria in sensitivity analyses: (1) excluding RA02 as a criterion for improvement: 90% met improvement criteria and 4% experienced clinical worsening, (2) changing the average RA02 threshold for clinical improvement to 94%: 62% met improvement criteria and 6% experienced clinical worsening, and (3) changing the average RA02 threshold for clinical improvement to 95%: 47% met improvement criteria and 5% experienced clinical worsening. Furthermore, stratifying by age <2 months and restricting to more stringent definitions of bronchiolitis (ie, age <1 year or age <1 year+no history of wheezing) also did not materially change the results (see Supporting Figure 1 in the online version of this article).

We compared the 214 children who were discharged prior to reaching clinical improvement with the 1702 children who reached the clinical improvement criteria. The 214 children were less likely to be age <2 months (22% vs 30%; P=0.02). These 2 groups (214 vs 1702) were similar with respect to severe retractions (2% vs 4%; P=0.13), median respiratory rate (48 vs 48; P=0.42), oxygen saturation <90% (15% vs 11%; P=0.07), inadequate oral intake (50% vs 43%; P=0.13), and rates of relapse events requiring rehospitalization within both 24 hours (0.6% vs 0.6%; P=0.88) and 7 days (1% vs 1%; P=0.90) of discharge.

DISCUSSION

In this large, multicenter, multiyear study of children hospitalized with bronchiolitis, we found that children present to a hospital in a relatively narrow time frame, but their time to recovery in the hospital is highly variable. Nonetheless, 96% of children continued to improve once they had: (1) improving or stable retractions rated as none/mild, (2) a decreasing or stable RR by age, (3) estimated average RAO2 saturation 90% and lowest RAO2 saturation of 88%, and (4) were hydrated. The 4% of children who worsened after clinically improving were more likely to be age <2 months, born <37 weeks, and present with more severe distress (ie, severe retractions, inadequate oral intake, or apnea). Based on the low risk of worsening after clinical improvement, especially among children admitted to the regular ward (2%), we believe these 4 clinical criteria could be used as discharge criteria for this common pediatric illness with a predominantly monophasic clinical course.

Variability in hospital LOS for children with bronchiolitis exists in the United States[3] and internationally.[4, 5] Cheung and colleagues analyzed administrative data from over 75,000 children admitted for bronchiolitis in England between April 2007 and March 2010 and found sixfold variation in LOS between sites. They concluded that this LOS variability was due in part to providers' clinical decision making.[5] Srivastava and colleagues[23] addressed variable clinician decision making in bronchiolitis and 10 other common pediatric conditions by embedding discharge criteria developed by expert consensus into admission order sets. They found that for children with bronchiolitis, the embedded discharge criteria reduced the median LOS from 1.91 to 1.87 days. In contrast to the single‐center data presented by White and colleagues,[24] the prospective, multicenter MARC‐30 data provide a clear understanding of the normal clinical course for children hospitalized with bronchiolitis, determine if children clinically worsen after clinical improvement, and provide data about discharge criteria for children hospitalized with bronchiolitis. Although there is a lack of rigorous published data, the lower tract symptoms of bronchiolitis (eg, cough, retractions) are said to peak on days 5 to 7 of illness and then gradually resolve.[25] In the present study, we found that the time from the onset of difficulty breathing until hospital admission is less variable than the time from the onset of difficulty breathing until either clinical improvement or discharge. Although 75% of children have clinically improved within 7.5 days of difficulty breathing based on the IQR results, the remaining 25% may have a more prolonged recovery in the hospital of up to 3 weeks. Interestingly, prolonged recovery times from bronchiolitis have also been noted in children presenting to the ED[26] and in an outpatient population.[27] It is unclear why 20% to 25% of children at different levels of severity of illness have prolonged recovery from bronchiolitis, but this group of children requires further investigation.

Given the variability of recovery times, clinicians may have difficulty knowing when a child is ready for hospital discharge. One of the main stumbling blocks for discharge readiness in children with bronchiolitis is the interpretation of the oxygen saturation value.[6, 8, 9, 20, 28] However, it should be considered that interpreting the oxygen saturation in a child who is clinically improving in the hospital setting is different than interpreting the oxygen saturation of a child in the ED or the clinic whose clinical course is less certain.[22] In the hospital setting, using the oxygen saturation value in in the AAP guideline,[9] 4% of children clinically worsened after they met the improvement criteria, a clinical pattern observed previously with supplemental oxygen.[28] This unpredictability may explain some of the variation in providers' clinical decision making.[5] The children who worsened, and therefore deserve more cautious discharge planning, were young (<2 months), premature (<37 weeks gestational age), and presented in more severe distress. Those children admitted to the ICU from the ED worsened more commonly than children admitted to the ward (19% vs 2%). Interestingly, the viral etiology of the child's bronchiolitis did not influence whether a child worsened after reaching the improvement criteria. Therefore, although children with RV bronchiolitis have a shorter hospital LOS than children with RSV bronchiolitis,[11] the pattern of recovery did not differ by viral etiology.

In addition to unsafe discharges, clinicians may be concerned about the possibility of readmissions. Although somewhat controversial, hospital readmission is being used as a quality of care metric.[29, 30, 31] One response to minimize readmissions would be for clinicians to observe children for longer than clinically indicated.[32] However, shorter LOS is not necessarily associated with increased readmission rates.[33] Given that the geometric mean of hospital charges per child with bronchiolitis increased from $6380 in 2000 to $8530 in 2009,[34] the potential for safely reducing hospital LOS by using the discharge criteria proposed in the current study instead of other criteria[8] may net substantial cost savings. Furthermore, reducing LOS would decrease the time children expose others to these respiratory viruses and possibly reduce medical errors.[35]

Our study has some potential limitations. Because the study participants were all hospitalized, these data do not inform admission or discharge decisions from either the ED or the clinic; but other data address those clinical scenarios.[22] Also, the 16 sites that participated in this study were large, urban teaching hospitals. Consequently, these results are not necessarily generalizable to smaller community hospitals. Although numerous data points were required to enter the analytic cohort, only 9% of the sample was excluded for missing data. There were 214 children who did not meet our improvement criteria by the time of discharge. Although the inability to include these children in the analysis may be seen as a limitation, this practice variability underscores the need for more data about discharging hospitalized children with bronchiolitis. Last, site teams reviewed medical records daily. More frequent recording of the clinical course would have yielded more granular data, but the current methodology replicates how data are generally presented during patient care rounds, when decisions about suitability for discharge are often considered.

CONCLUSION

We documented in this large multicenter study that most children hospitalized with bronchiolitis had a wide range of time to recovery, but the vast majority continued to improve once they reached the identified clinical criteria that predict a safe discharge to home. The children who worsened after clinical improvement were more likely to be younger, premature infants presenting in more severe distress. Although additional prospective validation of these hospital discharge criteria is warranted, these data may help clinicians make more evidence‐based discharge decisions for a common pediatric illness with high practice variation, both in the United States[3] and in other countries.[4, 5]

Although bronchiolitis is the leading cause of hospitalization for US infants,[1] there is a lack of basic prospective data about the expected inpatient clinical course and ongoing uncertainty about when a hospitalized child is ready for discharge to home.[2] This lack of data about children's readiness for discharge may result in variable hospital length‐of‐stay (LOS).[3, 4, 5]

One specific source of variability in discharge readiness and LOS variability may be the lack of consensus about safe threshold oxygen saturation values for discharge in children hospitalized with bronchiolitis.[6, 7] In 2006, the Scottish Intercollegiate Guidelines Network recommended a discharge room air oxygen (RAO2) saturation threshold of 95%.[8] The same year, the American Academy of Pediatrics (AAP) bronchiolitis clinical practice guideline stated that oxygen is not needed for children with RAO2 saturations 90% who are feeding well and have minimal respiratory distress.[9] There is a need for prospective studies to help clinicians make evidenced‐based discharge decisions for this common condition.

We performed a prospective, multicenter, multiyear study[10, 11, 12] to examine the typical inpatient clinical course of and to develop hospital discharge guidelines for children age <2 years hospitalized with bronchiolitis. We hypothesized that children would not worsen clinically and would be safe to discharge home once their respiratory status improved and they were able to remain hydrated.

METHODS

RESULTS

There were 1916 children hospitalized with bronchiolitis with data on all factors used to define clinical improvement and clinical worsening. The median number of days from the beginning of difficulty breathing until admission was 2 days (IQR, 15.5 days; range, 18 days) and from the beginning of difficulty breathing until clinical improvement was 4 days (IQR, 37.5 days; range, 133 days) (Figure 1). The variance for days to admission was significantly less than the variance for days to clinical improvement (P<0.001).

Figure 1

In this observational study, clinicians discharged 214 (11%) of the 1916 children before meeting the definition of clinical improvement. Thus, 1702 (89%; 95% CI: 87%‐90%) children reached the clinical improvement criteria, had a LOS >1 day, and had data on all factors (Figure 2).

Figure 2

Of the 1702 children who met the clinical improvement criteria, there were 76 children (4%; 95% CI: 3%5%) who worsened (Figure 2). The worsening occurred within a median of 1 day (IQR, 13 days) of clinical improvement. Forty‐six (3%) of the children required transfer to the ICU (1 required intubation, 1 required continuous positive airway pressure, and 4 had apnea), 23 (1%) required oxygen, and 17 (1%) required IV fluids. Eight percent of children met multiple criteria for worsening. A comparison between children who did and did not worsen is shown in Table 1. In general, children who worsened after improvement were younger and born earlier. These children also presented in more severe respiratory distress, had moderate or severe retractions, oxygen saturation <85% at hospitalization, inadequate oral intake, and apnea documented during the hospitalization. Neither viral etiology nor site of care influenced whether the children worsened after improving. However, stratified analysis of children based on initial location of admission (ie, ICU or ward) showed that among the children admitted to the ICU from the emergency department (ED), 89% met the improvement criteria and 19% clinically worsened. In contrast, among children admitted to the ward from the ED, 89% met the improvement criteria, and only 2% clinically worsened. Stratified multivariable models based on the initial location of admission from the ED (ie, ICU or ward) were not possible due to small sample sizes after stratification. None of these children had relapse events requiring rehospitalization within either 24 hours or 7 days of discharge.

On multivariable analysis (Table 2), independent risk factors for worsening after reaching the clinical improvement criteria were young age, preterm birth, and presenting to care with more severe bronchiolitis represented by severe retractions, inadequate oral intake, or apnea. To further evaluate the improvement criteria in the current analysis, multiple sensitivity analyses were conducted. The frequency of clinical worsening after reaching the improvement criteria was stable when we examined different RA02 criteria in sensitivity analyses: (1) excluding RA02 as a criterion for improvement: 90% met improvement criteria and 4% experienced clinical worsening, (2) changing the average RA02 threshold for clinical improvement to 94%: 62% met improvement criteria and 6% experienced clinical worsening, and (3) changing the average RA02 threshold for clinical improvement to 95%: 47% met improvement criteria and 5% experienced clinical worsening. Furthermore, stratifying by age <2 months and restricting to more stringent definitions of bronchiolitis (ie, age <1 year or age <1 year+no history of wheezing) also did not materially change the results (see Supporting Figure 1 in the online version of this article).

We compared the 214 children who were discharged prior to reaching clinical improvement with the 1702 children who reached the clinical improvement criteria. The 214 children were less likely to be age <2 months (22% vs 30%; P=0.02). These 2 groups (214 vs 1702) were similar with respect to severe retractions (2% vs 4%; P=0.13), median respiratory rate (48 vs 48; P=0.42), oxygen saturation <90% (15% vs 11%; P=0.07), inadequate oral intake (50% vs 43%; P=0.13), and rates of relapse events requiring rehospitalization within both 24 hours (0.6% vs 0.6%; P=0.88) and 7 days (1% vs 1%; P=0.90) of discharge.

DISCUSSION

In this large, multicenter, multiyear study of children hospitalized with bronchiolitis, we found that children present to a hospital in a relatively narrow time frame, but their time to recovery in the hospital is highly variable. Nonetheless, 96% of children continued to improve once they had: (1) improving or stable retractions rated as none/mild, (2) a decreasing or stable RR by age, (3) estimated average RAO2 saturation 90% and lowest RAO2 saturation of 88%, and (4) were hydrated. The 4% of children who worsened after clinically improving were more likely to be age <2 months, born <37 weeks, and present with more severe distress (ie, severe retractions, inadequate oral intake, or apnea). Based on the low risk of worsening after clinical improvement, especially among children admitted to the regular ward (2%), we believe these 4 clinical criteria could be used as discharge criteria for this common pediatric illness with a predominantly monophasic clinical course.

Variability in hospital LOS for children with bronchiolitis exists in the United States[3] and internationally.[4, 5] Cheung and colleagues analyzed administrative data from over 75,000 children admitted for bronchiolitis in England between April 2007 and March 2010 and found sixfold variation in LOS between sites. They concluded that this LOS variability was due in part to providers' clinical decision making.[5] Srivastava and colleagues[23] addressed variable clinician decision making in bronchiolitis and 10 other common pediatric conditions by embedding discharge criteria developed by expert consensus into admission order sets. They found that for children with bronchiolitis, the embedded discharge criteria reduced the median LOS from 1.91 to 1.87 days. In contrast to the single‐center data presented by White and colleagues,[24] the prospective, multicenter MARC‐30 data provide a clear understanding of the normal clinical course for children hospitalized with bronchiolitis, determine if children clinically worsen after clinical improvement, and provide data about discharge criteria for children hospitalized with bronchiolitis. Although there is a lack of rigorous published data, the lower tract symptoms of bronchiolitis (eg, cough, retractions) are said to peak on days 5 to 7 of illness and then gradually resolve.[25] In the present study, we found that the time from the onset of difficulty breathing until hospital admission is less variable than the time from the onset of difficulty breathing until either clinical improvement or discharge. Although 75% of children have clinically improved within 7.5 days of difficulty breathing based on the IQR results, the remaining 25% may have a more prolonged recovery in the hospital of up to 3 weeks. Interestingly, prolonged recovery times from bronchiolitis have also been noted in children presenting to the ED[26] and in an outpatient population.[27] It is unclear why 20% to 25% of children at different levels of severity of illness have prolonged recovery from bronchiolitis, but this group of children requires further investigation.

Given the variability of recovery times, clinicians may have difficulty knowing when a child is ready for hospital discharge. One of the main stumbling blocks for discharge readiness in children with bronchiolitis is the interpretation of the oxygen saturation value.[6, 8, 9, 20, 28] However, it should be considered that interpreting the oxygen saturation in a child who is clinically improving in the hospital setting is different than interpreting the oxygen saturation of a child in the ED or the clinic whose clinical course is less certain.[22] In the hospital setting, using the oxygen saturation value in in the AAP guideline,[9] 4% of children clinically worsened after they met the improvement criteria, a clinical pattern observed previously with supplemental oxygen.[28] This unpredictability may explain some of the variation in providers' clinical decision making.[5] The children who worsened, and therefore deserve more cautious discharge planning, were young (<2 months), premature (<37 weeks gestational age), and presented in more severe distress. Those children admitted to the ICU from the ED worsened more commonly than children admitted to the ward (19% vs 2%). Interestingly, the viral etiology of the child's bronchiolitis did not influence whether a child worsened after reaching the improvement criteria. Therefore, although children with RV bronchiolitis have a shorter hospital LOS than children with RSV bronchiolitis,[11] the pattern of recovery did not differ by viral etiology.

In addition to unsafe discharges, clinicians may be concerned about the possibility of readmissions. Although somewhat controversial, hospital readmission is being used as a quality of care metric.[29, 30, 31] One response to minimize readmissions would be for clinicians to observe children for longer than clinically indicated.[32] However, shorter LOS is not necessarily associated with increased readmission rates.[33] Given that the geometric mean of hospital charges per child with bronchiolitis increased from $6380 in 2000 to $8530 in 2009,[34] the potential for safely reducing hospital LOS by using the discharge criteria proposed in the current study instead of other criteria[8] may net substantial cost savings. Furthermore, reducing LOS would decrease the time children expose others to these respiratory viruses and possibly reduce medical errors.[35]

Our study has some potential limitations. Because the study participants were all hospitalized, these data do not inform admission or discharge decisions from either the ED or the clinic; but other data address those clinical scenarios.[22] Also, the 16 sites that participated in this study were large, urban teaching hospitals. Consequently, these results are not necessarily generalizable to smaller community hospitals. Although numerous data points were required to enter the analytic cohort, only 9% of the sample was excluded for missing data. There were 214 children who did not meet our improvement criteria by the time of discharge. Although the inability to include these children in the analysis may be seen as a limitation, this practice variability underscores the need for more data about discharging hospitalized children with bronchiolitis. Last, site teams reviewed medical records daily. More frequent recording of the clinical course would have yielded more granular data, but the current methodology replicates how data are generally presented during patient care rounds, when decisions about suitability for discharge are often considered.

CONCLUSION

We documented in this large multicenter study that most children hospitalized with bronchiolitis had a wide range of time to recovery, but the vast majority continued to improve once they reached the identified clinical criteria that predict a safe discharge to home. The children who worsened after clinical improvement were more likely to be younger, premature infants presenting in more severe distress. Although additional prospective validation of these hospital discharge criteria is warranted, these data may help clinicians make more evidence‐based discharge decisions for a common pediatric illness with high practice variation, both in the United States[3] and in other countries.[4, 5]

Currently, 3%5% of infants under a year of age will be admitted to a hospital for acute viral bronchiolitis each year, making it the leading cause of hospitalization in children.15 The American Academy of Pediatrics guideline on the diagnosis and management of bronchiolitis advocates primarily supportive care for this self‐limited disease.6 Specifically, the routine use of therapies such as bronchodilators and corticosteroids are not recommended, nor is routine evaluation with diagnostic testing.6 Numerous studies have established the presence of unwarranted variation in most aspects of bronchiolitis care,713 and the current evidence does not support the routine usage of specific interventions in inpatients.1418

Acute bronchiolitis accounts for direct inpatient medical costs of over $500 million per year.19 Based on estimates from the Healthcare Utilization Project Kids' Inpatient Database, acute bronchiolitis is second only to respiratory distress syndrome as the most expensive disease of hospitalized children.1 Although charges may not correlate directly with costs or even the actual intensity of resource utilization, the national bill, based on charges, is approximately 1.4 billion dollars per year.1 Either way, the leading cause of hospitalization in children is expensive and suffers from dramatic variation in care characterized by overutilization of ineffective interventions.

Evidence‐based guidelines for bronchiolitis are readily available and their successful adoption within larger, academic children's hospitals has been demonstrated.2028 However, upwards of 70% of all children in this country are cared for outside of freestanding children's hospitals,1 and very little has been published about wide dissemination of evidence‐based guidelines in these settings.29 In 2008, the Value in Inpatient Pediatrics (VIP) network was created, as an inclusive pediatric inpatient quality improvement collaborative with a focus on linking academic and community‐based hospitalist groups, to disseminate evidence‐based management strategies for bronchiolitis. We hypothesized that group norming, through benchmarking and public goal setting at the level of the hospitalist group, would decrease overall utilization of nonevidence‐based therapies. Specifically, we were trying to decrease the utilization of bronchodilators, steroids, chest physiotherapy, chest radiography, and viral testing in hospitalized children diagnosed with uncomplicated bronchiolitis.

METHODS

Beginning in early 2008, we recruited pediatric hospitalists into a voluntary bronchiolitis quality improvement collaborative from within the community of hospitalists created by the American Academy of Pediatrics Section on Hospital Medicine. Participants were recruited through open calls at national conferences and mass e‐mails to the section membership through the listserve. The guiding principle for the collaborative was the idea that institutional adoption of evidence‐based disease‐management strategies would result in higher value of care, and that this process could be facilitated by benchmarking local performance against norms created within the larger community. We used group consensus to identify the therapies and tests to benchmark, although the chosen measures meshed with those addressed in the American Academy of Pediatrics (AAP) clinical practice guideline. Use of bronchodilators, corticosteroids, chest physiotherapy, chest radiography, and viral testing were all felt to be significantly overutilized in participating clinical sites. We were unaware of any published national targets for utilization of these therapies or tests, and none of the participating hospitalist groups was actively benchmarking their utilization against any peer group at the start of the project. Length of stay, rates of readmission within 72 hours of discharge, and variable direct costs were chosen as balancing measures for the project.

We collected data on hospitalizations for bronchiolitis for 4 calendar years, from 2007 through 2010, based on the following inclusion criteria: children under 24 months of age, hospitalized for the primary diagnosis of acute viral bronchiolitis as defined by International Classification of Diseases, Ninth Revision (ICD‐9) codes 466.11 and 466.19. We specifically included patients who were in observation status as well as those in inpatient status, and excluded all intensive care unit admissions. Other exclusions were specific ICD‐9 codes for: chronic lung diseases, asthma, chromosomal abnormalities, heart disease, and neurological diseases. We then tracked overall utilization of any bronchodilator (albuterol, levalbuterol, epinephrine, or ipratropium) during the hospitalization, including the emergency department; total number of bronchodilator doses per patient; utilization of any corticosteroids (inhaled or systemic); chest radiography; respiratory syncytial virus (RSV) testing; and chest physiotherapy; as well as variable direct costs per hospitalization for each center. A standardized toolkit was provided to participating centers to facilitate data collection. Data was sought from administrative sources, collected in aggregate form and not at the patient level, and no protected health information was collected as part of the project. The project was categorized as exempt by the University of Texas Health Science Center San Antonio Institutional Review Board, the location of the data repository.

The project began in 2008, though we requested that centers provide 2007 data to supplement our baseline. We held the first group meeting in July 2009 and began the facilitated sharing of resources to promote evidence‐based care, such as guidelines, protocols, respiratory scores, and patient handouts, across sites using data from 2007 and 2008 as our baseline for benchmarking and later assessing any improvement. Centers adopted guidelines at their own pace and we did not require guideline adoption for continued participation. We provided summaries of the available literature by topic, in the event that site leaders wished to give institutional grand rounds or other presentations. All dissemination of guidelines or protocols was done based on the request of the center, and no specific resource was created or sanctioned by the group, though the AAP Guideline for the Diagnosis and Management of Bronchiolitis6 remained a guiding document. Some of our centers participated in more extensive collaborative projects which involved small‐group goal setting, adoption of similar protocols, and conference calls, though this never encompassed more than 25% of the network.

The main product of the project was a yearly report benchmarking each hospital against the network average on each of our chosen utilization measures. The first report was disseminated in July 2009 and included data on calendar year 2007 and 2008, which we considered our group baseline. Most institutions began local Plan‐Do‐Study‐Act (PDSA) cycles by mid‐2009 using the data we provided as they benchmarked their performance against other members of the collaborative, and these continued through 2010. Hospitals were coded and remained anonymous. However, we publicly honored the high performers within the network at a yearly meeting, and urged these centers to share their tools and strategies, which was facilitated through a project Web site.30 All participation was voluntary, and all costs were borne by individuals or their respective centers.

In order to assess data quality, we undertook a validation project for calendar year 2009. We requested local direct chart review of a 10% sample, or a minimum of 10 charts, to confirm reported utilization rates for the therapies and tests we tracked. Any center with less than 80% accuracy was then asked to review data collection methods and make adjustments accordingly. One center identified and resolved a significant data discrepancy and 2 centers refused to participate in the validation project, citing their participation in a large national database for which there was already a very rigorous data validation process (Child Health Corporation of America's Pediatric Health Information System database). Given that we did not uncover major discrepancies in data quality within our network, we did not request further data validation but rather promoted year‐to‐year consistency of collection methods, seeking to collect the same type/quality of data that hospitals use in their own internal performance assessments.

Statistical analyses were performed using GraphPad InStat, version 3.0 (GraphPad Software, San Diego, CA). Descriptive statistics (including interquartile range ([IQR], the range from 25th to 75th percentile of the data) are provided. Analysis of process measures over the series of years was performed using repeated measures analysis of variance (ANOVA), as were intra‐hospital comparisons for all measures. Hospitals were not weighted by volume of admissions, ie, the unit of analysis was the hospital and not individual hospitalizations. Data were analyzed for normality using the method of Kolmogorov and Smirnoff, and in cases where normality was not satisfied (steroids and chest physiotherapy), the data were transformed and nonparametric methods were used. Post‐test adjustment for multiple comparisons was done using the TukeyKramer test in cases where ANOVA P values were <0.05. Fisher's exact test was used to analyze contingency tables for categorical variables such as presence or absence of a protocol.

RESULTS

Data encompassing 11,568 bronchiolitis hospitalizations in 17 centers, for calendar years 2007 to 2010, were analyzed for this report. A total of 31 centers ever participated in the project; however, this report is restricted to centers who participated for the entirety of the project from 2008 through 2010, and who consented to have their data reported. Specifically, 18 centers met inclusion criteria and 1 center opted out of the project, leaving the 17 centers described in Table 1. The overall network makeup shifted each year, but was always more than 80% non‐freestanding children's hospitals and approximately 30% urban, as defined as located in a population center of more than 1 million. A large majority of the participants did not have a local bronchiolitis protocol or guideline at the start of the project, although 88% of participants adopted some form of protocolized care by 2010. Calendar years 2007 and 2008 served as our network baseline, with most interventions (in institutions where they occurred) begun by calendar year 2009. The level of intervention varied greatly among institutions, with a few institutions doing nothing more than benchmarking their performance.

Mean length of stay (LOS), readmission rates, and variable direct costs did not differ significantly during the project time period. Mean LOS for the network ranged from a low of 2.4 days (IQR, 2.22.8 days) to a high of 2.7 days (IQR, 2.43.1 days), and mean readmission rates ranged from 1.2% (IQR, 0.7%1.8%) to 1.7% (IQR, 0.7%2.5%) during the project. Mean variable direct costs ranged from $1639 (IQR, $1383$1864) to $1767 (IQR, $1365$2320).

Table 2 describes the mean overall utilization of bronchodilators, chest radiography, RSV testing, steroids, and chest physiotherapy among the group from 2007 to 2010. By 2010, we saw a 46% decline in the volume of bronchodilator used within the network, a 3.6 (95% confidence interval [CI] 1.45.8) dose per patient absolute decrease (P < 0.01). We also saw a 12% (95% CI 5%25%) absolute decline in the overall percentage of patients exposed to any bronchodilator (P < 0.01). Finally, there was a 10% (95% CI 3%18%) absolute decline in the overall utilization of any chest physiotherapy (P < 0.01). The project did not demonstrate a significant impact on utilization of corticosteroids, chest radiography, or viral testing, although several centers achieved significant decreases on a local level (data not shown).

We analyzed within‐hospital trends as well. Figure 1 describes intra‐hospital change over the course of the project for overall bronchodilator usage. In this analysis, 15 of 17 hospitals (88%) achieved a significant decrease in overall bronchodilator utilization by 2010. (Hospitals 27 and 29 were unable to provide 2007 baseline data.) For doses per patient, 15 of 17 institutions provided data on this measure, and 12 of 15 (80%) achieved significant decreases (Figure 2). Of note, the institutions failing to achieve significant decreases in bronchodilator utilization entered the project with utilization rates that were already significantly below network mean at the start of the project. (Institutions failing to improve are denoted with an asterisk in Figures 1 and 2.) Since most institutions made significant improvements in bronchodilator utilization over time, we looked for correlates of failure to decrease utilization. The strongest association for failure to improve during the project period was use of a protocol prior to joining the network (odds ratio [OR] = 11, 95% CI 261).

Figure 1

Figure 2

DISCUSSION

We demonstrated a significant decline in utilization of bronchodilators and chest physiotherapy in inpatient bronchiolitis within a voluntary quality collaborative focused on benchmarking without employing intensive interventions. This observation is important in that it demonstrates real‐world efficacy for our methods. Prior literature has clearly demonstrated that local bronchiolitis guidelines are effective; however, our data on over 11,000 hospitalizations from a broad array of inpatient settings continue to show a high rate of overutilization. We facilitated dissemination and sharing of guideline‐related tools primarily electronically, and capitalized on perceived peer‐group frustration with inefficient management of a high‐volume, high‐utilization disease. While the project leadership had varying degrees of advanced training in quality improvement methodology, the majority of the site leaders were self‐taught and trained while on the job. Our inclusive collaborative had some success using pragmatic and low‐resource methods which we believe is a novel approach to the issue of overutilization.

These considerations are highlighted given the pressing need to find more efficient and scalable means of bending the cost curve of healthcare in the United States. Learning collaboratives are a relatively new model for improvement, with some history in pediatrics,31, 32 and are attractive because of their potential to generate both widespread capacity for change as well as direct improvement. Both cystic fibrosis31 and neonatology collaboratives32 have been celebrated for their positive impacts on children's healthcare, and both are testaments to the power inherent in creating a community of like‐minded individuals. One of the most popular models for learning collaboratives remains the Institute for Healthcare Improvement's Breakthrough Series; however, this model is resource intensive in that it typically involves large teams and several yearly face‐to‐face meetings, with significant monetary investment on the part of hospitals. On the other hand, virtual collaboratives have produced mixed results with respect to quality improvement,33 so there is a continued need to maximize our learning about what works efficiently. Our collaborative was able to successfully disseminate tools developed in large academic institutions to be applied in smaller and more varied settings, where resources for quality improvement activities were limited.

One possible reason for any successes in this project was the existence of a well‐known guideline for the management of bronchiolitis published by the American Academy of Pediatrics in 2006. This guideline recommends primarily symptomatic care, and has a statement supporting the contention that routine use of our targeted therapies is unnecessary. It allows for a trial of bronchodilator, but specifically states that all trials should be accompanied by the use of an objective measure of improvement (typically interpreted to mean a respiratory distress score). A guideline sanctioned by an important national organization of pediatricians was invaluable, and we believe that it should serve as a basis for any nationally promoted inpatient quality measure for this very common pediatric illness. The existence of the AAP guideline also highlights the possibility that our results are merely representative of secular trends in utilization in bronchiolitis care, since we had no control group. The available literature on national guidelines has shown mixed and quite modest impacts in other countries.28, 34 Most of our group took active steps to operationalize the guidelines as part of their participation in this collaborative, though they might have done similar work anyway due to the increasing importance of quality improvement in hospitalist culture over the years of the project.

The project did not demonstrate any impact on steroid utilization, or on rates of obtaining chest radiography or viral testing, despite expressly targeting these widely overused interventions. These modalities are often employed in the emergency department and, as a collaborative of pediatric hospitalists, we did not have specific emergency department participation which we recognize as a major weakness and potential impediment to further progress. We hope to collaborate with our respective emergency departments in the future on these particular measures. We also noted that many institutions were inflexible about foregoing viral testing, due to infection control issues arising from the need to cohort patients in shared rooms based on RSV positivity during the busy winter months. A few institutions were able to alter their infection control policies using the strategy of assuming all children with bronchiolitis had RSV (ie, choosing to use both contact precautions and to wear a mask when entering rooms), though this was not universally popular. Finally, we recognize a missed opportunity in not collecting dose per patient level data for steroids, which might have allowed us to distinguish hospitals with ongoing inpatient utilization of steroids from those with only emergency department usage.

Another significant limitation of this project was the lack of annual assessments of data quality. However, we believe our findings are still useful and important, even with this obvious limitation. Most quality improvement work is done using hospital‐supplied data gleaned from administrative databases, exactly the sources used in this project. Key decisions are made in most hospitals in the country based on data of similar quality. Further limitations of the project relate to the issue of replicability. The disease process we addressed is a major source of frustration to pediatric hospitalists, and our sample likely consisted of the most highly motivated individuals, as they sought out and joined a group with the express purpose of decreasing unnecessary utilization in bronchiolitis. We believe this limitation highlights the likely need for quality measures to emerge organically out of a community of practice when resources are limited, ie, we do not believe we would have had significant success using our methods with an unpopular or externally imposed quality measure.

Although a detailed analysis of costs was beyond the scope of the current project, it is possible that decreased utilization resulted in overall cost savings, despite the fact that our data did not demonstrate a significant change in network‐level average variable direct costs related to bronchiolitis. It has been suggested that such savings may be particularly difficult to demonstrate objectively, especially when the principal costs targeted are labor‐based.35 LOS did not significantly vary during the project, whereas the use of labor‐intensive therapies like nebulized bronchodilators and chest physiotherapy declined. It is, however, quite possible that the decreased utilization we demonstrated was accompanied by a concomitant increase in utilization of other unmeasured therapies.

CONCLUSIONS

A volunteer, peer‐group collaborative focused on benchmarking decreased utilization of bronchodilators and chest physiotherapy in bronchiolitis, though had no impact on overuse of other unnecessary therapies and tests.

Currently, 3%5% of infants under a year of age will be admitted to a hospital for acute viral bronchiolitis each year, making it the leading cause of hospitalization in children.15 The American Academy of Pediatrics guideline on the diagnosis and management of bronchiolitis advocates primarily supportive care for this self‐limited disease.6 Specifically, the routine use of therapies such as bronchodilators and corticosteroids are not recommended, nor is routine evaluation with diagnostic testing.6 Numerous studies have established the presence of unwarranted variation in most aspects of bronchiolitis care,713 and the current evidence does not support the routine usage of specific interventions in inpatients.1418

Acute bronchiolitis accounts for direct inpatient medical costs of over $500 million per year.19 Based on estimates from the Healthcare Utilization Project Kids' Inpatient Database, acute bronchiolitis is second only to respiratory distress syndrome as the most expensive disease of hospitalized children.1 Although charges may not correlate directly with costs or even the actual intensity of resource utilization, the national bill, based on charges, is approximately 1.4 billion dollars per year.1 Either way, the leading cause of hospitalization in children is expensive and suffers from dramatic variation in care characterized by overutilization of ineffective interventions.

Evidence‐based guidelines for bronchiolitis are readily available and their successful adoption within larger, academic children's hospitals has been demonstrated.2028 However, upwards of 70% of all children in this country are cared for outside of freestanding children's hospitals,1 and very little has been published about wide dissemination of evidence‐based guidelines in these settings.29 In 2008, the Value in Inpatient Pediatrics (VIP) network was created, as an inclusive pediatric inpatient quality improvement collaborative with a focus on linking academic and community‐based hospitalist groups, to disseminate evidence‐based management strategies for bronchiolitis. We hypothesized that group norming, through benchmarking and public goal setting at the level of the hospitalist group, would decrease overall utilization of nonevidence‐based therapies. Specifically, we were trying to decrease the utilization of bronchodilators, steroids, chest physiotherapy, chest radiography, and viral testing in hospitalized children diagnosed with uncomplicated bronchiolitis.

METHODS

Beginning in early 2008, we recruited pediatric hospitalists into a voluntary bronchiolitis quality improvement collaborative from within the community of hospitalists created by the American Academy of Pediatrics Section on Hospital Medicine. Participants were recruited through open calls at national conferences and mass e‐mails to the section membership through the listserve. The guiding principle for the collaborative was the idea that institutional adoption of evidence‐based disease‐management strategies would result in higher value of care, and that this process could be facilitated by benchmarking local performance against norms created within the larger community. We used group consensus to identify the therapies and tests to benchmark, although the chosen measures meshed with those addressed in the American Academy of Pediatrics (AAP) clinical practice guideline. Use of bronchodilators, corticosteroids, chest physiotherapy, chest radiography, and viral testing were all felt to be significantly overutilized in participating clinical sites. We were unaware of any published national targets for utilization of these therapies or tests, and none of the participating hospitalist groups was actively benchmarking their utilization against any peer group at the start of the project. Length of stay, rates of readmission within 72 hours of discharge, and variable direct costs were chosen as balancing measures for the project.

We collected data on hospitalizations for bronchiolitis for 4 calendar years, from 2007 through 2010, based on the following inclusion criteria: children under 24 months of age, hospitalized for the primary diagnosis of acute viral bronchiolitis as defined by International Classification of Diseases, Ninth Revision (ICD‐9) codes 466.11 and 466.19. We specifically included patients who were in observation status as well as those in inpatient status, and excluded all intensive care unit admissions. Other exclusions were specific ICD‐9 codes for: chronic lung diseases, asthma, chromosomal abnormalities, heart disease, and neurological diseases. We then tracked overall utilization of any bronchodilator (albuterol, levalbuterol, epinephrine, or ipratropium) during the hospitalization, including the emergency department; total number of bronchodilator doses per patient; utilization of any corticosteroids (inhaled or systemic); chest radiography; respiratory syncytial virus (RSV) testing; and chest physiotherapy; as well as variable direct costs per hospitalization for each center. A standardized toolkit was provided to participating centers to facilitate data collection. Data was sought from administrative sources, collected in aggregate form and not at the patient level, and no protected health information was collected as part of the project. The project was categorized as exempt by the University of Texas Health Science Center San Antonio Institutional Review Board, the location of the data repository.

The project began in 2008, though we requested that centers provide 2007 data to supplement our baseline. We held the first group meeting in July 2009 and began the facilitated sharing of resources to promote evidence‐based care, such as guidelines, protocols, respiratory scores, and patient handouts, across sites using data from 2007 and 2008 as our baseline for benchmarking and later assessing any improvement. Centers adopted guidelines at their own pace and we did not require guideline adoption for continued participation. We provided summaries of the available literature by topic, in the event that site leaders wished to give institutional grand rounds or other presentations. All dissemination of guidelines or protocols was done based on the request of the center, and no specific resource was created or sanctioned by the group, though the AAP Guideline for the Diagnosis and Management of Bronchiolitis6 remained a guiding document. Some of our centers participated in more extensive collaborative projects which involved small‐group goal setting, adoption of similar protocols, and conference calls, though this never encompassed more than 25% of the network.

The main product of the project was a yearly report benchmarking each hospital against the network average on each of our chosen utilization measures. The first report was disseminated in July 2009 and included data on calendar year 2007 and 2008, which we considered our group baseline. Most institutions began local Plan‐Do‐Study‐Act (PDSA) cycles by mid‐2009 using the data we provided as they benchmarked their performance against other members of the collaborative, and these continued through 2010. Hospitals were coded and remained anonymous. However, we publicly honored the high performers within the network at a yearly meeting, and urged these centers to share their tools and strategies, which was facilitated through a project Web site.30 All participation was voluntary, and all costs were borne by individuals or their respective centers.

In order to assess data quality, we undertook a validation project for calendar year 2009. We requested local direct chart review of a 10% sample, or a minimum of 10 charts, to confirm reported utilization rates for the therapies and tests we tracked. Any center with less than 80% accuracy was then asked to review data collection methods and make adjustments accordingly. One center identified and resolved a significant data discrepancy and 2 centers refused to participate in the validation project, citing their participation in a large national database for which there was already a very rigorous data validation process (Child Health Corporation of America's Pediatric Health Information System database). Given that we did not uncover major discrepancies in data quality within our network, we did not request further data validation but rather promoted year‐to‐year consistency of collection methods, seeking to collect the same type/quality of data that hospitals use in their own internal performance assessments.

Statistical analyses were performed using GraphPad InStat, version 3.0 (GraphPad Software, San Diego, CA). Descriptive statistics (including interquartile range ([IQR], the range from 25th to 75th percentile of the data) are provided. Analysis of process measures over the series of years was performed using repeated measures analysis of variance (ANOVA), as were intra‐hospital comparisons for all measures. Hospitals were not weighted by volume of admissions, ie, the unit of analysis was the hospital and not individual hospitalizations. Data were analyzed for normality using the method of Kolmogorov and Smirnoff, and in cases where normality was not satisfied (steroids and chest physiotherapy), the data were transformed and nonparametric methods were used. Post‐test adjustment for multiple comparisons was done using the TukeyKramer test in cases where ANOVA P values were <0.05. Fisher's exact test was used to analyze contingency tables for categorical variables such as presence or absence of a protocol.

RESULTS

Data encompassing 11,568 bronchiolitis hospitalizations in 17 centers, for calendar years 2007 to 2010, were analyzed for this report. A total of 31 centers ever participated in the project; however, this report is restricted to centers who participated for the entirety of the project from 2008 through 2010, and who consented to have their data reported. Specifically, 18 centers met inclusion criteria and 1 center opted out of the project, leaving the 17 centers described in Table 1. The overall network makeup shifted each year, but was always more than 80% non‐freestanding children's hospitals and approximately 30% urban, as defined as located in a population center of more than 1 million. A large majority of the participants did not have a local bronchiolitis protocol or guideline at the start of the project, although 88% of participants adopted some form of protocolized care by 2010. Calendar years 2007 and 2008 served as our network baseline, with most interventions (in institutions where they occurred) begun by calendar year 2009. The level of intervention varied greatly among institutions, with a few institutions doing nothing more than benchmarking their performance.

Mean length of stay (LOS), readmission rates, and variable direct costs did not differ significantly during the project time period. Mean LOS for the network ranged from a low of 2.4 days (IQR, 2.22.8 days) to a high of 2.7 days (IQR, 2.43.1 days), and mean readmission rates ranged from 1.2% (IQR, 0.7%1.8%) to 1.7% (IQR, 0.7%2.5%) during the project. Mean variable direct costs ranged from $1639 (IQR, $1383$1864) to $1767 (IQR, $1365$2320).

Table 2 describes the mean overall utilization of bronchodilators, chest radiography, RSV testing, steroids, and chest physiotherapy among the group from 2007 to 2010. By 2010, we saw a 46% decline in the volume of bronchodilator used within the network, a 3.6 (95% confidence interval [CI] 1.45.8) dose per patient absolute decrease (P < 0.01). We also saw a 12% (95% CI 5%25%) absolute decline in the overall percentage of patients exposed to any bronchodilator (P < 0.01). Finally, there was a 10% (95% CI 3%18%) absolute decline in the overall utilization of any chest physiotherapy (P < 0.01). The project did not demonstrate a significant impact on utilization of corticosteroids, chest radiography, or viral testing, although several centers achieved significant decreases on a local level (data not shown).

We analyzed within‐hospital trends as well. Figure 1 describes intra‐hospital change over the course of the project for overall bronchodilator usage. In this analysis, 15 of 17 hospitals (88%) achieved a significant decrease in overall bronchodilator utilization by 2010. (Hospitals 27 and 29 were unable to provide 2007 baseline data.) For doses per patient, 15 of 17 institutions provided data on this measure, and 12 of 15 (80%) achieved significant decreases (Figure 2). Of note, the institutions failing to achieve significant decreases in bronchodilator utilization entered the project with utilization rates that were already significantly below network mean at the start of the project. (Institutions failing to improve are denoted with an asterisk in Figures 1 and 2.) Since most institutions made significant improvements in bronchodilator utilization over time, we looked for correlates of failure to decrease utilization. The strongest association for failure to improve during the project period was use of a protocol prior to joining the network (odds ratio [OR] = 11, 95% CI 261).

Figure 1

Figure 2

DISCUSSION

We demonstrated a significant decline in utilization of bronchodilators and chest physiotherapy in inpatient bronchiolitis within a voluntary quality collaborative focused on benchmarking without employing intensive interventions. This observation is important in that it demonstrates real‐world efficacy for our methods. Prior literature has clearly demonstrated that local bronchiolitis guidelines are effective; however, our data on over 11,000 hospitalizations from a broad array of inpatient settings continue to show a high rate of overutilization. We facilitated dissemination and sharing of guideline‐related tools primarily electronically, and capitalized on perceived peer‐group frustration with inefficient management of a high‐volume, high‐utilization disease. While the project leadership had varying degrees of advanced training in quality improvement methodology, the majority of the site leaders were self‐taught and trained while on the job. Our inclusive collaborative had some success using pragmatic and low‐resource methods which we believe is a novel approach to the issue of overutilization.

These considerations are highlighted given the pressing need to find more efficient and scalable means of bending the cost curve of healthcare in the United States. Learning collaboratives are a relatively new model for improvement, with some history in pediatrics,31, 32 and are attractive because of their potential to generate both widespread capacity for change as well as direct improvement. Both cystic fibrosis31 and neonatology collaboratives32 have been celebrated for their positive impacts on children's healthcare, and both are testaments to the power inherent in creating a community of like‐minded individuals. One of the most popular models for learning collaboratives remains the Institute for Healthcare Improvement's Breakthrough Series; however, this model is resource intensive in that it typically involves large teams and several yearly face‐to‐face meetings, with significant monetary investment on the part of hospitals. On the other hand, virtual collaboratives have produced mixed results with respect to quality improvement,33 so there is a continued need to maximize our learning about what works efficiently. Our collaborative was able to successfully disseminate tools developed in large academic institutions to be applied in smaller and more varied settings, where resources for quality improvement activities were limited.

One possible reason for any successes in this project was the existence of a well‐known guideline for the management of bronchiolitis published by the American Academy of Pediatrics in 2006. This guideline recommends primarily symptomatic care, and has a statement supporting the contention that routine use of our targeted therapies is unnecessary. It allows for a trial of bronchodilator, but specifically states that all trials should be accompanied by the use of an objective measure of improvement (typically interpreted to mean a respiratory distress score). A guideline sanctioned by an important national organization of pediatricians was invaluable, and we believe that it should serve as a basis for any nationally promoted inpatient quality measure for this very common pediatric illness. The existence of the AAP guideline also highlights the possibility that our results are merely representative of secular trends in utilization in bronchiolitis care, since we had no control group. The available literature on national guidelines has shown mixed and quite modest impacts in other countries.28, 34 Most of our group took active steps to operationalize the guidelines as part of their participation in this collaborative, though they might have done similar work anyway due to the increasing importance of quality improvement in hospitalist culture over the years of the project.

The project did not demonstrate any impact on steroid utilization, or on rates of obtaining chest radiography or viral testing, despite expressly targeting these widely overused interventions. These modalities are often employed in the emergency department and, as a collaborative of pediatric hospitalists, we did not have specific emergency department participation which we recognize as a major weakness and potential impediment to further progress. We hope to collaborate with our respective emergency departments in the future on these particular measures. We also noted that many institutions were inflexible about foregoing viral testing, due to infection control issues arising from the need to cohort patients in shared rooms based on RSV positivity during the busy winter months. A few institutions were able to alter their infection control policies using the strategy of assuming all children with bronchiolitis had RSV (ie, choosing to use both contact precautions and to wear a mask when entering rooms), though this was not universally popular. Finally, we recognize a missed opportunity in not collecting dose per patient level data for steroids, which might have allowed us to distinguish hospitals with ongoing inpatient utilization of steroids from those with only emergency department usage.

Another significant limitation of this project was the lack of annual assessments of data quality. However, we believe our findings are still useful and important, even with this obvious limitation. Most quality improvement work is done using hospital‐supplied data gleaned from administrative databases, exactly the sources used in this project. Key decisions are made in most hospitals in the country based on data of similar quality. Further limitations of the project relate to the issue of replicability. The disease process we addressed is a major source of frustration to pediatric hospitalists, and our sample likely consisted of the most highly motivated individuals, as they sought out and joined a group with the express purpose of decreasing unnecessary utilization in bronchiolitis. We believe this limitation highlights the likely need for quality measures to emerge organically out of a community of practice when resources are limited, ie, we do not believe we would have had significant success using our methods with an unpopular or externally imposed quality measure.

Although a detailed analysis of costs was beyond the scope of the current project, it is possible that decreased utilization resulted in overall cost savings, despite the fact that our data did not demonstrate a significant change in network‐level average variable direct costs related to bronchiolitis. It has been suggested that such savings may be particularly difficult to demonstrate objectively, especially when the principal costs targeted are labor‐based.35 LOS did not significantly vary during the project, whereas the use of labor‐intensive therapies like nebulized bronchodilators and chest physiotherapy declined. It is, however, quite possible that the decreased utilization we demonstrated was accompanied by a concomitant increase in utilization of other unmeasured therapies.

CONCLUSIONS

A volunteer, peer‐group collaborative focused on benchmarking decreased utilization of bronchodilators and chest physiotherapy in bronchiolitis, though had no impact on overuse of other unnecessary therapies and tests.

Currently, 3%5% of infants under a year of age will be admitted to a hospital for acute viral bronchiolitis each year, making it the leading cause of hospitalization in children.15 The American Academy of Pediatrics guideline on the diagnosis and management of bronchiolitis advocates primarily supportive care for this self‐limited disease.6 Specifically, the routine use of therapies such as bronchodilators and corticosteroids are not recommended, nor is routine evaluation with diagnostic testing.6 Numerous studies have established the presence of unwarranted variation in most aspects of bronchiolitis care,713 and the current evidence does not support the routine usage of specific interventions in inpatients.1418

Acute bronchiolitis accounts for direct inpatient medical costs of over $500 million per year.19 Based on estimates from the Healthcare Utilization Project Kids' Inpatient Database, acute bronchiolitis is second only to respiratory distress syndrome as the most expensive disease of hospitalized children.1 Although charges may not correlate directly with costs or even the actual intensity of resource utilization, the national bill, based on charges, is approximately 1.4 billion dollars per year.1 Either way, the leading cause of hospitalization in children is expensive and suffers from dramatic variation in care characterized by overutilization of ineffective interventions.

Evidence‐based guidelines for bronchiolitis are readily available and their successful adoption within larger, academic children's hospitals has been demonstrated.2028 However, upwards of 70% of all children in this country are cared for outside of freestanding children's hospitals,1 and very little has been published about wide dissemination of evidence‐based guidelines in these settings.29 In 2008, the Value in Inpatient Pediatrics (VIP) network was created, as an inclusive pediatric inpatient quality improvement collaborative with a focus on linking academic and community‐based hospitalist groups, to disseminate evidence‐based management strategies for bronchiolitis. We hypothesized that group norming, through benchmarking and public goal setting at the level of the hospitalist group, would decrease overall utilization of nonevidence‐based therapies. Specifically, we were trying to decrease the utilization of bronchodilators, steroids, chest physiotherapy, chest radiography, and viral testing in hospitalized children diagnosed with uncomplicated bronchiolitis.

METHODS

Beginning in early 2008, we recruited pediatric hospitalists into a voluntary bronchiolitis quality improvement collaborative from within the community of hospitalists created by the American Academy of Pediatrics Section on Hospital Medicine. Participants were recruited through open calls at national conferences and mass e‐mails to the section membership through the listserve. The guiding principle for the collaborative was the idea that institutional adoption of evidence‐based disease‐management strategies would result in higher value of care, and that this process could be facilitated by benchmarking local performance against norms created within the larger community. We used group consensus to identify the therapies and tests to benchmark, although the chosen measures meshed with those addressed in the American Academy of Pediatrics (AAP) clinical practice guideline. Use of bronchodilators, corticosteroids, chest physiotherapy, chest radiography, and viral testing were all felt to be significantly overutilized in participating clinical sites. We were unaware of any published national targets for utilization of these therapies or tests, and none of the participating hospitalist groups was actively benchmarking their utilization against any peer group at the start of the project. Length of stay, rates of readmission within 72 hours of discharge, and variable direct costs were chosen as balancing measures for the project.

We collected data on hospitalizations for bronchiolitis for 4 calendar years, from 2007 through 2010, based on the following inclusion criteria: children under 24 months of age, hospitalized for the primary diagnosis of acute viral bronchiolitis as defined by International Classification of Diseases, Ninth Revision (ICD‐9) codes 466.11 and 466.19. We specifically included patients who were in observation status as well as those in inpatient status, and excluded all intensive care unit admissions. Other exclusions were specific ICD‐9 codes for: chronic lung diseases, asthma, chromosomal abnormalities, heart disease, and neurological diseases. We then tracked overall utilization of any bronchodilator (albuterol, levalbuterol, epinephrine, or ipratropium) during the hospitalization, including the emergency department; total number of bronchodilator doses per patient; utilization of any corticosteroids (inhaled or systemic); chest radiography; respiratory syncytial virus (RSV) testing; and chest physiotherapy; as well as variable direct costs per hospitalization for each center. A standardized toolkit was provided to participating centers to facilitate data collection. Data was sought from administrative sources, collected in aggregate form and not at the patient level, and no protected health information was collected as part of the project. The project was categorized as exempt by the University of Texas Health Science Center San Antonio Institutional Review Board, the location of the data repository.

The project began in 2008, though we requested that centers provide 2007 data to supplement our baseline. We held the first group meeting in July 2009 and began the facilitated sharing of resources to promote evidence‐based care, such as guidelines, protocols, respiratory scores, and patient handouts, across sites using data from 2007 and 2008 as our baseline for benchmarking and later assessing any improvement. Centers adopted guidelines at their own pace and we did not require guideline adoption for continued participation. We provided summaries of the available literature by topic, in the event that site leaders wished to give institutional grand rounds or other presentations. All dissemination of guidelines or protocols was done based on the request of the center, and no specific resource was created or sanctioned by the group, though the AAP Guideline for the Diagnosis and Management of Bronchiolitis6 remained a guiding document. Some of our centers participated in more extensive collaborative projects which involved small‐group goal setting, adoption of similar protocols, and conference calls, though this never encompassed more than 25% of the network.

The main product of the project was a yearly report benchmarking each hospital against the network average on each of our chosen utilization measures. The first report was disseminated in July 2009 and included data on calendar year 2007 and 2008, which we considered our group baseline. Most institutions began local Plan‐Do‐Study‐Act (PDSA) cycles by mid‐2009 using the data we provided as they benchmarked their performance against other members of the collaborative, and these continued through 2010. Hospitals were coded and remained anonymous. However, we publicly honored the high performers within the network at a yearly meeting, and urged these centers to share their tools and strategies, which was facilitated through a project Web site.30 All participation was voluntary, and all costs were borne by individuals or their respective centers.

In order to assess data quality, we undertook a validation project for calendar year 2009. We requested local direct chart review of a 10% sample, or a minimum of 10 charts, to confirm reported utilization rates for the therapies and tests we tracked. Any center with less than 80% accuracy was then asked to review data collection methods and make adjustments accordingly. One center identified and resolved a significant data discrepancy and 2 centers refused to participate in the validation project, citing their participation in a large national database for which there was already a very rigorous data validation process (Child Health Corporation of America's Pediatric Health Information System database). Given that we did not uncover major discrepancies in data quality within our network, we did not request further data validation but rather promoted year‐to‐year consistency of collection methods, seeking to collect the same type/quality of data that hospitals use in their own internal performance assessments.

Statistical analyses were performed using GraphPad InStat, version 3.0 (GraphPad Software, San Diego, CA). Descriptive statistics (including interquartile range ([IQR], the range from 25th to 75th percentile of the data) are provided. Analysis of process measures over the series of years was performed using repeated measures analysis of variance (ANOVA), as were intra‐hospital comparisons for all measures. Hospitals were not weighted by volume of admissions, ie, the unit of analysis was the hospital and not individual hospitalizations. Data were analyzed for normality using the method of Kolmogorov and Smirnoff, and in cases where normality was not satisfied (steroids and chest physiotherapy), the data were transformed and nonparametric methods were used. Post‐test adjustment for multiple comparisons was done using the TukeyKramer test in cases where ANOVA P values were <0.05. Fisher's exact test was used to analyze contingency tables for categorical variables such as presence or absence of a protocol.

RESULTS

Data encompassing 11,568 bronchiolitis hospitalizations in 17 centers, for calendar years 2007 to 2010, were analyzed for this report. A total of 31 centers ever participated in the project; however, this report is restricted to centers who participated for the entirety of the project from 2008 through 2010, and who consented to have their data reported. Specifically, 18 centers met inclusion criteria and 1 center opted out of the project, leaving the 17 centers described in Table 1. The overall network makeup shifted each year, but was always more than 80% non‐freestanding children's hospitals and approximately 30% urban, as defined as located in a population center of more than 1 million. A large majority of the participants did not have a local bronchiolitis protocol or guideline at the start of the project, although 88% of participants adopted some form of protocolized care by 2010. Calendar years 2007 and 2008 served as our network baseline, with most interventions (in institutions where they occurred) begun by calendar year 2009. The level of intervention varied greatly among institutions, with a few institutions doing nothing more than benchmarking their performance.

Mean length of stay (LOS), readmission rates, and variable direct costs did not differ significantly during the project time period. Mean LOS for the network ranged from a low of 2.4 days (IQR, 2.22.8 days) to a high of 2.7 days (IQR, 2.43.1 days), and mean readmission rates ranged from 1.2% (IQR, 0.7%1.8%) to 1.7% (IQR, 0.7%2.5%) during the project. Mean variable direct costs ranged from $1639 (IQR, $1383$1864) to $1767 (IQR, $1365$2320).

Table 2 describes the mean overall utilization of bronchodilators, chest radiography, RSV testing, steroids, and chest physiotherapy among the group from 2007 to 2010. By 2010, we saw a 46% decline in the volume of bronchodilator used within the network, a 3.6 (95% confidence interval [CI] 1.45.8) dose per patient absolute decrease (P < 0.01). We also saw a 12% (95% CI 5%25%) absolute decline in the overall percentage of patients exposed to any bronchodilator (P < 0.01). Finally, there was a 10% (95% CI 3%18%) absolute decline in the overall utilization of any chest physiotherapy (P < 0.01). The project did not demonstrate a significant impact on utilization of corticosteroids, chest radiography, or viral testing, although several centers achieved significant decreases on a local level (data not shown).

We analyzed within‐hospital trends as well. Figure 1 describes intra‐hospital change over the course of the project for overall bronchodilator usage. In this analysis, 15 of 17 hospitals (88%) achieved a significant decrease in overall bronchodilator utilization by 2010. (Hospitals 27 and 29 were unable to provide 2007 baseline data.) For doses per patient, 15 of 17 institutions provided data on this measure, and 12 of 15 (80%) achieved significant decreases (Figure 2). Of note, the institutions failing to achieve significant decreases in bronchodilator utilization entered the project with utilization rates that were already significantly below network mean at the start of the project. (Institutions failing to improve are denoted with an asterisk in Figures 1 and 2.) Since most institutions made significant improvements in bronchodilator utilization over time, we looked for correlates of failure to decrease utilization. The strongest association for failure to improve during the project period was use of a protocol prior to joining the network (odds ratio [OR] = 11, 95% CI 261).

Figure 1

Figure 2

DISCUSSION

We demonstrated a significant decline in utilization of bronchodilators and chest physiotherapy in inpatient bronchiolitis within a voluntary quality collaborative focused on benchmarking without employing intensive interventions. This observation is important in that it demonstrates real‐world efficacy for our methods. Prior literature has clearly demonstrated that local bronchiolitis guidelines are effective; however, our data on over 11,000 hospitalizations from a broad array of inpatient settings continue to show a high rate of overutilization. We facilitated dissemination and sharing of guideline‐related tools primarily electronically, and capitalized on perceived peer‐group frustration with inefficient management of a high‐volume, high‐utilization disease. While the project leadership had varying degrees of advanced training in quality improvement methodology, the majority of the site leaders were self‐taught and trained while on the job. Our inclusive collaborative had some success using pragmatic and low‐resource methods which we believe is a novel approach to the issue of overutilization.

These considerations are highlighted given the pressing need to find more efficient and scalable means of bending the cost curve of healthcare in the United States. Learning collaboratives are a relatively new model for improvement, with some history in pediatrics,31, 32 and are attractive because of their potential to generate both widespread capacity for change as well as direct improvement. Both cystic fibrosis31 and neonatology collaboratives32 have been celebrated for their positive impacts on children's healthcare, and both are testaments to the power inherent in creating a community of like‐minded individuals. One of the most popular models for learning collaboratives remains the Institute for Healthcare Improvement's Breakthrough Series; however, this model is resource intensive in that it typically involves large teams and several yearly face‐to‐face meetings, with significant monetary investment on the part of hospitals. On the other hand, virtual collaboratives have produced mixed results with respect to quality improvement,33 so there is a continued need to maximize our learning about what works efficiently. Our collaborative was able to successfully disseminate tools developed in large academic institutions to be applied in smaller and more varied settings, where resources for quality improvement activities were limited.

One possible reason for any successes in this project was the existence of a well‐known guideline for the management of bronchiolitis published by the American Academy of Pediatrics in 2006. This guideline recommends primarily symptomatic care, and has a statement supporting the contention that routine use of our targeted therapies is unnecessary. It allows for a trial of bronchodilator, but specifically states that all trials should be accompanied by the use of an objective measure of improvement (typically interpreted to mean a respiratory distress score). A guideline sanctioned by an important national organization of pediatricians was invaluable, and we believe that it should serve as a basis for any nationally promoted inpatient quality measure for this very common pediatric illness. The existence of the AAP guideline also highlights the possibility that our results are merely representative of secular trends in utilization in bronchiolitis care, since we had no control group. The available literature on national guidelines has shown mixed and quite modest impacts in other countries.28, 34 Most of our group took active steps to operationalize the guidelines as part of their participation in this collaborative, though they might have done similar work anyway due to the increasing importance of quality improvement in hospitalist culture over the years of the project.

The project did not demonstrate any impact on steroid utilization, or on rates of obtaining chest radiography or viral testing, despite expressly targeting these widely overused interventions. These modalities are often employed in the emergency department and, as a collaborative of pediatric hospitalists, we did not have specific emergency department participation which we recognize as a major weakness and potential impediment to further progress. We hope to collaborate with our respective emergency departments in the future on these particular measures. We also noted that many institutions were inflexible about foregoing viral testing, due to infection control issues arising from the need to cohort patients in shared rooms based on RSV positivity during the busy winter months. A few institutions were able to alter their infection control policies using the strategy of assuming all children with bronchiolitis had RSV (ie, choosing to use both contact precautions and to wear a mask when entering rooms), though this was not universally popular. Finally, we recognize a missed opportunity in not collecting dose per patient level data for steroids, which might have allowed us to distinguish hospitals with ongoing inpatient utilization of steroids from those with only emergency department usage.

Another significant limitation of this project was the lack of annual assessments of data quality. However, we believe our findings are still useful and important, even with this obvious limitation. Most quality improvement work is done using hospital‐supplied data gleaned from administrative databases, exactly the sources used in this project. Key decisions are made in most hospitals in the country based on data of similar quality. Further limitations of the project relate to the issue of replicability. The disease process we addressed is a major source of frustration to pediatric hospitalists, and our sample likely consisted of the most highly motivated individuals, as they sought out and joined a group with the express purpose of decreasing unnecessary utilization in bronchiolitis. We believe this limitation highlights the likely need for quality measures to emerge organically out of a community of practice when resources are limited, ie, we do not believe we would have had significant success using our methods with an unpopular or externally imposed quality measure.

Although a detailed analysis of costs was beyond the scope of the current project, it is possible that decreased utilization resulted in overall cost savings, despite the fact that our data did not demonstrate a significant change in network‐level average variable direct costs related to bronchiolitis. It has been suggested that such savings may be particularly difficult to demonstrate objectively, especially when the principal costs targeted are labor‐based.35 LOS did not significantly vary during the project, whereas the use of labor‐intensive therapies like nebulized bronchodilators and chest physiotherapy declined. It is, however, quite possible that the decreased utilization we demonstrated was accompanied by a concomitant increase in utilization of other unmeasured therapies.

CONCLUSIONS

A volunteer, peer‐group collaborative focused on benchmarking decreased utilization of bronchodilators and chest physiotherapy in bronchiolitis, though had no impact on overuse of other unnecessary therapies and tests.