Amit Pahwa, MD

Proton pump inhibitors (PPIs) are among the most commonly used drugs worldwide to treat dyspepsia and prevent gastrointestinal bleeding (GIB).¹ Between 40% and 70% of hospitalized patients receive acid-suppressive therapy (AST; defined as PPIs or histamine-receptor antagonists), and nearly half of these are initiated during the inpatient stay.^2,3 While up to 50% of inpatients who received a new AST were discharged on these medications,² there were no evidence-based indications for a majority of the prescriptions.^2,3

Growing evidence shows that PPIs are overutilized and may be associated with wide-ranging adverse events, such as acute and chronic kidney disease,⁴Clostridium difficile infection,⁵ hypomagnesemia,⁶ and fractures.⁷ Because of the widespread overuse and the potential harm associated with PPIs, a concerted effort to promote their appropriate use in the inpatient setting is necessary. It is important to note that reducing the use of PPIs does not increase the risks of GIB or worsening dyspepsia. Rather, reducing overuse of PPIs lowers the risk of harm to patients. The efforts to reduce overuse, however, are complex and difficult.

This article summarizes evidence regarding interventions to reduce overuse and offers an implementation guide based on this evidence. This guide promotes value-based quality improvement and provides a blueprint for implementing an institution-wide program to reduce PPI overuse in the inpatient setting. We begin with a discussion about quality initiatives to reduce PPI overuse, followed by a review of the safety outcomes associated with reduced use of PPIs.

A focused search of the US National Library of Medicine’s PubMed database was performed to identify English-language articles published between 2000 and 2018 that addressed strategies to reduce PPI overuse for stress ulcer prophylaxis (SUP) and nonvariceal GIB. The following search terms were used: PPI and inappropriate use; acid-suppressive therapy and inappropriate use; PPI and discontinuation; acid-suppressive (or suppressant) therapy and discontinuation; SUP and cost; and histamine receptor antagonist and PPI. Inpatient or outpatient studies of patients aged 18 years or older were considered for inclusion in this narrative review, and all study types were included. The primary exclusion criterion was patients aged younger than 18 years. A manual review of the full text of the retrieved articles was performed and references were reviewed for missed citations.

We identified a total of 1,497 unique citations through our initial search. After performing a manual review, we excluded 1,483 of the references and added an additional 2, resulting in 16 articles selected for inclusion. The selected articles addressed interventions falling into three main groupings: implementation of institutional guidelines with or without electronic health record (EHR)–based decision support, educational interventions alone, and multifaceted interventions. Each of these interventions is discussed in the sections that follow. Table 1, Table 2, and Table 3 summarize the results of the studies included in our narrative review.

Institutional Guidelines With or Without EHR-Based Decision Support

Table 1 summarizes institutional guidelines, with or without EHR-based decision support, to reduce inappropriate PPI use. The implementation of institutional guidelines for the appropriate reduction of PPI use has had some success. Coursol and Sanzari evaluated the impact of a treatment algorithm on the appropriateness of prescriptions for SUP in the intensive care unit (ICU).⁸ Risk factors of patients in this study included mechanical ventilation for 48 hours, coagulopathy for 24 hours, postoperative transplant, severe burns, active gastrointestinal (GI) disease, multiple trauma, multiple organ failure, and septicemia. The three treatment options chosen for the algorithm were intravenous (IV) famotidine (if the oral route was unavailable or impractical), omeprazole tablets (if oral access was available), and omeprazole suspension (in cases of dysphagia and presence of nasogastric or orogastric tube). After implementation of the treatment algorithm, the proportion of inappropriate prophylaxis decreased from 95.7% to 88.2% (P = .033), and the cost per patient decreased from $11.11 to $8.49 Canadian dollars (P = .003).

Van Vliet et al implemented a clinical practice guideline listing specific criteria for prescribing a PPI.⁹ Their criteria included the presence of gastric or duodenal ulcer and use of a nonsteroidal anti-inflammatory drug (NSAID) or aspirin, plus at least one additional risk factor (eg, history of gastroduodenal hemorrhage or age >70 years). The proportion of patients started on PPIs during hospitalization decreased from 21% to 13% (odds ratio, 0.56; 95% CI, 0.33-0.97).

Michal et al utilized an institutional pharmacist-driven protocol that stipulated criteria for appropriate PPI use (eg, upper GIB, mechanical ventilation, peptic ulcer disease, gastroesophageal reflux disease, coagulopathy).¹⁰ Pharmacists in the study evaluated patients for PPI appropriateness and recommended changes in medication or discontinuation of use. This institutional intervention decreased PPI use in non-ICU hospitalized adults. Discontinuation of PPIs increased from 41% of patients in the preintervention group to 66% of patients in the postintervention group (P = .001).

In addition to implementing guidelines and intervention strategies, institutions have also adopted changes to the EHR to reduce inappropriate PPI use. Herzig et al utilized a computerized clinical decision support intervention to decrease SUP in non-ICU hospitalized patients.¹¹ Of the available response options for acid-suppressive medication, when SUP was chosen as the only indication for PPI use a prompt alerted the clinician that “[SUP] is not recommended for patients outside the [ICU]”; the alert resulted in a significant reduction in AST for the sole purpose of SUP. With this intervention, the percentage of patients who had any inappropriate acid-suppressive exposure decreased from 4.0% to 0.6% (P < .001).

Table 2 summarizes educational interventions to reduce inappropriate PPI use.

Agee et al employed a pharmacist-led educational seminar that described SUP indications, risks, and costs.¹² Inappropriate SUP prescriptions decreased from 55.5% to 30.5% after the intervention (P < .0001). However, there was no reduction in the percentage of patients discharged on inappropriate AST.

Chui et al performed an intervention with academic detailing wherein a one-on-one visit with a physician took place, providing education to improve physician prescribing behavior.¹³ In this study, academic detailing focused on the most common instances for which PPIs were inappropriately utilized at that hospital (eg, surgical prophylaxis, anemia). Inappropriate use of double-dose PPIs was also targeted. Despite these efforts, no significant difference in inappropriate PPI prescribing was observed post intervention.

Hamzat et al implemented an educational strategy to reduce inappropriate PPI prescribing during hospital stays, which included dissemination of fliers, posters, emails, and presentations over a 4-week period.¹⁴ Educational efforts targeted clinical pharmacists, nurses, physicians, and patients. Appropriate indications for PPI use in this study included peptic ulcer disease (current or previous), H pylori infection, and treatment or prevention of an NSAID-induced ulcer. The primary outcome was a reduction in PPI dose or discontinuation of PPI during the hospital admission, which increased from 9% in the preintervention (pre-education) phase to 43% during the intervention (education) phase and to 46% in the postintervention (posteducation) phase (P = .006).

Liberman and Whelan also implemented an educational intervention among internal medicine residents to reduce inappropriate use of SUP; this intervention was based on practice-based learning and improvement methodology.¹⁵ They noted that the rate of inappropriate prophylaxis with AST decreased from 59% preintervention to 33% post intervention (P < .007).

Table 3 summarizes several multifaceted approaches aimed at reducing inappropriate PPI use. Belfield et al utilized an intervention consisting of an institutional guideline review, education, and monitoring of AST by clinical pharmacists to reduce inappropriate use of PPI for SUP.¹⁶ With this intervention, the primary outcome of total inappropriate days of AST during hospitalization decreased from 279 to 116 (48% relative reduction in risk, P < .01, across 142 patients studied). Furthermore, inappropriate AST prescriptions at discharge decreased from 32% to 8% (P = .006). The one case of GIB noted in this study occurred in the control group.

Del Giorno et al combined audit and feedback with education to reduce new PPI prescriptions at the time of discharge from the hospital.¹⁷ The educational component of this intervention included guidance regarding potentially inappropriate PPI use and associated side effects and targeted multiple departments in the hospital. This intervention led to a sustained reduction in new PPI prescriptions at discharge during the 3-year study period. The annual rate of new PPI prescriptions was 19%, 19%, 18%, and 16% in years 2014, 2015, 2016, and 2017, respectively, in the internal medicine department (postintervention group), compared with rates of 30%, 29%, 36%, 36% (P < .001) for the same years in the surgery department (control group).

Education and the use of medication reconciliation forms on admission and discharge were utilized by Gupta et al to reduce inappropriate AST in hospitalized patients from 51% prior to intervention to 22% post intervention (P < .001).¹⁸ Furthermore, the proportion of patients discharged on inappropriate AST decreased from 69% to 20% (P < .001).

Hatch et al also used educational resources and pharmacist-led medication reconciliation to reduce use of SUP.¹⁹ Before the intervention, 24.4% of patients were continued on SUP after hospital discharge in the absence of a clear indication for use; post intervention, 11% of patients were continued on SUP after hospital discharge (of these patients, 8.7% had no clear indication for use). This represented a 64.4% decrease in inappropriately prescribed SUP after discharge (P < .0001).

Khalili et al combined an educational intervention with an institutional guideline in an infectious disease ward to reduce inappropriate use of SUP.²⁰ This intervention reduced the inappropriate use of AST from 80.9% before the intervention to 47.1% post intervention (P < .001).

Masood et al implemented two interventions wherein pharmacists reviewed SUP indications for each patient during daily team rounds, and ICU residents and fellows received education about indications for SUP and the implemented initiative on a bimonthly basis.²¹ Inappropriate AST decreased from 26.75 to 7.14 prescriptions per 100 patient-days of care (P < .001).

McDonald et al combined education with a web-based quality improvement tool to reduce inappropriate exit prescriptions for PPIs.²² The proportion of PPIs discontinued at hospital discharge increased from 7.7% per month to 18.5% per month (P = .03).

Finally, the initiative implemented by Tasaka et al to reduce overutilization of SUP included an institutional guideline, a pharmacist-led intervention, and an institutional education and awareness campaign.²³ Their initiative led to a reduction in inappropriate SUP both at the time of transfer out of the ICU (8% before intervention, 4% post intervention, P = .54) and at the time of discharge from the hospital (7% before intervention, 0% post intervention, P = .22).

Proton pump inhibitors are often initiated in the hospital setting, with up to half of these new prescriptions continued at discharge.^2,24,25 Inappropriate prescriptions for PPIs expose patients to excess risk of long-term adverse events.²⁶ De-escalating PPIs, however, raises concern among clinicians and patients for potential recurrence of dyspepsia and GIB. There is limited evidence regarding long-term safety outcomes (including GIB) following the discontinuation of PPIs deemed to have been inappropriately initiated in the hospital. In view of this, clinicians should educate and monitor individual patients for symptom relapse to ensure timely and appropriate resumption of AST.

Our literature search for this narrative review and implementation guide has limitations. First, the time frame we included (2000-2018) may have excluded relevant articles published before our starting year. We did not include articles published before 2000 based on concerns these might contain outdated information. Also, there may have been incomplete retrieval of relevant studies/articles due to the labor-intensive nature involved in determining whether PPI prescriptions are appropriate or inappropriate.

We noted that interventional studies aimed at reducing overuse of PPIs were often limited by a low number of participants; these studies were also more likely to be single-center interventions, which limits generalizability. In addition, the studies often had low methodological rigor and lacked randomization or controls. Moreover, to fully evaluate the sustainability of interventions, some of the studies had a limited postimplementation period. For multifaceted interventions, the efficacy of individual components of the interventions was not clearly evaluated. Moreover, there was a high risk of bias in many of the included studies. Some of the larger studies used overall AST prescriptions as a surrogate for more appropriate use. It would be advantageous for a site to perform a pilot study that provides well-defined parameters for appropriate prescribing, and then correlate with the total number of prescriptions (automated and much easier) thereafter. Further, although the evidence regarding appropriate PPI use for SUP and GIB has shifted rapidly in recent years, society guidelines have not been updated to reflect this change. As such, quality improvement interventions have predominantly focused on reducing PPI use for the indications reflected by these guidelines.

The following are our recommendations for successfully implementing an evidence-based, institution-wide initiative to promote the appropriate use of PPIs during hospitalization. These recommendations are informed by the evidence review and reflect the consensus of the combined committees coauthoring this review.

For an initiative to succeed, participation from multiple disciplines is necessary to formulate local guidelines and design and implement interventions. Such an interdisciplinary approach requires advocates to closely monitor and evaluate the program; sustainability will be greatly facilitated by the active engagement of key stakeholders, including the hospital’s executive administration, supply chain, pharmacists, and gastroenterologists. Lack of adequate buy-in on the part of key stakeholders is a barrier to the success of any intervention. Accordingly, before selecting a particular intervention, it is important to understand local factors driving the overuse of PPI.

1. Develop evidence-based institutional guidelines for both SUP and nonvariceal upper GIB through an interdisciplinary workgroup.

• Establish an interdisciplinary group including, but not limited to, pharmacists, hospitalists, gastroenterologists, and intensivists so that changes in practice will be widely adopted as institutional policy.
• Incorporate the best evidence and clearly convey appropriate and inappropriate uses.

2. Integrate changes to the EHR.

• If possible, the EHR should be leveraged to implement changes in PPI ordering practices.
• While integrating changes to the EHR, it is important to consider informatics and implementation science, since the utility of hard stops and best practice alerts has been questioned in the setting of operational inefficiencies and alert fatigue.
• Options for integrating changes to the EHR include the following:
  • Create an ordering pathway that provides clinical decision support for PPI use.
  • Incorporate a best practice alert in the EMR to notify clinicians of institutional guidelines when they initiate an order for PPI outside of the pathway.
  • Consider restricting the authority to order IV PPIs by requiring a code or password or implement another means of using the EHR to limit the supply of PPI.
  • Limit the duration of IV PPI by requiring daily renewal of IV PPI dosing or by altering the period of time that use of IV PPI is permitted (eg, 48 to 72 hours).
  • PPIs should be removed from any current order sets that include medications for SUP.

3. Foster pharmacy-driven interventions.

• Consider requiring pharmacist approval for IV PPIs.
• Pharmacist-led review and feedback to clinicians for discontinuation of inappropriate PPIs can be effective in decreasing inappropriate utilization.

4. Provide education, audit data, and obtain feedback.

• Data auditing is needed to measure the efficacy of interventions. Outcome measures may include the number of non-ICU and ICU patients who are started on a PPI during an admission; the audit should be continued through discharge. A process measure may be the number of pharmacist calls for inappropriate PPIs. A balancing measure would be ulcer-specific upper GIB in patients who do not receive SUP during their admission. (Upper GIB from other etiologies, such as varices, portal hypertensive gastropathy, and Mallory-Weiss tear would not be affected by PPI SUP.)
• Run or control charts should be utilized, and data should be shared with project champions and ordering clinicians—in real time if possible.
• Project champions should provide feedback to colleagues; they should also work with hospital leadership to develop new strategies to improve adherence.
• Provide ongoing education about appropriate indications for PPIs and potential adverse effects associated with their use. Whenever possible, point-of-care or just-in-time teaching is the preferred format.

Excessive use of PPIs during hospitalization is prevalent; however, quality improvement interventions can be effective in achieving sustainable reductions in overuse. There is a need for the American College of Gastroenterology to revisit and update their guidelines for management of patients with ulcer bleeding to include stronger evidence-based recommendations on the proper use of PPIs.²⁷ These updated guidelines could be used to update the implementation blueprint.

Quality improvement teams have an opportunity to use the principles of value-based healthcare to reduce inappropriate PPI use. By following the blueprint outlined in this article, institutions can safely and effectively tailor the use of PPIs to suitable patients in the appropriate settings. Reduction of PPI overuse can be employed as an institutional catalyst to promote implementation of further value-based measures to improve efficiency and quality of patient care.

Proton pump inhibitors (PPIs) are among the most commonly used drugs worldwide to treat dyspepsia and prevent gastrointestinal bleeding (GIB).¹ Between 40% and 70% of hospitalized patients receive acid-suppressive therapy (AST; defined as PPIs or histamine-receptor antagonists), and nearly half of these are initiated during the inpatient stay.^2,3 While up to 50% of inpatients who received a new AST were discharged on these medications,² there were no evidence-based indications for a majority of the prescriptions.^2,3

Growing evidence shows that PPIs are overutilized and may be associated with wide-ranging adverse events, such as acute and chronic kidney disease,⁴Clostridium difficile infection,⁵ hypomagnesemia,⁶ and fractures.⁷ Because of the widespread overuse and the potential harm associated with PPIs, a concerted effort to promote their appropriate use in the inpatient setting is necessary. It is important to note that reducing the use of PPIs does not increase the risks of GIB or worsening dyspepsia. Rather, reducing overuse of PPIs lowers the risk of harm to patients. The efforts to reduce overuse, however, are complex and difficult.

This article summarizes evidence regarding interventions to reduce overuse and offers an implementation guide based on this evidence. This guide promotes value-based quality improvement and provides a blueprint for implementing an institution-wide program to reduce PPI overuse in the inpatient setting. We begin with a discussion about quality initiatives to reduce PPI overuse, followed by a review of the safety outcomes associated with reduced use of PPIs.

A focused search of the US National Library of Medicine’s PubMed database was performed to identify English-language articles published between 2000 and 2018 that addressed strategies to reduce PPI overuse for stress ulcer prophylaxis (SUP) and nonvariceal GIB. The following search terms were used: PPI and inappropriate use; acid-suppressive therapy and inappropriate use; PPI and discontinuation; acid-suppressive (or suppressant) therapy and discontinuation; SUP and cost; and histamine receptor antagonist and PPI. Inpatient or outpatient studies of patients aged 18 years or older were considered for inclusion in this narrative review, and all study types were included. The primary exclusion criterion was patients aged younger than 18 years. A manual review of the full text of the retrieved articles was performed and references were reviewed for missed citations.

We identified a total of 1,497 unique citations through our initial search. After performing a manual review, we excluded 1,483 of the references and added an additional 2, resulting in 16 articles selected for inclusion. The selected articles addressed interventions falling into three main groupings: implementation of institutional guidelines with or without electronic health record (EHR)–based decision support, educational interventions alone, and multifaceted interventions. Each of these interventions is discussed in the sections that follow. Table 1, Table 2, and Table 3 summarize the results of the studies included in our narrative review.

Institutional Guidelines With or Without EHR-Based Decision Support

Table 1 summarizes institutional guidelines, with or without EHR-based decision support, to reduce inappropriate PPI use. The implementation of institutional guidelines for the appropriate reduction of PPI use has had some success. Coursol and Sanzari evaluated the impact of a treatment algorithm on the appropriateness of prescriptions for SUP in the intensive care unit (ICU).⁸ Risk factors of patients in this study included mechanical ventilation for 48 hours, coagulopathy for 24 hours, postoperative transplant, severe burns, active gastrointestinal (GI) disease, multiple trauma, multiple organ failure, and septicemia. The three treatment options chosen for the algorithm were intravenous (IV) famotidine (if the oral route was unavailable or impractical), omeprazole tablets (if oral access was available), and omeprazole suspension (in cases of dysphagia and presence of nasogastric or orogastric tube). After implementation of the treatment algorithm, the proportion of inappropriate prophylaxis decreased from 95.7% to 88.2% (P = .033), and the cost per patient decreased from $11.11 to $8.49 Canadian dollars (P = .003).

Van Vliet et al implemented a clinical practice guideline listing specific criteria for prescribing a PPI.⁹ Their criteria included the presence of gastric or duodenal ulcer and use of a nonsteroidal anti-inflammatory drug (NSAID) or aspirin, plus at least one additional risk factor (eg, history of gastroduodenal hemorrhage or age >70 years). The proportion of patients started on PPIs during hospitalization decreased from 21% to 13% (odds ratio, 0.56; 95% CI, 0.33-0.97).

Michal et al utilized an institutional pharmacist-driven protocol that stipulated criteria for appropriate PPI use (eg, upper GIB, mechanical ventilation, peptic ulcer disease, gastroesophageal reflux disease, coagulopathy).¹⁰ Pharmacists in the study evaluated patients for PPI appropriateness and recommended changes in medication or discontinuation of use. This institutional intervention decreased PPI use in non-ICU hospitalized adults. Discontinuation of PPIs increased from 41% of patients in the preintervention group to 66% of patients in the postintervention group (P = .001).

In addition to implementing guidelines and intervention strategies, institutions have also adopted changes to the EHR to reduce inappropriate PPI use. Herzig et al utilized a computerized clinical decision support intervention to decrease SUP in non-ICU hospitalized patients.¹¹ Of the available response options for acid-suppressive medication, when SUP was chosen as the only indication for PPI use a prompt alerted the clinician that “[SUP] is not recommended for patients outside the [ICU]”; the alert resulted in a significant reduction in AST for the sole purpose of SUP. With this intervention, the percentage of patients who had any inappropriate acid-suppressive exposure decreased from 4.0% to 0.6% (P < .001).

Table 2 summarizes educational interventions to reduce inappropriate PPI use.

Agee et al employed a pharmacist-led educational seminar that described SUP indications, risks, and costs.¹² Inappropriate SUP prescriptions decreased from 55.5% to 30.5% after the intervention (P < .0001). However, there was no reduction in the percentage of patients discharged on inappropriate AST.

Chui et al performed an intervention with academic detailing wherein a one-on-one visit with a physician took place, providing education to improve physician prescribing behavior.¹³ In this study, academic detailing focused on the most common instances for which PPIs were inappropriately utilized at that hospital (eg, surgical prophylaxis, anemia). Inappropriate use of double-dose PPIs was also targeted. Despite these efforts, no significant difference in inappropriate PPI prescribing was observed post intervention.

Hamzat et al implemented an educational strategy to reduce inappropriate PPI prescribing during hospital stays, which included dissemination of fliers, posters, emails, and presentations over a 4-week period.¹⁴ Educational efforts targeted clinical pharmacists, nurses, physicians, and patients. Appropriate indications for PPI use in this study included peptic ulcer disease (current or previous), H pylori infection, and treatment or prevention of an NSAID-induced ulcer. The primary outcome was a reduction in PPI dose or discontinuation of PPI during the hospital admission, which increased from 9% in the preintervention (pre-education) phase to 43% during the intervention (education) phase and to 46% in the postintervention (posteducation) phase (P = .006).

Liberman and Whelan also implemented an educational intervention among internal medicine residents to reduce inappropriate use of SUP; this intervention was based on practice-based learning and improvement methodology.¹⁵ They noted that the rate of inappropriate prophylaxis with AST decreased from 59% preintervention to 33% post intervention (P < .007).

Table 3 summarizes several multifaceted approaches aimed at reducing inappropriate PPI use. Belfield et al utilized an intervention consisting of an institutional guideline review, education, and monitoring of AST by clinical pharmacists to reduce inappropriate use of PPI for SUP.¹⁶ With this intervention, the primary outcome of total inappropriate days of AST during hospitalization decreased from 279 to 116 (48% relative reduction in risk, P < .01, across 142 patients studied). Furthermore, inappropriate AST prescriptions at discharge decreased from 32% to 8% (P = .006). The one case of GIB noted in this study occurred in the control group.

Del Giorno et al combined audit and feedback with education to reduce new PPI prescriptions at the time of discharge from the hospital.¹⁷ The educational component of this intervention included guidance regarding potentially inappropriate PPI use and associated side effects and targeted multiple departments in the hospital. This intervention led to a sustained reduction in new PPI prescriptions at discharge during the 3-year study period. The annual rate of new PPI prescriptions was 19%, 19%, 18%, and 16% in years 2014, 2015, 2016, and 2017, respectively, in the internal medicine department (postintervention group), compared with rates of 30%, 29%, 36%, 36% (P < .001) for the same years in the surgery department (control group).

Education and the use of medication reconciliation forms on admission and discharge were utilized by Gupta et al to reduce inappropriate AST in hospitalized patients from 51% prior to intervention to 22% post intervention (P < .001).¹⁸ Furthermore, the proportion of patients discharged on inappropriate AST decreased from 69% to 20% (P < .001).

Hatch et al also used educational resources and pharmacist-led medication reconciliation to reduce use of SUP.¹⁹ Before the intervention, 24.4% of patients were continued on SUP after hospital discharge in the absence of a clear indication for use; post intervention, 11% of patients were continued on SUP after hospital discharge (of these patients, 8.7% had no clear indication for use). This represented a 64.4% decrease in inappropriately prescribed SUP after discharge (P < .0001).

Khalili et al combined an educational intervention with an institutional guideline in an infectious disease ward to reduce inappropriate use of SUP.²⁰ This intervention reduced the inappropriate use of AST from 80.9% before the intervention to 47.1% post intervention (P < .001).

Masood et al implemented two interventions wherein pharmacists reviewed SUP indications for each patient during daily team rounds, and ICU residents and fellows received education about indications for SUP and the implemented initiative on a bimonthly basis.²¹ Inappropriate AST decreased from 26.75 to 7.14 prescriptions per 100 patient-days of care (P < .001).

McDonald et al combined education with a web-based quality improvement tool to reduce inappropriate exit prescriptions for PPIs.²² The proportion of PPIs discontinued at hospital discharge increased from 7.7% per month to 18.5% per month (P = .03).

Finally, the initiative implemented by Tasaka et al to reduce overutilization of SUP included an institutional guideline, a pharmacist-led intervention, and an institutional education and awareness campaign.²³ Their initiative led to a reduction in inappropriate SUP both at the time of transfer out of the ICU (8% before intervention, 4% post intervention, P = .54) and at the time of discharge from the hospital (7% before intervention, 0% post intervention, P = .22).

Proton pump inhibitors are often initiated in the hospital setting, with up to half of these new prescriptions continued at discharge.^2,24,25 Inappropriate prescriptions for PPIs expose patients to excess risk of long-term adverse events.²⁶ De-escalating PPIs, however, raises concern among clinicians and patients for potential recurrence of dyspepsia and GIB. There is limited evidence regarding long-term safety outcomes (including GIB) following the discontinuation of PPIs deemed to have been inappropriately initiated in the hospital. In view of this, clinicians should educate and monitor individual patients for symptom relapse to ensure timely and appropriate resumption of AST.

Our literature search for this narrative review and implementation guide has limitations. First, the time frame we included (2000-2018) may have excluded relevant articles published before our starting year. We did not include articles published before 2000 based on concerns these might contain outdated information. Also, there may have been incomplete retrieval of relevant studies/articles due to the labor-intensive nature involved in determining whether PPI prescriptions are appropriate or inappropriate.

We noted that interventional studies aimed at reducing overuse of PPIs were often limited by a low number of participants; these studies were also more likely to be single-center interventions, which limits generalizability. In addition, the studies often had low methodological rigor and lacked randomization or controls. Moreover, to fully evaluate the sustainability of interventions, some of the studies had a limited postimplementation period. For multifaceted interventions, the efficacy of individual components of the interventions was not clearly evaluated. Moreover, there was a high risk of bias in many of the included studies. Some of the larger studies used overall AST prescriptions as a surrogate for more appropriate use. It would be advantageous for a site to perform a pilot study that provides well-defined parameters for appropriate prescribing, and then correlate with the total number of prescriptions (automated and much easier) thereafter. Further, although the evidence regarding appropriate PPI use for SUP and GIB has shifted rapidly in recent years, society guidelines have not been updated to reflect this change. As such, quality improvement interventions have predominantly focused on reducing PPI use for the indications reflected by these guidelines.

The following are our recommendations for successfully implementing an evidence-based, institution-wide initiative to promote the appropriate use of PPIs during hospitalization. These recommendations are informed by the evidence review and reflect the consensus of the combined committees coauthoring this review.

For an initiative to succeed, participation from multiple disciplines is necessary to formulate local guidelines and design and implement interventions. Such an interdisciplinary approach requires advocates to closely monitor and evaluate the program; sustainability will be greatly facilitated by the active engagement of key stakeholders, including the hospital’s executive administration, supply chain, pharmacists, and gastroenterologists. Lack of adequate buy-in on the part of key stakeholders is a barrier to the success of any intervention. Accordingly, before selecting a particular intervention, it is important to understand local factors driving the overuse of PPI.

1. Develop evidence-based institutional guidelines for both SUP and nonvariceal upper GIB through an interdisciplinary workgroup.

• Establish an interdisciplinary group including, but not limited to, pharmacists, hospitalists, gastroenterologists, and intensivists so that changes in practice will be widely adopted as institutional policy.
• Incorporate the best evidence and clearly convey appropriate and inappropriate uses.

2. Integrate changes to the EHR.

• If possible, the EHR should be leveraged to implement changes in PPI ordering practices.
• While integrating changes to the EHR, it is important to consider informatics and implementation science, since the utility of hard stops and best practice alerts has been questioned in the setting of operational inefficiencies and alert fatigue.
• Options for integrating changes to the EHR include the following:
  • Create an ordering pathway that provides clinical decision support for PPI use.
  • Incorporate a best practice alert in the EMR to notify clinicians of institutional guidelines when they initiate an order for PPI outside of the pathway.
  • Consider restricting the authority to order IV PPIs by requiring a code or password or implement another means of using the EHR to limit the supply of PPI.
  • Limit the duration of IV PPI by requiring daily renewal of IV PPI dosing or by altering the period of time that use of IV PPI is permitted (eg, 48 to 72 hours).
  • PPIs should be removed from any current order sets that include medications for SUP.

3. Foster pharmacy-driven interventions.

• Consider requiring pharmacist approval for IV PPIs.
• Pharmacist-led review and feedback to clinicians for discontinuation of inappropriate PPIs can be effective in decreasing inappropriate utilization.

4. Provide education, audit data, and obtain feedback.

• Data auditing is needed to measure the efficacy of interventions. Outcome measures may include the number of non-ICU and ICU patients who are started on a PPI during an admission; the audit should be continued through discharge. A process measure may be the number of pharmacist calls for inappropriate PPIs. A balancing measure would be ulcer-specific upper GIB in patients who do not receive SUP during their admission. (Upper GIB from other etiologies, such as varices, portal hypertensive gastropathy, and Mallory-Weiss tear would not be affected by PPI SUP.)
• Run or control charts should be utilized, and data should be shared with project champions and ordering clinicians—in real time if possible.
• Project champions should provide feedback to colleagues; they should also work with hospital leadership to develop new strategies to improve adherence.
• Provide ongoing education about appropriate indications for PPIs and potential adverse effects associated with their use. Whenever possible, point-of-care or just-in-time teaching is the preferred format.

Excessive use of PPIs during hospitalization is prevalent; however, quality improvement interventions can be effective in achieving sustainable reductions in overuse. There is a need for the American College of Gastroenterology to revisit and update their guidelines for management of patients with ulcer bleeding to include stronger evidence-based recommendations on the proper use of PPIs.²⁷ These updated guidelines could be used to update the implementation blueprint.

Quality improvement teams have an opportunity to use the principles of value-based healthcare to reduce inappropriate PPI use. By following the blueprint outlined in this article, institutions can safely and effectively tailor the use of PPIs to suitable patients in the appropriate settings. Reduction of PPI overuse can be employed as an institutional catalyst to promote implementation of further value-based measures to improve efficiency and quality of patient care.

Proton pump inhibitors (PPIs) are among the most commonly used drugs worldwide to treat dyspepsia and prevent gastrointestinal bleeding (GIB).¹ Between 40% and 70% of hospitalized patients receive acid-suppressive therapy (AST; defined as PPIs or histamine-receptor antagonists), and nearly half of these are initiated during the inpatient stay.^2,3 While up to 50% of inpatients who received a new AST were discharged on these medications,² there were no evidence-based indications for a majority of the prescriptions.^2,3

Growing evidence shows that PPIs are overutilized and may be associated with wide-ranging adverse events, such as acute and chronic kidney disease,⁴Clostridium difficile infection,⁵ hypomagnesemia,⁶ and fractures.⁷ Because of the widespread overuse and the potential harm associated with PPIs, a concerted effort to promote their appropriate use in the inpatient setting is necessary. It is important to note that reducing the use of PPIs does not increase the risks of GIB or worsening dyspepsia. Rather, reducing overuse of PPIs lowers the risk of harm to patients. The efforts to reduce overuse, however, are complex and difficult.

This article summarizes evidence regarding interventions to reduce overuse and offers an implementation guide based on this evidence. This guide promotes value-based quality improvement and provides a blueprint for implementing an institution-wide program to reduce PPI overuse in the inpatient setting. We begin with a discussion about quality initiatives to reduce PPI overuse, followed by a review of the safety outcomes associated with reduced use of PPIs.

A focused search of the US National Library of Medicine’s PubMed database was performed to identify English-language articles published between 2000 and 2018 that addressed strategies to reduce PPI overuse for stress ulcer prophylaxis (SUP) and nonvariceal GIB. The following search terms were used: PPI and inappropriate use; acid-suppressive therapy and inappropriate use; PPI and discontinuation; acid-suppressive (or suppressant) therapy and discontinuation; SUP and cost; and histamine receptor antagonist and PPI. Inpatient or outpatient studies of patients aged 18 years or older were considered for inclusion in this narrative review, and all study types were included. The primary exclusion criterion was patients aged younger than 18 years. A manual review of the full text of the retrieved articles was performed and references were reviewed for missed citations.

We identified a total of 1,497 unique citations through our initial search. After performing a manual review, we excluded 1,483 of the references and added an additional 2, resulting in 16 articles selected for inclusion. The selected articles addressed interventions falling into three main groupings: implementation of institutional guidelines with or without electronic health record (EHR)–based decision support, educational interventions alone, and multifaceted interventions. Each of these interventions is discussed in the sections that follow. Table 1, Table 2, and Table 3 summarize the results of the studies included in our narrative review.

Institutional Guidelines With or Without EHR-Based Decision Support

Table 1 summarizes institutional guidelines, with or without EHR-based decision support, to reduce inappropriate PPI use. The implementation of institutional guidelines for the appropriate reduction of PPI use has had some success. Coursol and Sanzari evaluated the impact of a treatment algorithm on the appropriateness of prescriptions for SUP in the intensive care unit (ICU).⁸ Risk factors of patients in this study included mechanical ventilation for 48 hours, coagulopathy for 24 hours, postoperative transplant, severe burns, active gastrointestinal (GI) disease, multiple trauma, multiple organ failure, and septicemia. The three treatment options chosen for the algorithm were intravenous (IV) famotidine (if the oral route was unavailable or impractical), omeprazole tablets (if oral access was available), and omeprazole suspension (in cases of dysphagia and presence of nasogastric or orogastric tube). After implementation of the treatment algorithm, the proportion of inappropriate prophylaxis decreased from 95.7% to 88.2% (P = .033), and the cost per patient decreased from $11.11 to $8.49 Canadian dollars (P = .003).

Van Vliet et al implemented a clinical practice guideline listing specific criteria for prescribing a PPI.⁹ Their criteria included the presence of gastric or duodenal ulcer and use of a nonsteroidal anti-inflammatory drug (NSAID) or aspirin, plus at least one additional risk factor (eg, history of gastroduodenal hemorrhage or age >70 years). The proportion of patients started on PPIs during hospitalization decreased from 21% to 13% (odds ratio, 0.56; 95% CI, 0.33-0.97).

Michal et al utilized an institutional pharmacist-driven protocol that stipulated criteria for appropriate PPI use (eg, upper GIB, mechanical ventilation, peptic ulcer disease, gastroesophageal reflux disease, coagulopathy).¹⁰ Pharmacists in the study evaluated patients for PPI appropriateness and recommended changes in medication or discontinuation of use. This institutional intervention decreased PPI use in non-ICU hospitalized adults. Discontinuation of PPIs increased from 41% of patients in the preintervention group to 66% of patients in the postintervention group (P = .001).

In addition to implementing guidelines and intervention strategies, institutions have also adopted changes to the EHR to reduce inappropriate PPI use. Herzig et al utilized a computerized clinical decision support intervention to decrease SUP in non-ICU hospitalized patients.¹¹ Of the available response options for acid-suppressive medication, when SUP was chosen as the only indication for PPI use a prompt alerted the clinician that “[SUP] is not recommended for patients outside the [ICU]”; the alert resulted in a significant reduction in AST for the sole purpose of SUP. With this intervention, the percentage of patients who had any inappropriate acid-suppressive exposure decreased from 4.0% to 0.6% (P < .001).

Table 2 summarizes educational interventions to reduce inappropriate PPI use.

Agee et al employed a pharmacist-led educational seminar that described SUP indications, risks, and costs.¹² Inappropriate SUP prescriptions decreased from 55.5% to 30.5% after the intervention (P < .0001). However, there was no reduction in the percentage of patients discharged on inappropriate AST.

Chui et al performed an intervention with academic detailing wherein a one-on-one visit with a physician took place, providing education to improve physician prescribing behavior.¹³ In this study, academic detailing focused on the most common instances for which PPIs were inappropriately utilized at that hospital (eg, surgical prophylaxis, anemia). Inappropriate use of double-dose PPIs was also targeted. Despite these efforts, no significant difference in inappropriate PPI prescribing was observed post intervention.

Hamzat et al implemented an educational strategy to reduce inappropriate PPI prescribing during hospital stays, which included dissemination of fliers, posters, emails, and presentations over a 4-week period.¹⁴ Educational efforts targeted clinical pharmacists, nurses, physicians, and patients. Appropriate indications for PPI use in this study included peptic ulcer disease (current or previous), H pylori infection, and treatment or prevention of an NSAID-induced ulcer. The primary outcome was a reduction in PPI dose or discontinuation of PPI during the hospital admission, which increased from 9% in the preintervention (pre-education) phase to 43% during the intervention (education) phase and to 46% in the postintervention (posteducation) phase (P = .006).

Liberman and Whelan also implemented an educational intervention among internal medicine residents to reduce inappropriate use of SUP; this intervention was based on practice-based learning and improvement methodology.¹⁵ They noted that the rate of inappropriate prophylaxis with AST decreased from 59% preintervention to 33% post intervention (P < .007).

Table 3 summarizes several multifaceted approaches aimed at reducing inappropriate PPI use. Belfield et al utilized an intervention consisting of an institutional guideline review, education, and monitoring of AST by clinical pharmacists to reduce inappropriate use of PPI for SUP.¹⁶ With this intervention, the primary outcome of total inappropriate days of AST during hospitalization decreased from 279 to 116 (48% relative reduction in risk, P < .01, across 142 patients studied). Furthermore, inappropriate AST prescriptions at discharge decreased from 32% to 8% (P = .006). The one case of GIB noted in this study occurred in the control group.

Del Giorno et al combined audit and feedback with education to reduce new PPI prescriptions at the time of discharge from the hospital.¹⁷ The educational component of this intervention included guidance regarding potentially inappropriate PPI use and associated side effects and targeted multiple departments in the hospital. This intervention led to a sustained reduction in new PPI prescriptions at discharge during the 3-year study period. The annual rate of new PPI prescriptions was 19%, 19%, 18%, and 16% in years 2014, 2015, 2016, and 2017, respectively, in the internal medicine department (postintervention group), compared with rates of 30%, 29%, 36%, 36% (P < .001) for the same years in the surgery department (control group).

Education and the use of medication reconciliation forms on admission and discharge were utilized by Gupta et al to reduce inappropriate AST in hospitalized patients from 51% prior to intervention to 22% post intervention (P < .001).¹⁸ Furthermore, the proportion of patients discharged on inappropriate AST decreased from 69% to 20% (P < .001).

Hatch et al also used educational resources and pharmacist-led medication reconciliation to reduce use of SUP.¹⁹ Before the intervention, 24.4% of patients were continued on SUP after hospital discharge in the absence of a clear indication for use; post intervention, 11% of patients were continued on SUP after hospital discharge (of these patients, 8.7% had no clear indication for use). This represented a 64.4% decrease in inappropriately prescribed SUP after discharge (P < .0001).

Khalili et al combined an educational intervention with an institutional guideline in an infectious disease ward to reduce inappropriate use of SUP.²⁰ This intervention reduced the inappropriate use of AST from 80.9% before the intervention to 47.1% post intervention (P < .001).

Masood et al implemented two interventions wherein pharmacists reviewed SUP indications for each patient during daily team rounds, and ICU residents and fellows received education about indications for SUP and the implemented initiative on a bimonthly basis.²¹ Inappropriate AST decreased from 26.75 to 7.14 prescriptions per 100 patient-days of care (P < .001).

McDonald et al combined education with a web-based quality improvement tool to reduce inappropriate exit prescriptions for PPIs.²² The proportion of PPIs discontinued at hospital discharge increased from 7.7% per month to 18.5% per month (P = .03).

Finally, the initiative implemented by Tasaka et al to reduce overutilization of SUP included an institutional guideline, a pharmacist-led intervention, and an institutional education and awareness campaign.²³ Their initiative led to a reduction in inappropriate SUP both at the time of transfer out of the ICU (8% before intervention, 4% post intervention, P = .54) and at the time of discharge from the hospital (7% before intervention, 0% post intervention, P = .22).

Proton pump inhibitors are often initiated in the hospital setting, with up to half of these new prescriptions continued at discharge.^2,24,25 Inappropriate prescriptions for PPIs expose patients to excess risk of long-term adverse events.²⁶ De-escalating PPIs, however, raises concern among clinicians and patients for potential recurrence of dyspepsia and GIB. There is limited evidence regarding long-term safety outcomes (including GIB) following the discontinuation of PPIs deemed to have been inappropriately initiated in the hospital. In view of this, clinicians should educate and monitor individual patients for symptom relapse to ensure timely and appropriate resumption of AST.

Our literature search for this narrative review and implementation guide has limitations. First, the time frame we included (2000-2018) may have excluded relevant articles published before our starting year. We did not include articles published before 2000 based on concerns these might contain outdated information. Also, there may have been incomplete retrieval of relevant studies/articles due to the labor-intensive nature involved in determining whether PPI prescriptions are appropriate or inappropriate.

We noted that interventional studies aimed at reducing overuse of PPIs were often limited by a low number of participants; these studies were also more likely to be single-center interventions, which limits generalizability. In addition, the studies often had low methodological rigor and lacked randomization or controls. Moreover, to fully evaluate the sustainability of interventions, some of the studies had a limited postimplementation period. For multifaceted interventions, the efficacy of individual components of the interventions was not clearly evaluated. Moreover, there was a high risk of bias in many of the included studies. Some of the larger studies used overall AST prescriptions as a surrogate for more appropriate use. It would be advantageous for a site to perform a pilot study that provides well-defined parameters for appropriate prescribing, and then correlate with the total number of prescriptions (automated and much easier) thereafter. Further, although the evidence regarding appropriate PPI use for SUP and GIB has shifted rapidly in recent years, society guidelines have not been updated to reflect this change. As such, quality improvement interventions have predominantly focused on reducing PPI use for the indications reflected by these guidelines.

The following are our recommendations for successfully implementing an evidence-based, institution-wide initiative to promote the appropriate use of PPIs during hospitalization. These recommendations are informed by the evidence review and reflect the consensus of the combined committees coauthoring this review.

For an initiative to succeed, participation from multiple disciplines is necessary to formulate local guidelines and design and implement interventions. Such an interdisciplinary approach requires advocates to closely monitor and evaluate the program; sustainability will be greatly facilitated by the active engagement of key stakeholders, including the hospital’s executive administration, supply chain, pharmacists, and gastroenterologists. Lack of adequate buy-in on the part of key stakeholders is a barrier to the success of any intervention. Accordingly, before selecting a particular intervention, it is important to understand local factors driving the overuse of PPI.

1. Develop evidence-based institutional guidelines for both SUP and nonvariceal upper GIB through an interdisciplinary workgroup.

• Establish an interdisciplinary group including, but not limited to, pharmacists, hospitalists, gastroenterologists, and intensivists so that changes in practice will be widely adopted as institutional policy.
• Incorporate the best evidence and clearly convey appropriate and inappropriate uses.

2. Integrate changes to the EHR.

• If possible, the EHR should be leveraged to implement changes in PPI ordering practices.
• While integrating changes to the EHR, it is important to consider informatics and implementation science, since the utility of hard stops and best practice alerts has been questioned in the setting of operational inefficiencies and alert fatigue.
• Options for integrating changes to the EHR include the following:
  • Create an ordering pathway that provides clinical decision support for PPI use.
  • Incorporate a best practice alert in the EMR to notify clinicians of institutional guidelines when they initiate an order for PPI outside of the pathway.
  • Consider restricting the authority to order IV PPIs by requiring a code or password or implement another means of using the EHR to limit the supply of PPI.
  • Limit the duration of IV PPI by requiring daily renewal of IV PPI dosing or by altering the period of time that use of IV PPI is permitted (eg, 48 to 72 hours).
  • PPIs should be removed from any current order sets that include medications for SUP.

3. Foster pharmacy-driven interventions.

• Consider requiring pharmacist approval for IV PPIs.
• Pharmacist-led review and feedback to clinicians for discontinuation of inappropriate PPIs can be effective in decreasing inappropriate utilization.

4. Provide education, audit data, and obtain feedback.

• Data auditing is needed to measure the efficacy of interventions. Outcome measures may include the number of non-ICU and ICU patients who are started on a PPI during an admission; the audit should be continued through discharge. A process measure may be the number of pharmacist calls for inappropriate PPIs. A balancing measure would be ulcer-specific upper GIB in patients who do not receive SUP during their admission. (Upper GIB from other etiologies, such as varices, portal hypertensive gastropathy, and Mallory-Weiss tear would not be affected by PPI SUP.)
• Run or control charts should be utilized, and data should be shared with project champions and ordering clinicians—in real time if possible.
• Project champions should provide feedback to colleagues; they should also work with hospital leadership to develop new strategies to improve adherence.
• Provide ongoing education about appropriate indications for PPIs and potential adverse effects associated with their use. Whenever possible, point-of-care or just-in-time teaching is the preferred format.

Excessive use of PPIs during hospitalization is prevalent; however, quality improvement interventions can be effective in achieving sustainable reductions in overuse. There is a need for the American College of Gastroenterology to revisit and update their guidelines for management of patients with ulcer bleeding to include stronger evidence-based recommendations on the proper use of PPIs.²⁷ These updated guidelines could be used to update the implementation blueprint.

Quality improvement teams have an opportunity to use the principles of value-based healthcare to reduce inappropriate PPI use. By following the blueprint outlined in this article, institutions can safely and effectively tailor the use of PPIs to suitable patients in the appropriate settings. Reduction of PPI overuse can be employed as an institutional catalyst to promote implementation of further value-based measures to improve efficiency and quality of patient care.

In this issue of the Journal of Hospital Medicine^®, Drs. Arora and Moriates highlight an important deficiency in quality improvement efforts designed to reduce overuse of tests and treatments: the potential for trainees—and by extension, more seasoned clinicians—to rationalize minimizing under the guise of high-value care.¹ This insightful perspective from the Co-Directors of Costs of Care should serve as a catalyst for further robust and effective care redesign efforts to optimize the use of all medical resources, including tests, treatments, procedures, consultations, emergency department (ED) visits, and hospital admissions. The formula to root out minimizers is not straightforward and requires an evaluation of wasteful practices in a nuanced and holistic manner that considers not only the frequency that the overused test (or treatment) is ordered but also the collateral impact of not ordering it. This principle has implications for measuring, paying for, and studying high-value care.

Overuse of tests and treatments increases costs and carries a risk of harm, from unnecessary use of creatine kinase–myocardial band (CK-MB) in suspected acute coronary syndrome² to unwarranted administration of antibiotics for asymptomatic bacteriuria³ to over-administration of blood transfusions.⁴ However, decreasing the use of a commonly ordered test is not always clinically appropriate. To illustrate this point, we consider the evidence-based algorithm to deliver best practice in the work-up of pulmonary embolism (PE) by Raja et al; which integrates pretest probability, PERC assessment, and appropriate use of D-dimer and pulmonary CT angiography (CTA).⁵ Avoiding D-dimer testing is appropriate in patients with very low pretest probability who pass a pulmonary embolism rule-out criteria (PERC) clinical assessment and is also appropriate in patients who have sufficiently high clinical probability for PE to justify CTA regardless of a D-dimer result. On the other hand, avoiding D-dimer testing by attributing a patient’s symptoms to anxiety (as a minimizer might do) would increase patient risk, and could potentially increase cost if that patient ends up in intensive care after delayed diagnosis. Following diagnostic algorithms that include physician decision-making and evidence-based guidelines can prevent overuse and underuse, thereby maximizing efficiency and effectiveness. Engaging trainees in the development of such algorithms and decision support tools will serve to ingrain these principles into their practice.

Arora and Moriates highlight the importance of caring for a patient along a continuum rather than simply optimizing practice with respect to a single management decision or an isolated care episode. This approach is fundamental to the quality of care we provide, the public trust our profession still commands, and the total cost of care (TCOC). The two largest contributors to debilitating patient healthcare debt are not overuse of tests and treatments, but ED visits and hospitalizations.⁶ Thus, high-value quality improvement needs to anticipate future healthcare needs, including those that may result from delayed or missed diagnoses. Furthermore, excessive focus on the minutiae of high-value care (fewer daily basic metabolic panels) can lead to change fatigue and divert attention from higher impact utilization. We endorse a holistic approach in which the lens is shifted from the test—and even from the encounter or episode of care—to the entire continuum of care so that we can safeguard against inappropriate minimization. This approach has started to gain traction with policymakers. For example, the state of Maryland has implemented a TCOC hospital payment model predicted to save $1 billion by 2023.⁷ The TCOC model includes a Care Redesign Program whereby hospitals and nonhospital healthcare providers collaborate to improve the quality of care while reducing spending, and cost savings can be used for incentive payments to the nonhospital providers (gainsharing) while simultaneously monitoring quality measures to guard against rationing.⁷ In keeping with the authors’ call to prioritize overall health, this new reimbursement model and others similar to it aim to incentivize the delivery of high-value care across a continuum.

Research is needed to guide best practice from this global perspective; as such, value improvement projects aimed at optimizing use of tests and treatments should include rigorous methodology, measures of downstream outcomes and costs, and balancing safety measures.⁸ For example, the ROMICAT II randomized trial evaluated two diagnostic approaches in emergency department patients with suspected acute coronary syndrome: early coronary computed tomography angiogram (CCTA) and standard ED evaluation.⁹ In addition to outcomes related to the ED visit itself, downstream testing and outcomes for 28 days after the episode were studied. In the acute setting, CCTA decreased time to diagnosis, reduced mean hospital length of stay by 7.6 hours, and resulted in 47% of patients being discharged within 8.6 hours as opposed to only 12% of the standard evaluation cohort. No cases of ACS were missed, and the CCTA cohort has slightly fewer cardiovascular adverse events (P = .18). However, the CCTA patients received significantly more diagnostic and functional testing and higher radiation exposure than the standard evaluation cohort, and underwent modestly higher rates of coronary angiography and percutaneous coronary intervention. The TCOC over the 28-day period was similar at $4,289 for CCTA versus $4,060 for standard care (P = .65).⁹

Reducing the TCOC is imperative to protect patients from the burden of healthcare debt, but concerns have been raised about the ethics of high-value care if decision-making is driven by cost considerations.¹⁰ A recent viewpoint proposed a framework where high-value care recommendations are categorized as obligatory (protecting patients from harm), permissible (call for shared decision-making), or suspect (entirely cost-driven). By reframing care redesign as thoughtful, responsible care delivery, we can better incentivize physicians to exercise professionalism and maintain medical practice as a public trust.

High-value champions have a great deal of work ahead to redesign care to improve health, reduce TCOC, and investigate outcomes of care redesign. We applaud Drs. Arora and Moriates for once again leading the charge in preparing medical students and residents to deliver higher-value healthcare by emphasizing that effective patient care is not measured by a single episode or clinical decision, but is defined through a lifelong partnership between the patient and the healthcare system. As the country moves toward improved holistic models of care and financing, physician leadership in care redesign is essential to ensure that quality, safety, and patient well-being are not sacrificed at the altar of cost savings.

Disclosures

Dr. Johnson is a Consultant and Advisory Board Member at Oliver Wyman, receives salary support from an AHRQ grant, and has pending potential royalties from licensure of evidence-based appropriate use guidelines/criteria to AgilMD (Agile is a clinical decision support company). The other authors have no relevant disclosures. Dr. Johnson and Dr. Pahwa are Co-directors, High Value Practice Academic Alliance, www.hvpaa.org

In this issue of the Journal of Hospital Medicine^®, Drs. Arora and Moriates highlight an important deficiency in quality improvement efforts designed to reduce overuse of tests and treatments: the potential for trainees—and by extension, more seasoned clinicians—to rationalize minimizing under the guise of high-value care.¹ This insightful perspective from the Co-Directors of Costs of Care should serve as a catalyst for further robust and effective care redesign efforts to optimize the use of all medical resources, including tests, treatments, procedures, consultations, emergency department (ED) visits, and hospital admissions. The formula to root out minimizers is not straightforward and requires an evaluation of wasteful practices in a nuanced and holistic manner that considers not only the frequency that the overused test (or treatment) is ordered but also the collateral impact of not ordering it. This principle has implications for measuring, paying for, and studying high-value care.

Overuse of tests and treatments increases costs and carries a risk of harm, from unnecessary use of creatine kinase–myocardial band (CK-MB) in suspected acute coronary syndrome² to unwarranted administration of antibiotics for asymptomatic bacteriuria³ to over-administration of blood transfusions.⁴ However, decreasing the use of a commonly ordered test is not always clinically appropriate. To illustrate this point, we consider the evidence-based algorithm to deliver best practice in the work-up of pulmonary embolism (PE) by Raja et al; which integrates pretest probability, PERC assessment, and appropriate use of D-dimer and pulmonary CT angiography (CTA).⁵ Avoiding D-dimer testing is appropriate in patients with very low pretest probability who pass a pulmonary embolism rule-out criteria (PERC) clinical assessment and is also appropriate in patients who have sufficiently high clinical probability for PE to justify CTA regardless of a D-dimer result. On the other hand, avoiding D-dimer testing by attributing a patient’s symptoms to anxiety (as a minimizer might do) would increase patient risk, and could potentially increase cost if that patient ends up in intensive care after delayed diagnosis. Following diagnostic algorithms that include physician decision-making and evidence-based guidelines can prevent overuse and underuse, thereby maximizing efficiency and effectiveness. Engaging trainees in the development of such algorithms and decision support tools will serve to ingrain these principles into their practice.

Arora and Moriates highlight the importance of caring for a patient along a continuum rather than simply optimizing practice with respect to a single management decision or an isolated care episode. This approach is fundamental to the quality of care we provide, the public trust our profession still commands, and the total cost of care (TCOC). The two largest contributors to debilitating patient healthcare debt are not overuse of tests and treatments, but ED visits and hospitalizations.⁶ Thus, high-value quality improvement needs to anticipate future healthcare needs, including those that may result from delayed or missed diagnoses. Furthermore, excessive focus on the minutiae of high-value care (fewer daily basic metabolic panels) can lead to change fatigue and divert attention from higher impact utilization. We endorse a holistic approach in which the lens is shifted from the test—and even from the encounter or episode of care—to the entire continuum of care so that we can safeguard against inappropriate minimization. This approach has started to gain traction with policymakers. For example, the state of Maryland has implemented a TCOC hospital payment model predicted to save $1 billion by 2023.⁷ The TCOC model includes a Care Redesign Program whereby hospitals and nonhospital healthcare providers collaborate to improve the quality of care while reducing spending, and cost savings can be used for incentive payments to the nonhospital providers (gainsharing) while simultaneously monitoring quality measures to guard against rationing.⁷ In keeping with the authors’ call to prioritize overall health, this new reimbursement model and others similar to it aim to incentivize the delivery of high-value care across a continuum.

Research is needed to guide best practice from this global perspective; as such, value improvement projects aimed at optimizing use of tests and treatments should include rigorous methodology, measures of downstream outcomes and costs, and balancing safety measures.⁸ For example, the ROMICAT II randomized trial evaluated two diagnostic approaches in emergency department patients with suspected acute coronary syndrome: early coronary computed tomography angiogram (CCTA) and standard ED evaluation.⁹ In addition to outcomes related to the ED visit itself, downstream testing and outcomes for 28 days after the episode were studied. In the acute setting, CCTA decreased time to diagnosis, reduced mean hospital length of stay by 7.6 hours, and resulted in 47% of patients being discharged within 8.6 hours as opposed to only 12% of the standard evaluation cohort. No cases of ACS were missed, and the CCTA cohort has slightly fewer cardiovascular adverse events (P = .18). However, the CCTA patients received significantly more diagnostic and functional testing and higher radiation exposure than the standard evaluation cohort, and underwent modestly higher rates of coronary angiography and percutaneous coronary intervention. The TCOC over the 28-day period was similar at $4,289 for CCTA versus $4,060 for standard care (P = .65).⁹

Reducing the TCOC is imperative to protect patients from the burden of healthcare debt, but concerns have been raised about the ethics of high-value care if decision-making is driven by cost considerations.¹⁰ A recent viewpoint proposed a framework where high-value care recommendations are categorized as obligatory (protecting patients from harm), permissible (call for shared decision-making), or suspect (entirely cost-driven). By reframing care redesign as thoughtful, responsible care delivery, we can better incentivize physicians to exercise professionalism and maintain medical practice as a public trust.

High-value champions have a great deal of work ahead to redesign care to improve health, reduce TCOC, and investigate outcomes of care redesign. We applaud Drs. Arora and Moriates for once again leading the charge in preparing medical students and residents to deliver higher-value healthcare by emphasizing that effective patient care is not measured by a single episode or clinical decision, but is defined through a lifelong partnership between the patient and the healthcare system. As the country moves toward improved holistic models of care and financing, physician leadership in care redesign is essential to ensure that quality, safety, and patient well-being are not sacrificed at the altar of cost savings.

Disclosures

Dr. Johnson is a Consultant and Advisory Board Member at Oliver Wyman, receives salary support from an AHRQ grant, and has pending potential royalties from licensure of evidence-based appropriate use guidelines/criteria to AgilMD (Agile is a clinical decision support company). The other authors have no relevant disclosures. Dr. Johnson and Dr. Pahwa are Co-directors, High Value Practice Academic Alliance, www.hvpaa.org

In this issue of the Journal of Hospital Medicine^®, Drs. Arora and Moriates highlight an important deficiency in quality improvement efforts designed to reduce overuse of tests and treatments: the potential for trainees—and by extension, more seasoned clinicians—to rationalize minimizing under the guise of high-value care.¹ This insightful perspective from the Co-Directors of Costs of Care should serve as a catalyst for further robust and effective care redesign efforts to optimize the use of all medical resources, including tests, treatments, procedures, consultations, emergency department (ED) visits, and hospital admissions. The formula to root out minimizers is not straightforward and requires an evaluation of wasteful practices in a nuanced and holistic manner that considers not only the frequency that the overused test (or treatment) is ordered but also the collateral impact of not ordering it. This principle has implications for measuring, paying for, and studying high-value care.

Overuse of tests and treatments increases costs and carries a risk of harm, from unnecessary use of creatine kinase–myocardial band (CK-MB) in suspected acute coronary syndrome² to unwarranted administration of antibiotics for asymptomatic bacteriuria³ to over-administration of blood transfusions.⁴ However, decreasing the use of a commonly ordered test is not always clinically appropriate. To illustrate this point, we consider the evidence-based algorithm to deliver best practice in the work-up of pulmonary embolism (PE) by Raja et al; which integrates pretest probability, PERC assessment, and appropriate use of D-dimer and pulmonary CT angiography (CTA).⁵ Avoiding D-dimer testing is appropriate in patients with very low pretest probability who pass a pulmonary embolism rule-out criteria (PERC) clinical assessment and is also appropriate in patients who have sufficiently high clinical probability for PE to justify CTA regardless of a D-dimer result. On the other hand, avoiding D-dimer testing by attributing a patient’s symptoms to anxiety (as a minimizer might do) would increase patient risk, and could potentially increase cost if that patient ends up in intensive care after delayed diagnosis. Following diagnostic algorithms that include physician decision-making and evidence-based guidelines can prevent overuse and underuse, thereby maximizing efficiency and effectiveness. Engaging trainees in the development of such algorithms and decision support tools will serve to ingrain these principles into their practice.

Arora and Moriates highlight the importance of caring for a patient along a continuum rather than simply optimizing practice with respect to a single management decision or an isolated care episode. This approach is fundamental to the quality of care we provide, the public trust our profession still commands, and the total cost of care (TCOC). The two largest contributors to debilitating patient healthcare debt are not overuse of tests and treatments, but ED visits and hospitalizations.⁶ Thus, high-value quality improvement needs to anticipate future healthcare needs, including those that may result from delayed or missed diagnoses. Furthermore, excessive focus on the minutiae of high-value care (fewer daily basic metabolic panels) can lead to change fatigue and divert attention from higher impact utilization. We endorse a holistic approach in which the lens is shifted from the test—and even from the encounter or episode of care—to the entire continuum of care so that we can safeguard against inappropriate minimization. This approach has started to gain traction with policymakers. For example, the state of Maryland has implemented a TCOC hospital payment model predicted to save $1 billion by 2023.⁷ The TCOC model includes a Care Redesign Program whereby hospitals and nonhospital healthcare providers collaborate to improve the quality of care while reducing spending, and cost savings can be used for incentive payments to the nonhospital providers (gainsharing) while simultaneously monitoring quality measures to guard against rationing.⁷ In keeping with the authors’ call to prioritize overall health, this new reimbursement model and others similar to it aim to incentivize the delivery of high-value care across a continuum.

Research is needed to guide best practice from this global perspective; as such, value improvement projects aimed at optimizing use of tests and treatments should include rigorous methodology, measures of downstream outcomes and costs, and balancing safety measures.⁸ For example, the ROMICAT II randomized trial evaluated two diagnostic approaches in emergency department patients with suspected acute coronary syndrome: early coronary computed tomography angiogram (CCTA) and standard ED evaluation.⁹ In addition to outcomes related to the ED visit itself, downstream testing and outcomes for 28 days after the episode were studied. In the acute setting, CCTA decreased time to diagnosis, reduced mean hospital length of stay by 7.6 hours, and resulted in 47% of patients being discharged within 8.6 hours as opposed to only 12% of the standard evaluation cohort. No cases of ACS were missed, and the CCTA cohort has slightly fewer cardiovascular adverse events (P = .18). However, the CCTA patients received significantly more diagnostic and functional testing and higher radiation exposure than the standard evaluation cohort, and underwent modestly higher rates of coronary angiography and percutaneous coronary intervention. The TCOC over the 28-day period was similar at $4,289 for CCTA versus $4,060 for standard care (P = .65).⁹

Reducing the TCOC is imperative to protect patients from the burden of healthcare debt, but concerns have been raised about the ethics of high-value care if decision-making is driven by cost considerations.¹⁰ A recent viewpoint proposed a framework where high-value care recommendations are categorized as obligatory (protecting patients from harm), permissible (call for shared decision-making), or suspect (entirely cost-driven). By reframing care redesign as thoughtful, responsible care delivery, we can better incentivize physicians to exercise professionalism and maintain medical practice as a public trust.

High-value champions have a great deal of work ahead to redesign care to improve health, reduce TCOC, and investigate outcomes of care redesign. We applaud Drs. Arora and Moriates for once again leading the charge in preparing medical students and residents to deliver higher-value healthcare by emphasizing that effective patient care is not measured by a single episode or clinical decision, but is defined through a lifelong partnership between the patient and the healthcare system. As the country moves toward improved holistic models of care and financing, physician leadership in care redesign is essential to ensure that quality, safety, and patient well-being are not sacrificed at the altar of cost savings.

Disclosures

Dr. Johnson is a Consultant and Advisory Board Member at Oliver Wyman, receives salary support from an AHRQ grant, and has pending potential royalties from licensure of evidence-based appropriate use guidelines/criteria to AgilMD (Agile is a clinical decision support company). The other authors have no relevant disclosures. Dr. Johnson and Dr. Pahwa are Co-directors, High Value Practice Academic Alliance, www.hvpaa.org

Reducing the treatment of asymptomatic bacteriuria (ASB), or isolation of bacteria from a urine specimen in a patient without urinary tract infection (UTI) symptoms, is a key goal of antibiotic stewardship programs.¹ Treatment of ASB has been associated with the emergence of resistant organisms and subsequent UTI risk among women with recurrent UTI.^2,3 The Infectious Diseases Society of America and the American Board of Internal Medicine Foundation’s Choosing Wisely campaign recommend against treating ASB, with the exception of pregnant patients and urogenital surgical patients.^1,4

Obtaining urinalyses and urine cultures (UC) in asymptomatic patients may contribute to the unnecessary treatment of ASB. In a study of hospitalized patients, 62% received urinalysis testing, even though 82% of these patients did not have UTI symptoms.⁵ Of the patients found to have ASB, 30% were given antibiotics.⁵ Therefore, interventions aimed at reducing urine testing may reduce ASB treatment.

Electronic passive clinical decision support (CDS) alerts and electronic education may be effective interventions to reduce urine testing.⁶ While CDS tools are recommended in antibiotic stewardship guidelines,⁷ they have led to only modest improvements in appropriate antibiotic prescribing and are typically bundled with time-intensive educational interventions.⁸ Furthermore, most in-hospital interventions to decrease ASB treatment have focused on intensive care units (ICUs).⁹ We hypothesized that CDS and electronic education would decrease (1) urinalysis and UC ordering and (2) antibiotic orders for urinalyses and UCs in hospitalized adult patients.

Population

We conducted a prospective time series analysis (preintervention: September 2014 to June 2015; postintervention: September 2015 to June 2016) at a large tertiary medical center. All hospitalized patients ≥18 years old were eligible except those admitted to services requiring specialized ASB management (eg, leukemia and lymphoma, solid organ transplant, and obstetrics).¹ The study was declared quality improvement by the Johns Hopkins Institutional Review Board.

Intervention

In August 2015, we implemented a multifaceted intervention that included provider education and passive electronic CDS (supplementary Appendix 1 and supplementary Appendix 2). Materials were disseminated through hospital-wide computer workstation screensavers and a 1-page e-mailed newsletter to department of medicine clinicians. The CDS tool included simple informational messages recommending against urine testing without symptoms and against treating ASB; these messages accompanied electronic health record (EHR; Allscripts Sunrise Clinical Manager, Chicago, IL) orders for urinalysis, UC, and antibiotics commonly used within our institution to treat UTI (cefazolin, cephalexin, ceftriaxone, trimethoprim-sulfamethoxazole, nitrofurantoin, and ciprofloxacin). The information was displayed automatically when orders for these tests and antibiotics were selected; provider acknowledgment was not required to proceed.

Data Collection

The services within our hospital are geographically located. We collected orders for urinalysis, UC, and the associated antibiotics for all units except those housing patients excluded from our study. As the CDS tool appeared only in the inpatient EHR, only postadmission orders were included, excluding emergency department orders. For admissions with multiple urinalyses, urinalysis orders placed ≥72 hours apart were eligible. Only antibiotics ordered for ≥24 hours were included, excluding on-call and 1-time antibiotic orders.

Our approach to data collection attempted to model a clinician’s decision-making pathway from (1) ordering a urinalysis, to (2) ordering a UC in response to a urinalysis result, to (3) ordering antibiotics in response to a urinalysis or UC result. We focused on order placement rather than results to prioritize avoiding testing in asymptomatic patients, as our institution does not require positive urinalyses for UC testing (reflex testing). Urinalyses resulted within 1 to 2 hours, allowing for clinicians to quickly order UCs after urinalysis result review. Urinalysis and UC orders per monthly admissions were defined as (1) urinalyses, (2) UCs, (3) simultaneous urinalysis and UC (within 1 hour of each other), and (4) UCs ordered 1 to 24 hours after urinalysis. We also analyzed the following antibiotic orders per monthly admissions: (1) simultaneous urinalysis and antibiotic orders, (2) antibiotics ordered 1 to 24 hours after urinalysis order, and (3) antibiotics ordered within 24 hours of the UC result.

Outcome Measures

All outcome measures were calculated as the change over time per total monthly admissions in the preintervention and postintervention periods. In addition to symptoms, urinalysis is a critical, measurable early step in determining the presence of ASB. Therefore, the primary outcome measure was the postintervention change in monthly urinalysis orders, and the secondary outcome measure was the postintervention change in monthly UC orders. Additional outcome measures included monthly postintervention changes in (1) UC ordered 1 to 24 hours after urinalyses, (2) urinalyses and antibiotics ordered simultaneously, (3) antibiotic orders within 1 to 24 hours of urinalyses, and (4) antibiotics ordered within 24 hours of UC result.

Statistical Analysis

Statistical analyses were performed by using Stata (version 14.2; StataCorp LLC, College Station, TX). An interrupted time series analysis was performed to compare the change in orders per 100 monthly admissions in preintervention and postintervention periods. To do this, we created 2 separate segmented linear regression models for each dependent variable, pre- and postintervention. Normality was assumed because of large numbers. Rate differences per 100 monthly admissions are also calculated as the total number of orders divided by the total number of admissions in postintervention and preintervention periods with Mantel-Haenszel estimators. Differences were considered statistically significant at P ≤ .05.

A multifaceted but simple bundle of CDS and provider education reduced UC testing but not urinalyses in a large tertiary care hospital. The bundle also reduced antibiotic ordering in response to urinalyses as well as antibiotic ordering in response to UC results.

Other in-hospital CDS tools to decrease ASB treatment have focused only on ICUs.^9,10 Our intervention was evaluated hospital-wide and included urinalyses and UCs. Our intervention was clinician directed and not laboratory directed, such as a positive urinalysis reflexing to a UC. Simultaneous urinalysis and UC testing may lead to ASB treatment, as clinicians treat the positive UC and ignore the negative urinalysis.^11,12 Therefore, we focused on UCs being sent in response to urinalyses.

We chose to focus on laboratory testing data instead of administrative diagnoses for UTI. The sensitivity of administrative data to determine similar conditions such as catheter-associated UTIs is low (0%).¹³

Our single-center study may not be generalizable to other settings. We did not include emergency department patients, as this location used a different EHR. In addition, given the 600,000 yearly hospital admissions, it was impractical to assess the appropriateness of each antibiotic-based documentation of symptoms. Instead of focusing on symptoms of ASB or UTI diagnoses, we focused on ordering urinalysis, UC, and antibiotics. In investigating the antibiotics most frequently used to treat UTI in our hospital, we may have both missed some patients who were treated with other antibiotics for ASB (eg, 4th generation cephalosporins, penicillins, carbapenems, etc) and captured patients receiving antibiotics for indications other than UTI (eg, pneumonia). In our focus on overall ordering practices across a hospital, we did not capture data on bladder catheterization status or the predominant organism seen in UC. At the time of the intervention, the laboratory did not have the resources for urinalysis testing reflexing to UC. However, our intervention did not prevent ordering simultaneous urinalysis and UC in symptomatic patients in general or urosepsis in particular. With only 12 total time points, the interrupted time series analysis may have been underpowered.¹⁴ We also do not know if the intervention’s effect would decay over time.

Although the intervention took very little staff time and resources, alert fatigue was a risk.¹⁵ We attempted to mitigate this alert fatigue by making the CDS passive (in the form of a brief informational message) with no provider action required. In conversations with providers in our institution, there has been dissatisfaction with alerts requiring action, as these are thought to be overly intrusive. We are also not clear on which element of the intervention bundle (ie, the CDS or the educational intervention) may have had more of an impact, as the elements of the intervention bundle were rolled out simultaneously. It is possible and even probable that both elements are needed to raise awareness of the problem. Also, as our EHR required all interventions to be rolled out hospital-wide simultaneously, we were unable to randomize certain floors or providers to the CDS portion of the intervention bundle. Other analyses including the type of hospital unit were beyond the scope of this brief report.

Our intervention bundle was associated with reduced UC orders and reduced antibiotics ordered after urinalyses. If a provider does not know there is bacteriuria, then the provider will not be tempted to order antibiotics. This easily implementable bundle may play an important role as an antimicrobial stewardship strategy for ASB.

Acknowledgments

The authors acknowledge the support of Erin Fanning, BS, and Angel Florentin, BS, in providing data for analysis. SCK received funding from the Johns Hopkins Institute for Clinical and Translational Research (ICTR), which is funded in part by grant number KL2TR001077 from the National Center for Advancing Translational Sciences (NCATS), a component of the National Institutes of Health (NIH), and the NIH Roadmap for Medical Research. These contents are solely the responsibility of the authors and do not necessarily represent the official view of the Johns Hopkins ICTR, NCATS, or NIH. We also acknowledge support from the Centers for Disease Control and Prevention’s Prevention Epicenter Program Q8377 (collaborative agreement U54 CK000447 to SEC). SEC has received support for consulting from Novartis and Theravance, and her institution has received a grant from Pfizer Grants for Learning and Change/The Joint Commission. This work was supported by the NIH T32 HL116275 to NC. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

Disclosure

No conflicts of interest have been reported by any author.

Reducing the treatment of asymptomatic bacteriuria (ASB), or isolation of bacteria from a urine specimen in a patient without urinary tract infection (UTI) symptoms, is a key goal of antibiotic stewardship programs.¹ Treatment of ASB has been associated with the emergence of resistant organisms and subsequent UTI risk among women with recurrent UTI.^2,3 The Infectious Diseases Society of America and the American Board of Internal Medicine Foundation’s Choosing Wisely campaign recommend against treating ASB, with the exception of pregnant patients and urogenital surgical patients.^1,4

Obtaining urinalyses and urine cultures (UC) in asymptomatic patients may contribute to the unnecessary treatment of ASB. In a study of hospitalized patients, 62% received urinalysis testing, even though 82% of these patients did not have UTI symptoms.⁵ Of the patients found to have ASB, 30% were given antibiotics.⁵ Therefore, interventions aimed at reducing urine testing may reduce ASB treatment.

Electronic passive clinical decision support (CDS) alerts and electronic education may be effective interventions to reduce urine testing.⁶ While CDS tools are recommended in antibiotic stewardship guidelines,⁷ they have led to only modest improvements in appropriate antibiotic prescribing and are typically bundled with time-intensive educational interventions.⁸ Furthermore, most in-hospital interventions to decrease ASB treatment have focused on intensive care units (ICUs).⁹ We hypothesized that CDS and electronic education would decrease (1) urinalysis and UC ordering and (2) antibiotic orders for urinalyses and UCs in hospitalized adult patients.

Population

We conducted a prospective time series analysis (preintervention: September 2014 to June 2015; postintervention: September 2015 to June 2016) at a large tertiary medical center. All hospitalized patients ≥18 years old were eligible except those admitted to services requiring specialized ASB management (eg, leukemia and lymphoma, solid organ transplant, and obstetrics).¹ The study was declared quality improvement by the Johns Hopkins Institutional Review Board.

Intervention

In August 2015, we implemented a multifaceted intervention that included provider education and passive electronic CDS (supplementary Appendix 1 and supplementary Appendix 2). Materials were disseminated through hospital-wide computer workstation screensavers and a 1-page e-mailed newsletter to department of medicine clinicians. The CDS tool included simple informational messages recommending against urine testing without symptoms and against treating ASB; these messages accompanied electronic health record (EHR; Allscripts Sunrise Clinical Manager, Chicago, IL) orders for urinalysis, UC, and antibiotics commonly used within our institution to treat UTI (cefazolin, cephalexin, ceftriaxone, trimethoprim-sulfamethoxazole, nitrofurantoin, and ciprofloxacin). The information was displayed automatically when orders for these tests and antibiotics were selected; provider acknowledgment was not required to proceed.

Data Collection

The services within our hospital are geographically located. We collected orders for urinalysis, UC, and the associated antibiotics for all units except those housing patients excluded from our study. As the CDS tool appeared only in the inpatient EHR, only postadmission orders were included, excluding emergency department orders. For admissions with multiple urinalyses, urinalysis orders placed ≥72 hours apart were eligible. Only antibiotics ordered for ≥24 hours were included, excluding on-call and 1-time antibiotic orders.

Our approach to data collection attempted to model a clinician’s decision-making pathway from (1) ordering a urinalysis, to (2) ordering a UC in response to a urinalysis result, to (3) ordering antibiotics in response to a urinalysis or UC result. We focused on order placement rather than results to prioritize avoiding testing in asymptomatic patients, as our institution does not require positive urinalyses for UC testing (reflex testing). Urinalyses resulted within 1 to 2 hours, allowing for clinicians to quickly order UCs after urinalysis result review. Urinalysis and UC orders per monthly admissions were defined as (1) urinalyses, (2) UCs, (3) simultaneous urinalysis and UC (within 1 hour of each other), and (4) UCs ordered 1 to 24 hours after urinalysis. We also analyzed the following antibiotic orders per monthly admissions: (1) simultaneous urinalysis and antibiotic orders, (2) antibiotics ordered 1 to 24 hours after urinalysis order, and (3) antibiotics ordered within 24 hours of the UC result.

Outcome Measures

All outcome measures were calculated as the change over time per total monthly admissions in the preintervention and postintervention periods. In addition to symptoms, urinalysis is a critical, measurable early step in determining the presence of ASB. Therefore, the primary outcome measure was the postintervention change in monthly urinalysis orders, and the secondary outcome measure was the postintervention change in monthly UC orders. Additional outcome measures included monthly postintervention changes in (1) UC ordered 1 to 24 hours after urinalyses, (2) urinalyses and antibiotics ordered simultaneously, (3) antibiotic orders within 1 to 24 hours of urinalyses, and (4) antibiotics ordered within 24 hours of UC result.

Statistical Analysis

Statistical analyses were performed by using Stata (version 14.2; StataCorp LLC, College Station, TX). An interrupted time series analysis was performed to compare the change in orders per 100 monthly admissions in preintervention and postintervention periods. To do this, we created 2 separate segmented linear regression models for each dependent variable, pre- and postintervention. Normality was assumed because of large numbers. Rate differences per 100 monthly admissions are also calculated as the total number of orders divided by the total number of admissions in postintervention and preintervention periods with Mantel-Haenszel estimators. Differences were considered statistically significant at P ≤ .05.

A multifaceted but simple bundle of CDS and provider education reduced UC testing but not urinalyses in a large tertiary care hospital. The bundle also reduced antibiotic ordering in response to urinalyses as well as antibiotic ordering in response to UC results.

Other in-hospital CDS tools to decrease ASB treatment have focused only on ICUs.^9,10 Our intervention was evaluated hospital-wide and included urinalyses and UCs. Our intervention was clinician directed and not laboratory directed, such as a positive urinalysis reflexing to a UC. Simultaneous urinalysis and UC testing may lead to ASB treatment, as clinicians treat the positive UC and ignore the negative urinalysis.^11,12 Therefore, we focused on UCs being sent in response to urinalyses.

We chose to focus on laboratory testing data instead of administrative diagnoses for UTI. The sensitivity of administrative data to determine similar conditions such as catheter-associated UTIs is low (0%).¹³

Our single-center study may not be generalizable to other settings. We did not include emergency department patients, as this location used a different EHR. In addition, given the 600,000 yearly hospital admissions, it was impractical to assess the appropriateness of each antibiotic-based documentation of symptoms. Instead of focusing on symptoms of ASB or UTI diagnoses, we focused on ordering urinalysis, UC, and antibiotics. In investigating the antibiotics most frequently used to treat UTI in our hospital, we may have both missed some patients who were treated with other antibiotics for ASB (eg, 4th generation cephalosporins, penicillins, carbapenems, etc) and captured patients receiving antibiotics for indications other than UTI (eg, pneumonia). In our focus on overall ordering practices across a hospital, we did not capture data on bladder catheterization status or the predominant organism seen in UC. At the time of the intervention, the laboratory did not have the resources for urinalysis testing reflexing to UC. However, our intervention did not prevent ordering simultaneous urinalysis and UC in symptomatic patients in general or urosepsis in particular. With only 12 total time points, the interrupted time series analysis may have been underpowered.¹⁴ We also do not know if the intervention’s effect would decay over time.

Although the intervention took very little staff time and resources, alert fatigue was a risk.¹⁵ We attempted to mitigate this alert fatigue by making the CDS passive (in the form of a brief informational message) with no provider action required. In conversations with providers in our institution, there has been dissatisfaction with alerts requiring action, as these are thought to be overly intrusive. We are also not clear on which element of the intervention bundle (ie, the CDS or the educational intervention) may have had more of an impact, as the elements of the intervention bundle were rolled out simultaneously. It is possible and even probable that both elements are needed to raise awareness of the problem. Also, as our EHR required all interventions to be rolled out hospital-wide simultaneously, we were unable to randomize certain floors or providers to the CDS portion of the intervention bundle. Other analyses including the type of hospital unit were beyond the scope of this brief report.

Our intervention bundle was associated with reduced UC orders and reduced antibiotics ordered after urinalyses. If a provider does not know there is bacteriuria, then the provider will not be tempted to order antibiotics. This easily implementable bundle may play an important role as an antimicrobial stewardship strategy for ASB.

Acknowledgments

The authors acknowledge the support of Erin Fanning, BS, and Angel Florentin, BS, in providing data for analysis. SCK received funding from the Johns Hopkins Institute for Clinical and Translational Research (ICTR), which is funded in part by grant number KL2TR001077 from the National Center for Advancing Translational Sciences (NCATS), a component of the National Institutes of Health (NIH), and the NIH Roadmap for Medical Research. These contents are solely the responsibility of the authors and do not necessarily represent the official view of the Johns Hopkins ICTR, NCATS, or NIH. We also acknowledge support from the Centers for Disease Control and Prevention’s Prevention Epicenter Program Q8377 (collaborative agreement U54 CK000447 to SEC). SEC has received support for consulting from Novartis and Theravance, and her institution has received a grant from Pfizer Grants for Learning and Change/The Joint Commission. This work was supported by the NIH T32 HL116275 to NC. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

Disclosure

No conflicts of interest have been reported by any author.

Reducing the treatment of asymptomatic bacteriuria (ASB), or isolation of bacteria from a urine specimen in a patient without urinary tract infection (UTI) symptoms, is a key goal of antibiotic stewardship programs.¹ Treatment of ASB has been associated with the emergence of resistant organisms and subsequent UTI risk among women with recurrent UTI.^2,3 The Infectious Diseases Society of America and the American Board of Internal Medicine Foundation’s Choosing Wisely campaign recommend against treating ASB, with the exception of pregnant patients and urogenital surgical patients.^1,4

Obtaining urinalyses and urine cultures (UC) in asymptomatic patients may contribute to the unnecessary treatment of ASB. In a study of hospitalized patients, 62% received urinalysis testing, even though 82% of these patients did not have UTI symptoms.⁵ Of the patients found to have ASB, 30% were given antibiotics.⁵ Therefore, interventions aimed at reducing urine testing may reduce ASB treatment.

Electronic passive clinical decision support (CDS) alerts and electronic education may be effective interventions to reduce urine testing.⁶ While CDS tools are recommended in antibiotic stewardship guidelines,⁷ they have led to only modest improvements in appropriate antibiotic prescribing and are typically bundled with time-intensive educational interventions.⁸ Furthermore, most in-hospital interventions to decrease ASB treatment have focused on intensive care units (ICUs).⁹ We hypothesized that CDS and electronic education would decrease (1) urinalysis and UC ordering and (2) antibiotic orders for urinalyses and UCs in hospitalized adult patients.

Population

We conducted a prospective time series analysis (preintervention: September 2014 to June 2015; postintervention: September 2015 to June 2016) at a large tertiary medical center. All hospitalized patients ≥18 years old were eligible except those admitted to services requiring specialized ASB management (eg, leukemia and lymphoma, solid organ transplant, and obstetrics).¹ The study was declared quality improvement by the Johns Hopkins Institutional Review Board.

Intervention

In August 2015, we implemented a multifaceted intervention that included provider education and passive electronic CDS (supplementary Appendix 1 and supplementary Appendix 2). Materials were disseminated through hospital-wide computer workstation screensavers and a 1-page e-mailed newsletter to department of medicine clinicians. The CDS tool included simple informational messages recommending against urine testing without symptoms and against treating ASB; these messages accompanied electronic health record (EHR; Allscripts Sunrise Clinical Manager, Chicago, IL) orders for urinalysis, UC, and antibiotics commonly used within our institution to treat UTI (cefazolin, cephalexin, ceftriaxone, trimethoprim-sulfamethoxazole, nitrofurantoin, and ciprofloxacin). The information was displayed automatically when orders for these tests and antibiotics were selected; provider acknowledgment was not required to proceed.

Data Collection

The services within our hospital are geographically located. We collected orders for urinalysis, UC, and the associated antibiotics for all units except those housing patients excluded from our study. As the CDS tool appeared only in the inpatient EHR, only postadmission orders were included, excluding emergency department orders. For admissions with multiple urinalyses, urinalysis orders placed ≥72 hours apart were eligible. Only antibiotics ordered for ≥24 hours were included, excluding on-call and 1-time antibiotic orders.

Our approach to data collection attempted to model a clinician’s decision-making pathway from (1) ordering a urinalysis, to (2) ordering a UC in response to a urinalysis result, to (3) ordering antibiotics in response to a urinalysis or UC result. We focused on order placement rather than results to prioritize avoiding testing in asymptomatic patients, as our institution does not require positive urinalyses for UC testing (reflex testing). Urinalyses resulted within 1 to 2 hours, allowing for clinicians to quickly order UCs after urinalysis result review. Urinalysis and UC orders per monthly admissions were defined as (1) urinalyses, (2) UCs, (3) simultaneous urinalysis and UC (within 1 hour of each other), and (4) UCs ordered 1 to 24 hours after urinalysis. We also analyzed the following antibiotic orders per monthly admissions: (1) simultaneous urinalysis and antibiotic orders, (2) antibiotics ordered 1 to 24 hours after urinalysis order, and (3) antibiotics ordered within 24 hours of the UC result.

Outcome Measures

All outcome measures were calculated as the change over time per total monthly admissions in the preintervention and postintervention periods. In addition to symptoms, urinalysis is a critical, measurable early step in determining the presence of ASB. Therefore, the primary outcome measure was the postintervention change in monthly urinalysis orders, and the secondary outcome measure was the postintervention change in monthly UC orders. Additional outcome measures included monthly postintervention changes in (1) UC ordered 1 to 24 hours after urinalyses, (2) urinalyses and antibiotics ordered simultaneously, (3) antibiotic orders within 1 to 24 hours of urinalyses, and (4) antibiotics ordered within 24 hours of UC result.

Statistical Analysis

Statistical analyses were performed by using Stata (version 14.2; StataCorp LLC, College Station, TX). An interrupted time series analysis was performed to compare the change in orders per 100 monthly admissions in preintervention and postintervention periods. To do this, we created 2 separate segmented linear regression models for each dependent variable, pre- and postintervention. Normality was assumed because of large numbers. Rate differences per 100 monthly admissions are also calculated as the total number of orders divided by the total number of admissions in postintervention and preintervention periods with Mantel-Haenszel estimators. Differences were considered statistically significant at P ≤ .05.

A multifaceted but simple bundle of CDS and provider education reduced UC testing but not urinalyses in a large tertiary care hospital. The bundle also reduced antibiotic ordering in response to urinalyses as well as antibiotic ordering in response to UC results.

Other in-hospital CDS tools to decrease ASB treatment have focused only on ICUs.^9,10 Our intervention was evaluated hospital-wide and included urinalyses and UCs. Our intervention was clinician directed and not laboratory directed, such as a positive urinalysis reflexing to a UC. Simultaneous urinalysis and UC testing may lead to ASB treatment, as clinicians treat the positive UC and ignore the negative urinalysis.^11,12 Therefore, we focused on UCs being sent in response to urinalyses.

We chose to focus on laboratory testing data instead of administrative diagnoses for UTI. The sensitivity of administrative data to determine similar conditions such as catheter-associated UTIs is low (0%).¹³

Our single-center study may not be generalizable to other settings. We did not include emergency department patients, as this location used a different EHR. In addition, given the 600,000 yearly hospital admissions, it was impractical to assess the appropriateness of each antibiotic-based documentation of symptoms. Instead of focusing on symptoms of ASB or UTI diagnoses, we focused on ordering urinalysis, UC, and antibiotics. In investigating the antibiotics most frequently used to treat UTI in our hospital, we may have both missed some patients who were treated with other antibiotics for ASB (eg, 4th generation cephalosporins, penicillins, carbapenems, etc) and captured patients receiving antibiotics for indications other than UTI (eg, pneumonia). In our focus on overall ordering practices across a hospital, we did not capture data on bladder catheterization status or the predominant organism seen in UC. At the time of the intervention, the laboratory did not have the resources for urinalysis testing reflexing to UC. However, our intervention did not prevent ordering simultaneous urinalysis and UC in symptomatic patients in general or urosepsis in particular. With only 12 total time points, the interrupted time series analysis may have been underpowered.¹⁴ We also do not know if the intervention’s effect would decay over time.

Although the intervention took very little staff time and resources, alert fatigue was a risk.¹⁵ We attempted to mitigate this alert fatigue by making the CDS passive (in the form of a brief informational message) with no provider action required. In conversations with providers in our institution, there has been dissatisfaction with alerts requiring action, as these are thought to be overly intrusive. We are also not clear on which element of the intervention bundle (ie, the CDS or the educational intervention) may have had more of an impact, as the elements of the intervention bundle were rolled out simultaneously. It is possible and even probable that both elements are needed to raise awareness of the problem. Also, as our EHR required all interventions to be rolled out hospital-wide simultaneously, we were unable to randomize certain floors or providers to the CDS portion of the intervention bundle. Other analyses including the type of hospital unit were beyond the scope of this brief report.

Our intervention bundle was associated with reduced UC orders and reduced antibiotics ordered after urinalyses. If a provider does not know there is bacteriuria, then the provider will not be tempted to order antibiotics. This easily implementable bundle may play an important role as an antimicrobial stewardship strategy for ASB.

Acknowledgments

The authors acknowledge the support of Erin Fanning, BS, and Angel Florentin, BS, in providing data for analysis. SCK received funding from the Johns Hopkins Institute for Clinical and Translational Research (ICTR), which is funded in part by grant number KL2TR001077 from the National Center for Advancing Translational Sciences (NCATS), a component of the National Institutes of Health (NIH), and the NIH Roadmap for Medical Research. These contents are solely the responsibility of the authors and do not necessarily represent the official view of the Johns Hopkins ICTR, NCATS, or NIH. We also acknowledge support from the Centers for Disease Control and Prevention’s Prevention Epicenter Program Q8377 (collaborative agreement U54 CK000447 to SEC). SEC has received support for consulting from Novartis and Theravance, and her institution has received a grant from Pfizer Grants for Learning and Change/The Joint Commission. This work was supported by the NIH T32 HL116275 to NC. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

Disclosure

No conflicts of interest have been reported by any author.

During internal medicine (IM) clerkships, course directors are responsible for ensuring that medical students attain basic competency in patient management through use of risk–benefit, cost–benefit, and evidence-based considerations.¹ However, the students’ primary teachers—IM residents and attendings—consistently role-model high-value care (HVC) perhaps only half the time.² The inconsistency may have a few sources, including unawareness of the costs of tests and treatments ordered and little formal training in HVC.^3-5 In addition, the environment at some academic institutions may reward learners for performing tests that may be unnecessary.⁶

We conducted a study to assess medical students’ perceptions of unnecessary testing and the adequacy–inadequacy of HVC instruction, as well as their observations of behavior that may hinder the practice of HVC during the IM clerkship.

When students completed their third-year IM clerkships at The Johns Hopkins University School of Medicine, the Icahn School of Medicine at Mount Sinai, the University of Alabama at Birmingham School of Medicine, and the Tulane University School of Medicine, we sent them a recruitment email asking them to complete an anonymous survey regarding their clerkship experiences with HVC. The clerkships’ directors, who collaborated on survey development, searched the literature to quantify behavior thought to decrease the practice of HVC. The survey was tested several times with different learners and faculty to increase response process validity.

The SurveyMonkey online platform was used to administer the survey. Students were given 1 week after the end of their clerkship to complete the survey. Data were collected for the period October 2013 to December 2014. Each student was offered a $10 gift certificate for survey completion. Each institution received exempt approval from its institutional review board.

Survey respondents were divided into those who perceived HVC education as adequate and those who perceived it as inadequate. Chi-square tests were performed with Stata Version 12 (College Station, TX) to determine whether a student’s perception of HVC education being adequate or inadequate was significantly associated with the other survey questions.

Of 577 eligible students, 307 (53%) completed the survey. About 83% of the respondents reported noticing the ordering of laboratory or radiologic tests they considered unnecessary, and a majority (81%) of those students noticed this activity at least once a week. Overall, 51% of the respondents thought their HVC education was inadequate. Significantly more of the students who perceived their HVC education as inadequate were uncomfortable bringing an unnecessary test to the attention of the ward team, rarely discussed costs, and rarely observed team members being praised for forgoing unnecessary tests (Table). Two significant associations were found: between institution attended and perceived adequacy–inadequacy of HVC education and between institution and frequency of cost discussions.

Most (78.5%) students thought an HVC curriculum should be added to the IM clerkship, and 34.5% thought the HVC curriculum should be incorporated into daily rounds. In regards to additions to the clerkship curriculum, most students wanted to round with phlebotomy (29%) or discuss costs of testing on patients (26%).

Students attributed the ordering of unnecessary tests and treatments to several factors: residents investigating “interesting diagnoses” (46%), teams practicing defensive medicine (43%), consultants making requests (40%), attendings investigating “interesting diagnoses” (27%), and patients making requests (8%).

About 51% of the students thought their HVC education was inadequate, and about 83% noticed unnecessary testing. Our study findings reaffirm those of a single-site study in which 93% of students noted unnecessary testing.⁷

In this study, many students perceived HVC education as inadequate and reported wanting HVC principles added to their training and an HVC curriculum incorporated into daily rounds. Students who perceived HVC education as inadequate were significantly less comfortable bringing an unnecessary test to the attention of the ward team and noticed less discussion about costs and less praise for avoiding unnecessary tests. One institution had a significantly higher proportion of students perceiving their HVC education as adequate and noticing more discussions about test costs. This institution was the only one that incorporated discussions about test costs into its curriculum during the study period—which may account for its students’ perceptions.

This study had a few limitations. First, as the survey was administered after the IM clerkships, students’ responses may have been subject to recall bias. We minimized this bias by allowing 1 week for survey completion. Second, given the 53% response rate, there may have been response bias. However, one institution’s demographics showed no significant differences between responders and nonresponders with respect to age, sex, ethnicity, or type of degree. Third, students’ understanding of what tests and treatments are necessary and unnecessary may be relatively underdeveloped, given their training level. One study found that medical students with minimal clinical experience were able to identify unnecessary tests and treatments, but this study has not been validated at other institutions.⁷

Efforts to increase HVC education and practice have focused on residents and attendings, but our study findings reaffirm that HVC training is much needed and wanted in undergraduate medical education. Studies are needed to test the effectiveness of HVC curricula in medical school and the ability of these curricula to give students the tools they need to practice HVC.

Disclosures

Dr. Pahwa received support from the Johns Hopkins Hospitalist Scholars Fund, and Dr. Cayea is supported by the Daniel and Jeanette Hendin Schapiro Geriatric Medical Education Center. The sponsors had no role in study design, methods, subject recruitment, data collection, data analysis, or manuscript preparation. The authors have no conflicts of interest to disclose.

During internal medicine (IM) clerkships, course directors are responsible for ensuring that medical students attain basic competency in patient management through use of risk–benefit, cost–benefit, and evidence-based considerations.¹ However, the students’ primary teachers—IM residents and attendings—consistently role-model high-value care (HVC) perhaps only half the time.² The inconsistency may have a few sources, including unawareness of the costs of tests and treatments ordered and little formal training in HVC.^3-5 In addition, the environment at some academic institutions may reward learners for performing tests that may be unnecessary.⁶

We conducted a study to assess medical students’ perceptions of unnecessary testing and the adequacy–inadequacy of HVC instruction, as well as their observations of behavior that may hinder the practice of HVC during the IM clerkship.

When students completed their third-year IM clerkships at The Johns Hopkins University School of Medicine, the Icahn School of Medicine at Mount Sinai, the University of Alabama at Birmingham School of Medicine, and the Tulane University School of Medicine, we sent them a recruitment email asking them to complete an anonymous survey regarding their clerkship experiences with HVC. The clerkships’ directors, who collaborated on survey development, searched the literature to quantify behavior thought to decrease the practice of HVC. The survey was tested several times with different learners and faculty to increase response process validity.

The SurveyMonkey online platform was used to administer the survey. Students were given 1 week after the end of their clerkship to complete the survey. Data were collected for the period October 2013 to December 2014. Each student was offered a $10 gift certificate for survey completion. Each institution received exempt approval from its institutional review board.

Survey respondents were divided into those who perceived HVC education as adequate and those who perceived it as inadequate. Chi-square tests were performed with Stata Version 12 (College Station, TX) to determine whether a student’s perception of HVC education being adequate or inadequate was significantly associated with the other survey questions.

Of 577 eligible students, 307 (53%) completed the survey. About 83% of the respondents reported noticing the ordering of laboratory or radiologic tests they considered unnecessary, and a majority (81%) of those students noticed this activity at least once a week. Overall, 51% of the respondents thought their HVC education was inadequate. Significantly more of the students who perceived their HVC education as inadequate were uncomfortable bringing an unnecessary test to the attention of the ward team, rarely discussed costs, and rarely observed team members being praised for forgoing unnecessary tests (Table). Two significant associations were found: between institution attended and perceived adequacy–inadequacy of HVC education and between institution and frequency of cost discussions.

Most (78.5%) students thought an HVC curriculum should be added to the IM clerkship, and 34.5% thought the HVC curriculum should be incorporated into daily rounds. In regards to additions to the clerkship curriculum, most students wanted to round with phlebotomy (29%) or discuss costs of testing on patients (26%).

Students attributed the ordering of unnecessary tests and treatments to several factors: residents investigating “interesting diagnoses” (46%), teams practicing defensive medicine (43%), consultants making requests (40%), attendings investigating “interesting diagnoses” (27%), and patients making requests (8%).

About 51% of the students thought their HVC education was inadequate, and about 83% noticed unnecessary testing. Our study findings reaffirm those of a single-site study in which 93% of students noted unnecessary testing.⁷

In this study, many students perceived HVC education as inadequate and reported wanting HVC principles added to their training and an HVC curriculum incorporated into daily rounds. Students who perceived HVC education as inadequate were significantly less comfortable bringing an unnecessary test to the attention of the ward team and noticed less discussion about costs and less praise for avoiding unnecessary tests. One institution had a significantly higher proportion of students perceiving their HVC education as adequate and noticing more discussions about test costs. This institution was the only one that incorporated discussions about test costs into its curriculum during the study period—which may account for its students’ perceptions.

This study had a few limitations. First, as the survey was administered after the IM clerkships, students’ responses may have been subject to recall bias. We minimized this bias by allowing 1 week for survey completion. Second, given the 53% response rate, there may have been response bias. However, one institution’s demographics showed no significant differences between responders and nonresponders with respect to age, sex, ethnicity, or type of degree. Third, students’ understanding of what tests and treatments are necessary and unnecessary may be relatively underdeveloped, given their training level. One study found that medical students with minimal clinical experience were able to identify unnecessary tests and treatments, but this study has not been validated at other institutions.⁷

Efforts to increase HVC education and practice have focused on residents and attendings, but our study findings reaffirm that HVC training is much needed and wanted in undergraduate medical education. Studies are needed to test the effectiveness of HVC curricula in medical school and the ability of these curricula to give students the tools they need to practice HVC.

Disclosures

Dr. Pahwa received support from the Johns Hopkins Hospitalist Scholars Fund, and Dr. Cayea is supported by the Daniel and Jeanette Hendin Schapiro Geriatric Medical Education Center. The sponsors had no role in study design, methods, subject recruitment, data collection, data analysis, or manuscript preparation. The authors have no conflicts of interest to disclose.

During internal medicine (IM) clerkships, course directors are responsible for ensuring that medical students attain basic competency in patient management through use of risk–benefit, cost–benefit, and evidence-based considerations.¹ However, the students’ primary teachers—IM residents and attendings—consistently role-model high-value care (HVC) perhaps only half the time.² The inconsistency may have a few sources, including unawareness of the costs of tests and treatments ordered and little formal training in HVC.^3-5 In addition, the environment at some academic institutions may reward learners for performing tests that may be unnecessary.⁶

We conducted a study to assess medical students’ perceptions of unnecessary testing and the adequacy–inadequacy of HVC instruction, as well as their observations of behavior that may hinder the practice of HVC during the IM clerkship.

When students completed their third-year IM clerkships at The Johns Hopkins University School of Medicine, the Icahn School of Medicine at Mount Sinai, the University of Alabama at Birmingham School of Medicine, and the Tulane University School of Medicine, we sent them a recruitment email asking them to complete an anonymous survey regarding their clerkship experiences with HVC. The clerkships’ directors, who collaborated on survey development, searched the literature to quantify behavior thought to decrease the practice of HVC. The survey was tested several times with different learners and faculty to increase response process validity.

The SurveyMonkey online platform was used to administer the survey. Students were given 1 week after the end of their clerkship to complete the survey. Data were collected for the period October 2013 to December 2014. Each student was offered a $10 gift certificate for survey completion. Each institution received exempt approval from its institutional review board.

Survey respondents were divided into those who perceived HVC education as adequate and those who perceived it as inadequate. Chi-square tests were performed with Stata Version 12 (College Station, TX) to determine whether a student’s perception of HVC education being adequate or inadequate was significantly associated with the other survey questions.

Of 577 eligible students, 307 (53%) completed the survey. About 83% of the respondents reported noticing the ordering of laboratory or radiologic tests they considered unnecessary, and a majority (81%) of those students noticed this activity at least once a week. Overall, 51% of the respondents thought their HVC education was inadequate. Significantly more of the students who perceived their HVC education as inadequate were uncomfortable bringing an unnecessary test to the attention of the ward team, rarely discussed costs, and rarely observed team members being praised for forgoing unnecessary tests (Table). Two significant associations were found: between institution attended and perceived adequacy–inadequacy of HVC education and between institution and frequency of cost discussions.

Most (78.5%) students thought an HVC curriculum should be added to the IM clerkship, and 34.5% thought the HVC curriculum should be incorporated into daily rounds. In regards to additions to the clerkship curriculum, most students wanted to round with phlebotomy (29%) or discuss costs of testing on patients (26%).

Students attributed the ordering of unnecessary tests and treatments to several factors: residents investigating “interesting diagnoses” (46%), teams practicing defensive medicine (43%), consultants making requests (40%), attendings investigating “interesting diagnoses” (27%), and patients making requests (8%).

About 51% of the students thought their HVC education was inadequate, and about 83% noticed unnecessary testing. Our study findings reaffirm those of a single-site study in which 93% of students noted unnecessary testing.⁷

In this study, many students perceived HVC education as inadequate and reported wanting HVC principles added to their training and an HVC curriculum incorporated into daily rounds. Students who perceived HVC education as inadequate were significantly less comfortable bringing an unnecessary test to the attention of the ward team and noticed less discussion about costs and less praise for avoiding unnecessary tests. One institution had a significantly higher proportion of students perceiving their HVC education as adequate and noticing more discussions about test costs. This institution was the only one that incorporated discussions about test costs into its curriculum during the study period—which may account for its students’ perceptions.

This study had a few limitations. First, as the survey was administered after the IM clerkships, students’ responses may have been subject to recall bias. We minimized this bias by allowing 1 week for survey completion. Second, given the 53% response rate, there may have been response bias. However, one institution’s demographics showed no significant differences between responders and nonresponders with respect to age, sex, ethnicity, or type of degree. Third, students’ understanding of what tests and treatments are necessary and unnecessary may be relatively underdeveloped, given their training level. One study found that medical students with minimal clinical experience were able to identify unnecessary tests and treatments, but this study has not been validated at other institutions.⁷

Efforts to increase HVC education and practice have focused on residents and attendings, but our study findings reaffirm that HVC training is much needed and wanted in undergraduate medical education. Studies are needed to test the effectiveness of HVC curricula in medical school and the ability of these curricula to give students the tools they need to practice HVC.

Disclosures

Dr. Pahwa received support from the Johns Hopkins Hospitalist Scholars Fund, and Dr. Cayea is supported by the Daniel and Jeanette Hendin Schapiro Geriatric Medical Education Center. The sponsors had no role in study design, methods, subject recruitment, data collection, data analysis, or manuscript preparation. The authors have no conflicts of interest to disclose.