Sarah Imershein, MS

© 2017 Society of Hospital Medicine

Strategies are needed to empower frontline clinicians to work with organizational leadership to reduce healthcare costs and improve high-value care. Caring Wisely^® is a program developed by the University of California, San Francisco’s (UCSF) Center for Healthcare Value (CHV), aimed at engaging frontline clinicians and staff, connecting them with implementation experts, and supporting the development of targeted interventions to improve value. Financial savings from the program more than cover program costs. Caring Wisely^® provides an institutional model for implementing robust interventions to address areas of low-value care.

Launched in 2013, the annual Caring Wisely^® program consists of 3 stages for identifying projects that meet the following criteria:

• Potential to measurably reduce UCSF Health’s costs of care without transferring costs to patients, insurers, or other providers
• Plan for ensuring that health outcomes are maintained or improved
• Envision disseminating the intervention within and beyond UCSF
• Demonstrate commitment and engagement of clinical leadership and frontline staff.

The first stage is the Ideas Contest, a UCSF Health-wide call (to learn more about UCSF Health: https://www.ucsf.edu/sites/default/files/052516_About_UCSF.pdf) to identify areas that may be targeted to reduce unnecessary services, inefficiencies, and healthcare costs. We use a crowdsourcing platform—Open Proposals—to solicit the best ideas from frontline clinicians and staff.¹ Open Proposals is a secure, web-based platform for transparent and collaborative proposal development that displays threads of comments, responses, and revisions, and allows submissions to be “liked.” Open Proposals is managed by the UCSF Clinical and Translational Science Institute, funded by the National Center for Advancing Translational Sciences (Grant Number UL1 TR000004) at the National Institutes of Health. Using institutional e-mail lists for faculty, staff and residents, as well as described at monthly managers and directors meetings, the Ideas Contest is announced each year by the Chief Medical Officer and the CHV leadership. The Caring Wisely^® Executive Steering Committee, which consists of CHV and senior UCSF Health system leaders, selects the top 5-10 ideas based on the above criteria. Each winning idea receives a $100 gift certificate for a popular restaurant in San Francisco, and the list of winners is announced to the entire UCSF community.

The second stage is the Request for Proposals. The Caring Wisely^® program solicits proposals that outline implementation plans to target specific areas identified through the Ideas Contest. Finalists from the Ideas Contest are encouraged to submit proposals that address the problem they identified, but anyone affiliated with UCSF Health may submit a proposal on a winning idea. There is an approximately 4-week open submission period during which applicants submit brief 2-page proposals on the Open Proposal platform. This is followed by a period of optimization that leverages the social media aspect of the Open Proposals platform in which the UCSF Health community asks clarifying questions, make suggestions, and modifications can be made to the proposals. All submissions receive written feedback from at least one Steering Committee member. In addition, the Caring Wisely^® Director directly invites relevant UCSF colleagues, administrators, or program leaders to comment on proposals and make suggestions for improvement. Plans for assessing financial and health care delivery impacts are developed in collaboration with the UCSF Health Finance department. UCSF Health managers and leaders who are stakeholders in project proposal areas are consulted to provide input and finalize proposal plans, including the identification of existing personnel who can support and drive the project forward. Proposers use this feedback to revise their applications throughout this stage.

The third stage is Project Implementation. The Caring Wisely^® Executive Steering Committee selects up to 3 winners from the submitted proposals. Using the program criteria above, each project is scored independently, discussed in committee, and rescored to identify the top proposals. Each selected project receives a maximum budget of $50,000 that can be used for project materials, activities, and salary support for project leaders or staff. In addition to funding, each project team receives input from the implementation science team to co-develop and implement the intervention with a goal of creating a first-test-of-change within 3-6 months. A key feature of Caring Wisely^® is the partnership between project teams and the Caring Wisely^® implementation team, which includes a director, program manager, data analysts, and implementation scientists (Table 1).

The $150,000 administrative budget for the Caring Wisely^® program provides 20% support of the medical director, 50% support of a program manager/analyst, and 10% support of an implementation scientist. Approximately 5% support is donated from additional senior implementation scientists and various UCSF Health experts based on project needs. To make most efficient use of the Caring Wisely^® program staff time with the project teams, there is a weekly 60-90 minute works-in-progress session attended by all 3 teams with a rotating schedule for lead presenter during the first 6 months; these meetings occur every 2-3 weeks during the second 6 months. Caring Wisely^® program staff and the implementation scientist are also available for 1:1 meetings as needed. The Caring Wisely^® Executive Steering Committee is not paid and meets for 90 minutes quarterly. Custom reports and modifications of the electronic health record are provided by the UCSF Health clinical informatics department as part of their operating budget.

The collaboration between the project teams and the implementation science team is guided by the Consolidated Framework for Implementation Research (CFIR)² and PRECEDE-PROCEED model—a logic model and evaluation tool that is based on a composite of individual behavior change theory and social ecology.³ Table 2 illustrates how we weave PRECEDE-PROCEED and Plan-Do-Study-Act frameworks into project design and strategy. Each funded team is required to submit an end-of-year progress report.

Cost and cost savings estimates were based on administrative financial data obtained through the assistance of the Decision Support Services unit of the Finance Department of UCSF Health. All costs reflect direct institutional costs, rather than charges. For some projects, costs are directly available through computerized dashboards that provide year-to-year comparisons of specific costs of materials, supplies, and services (eg, blood transfusion reduction, surgical supplies project, OR efficiency program). This same dashboard also allows calculation of CMI-adjusted direct costs of hospital care by service line, as used in the perioperative pathways program evaluation. In other cases, the Decision Support Services and/or Caring Wisely^® program manager created custom cost reports based on the key performance indicator (eg, nebulizer therapy costs consist of medication costs plus respiratory therapist time; CT scan utilization for suspected pulmonary embolus in emergency department; and antimicrobial utilization for suspected neonatal sepsis).

Ongoing monitoring and sustainability of Caring Wisely^® projects is supported by the Caring Wisely^® program leaders. Monitoring of ongoing cost savings is based on automated service-line level dashboards related to cost, utilization, and quality outcomes with quarterly updates provided to the Caring Wisely^® Steering Committee. Depending on the project or program, appropriate UCSF Health senior leaders determine the level of support within their departments that is required to sustain the program(s). Ongoing monitoring of each program is also included in the strategic deployment visibility room with regular rounding by senior health system executives.

Since 2013, there have been 3 complete Caring Wisely^® cycles. The Ideas Contest generated more than 75 ideas in each of the past 3 cycles, ranging from eliminating redundant laboratory or radiological studies to reducing linen and food waste. We received between 13-20 full proposals in each of the request for proposal stages, and 9 projects have been implemented, 3 in each year. Funded projects have been led by a variety of individuals including physicians, nurses, pharmacists, administrators and residents, and topics have ranged from reducing overutilization of tests, supplies and treatments, to improving patient throughput during the perioperative period (Table 3). Estimated cumulative savings to date from Caring Wisely^® projects has exceeded $4 million, based on the four projects shown in Table 4. The IV-to-PO switch program and the neonatal sepsis risk prediction project (Table 3) have been successful in reducing unnecessary utilization, but cost and savings estimates are not yet finalized. Three funded projects were equivocal in cost savings but were successful in their primary aims: (1) increasing the appropriateness of CT scan ordering for suspected pulmonary embolus; (2) shortening operating room turnover times; and (3) implementing a postoperative debrief program for the systematic documentation of safety events, waste, and inefficiencies related to surgery.

We developed an innovative program that reduces hospital costs through crowdsourcing of ideas from frontline clinicians and staff, and by connecting these ideas to project and implementation science teams. At a time when healthcare costs have reached unsustainable levels, the Caring Wisely^® program provides a process for healthcare personnel to make a positive impact on healthcare costs in areas under their direct control. Through the Open Proposals platform, we have tapped a growing desire among frontline providers to reduce medical waste.

A key criterion for the Caring Wisely^® program is to propose changes that reduce cost without adversely affect healthcare quality or outcomes. While this is an important consideration in selecting projects, there is limited power to detect many of the most clinically relevant outcomes. We find this acceptable because many of the sponsored Caring Wisely^® project goals were to increase compliance with evidence-based practice guidelines and reduce harms associated with unnecessary treatments (eg, blood transfusion, nebulizer therapy, CT scan, antimicrobial therapy). Selected balancing metrics for each project are reported by established quality and safety programs at UCSF Health, but we acknowledge that many factors that can affect these clinical outcomes are not related to the cost-reduction intervention and are not possible to control outside of a clinical research study. Therefore, any response to changes in these outcome and balancing measures requires further analysis beyond the Caring Wisely^® project alone.

We believe one of the key factors in the success of the Caring Wisely^® program is the application of implementation science principles to the intervention design strategies (Table 1). These principles included stakeholder engagement, behavior change theory, market (target audience) segmentation, and process measurement and feedback. Because we are conducting this program in an academic health center, resident and fellow education and engagement are also critical to success. In each project, we utilize the PRECEDE model as a guide to ensure that each intervention design includes complementary elements of effective behavior change, intended to increase awareness and motivation to change, to make change “easy,” and to reinforce change(Table 2).³

The Caring Wisely^® program—itself a multifaceted intervention—embodies the same PRECEDE dimensions we apply to each specific project. The Ideas Contest serves as a tool for increasing awareness, attitudes, and motivation across the clinical enterprise for reducing healthcare costs. The support provided to the project teams by the Caring Wisely^® program is an enabling factor that makes it “easier” for frontline teams to design and implement interventions with a greater likelihood of achieving early success. Timely measurement and feedback of results to the hospital leadership and broadcasting to the larger community reinforces the support of the program at both the leadership and frontline levels.

Collaboration between project teams and the Caring Wisely^® program also provides frontline clinicians and staff with practical experience and lessons that they can apply to future improvement work. Project teams learn implementation science principles such as constructing a pragmatic theoretical framework to guide implementation design using CFIR model.² Incorporating multiple, rapid-cycle tests of change allows teams to modify and adapt final interventions as they learn how the target audience and environment responds to specific intervention components. Access to real-time, actionable data and a data analyst is essential to rapid cycle adaptation that allows teams to focus on specific units or providers. We also find that cross-fertilization between project teams working in different areas helps to share resources and minimize duplication of efforts from the clinical and staff champions. Partnering with UCSF Health system leaders at every phase of project development—from proposal selection, development, and final evaluation of results—enhances sustainable transition of successful projects into clinical operations.

The costs and coordination for the first cycle of Caring Wisely^® were supported by the UCSF Center for Healthcare Value. Upon completion of the evaluation of the first cycle, UCSF Health agreed to fund the program going forward, with the expectation that Caring Wisely would continue to achieve direct cost-savings for the organization. The Caring Wisely team provides a final report each year detailing the impact of each project on utilization and associated costs. Currently, program costs are approximately $150,000 for the Caring Wisely program leaders, staff, and other resources, and $50,000 for each of 3 projects for a total program cost of $300,000 per year. Projects included in the first three cycles have already saved more than $4 million, representing a strong return on investment. This program could be a model for other academic health centers to engage frontline clinicians and staff in addressing healthcare costs, and lends itself to being scaled-up into a multi-system collaborative.

 

LIST OF ABBREVIATIONS

UCSF—University of California, San Francisco; PRECEDE—Predisposing, Reinforcing, and Enabling Constructs in Educational Diagnosis and Evaluation; PROCEED—Policy, Regulatory and Organizational Constructs in Educational and Environmental Development

Acknowledgments

Other participants in blood transfusion reduction project (D. Johnson, K. Curcione); IV-to-PO Switch (C. Tsourounis, A. Pollock); Surgical Supply Cost Reduction (C. Zygourakis); Perioperative Efficiency (L. Hampson); CT for PE Risk Prediction (E. Weber); ERAS Pathways (L. Chen); Neonatal Sepsis Risk Prediction (T. Newman); Post-Operative Debrief (S. Imershein). Caring Wisely Executive Steering Committee (J. Adler, S. Antrum, A Auerbach, J. Bennan, M. Blum, C. Ritchie, C. Tsourounis). This Center for Healthcare Value is funded in part by a grant from the Grove Foundation. We appreciate additional review and comments to the manuscript provided by George Sawaya and Adams Dudley.

Disclosures 

Christopher Moriates has accepted royalties from McGraw-Hill for textbook, Understanding Value-Based Healthcare. Alvin Rajkomar has received fees as a research adviser from Google, Inc.

© 2017 Society of Hospital Medicine

Strategies are needed to empower frontline clinicians to work with organizational leadership to reduce healthcare costs and improve high-value care. Caring Wisely^® is a program developed by the University of California, San Francisco’s (UCSF) Center for Healthcare Value (CHV), aimed at engaging frontline clinicians and staff, connecting them with implementation experts, and supporting the development of targeted interventions to improve value. Financial savings from the program more than cover program costs. Caring Wisely^® provides an institutional model for implementing robust interventions to address areas of low-value care.

Launched in 2013, the annual Caring Wisely^® program consists of 3 stages for identifying projects that meet the following criteria:

• Potential to measurably reduce UCSF Health’s costs of care without transferring costs to patients, insurers, or other providers
• Plan for ensuring that health outcomes are maintained or improved
• Envision disseminating the intervention within and beyond UCSF
• Demonstrate commitment and engagement of clinical leadership and frontline staff.

The first stage is the Ideas Contest, a UCSF Health-wide call (to learn more about UCSF Health: https://www.ucsf.edu/sites/default/files/052516_About_UCSF.pdf) to identify areas that may be targeted to reduce unnecessary services, inefficiencies, and healthcare costs. We use a crowdsourcing platform—Open Proposals—to solicit the best ideas from frontline clinicians and staff.¹ Open Proposals is a secure, web-based platform for transparent and collaborative proposal development that displays threads of comments, responses, and revisions, and allows submissions to be “liked.” Open Proposals is managed by the UCSF Clinical and Translational Science Institute, funded by the National Center for Advancing Translational Sciences (Grant Number UL1 TR000004) at the National Institutes of Health. Using institutional e-mail lists for faculty, staff and residents, as well as described at monthly managers and directors meetings, the Ideas Contest is announced each year by the Chief Medical Officer and the CHV leadership. The Caring Wisely^® Executive Steering Committee, which consists of CHV and senior UCSF Health system leaders, selects the top 5-10 ideas based on the above criteria. Each winning idea receives a $100 gift certificate for a popular restaurant in San Francisco, and the list of winners is announced to the entire UCSF community.

The second stage is the Request for Proposals. The Caring Wisely^® program solicits proposals that outline implementation plans to target specific areas identified through the Ideas Contest. Finalists from the Ideas Contest are encouraged to submit proposals that address the problem they identified, but anyone affiliated with UCSF Health may submit a proposal on a winning idea. There is an approximately 4-week open submission period during which applicants submit brief 2-page proposals on the Open Proposal platform. This is followed by a period of optimization that leverages the social media aspect of the Open Proposals platform in which the UCSF Health community asks clarifying questions, make suggestions, and modifications can be made to the proposals. All submissions receive written feedback from at least one Steering Committee member. In addition, the Caring Wisely^® Director directly invites relevant UCSF colleagues, administrators, or program leaders to comment on proposals and make suggestions for improvement. Plans for assessing financial and health care delivery impacts are developed in collaboration with the UCSF Health Finance department. UCSF Health managers and leaders who are stakeholders in project proposal areas are consulted to provide input and finalize proposal plans, including the identification of existing personnel who can support and drive the project forward. Proposers use this feedback to revise their applications throughout this stage.

The third stage is Project Implementation. The Caring Wisely^® Executive Steering Committee selects up to 3 winners from the submitted proposals. Using the program criteria above, each project is scored independently, discussed in committee, and rescored to identify the top proposals. Each selected project receives a maximum budget of $50,000 that can be used for project materials, activities, and salary support for project leaders or staff. In addition to funding, each project team receives input from the implementation science team to co-develop and implement the intervention with a goal of creating a first-test-of-change within 3-6 months. A key feature of Caring Wisely^® is the partnership between project teams and the Caring Wisely^® implementation team, which includes a director, program manager, data analysts, and implementation scientists (Table 1).

The $150,000 administrative budget for the Caring Wisely^® program provides 20% support of the medical director, 50% support of a program manager/analyst, and 10% support of an implementation scientist. Approximately 5% support is donated from additional senior implementation scientists and various UCSF Health experts based on project needs. To make most efficient use of the Caring Wisely^® program staff time with the project teams, there is a weekly 60-90 minute works-in-progress session attended by all 3 teams with a rotating schedule for lead presenter during the first 6 months; these meetings occur every 2-3 weeks during the second 6 months. Caring Wisely^® program staff and the implementation scientist are also available for 1:1 meetings as needed. The Caring Wisely^® Executive Steering Committee is not paid and meets for 90 minutes quarterly. Custom reports and modifications of the electronic health record are provided by the UCSF Health clinical informatics department as part of their operating budget.

The collaboration between the project teams and the implementation science team is guided by the Consolidated Framework for Implementation Research (CFIR)² and PRECEDE-PROCEED model—a logic model and evaluation tool that is based on a composite of individual behavior change theory and social ecology.³ Table 2 illustrates how we weave PRECEDE-PROCEED and Plan-Do-Study-Act frameworks into project design and strategy. Each funded team is required to submit an end-of-year progress report.

Cost and cost savings estimates were based on administrative financial data obtained through the assistance of the Decision Support Services unit of the Finance Department of UCSF Health. All costs reflect direct institutional costs, rather than charges. For some projects, costs are directly available through computerized dashboards that provide year-to-year comparisons of specific costs of materials, supplies, and services (eg, blood transfusion reduction, surgical supplies project, OR efficiency program). This same dashboard also allows calculation of CMI-adjusted direct costs of hospital care by service line, as used in the perioperative pathways program evaluation. In other cases, the Decision Support Services and/or Caring Wisely^® program manager created custom cost reports based on the key performance indicator (eg, nebulizer therapy costs consist of medication costs plus respiratory therapist time; CT scan utilization for suspected pulmonary embolus in emergency department; and antimicrobial utilization for suspected neonatal sepsis).

Ongoing monitoring and sustainability of Caring Wisely^® projects is supported by the Caring Wisely^® program leaders. Monitoring of ongoing cost savings is based on automated service-line level dashboards related to cost, utilization, and quality outcomes with quarterly updates provided to the Caring Wisely^® Steering Committee. Depending on the project or program, appropriate UCSF Health senior leaders determine the level of support within their departments that is required to sustain the program(s). Ongoing monitoring of each program is also included in the strategic deployment visibility room with regular rounding by senior health system executives.

Since 2013, there have been 3 complete Caring Wisely^® cycles. The Ideas Contest generated more than 75 ideas in each of the past 3 cycles, ranging from eliminating redundant laboratory or radiological studies to reducing linen and food waste. We received between 13-20 full proposals in each of the request for proposal stages, and 9 projects have been implemented, 3 in each year. Funded projects have been led by a variety of individuals including physicians, nurses, pharmacists, administrators and residents, and topics have ranged from reducing overutilization of tests, supplies and treatments, to improving patient throughput during the perioperative period (Table 3). Estimated cumulative savings to date from Caring Wisely^® projects has exceeded $4 million, based on the four projects shown in Table 4. The IV-to-PO switch program and the neonatal sepsis risk prediction project (Table 3) have been successful in reducing unnecessary utilization, but cost and savings estimates are not yet finalized. Three funded projects were equivocal in cost savings but were successful in their primary aims: (1) increasing the appropriateness of CT scan ordering for suspected pulmonary embolus; (2) shortening operating room turnover times; and (3) implementing a postoperative debrief program for the systematic documentation of safety events, waste, and inefficiencies related to surgery.

We developed an innovative program that reduces hospital costs through crowdsourcing of ideas from frontline clinicians and staff, and by connecting these ideas to project and implementation science teams. At a time when healthcare costs have reached unsustainable levels, the Caring Wisely^® program provides a process for healthcare personnel to make a positive impact on healthcare costs in areas under their direct control. Through the Open Proposals platform, we have tapped a growing desire among frontline providers to reduce medical waste.

A key criterion for the Caring Wisely^® program is to propose changes that reduce cost without adversely affect healthcare quality or outcomes. While this is an important consideration in selecting projects, there is limited power to detect many of the most clinically relevant outcomes. We find this acceptable because many of the sponsored Caring Wisely^® project goals were to increase compliance with evidence-based practice guidelines and reduce harms associated with unnecessary treatments (eg, blood transfusion, nebulizer therapy, CT scan, antimicrobial therapy). Selected balancing metrics for each project are reported by established quality and safety programs at UCSF Health, but we acknowledge that many factors that can affect these clinical outcomes are not related to the cost-reduction intervention and are not possible to control outside of a clinical research study. Therefore, any response to changes in these outcome and balancing measures requires further analysis beyond the Caring Wisely^® project alone.

We believe one of the key factors in the success of the Caring Wisely^® program is the application of implementation science principles to the intervention design strategies (Table 1). These principles included stakeholder engagement, behavior change theory, market (target audience) segmentation, and process measurement and feedback. Because we are conducting this program in an academic health center, resident and fellow education and engagement are also critical to success. In each project, we utilize the PRECEDE model as a guide to ensure that each intervention design includes complementary elements of effective behavior change, intended to increase awareness and motivation to change, to make change “easy,” and to reinforce change(Table 2).³

The Caring Wisely^® program—itself a multifaceted intervention—embodies the same PRECEDE dimensions we apply to each specific project. The Ideas Contest serves as a tool for increasing awareness, attitudes, and motivation across the clinical enterprise for reducing healthcare costs. The support provided to the project teams by the Caring Wisely^® program is an enabling factor that makes it “easier” for frontline teams to design and implement interventions with a greater likelihood of achieving early success. Timely measurement and feedback of results to the hospital leadership and broadcasting to the larger community reinforces the support of the program at both the leadership and frontline levels.

Collaboration between project teams and the Caring Wisely^® program also provides frontline clinicians and staff with practical experience and lessons that they can apply to future improvement work. Project teams learn implementation science principles such as constructing a pragmatic theoretical framework to guide implementation design using CFIR model.² Incorporating multiple, rapid-cycle tests of change allows teams to modify and adapt final interventions as they learn how the target audience and environment responds to specific intervention components. Access to real-time, actionable data and a data analyst is essential to rapid cycle adaptation that allows teams to focus on specific units or providers. We also find that cross-fertilization between project teams working in different areas helps to share resources and minimize duplication of efforts from the clinical and staff champions. Partnering with UCSF Health system leaders at every phase of project development—from proposal selection, development, and final evaluation of results—enhances sustainable transition of successful projects into clinical operations.

The costs and coordination for the first cycle of Caring Wisely^® were supported by the UCSF Center for Healthcare Value. Upon completion of the evaluation of the first cycle, UCSF Health agreed to fund the program going forward, with the expectation that Caring Wisely would continue to achieve direct cost-savings for the organization. The Caring Wisely team provides a final report each year detailing the impact of each project on utilization and associated costs. Currently, program costs are approximately $150,000 for the Caring Wisely program leaders, staff, and other resources, and $50,000 for each of 3 projects for a total program cost of $300,000 per year. Projects included in the first three cycles have already saved more than $4 million, representing a strong return on investment. This program could be a model for other academic health centers to engage frontline clinicians and staff in addressing healthcare costs, and lends itself to being scaled-up into a multi-system collaborative.

 

LIST OF ABBREVIATIONS

UCSF—University of California, San Francisco; PRECEDE—Predisposing, Reinforcing, and Enabling Constructs in Educational Diagnosis and Evaluation; PROCEED—Policy, Regulatory and Organizational Constructs in Educational and Environmental Development

Acknowledgments

Other participants in blood transfusion reduction project (D. Johnson, K. Curcione); IV-to-PO Switch (C. Tsourounis, A. Pollock); Surgical Supply Cost Reduction (C. Zygourakis); Perioperative Efficiency (L. Hampson); CT for PE Risk Prediction (E. Weber); ERAS Pathways (L. Chen); Neonatal Sepsis Risk Prediction (T. Newman); Post-Operative Debrief (S. Imershein). Caring Wisely Executive Steering Committee (J. Adler, S. Antrum, A Auerbach, J. Bennan, M. Blum, C. Ritchie, C. Tsourounis). This Center for Healthcare Value is funded in part by a grant from the Grove Foundation. We appreciate additional review and comments to the manuscript provided by George Sawaya and Adams Dudley.

Disclosures 

Christopher Moriates has accepted royalties from McGraw-Hill for textbook, Understanding Value-Based Healthcare. Alvin Rajkomar has received fees as a research adviser from Google, Inc.

© 2017 Society of Hospital Medicine

Strategies are needed to empower frontline clinicians to work with organizational leadership to reduce healthcare costs and improve high-value care. Caring Wisely^® is a program developed by the University of California, San Francisco’s (UCSF) Center for Healthcare Value (CHV), aimed at engaging frontline clinicians and staff, connecting them with implementation experts, and supporting the development of targeted interventions to improve value. Financial savings from the program more than cover program costs. Caring Wisely^® provides an institutional model for implementing robust interventions to address areas of low-value care.

Launched in 2013, the annual Caring Wisely^® program consists of 3 stages for identifying projects that meet the following criteria:

• Potential to measurably reduce UCSF Health’s costs of care without transferring costs to patients, insurers, or other providers
• Plan for ensuring that health outcomes are maintained or improved
• Envision disseminating the intervention within and beyond UCSF
• Demonstrate commitment and engagement of clinical leadership and frontline staff.

The first stage is the Ideas Contest, a UCSF Health-wide call (to learn more about UCSF Health: https://www.ucsf.edu/sites/default/files/052516_About_UCSF.pdf) to identify areas that may be targeted to reduce unnecessary services, inefficiencies, and healthcare costs. We use a crowdsourcing platform—Open Proposals—to solicit the best ideas from frontline clinicians and staff.¹ Open Proposals is a secure, web-based platform for transparent and collaborative proposal development that displays threads of comments, responses, and revisions, and allows submissions to be “liked.” Open Proposals is managed by the UCSF Clinical and Translational Science Institute, funded by the National Center for Advancing Translational Sciences (Grant Number UL1 TR000004) at the National Institutes of Health. Using institutional e-mail lists for faculty, staff and residents, as well as described at monthly managers and directors meetings, the Ideas Contest is announced each year by the Chief Medical Officer and the CHV leadership. The Caring Wisely^® Executive Steering Committee, which consists of CHV and senior UCSF Health system leaders, selects the top 5-10 ideas based on the above criteria. Each winning idea receives a $100 gift certificate for a popular restaurant in San Francisco, and the list of winners is announced to the entire UCSF community.

The second stage is the Request for Proposals. The Caring Wisely^® program solicits proposals that outline implementation plans to target specific areas identified through the Ideas Contest. Finalists from the Ideas Contest are encouraged to submit proposals that address the problem they identified, but anyone affiliated with UCSF Health may submit a proposal on a winning idea. There is an approximately 4-week open submission period during which applicants submit brief 2-page proposals on the Open Proposal platform. This is followed by a period of optimization that leverages the social media aspect of the Open Proposals platform in which the UCSF Health community asks clarifying questions, make suggestions, and modifications can be made to the proposals. All submissions receive written feedback from at least one Steering Committee member. In addition, the Caring Wisely^® Director directly invites relevant UCSF colleagues, administrators, or program leaders to comment on proposals and make suggestions for improvement. Plans for assessing financial and health care delivery impacts are developed in collaboration with the UCSF Health Finance department. UCSF Health managers and leaders who are stakeholders in project proposal areas are consulted to provide input and finalize proposal plans, including the identification of existing personnel who can support and drive the project forward. Proposers use this feedback to revise their applications throughout this stage.

The third stage is Project Implementation. The Caring Wisely^® Executive Steering Committee selects up to 3 winners from the submitted proposals. Using the program criteria above, each project is scored independently, discussed in committee, and rescored to identify the top proposals. Each selected project receives a maximum budget of $50,000 that can be used for project materials, activities, and salary support for project leaders or staff. In addition to funding, each project team receives input from the implementation science team to co-develop and implement the intervention with a goal of creating a first-test-of-change within 3-6 months. A key feature of Caring Wisely^® is the partnership between project teams and the Caring Wisely^® implementation team, which includes a director, program manager, data analysts, and implementation scientists (Table 1).

The $150,000 administrative budget for the Caring Wisely^® program provides 20% support of the medical director, 50% support of a program manager/analyst, and 10% support of an implementation scientist. Approximately 5% support is donated from additional senior implementation scientists and various UCSF Health experts based on project needs. To make most efficient use of the Caring Wisely^® program staff time with the project teams, there is a weekly 60-90 minute works-in-progress session attended by all 3 teams with a rotating schedule for lead presenter during the first 6 months; these meetings occur every 2-3 weeks during the second 6 months. Caring Wisely^® program staff and the implementation scientist are also available for 1:1 meetings as needed. The Caring Wisely^® Executive Steering Committee is not paid and meets for 90 minutes quarterly. Custom reports and modifications of the electronic health record are provided by the UCSF Health clinical informatics department as part of their operating budget.

The collaboration between the project teams and the implementation science team is guided by the Consolidated Framework for Implementation Research (CFIR)² and PRECEDE-PROCEED model—a logic model and evaluation tool that is based on a composite of individual behavior change theory and social ecology.³ Table 2 illustrates how we weave PRECEDE-PROCEED and Plan-Do-Study-Act frameworks into project design and strategy. Each funded team is required to submit an end-of-year progress report.

Cost and cost savings estimates were based on administrative financial data obtained through the assistance of the Decision Support Services unit of the Finance Department of UCSF Health. All costs reflect direct institutional costs, rather than charges. For some projects, costs are directly available through computerized dashboards that provide year-to-year comparisons of specific costs of materials, supplies, and services (eg, blood transfusion reduction, surgical supplies project, OR efficiency program). This same dashboard also allows calculation of CMI-adjusted direct costs of hospital care by service line, as used in the perioperative pathways program evaluation. In other cases, the Decision Support Services and/or Caring Wisely^® program manager created custom cost reports based on the key performance indicator (eg, nebulizer therapy costs consist of medication costs plus respiratory therapist time; CT scan utilization for suspected pulmonary embolus in emergency department; and antimicrobial utilization for suspected neonatal sepsis).

Ongoing monitoring and sustainability of Caring Wisely^® projects is supported by the Caring Wisely^® program leaders. Monitoring of ongoing cost savings is based on automated service-line level dashboards related to cost, utilization, and quality outcomes with quarterly updates provided to the Caring Wisely^® Steering Committee. Depending on the project or program, appropriate UCSF Health senior leaders determine the level of support within their departments that is required to sustain the program(s). Ongoing monitoring of each program is also included in the strategic deployment visibility room with regular rounding by senior health system executives.

Since 2013, there have been 3 complete Caring Wisely^® cycles. The Ideas Contest generated more than 75 ideas in each of the past 3 cycles, ranging from eliminating redundant laboratory or radiological studies to reducing linen and food waste. We received between 13-20 full proposals in each of the request for proposal stages, and 9 projects have been implemented, 3 in each year. Funded projects have been led by a variety of individuals including physicians, nurses, pharmacists, administrators and residents, and topics have ranged from reducing overutilization of tests, supplies and treatments, to improving patient throughput during the perioperative period (Table 3). Estimated cumulative savings to date from Caring Wisely^® projects has exceeded $4 million, based on the four projects shown in Table 4. The IV-to-PO switch program and the neonatal sepsis risk prediction project (Table 3) have been successful in reducing unnecessary utilization, but cost and savings estimates are not yet finalized. Three funded projects were equivocal in cost savings but were successful in their primary aims: (1) increasing the appropriateness of CT scan ordering for suspected pulmonary embolus; (2) shortening operating room turnover times; and (3) implementing a postoperative debrief program for the systematic documentation of safety events, waste, and inefficiencies related to surgery.

We developed an innovative program that reduces hospital costs through crowdsourcing of ideas from frontline clinicians and staff, and by connecting these ideas to project and implementation science teams. At a time when healthcare costs have reached unsustainable levels, the Caring Wisely^® program provides a process for healthcare personnel to make a positive impact on healthcare costs in areas under their direct control. Through the Open Proposals platform, we have tapped a growing desire among frontline providers to reduce medical waste.

A key criterion for the Caring Wisely^® program is to propose changes that reduce cost without adversely affect healthcare quality or outcomes. While this is an important consideration in selecting projects, there is limited power to detect many of the most clinically relevant outcomes. We find this acceptable because many of the sponsored Caring Wisely^® project goals were to increase compliance with evidence-based practice guidelines and reduce harms associated with unnecessary treatments (eg, blood transfusion, nebulizer therapy, CT scan, antimicrobial therapy). Selected balancing metrics for each project are reported by established quality and safety programs at UCSF Health, but we acknowledge that many factors that can affect these clinical outcomes are not related to the cost-reduction intervention and are not possible to control outside of a clinical research study. Therefore, any response to changes in these outcome and balancing measures requires further analysis beyond the Caring Wisely^® project alone.

We believe one of the key factors in the success of the Caring Wisely^® program is the application of implementation science principles to the intervention design strategies (Table 1). These principles included stakeholder engagement, behavior change theory, market (target audience) segmentation, and process measurement and feedback. Because we are conducting this program in an academic health center, resident and fellow education and engagement are also critical to success. In each project, we utilize the PRECEDE model as a guide to ensure that each intervention design includes complementary elements of effective behavior change, intended to increase awareness and motivation to change, to make change “easy,” and to reinforce change(Table 2).³

The Caring Wisely^® program—itself a multifaceted intervention—embodies the same PRECEDE dimensions we apply to each specific project. The Ideas Contest serves as a tool for increasing awareness, attitudes, and motivation across the clinical enterprise for reducing healthcare costs. The support provided to the project teams by the Caring Wisely^® program is an enabling factor that makes it “easier” for frontline teams to design and implement interventions with a greater likelihood of achieving early success. Timely measurement and feedback of results to the hospital leadership and broadcasting to the larger community reinforces the support of the program at both the leadership and frontline levels.

Collaboration between project teams and the Caring Wisely^® program also provides frontline clinicians and staff with practical experience and lessons that they can apply to future improvement work. Project teams learn implementation science principles such as constructing a pragmatic theoretical framework to guide implementation design using CFIR model.² Incorporating multiple, rapid-cycle tests of change allows teams to modify and adapt final interventions as they learn how the target audience and environment responds to specific intervention components. Access to real-time, actionable data and a data analyst is essential to rapid cycle adaptation that allows teams to focus on specific units or providers. We also find that cross-fertilization between project teams working in different areas helps to share resources and minimize duplication of efforts from the clinical and staff champions. Partnering with UCSF Health system leaders at every phase of project development—from proposal selection, development, and final evaluation of results—enhances sustainable transition of successful projects into clinical operations.

The costs and coordination for the first cycle of Caring Wisely^® were supported by the UCSF Center for Healthcare Value. Upon completion of the evaluation of the first cycle, UCSF Health agreed to fund the program going forward, with the expectation that Caring Wisely would continue to achieve direct cost-savings for the organization. The Caring Wisely team provides a final report each year detailing the impact of each project on utilization and associated costs. Currently, program costs are approximately $150,000 for the Caring Wisely program leaders, staff, and other resources, and $50,000 for each of 3 projects for a total program cost of $300,000 per year. Projects included in the first three cycles have already saved more than $4 million, representing a strong return on investment. This program could be a model for other academic health centers to engage frontline clinicians and staff in addressing healthcare costs, and lends itself to being scaled-up into a multi-system collaborative.

 

LIST OF ABBREVIATIONS

UCSF—University of California, San Francisco; PRECEDE—Predisposing, Reinforcing, and Enabling Constructs in Educational Diagnosis and Evaluation; PROCEED—Policy, Regulatory and Organizational Constructs in Educational and Environmental Development

Acknowledgments

Other participants in blood transfusion reduction project (D. Johnson, K. Curcione); IV-to-PO Switch (C. Tsourounis, A. Pollock); Surgical Supply Cost Reduction (C. Zygourakis); Perioperative Efficiency (L. Hampson); CT for PE Risk Prediction (E. Weber); ERAS Pathways (L. Chen); Neonatal Sepsis Risk Prediction (T. Newman); Post-Operative Debrief (S. Imershein). Caring Wisely Executive Steering Committee (J. Adler, S. Antrum, A Auerbach, J. Bennan, M. Blum, C. Ritchie, C. Tsourounis). This Center for Healthcare Value is funded in part by a grant from the Grove Foundation. We appreciate additional review and comments to the manuscript provided by George Sawaya and Adams Dudley.

Disclosures 

Christopher Moriates has accepted royalties from McGraw-Hill for textbook, Understanding Value-Based Healthcare. Alvin Rajkomar has received fees as a research adviser from Google, Inc.