User login
Assessing Vascular Nursing Experience
Peripherally inserted central catheters (PICCs) are among the most prevalent of venous access devices in hospitalized patients.[1, 2] Although growing use of these devices reflects clinical advantages, such as a reduced risk of complications during insertion and durable venous access, use of PICCs is also likely related to the growth of vascular access nursing.[3, 4] A relatively new specialty, vascular access nurses obtain, maintain, and manage venous access in hospitalized patients.[4, 5] Depending on their scope of practice, these professionals are responsible not only for insertion of devices, such as peripheral intravenous catheters and PICCs, but also nontunneled central venous catheters and arterial catheters in some settings.[6]
Although a growing number of US hospitals have introduced vascular nursing teams,[7] little is known about the experience, practice, knowledge, and beliefs of vascular access nurses. This knowledge gap is relevant for hospitalists and hospital medicine as (1) vascular access nurses increasingly represent a key partner in the care of hospitalized patients; (2) the knowledge and practice of these individuals directly affects patient safety and clinical outcomes; and (3) understanding experience, practice, and beliefs of these specialists can help inform decision making and quality‐improvement efforts related to PICCs. As hospitalists increasingly order the placement of and care for patients with PICCs, they are also well suited to improve PICC practice.
Therefore, we conducted a survey of vascular access nurses employed by hospitals that participate in the Michigan Hospital Medicine Safety (HMS) Consortium, a Blue Cross Blue Shield of Michiganfunded collaborative quality initiative.[6] We aimed to understand experience, practice, knowledge, and beliefs related to PICC care and use.
METHODS
Study Setting and Participants
To quantify vascular nursing experience, practice, knowledge, and beliefs, we conducted a Web‐based survey of vascular nurses across 47 Michigan hospitals that participate in HMS. A statewide quality‐improvement initiative, HMS aims to prevent adverse events in hospitalized medical patients through the creation of a data registry and sharing of best practices. The setting and design of this multicenter initiative have been previously described.[8, 9] Although participation is voluntary, each hospital receives payment for participating in the consortium and for data collection. Because HMS has an ongoing initiative aimed at identifying and preventing PICC‐related complications, this study was particularly relevant for participating hospitals and nurses.
Each HMS site has a designated quality‐improvement lead, physician champion, and data abstractor. To coordinate distribution and dissemination of the survey, we contacted the quality‐improvement leads at each site and enquired whether their hospital employed vascular access nurses who placed PICCs. Because we were only interested in responses from vascular access nurses, HMS hospitals that did not have these providers or stated PICCs were placed by other specialists (eg, interventional radiology) were excluded. At eligible sites, we obtained the total number of vascular nurses employed so as to determine the number of eligible respondents. In this manner, a purposeful sample of vascular nurses at participating HMS hospitals was constituted.
Participation in the survey was solicited through hospital quality leads that either distributed an electronic survey link to vascular nurses at their facilities or sent us individual email addresses to contact them directly. A cover letter explaining the rationale and the purpose of the survey along with the survey link was then sent to respondents through either of these routes. The survey was administered at all HMS sites contemporaneously and kept open for a period of 5 weeks. During the 5‐week period, 2 e‐mail reminders were sent to encourage participation. As a token of appreciation, a $10 Amazon gift card was offered to those who took the survey.
Development and Validation of the Survey
We developed the survey instrument (which we call PICC1 as we hope to administer longitudinally to track changes over time) by first conducting a literature search to identify relevant evidence‐based guidelines and studies regarding vascular access nursing practices and experiences.[10, 11, 12, 13] In addition, we consulted and involved national and international leaders in vascular access nursing to ensure validity and representativeness of the questions posed. We were specifically interested in nursing background, hospital practices, types of PICCs used, use of various technologies, relationships with healthcare providers, and management of complications. To understand participant characteristics and quantify potential variation in responses, we collected basic participant data including demographics, years in practice, number of PICCs placed, leadership roles, and vascular access certification status. Based on clinical reasoning and existing studies,[14, 15] we hypothesized that responses regarding certain practices (ultrasound use, electrocardiography [ECG] guidance system use), management of complications, or perceptions regarding leadership might vary based on years of experience, number of PICCs placed, or certification status. We therefore examined these associations as prespecified subgroup analyses.
The initial survey instrument was pilot tested with vascular nurses outside of the sampling frame. Based on feedback from the pilot testers, the instrument was refined and edited to improve clarity of the questions. In addition, specific skip patterns and logic were programmed into the final survey to reduce respondent burden and allow participants to seamlessly bypass questions that were contingent on a prior response (eg, use of ECG to place PICCs would lead to a series of questions about ECG‐assisted placement only for those respondents who used the technology). This final version of the survey was tested by members of the study team (V.C., L.K., S.L.K.) and then posted to SurveyMonkey for dissemination.
Statistical Analysis
Descriptive statistics (percentage, n/N) were used to tabulate results. In accordance with our a priori hypothesis that variation to responses might be associated with respondent characteristics, responses to questions regarding insertion practice (eg, use of ultrasound, measurement of catheter:vein ratio, trimming of catheters) and approach to complications (eg, catheter occlusion, deep vein thrombosis [DVT] notification, and PICC removal in the setting of fever) were compared by respondent years in practice (dichotomized to <5 vs >5 years), volume of PICCs placed (<999 vs 1000), and certification status (yes/no). Bivariate comparisons were made using 2 or Fisher exact tests based on the number of responses in a cell as appropriate; 2‐sided with a P value <0.05 was considered statistically significant. All statistical analyses were conducted using SAS version 9.3 (SAS Institute, Cary, NC).
Ethical and Regulatory Oversight
Because our study sought to describe existing practice without collecting any individual or facility level identifiable information, the project received a Not Regulated status by the University of Michigan Medical School Institutional Review Board (HUM00088351).
RESULTS
Of 172 vascular nurses who received invitations, 140 completed the survey for a response rate of 81%. Respondents reported working in not‐for‐profit hospitals (36%), academic medical centers (29%), and for‐profit hospitals (21%). Although multiple providers (eg, interventional radiology staff and providers, physicians) placed PICCs, 95% of those surveyed reported that they placed the majority of the PICCs at their institutions. Although most respondents placed PICCs in adult patients (86%), a few also placed PICCs in pediatric populations (17%). Vascular nursing programs were largely housed in their own department, but some reported to general nursing or subspecialties such as interventional radiology, cardiology, and critical care. Most respondents indicated their facilities had written policies regarding standard insertion and care practices (87% and 95%, respectively), but only 30% had policies regarding the necessity or appropriateness of PICCs.
Experience among respondents was variable: approximately a third had placed PICCs for <5 years (28.6%), whereas 58% reported placing PICCs for 5 years Correspondingly, 26% reported having placed 100 to 500 PICCs, whereas 34% had placed 1000 or more PICCs. Only 23% of those surveyed held a dedicated vascular access certification, such as board certified in vascular access or certified registered nurse infusion, whereas 16% indicated that they served as the vascular access lead nurse for their facility. Following placement, 94% of respondents reported that their facilities tracked the number of PICCs inserted, but only 40% indicated that dwell times of devices were also recorded. Only 30% of nurses reported that their hospitals had a written policy to evaluate PICC necessity or appropriateness following placement (Table 1).
No.* | % | |
---|---|---|
| ||
Participant characteristics | ||
For how many years have you been inserting PICCs? | ||
<5 years | 40 | 28.6% |
5 years | 81 | 57.9% |
Missing | ||
In which of the following populations do you insert PICCs? | ||
Adult patients | 121 | 86.4% |
Pediatric patients | 24 | 17.1% |
Neonatal patients | 1 | 0.7% |
In which of the following locations do you place PICCs? (Select all that apply.) | ||
Adult medical ward | 115 | 82.1% |
General adult surgical ward | 110 | 78.6% |
General pediatric medical ward | 34 | 24.3% |
General pediatric surgical ward | 24 | 17.1% |
Adult intensive care unit | 114 | 81.4% |
Pediatric intensive care unit | 19 | 13.6% |
Neonatal intensive care unit | 3 | 2.1% |
Other intensive care unit | 59 | 42.1% |
Outpatient clinic or emergency department | 17 | 12.1% |
Other | 10 | 7.1% |
Approximately how many PICCs may you have placed in your career? | ||
099 | 15 | 10.7% |
100499 | 36 | 25.7% |
500999 | 23 | 16.4% |
1,000 | 47 | 33.6% |
Are you the vascular access lead nurse for your facility or organization? | ||
Yes | 22 | 15.7% |
No | 98 | 70.0% |
Do you currently hold a dedicated vascular access certification (BC‐VA, CRNI, etc.)? | ||
Yes | 32 | 22.9% |
No | 89 | 63.6% |
Facility characteristics | ||
Which of the following best describes your primary work location? | ||
Academic medical center | 41 | 29.3% |
For‐profit community‐based hospital or medical center | 30 | 21.4% |
Not‐for‐profit community‐based hospital or medical center | 50 | 35.7% |
Who inserts the most PICCs in your facility? | ||
Vascular access nurses | 133 | 95.0% |
Interventional radiology or other providers | 7 | 5.0% |
In which department is vascular access nursing located? | ||
Vascular nursing | 76 | 54.3% |
General nursing | 38 | 27.1% |
Interventional radiology | 15 | 10.7% |
Other | 11 | 7.9% |
Using your best guess, how many PICCs do you think your facility inserts each month? | ||
<25 | 5 | 3.6% |
2549 | 13 | 9.3% |
50100 | 39 | 27.9% |
>100 | 78 | 55.7% |
Unknown | 2 | 1.4% |
How many vascular access nurses are employed by your facility? | ||
<4 | 14 | 10.0% |
46 | 33 | 23.6% |
79 | 15 | 10.7% |
1015 | 25 | 17.9% |
>15 | 53 | 37.9% |
Does your facility track the number of PICCs placed? | ||
Yes | 132 | 94.3% |
No | 5 | 3.6% |
Unknown | 3 | 2.1% |
Does your facility track the duration or dwell time of PICCs? | ||
Yes | 56 | 40.0% |
No | 60 | 42.9% |
Unknown | 24 | 17.1% |
Does your facility have a written policy regarding standard PICC insertion practices? | ||
Yes | 122 | 87.1% |
No | 8 | 5.7% |
Unknown | 7 | 5.0% |
Does your facility have a written policy regarding standard PICC care and maintenance? | ||
Yes | 133 | 95.0% |
No | 3 | 2.1% |
Unknown | 1 | 0.7% |
Does your facility have a written process to review the necessity or appropriateness of a PICC? | ||
Yes | 42 | 30.0% |
No | 63 | 45.0% |
Unknown | 20 | 14.3% |
The most commonly reported indications for PICC placement included intravenous antibiotics at discharge, difficult venous access, and placement for chemotherapy in patients with cancer. Forty‐six percent of nurses indicated they had placed a PICC in a patient receiving some form of dialysis in the past several months; however, 91% of these respondents reported receiving approval from nephrology prior to placement in these patients. Although almost all nurses (91%) used ultrasound to find a suitable vein for PICC placement, a smaller percentage used ultrasound to estimate the catheter‐to‐vein ratio to prevent thrombosis (79%), and only a few (14%) documented this figure in the medical record. Three‐quarters of those surveyed (76%) indicated they used ECG‐based systems to position PICC tips at the cavoatrial junction to prevent thrombosis. Of those who used this technology, 36% still obtained chest x‐rays to verify the position of the PICC tip. According to 84% of respondents, flushing of PICCs was performed mainly by bedside nurses, whereas scheduled weekly dressing changes were most often performed by vascular access nurses (Table 2).
Question | No. | % |
---|---|---|
| ||
Do you use ultrasound to find a suitable vein prior to PICC insertion? | ||
Yes | 128 | 91.4% |
No | 0 | 0.0% |
Do you use ultrasound to estimate the catheter‐to‐vein ratio prior to PICC insertion? | ||
Yes | 110 | 78.6% |
No | 18 | 12.9% |
When using ultrasound, do you document the catheter‐to‐vein ratio in the PICC insertion note? | ||
Yes | 20 | 14.3% |
No | 89 | 63.6% |
Do you use ECG guidance‐assisted systems to place PICCs? | ||
Yes | 106 | 75.7% |
No | 21 | 15.0% |
If using ECG guidance, do you still routinely obtain a chest x‐ray to verify PICC tip position after placing the PICC using ECG guidance? | ||
Yes | 38 | 27.1% |
No | 68 | 48.6% |
Who is primarily responsible for administering and adhering to a flushing protocol after PICC insertion at your facility? | ||
Bedside nurses | 118 | 83.6% |
Patients | 1 | 0.7% |
Vascular access nurses | 8 | 5.7% |
Which of the following agents are most often used to flush PICCs? | ||
Both heparin and normal saline flushes | 61 | 43.6% |
Normal saline only | 63 | 45.0% |
Heparin only | 3 | 2.1% |
Who is responsible for scheduled weekly dressing changes for PICCs? | ||
Vascular access nurses | 110 | 78.6% |
Bedside nurses | 14 | 10.0% |
Other (eg, IR staff, ICU staff) | 3 | 2.1% |
In the past few months, have you placed a PICC in a patient who was receiving a form of dialysis (eg, peritoneal or hemodialysis)? | ||
Yes | 65 | 46.4% |
No | 64 | 45.7% |
If you have placed PICCs in patients on dialysis, do you discuss PICC placement or receive approval from nephrology prior to inserting the PICC? | ||
Yes | 59 | 90.8% |
No | 6 | 9.2% |
With respect to complications, catheter occlusion, migration, and DVT were reported as the 3 most prevalent adverse events. Interestingly, respondents did not report central lineassociated bloodstream infection (CLABSI) as a common complication. Additionally, 51% of those surveyed indicated that physicians unnecessarily removed PICCs when CLABSI was suspected but not confirmed. When managing catheter occlusion, 50% of respondents began with normal saline flushes but used tissue‐plasminogen activator if saline failed to resolve occlusion. Management of catheter migration varied based on degree of device movement: when the PICC had migrated <5 cm, most respondents (77%) indicated they would first obtain a chest x‐ray to determine the position of the PICC tip, with few (4%) performing catheter exchange. However, if the PICC had migrated more than 5 cm, a significantly greater proportion of respondents (21%) indicated they would perform a catheter exchange. With regard to managing DVT, most vascular nurses reported they notified nurses and physicians to continue using the PICC but recommended tests to confirm the diagnosis.
To better understand the experiences of vascular nurses, we asked for their perceptions regarding appropriateness of PICC use and relationships with bedside nurses, physicians, and leadership. Over a third of respondents (36%) felt that <5% of all PICCs may be inappropriate in their facility, whereas 1 in 5 indicated that 10% to 24% of PICCs placed in their facilities may be inappropriate or could have been avoided. Almost all (98%) of the nurses stated they were not empowered to remove idle or clinically unnecessary PICCs without physician authorization. Although 51% of nurses described the support received from hospital leadership as excellent, very good, or good, 43% described leadership support as either fair or poor. Conversely, relationships with bedside nurses and physicians were rated as being very good or good by nearly two‐thirds of those surveyed (64% and 65%, respectively) (Table 3).
Question | No. | % |
---|---|---|
| ||
Which of the following PICC‐related complications have you most frequently encountered in your practice? | ||
Catheter occlusion | 81 | 57.9% |
Catheter migration | 27 | 19.3% |
PICC‐associated DVT | 6 | 4.3% |
Catheter fracture or embolization | 3 | 2.1% |
Exit site infection | 3 | 2.1% |
Coiling or kinking after insertion | 2 | 1.4% |
If you suspect a patient has catheter occlusion, which of the following best describes your approach to resolving this problem? | ||
Begin with normal saline but use a tPA product if this fails to restore patency | 70 | 50.0% |
Use a tPA product (eg, Cathflo, Activase, or Retavase) to restore patency | 44 | 31.4% |
Begin with heparin‐based flushes but use a tPA product if this fails to restore | 7 | 5.0% |
Use only normal saline flushes to restore patency | 3 | 2.1% |
If you find a PICC that has migrated out or has been accidentally dislodged <5 cm in a patient without symptoms, and the device is still clinically needed, which of the following best describes your practice? | ||
Obtain a chest x‐ray to verify tip position | 108 | 77.1% |
Perform a complete catheter exchange over a guidewire if possible | 5 | 3.6% |
Notify/discuss next steps with physician | 5 | 3.6% |
Other | 6 | 4.3% |
If you find a PICC that has migrated out or has been accidentally dislodged >5 cm in a patient without symptoms, and the device is still clinically needed, which of the following best describes your practice? | ||
Obtain a chest x‐ray to verify tip position | 72 | 51.4% |
Perform a catheter exchange over a guidewire if possible | 30 | 21.4% |
Notify/discuss next steps with physician | 10 | 7.1% |
Other | 12 | 8.6% |
Which of the following best describes your first approach when you suspect a patient has PICC‐associated phlebitis? | ||
Discuss best course of action with physician or nurse | 79 | 56.4% |
Supportive measures (eg, warm compresses, analgesics, monitoring) | 25 | 17.9% |
Remove the PICC | 15 | 10.7% |
Other | 5 | 3.6% |
Which of the following best describes your first approach when you suspect a patient has a PICC‐related DVT? | ||
Notify caregivers to continue using PICC and consider tests such as ultrasound | 82 | 58.6% |
Notify bedside nurse and physician not to continue use of the PICC and consider tests such as ultrasound | 42 | 30.0% |
PICCs are often removed when physicians suspect, but have not yet confirmed, CLABSI. Considering your experiences, what percentage of PICCs may have been removed in this manner at your facility? | ||
<5% | 11 | 7.9% |
59% | 16 | 11.4% |
1024% | 24 | 17.1% |
25% | 71 | 50.7% |
Based on your experience, what percentage of PICCs do you think are inappropriate or could have been avoided at your facility? | ||
<5% | 51 | 36.4% |
59% | 25 | 17.9% |
1024% | 28 | 20.0% |
2550% | 13 | 9.3% |
>50% | 5 | 3.6% |
Are vascular access nurses empowered to remove PICCs that are idle or clinically unnecessary without physician authorization? | ||
Yes | 3 | 2.1% |
No | 122 | 87.1% |
How would you rank the overall support your vascular access service receives from hospital leadership? | ||
Excellent | 5 | 3.6% |
Very good | 32 | 22.9% |
Good | 40 | 28.6% |
Fair | 35 | 25.0% |
Poor | 25 | 17.9% |
How would you describe your relationship with physicians at your facility when it comes to communicating recommendations or management of PICCs? | ||
Very good | 28 | 20.0% |
Good | 63 | 45.0% |
Fair | 35 | 25.0% |
Poor | 7 | 5.0% |
Very poor | 4 | 2.9% |
How would you describe your relationship with bedside nurses at your facility when it comes to communicating recommendations or management of PICCs? | ||
Very good | 32 | 22.9% |
Good | 58 | 41.4% |
Fair | 38 | 27.1% |
Poor | 7 | 5.0% |
Very poor | 2 | 1.4% |
Variation in Responses Based on Years in Practice or Certification
We initially hypothesized that responses regarding practice (ultrasound use, ECG guidance system use), management of complications, or perceptions regarding leadership might vary based on years of experience, number of PICCs placed, or certification status. However, no statistically significant associations with these factors and individual responses were identified.
DISCUSSION
In this survey of 140 vascular access nurses in hospitals across Michigan, new insights regarding the experience, practice, knowledge, and beliefs of this group of providers were obtained. We found that vascular access nurses varied with respect to years in practice, volume of PICCs placed, and certification status, reflecting heterogeneity in this provider group. Variation in insertion techniques, such as use of ultrasound to examine catheter‐to‐vein ratio (a key way to prevent thrombosis) or newer ECG technology to position the PICC, was also noted. Although indications for PICC insertion appeared consistent with published literature, the frequency with which these devices were placed in patients receiving dialysis (reportedly with nephrology approval) was surprising given national calls to avoid such use.[16] Opportunities to improve hospital practices, such as tracking PICC dwell times and PICC necessity, as well as the potential need to better educate physicians on when to remove PICCs for suspected CLABSI, were also identified. Collectively, these data are highly relevant to hospitalists and health systems as they help to identify areas for quality improvement and inform clinical practice regarding the use of PICCs in hospitalized patients. As hospitalists increasingly order PICCs and manage complications associated with these devices, they are well suited to use these data so as to improve patient safety and clinical outcomes.
Venous access is the most common medical procedure performed in hospitalized medical patients. Although a number of devices including peripheral intravenous catheters, central venous catheters, and PICCs are used for this purpose, the growing use of PICCs to secure venous access has been documented in several studies.[17] Such growth, in part, undoubtedly reflects increasing availability of vascular access nurses. Traditionally placed by interventional radiologists, the creation of dedicated vascular nursing teams has resulted in these subspecialists now serving in more of a backup or trouble‐shooting role rather than that of primary operator.[4, 14] This paradigm shift is well illustrated in a recent survey of infection preventionists, where over 60% of respondents reported that they had a vascular nursing team in their facility.[7] The growth of these nursing‐led vascular access teams has produced not only high rates of insertion success and low rates of complications, but also greater cost‐effectiveness when compared to interventional radiologybased insertion.[18]
Nonetheless, our survey also identified a number of important concerns regarding PICC practices and vascular nursing providers. First, we found variation in areas such as insertion practices and management of complications. Such variability highlights the importance of both growing and disseminating the evidence base for consistent practice in vascular nursing. Through their close clinical affiliation with vascular nurses and shared interests in obtaining safe and appropriate venous access for patients, hospitalists are ideally poised to lead this effort. Second, similarities between vascular nurse opinions regarding appropriateness of PICCs and those of hospitalists from a prior survey were noted.[19] Namely, a substantial proportion of both vascular nurses and hospitalists felt that some PICCs were inappropriate and could be avoided. Third, although relationships between vascular access nurses and leadership were reported as being variable, the survey responses suggested relatively good interprovider relationships with bedside nurses and physicians. Such relationships likely reflect the close clinical ties that emerge from being in the trenches of patient care and suggest that interventions to improve care in partnership with these providers are highly viable.
Our study has some limitations. First, despite a high response rate, our study used a survey design and reports findings from a convenience sample of vascular access nurses in a single state. Thus, nonrespondent and selection biases remain threats to our conclusions. Additionally, some respondents did not complete all responses, perhaps due to nonapplicability to practice or other unknown reasons. The pattern of missingness observed, however, suggested that such responses were missing at random. Second, we surveyed vascular nurses in hospitals that are actively engaged in improving PICC practices; our findings may therefore not be representative of vascular nursing professionals as a whole and may instead reflect those of a highly motivated group of individuals. Relatedly, the underlying reasons for adoption of specific practices or techniques cannot be discerned from our study. Third, although we did not find differences based on years in practice or certification status, our sample size was relatively small and likely underpowered for these comparisons. Finally, our study sample consists of vascular nurses who are clustered within hospitals in which they are employed. Therefore, overlap between reported practices and those required by the facility are possible.
Despite these limitations, our study has important strengths. First, this is among the most comprehensive of surveys examining vascular nursing experience, practice, knowledge, and beliefs. The growing presence of these providers across US hospitals, coupled with limited insight regarding their clinical practices, highlight the importance and utility of these data. Second, we noted important differences in experience, practices, and interprovider relationships between vascular providers in this field. Although we are unable to ascertain the drivers or significance of such variation, hospitals and health systems focused on improving patient safety should consider quantifying and exploring these factors. Third, findings from our survey within Michigan suggest the need for similar, larger studies across the country. Partnerships with nursing organizations or larger professional groups that represent vascular nursing specialists may be helpful in this regard.
In conclusion, we found important similarities and differences in vascular nursing experience, practice, knowledge, and beliefs in Michigan. These data are useful as they help provide context regarding the constitution of these teams, current practices, and opportunities for improving care. Hospitalists seeking to improve patient safety may use these data to better inform vascular access practice in hospitalized patients.
Acknowledgements
The authors thank Claire Rickard, PhD, RN, Britt Meyer, RN, Peter Carr, PhD, and David Dempsey, RN for their assistance in developing the survey instrument used in this study.
Disclosures: This project was funded through an Investigator Initiated Research Grant from the Blue Cross Blue Shield of Michigan (BCBSM) Foundation (grant number 2140.II). The funding source played no role in study design, data acquisition, analysis, or reporting of the data. Support for the Hospital Medicine Safety (HMS) Consortium is provided by BCBSM and the Blue Care Network as part of the BCBSM Value Partnerships program. Although BCBSM and HMS work collaboratively, the opinions, beliefs, and viewpoints expressed by the authors do not necessarily reflect the opinions, beliefs, and viewpoints of BCBSM or any of its employees. This work was also supported with resources from the Veterans Affairs Ann Arbor Healthcare System. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government.
- Peripherally inserted central venous catheters in the acute care setting: a safe alternative to high‐risk short‐term central venous catheters. Am J Infect Control. 2010;38(2):149–153. , , , et al.
- Risk of venous thromboembolism in hospitalized patients with peripherally inserted central catheters. J Hosp Med. 2009;4(7):417–422. , , , , .
- Central venous catheter placement by advanced practice nurses demonstrates low procedural complication and infection rates‐‐a report from 13 years of service. Crit Care Med. 2014;42(3):536–543. , , , , , .
- Developing an alternative workflow model for peripherally inserted central catheter placement. J Infus Nurs. 2012;34(1):34–42. .
- Facility wide benefits of radiology vascular access teams. Radiol Manage. 2010;32(1):28–32; quiz 33–34. , .
- Moving the needle forward: the imperative for collaboration in vascular access. J Infus Nurs. 2015;38(2):100–102. , .
- Use of designated PICC teams by U.S. hospitals: a survey‐based study [published online November 10, 2015]. J Patient Saf. doi: 10.1097/PTS.0000000000000246 , , , .
- The association between PICC use and venous thromboembolism in upper and lower extremities. American J Med. 2015;128(9):986–993.e1. , , , , .
- Hospital performance for pharmacologic venous thromboembolism prophylaxis and rate of venous thromboembolism: a cohort study. JAMA Intern Med. 2014;174(10):1577–1584. , , , et al.
- Risk of venous thromboembolism associated with peripherally inserted central catheters: a systematic review and meta‐analysis. Lancet. 2013;382(9889):311–325. , , , et al.
- Infusion Nurses Society. Infusion nursing standards of practice. J Infus Nurs. 2006;29(1 suppl):S1–S92.
- Guidelines for the prevention of intravascular catheter‐related infections. Am J Infect Control. 2011;39(4 suppl 1):S1–S34. , , , et al.
- International evidence‐based recommendations on ultrasound‐guided vascular access. Intensive Care Med. 2012;38(7):1105–1117. , , , et al.
- A single institution experience of seven hundred consecutively placed peripherally inserted central venous catheters. J Vasc Access. 2014;15(6):498–502. , , .
- Central venous access devices site care practices: an international survey of 34 countries [published online September 3, 2015]. J Vasc Access. doi: 10.5301/jva.5000450 , , .
- American Society of Nephrology. World's Leading Kidney Society Joins Effort to Reduce Unnecessary Medical Tests and Procedures. Available at: https://www.asn‐online.org/policy/choosingwisely/PressReleaseChoosingWisely.pdf. Accessed September 4, 2015.
- A survey of the current use of peripherally inserted central venous catheter (PICC) in Swedish oncology departments. Acta Oncol. 2013;52(6):1241–1242. , , , .
- Nurse‐led PICC insertion: is it cost effective? Br J Nurs. 2013;22(19):S9–S15. , .
- Hospitalist experiences, practice, opinions, and knowledge regarding peripherally inserted central catheters: a Michigan survey. J Hosp Med. 2013;8(6):309–314. , , , et al.
Peripherally inserted central catheters (PICCs) are among the most prevalent of venous access devices in hospitalized patients.[1, 2] Although growing use of these devices reflects clinical advantages, such as a reduced risk of complications during insertion and durable venous access, use of PICCs is also likely related to the growth of vascular access nursing.[3, 4] A relatively new specialty, vascular access nurses obtain, maintain, and manage venous access in hospitalized patients.[4, 5] Depending on their scope of practice, these professionals are responsible not only for insertion of devices, such as peripheral intravenous catheters and PICCs, but also nontunneled central venous catheters and arterial catheters in some settings.[6]
Although a growing number of US hospitals have introduced vascular nursing teams,[7] little is known about the experience, practice, knowledge, and beliefs of vascular access nurses. This knowledge gap is relevant for hospitalists and hospital medicine as (1) vascular access nurses increasingly represent a key partner in the care of hospitalized patients; (2) the knowledge and practice of these individuals directly affects patient safety and clinical outcomes; and (3) understanding experience, practice, and beliefs of these specialists can help inform decision making and quality‐improvement efforts related to PICCs. As hospitalists increasingly order the placement of and care for patients with PICCs, they are also well suited to improve PICC practice.
Therefore, we conducted a survey of vascular access nurses employed by hospitals that participate in the Michigan Hospital Medicine Safety (HMS) Consortium, a Blue Cross Blue Shield of Michiganfunded collaborative quality initiative.[6] We aimed to understand experience, practice, knowledge, and beliefs related to PICC care and use.
METHODS
Study Setting and Participants
To quantify vascular nursing experience, practice, knowledge, and beliefs, we conducted a Web‐based survey of vascular nurses across 47 Michigan hospitals that participate in HMS. A statewide quality‐improvement initiative, HMS aims to prevent adverse events in hospitalized medical patients through the creation of a data registry and sharing of best practices. The setting and design of this multicenter initiative have been previously described.[8, 9] Although participation is voluntary, each hospital receives payment for participating in the consortium and for data collection. Because HMS has an ongoing initiative aimed at identifying and preventing PICC‐related complications, this study was particularly relevant for participating hospitals and nurses.
Each HMS site has a designated quality‐improvement lead, physician champion, and data abstractor. To coordinate distribution and dissemination of the survey, we contacted the quality‐improvement leads at each site and enquired whether their hospital employed vascular access nurses who placed PICCs. Because we were only interested in responses from vascular access nurses, HMS hospitals that did not have these providers or stated PICCs were placed by other specialists (eg, interventional radiology) were excluded. At eligible sites, we obtained the total number of vascular nurses employed so as to determine the number of eligible respondents. In this manner, a purposeful sample of vascular nurses at participating HMS hospitals was constituted.
Participation in the survey was solicited through hospital quality leads that either distributed an electronic survey link to vascular nurses at their facilities or sent us individual email addresses to contact them directly. A cover letter explaining the rationale and the purpose of the survey along with the survey link was then sent to respondents through either of these routes. The survey was administered at all HMS sites contemporaneously and kept open for a period of 5 weeks. During the 5‐week period, 2 e‐mail reminders were sent to encourage participation. As a token of appreciation, a $10 Amazon gift card was offered to those who took the survey.
Development and Validation of the Survey
We developed the survey instrument (which we call PICC1 as we hope to administer longitudinally to track changes over time) by first conducting a literature search to identify relevant evidence‐based guidelines and studies regarding vascular access nursing practices and experiences.[10, 11, 12, 13] In addition, we consulted and involved national and international leaders in vascular access nursing to ensure validity and representativeness of the questions posed. We were specifically interested in nursing background, hospital practices, types of PICCs used, use of various technologies, relationships with healthcare providers, and management of complications. To understand participant characteristics and quantify potential variation in responses, we collected basic participant data including demographics, years in practice, number of PICCs placed, leadership roles, and vascular access certification status. Based on clinical reasoning and existing studies,[14, 15] we hypothesized that responses regarding certain practices (ultrasound use, electrocardiography [ECG] guidance system use), management of complications, or perceptions regarding leadership might vary based on years of experience, number of PICCs placed, or certification status. We therefore examined these associations as prespecified subgroup analyses.
The initial survey instrument was pilot tested with vascular nurses outside of the sampling frame. Based on feedback from the pilot testers, the instrument was refined and edited to improve clarity of the questions. In addition, specific skip patterns and logic were programmed into the final survey to reduce respondent burden and allow participants to seamlessly bypass questions that were contingent on a prior response (eg, use of ECG to place PICCs would lead to a series of questions about ECG‐assisted placement only for those respondents who used the technology). This final version of the survey was tested by members of the study team (V.C., L.K., S.L.K.) and then posted to SurveyMonkey for dissemination.
Statistical Analysis
Descriptive statistics (percentage, n/N) were used to tabulate results. In accordance with our a priori hypothesis that variation to responses might be associated with respondent characteristics, responses to questions regarding insertion practice (eg, use of ultrasound, measurement of catheter:vein ratio, trimming of catheters) and approach to complications (eg, catheter occlusion, deep vein thrombosis [DVT] notification, and PICC removal in the setting of fever) were compared by respondent years in practice (dichotomized to <5 vs >5 years), volume of PICCs placed (<999 vs 1000), and certification status (yes/no). Bivariate comparisons were made using 2 or Fisher exact tests based on the number of responses in a cell as appropriate; 2‐sided with a P value <0.05 was considered statistically significant. All statistical analyses were conducted using SAS version 9.3 (SAS Institute, Cary, NC).
Ethical and Regulatory Oversight
Because our study sought to describe existing practice without collecting any individual or facility level identifiable information, the project received a Not Regulated status by the University of Michigan Medical School Institutional Review Board (HUM00088351).
RESULTS
Of 172 vascular nurses who received invitations, 140 completed the survey for a response rate of 81%. Respondents reported working in not‐for‐profit hospitals (36%), academic medical centers (29%), and for‐profit hospitals (21%). Although multiple providers (eg, interventional radiology staff and providers, physicians) placed PICCs, 95% of those surveyed reported that they placed the majority of the PICCs at their institutions. Although most respondents placed PICCs in adult patients (86%), a few also placed PICCs in pediatric populations (17%). Vascular nursing programs were largely housed in their own department, but some reported to general nursing or subspecialties such as interventional radiology, cardiology, and critical care. Most respondents indicated their facilities had written policies regarding standard insertion and care practices (87% and 95%, respectively), but only 30% had policies regarding the necessity or appropriateness of PICCs.
Experience among respondents was variable: approximately a third had placed PICCs for <5 years (28.6%), whereas 58% reported placing PICCs for 5 years Correspondingly, 26% reported having placed 100 to 500 PICCs, whereas 34% had placed 1000 or more PICCs. Only 23% of those surveyed held a dedicated vascular access certification, such as board certified in vascular access or certified registered nurse infusion, whereas 16% indicated that they served as the vascular access lead nurse for their facility. Following placement, 94% of respondents reported that their facilities tracked the number of PICCs inserted, but only 40% indicated that dwell times of devices were also recorded. Only 30% of nurses reported that their hospitals had a written policy to evaluate PICC necessity or appropriateness following placement (Table 1).
No.* | % | |
---|---|---|
| ||
Participant characteristics | ||
For how many years have you been inserting PICCs? | ||
<5 years | 40 | 28.6% |
5 years | 81 | 57.9% |
Missing | ||
In which of the following populations do you insert PICCs? | ||
Adult patients | 121 | 86.4% |
Pediatric patients | 24 | 17.1% |
Neonatal patients | 1 | 0.7% |
In which of the following locations do you place PICCs? (Select all that apply.) | ||
Adult medical ward | 115 | 82.1% |
General adult surgical ward | 110 | 78.6% |
General pediatric medical ward | 34 | 24.3% |
General pediatric surgical ward | 24 | 17.1% |
Adult intensive care unit | 114 | 81.4% |
Pediatric intensive care unit | 19 | 13.6% |
Neonatal intensive care unit | 3 | 2.1% |
Other intensive care unit | 59 | 42.1% |
Outpatient clinic or emergency department | 17 | 12.1% |
Other | 10 | 7.1% |
Approximately how many PICCs may you have placed in your career? | ||
099 | 15 | 10.7% |
100499 | 36 | 25.7% |
500999 | 23 | 16.4% |
1,000 | 47 | 33.6% |
Are you the vascular access lead nurse for your facility or organization? | ||
Yes | 22 | 15.7% |
No | 98 | 70.0% |
Do you currently hold a dedicated vascular access certification (BC‐VA, CRNI, etc.)? | ||
Yes | 32 | 22.9% |
No | 89 | 63.6% |
Facility characteristics | ||
Which of the following best describes your primary work location? | ||
Academic medical center | 41 | 29.3% |
For‐profit community‐based hospital or medical center | 30 | 21.4% |
Not‐for‐profit community‐based hospital or medical center | 50 | 35.7% |
Who inserts the most PICCs in your facility? | ||
Vascular access nurses | 133 | 95.0% |
Interventional radiology or other providers | 7 | 5.0% |
In which department is vascular access nursing located? | ||
Vascular nursing | 76 | 54.3% |
General nursing | 38 | 27.1% |
Interventional radiology | 15 | 10.7% |
Other | 11 | 7.9% |
Using your best guess, how many PICCs do you think your facility inserts each month? | ||
<25 | 5 | 3.6% |
2549 | 13 | 9.3% |
50100 | 39 | 27.9% |
>100 | 78 | 55.7% |
Unknown | 2 | 1.4% |
How many vascular access nurses are employed by your facility? | ||
<4 | 14 | 10.0% |
46 | 33 | 23.6% |
79 | 15 | 10.7% |
1015 | 25 | 17.9% |
>15 | 53 | 37.9% |
Does your facility track the number of PICCs placed? | ||
Yes | 132 | 94.3% |
No | 5 | 3.6% |
Unknown | 3 | 2.1% |
Does your facility track the duration or dwell time of PICCs? | ||
Yes | 56 | 40.0% |
No | 60 | 42.9% |
Unknown | 24 | 17.1% |
Does your facility have a written policy regarding standard PICC insertion practices? | ||
Yes | 122 | 87.1% |
No | 8 | 5.7% |
Unknown | 7 | 5.0% |
Does your facility have a written policy regarding standard PICC care and maintenance? | ||
Yes | 133 | 95.0% |
No | 3 | 2.1% |
Unknown | 1 | 0.7% |
Does your facility have a written process to review the necessity or appropriateness of a PICC? | ||
Yes | 42 | 30.0% |
No | 63 | 45.0% |
Unknown | 20 | 14.3% |
The most commonly reported indications for PICC placement included intravenous antibiotics at discharge, difficult venous access, and placement for chemotherapy in patients with cancer. Forty‐six percent of nurses indicated they had placed a PICC in a patient receiving some form of dialysis in the past several months; however, 91% of these respondents reported receiving approval from nephrology prior to placement in these patients. Although almost all nurses (91%) used ultrasound to find a suitable vein for PICC placement, a smaller percentage used ultrasound to estimate the catheter‐to‐vein ratio to prevent thrombosis (79%), and only a few (14%) documented this figure in the medical record. Three‐quarters of those surveyed (76%) indicated they used ECG‐based systems to position PICC tips at the cavoatrial junction to prevent thrombosis. Of those who used this technology, 36% still obtained chest x‐rays to verify the position of the PICC tip. According to 84% of respondents, flushing of PICCs was performed mainly by bedside nurses, whereas scheduled weekly dressing changes were most often performed by vascular access nurses (Table 2).
Question | No. | % |
---|---|---|
| ||
Do you use ultrasound to find a suitable vein prior to PICC insertion? | ||
Yes | 128 | 91.4% |
No | 0 | 0.0% |
Do you use ultrasound to estimate the catheter‐to‐vein ratio prior to PICC insertion? | ||
Yes | 110 | 78.6% |
No | 18 | 12.9% |
When using ultrasound, do you document the catheter‐to‐vein ratio in the PICC insertion note? | ||
Yes | 20 | 14.3% |
No | 89 | 63.6% |
Do you use ECG guidance‐assisted systems to place PICCs? | ||
Yes | 106 | 75.7% |
No | 21 | 15.0% |
If using ECG guidance, do you still routinely obtain a chest x‐ray to verify PICC tip position after placing the PICC using ECG guidance? | ||
Yes | 38 | 27.1% |
No | 68 | 48.6% |
Who is primarily responsible for administering and adhering to a flushing protocol after PICC insertion at your facility? | ||
Bedside nurses | 118 | 83.6% |
Patients | 1 | 0.7% |
Vascular access nurses | 8 | 5.7% |
Which of the following agents are most often used to flush PICCs? | ||
Both heparin and normal saline flushes | 61 | 43.6% |
Normal saline only | 63 | 45.0% |
Heparin only | 3 | 2.1% |
Who is responsible for scheduled weekly dressing changes for PICCs? | ||
Vascular access nurses | 110 | 78.6% |
Bedside nurses | 14 | 10.0% |
Other (eg, IR staff, ICU staff) | 3 | 2.1% |
In the past few months, have you placed a PICC in a patient who was receiving a form of dialysis (eg, peritoneal or hemodialysis)? | ||
Yes | 65 | 46.4% |
No | 64 | 45.7% |
If you have placed PICCs in patients on dialysis, do you discuss PICC placement or receive approval from nephrology prior to inserting the PICC? | ||
Yes | 59 | 90.8% |
No | 6 | 9.2% |
With respect to complications, catheter occlusion, migration, and DVT were reported as the 3 most prevalent adverse events. Interestingly, respondents did not report central lineassociated bloodstream infection (CLABSI) as a common complication. Additionally, 51% of those surveyed indicated that physicians unnecessarily removed PICCs when CLABSI was suspected but not confirmed. When managing catheter occlusion, 50% of respondents began with normal saline flushes but used tissue‐plasminogen activator if saline failed to resolve occlusion. Management of catheter migration varied based on degree of device movement: when the PICC had migrated <5 cm, most respondents (77%) indicated they would first obtain a chest x‐ray to determine the position of the PICC tip, with few (4%) performing catheter exchange. However, if the PICC had migrated more than 5 cm, a significantly greater proportion of respondents (21%) indicated they would perform a catheter exchange. With regard to managing DVT, most vascular nurses reported they notified nurses and physicians to continue using the PICC but recommended tests to confirm the diagnosis.
To better understand the experiences of vascular nurses, we asked for their perceptions regarding appropriateness of PICC use and relationships with bedside nurses, physicians, and leadership. Over a third of respondents (36%) felt that <5% of all PICCs may be inappropriate in their facility, whereas 1 in 5 indicated that 10% to 24% of PICCs placed in their facilities may be inappropriate or could have been avoided. Almost all (98%) of the nurses stated they were not empowered to remove idle or clinically unnecessary PICCs without physician authorization. Although 51% of nurses described the support received from hospital leadership as excellent, very good, or good, 43% described leadership support as either fair or poor. Conversely, relationships with bedside nurses and physicians were rated as being very good or good by nearly two‐thirds of those surveyed (64% and 65%, respectively) (Table 3).
Question | No. | % |
---|---|---|
| ||
Which of the following PICC‐related complications have you most frequently encountered in your practice? | ||
Catheter occlusion | 81 | 57.9% |
Catheter migration | 27 | 19.3% |
PICC‐associated DVT | 6 | 4.3% |
Catheter fracture or embolization | 3 | 2.1% |
Exit site infection | 3 | 2.1% |
Coiling or kinking after insertion | 2 | 1.4% |
If you suspect a patient has catheter occlusion, which of the following best describes your approach to resolving this problem? | ||
Begin with normal saline but use a tPA product if this fails to restore patency | 70 | 50.0% |
Use a tPA product (eg, Cathflo, Activase, or Retavase) to restore patency | 44 | 31.4% |
Begin with heparin‐based flushes but use a tPA product if this fails to restore | 7 | 5.0% |
Use only normal saline flushes to restore patency | 3 | 2.1% |
If you find a PICC that has migrated out or has been accidentally dislodged <5 cm in a patient without symptoms, and the device is still clinically needed, which of the following best describes your practice? | ||
Obtain a chest x‐ray to verify tip position | 108 | 77.1% |
Perform a complete catheter exchange over a guidewire if possible | 5 | 3.6% |
Notify/discuss next steps with physician | 5 | 3.6% |
Other | 6 | 4.3% |
If you find a PICC that has migrated out or has been accidentally dislodged >5 cm in a patient without symptoms, and the device is still clinically needed, which of the following best describes your practice? | ||
Obtain a chest x‐ray to verify tip position | 72 | 51.4% |
Perform a catheter exchange over a guidewire if possible | 30 | 21.4% |
Notify/discuss next steps with physician | 10 | 7.1% |
Other | 12 | 8.6% |
Which of the following best describes your first approach when you suspect a patient has PICC‐associated phlebitis? | ||
Discuss best course of action with physician or nurse | 79 | 56.4% |
Supportive measures (eg, warm compresses, analgesics, monitoring) | 25 | 17.9% |
Remove the PICC | 15 | 10.7% |
Other | 5 | 3.6% |
Which of the following best describes your first approach when you suspect a patient has a PICC‐related DVT? | ||
Notify caregivers to continue using PICC and consider tests such as ultrasound | 82 | 58.6% |
Notify bedside nurse and physician not to continue use of the PICC and consider tests such as ultrasound | 42 | 30.0% |
PICCs are often removed when physicians suspect, but have not yet confirmed, CLABSI. Considering your experiences, what percentage of PICCs may have been removed in this manner at your facility? | ||
<5% | 11 | 7.9% |
59% | 16 | 11.4% |
1024% | 24 | 17.1% |
25% | 71 | 50.7% |
Based on your experience, what percentage of PICCs do you think are inappropriate or could have been avoided at your facility? | ||
<5% | 51 | 36.4% |
59% | 25 | 17.9% |
1024% | 28 | 20.0% |
2550% | 13 | 9.3% |
>50% | 5 | 3.6% |
Are vascular access nurses empowered to remove PICCs that are idle or clinically unnecessary without physician authorization? | ||
Yes | 3 | 2.1% |
No | 122 | 87.1% |
How would you rank the overall support your vascular access service receives from hospital leadership? | ||
Excellent | 5 | 3.6% |
Very good | 32 | 22.9% |
Good | 40 | 28.6% |
Fair | 35 | 25.0% |
Poor | 25 | 17.9% |
How would you describe your relationship with physicians at your facility when it comes to communicating recommendations or management of PICCs? | ||
Very good | 28 | 20.0% |
Good | 63 | 45.0% |
Fair | 35 | 25.0% |
Poor | 7 | 5.0% |
Very poor | 4 | 2.9% |
How would you describe your relationship with bedside nurses at your facility when it comes to communicating recommendations or management of PICCs? | ||
Very good | 32 | 22.9% |
Good | 58 | 41.4% |
Fair | 38 | 27.1% |
Poor | 7 | 5.0% |
Very poor | 2 | 1.4% |
Variation in Responses Based on Years in Practice or Certification
We initially hypothesized that responses regarding practice (ultrasound use, ECG guidance system use), management of complications, or perceptions regarding leadership might vary based on years of experience, number of PICCs placed, or certification status. However, no statistically significant associations with these factors and individual responses were identified.
DISCUSSION
In this survey of 140 vascular access nurses in hospitals across Michigan, new insights regarding the experience, practice, knowledge, and beliefs of this group of providers were obtained. We found that vascular access nurses varied with respect to years in practice, volume of PICCs placed, and certification status, reflecting heterogeneity in this provider group. Variation in insertion techniques, such as use of ultrasound to examine catheter‐to‐vein ratio (a key way to prevent thrombosis) or newer ECG technology to position the PICC, was also noted. Although indications for PICC insertion appeared consistent with published literature, the frequency with which these devices were placed in patients receiving dialysis (reportedly with nephrology approval) was surprising given national calls to avoid such use.[16] Opportunities to improve hospital practices, such as tracking PICC dwell times and PICC necessity, as well as the potential need to better educate physicians on when to remove PICCs for suspected CLABSI, were also identified. Collectively, these data are highly relevant to hospitalists and health systems as they help to identify areas for quality improvement and inform clinical practice regarding the use of PICCs in hospitalized patients. As hospitalists increasingly order PICCs and manage complications associated with these devices, they are well suited to use these data so as to improve patient safety and clinical outcomes.
Venous access is the most common medical procedure performed in hospitalized medical patients. Although a number of devices including peripheral intravenous catheters, central venous catheters, and PICCs are used for this purpose, the growing use of PICCs to secure venous access has been documented in several studies.[17] Such growth, in part, undoubtedly reflects increasing availability of vascular access nurses. Traditionally placed by interventional radiologists, the creation of dedicated vascular nursing teams has resulted in these subspecialists now serving in more of a backup or trouble‐shooting role rather than that of primary operator.[4, 14] This paradigm shift is well illustrated in a recent survey of infection preventionists, where over 60% of respondents reported that they had a vascular nursing team in their facility.[7] The growth of these nursing‐led vascular access teams has produced not only high rates of insertion success and low rates of complications, but also greater cost‐effectiveness when compared to interventional radiologybased insertion.[18]
Nonetheless, our survey also identified a number of important concerns regarding PICC practices and vascular nursing providers. First, we found variation in areas such as insertion practices and management of complications. Such variability highlights the importance of both growing and disseminating the evidence base for consistent practice in vascular nursing. Through their close clinical affiliation with vascular nurses and shared interests in obtaining safe and appropriate venous access for patients, hospitalists are ideally poised to lead this effort. Second, similarities between vascular nurse opinions regarding appropriateness of PICCs and those of hospitalists from a prior survey were noted.[19] Namely, a substantial proportion of both vascular nurses and hospitalists felt that some PICCs were inappropriate and could be avoided. Third, although relationships between vascular access nurses and leadership were reported as being variable, the survey responses suggested relatively good interprovider relationships with bedside nurses and physicians. Such relationships likely reflect the close clinical ties that emerge from being in the trenches of patient care and suggest that interventions to improve care in partnership with these providers are highly viable.
Our study has some limitations. First, despite a high response rate, our study used a survey design and reports findings from a convenience sample of vascular access nurses in a single state. Thus, nonrespondent and selection biases remain threats to our conclusions. Additionally, some respondents did not complete all responses, perhaps due to nonapplicability to practice or other unknown reasons. The pattern of missingness observed, however, suggested that such responses were missing at random. Second, we surveyed vascular nurses in hospitals that are actively engaged in improving PICC practices; our findings may therefore not be representative of vascular nursing professionals as a whole and may instead reflect those of a highly motivated group of individuals. Relatedly, the underlying reasons for adoption of specific practices or techniques cannot be discerned from our study. Third, although we did not find differences based on years in practice or certification status, our sample size was relatively small and likely underpowered for these comparisons. Finally, our study sample consists of vascular nurses who are clustered within hospitals in which they are employed. Therefore, overlap between reported practices and those required by the facility are possible.
Despite these limitations, our study has important strengths. First, this is among the most comprehensive of surveys examining vascular nursing experience, practice, knowledge, and beliefs. The growing presence of these providers across US hospitals, coupled with limited insight regarding their clinical practices, highlight the importance and utility of these data. Second, we noted important differences in experience, practices, and interprovider relationships between vascular providers in this field. Although we are unable to ascertain the drivers or significance of such variation, hospitals and health systems focused on improving patient safety should consider quantifying and exploring these factors. Third, findings from our survey within Michigan suggest the need for similar, larger studies across the country. Partnerships with nursing organizations or larger professional groups that represent vascular nursing specialists may be helpful in this regard.
In conclusion, we found important similarities and differences in vascular nursing experience, practice, knowledge, and beliefs in Michigan. These data are useful as they help provide context regarding the constitution of these teams, current practices, and opportunities for improving care. Hospitalists seeking to improve patient safety may use these data to better inform vascular access practice in hospitalized patients.
Acknowledgements
The authors thank Claire Rickard, PhD, RN, Britt Meyer, RN, Peter Carr, PhD, and David Dempsey, RN for their assistance in developing the survey instrument used in this study.
Disclosures: This project was funded through an Investigator Initiated Research Grant from the Blue Cross Blue Shield of Michigan (BCBSM) Foundation (grant number 2140.II). The funding source played no role in study design, data acquisition, analysis, or reporting of the data. Support for the Hospital Medicine Safety (HMS) Consortium is provided by BCBSM and the Blue Care Network as part of the BCBSM Value Partnerships program. Although BCBSM and HMS work collaboratively, the opinions, beliefs, and viewpoints expressed by the authors do not necessarily reflect the opinions, beliefs, and viewpoints of BCBSM or any of its employees. This work was also supported with resources from the Veterans Affairs Ann Arbor Healthcare System. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government.
Peripherally inserted central catheters (PICCs) are among the most prevalent of venous access devices in hospitalized patients.[1, 2] Although growing use of these devices reflects clinical advantages, such as a reduced risk of complications during insertion and durable venous access, use of PICCs is also likely related to the growth of vascular access nursing.[3, 4] A relatively new specialty, vascular access nurses obtain, maintain, and manage venous access in hospitalized patients.[4, 5] Depending on their scope of practice, these professionals are responsible not only for insertion of devices, such as peripheral intravenous catheters and PICCs, but also nontunneled central venous catheters and arterial catheters in some settings.[6]
Although a growing number of US hospitals have introduced vascular nursing teams,[7] little is known about the experience, practice, knowledge, and beliefs of vascular access nurses. This knowledge gap is relevant for hospitalists and hospital medicine as (1) vascular access nurses increasingly represent a key partner in the care of hospitalized patients; (2) the knowledge and practice of these individuals directly affects patient safety and clinical outcomes; and (3) understanding experience, practice, and beliefs of these specialists can help inform decision making and quality‐improvement efforts related to PICCs. As hospitalists increasingly order the placement of and care for patients with PICCs, they are also well suited to improve PICC practice.
Therefore, we conducted a survey of vascular access nurses employed by hospitals that participate in the Michigan Hospital Medicine Safety (HMS) Consortium, a Blue Cross Blue Shield of Michiganfunded collaborative quality initiative.[6] We aimed to understand experience, practice, knowledge, and beliefs related to PICC care and use.
METHODS
Study Setting and Participants
To quantify vascular nursing experience, practice, knowledge, and beliefs, we conducted a Web‐based survey of vascular nurses across 47 Michigan hospitals that participate in HMS. A statewide quality‐improvement initiative, HMS aims to prevent adverse events in hospitalized medical patients through the creation of a data registry and sharing of best practices. The setting and design of this multicenter initiative have been previously described.[8, 9] Although participation is voluntary, each hospital receives payment for participating in the consortium and for data collection. Because HMS has an ongoing initiative aimed at identifying and preventing PICC‐related complications, this study was particularly relevant for participating hospitals and nurses.
Each HMS site has a designated quality‐improvement lead, physician champion, and data abstractor. To coordinate distribution and dissemination of the survey, we contacted the quality‐improvement leads at each site and enquired whether their hospital employed vascular access nurses who placed PICCs. Because we were only interested in responses from vascular access nurses, HMS hospitals that did not have these providers or stated PICCs were placed by other specialists (eg, interventional radiology) were excluded. At eligible sites, we obtained the total number of vascular nurses employed so as to determine the number of eligible respondents. In this manner, a purposeful sample of vascular nurses at participating HMS hospitals was constituted.
Participation in the survey was solicited through hospital quality leads that either distributed an electronic survey link to vascular nurses at their facilities or sent us individual email addresses to contact them directly. A cover letter explaining the rationale and the purpose of the survey along with the survey link was then sent to respondents through either of these routes. The survey was administered at all HMS sites contemporaneously and kept open for a period of 5 weeks. During the 5‐week period, 2 e‐mail reminders were sent to encourage participation. As a token of appreciation, a $10 Amazon gift card was offered to those who took the survey.
Development and Validation of the Survey
We developed the survey instrument (which we call PICC1 as we hope to administer longitudinally to track changes over time) by first conducting a literature search to identify relevant evidence‐based guidelines and studies regarding vascular access nursing practices and experiences.[10, 11, 12, 13] In addition, we consulted and involved national and international leaders in vascular access nursing to ensure validity and representativeness of the questions posed. We were specifically interested in nursing background, hospital practices, types of PICCs used, use of various technologies, relationships with healthcare providers, and management of complications. To understand participant characteristics and quantify potential variation in responses, we collected basic participant data including demographics, years in practice, number of PICCs placed, leadership roles, and vascular access certification status. Based on clinical reasoning and existing studies,[14, 15] we hypothesized that responses regarding certain practices (ultrasound use, electrocardiography [ECG] guidance system use), management of complications, or perceptions regarding leadership might vary based on years of experience, number of PICCs placed, or certification status. We therefore examined these associations as prespecified subgroup analyses.
The initial survey instrument was pilot tested with vascular nurses outside of the sampling frame. Based on feedback from the pilot testers, the instrument was refined and edited to improve clarity of the questions. In addition, specific skip patterns and logic were programmed into the final survey to reduce respondent burden and allow participants to seamlessly bypass questions that were contingent on a prior response (eg, use of ECG to place PICCs would lead to a series of questions about ECG‐assisted placement only for those respondents who used the technology). This final version of the survey was tested by members of the study team (V.C., L.K., S.L.K.) and then posted to SurveyMonkey for dissemination.
Statistical Analysis
Descriptive statistics (percentage, n/N) were used to tabulate results. In accordance with our a priori hypothesis that variation to responses might be associated with respondent characteristics, responses to questions regarding insertion practice (eg, use of ultrasound, measurement of catheter:vein ratio, trimming of catheters) and approach to complications (eg, catheter occlusion, deep vein thrombosis [DVT] notification, and PICC removal in the setting of fever) were compared by respondent years in practice (dichotomized to <5 vs >5 years), volume of PICCs placed (<999 vs 1000), and certification status (yes/no). Bivariate comparisons were made using 2 or Fisher exact tests based on the number of responses in a cell as appropriate; 2‐sided with a P value <0.05 was considered statistically significant. All statistical analyses were conducted using SAS version 9.3 (SAS Institute, Cary, NC).
Ethical and Regulatory Oversight
Because our study sought to describe existing practice without collecting any individual or facility level identifiable information, the project received a Not Regulated status by the University of Michigan Medical School Institutional Review Board (HUM00088351).
RESULTS
Of 172 vascular nurses who received invitations, 140 completed the survey for a response rate of 81%. Respondents reported working in not‐for‐profit hospitals (36%), academic medical centers (29%), and for‐profit hospitals (21%). Although multiple providers (eg, interventional radiology staff and providers, physicians) placed PICCs, 95% of those surveyed reported that they placed the majority of the PICCs at their institutions. Although most respondents placed PICCs in adult patients (86%), a few also placed PICCs in pediatric populations (17%). Vascular nursing programs were largely housed in their own department, but some reported to general nursing or subspecialties such as interventional radiology, cardiology, and critical care. Most respondents indicated their facilities had written policies regarding standard insertion and care practices (87% and 95%, respectively), but only 30% had policies regarding the necessity or appropriateness of PICCs.
Experience among respondents was variable: approximately a third had placed PICCs for <5 years (28.6%), whereas 58% reported placing PICCs for 5 years Correspondingly, 26% reported having placed 100 to 500 PICCs, whereas 34% had placed 1000 or more PICCs. Only 23% of those surveyed held a dedicated vascular access certification, such as board certified in vascular access or certified registered nurse infusion, whereas 16% indicated that they served as the vascular access lead nurse for their facility. Following placement, 94% of respondents reported that their facilities tracked the number of PICCs inserted, but only 40% indicated that dwell times of devices were also recorded. Only 30% of nurses reported that their hospitals had a written policy to evaluate PICC necessity or appropriateness following placement (Table 1).
No.* | % | |
---|---|---|
| ||
Participant characteristics | ||
For how many years have you been inserting PICCs? | ||
<5 years | 40 | 28.6% |
5 years | 81 | 57.9% |
Missing | ||
In which of the following populations do you insert PICCs? | ||
Adult patients | 121 | 86.4% |
Pediatric patients | 24 | 17.1% |
Neonatal patients | 1 | 0.7% |
In which of the following locations do you place PICCs? (Select all that apply.) | ||
Adult medical ward | 115 | 82.1% |
General adult surgical ward | 110 | 78.6% |
General pediatric medical ward | 34 | 24.3% |
General pediatric surgical ward | 24 | 17.1% |
Adult intensive care unit | 114 | 81.4% |
Pediatric intensive care unit | 19 | 13.6% |
Neonatal intensive care unit | 3 | 2.1% |
Other intensive care unit | 59 | 42.1% |
Outpatient clinic or emergency department | 17 | 12.1% |
Other | 10 | 7.1% |
Approximately how many PICCs may you have placed in your career? | ||
099 | 15 | 10.7% |
100499 | 36 | 25.7% |
500999 | 23 | 16.4% |
1,000 | 47 | 33.6% |
Are you the vascular access lead nurse for your facility or organization? | ||
Yes | 22 | 15.7% |
No | 98 | 70.0% |
Do you currently hold a dedicated vascular access certification (BC‐VA, CRNI, etc.)? | ||
Yes | 32 | 22.9% |
No | 89 | 63.6% |
Facility characteristics | ||
Which of the following best describes your primary work location? | ||
Academic medical center | 41 | 29.3% |
For‐profit community‐based hospital or medical center | 30 | 21.4% |
Not‐for‐profit community‐based hospital or medical center | 50 | 35.7% |
Who inserts the most PICCs in your facility? | ||
Vascular access nurses | 133 | 95.0% |
Interventional radiology or other providers | 7 | 5.0% |
In which department is vascular access nursing located? | ||
Vascular nursing | 76 | 54.3% |
General nursing | 38 | 27.1% |
Interventional radiology | 15 | 10.7% |
Other | 11 | 7.9% |
Using your best guess, how many PICCs do you think your facility inserts each month? | ||
<25 | 5 | 3.6% |
2549 | 13 | 9.3% |
50100 | 39 | 27.9% |
>100 | 78 | 55.7% |
Unknown | 2 | 1.4% |
How many vascular access nurses are employed by your facility? | ||
<4 | 14 | 10.0% |
46 | 33 | 23.6% |
79 | 15 | 10.7% |
1015 | 25 | 17.9% |
>15 | 53 | 37.9% |
Does your facility track the number of PICCs placed? | ||
Yes | 132 | 94.3% |
No | 5 | 3.6% |
Unknown | 3 | 2.1% |
Does your facility track the duration or dwell time of PICCs? | ||
Yes | 56 | 40.0% |
No | 60 | 42.9% |
Unknown | 24 | 17.1% |
Does your facility have a written policy regarding standard PICC insertion practices? | ||
Yes | 122 | 87.1% |
No | 8 | 5.7% |
Unknown | 7 | 5.0% |
Does your facility have a written policy regarding standard PICC care and maintenance? | ||
Yes | 133 | 95.0% |
No | 3 | 2.1% |
Unknown | 1 | 0.7% |
Does your facility have a written process to review the necessity or appropriateness of a PICC? | ||
Yes | 42 | 30.0% |
No | 63 | 45.0% |
Unknown | 20 | 14.3% |
The most commonly reported indications for PICC placement included intravenous antibiotics at discharge, difficult venous access, and placement for chemotherapy in patients with cancer. Forty‐six percent of nurses indicated they had placed a PICC in a patient receiving some form of dialysis in the past several months; however, 91% of these respondents reported receiving approval from nephrology prior to placement in these patients. Although almost all nurses (91%) used ultrasound to find a suitable vein for PICC placement, a smaller percentage used ultrasound to estimate the catheter‐to‐vein ratio to prevent thrombosis (79%), and only a few (14%) documented this figure in the medical record. Three‐quarters of those surveyed (76%) indicated they used ECG‐based systems to position PICC tips at the cavoatrial junction to prevent thrombosis. Of those who used this technology, 36% still obtained chest x‐rays to verify the position of the PICC tip. According to 84% of respondents, flushing of PICCs was performed mainly by bedside nurses, whereas scheduled weekly dressing changes were most often performed by vascular access nurses (Table 2).
Question | No. | % |
---|---|---|
| ||
Do you use ultrasound to find a suitable vein prior to PICC insertion? | ||
Yes | 128 | 91.4% |
No | 0 | 0.0% |
Do you use ultrasound to estimate the catheter‐to‐vein ratio prior to PICC insertion? | ||
Yes | 110 | 78.6% |
No | 18 | 12.9% |
When using ultrasound, do you document the catheter‐to‐vein ratio in the PICC insertion note? | ||
Yes | 20 | 14.3% |
No | 89 | 63.6% |
Do you use ECG guidance‐assisted systems to place PICCs? | ||
Yes | 106 | 75.7% |
No | 21 | 15.0% |
If using ECG guidance, do you still routinely obtain a chest x‐ray to verify PICC tip position after placing the PICC using ECG guidance? | ||
Yes | 38 | 27.1% |
No | 68 | 48.6% |
Who is primarily responsible for administering and adhering to a flushing protocol after PICC insertion at your facility? | ||
Bedside nurses | 118 | 83.6% |
Patients | 1 | 0.7% |
Vascular access nurses | 8 | 5.7% |
Which of the following agents are most often used to flush PICCs? | ||
Both heparin and normal saline flushes | 61 | 43.6% |
Normal saline only | 63 | 45.0% |
Heparin only | 3 | 2.1% |
Who is responsible for scheduled weekly dressing changes for PICCs? | ||
Vascular access nurses | 110 | 78.6% |
Bedside nurses | 14 | 10.0% |
Other (eg, IR staff, ICU staff) | 3 | 2.1% |
In the past few months, have you placed a PICC in a patient who was receiving a form of dialysis (eg, peritoneal or hemodialysis)? | ||
Yes | 65 | 46.4% |
No | 64 | 45.7% |
If you have placed PICCs in patients on dialysis, do you discuss PICC placement or receive approval from nephrology prior to inserting the PICC? | ||
Yes | 59 | 90.8% |
No | 6 | 9.2% |
With respect to complications, catheter occlusion, migration, and DVT were reported as the 3 most prevalent adverse events. Interestingly, respondents did not report central lineassociated bloodstream infection (CLABSI) as a common complication. Additionally, 51% of those surveyed indicated that physicians unnecessarily removed PICCs when CLABSI was suspected but not confirmed. When managing catheter occlusion, 50% of respondents began with normal saline flushes but used tissue‐plasminogen activator if saline failed to resolve occlusion. Management of catheter migration varied based on degree of device movement: when the PICC had migrated <5 cm, most respondents (77%) indicated they would first obtain a chest x‐ray to determine the position of the PICC tip, with few (4%) performing catheter exchange. However, if the PICC had migrated more than 5 cm, a significantly greater proportion of respondents (21%) indicated they would perform a catheter exchange. With regard to managing DVT, most vascular nurses reported they notified nurses and physicians to continue using the PICC but recommended tests to confirm the diagnosis.
To better understand the experiences of vascular nurses, we asked for their perceptions regarding appropriateness of PICC use and relationships with bedside nurses, physicians, and leadership. Over a third of respondents (36%) felt that <5% of all PICCs may be inappropriate in their facility, whereas 1 in 5 indicated that 10% to 24% of PICCs placed in their facilities may be inappropriate or could have been avoided. Almost all (98%) of the nurses stated they were not empowered to remove idle or clinically unnecessary PICCs without physician authorization. Although 51% of nurses described the support received from hospital leadership as excellent, very good, or good, 43% described leadership support as either fair or poor. Conversely, relationships with bedside nurses and physicians were rated as being very good or good by nearly two‐thirds of those surveyed (64% and 65%, respectively) (Table 3).
Question | No. | % |
---|---|---|
| ||
Which of the following PICC‐related complications have you most frequently encountered in your practice? | ||
Catheter occlusion | 81 | 57.9% |
Catheter migration | 27 | 19.3% |
PICC‐associated DVT | 6 | 4.3% |
Catheter fracture or embolization | 3 | 2.1% |
Exit site infection | 3 | 2.1% |
Coiling or kinking after insertion | 2 | 1.4% |
If you suspect a patient has catheter occlusion, which of the following best describes your approach to resolving this problem? | ||
Begin with normal saline but use a tPA product if this fails to restore patency | 70 | 50.0% |
Use a tPA product (eg, Cathflo, Activase, or Retavase) to restore patency | 44 | 31.4% |
Begin with heparin‐based flushes but use a tPA product if this fails to restore | 7 | 5.0% |
Use only normal saline flushes to restore patency | 3 | 2.1% |
If you find a PICC that has migrated out or has been accidentally dislodged <5 cm in a patient without symptoms, and the device is still clinically needed, which of the following best describes your practice? | ||
Obtain a chest x‐ray to verify tip position | 108 | 77.1% |
Perform a complete catheter exchange over a guidewire if possible | 5 | 3.6% |
Notify/discuss next steps with physician | 5 | 3.6% |
Other | 6 | 4.3% |
If you find a PICC that has migrated out or has been accidentally dislodged >5 cm in a patient without symptoms, and the device is still clinically needed, which of the following best describes your practice? | ||
Obtain a chest x‐ray to verify tip position | 72 | 51.4% |
Perform a catheter exchange over a guidewire if possible | 30 | 21.4% |
Notify/discuss next steps with physician | 10 | 7.1% |
Other | 12 | 8.6% |
Which of the following best describes your first approach when you suspect a patient has PICC‐associated phlebitis? | ||
Discuss best course of action with physician or nurse | 79 | 56.4% |
Supportive measures (eg, warm compresses, analgesics, monitoring) | 25 | 17.9% |
Remove the PICC | 15 | 10.7% |
Other | 5 | 3.6% |
Which of the following best describes your first approach when you suspect a patient has a PICC‐related DVT? | ||
Notify caregivers to continue using PICC and consider tests such as ultrasound | 82 | 58.6% |
Notify bedside nurse and physician not to continue use of the PICC and consider tests such as ultrasound | 42 | 30.0% |
PICCs are often removed when physicians suspect, but have not yet confirmed, CLABSI. Considering your experiences, what percentage of PICCs may have been removed in this manner at your facility? | ||
<5% | 11 | 7.9% |
59% | 16 | 11.4% |
1024% | 24 | 17.1% |
25% | 71 | 50.7% |
Based on your experience, what percentage of PICCs do you think are inappropriate or could have been avoided at your facility? | ||
<5% | 51 | 36.4% |
59% | 25 | 17.9% |
1024% | 28 | 20.0% |
2550% | 13 | 9.3% |
>50% | 5 | 3.6% |
Are vascular access nurses empowered to remove PICCs that are idle or clinically unnecessary without physician authorization? | ||
Yes | 3 | 2.1% |
No | 122 | 87.1% |
How would you rank the overall support your vascular access service receives from hospital leadership? | ||
Excellent | 5 | 3.6% |
Very good | 32 | 22.9% |
Good | 40 | 28.6% |
Fair | 35 | 25.0% |
Poor | 25 | 17.9% |
How would you describe your relationship with physicians at your facility when it comes to communicating recommendations or management of PICCs? | ||
Very good | 28 | 20.0% |
Good | 63 | 45.0% |
Fair | 35 | 25.0% |
Poor | 7 | 5.0% |
Very poor | 4 | 2.9% |
How would you describe your relationship with bedside nurses at your facility when it comes to communicating recommendations or management of PICCs? | ||
Very good | 32 | 22.9% |
Good | 58 | 41.4% |
Fair | 38 | 27.1% |
Poor | 7 | 5.0% |
Very poor | 2 | 1.4% |
Variation in Responses Based on Years in Practice or Certification
We initially hypothesized that responses regarding practice (ultrasound use, ECG guidance system use), management of complications, or perceptions regarding leadership might vary based on years of experience, number of PICCs placed, or certification status. However, no statistically significant associations with these factors and individual responses were identified.
DISCUSSION
In this survey of 140 vascular access nurses in hospitals across Michigan, new insights regarding the experience, practice, knowledge, and beliefs of this group of providers were obtained. We found that vascular access nurses varied with respect to years in practice, volume of PICCs placed, and certification status, reflecting heterogeneity in this provider group. Variation in insertion techniques, such as use of ultrasound to examine catheter‐to‐vein ratio (a key way to prevent thrombosis) or newer ECG technology to position the PICC, was also noted. Although indications for PICC insertion appeared consistent with published literature, the frequency with which these devices were placed in patients receiving dialysis (reportedly with nephrology approval) was surprising given national calls to avoid such use.[16] Opportunities to improve hospital practices, such as tracking PICC dwell times and PICC necessity, as well as the potential need to better educate physicians on when to remove PICCs for suspected CLABSI, were also identified. Collectively, these data are highly relevant to hospitalists and health systems as they help to identify areas for quality improvement and inform clinical practice regarding the use of PICCs in hospitalized patients. As hospitalists increasingly order PICCs and manage complications associated with these devices, they are well suited to use these data so as to improve patient safety and clinical outcomes.
Venous access is the most common medical procedure performed in hospitalized medical patients. Although a number of devices including peripheral intravenous catheters, central venous catheters, and PICCs are used for this purpose, the growing use of PICCs to secure venous access has been documented in several studies.[17] Such growth, in part, undoubtedly reflects increasing availability of vascular access nurses. Traditionally placed by interventional radiologists, the creation of dedicated vascular nursing teams has resulted in these subspecialists now serving in more of a backup or trouble‐shooting role rather than that of primary operator.[4, 14] This paradigm shift is well illustrated in a recent survey of infection preventionists, where over 60% of respondents reported that they had a vascular nursing team in their facility.[7] The growth of these nursing‐led vascular access teams has produced not only high rates of insertion success and low rates of complications, but also greater cost‐effectiveness when compared to interventional radiologybased insertion.[18]
Nonetheless, our survey also identified a number of important concerns regarding PICC practices and vascular nursing providers. First, we found variation in areas such as insertion practices and management of complications. Such variability highlights the importance of both growing and disseminating the evidence base for consistent practice in vascular nursing. Through their close clinical affiliation with vascular nurses and shared interests in obtaining safe and appropriate venous access for patients, hospitalists are ideally poised to lead this effort. Second, similarities between vascular nurse opinions regarding appropriateness of PICCs and those of hospitalists from a prior survey were noted.[19] Namely, a substantial proportion of both vascular nurses and hospitalists felt that some PICCs were inappropriate and could be avoided. Third, although relationships between vascular access nurses and leadership were reported as being variable, the survey responses suggested relatively good interprovider relationships with bedside nurses and physicians. Such relationships likely reflect the close clinical ties that emerge from being in the trenches of patient care and suggest that interventions to improve care in partnership with these providers are highly viable.
Our study has some limitations. First, despite a high response rate, our study used a survey design and reports findings from a convenience sample of vascular access nurses in a single state. Thus, nonrespondent and selection biases remain threats to our conclusions. Additionally, some respondents did not complete all responses, perhaps due to nonapplicability to practice or other unknown reasons. The pattern of missingness observed, however, suggested that such responses were missing at random. Second, we surveyed vascular nurses in hospitals that are actively engaged in improving PICC practices; our findings may therefore not be representative of vascular nursing professionals as a whole and may instead reflect those of a highly motivated group of individuals. Relatedly, the underlying reasons for adoption of specific practices or techniques cannot be discerned from our study. Third, although we did not find differences based on years in practice or certification status, our sample size was relatively small and likely underpowered for these comparisons. Finally, our study sample consists of vascular nurses who are clustered within hospitals in which they are employed. Therefore, overlap between reported practices and those required by the facility are possible.
Despite these limitations, our study has important strengths. First, this is among the most comprehensive of surveys examining vascular nursing experience, practice, knowledge, and beliefs. The growing presence of these providers across US hospitals, coupled with limited insight regarding their clinical practices, highlight the importance and utility of these data. Second, we noted important differences in experience, practices, and interprovider relationships between vascular providers in this field. Although we are unable to ascertain the drivers or significance of such variation, hospitals and health systems focused on improving patient safety should consider quantifying and exploring these factors. Third, findings from our survey within Michigan suggest the need for similar, larger studies across the country. Partnerships with nursing organizations or larger professional groups that represent vascular nursing specialists may be helpful in this regard.
In conclusion, we found important similarities and differences in vascular nursing experience, practice, knowledge, and beliefs in Michigan. These data are useful as they help provide context regarding the constitution of these teams, current practices, and opportunities for improving care. Hospitalists seeking to improve patient safety may use these data to better inform vascular access practice in hospitalized patients.
Acknowledgements
The authors thank Claire Rickard, PhD, RN, Britt Meyer, RN, Peter Carr, PhD, and David Dempsey, RN for their assistance in developing the survey instrument used in this study.
Disclosures: This project was funded through an Investigator Initiated Research Grant from the Blue Cross Blue Shield of Michigan (BCBSM) Foundation (grant number 2140.II). The funding source played no role in study design, data acquisition, analysis, or reporting of the data. Support for the Hospital Medicine Safety (HMS) Consortium is provided by BCBSM and the Blue Care Network as part of the BCBSM Value Partnerships program. Although BCBSM and HMS work collaboratively, the opinions, beliefs, and viewpoints expressed by the authors do not necessarily reflect the opinions, beliefs, and viewpoints of BCBSM or any of its employees. This work was also supported with resources from the Veterans Affairs Ann Arbor Healthcare System. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government.
- Peripherally inserted central venous catheters in the acute care setting: a safe alternative to high‐risk short‐term central venous catheters. Am J Infect Control. 2010;38(2):149–153. , , , et al.
- Risk of venous thromboembolism in hospitalized patients with peripherally inserted central catheters. J Hosp Med. 2009;4(7):417–422. , , , , .
- Central venous catheter placement by advanced practice nurses demonstrates low procedural complication and infection rates‐‐a report from 13 years of service. Crit Care Med. 2014;42(3):536–543. , , , , , .
- Developing an alternative workflow model for peripherally inserted central catheter placement. J Infus Nurs. 2012;34(1):34–42. .
- Facility wide benefits of radiology vascular access teams. Radiol Manage. 2010;32(1):28–32; quiz 33–34. , .
- Moving the needle forward: the imperative for collaboration in vascular access. J Infus Nurs. 2015;38(2):100–102. , .
- Use of designated PICC teams by U.S. hospitals: a survey‐based study [published online November 10, 2015]. J Patient Saf. doi: 10.1097/PTS.0000000000000246 , , , .
- The association between PICC use and venous thromboembolism in upper and lower extremities. American J Med. 2015;128(9):986–993.e1. , , , , .
- Hospital performance for pharmacologic venous thromboembolism prophylaxis and rate of venous thromboembolism: a cohort study. JAMA Intern Med. 2014;174(10):1577–1584. , , , et al.
- Risk of venous thromboembolism associated with peripherally inserted central catheters: a systematic review and meta‐analysis. Lancet. 2013;382(9889):311–325. , , , et al.
- Infusion Nurses Society. Infusion nursing standards of practice. J Infus Nurs. 2006;29(1 suppl):S1–S92.
- Guidelines for the prevention of intravascular catheter‐related infections. Am J Infect Control. 2011;39(4 suppl 1):S1–S34. , , , et al.
- International evidence‐based recommendations on ultrasound‐guided vascular access. Intensive Care Med. 2012;38(7):1105–1117. , , , et al.
- A single institution experience of seven hundred consecutively placed peripherally inserted central venous catheters. J Vasc Access. 2014;15(6):498–502. , , .
- Central venous access devices site care practices: an international survey of 34 countries [published online September 3, 2015]. J Vasc Access. doi: 10.5301/jva.5000450 , , .
- American Society of Nephrology. World's Leading Kidney Society Joins Effort to Reduce Unnecessary Medical Tests and Procedures. Available at: https://www.asn‐online.org/policy/choosingwisely/PressReleaseChoosingWisely.pdf. Accessed September 4, 2015.
- A survey of the current use of peripherally inserted central venous catheter (PICC) in Swedish oncology departments. Acta Oncol. 2013;52(6):1241–1242. , , , .
- Nurse‐led PICC insertion: is it cost effective? Br J Nurs. 2013;22(19):S9–S15. , .
- Hospitalist experiences, practice, opinions, and knowledge regarding peripherally inserted central catheters: a Michigan survey. J Hosp Med. 2013;8(6):309–314. , , , et al.
- Peripherally inserted central venous catheters in the acute care setting: a safe alternative to high‐risk short‐term central venous catheters. Am J Infect Control. 2010;38(2):149–153. , , , et al.
- Risk of venous thromboembolism in hospitalized patients with peripherally inserted central catheters. J Hosp Med. 2009;4(7):417–422. , , , , .
- Central venous catheter placement by advanced practice nurses demonstrates low procedural complication and infection rates‐‐a report from 13 years of service. Crit Care Med. 2014;42(3):536–543. , , , , , .
- Developing an alternative workflow model for peripherally inserted central catheter placement. J Infus Nurs. 2012;34(1):34–42. .
- Facility wide benefits of radiology vascular access teams. Radiol Manage. 2010;32(1):28–32; quiz 33–34. , .
- Moving the needle forward: the imperative for collaboration in vascular access. J Infus Nurs. 2015;38(2):100–102. , .
- Use of designated PICC teams by U.S. hospitals: a survey‐based study [published online November 10, 2015]. J Patient Saf. doi: 10.1097/PTS.0000000000000246 , , , .
- The association between PICC use and venous thromboembolism in upper and lower extremities. American J Med. 2015;128(9):986–993.e1. , , , , .
- Hospital performance for pharmacologic venous thromboembolism prophylaxis and rate of venous thromboembolism: a cohort study. JAMA Intern Med. 2014;174(10):1577–1584. , , , et al.
- Risk of venous thromboembolism associated with peripherally inserted central catheters: a systematic review and meta‐analysis. Lancet. 2013;382(9889):311–325. , , , et al.
- Infusion Nurses Society. Infusion nursing standards of practice. J Infus Nurs. 2006;29(1 suppl):S1–S92.
- Guidelines for the prevention of intravascular catheter‐related infections. Am J Infect Control. 2011;39(4 suppl 1):S1–S34. , , , et al.
- International evidence‐based recommendations on ultrasound‐guided vascular access. Intensive Care Med. 2012;38(7):1105–1117. , , , et al.
- A single institution experience of seven hundred consecutively placed peripherally inserted central venous catheters. J Vasc Access. 2014;15(6):498–502. , , .
- Central venous access devices site care practices: an international survey of 34 countries [published online September 3, 2015]. J Vasc Access. doi: 10.5301/jva.5000450 , , .
- American Society of Nephrology. World's Leading Kidney Society Joins Effort to Reduce Unnecessary Medical Tests and Procedures. Available at: https://www.asn‐online.org/policy/choosingwisely/PressReleaseChoosingWisely.pdf. Accessed September 4, 2015.
- A survey of the current use of peripherally inserted central venous catheter (PICC) in Swedish oncology departments. Acta Oncol. 2013;52(6):1241–1242. , , , .
- Nurse‐led PICC insertion: is it cost effective? Br J Nurs. 2013;22(19):S9–S15. , .
- Hospitalist experiences, practice, opinions, and knowledge regarding peripherally inserted central catheters: a Michigan survey. J Hosp Med. 2013;8(6):309–314. , , , et al.
© 2015 Society of Hospital Medicine
Evaluating an Academic Hospitalist Service
Improving quality while reducing costs remains important for hospitals across the United States, including the approximately 150 hospitals that are part of the Veterans Affairs (VA) healthcare system.[1, 2] The field of hospital medicine has grown rapidly, leading to predictions that the majority of inpatient care in the United States eventually will be delivered by hospitalists.[3, 4] In 2010, 57% of US hospitals had hospitalists on staff, including 87% of hospitals with 200 beds,[5] and nearly 80% of VA hospitals.[6]
The demand for hospitalists within teaching hospitals has grown in part as a response to the mandate to reduce residency work hours.[7] Furthermore, previous research has found that hospitalist care is associated with modest reductions in length of stay (LOS) and weak but inconsistent differences in quality.[8] The educational effect of hospitalists has been far less examined. The limited number of studies published to date suggests that hospitalists may improve resident learning and house‐officer satisfaction in academic medical centers and community teaching hospitals[9, 10, 11] and provide positive experiences for medical students12,13; however, Wachter et al reported no significant changes in clinical outcomes or patient, faculty, and house‐staff satisfaction in a newly designed hospital medicine service in San Francisco.[14] Additionally, whether using hospitalists influences nurse‐physician communication[15] is unknown.
Recognizing the limited and sometimes conflicting evidence about the hospitalist model, we report the results of a 3‐year quasi‐experimental evaluation of the experience at our medical center with academic hospitalists. As part of a VA Systems Redesign Improvement Capability Grantknown as the Hospital Outcomes Program of Excellence (HOPE) Initiativewe created a hospitalist‐based medicine team focused on quality improvement, medical education, and patient outcomes.
METHODS
Setting and Design
The main hospital of the VA Ann Arbor Healthcare System, located in Ann Arbor, Michigan, operates 105 acute‐care beds and 40 extended‐care beds. At the time of this evaluation, the medicine service consisted of 4 internal medicine teamsGold, Silver, Burgundy, and Yelloweach of which was responsible for admitting patients on a rotating basis every fourth day, with limited numbers of admissions occurring between each team's primary admitting day. Each team is led by an attending physician, a board‐certified (or board‐eligible) general internist or subspecialist who is also a faculty member at the University of Michigan Medical School. Each team has a senior medical resident, 2 to 3 interns, and 3 to 5 medical students (mostly third‐year students). In total, there are approximately 50 senior medical residents, 60 interns, and 170 medical students who rotate through the medicine service each year. Traditional rounding involves the medical students and interns receiving sign‐out from the overnight team in the morning, then pre‐rounding on each patient by obtaining an interval history, performing an exam, and checking any test results. A tentative plan of care is formed with the senior medical resident, usually by discussing each patient very quickly in the team room. Attending rounds are then conducted, with the physician team visiting each patient one by one to review and plan all aspects of care in detail. When time allows, small segments of teaching may occur during these attending work rounds. This system had been in place for >20 years.
Resulting in part from a grant received from the VA Systems Redesign Central Office (ie, the HOPE Initiative), the Gold team was modified in July 2009 and an academic hospitalist (S.S.) was assigned to head this team. Specific hospitalists were selected by the Associate Chief of Medicine (S.S.) and the Chief of Medicine (R.H.M.) to serve as Gold team attendings on a regular basis. The other teams continued to be overseen by the Chief of Medicine, and the Gold team remained within the medicine service. Characteristics of the Gold and nonGold team attendings can be found in Table 1. The 3 other teams initially were noninterventional concurrent control groups. However, during the second year of the evaluation, the Silver team adopted some of the initiatives as a result of the preliminary findings observed on Gold. Specifically, in the second year of the evaluation, approximately 42% of attendings on the Silver team were from the Gold team. This increased in the third year to 67% of coverage by Gold team attendings on the Silver team. The evaluation of the Gold team ended in June 2012.
Characteristic | Gold Team | Non‐Gold Teams |
---|---|---|
Total number of attendings | 14 | 57 |
Sex, % | ||
Male | 79 | 58 |
Female | 21 | 42 |
Median years postresidency (range) | 10 (130) | 7 (141) |
Subspecialists, % | 14 | 40 |
Median days on service per year (range) | 53 (574) | 30 (592) |
The clinical interventions implemented on the Gold team were quality‐improvement work and were therefore exempt from institutional review board review. Human subjects' approval was, however, received to conduct interviews as part of a qualitative assessment.
Clinical Interventions
Several interventions involving the clinical care delivered were introduced on the Gold team, with a focus on improving communication among healthcare workers (Table 2).
Clinical Interventions | Educational Interventions |
---|---|
Modified structure of attending rounds | Modified structure of attending rounds |
Circle of Concern rounds | Attending reading list |
Clinical Care Coordinator | Nifty Fifty reading list for learners |
Regular attending team meetings | Website to provide expectations to learners |
Two‐month per year commitment by attendings |
Structure of Attending Rounds
The structure of morning rounds was modified on the Gold team. Similar to the traditional structure, medical students and interns on the Gold team receive sign‐out from the overnight team in the morning. However, interns and students may or may not conduct pre‐rounds on each patient. The majority of time between sign‐out and the arrival of the attending physician is spent on work rounds. The senior resident leads rounds with the interns and students, discussing each patient while focusing on overnight events and current symptoms, new physical‐examination findings, and laboratory and test data. The plan of care to be presented to the attending is then formulated with the senior resident. The attending physician then leads Circle of Concern rounds with an expanded team, including a charge nurse, a clinical pharmacist, and a nurse Clinical Care Coordinator. Attending rounds tend to use an E‐AP format: significant Events overnight are discussed, followed by an Assessment & Plan by problem for the top active problems. Using this model, the attendings are able to focus more on teaching and discussing the patient plan than in the traditional model (in which the learner presents the details of the subjective, objective, laboratory, and radiographic data, with limited time left for the assessment and plan for each problem).
Circle of Concern Rounds
Suzanne Gordon described the Circle of Concern in her book Nursing Against the Odds.[16] From her observations, she noted that physicians typically form a circle to discuss patient care during rounds. The circle expands when another physician joins the group; however, the circle does not similarly expand to include nurses when they approach the group. Instead, nurses typically remain on the periphery, listening silently or trying to communicate to physicians' backs.[16] Thus, to promote nurse‐physician communication, Circle of Concern rounds were formally introduced on the Gold team. Each morning, the charge nurse rounds with the team and is encouraged to bring up nursing concerns. The inpatient clinical pharmacist is also included 2 to 3 times per week to help provide education to residents and students and perform medication reconciliation.
Clinical Care Coordinator
The role of the nurse Clinical Care Coordinatoralso introduced on the Gold teamis to provide continuity of patient care, facilitate interdisciplinary communication, facilitate patient discharge, ensure appropriate appointments are scheduled, communicate with the ambulatory care service to ensure proper transition between inpatient and outpatient care, and help educate residents and students on VA procedures and resources.
Regular Gold Team Meetings
All Gold team attendings are expected to dedicate 2 months per year to inpatient service (divided into half‐month blocks), instead of the average 1 month per year for attendings on the other teams. The Gold team attendings, unlike the other teams, also attend bimonthly meetings to discuss strategies for running the team.
Educational Interventions
Given the high number of learners on the medicine service, we wanted to enhance the educational experience for our learners. We thus implemented various interventions, in addition to the change in the structure of rounds, as described below.
Reading List for Learners: The Nifty Fifty
Because reading about clinical medicine is an integral part of medical education, we make explicit our expectation that residents and students read something clinically relevant every day. To promote this, we have provided a Nifty Fifty reading list of key articles. The PDF of each article is provided, along with a brief summary highlighting key points.
Reading List for Gold Attendings and Support Staff
To promote a common understanding of leadership techniques, management books are provided to Gold attending physicians and other members of the team (eg, Care Coordinator, nurse researcher, systems redesign engineer). One book is discussed at each Gold team meeting (Table 3), with participants taking turns leading the discussion.
Book Title | Author(s) |
---|---|
The One Minute Manager | Ken Blanchard and Spencer Johnson |
Good to Great | Jim Collins |
Good to Great and the Social Sectors | Jim Collins |
The Checklist Manifesto: How to Get Things Right | Atul Gawande |
The Five Dysfunctions of a Team: A Leadership Fable | Patrick Lencioni |
Getting to Yes: Negotiating Agreement Without Giving In | Roger Fisher, William Ury, and Bruce Patton |
The Effective Executive: The Definitive Guide to Getting the Right Things Done | Peter Drucker |
A Sense of Urgency | John Kotter |
The Power of Positive Deviance: How Unlikely Innovators Solve the World's Toughest Problems | Richard Pascale, Jerry Sternin, and Monique Sternin |
On the Mend: Revolutionizing Healthcare to Save Lives and Transform the Industry | John Toussaint and Roger Gerard |
Outliers: The Story of Success | Malcolm Gladwell |
Nursing Against the Odds: How Health Care Cost Cutting, Media Stereotypes, and Medical Hubris Undermine Nurses and Patient Care | Suzanne Gordon |
How the Mighty Fall and Why Some Companies Never Give In | Jim Collins |
What the Best College Teachers Do | Ken Bain |
The Creative Destruction of Medicine | Eric Topol |
What Got You Here Won't Get You There: How Successful People Become Even More Successful! | Marshall Goldsmith |
Website
A HOPE Initiative website was created (
Qualitative Assessment
To evaluate our efforts, we conducted a thorough qualitative assessment during the third year of the program. A total of 35 semistructured qualitative interviews were conducted with patients and staff from all levels of the organization, including senior leadership. The qualitative assessment was led by research staff from the Center for Clinical Management Research, who were minimally involved in the redesign effort and could provide an unbiased view of the initiative. Field notes from the semistructured interviews were analyzed, with themes developed using a descriptive approach and through discussion by a multidisciplinary team, which included building team consensus on findings that were supported by clear evidence in the data.[17]
Quantitative Outcome Measures
Clinical Outcomes
To determine if our communication and educational interventions had an impact on patient care, we used hospital administrative data to evaluate admission rates, LOS, and readmission rates for all 4 of the medicine teams. Additional clinical measures were assessed as needed. For example, we monitored the impact of the clinical pharmacist during a 4‐week pilot study by asking the Clinical Care Coordinator to track the proportion of patient encounters (n=170) in which the clinical pharmacist changed management or provided education to team members. Additionally, 2 staff surveys were conducted. The first survey focused on healthcare‐worker communication and was given to inpatient nurses and physicians (including attendings, residents, and medical students) who were recently on an inpatient medical service rotation. The survey included questions from previously validated communication measures,[18, 19, 20] as well as study‐specific questions. The second survey evaluated the new role of the Clinical Care Coordinator (Appendix). Both physicians and nurses who interacted with the Gold team's Clinical Care Coordinator were asked to complete this survey.
Educational Outcomes
To assess the educational interventions, we used learner evaluations of attendings, by both residents and medical students, and standardized internal medicine National Board of Medical Examiners Subject Examination (or shelf) scores for third‐year medical students. A separate evaluation of medical student perceptions of the rounding structure introduced on the Gold team using survey design has already been published.[21]
Statistical Analyses
Data from all sources were analyzed using SAS 9.3 (SAS Institute, Inc., Cary, NC). Outliers for the LOS variable were removed from the analysis. Means and frequency distributions were examined for all variables. Student t tests and [2] tests of independence were used to compare data between groups. Multivariable linear regression models controlling for time (preintervention vs postintervention) were used to assess the effect of the HOPE Initiative on patient LOS and readmission rates. In all cases, 2‐tailed P values of 0.05 or less were considered statistically significant.
Role of the Funding Source
The VA Office of Systems Redesign provided funding but was not involved in the design or conduct of the study, data analysis, or preparation of the manuscript.
RESULTS
Clinical Outcomes
Patient Outcomes
Our multivariable linear regression analysis, controlling for time, showed a significant reduction in LOS of approximately 0.3 days on all teams after the HOPE Initiative began (P=0.004). There were no significant differences between the Gold and non‐Gold teams in the multivariate models when controlling for time for any of the patient‐outcome measures. The number of admissions increased for all 4 medical teams (Figure 1), but, as shown in Figures 2 and 3, the readmission rates for all teams remained relatively stable over this same period of time.
Clinical Pharmacist on Gold Team Rounds
The inpatient clinical pharmacist changed the management plan for 22% of the patients seen on rounds. Contributions from the clinical pharmacist included adjusting the dosing of ordered medication and correcting medication reconciliation. Education and pharmaceutical information was provided to the team in another 6% of the 170 consecutive patient encounters evaluated.
Perception of Circle of Concern Rounds
Circle of Concern rounds were generally well‐received by both nurses and physicians. In a healthcare‐worker communication survey, completed by 38 physicians (62% response rate) and 48 nurses (54% response rate), the majority of both physicians (83%) and nurses (68%) felt Circle of Concern rounds improved communication.
Nurse Perception of Communication
The healthcare‐worker communication survey asked inpatient nurses to rate communication between nurses and physicians on each of the 4 medicine teams. Significantly more nurses were satisfied with communication with the Gold team (71%) compared with the other 3 medicine teams (53%; P=0.02) (Figure 4).
Perception of the Clinical Care Coordinator
In total, 20 physicians (87% response rate) and 10 nurses (56% response rate) completed the Clinical Care Coordinator survey. The physician results were overwhelmingly positive: 100% were satisfied or very satisfied with the role; 100% felt each team should have a Clinical Care Coordinator; and 100% agreed or strongly agreed that the Clinical Care Coordinator ensures that appropriate follow‐up is arranged, provides continuity of care, assists with interdisciplinary communication, and helps facilitate discharge. The majority of nurses was also satisfied or very satisfied with the Clinical Care Coordinator role and felt each team should have one.
Educational Outcomes
House Officer Evaluation of Attendings
Monthly evaluations of attending physicians by house officers (Figure 5) revealed that prior to the HOPE Initiative, little differences were observed between teams, as would be expected because attending assignment was largely random. After the intervention date of July 2009, however, significant differences were noted, with Gold team attendings receiving significantly higher teaching evaluations immediately after the introduction of the HOPE Initiative. Although ratings for Gold attendings remained more favorable, the difference was no longer statistically significant in the second and third year of the initiative, likely due to Gold attendings serving on other medicine teams, which contributed to an improvement in ratings of all attendings.
Medical Student Evaluation of Attendings
Monthly evaluations of attending physicians by third‐year medical students (Figure 6) revealed differences between the Gold attendings and all others, with the attendings that joined the Gold team in 2009 receiving higher teaching evaluations even before the HOPE Initiative started. However, this difference remained statistically significant in years 2 and 3 postinitiative, despite the addition of 4 new junior attendings.
Medical Student Medicine Shelf Scores
The national average on the shelf exam, which reflects learning after the internal medicine third‐year clerkship, has ranged from 75 to 78 for the past several years, with University of Michigan students averaging significantly higher scores prior to and after the HOPE Initiative. However, following the HOPE Initiative, third‐year medical students on the Gold team scored significantly higher on the shelf exam compared with their colleagues on the non‐Gold teams (84 vs 82; P=0.006). This difference in the shelf exam scores, although small, is statistically significant. It represents a measurable improvement in shelf scores in our system and demonstrates the potential educational benefit for the students. Over this same time period, scores on the United States Medical Licensing Exam, given to medical students at the beginning of their third year, remained stable (233 preHOPE Initiative; 234 postHOPE Initiative).
Qualitative Assessment
Qualitative data collected as part of our evaluation of the HOPE Initiative also suggested that nurse‐physician communication had improved since the start of the project. In particular, they reported positively on the Gold team in general, the Circle of Concern rounds, and the Clinical Care Coordinator (Table 4).
Staff Type | Statement1 |
---|---|
| |
Nurse | [Gold is] above and beyond other [teams]. Other teams don't run as smoothly. |
Nurse | There has been a difference in communication [on Gold]. You can tell the difference in how they communicate with staff. We know the Clinical Care Coordinator or charge nurse is rounding with that team, so there is more communication. |
Nurse | The most important thing that has improved communication is the Circle of Concern rounds. |
Physician | [The Gold Clinical Care Coordinator] expedites care, not only what to do but who to call. She can convey the urgency. On rounds she is able to break off, put in an order, place a call, talk to a patient. Things that we would do at 11 AM she gets to at 9 AM. A couple of hours may not seem like much, but sometimes it can make the difference between things happening that day instead of the next. |
Physician | The Clinical Care Coordinator is completely indispensable. Major benefit to providing care to Veterans. |
Physician | I like to think Gold has lifted all of the teams to a higher level. |
Medical student | It may be due to personalities vs the Gold [team] itself, but there is more emphasis on best practices. Are we following guidelines even if it is not related to the primary reason for admission? |
Medical student | Gold is very collegial and nurses/physicians know one another by name. Physicians request rather than order; this sets a good example to me on how to approach the nurses. |
Chief resident | [Gold attendings] encourage senior residents to take charge and run the team, although the attending is there for back‐up and support. This provides great learning for the residents. Interns and medical students also are affected because they have to step up their game as well. |
DISCUSSION
Within academic medical centers, hospitalists are expected to care for patients, teach, and help improve the quality and efficiency of hospital‐based care.[7] The Department of Veterans Affairs runs the largest integrated healthcare system in the United States, with approximately 80% of VA hospitals having hospital medicine programs. Overall, one‐third of US residents perform part of their residency training at a VA hospital.[22, 23] Thus, the effects of a system‐wide change at a VA hospital may have implications throughout the country. We studied one such intervention. Our primary findings are that we were able to improve communication and learner education with minimal effects on patient outcomes. While overall LOS decreased slightly postintervention, after taking into account secular trends, readmission rates did not.
We are not the first to evaluate a hospital medicine team using a quasi‐experimental design. For example, Meltzer and colleagues evaluated a hospitalist program at the University of Chicago Medical Center and found that, by the second year of operation, hospitalist care was associated with significantly shorter LOS (0.49 days), reduced costs, and decreased mortality.[24] Auerbach also evaluated a newly created hospital medicine service, finding decreased LOS (0.61 days), lower costs, and lower risk of mortality by the second year of the program.[25]
Improving nurse‐physician communication is considered important for avoiding medical error,[26] yet there has been limited empirical study of methods to improve communication within the medical profession.[27] Based both on our surveys and qualitative interviews, healthcare‐worker communication appeared to improve on the Gold team during the study. A key component of this improvement is likely related to instituting Circle of Concern rounds, in which nurses joined the medical team during attending rounds. Such an intervention likely helped to address organizational silence[28] and enhance the psychological safety of the nursing staff, because the attending physician was proactive about soliciting the input of nurses during rounds.[29] Such leader inclusivenesswords and deeds exhibited by leaders that invite and appreciate others' contributionscan aid interdisciplinary teams in overcoming the negative effects of status differences, thereby promoting collaboration.[29] The inclusion of nurses on rounds is also relationship‐building, which Gotlib Conn and colleagues found was important to improved interprofessional communication and collaboration.[30] In the future, using a tool such as the Teamwork Effectiveness Assessment Module (TEAM) developed by the American Board of Internal Medicine[31] could provide further evaluation of the impact on interprofessional teamwork and communication.
The focus on learner education, though evaluated in prior studies, is also novel. One previous survey of medical students showed that engaging students in substantive discussions is associated with greater student satisfaction.[32] Another survey of medical students found that attendings who were enthusiastic about teaching, inspired confidence in knowledge and skills, provided useful feedback, and encouraged increased student responsibility were viewed as more effective teachers.[33] No previous study that we are aware of, however, has looked at actual educational outcomes, such as shelf scores. The National Board of Medical Examiners reports that the Medicine subject exam is scaled to have a mean of 70 and a standard deviation of 8.[34] Thus, a mean increase in score of 2 points is small, but not trivial. This shows improvement in a hard educational outcome. Additionally, 2 points, although small in the context of total score and standard deviation, may make a substantial difference to an individual student in terms of overall grade, and, thus, residency applications. Our finding that third‐year medical students on the Gold team performed significantly better than University of Michigan third‐year medical students on other teams is an intriguing finding that warrants confirmation. On the other hand, this finding is consistent with a previous report evaluating learner satisfaction in which Bodnar et al found improved ratings of quantity and quality of teaching on teams with a nontraditional structure (Gold team).[21] Moreover, despite relatively few studies, the reason underlying the educational benefit of hospitalists should surprise few. The hospitalist model ensures that learners are supervised by physicians who are experts in the care of hospitalized patients.[35] Hospitalists hired at teaching hospitals to work on services with learners are generally chosen because they possess superior educational skills.[7]
Our findings should be interpreted in the context of the following limitations. First, our study focused on a single academically affiliated VA hospital. As other VA hospitals are pursuing a similar approach (eg, the Houston and Detroit VA medical centers), replicating our results will be important. Second, the VA system, although the largest integrated healthcare system in the United States, has unique characteristicssuch as an integrated electronic health record and predominantly male patient populationthat may make generalizations to the larger US healthcare system challenging. Third, there was a slightly lower response rate among nurses on a few of the surveys to evaluate our efforts; however, this rate of response is standard at our facility. Finally, our evaluation lacks an empirical measure of healthcare‐worker communication, such as incident reports.
Despite these limitations, our results have important implications. Using both quantitative and qualitative assessment, we found that academic hospitalists have the ability to improve healthcare‐worker communication and enhance learner education without increasing LOS. These findings are directly applicable to VA medical centers and potentially applicable to other academic medical centers.
Acknowledgments
The authors thank Milisa Manojlovich, PhD, RN, Edward Kennedy, MS, and Andrew Hickner, MSI, for help with preparation of this manuscript.
Disclosures: This work was funded by a US Department of Veterans Affairs, Office of Systems Redesign Improvement Capability grant. The findings and conclusions in this report are those of the authors and do not necessarily represent the position or policy of the Department of Veterans Affairs. Dr. Saint reports receiving travel reimbursement for giving invited talks at the Society of Hospital Medicine's National Meeting, as well as serving on the advisory boards of Doximity and Jvion.
APPENDIX
Survey to Evaluate the Care Coordinator Position
Yes | No | Not Sure | |
Q1. Are you familiar with the role of the Care Coordinator on the Gold Service (Susan Lee)? | 1 | 2 | 3 |
Please indicate how much you agree or disagree with the statements below.
Strongly Agree | Agree | Neutral | Disagree | Strongly Disagree | Don't Know | |
Q2. The Care Coordinator ensures that appropriate primary care follow‐up and any other appropriate services are arranged. | 1 | 2 | 3 | 4 | 5 | 9 |
Q3. The Care Coordinator provides continuity of patient care on the Gold Service. | 1 | 2 | 3 | 4 | 5 | 9 |
Q4. The Care Coordinator helps educate House Officers and Medical Students on VA processes (e.g., CPRS). | 1 | 2 | 3 | 4 | 5 | 9 |
Q5. The Care Coordinator assists with interdisciplinary communication between the medical team and other services (e.g., nursing, ambulatory care, pharmacy, social work) | 1 | 2 | 3 | 4 | 5 | 9 |
Q6. The Care Coordinator helps facilitate patient discharge. | 1 | 2 | 3 | 4 | 5 | 9 |
Q7. The Care Coordinator initiates communication with the ambulatory care teams to coordinate care. | 1 | 2 | 3 | 4 | 5 | 9 |
Yes | No | |
Q8. Are you a physician (attending or resident), or medical student who has been on more than one medical team at the VA (Gold, Silver, Burgundy, or Yellow)? | 1 | 2 |
If no, please skip to Q13
If yes, comparing your experience on the Gold Service (with the Care Coordinator) to your experience on any of the other services (Silver, Burgundy, or Yellow):
Not at All | Very Little | Somewhat | To a Great Extent | |
Q9. To what extent does the presence of a Care Coordinator affect patient care? | 1 | 2 | 3 | 4 |
Q10. To what extent does the presence of a Care Coordinator improve patient flow? | 1 | 2 | 3 | 4 |
Q11. To what extent does the presence of a Care Coordinator assist with education? | 1 | 2 | 3 | 4 |
Q12. To what extent does the presence of a Care Coordinator contribute to attending rounds? | 1 | 2 | 3 | 4 |
Yes | No | |
Q13. Do you work [as a nurse] in ambulatory care? | 1 | 2 |
If no, please skip to Q17.
If yes, comparing your experience with the Gold Service (with the Care Coordinator) to the other services (Silver, Burgundy, or Yellow):
Not at All | Very Little | Somewhat | To a Great Extent | |
Q14. To what extent does the presence of a Care Coordinator improve coordination of care between inpatient and outpatient services? | 1 | 2 | 3 | 4 |
Q15. To what extent does the presence of a Care Coordinator help identify high risk patients who require follow‐up? | 1 | 2 | 3 | 4 |
Q16. To what extent does the presence of a Care Coordinator ensure follow‐up appointments are scheduled? | 1 | 2 | 3 | 4 |
Yes | No | Not Sure | |
Q17. Do you think each medical team should have a Care Coordinator? | 1 | 2 | 3 |
Q18. Are there any additional tasks or duties you think would improve the effectiveness of the Care Coordinator? |
Very Satisfied | Satisfied | Neutral | Dissatisfied | Very Dissatisfied | |
Q19. Overall how satisfied are you with the role of the Care Coordinator on the Gold Service? | 1 | 2 | 3 | 4 | 5 |
Q20. Do you have any other comments about the role of the Care Coordinator? |
Q21. What is your position? |
1. Physician (attending or resident) or medical student |
2. Nurse (inpatient or ambulatory care) |
- Kohn LT, Corrigan JM, Donaldson MS, eds. To Err Is Human: Building a Safer Health System. Washington, D.C.: National Academies Press; 2000.
- Institute of Medicine of the National Academies. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, D.C.: National Academies Press; 2001.
- Growth in the care of older patients by hospitalists in the United States. N Engl J Med. 2009;360(11):1102–1112. , , , .
- Growth in care provided by hospitalists. N Engl J Med. 2009;360(26):2789–2791. .
- American Hospital Association. AHA Annual Survey of Hospitals, 2010. Chicago, IL: Health Forum, LLC; 2010.
- Preventing hospital‐acquired infections: a national survey of practices reported by U.S. hospitals in 2005 and 2009. J Gen Intern Med. 2012;27(7):773–779. , , , .
- Hospitalists in teaching hospitals: opportunities but not without danger. J Gen Intern Med. 2004;19(4):392–393. , .
- Do hospitalist physicians improve the quality of inpatient care delivery? A systematic review of process, efficiency and outcome measures. BMC Med. 2011;9:58. , .
- Effect of hospitalist attending physicians on trainee educational experiences: a systematic review. J Hosp Med. 2009;4(8):490–498. , , , .
- Resident satisfaction on an academic hospitalist service: time to teach. Am J Med. 2002;112(7):597–601. , , , , , .
- The positive impact of initiation of hospitalist clinician educators. J Gen Intern Med. 2004;19(4):293–301. , , , et al.
- Third‐year medical students' evaluation of hospitalist and nonhospitalist faculty during the inpatient portion of their pediatrics clerkships. J Hosp Med. 2007;2(1):17–22. , .
- Medical student evaluation of the quality of hospitalist and nonhospitalist teaching faculty on inpatient medicine rotations. Acad Med. 2004;79(1):78–82. , , , .
- Reorganizing an academic medical service: impact on cost, quality, patient satisfaction, and education. JAMA. 1998;279(19):1560–1565. , , , , .
- Nurse/physician communication through a sensemaking lens: shifting the paradigm to improve patient safety. Med Care. 2010;48(11):941–946. .
- Nursing Against the Odds: How Health Care Cost Cutting, Media Stereotypes, and Medical Hubris Undermine Nurses and Patient Care. Ithaca, NY: Cornell University Press; 2005. .
- Focus on research methods: whatever happened to qualitative description? Res Nurs Health. 2000;23:334–340. .
- Organizational assessment in intensive care units (ICUs): construct development, reliability, and validity of the ICU nurse‐physician questionnaire. Med Care. 1991;29(8):709–726. , , , , .
- Development of an instrument to measure collaboration and satisfaction about care decisions. J Adv Nurs. 1994;20(1):176–182. .
- Development of the practice environment scale of the Nursing Work Index. Res Nurs Health. 2002;25(3):176–188. .
- Does the structure of inpatient rounds affect medical student education? Int J Med Educ. 2013;4:96–100. , , .
- U.S. Department of Veterans Affairs, Office of Academic Affiliations. Medical and Dental Education Program. Available at: http://www.va. gov/oaa/GME_default.asp. Published 2012. Accessed May 08, 2013.
- Graduate medical education, 2011–2012. JAMA. 2012;308(21):2264–2279. , .
- Effects of physician experience on costs and outcomes on an academic general medicine service: results of a trial of hospitalists. Ann Intern Med. 2002;137(11):866–874. , , , et al.
- Implementation of a voluntary hospitalist service at a community teaching hospital: improved clinical efficiency and patient outcomes. Ann Intern Med. 2002;137(11):859–865. , , , , , .
- Communication failures: an insidious contributor to medical mishaps. Acad Med. 2004;79(2):186–194. , , .
- ‘It depends': medical residents' perspectives on working with nurses. Am J Nurs. 2009;109(7):34–44. , , .
- Organizational silence: a barrier to change and development in a pluralistic world. Acad Manage Rev. 2000;25(4):706–725. , .
- Making it safe: the effects of leader inclusiveness and professional status on psychological safety and improvement efforts in health care teams. J Organiz Behav. 2006;27:941–966. , .
- Interprofessional communication with hospitalist and consultant physicians in general internal medicine: a qualitative study. BMC Health Serv Res. 2012;12:437. , , , , .
- A new tool to give hospitalists feedback to improve interprofessional teamwork and advance patient care. Health Aff (Millwood). 2012;31(11):2485–2492. , , , , , .
- Impact of instructional practices on student satisfaction with attendings' teaching in the inpatient component of internal medicine clerkships. J Gen Intern Med. 2006;21(1):7–12. , , , , , .
- Medical students' perceptions of the elements of effective inpatient teaching by attending physicians and housestaff. J Gen Intern Med. 2005;20(7):635–639. , .
- National Board of Medical Examiners Subject Examination Program. Internal Medicine Advanced Clinical Examination, score interpretation guide. Available at: http://www.nbme.org/PDF/SampleScoreReports/Internal_Medicine_ACE_Score_Report.pdf. Published 2011. Accessed September 13, 2013.
- The impact of hospitalists on medical education and the academic health system. Ann Intern Med. 1999;130(4 part 2):364–367. .
Improving quality while reducing costs remains important for hospitals across the United States, including the approximately 150 hospitals that are part of the Veterans Affairs (VA) healthcare system.[1, 2] The field of hospital medicine has grown rapidly, leading to predictions that the majority of inpatient care in the United States eventually will be delivered by hospitalists.[3, 4] In 2010, 57% of US hospitals had hospitalists on staff, including 87% of hospitals with 200 beds,[5] and nearly 80% of VA hospitals.[6]
The demand for hospitalists within teaching hospitals has grown in part as a response to the mandate to reduce residency work hours.[7] Furthermore, previous research has found that hospitalist care is associated with modest reductions in length of stay (LOS) and weak but inconsistent differences in quality.[8] The educational effect of hospitalists has been far less examined. The limited number of studies published to date suggests that hospitalists may improve resident learning and house‐officer satisfaction in academic medical centers and community teaching hospitals[9, 10, 11] and provide positive experiences for medical students12,13; however, Wachter et al reported no significant changes in clinical outcomes or patient, faculty, and house‐staff satisfaction in a newly designed hospital medicine service in San Francisco.[14] Additionally, whether using hospitalists influences nurse‐physician communication[15] is unknown.
Recognizing the limited and sometimes conflicting evidence about the hospitalist model, we report the results of a 3‐year quasi‐experimental evaluation of the experience at our medical center with academic hospitalists. As part of a VA Systems Redesign Improvement Capability Grantknown as the Hospital Outcomes Program of Excellence (HOPE) Initiativewe created a hospitalist‐based medicine team focused on quality improvement, medical education, and patient outcomes.
METHODS
Setting and Design
The main hospital of the VA Ann Arbor Healthcare System, located in Ann Arbor, Michigan, operates 105 acute‐care beds and 40 extended‐care beds. At the time of this evaluation, the medicine service consisted of 4 internal medicine teamsGold, Silver, Burgundy, and Yelloweach of which was responsible for admitting patients on a rotating basis every fourth day, with limited numbers of admissions occurring between each team's primary admitting day. Each team is led by an attending physician, a board‐certified (or board‐eligible) general internist or subspecialist who is also a faculty member at the University of Michigan Medical School. Each team has a senior medical resident, 2 to 3 interns, and 3 to 5 medical students (mostly third‐year students). In total, there are approximately 50 senior medical residents, 60 interns, and 170 medical students who rotate through the medicine service each year. Traditional rounding involves the medical students and interns receiving sign‐out from the overnight team in the morning, then pre‐rounding on each patient by obtaining an interval history, performing an exam, and checking any test results. A tentative plan of care is formed with the senior medical resident, usually by discussing each patient very quickly in the team room. Attending rounds are then conducted, with the physician team visiting each patient one by one to review and plan all aspects of care in detail. When time allows, small segments of teaching may occur during these attending work rounds. This system had been in place for >20 years.
Resulting in part from a grant received from the VA Systems Redesign Central Office (ie, the HOPE Initiative), the Gold team was modified in July 2009 and an academic hospitalist (S.S.) was assigned to head this team. Specific hospitalists were selected by the Associate Chief of Medicine (S.S.) and the Chief of Medicine (R.H.M.) to serve as Gold team attendings on a regular basis. The other teams continued to be overseen by the Chief of Medicine, and the Gold team remained within the medicine service. Characteristics of the Gold and nonGold team attendings can be found in Table 1. The 3 other teams initially were noninterventional concurrent control groups. However, during the second year of the evaluation, the Silver team adopted some of the initiatives as a result of the preliminary findings observed on Gold. Specifically, in the second year of the evaluation, approximately 42% of attendings on the Silver team were from the Gold team. This increased in the third year to 67% of coverage by Gold team attendings on the Silver team. The evaluation of the Gold team ended in June 2012.
Characteristic | Gold Team | Non‐Gold Teams |
---|---|---|
Total number of attendings | 14 | 57 |
Sex, % | ||
Male | 79 | 58 |
Female | 21 | 42 |
Median years postresidency (range) | 10 (130) | 7 (141) |
Subspecialists, % | 14 | 40 |
Median days on service per year (range) | 53 (574) | 30 (592) |
The clinical interventions implemented on the Gold team were quality‐improvement work and were therefore exempt from institutional review board review. Human subjects' approval was, however, received to conduct interviews as part of a qualitative assessment.
Clinical Interventions
Several interventions involving the clinical care delivered were introduced on the Gold team, with a focus on improving communication among healthcare workers (Table 2).
Clinical Interventions | Educational Interventions |
---|---|
Modified structure of attending rounds | Modified structure of attending rounds |
Circle of Concern rounds | Attending reading list |
Clinical Care Coordinator | Nifty Fifty reading list for learners |
Regular attending team meetings | Website to provide expectations to learners |
Two‐month per year commitment by attendings |
Structure of Attending Rounds
The structure of morning rounds was modified on the Gold team. Similar to the traditional structure, medical students and interns on the Gold team receive sign‐out from the overnight team in the morning. However, interns and students may or may not conduct pre‐rounds on each patient. The majority of time between sign‐out and the arrival of the attending physician is spent on work rounds. The senior resident leads rounds with the interns and students, discussing each patient while focusing on overnight events and current symptoms, new physical‐examination findings, and laboratory and test data. The plan of care to be presented to the attending is then formulated with the senior resident. The attending physician then leads Circle of Concern rounds with an expanded team, including a charge nurse, a clinical pharmacist, and a nurse Clinical Care Coordinator. Attending rounds tend to use an E‐AP format: significant Events overnight are discussed, followed by an Assessment & Plan by problem for the top active problems. Using this model, the attendings are able to focus more on teaching and discussing the patient plan than in the traditional model (in which the learner presents the details of the subjective, objective, laboratory, and radiographic data, with limited time left for the assessment and plan for each problem).
Circle of Concern Rounds
Suzanne Gordon described the Circle of Concern in her book Nursing Against the Odds.[16] From her observations, she noted that physicians typically form a circle to discuss patient care during rounds. The circle expands when another physician joins the group; however, the circle does not similarly expand to include nurses when they approach the group. Instead, nurses typically remain on the periphery, listening silently or trying to communicate to physicians' backs.[16] Thus, to promote nurse‐physician communication, Circle of Concern rounds were formally introduced on the Gold team. Each morning, the charge nurse rounds with the team and is encouraged to bring up nursing concerns. The inpatient clinical pharmacist is also included 2 to 3 times per week to help provide education to residents and students and perform medication reconciliation.
Clinical Care Coordinator
The role of the nurse Clinical Care Coordinatoralso introduced on the Gold teamis to provide continuity of patient care, facilitate interdisciplinary communication, facilitate patient discharge, ensure appropriate appointments are scheduled, communicate with the ambulatory care service to ensure proper transition between inpatient and outpatient care, and help educate residents and students on VA procedures and resources.
Regular Gold Team Meetings
All Gold team attendings are expected to dedicate 2 months per year to inpatient service (divided into half‐month blocks), instead of the average 1 month per year for attendings on the other teams. The Gold team attendings, unlike the other teams, also attend bimonthly meetings to discuss strategies for running the team.
Educational Interventions
Given the high number of learners on the medicine service, we wanted to enhance the educational experience for our learners. We thus implemented various interventions, in addition to the change in the structure of rounds, as described below.
Reading List for Learners: The Nifty Fifty
Because reading about clinical medicine is an integral part of medical education, we make explicit our expectation that residents and students read something clinically relevant every day. To promote this, we have provided a Nifty Fifty reading list of key articles. The PDF of each article is provided, along with a brief summary highlighting key points.
Reading List for Gold Attendings and Support Staff
To promote a common understanding of leadership techniques, management books are provided to Gold attending physicians and other members of the team (eg, Care Coordinator, nurse researcher, systems redesign engineer). One book is discussed at each Gold team meeting (Table 3), with participants taking turns leading the discussion.
Book Title | Author(s) |
---|---|
The One Minute Manager | Ken Blanchard and Spencer Johnson |
Good to Great | Jim Collins |
Good to Great and the Social Sectors | Jim Collins |
The Checklist Manifesto: How to Get Things Right | Atul Gawande |
The Five Dysfunctions of a Team: A Leadership Fable | Patrick Lencioni |
Getting to Yes: Negotiating Agreement Without Giving In | Roger Fisher, William Ury, and Bruce Patton |
The Effective Executive: The Definitive Guide to Getting the Right Things Done | Peter Drucker |
A Sense of Urgency | John Kotter |
The Power of Positive Deviance: How Unlikely Innovators Solve the World's Toughest Problems | Richard Pascale, Jerry Sternin, and Monique Sternin |
On the Mend: Revolutionizing Healthcare to Save Lives and Transform the Industry | John Toussaint and Roger Gerard |
Outliers: The Story of Success | Malcolm Gladwell |
Nursing Against the Odds: How Health Care Cost Cutting, Media Stereotypes, and Medical Hubris Undermine Nurses and Patient Care | Suzanne Gordon |
How the Mighty Fall and Why Some Companies Never Give In | Jim Collins |
What the Best College Teachers Do | Ken Bain |
The Creative Destruction of Medicine | Eric Topol |
What Got You Here Won't Get You There: How Successful People Become Even More Successful! | Marshall Goldsmith |
Website
A HOPE Initiative website was created (
Qualitative Assessment
To evaluate our efforts, we conducted a thorough qualitative assessment during the third year of the program. A total of 35 semistructured qualitative interviews were conducted with patients and staff from all levels of the organization, including senior leadership. The qualitative assessment was led by research staff from the Center for Clinical Management Research, who were minimally involved in the redesign effort and could provide an unbiased view of the initiative. Field notes from the semistructured interviews were analyzed, with themes developed using a descriptive approach and through discussion by a multidisciplinary team, which included building team consensus on findings that were supported by clear evidence in the data.[17]
Quantitative Outcome Measures
Clinical Outcomes
To determine if our communication and educational interventions had an impact on patient care, we used hospital administrative data to evaluate admission rates, LOS, and readmission rates for all 4 of the medicine teams. Additional clinical measures were assessed as needed. For example, we monitored the impact of the clinical pharmacist during a 4‐week pilot study by asking the Clinical Care Coordinator to track the proportion of patient encounters (n=170) in which the clinical pharmacist changed management or provided education to team members. Additionally, 2 staff surveys were conducted. The first survey focused on healthcare‐worker communication and was given to inpatient nurses and physicians (including attendings, residents, and medical students) who were recently on an inpatient medical service rotation. The survey included questions from previously validated communication measures,[18, 19, 20] as well as study‐specific questions. The second survey evaluated the new role of the Clinical Care Coordinator (Appendix). Both physicians and nurses who interacted with the Gold team's Clinical Care Coordinator were asked to complete this survey.
Educational Outcomes
To assess the educational interventions, we used learner evaluations of attendings, by both residents and medical students, and standardized internal medicine National Board of Medical Examiners Subject Examination (or shelf) scores for third‐year medical students. A separate evaluation of medical student perceptions of the rounding structure introduced on the Gold team using survey design has already been published.[21]
Statistical Analyses
Data from all sources were analyzed using SAS 9.3 (SAS Institute, Inc., Cary, NC). Outliers for the LOS variable were removed from the analysis. Means and frequency distributions were examined for all variables. Student t tests and [2] tests of independence were used to compare data between groups. Multivariable linear regression models controlling for time (preintervention vs postintervention) were used to assess the effect of the HOPE Initiative on patient LOS and readmission rates. In all cases, 2‐tailed P values of 0.05 or less were considered statistically significant.
Role of the Funding Source
The VA Office of Systems Redesign provided funding but was not involved in the design or conduct of the study, data analysis, or preparation of the manuscript.
RESULTS
Clinical Outcomes
Patient Outcomes
Our multivariable linear regression analysis, controlling for time, showed a significant reduction in LOS of approximately 0.3 days on all teams after the HOPE Initiative began (P=0.004). There were no significant differences between the Gold and non‐Gold teams in the multivariate models when controlling for time for any of the patient‐outcome measures. The number of admissions increased for all 4 medical teams (Figure 1), but, as shown in Figures 2 and 3, the readmission rates for all teams remained relatively stable over this same period of time.
Clinical Pharmacist on Gold Team Rounds
The inpatient clinical pharmacist changed the management plan for 22% of the patients seen on rounds. Contributions from the clinical pharmacist included adjusting the dosing of ordered medication and correcting medication reconciliation. Education and pharmaceutical information was provided to the team in another 6% of the 170 consecutive patient encounters evaluated.
Perception of Circle of Concern Rounds
Circle of Concern rounds were generally well‐received by both nurses and physicians. In a healthcare‐worker communication survey, completed by 38 physicians (62% response rate) and 48 nurses (54% response rate), the majority of both physicians (83%) and nurses (68%) felt Circle of Concern rounds improved communication.
Nurse Perception of Communication
The healthcare‐worker communication survey asked inpatient nurses to rate communication between nurses and physicians on each of the 4 medicine teams. Significantly more nurses were satisfied with communication with the Gold team (71%) compared with the other 3 medicine teams (53%; P=0.02) (Figure 4).
Perception of the Clinical Care Coordinator
In total, 20 physicians (87% response rate) and 10 nurses (56% response rate) completed the Clinical Care Coordinator survey. The physician results were overwhelmingly positive: 100% were satisfied or very satisfied with the role; 100% felt each team should have a Clinical Care Coordinator; and 100% agreed or strongly agreed that the Clinical Care Coordinator ensures that appropriate follow‐up is arranged, provides continuity of care, assists with interdisciplinary communication, and helps facilitate discharge. The majority of nurses was also satisfied or very satisfied with the Clinical Care Coordinator role and felt each team should have one.
Educational Outcomes
House Officer Evaluation of Attendings
Monthly evaluations of attending physicians by house officers (Figure 5) revealed that prior to the HOPE Initiative, little differences were observed between teams, as would be expected because attending assignment was largely random. After the intervention date of July 2009, however, significant differences were noted, with Gold team attendings receiving significantly higher teaching evaluations immediately after the introduction of the HOPE Initiative. Although ratings for Gold attendings remained more favorable, the difference was no longer statistically significant in the second and third year of the initiative, likely due to Gold attendings serving on other medicine teams, which contributed to an improvement in ratings of all attendings.
Medical Student Evaluation of Attendings
Monthly evaluations of attending physicians by third‐year medical students (Figure 6) revealed differences between the Gold attendings and all others, with the attendings that joined the Gold team in 2009 receiving higher teaching evaluations even before the HOPE Initiative started. However, this difference remained statistically significant in years 2 and 3 postinitiative, despite the addition of 4 new junior attendings.
Medical Student Medicine Shelf Scores
The national average on the shelf exam, which reflects learning after the internal medicine third‐year clerkship, has ranged from 75 to 78 for the past several years, with University of Michigan students averaging significantly higher scores prior to and after the HOPE Initiative. However, following the HOPE Initiative, third‐year medical students on the Gold team scored significantly higher on the shelf exam compared with their colleagues on the non‐Gold teams (84 vs 82; P=0.006). This difference in the shelf exam scores, although small, is statistically significant. It represents a measurable improvement in shelf scores in our system and demonstrates the potential educational benefit for the students. Over this same time period, scores on the United States Medical Licensing Exam, given to medical students at the beginning of their third year, remained stable (233 preHOPE Initiative; 234 postHOPE Initiative).
Qualitative Assessment
Qualitative data collected as part of our evaluation of the HOPE Initiative also suggested that nurse‐physician communication had improved since the start of the project. In particular, they reported positively on the Gold team in general, the Circle of Concern rounds, and the Clinical Care Coordinator (Table 4).
Staff Type | Statement1 |
---|---|
| |
Nurse | [Gold is] above and beyond other [teams]. Other teams don't run as smoothly. |
Nurse | There has been a difference in communication [on Gold]. You can tell the difference in how they communicate with staff. We know the Clinical Care Coordinator or charge nurse is rounding with that team, so there is more communication. |
Nurse | The most important thing that has improved communication is the Circle of Concern rounds. |
Physician | [The Gold Clinical Care Coordinator] expedites care, not only what to do but who to call. She can convey the urgency. On rounds she is able to break off, put in an order, place a call, talk to a patient. Things that we would do at 11 AM she gets to at 9 AM. A couple of hours may not seem like much, but sometimes it can make the difference between things happening that day instead of the next. |
Physician | The Clinical Care Coordinator is completely indispensable. Major benefit to providing care to Veterans. |
Physician | I like to think Gold has lifted all of the teams to a higher level. |
Medical student | It may be due to personalities vs the Gold [team] itself, but there is more emphasis on best practices. Are we following guidelines even if it is not related to the primary reason for admission? |
Medical student | Gold is very collegial and nurses/physicians know one another by name. Physicians request rather than order; this sets a good example to me on how to approach the nurses. |
Chief resident | [Gold attendings] encourage senior residents to take charge and run the team, although the attending is there for back‐up and support. This provides great learning for the residents. Interns and medical students also are affected because they have to step up their game as well. |
DISCUSSION
Within academic medical centers, hospitalists are expected to care for patients, teach, and help improve the quality and efficiency of hospital‐based care.[7] The Department of Veterans Affairs runs the largest integrated healthcare system in the United States, with approximately 80% of VA hospitals having hospital medicine programs. Overall, one‐third of US residents perform part of their residency training at a VA hospital.[22, 23] Thus, the effects of a system‐wide change at a VA hospital may have implications throughout the country. We studied one such intervention. Our primary findings are that we were able to improve communication and learner education with minimal effects on patient outcomes. While overall LOS decreased slightly postintervention, after taking into account secular trends, readmission rates did not.
We are not the first to evaluate a hospital medicine team using a quasi‐experimental design. For example, Meltzer and colleagues evaluated a hospitalist program at the University of Chicago Medical Center and found that, by the second year of operation, hospitalist care was associated with significantly shorter LOS (0.49 days), reduced costs, and decreased mortality.[24] Auerbach also evaluated a newly created hospital medicine service, finding decreased LOS (0.61 days), lower costs, and lower risk of mortality by the second year of the program.[25]
Improving nurse‐physician communication is considered important for avoiding medical error,[26] yet there has been limited empirical study of methods to improve communication within the medical profession.[27] Based both on our surveys and qualitative interviews, healthcare‐worker communication appeared to improve on the Gold team during the study. A key component of this improvement is likely related to instituting Circle of Concern rounds, in which nurses joined the medical team during attending rounds. Such an intervention likely helped to address organizational silence[28] and enhance the psychological safety of the nursing staff, because the attending physician was proactive about soliciting the input of nurses during rounds.[29] Such leader inclusivenesswords and deeds exhibited by leaders that invite and appreciate others' contributionscan aid interdisciplinary teams in overcoming the negative effects of status differences, thereby promoting collaboration.[29] The inclusion of nurses on rounds is also relationship‐building, which Gotlib Conn and colleagues found was important to improved interprofessional communication and collaboration.[30] In the future, using a tool such as the Teamwork Effectiveness Assessment Module (TEAM) developed by the American Board of Internal Medicine[31] could provide further evaluation of the impact on interprofessional teamwork and communication.
The focus on learner education, though evaluated in prior studies, is also novel. One previous survey of medical students showed that engaging students in substantive discussions is associated with greater student satisfaction.[32] Another survey of medical students found that attendings who were enthusiastic about teaching, inspired confidence in knowledge and skills, provided useful feedback, and encouraged increased student responsibility were viewed as more effective teachers.[33] No previous study that we are aware of, however, has looked at actual educational outcomes, such as shelf scores. The National Board of Medical Examiners reports that the Medicine subject exam is scaled to have a mean of 70 and a standard deviation of 8.[34] Thus, a mean increase in score of 2 points is small, but not trivial. This shows improvement in a hard educational outcome. Additionally, 2 points, although small in the context of total score and standard deviation, may make a substantial difference to an individual student in terms of overall grade, and, thus, residency applications. Our finding that third‐year medical students on the Gold team performed significantly better than University of Michigan third‐year medical students on other teams is an intriguing finding that warrants confirmation. On the other hand, this finding is consistent with a previous report evaluating learner satisfaction in which Bodnar et al found improved ratings of quantity and quality of teaching on teams with a nontraditional structure (Gold team).[21] Moreover, despite relatively few studies, the reason underlying the educational benefit of hospitalists should surprise few. The hospitalist model ensures that learners are supervised by physicians who are experts in the care of hospitalized patients.[35] Hospitalists hired at teaching hospitals to work on services with learners are generally chosen because they possess superior educational skills.[7]
Our findings should be interpreted in the context of the following limitations. First, our study focused on a single academically affiliated VA hospital. As other VA hospitals are pursuing a similar approach (eg, the Houston and Detroit VA medical centers), replicating our results will be important. Second, the VA system, although the largest integrated healthcare system in the United States, has unique characteristicssuch as an integrated electronic health record and predominantly male patient populationthat may make generalizations to the larger US healthcare system challenging. Third, there was a slightly lower response rate among nurses on a few of the surveys to evaluate our efforts; however, this rate of response is standard at our facility. Finally, our evaluation lacks an empirical measure of healthcare‐worker communication, such as incident reports.
Despite these limitations, our results have important implications. Using both quantitative and qualitative assessment, we found that academic hospitalists have the ability to improve healthcare‐worker communication and enhance learner education without increasing LOS. These findings are directly applicable to VA medical centers and potentially applicable to other academic medical centers.
Acknowledgments
The authors thank Milisa Manojlovich, PhD, RN, Edward Kennedy, MS, and Andrew Hickner, MSI, for help with preparation of this manuscript.
Disclosures: This work was funded by a US Department of Veterans Affairs, Office of Systems Redesign Improvement Capability grant. The findings and conclusions in this report are those of the authors and do not necessarily represent the position or policy of the Department of Veterans Affairs. Dr. Saint reports receiving travel reimbursement for giving invited talks at the Society of Hospital Medicine's National Meeting, as well as serving on the advisory boards of Doximity and Jvion.
APPENDIX
Survey to Evaluate the Care Coordinator Position
Yes | No | Not Sure | |
Q1. Are you familiar with the role of the Care Coordinator on the Gold Service (Susan Lee)? | 1 | 2 | 3 |
Please indicate how much you agree or disagree with the statements below.
Strongly Agree | Agree | Neutral | Disagree | Strongly Disagree | Don't Know | |
Q2. The Care Coordinator ensures that appropriate primary care follow‐up and any other appropriate services are arranged. | 1 | 2 | 3 | 4 | 5 | 9 |
Q3. The Care Coordinator provides continuity of patient care on the Gold Service. | 1 | 2 | 3 | 4 | 5 | 9 |
Q4. The Care Coordinator helps educate House Officers and Medical Students on VA processes (e.g., CPRS). | 1 | 2 | 3 | 4 | 5 | 9 |
Q5. The Care Coordinator assists with interdisciplinary communication between the medical team and other services (e.g., nursing, ambulatory care, pharmacy, social work) | 1 | 2 | 3 | 4 | 5 | 9 |
Q6. The Care Coordinator helps facilitate patient discharge. | 1 | 2 | 3 | 4 | 5 | 9 |
Q7. The Care Coordinator initiates communication with the ambulatory care teams to coordinate care. | 1 | 2 | 3 | 4 | 5 | 9 |
Yes | No | |
Q8. Are you a physician (attending or resident), or medical student who has been on more than one medical team at the VA (Gold, Silver, Burgundy, or Yellow)? | 1 | 2 |
If no, please skip to Q13
If yes, comparing your experience on the Gold Service (with the Care Coordinator) to your experience on any of the other services (Silver, Burgundy, or Yellow):
Not at All | Very Little | Somewhat | To a Great Extent | |
Q9. To what extent does the presence of a Care Coordinator affect patient care? | 1 | 2 | 3 | 4 |
Q10. To what extent does the presence of a Care Coordinator improve patient flow? | 1 | 2 | 3 | 4 |
Q11. To what extent does the presence of a Care Coordinator assist with education? | 1 | 2 | 3 | 4 |
Q12. To what extent does the presence of a Care Coordinator contribute to attending rounds? | 1 | 2 | 3 | 4 |
Yes | No | |
Q13. Do you work [as a nurse] in ambulatory care? | 1 | 2 |
If no, please skip to Q17.
If yes, comparing your experience with the Gold Service (with the Care Coordinator) to the other services (Silver, Burgundy, or Yellow):
Not at All | Very Little | Somewhat | To a Great Extent | |
Q14. To what extent does the presence of a Care Coordinator improve coordination of care between inpatient and outpatient services? | 1 | 2 | 3 | 4 |
Q15. To what extent does the presence of a Care Coordinator help identify high risk patients who require follow‐up? | 1 | 2 | 3 | 4 |
Q16. To what extent does the presence of a Care Coordinator ensure follow‐up appointments are scheduled? | 1 | 2 | 3 | 4 |
Yes | No | Not Sure | |
Q17. Do you think each medical team should have a Care Coordinator? | 1 | 2 | 3 |
Q18. Are there any additional tasks or duties you think would improve the effectiveness of the Care Coordinator? |
Very Satisfied | Satisfied | Neutral | Dissatisfied | Very Dissatisfied | |
Q19. Overall how satisfied are you with the role of the Care Coordinator on the Gold Service? | 1 | 2 | 3 | 4 | 5 |
Q20. Do you have any other comments about the role of the Care Coordinator? |
Q21. What is your position? |
1. Physician (attending or resident) or medical student |
2. Nurse (inpatient or ambulatory care) |
Improving quality while reducing costs remains important for hospitals across the United States, including the approximately 150 hospitals that are part of the Veterans Affairs (VA) healthcare system.[1, 2] The field of hospital medicine has grown rapidly, leading to predictions that the majority of inpatient care in the United States eventually will be delivered by hospitalists.[3, 4] In 2010, 57% of US hospitals had hospitalists on staff, including 87% of hospitals with 200 beds,[5] and nearly 80% of VA hospitals.[6]
The demand for hospitalists within teaching hospitals has grown in part as a response to the mandate to reduce residency work hours.[7] Furthermore, previous research has found that hospitalist care is associated with modest reductions in length of stay (LOS) and weak but inconsistent differences in quality.[8] The educational effect of hospitalists has been far less examined. The limited number of studies published to date suggests that hospitalists may improve resident learning and house‐officer satisfaction in academic medical centers and community teaching hospitals[9, 10, 11] and provide positive experiences for medical students12,13; however, Wachter et al reported no significant changes in clinical outcomes or patient, faculty, and house‐staff satisfaction in a newly designed hospital medicine service in San Francisco.[14] Additionally, whether using hospitalists influences nurse‐physician communication[15] is unknown.
Recognizing the limited and sometimes conflicting evidence about the hospitalist model, we report the results of a 3‐year quasi‐experimental evaluation of the experience at our medical center with academic hospitalists. As part of a VA Systems Redesign Improvement Capability Grantknown as the Hospital Outcomes Program of Excellence (HOPE) Initiativewe created a hospitalist‐based medicine team focused on quality improvement, medical education, and patient outcomes.
METHODS
Setting and Design
The main hospital of the VA Ann Arbor Healthcare System, located in Ann Arbor, Michigan, operates 105 acute‐care beds and 40 extended‐care beds. At the time of this evaluation, the medicine service consisted of 4 internal medicine teamsGold, Silver, Burgundy, and Yelloweach of which was responsible for admitting patients on a rotating basis every fourth day, with limited numbers of admissions occurring between each team's primary admitting day. Each team is led by an attending physician, a board‐certified (or board‐eligible) general internist or subspecialist who is also a faculty member at the University of Michigan Medical School. Each team has a senior medical resident, 2 to 3 interns, and 3 to 5 medical students (mostly third‐year students). In total, there are approximately 50 senior medical residents, 60 interns, and 170 medical students who rotate through the medicine service each year. Traditional rounding involves the medical students and interns receiving sign‐out from the overnight team in the morning, then pre‐rounding on each patient by obtaining an interval history, performing an exam, and checking any test results. A tentative plan of care is formed with the senior medical resident, usually by discussing each patient very quickly in the team room. Attending rounds are then conducted, with the physician team visiting each patient one by one to review and plan all aspects of care in detail. When time allows, small segments of teaching may occur during these attending work rounds. This system had been in place for >20 years.
Resulting in part from a grant received from the VA Systems Redesign Central Office (ie, the HOPE Initiative), the Gold team was modified in July 2009 and an academic hospitalist (S.S.) was assigned to head this team. Specific hospitalists were selected by the Associate Chief of Medicine (S.S.) and the Chief of Medicine (R.H.M.) to serve as Gold team attendings on a regular basis. The other teams continued to be overseen by the Chief of Medicine, and the Gold team remained within the medicine service. Characteristics of the Gold and nonGold team attendings can be found in Table 1. The 3 other teams initially were noninterventional concurrent control groups. However, during the second year of the evaluation, the Silver team adopted some of the initiatives as a result of the preliminary findings observed on Gold. Specifically, in the second year of the evaluation, approximately 42% of attendings on the Silver team were from the Gold team. This increased in the third year to 67% of coverage by Gold team attendings on the Silver team. The evaluation of the Gold team ended in June 2012.
Characteristic | Gold Team | Non‐Gold Teams |
---|---|---|
Total number of attendings | 14 | 57 |
Sex, % | ||
Male | 79 | 58 |
Female | 21 | 42 |
Median years postresidency (range) | 10 (130) | 7 (141) |
Subspecialists, % | 14 | 40 |
Median days on service per year (range) | 53 (574) | 30 (592) |
The clinical interventions implemented on the Gold team were quality‐improvement work and were therefore exempt from institutional review board review. Human subjects' approval was, however, received to conduct interviews as part of a qualitative assessment.
Clinical Interventions
Several interventions involving the clinical care delivered were introduced on the Gold team, with a focus on improving communication among healthcare workers (Table 2).
Clinical Interventions | Educational Interventions |
---|---|
Modified structure of attending rounds | Modified structure of attending rounds |
Circle of Concern rounds | Attending reading list |
Clinical Care Coordinator | Nifty Fifty reading list for learners |
Regular attending team meetings | Website to provide expectations to learners |
Two‐month per year commitment by attendings |
Structure of Attending Rounds
The structure of morning rounds was modified on the Gold team. Similar to the traditional structure, medical students and interns on the Gold team receive sign‐out from the overnight team in the morning. However, interns and students may or may not conduct pre‐rounds on each patient. The majority of time between sign‐out and the arrival of the attending physician is spent on work rounds. The senior resident leads rounds with the interns and students, discussing each patient while focusing on overnight events and current symptoms, new physical‐examination findings, and laboratory and test data. The plan of care to be presented to the attending is then formulated with the senior resident. The attending physician then leads Circle of Concern rounds with an expanded team, including a charge nurse, a clinical pharmacist, and a nurse Clinical Care Coordinator. Attending rounds tend to use an E‐AP format: significant Events overnight are discussed, followed by an Assessment & Plan by problem for the top active problems. Using this model, the attendings are able to focus more on teaching and discussing the patient plan than in the traditional model (in which the learner presents the details of the subjective, objective, laboratory, and radiographic data, with limited time left for the assessment and plan for each problem).
Circle of Concern Rounds
Suzanne Gordon described the Circle of Concern in her book Nursing Against the Odds.[16] From her observations, she noted that physicians typically form a circle to discuss patient care during rounds. The circle expands when another physician joins the group; however, the circle does not similarly expand to include nurses when they approach the group. Instead, nurses typically remain on the periphery, listening silently or trying to communicate to physicians' backs.[16] Thus, to promote nurse‐physician communication, Circle of Concern rounds were formally introduced on the Gold team. Each morning, the charge nurse rounds with the team and is encouraged to bring up nursing concerns. The inpatient clinical pharmacist is also included 2 to 3 times per week to help provide education to residents and students and perform medication reconciliation.
Clinical Care Coordinator
The role of the nurse Clinical Care Coordinatoralso introduced on the Gold teamis to provide continuity of patient care, facilitate interdisciplinary communication, facilitate patient discharge, ensure appropriate appointments are scheduled, communicate with the ambulatory care service to ensure proper transition between inpatient and outpatient care, and help educate residents and students on VA procedures and resources.
Regular Gold Team Meetings
All Gold team attendings are expected to dedicate 2 months per year to inpatient service (divided into half‐month blocks), instead of the average 1 month per year for attendings on the other teams. The Gold team attendings, unlike the other teams, also attend bimonthly meetings to discuss strategies for running the team.
Educational Interventions
Given the high number of learners on the medicine service, we wanted to enhance the educational experience for our learners. We thus implemented various interventions, in addition to the change in the structure of rounds, as described below.
Reading List for Learners: The Nifty Fifty
Because reading about clinical medicine is an integral part of medical education, we make explicit our expectation that residents and students read something clinically relevant every day. To promote this, we have provided a Nifty Fifty reading list of key articles. The PDF of each article is provided, along with a brief summary highlighting key points.
Reading List for Gold Attendings and Support Staff
To promote a common understanding of leadership techniques, management books are provided to Gold attending physicians and other members of the team (eg, Care Coordinator, nurse researcher, systems redesign engineer). One book is discussed at each Gold team meeting (Table 3), with participants taking turns leading the discussion.
Book Title | Author(s) |
---|---|
The One Minute Manager | Ken Blanchard and Spencer Johnson |
Good to Great | Jim Collins |
Good to Great and the Social Sectors | Jim Collins |
The Checklist Manifesto: How to Get Things Right | Atul Gawande |
The Five Dysfunctions of a Team: A Leadership Fable | Patrick Lencioni |
Getting to Yes: Negotiating Agreement Without Giving In | Roger Fisher, William Ury, and Bruce Patton |
The Effective Executive: The Definitive Guide to Getting the Right Things Done | Peter Drucker |
A Sense of Urgency | John Kotter |
The Power of Positive Deviance: How Unlikely Innovators Solve the World's Toughest Problems | Richard Pascale, Jerry Sternin, and Monique Sternin |
On the Mend: Revolutionizing Healthcare to Save Lives and Transform the Industry | John Toussaint and Roger Gerard |
Outliers: The Story of Success | Malcolm Gladwell |
Nursing Against the Odds: How Health Care Cost Cutting, Media Stereotypes, and Medical Hubris Undermine Nurses and Patient Care | Suzanne Gordon |
How the Mighty Fall and Why Some Companies Never Give In | Jim Collins |
What the Best College Teachers Do | Ken Bain |
The Creative Destruction of Medicine | Eric Topol |
What Got You Here Won't Get You There: How Successful People Become Even More Successful! | Marshall Goldsmith |
Website
A HOPE Initiative website was created (
Qualitative Assessment
To evaluate our efforts, we conducted a thorough qualitative assessment during the third year of the program. A total of 35 semistructured qualitative interviews were conducted with patients and staff from all levels of the organization, including senior leadership. The qualitative assessment was led by research staff from the Center for Clinical Management Research, who were minimally involved in the redesign effort and could provide an unbiased view of the initiative. Field notes from the semistructured interviews were analyzed, with themes developed using a descriptive approach and through discussion by a multidisciplinary team, which included building team consensus on findings that were supported by clear evidence in the data.[17]
Quantitative Outcome Measures
Clinical Outcomes
To determine if our communication and educational interventions had an impact on patient care, we used hospital administrative data to evaluate admission rates, LOS, and readmission rates for all 4 of the medicine teams. Additional clinical measures were assessed as needed. For example, we monitored the impact of the clinical pharmacist during a 4‐week pilot study by asking the Clinical Care Coordinator to track the proportion of patient encounters (n=170) in which the clinical pharmacist changed management or provided education to team members. Additionally, 2 staff surveys were conducted. The first survey focused on healthcare‐worker communication and was given to inpatient nurses and physicians (including attendings, residents, and medical students) who were recently on an inpatient medical service rotation. The survey included questions from previously validated communication measures,[18, 19, 20] as well as study‐specific questions. The second survey evaluated the new role of the Clinical Care Coordinator (Appendix). Both physicians and nurses who interacted with the Gold team's Clinical Care Coordinator were asked to complete this survey.
Educational Outcomes
To assess the educational interventions, we used learner evaluations of attendings, by both residents and medical students, and standardized internal medicine National Board of Medical Examiners Subject Examination (or shelf) scores for third‐year medical students. A separate evaluation of medical student perceptions of the rounding structure introduced on the Gold team using survey design has already been published.[21]
Statistical Analyses
Data from all sources were analyzed using SAS 9.3 (SAS Institute, Inc., Cary, NC). Outliers for the LOS variable were removed from the analysis. Means and frequency distributions were examined for all variables. Student t tests and [2] tests of independence were used to compare data between groups. Multivariable linear regression models controlling for time (preintervention vs postintervention) were used to assess the effect of the HOPE Initiative on patient LOS and readmission rates. In all cases, 2‐tailed P values of 0.05 or less were considered statistically significant.
Role of the Funding Source
The VA Office of Systems Redesign provided funding but was not involved in the design or conduct of the study, data analysis, or preparation of the manuscript.
RESULTS
Clinical Outcomes
Patient Outcomes
Our multivariable linear regression analysis, controlling for time, showed a significant reduction in LOS of approximately 0.3 days on all teams after the HOPE Initiative began (P=0.004). There were no significant differences between the Gold and non‐Gold teams in the multivariate models when controlling for time for any of the patient‐outcome measures. The number of admissions increased for all 4 medical teams (Figure 1), but, as shown in Figures 2 and 3, the readmission rates for all teams remained relatively stable over this same period of time.
Clinical Pharmacist on Gold Team Rounds
The inpatient clinical pharmacist changed the management plan for 22% of the patients seen on rounds. Contributions from the clinical pharmacist included adjusting the dosing of ordered medication and correcting medication reconciliation. Education and pharmaceutical information was provided to the team in another 6% of the 170 consecutive patient encounters evaluated.
Perception of Circle of Concern Rounds
Circle of Concern rounds were generally well‐received by both nurses and physicians. In a healthcare‐worker communication survey, completed by 38 physicians (62% response rate) and 48 nurses (54% response rate), the majority of both physicians (83%) and nurses (68%) felt Circle of Concern rounds improved communication.
Nurse Perception of Communication
The healthcare‐worker communication survey asked inpatient nurses to rate communication between nurses and physicians on each of the 4 medicine teams. Significantly more nurses were satisfied with communication with the Gold team (71%) compared with the other 3 medicine teams (53%; P=0.02) (Figure 4).
Perception of the Clinical Care Coordinator
In total, 20 physicians (87% response rate) and 10 nurses (56% response rate) completed the Clinical Care Coordinator survey. The physician results were overwhelmingly positive: 100% were satisfied or very satisfied with the role; 100% felt each team should have a Clinical Care Coordinator; and 100% agreed or strongly agreed that the Clinical Care Coordinator ensures that appropriate follow‐up is arranged, provides continuity of care, assists with interdisciplinary communication, and helps facilitate discharge. The majority of nurses was also satisfied or very satisfied with the Clinical Care Coordinator role and felt each team should have one.
Educational Outcomes
House Officer Evaluation of Attendings
Monthly evaluations of attending physicians by house officers (Figure 5) revealed that prior to the HOPE Initiative, little differences were observed between teams, as would be expected because attending assignment was largely random. After the intervention date of July 2009, however, significant differences were noted, with Gold team attendings receiving significantly higher teaching evaluations immediately after the introduction of the HOPE Initiative. Although ratings for Gold attendings remained more favorable, the difference was no longer statistically significant in the second and third year of the initiative, likely due to Gold attendings serving on other medicine teams, which contributed to an improvement in ratings of all attendings.
Medical Student Evaluation of Attendings
Monthly evaluations of attending physicians by third‐year medical students (Figure 6) revealed differences between the Gold attendings and all others, with the attendings that joined the Gold team in 2009 receiving higher teaching evaluations even before the HOPE Initiative started. However, this difference remained statistically significant in years 2 and 3 postinitiative, despite the addition of 4 new junior attendings.
Medical Student Medicine Shelf Scores
The national average on the shelf exam, which reflects learning after the internal medicine third‐year clerkship, has ranged from 75 to 78 for the past several years, with University of Michigan students averaging significantly higher scores prior to and after the HOPE Initiative. However, following the HOPE Initiative, third‐year medical students on the Gold team scored significantly higher on the shelf exam compared with their colleagues on the non‐Gold teams (84 vs 82; P=0.006). This difference in the shelf exam scores, although small, is statistically significant. It represents a measurable improvement in shelf scores in our system and demonstrates the potential educational benefit for the students. Over this same time period, scores on the United States Medical Licensing Exam, given to medical students at the beginning of their third year, remained stable (233 preHOPE Initiative; 234 postHOPE Initiative).
Qualitative Assessment
Qualitative data collected as part of our evaluation of the HOPE Initiative also suggested that nurse‐physician communication had improved since the start of the project. In particular, they reported positively on the Gold team in general, the Circle of Concern rounds, and the Clinical Care Coordinator (Table 4).
Staff Type | Statement1 |
---|---|
| |
Nurse | [Gold is] above and beyond other [teams]. Other teams don't run as smoothly. |
Nurse | There has been a difference in communication [on Gold]. You can tell the difference in how they communicate with staff. We know the Clinical Care Coordinator or charge nurse is rounding with that team, so there is more communication. |
Nurse | The most important thing that has improved communication is the Circle of Concern rounds. |
Physician | [The Gold Clinical Care Coordinator] expedites care, not only what to do but who to call. She can convey the urgency. On rounds she is able to break off, put in an order, place a call, talk to a patient. Things that we would do at 11 AM she gets to at 9 AM. A couple of hours may not seem like much, but sometimes it can make the difference between things happening that day instead of the next. |
Physician | The Clinical Care Coordinator is completely indispensable. Major benefit to providing care to Veterans. |
Physician | I like to think Gold has lifted all of the teams to a higher level. |
Medical student | It may be due to personalities vs the Gold [team] itself, but there is more emphasis on best practices. Are we following guidelines even if it is not related to the primary reason for admission? |
Medical student | Gold is very collegial and nurses/physicians know one another by name. Physicians request rather than order; this sets a good example to me on how to approach the nurses. |
Chief resident | [Gold attendings] encourage senior residents to take charge and run the team, although the attending is there for back‐up and support. This provides great learning for the residents. Interns and medical students also are affected because they have to step up their game as well. |
DISCUSSION
Within academic medical centers, hospitalists are expected to care for patients, teach, and help improve the quality and efficiency of hospital‐based care.[7] The Department of Veterans Affairs runs the largest integrated healthcare system in the United States, with approximately 80% of VA hospitals having hospital medicine programs. Overall, one‐third of US residents perform part of their residency training at a VA hospital.[22, 23] Thus, the effects of a system‐wide change at a VA hospital may have implications throughout the country. We studied one such intervention. Our primary findings are that we were able to improve communication and learner education with minimal effects on patient outcomes. While overall LOS decreased slightly postintervention, after taking into account secular trends, readmission rates did not.
We are not the first to evaluate a hospital medicine team using a quasi‐experimental design. For example, Meltzer and colleagues evaluated a hospitalist program at the University of Chicago Medical Center and found that, by the second year of operation, hospitalist care was associated with significantly shorter LOS (0.49 days), reduced costs, and decreased mortality.[24] Auerbach also evaluated a newly created hospital medicine service, finding decreased LOS (0.61 days), lower costs, and lower risk of mortality by the second year of the program.[25]
Improving nurse‐physician communication is considered important for avoiding medical error,[26] yet there has been limited empirical study of methods to improve communication within the medical profession.[27] Based both on our surveys and qualitative interviews, healthcare‐worker communication appeared to improve on the Gold team during the study. A key component of this improvement is likely related to instituting Circle of Concern rounds, in which nurses joined the medical team during attending rounds. Such an intervention likely helped to address organizational silence[28] and enhance the psychological safety of the nursing staff, because the attending physician was proactive about soliciting the input of nurses during rounds.[29] Such leader inclusivenesswords and deeds exhibited by leaders that invite and appreciate others' contributionscan aid interdisciplinary teams in overcoming the negative effects of status differences, thereby promoting collaboration.[29] The inclusion of nurses on rounds is also relationship‐building, which Gotlib Conn and colleagues found was important to improved interprofessional communication and collaboration.[30] In the future, using a tool such as the Teamwork Effectiveness Assessment Module (TEAM) developed by the American Board of Internal Medicine[31] could provide further evaluation of the impact on interprofessional teamwork and communication.
The focus on learner education, though evaluated in prior studies, is also novel. One previous survey of medical students showed that engaging students in substantive discussions is associated with greater student satisfaction.[32] Another survey of medical students found that attendings who were enthusiastic about teaching, inspired confidence in knowledge and skills, provided useful feedback, and encouraged increased student responsibility were viewed as more effective teachers.[33] No previous study that we are aware of, however, has looked at actual educational outcomes, such as shelf scores. The National Board of Medical Examiners reports that the Medicine subject exam is scaled to have a mean of 70 and a standard deviation of 8.[34] Thus, a mean increase in score of 2 points is small, but not trivial. This shows improvement in a hard educational outcome. Additionally, 2 points, although small in the context of total score and standard deviation, may make a substantial difference to an individual student in terms of overall grade, and, thus, residency applications. Our finding that third‐year medical students on the Gold team performed significantly better than University of Michigan third‐year medical students on other teams is an intriguing finding that warrants confirmation. On the other hand, this finding is consistent with a previous report evaluating learner satisfaction in which Bodnar et al found improved ratings of quantity and quality of teaching on teams with a nontraditional structure (Gold team).[21] Moreover, despite relatively few studies, the reason underlying the educational benefit of hospitalists should surprise few. The hospitalist model ensures that learners are supervised by physicians who are experts in the care of hospitalized patients.[35] Hospitalists hired at teaching hospitals to work on services with learners are generally chosen because they possess superior educational skills.[7]
Our findings should be interpreted in the context of the following limitations. First, our study focused on a single academically affiliated VA hospital. As other VA hospitals are pursuing a similar approach (eg, the Houston and Detroit VA medical centers), replicating our results will be important. Second, the VA system, although the largest integrated healthcare system in the United States, has unique characteristicssuch as an integrated electronic health record and predominantly male patient populationthat may make generalizations to the larger US healthcare system challenging. Third, there was a slightly lower response rate among nurses on a few of the surveys to evaluate our efforts; however, this rate of response is standard at our facility. Finally, our evaluation lacks an empirical measure of healthcare‐worker communication, such as incident reports.
Despite these limitations, our results have important implications. Using both quantitative and qualitative assessment, we found that academic hospitalists have the ability to improve healthcare‐worker communication and enhance learner education without increasing LOS. These findings are directly applicable to VA medical centers and potentially applicable to other academic medical centers.
Acknowledgments
The authors thank Milisa Manojlovich, PhD, RN, Edward Kennedy, MS, and Andrew Hickner, MSI, for help with preparation of this manuscript.
Disclosures: This work was funded by a US Department of Veterans Affairs, Office of Systems Redesign Improvement Capability grant. The findings and conclusions in this report are those of the authors and do not necessarily represent the position or policy of the Department of Veterans Affairs. Dr. Saint reports receiving travel reimbursement for giving invited talks at the Society of Hospital Medicine's National Meeting, as well as serving on the advisory boards of Doximity and Jvion.
APPENDIX
Survey to Evaluate the Care Coordinator Position
Yes | No | Not Sure | |
Q1. Are you familiar with the role of the Care Coordinator on the Gold Service (Susan Lee)? | 1 | 2 | 3 |
Please indicate how much you agree or disagree with the statements below.
Strongly Agree | Agree | Neutral | Disagree | Strongly Disagree | Don't Know | |
Q2. The Care Coordinator ensures that appropriate primary care follow‐up and any other appropriate services are arranged. | 1 | 2 | 3 | 4 | 5 | 9 |
Q3. The Care Coordinator provides continuity of patient care on the Gold Service. | 1 | 2 | 3 | 4 | 5 | 9 |
Q4. The Care Coordinator helps educate House Officers and Medical Students on VA processes (e.g., CPRS). | 1 | 2 | 3 | 4 | 5 | 9 |
Q5. The Care Coordinator assists with interdisciplinary communication between the medical team and other services (e.g., nursing, ambulatory care, pharmacy, social work) | 1 | 2 | 3 | 4 | 5 | 9 |
Q6. The Care Coordinator helps facilitate patient discharge. | 1 | 2 | 3 | 4 | 5 | 9 |
Q7. The Care Coordinator initiates communication with the ambulatory care teams to coordinate care. | 1 | 2 | 3 | 4 | 5 | 9 |
Yes | No | |
Q8. Are you a physician (attending or resident), or medical student who has been on more than one medical team at the VA (Gold, Silver, Burgundy, or Yellow)? | 1 | 2 |
If no, please skip to Q13
If yes, comparing your experience on the Gold Service (with the Care Coordinator) to your experience on any of the other services (Silver, Burgundy, or Yellow):
Not at All | Very Little | Somewhat | To a Great Extent | |
Q9. To what extent does the presence of a Care Coordinator affect patient care? | 1 | 2 | 3 | 4 |
Q10. To what extent does the presence of a Care Coordinator improve patient flow? | 1 | 2 | 3 | 4 |
Q11. To what extent does the presence of a Care Coordinator assist with education? | 1 | 2 | 3 | 4 |
Q12. To what extent does the presence of a Care Coordinator contribute to attending rounds? | 1 | 2 | 3 | 4 |
Yes | No | |
Q13. Do you work [as a nurse] in ambulatory care? | 1 | 2 |
If no, please skip to Q17.
If yes, comparing your experience with the Gold Service (with the Care Coordinator) to the other services (Silver, Burgundy, or Yellow):
Not at All | Very Little | Somewhat | To a Great Extent | |
Q14. To what extent does the presence of a Care Coordinator improve coordination of care between inpatient and outpatient services? | 1 | 2 | 3 | 4 |
Q15. To what extent does the presence of a Care Coordinator help identify high risk patients who require follow‐up? | 1 | 2 | 3 | 4 |
Q16. To what extent does the presence of a Care Coordinator ensure follow‐up appointments are scheduled? | 1 | 2 | 3 | 4 |
Yes | No | Not Sure | |
Q17. Do you think each medical team should have a Care Coordinator? | 1 | 2 | 3 |
Q18. Are there any additional tasks or duties you think would improve the effectiveness of the Care Coordinator? |
Very Satisfied | Satisfied | Neutral | Dissatisfied | Very Dissatisfied | |
Q19. Overall how satisfied are you with the role of the Care Coordinator on the Gold Service? | 1 | 2 | 3 | 4 | 5 |
Q20. Do you have any other comments about the role of the Care Coordinator? |
Q21. What is your position? |
1. Physician (attending or resident) or medical student |
2. Nurse (inpatient or ambulatory care) |
- Kohn LT, Corrigan JM, Donaldson MS, eds. To Err Is Human: Building a Safer Health System. Washington, D.C.: National Academies Press; 2000.
- Institute of Medicine of the National Academies. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, D.C.: National Academies Press; 2001.
- Growth in the care of older patients by hospitalists in the United States. N Engl J Med. 2009;360(11):1102–1112. , , , .
- Growth in care provided by hospitalists. N Engl J Med. 2009;360(26):2789–2791. .
- American Hospital Association. AHA Annual Survey of Hospitals, 2010. Chicago, IL: Health Forum, LLC; 2010.
- Preventing hospital‐acquired infections: a national survey of practices reported by U.S. hospitals in 2005 and 2009. J Gen Intern Med. 2012;27(7):773–779. , , , .
- Hospitalists in teaching hospitals: opportunities but not without danger. J Gen Intern Med. 2004;19(4):392–393. , .
- Do hospitalist physicians improve the quality of inpatient care delivery? A systematic review of process, efficiency and outcome measures. BMC Med. 2011;9:58. , .
- Effect of hospitalist attending physicians on trainee educational experiences: a systematic review. J Hosp Med. 2009;4(8):490–498. , , , .
- Resident satisfaction on an academic hospitalist service: time to teach. Am J Med. 2002;112(7):597–601. , , , , , .
- The positive impact of initiation of hospitalist clinician educators. J Gen Intern Med. 2004;19(4):293–301. , , , et al.
- Third‐year medical students' evaluation of hospitalist and nonhospitalist faculty during the inpatient portion of their pediatrics clerkships. J Hosp Med. 2007;2(1):17–22. , .
- Medical student evaluation of the quality of hospitalist and nonhospitalist teaching faculty on inpatient medicine rotations. Acad Med. 2004;79(1):78–82. , , , .
- Reorganizing an academic medical service: impact on cost, quality, patient satisfaction, and education. JAMA. 1998;279(19):1560–1565. , , , , .
- Nurse/physician communication through a sensemaking lens: shifting the paradigm to improve patient safety. Med Care. 2010;48(11):941–946. .
- Nursing Against the Odds: How Health Care Cost Cutting, Media Stereotypes, and Medical Hubris Undermine Nurses and Patient Care. Ithaca, NY: Cornell University Press; 2005. .
- Focus on research methods: whatever happened to qualitative description? Res Nurs Health. 2000;23:334–340. .
- Organizational assessment in intensive care units (ICUs): construct development, reliability, and validity of the ICU nurse‐physician questionnaire. Med Care. 1991;29(8):709–726. , , , , .
- Development of an instrument to measure collaboration and satisfaction about care decisions. J Adv Nurs. 1994;20(1):176–182. .
- Development of the practice environment scale of the Nursing Work Index. Res Nurs Health. 2002;25(3):176–188. .
- Does the structure of inpatient rounds affect medical student education? Int J Med Educ. 2013;4:96–100. , , .
- U.S. Department of Veterans Affairs, Office of Academic Affiliations. Medical and Dental Education Program. Available at: http://www.va. gov/oaa/GME_default.asp. Published 2012. Accessed May 08, 2013.
- Graduate medical education, 2011–2012. JAMA. 2012;308(21):2264–2279. , .
- Effects of physician experience on costs and outcomes on an academic general medicine service: results of a trial of hospitalists. Ann Intern Med. 2002;137(11):866–874. , , , et al.
- Implementation of a voluntary hospitalist service at a community teaching hospital: improved clinical efficiency and patient outcomes. Ann Intern Med. 2002;137(11):859–865. , , , , , .
- Communication failures: an insidious contributor to medical mishaps. Acad Med. 2004;79(2):186–194. , , .
- ‘It depends': medical residents' perspectives on working with nurses. Am J Nurs. 2009;109(7):34–44. , , .
- Organizational silence: a barrier to change and development in a pluralistic world. Acad Manage Rev. 2000;25(4):706–725. , .
- Making it safe: the effects of leader inclusiveness and professional status on psychological safety and improvement efforts in health care teams. J Organiz Behav. 2006;27:941–966. , .
- Interprofessional communication with hospitalist and consultant physicians in general internal medicine: a qualitative study. BMC Health Serv Res. 2012;12:437. , , , , .
- A new tool to give hospitalists feedback to improve interprofessional teamwork and advance patient care. Health Aff (Millwood). 2012;31(11):2485–2492. , , , , , .
- Impact of instructional practices on student satisfaction with attendings' teaching in the inpatient component of internal medicine clerkships. J Gen Intern Med. 2006;21(1):7–12. , , , , , .
- Medical students' perceptions of the elements of effective inpatient teaching by attending physicians and housestaff. J Gen Intern Med. 2005;20(7):635–639. , .
- National Board of Medical Examiners Subject Examination Program. Internal Medicine Advanced Clinical Examination, score interpretation guide. Available at: http://www.nbme.org/PDF/SampleScoreReports/Internal_Medicine_ACE_Score_Report.pdf. Published 2011. Accessed September 13, 2013.
- The impact of hospitalists on medical education and the academic health system. Ann Intern Med. 1999;130(4 part 2):364–367. .
- Kohn LT, Corrigan JM, Donaldson MS, eds. To Err Is Human: Building a Safer Health System. Washington, D.C.: National Academies Press; 2000.
- Institute of Medicine of the National Academies. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, D.C.: National Academies Press; 2001.
- Growth in the care of older patients by hospitalists in the United States. N Engl J Med. 2009;360(11):1102–1112. , , , .
- Growth in care provided by hospitalists. N Engl J Med. 2009;360(26):2789–2791. .
- American Hospital Association. AHA Annual Survey of Hospitals, 2010. Chicago, IL: Health Forum, LLC; 2010.
- Preventing hospital‐acquired infections: a national survey of practices reported by U.S. hospitals in 2005 and 2009. J Gen Intern Med. 2012;27(7):773–779. , , , .
- Hospitalists in teaching hospitals: opportunities but not without danger. J Gen Intern Med. 2004;19(4):392–393. , .
- Do hospitalist physicians improve the quality of inpatient care delivery? A systematic review of process, efficiency and outcome measures. BMC Med. 2011;9:58. , .
- Effect of hospitalist attending physicians on trainee educational experiences: a systematic review. J Hosp Med. 2009;4(8):490–498. , , , .
- Resident satisfaction on an academic hospitalist service: time to teach. Am J Med. 2002;112(7):597–601. , , , , , .
- The positive impact of initiation of hospitalist clinician educators. J Gen Intern Med. 2004;19(4):293–301. , , , et al.
- Third‐year medical students' evaluation of hospitalist and nonhospitalist faculty during the inpatient portion of their pediatrics clerkships. J Hosp Med. 2007;2(1):17–22. , .
- Medical student evaluation of the quality of hospitalist and nonhospitalist teaching faculty on inpatient medicine rotations. Acad Med. 2004;79(1):78–82. , , , .
- Reorganizing an academic medical service: impact on cost, quality, patient satisfaction, and education. JAMA. 1998;279(19):1560–1565. , , , , .
- Nurse/physician communication through a sensemaking lens: shifting the paradigm to improve patient safety. Med Care. 2010;48(11):941–946. .
- Nursing Against the Odds: How Health Care Cost Cutting, Media Stereotypes, and Medical Hubris Undermine Nurses and Patient Care. Ithaca, NY: Cornell University Press; 2005. .
- Focus on research methods: whatever happened to qualitative description? Res Nurs Health. 2000;23:334–340. .
- Organizational assessment in intensive care units (ICUs): construct development, reliability, and validity of the ICU nurse‐physician questionnaire. Med Care. 1991;29(8):709–726. , , , , .
- Development of an instrument to measure collaboration and satisfaction about care decisions. J Adv Nurs. 1994;20(1):176–182. .
- Development of the practice environment scale of the Nursing Work Index. Res Nurs Health. 2002;25(3):176–188. .
- Does the structure of inpatient rounds affect medical student education? Int J Med Educ. 2013;4:96–100. , , .
- U.S. Department of Veterans Affairs, Office of Academic Affiliations. Medical and Dental Education Program. Available at: http://www.va. gov/oaa/GME_default.asp. Published 2012. Accessed May 08, 2013.
- Graduate medical education, 2011–2012. JAMA. 2012;308(21):2264–2279. , .
- Effects of physician experience on costs and outcomes on an academic general medicine service: results of a trial of hospitalists. Ann Intern Med. 2002;137(11):866–874. , , , et al.
- Implementation of a voluntary hospitalist service at a community teaching hospital: improved clinical efficiency and patient outcomes. Ann Intern Med. 2002;137(11):859–865. , , , , , .
- Communication failures: an insidious contributor to medical mishaps. Acad Med. 2004;79(2):186–194. , , .
- ‘It depends': medical residents' perspectives on working with nurses. Am J Nurs. 2009;109(7):34–44. , , .
- Organizational silence: a barrier to change and development in a pluralistic world. Acad Manage Rev. 2000;25(4):706–725. , .
- Making it safe: the effects of leader inclusiveness and professional status on psychological safety and improvement efforts in health care teams. J Organiz Behav. 2006;27:941–966. , .
- Interprofessional communication with hospitalist and consultant physicians in general internal medicine: a qualitative study. BMC Health Serv Res. 2012;12:437. , , , , .
- A new tool to give hospitalists feedback to improve interprofessional teamwork and advance patient care. Health Aff (Millwood). 2012;31(11):2485–2492. , , , , , .
- Impact of instructional practices on student satisfaction with attendings' teaching in the inpatient component of internal medicine clerkships. J Gen Intern Med. 2006;21(1):7–12. , , , , , .
- Medical students' perceptions of the elements of effective inpatient teaching by attending physicians and housestaff. J Gen Intern Med. 2005;20(7):635–639. , .
- National Board of Medical Examiners Subject Examination Program. Internal Medicine Advanced Clinical Examination, score interpretation guide. Available at: http://www.nbme.org/PDF/SampleScoreReports/Internal_Medicine_ACE_Score_Report.pdf. Published 2011. Accessed September 13, 2013.
- The impact of hospitalists on medical education and the academic health system. Ann Intern Med. 1999;130(4 part 2):364–367. .
© 2013 Society of The Authors. Journal of Hospital Medicine published by Wiley Periodicals, Inc. on behalf of Society of Hospital Medicine.