User login
Letter to the Editor
We greatly appreciate the thoughtful points made by Dr. Kerman regarding our recently published study evaluating the association of hospitalist continuity on adverse events (AEs).[1] We agree that a 7‐on/7‐off staffing model may limit discontinuity relative to models using shorter rotations lengths. Many hospital medicine programs use a 7‐on/7‐off model to optimize continuity. Longer rotation lengths are uncommon, as they may lead to fatigue and negatively affect physician work‐life balance. Shorter rotation lengths do exist, and we acknowledge that a study in a setting with greater fragmentation may have detected an effect.
We respectfully disagree with Dr. Kerman's concern that our methods for AE detection and confirmation may have been insensitive. We did not rely on incident reports, as these systems suffer from under‐reporting and often represent only a fraction of true AEs. We used a modified version of the classic 2‐stage method to identify and confirm AEs.[2] In the first stage, we used computerized screens, based on criteria from the Harvard Medical Practice Study and Institute for Healthcare Improvement global trigger tool, to identify potential AEs.[3, 4, 5] A research nurse created narrative summaries of potential AEs. A physician researcher then reviewed the narrative summaries to confirm whether an AE was truly present. This time‐consuming method is much more sensitive and specific than other options for patient safety measurement, including administrative data analyses and incident reporting systems.[6, 7]
With respect to other outcomes that may be affected by hospitalist continuity, we recently published a separate study showing that lower inpatient physician continuity was significantly associated with modest increases in hospital costs.[8] We found no association between continuity and patient satisfaction, but were likely underpowered to detect one. Interestingly, some of the models in our study suggested a slightly reduced risk of readmission with lower continuity. We were surprised by this finding and hypothesized that countervailing forces may be at play during handoffs of care from 1 hospitalist to another. Transitions of care introduce the opportunity for critical information to be lost, but they also introduce the potential for patient reassessment. A hospitalist newly taking over care from another may not be anchored to the initial diagnostic impressions and management plan established by the first. Of course, the potential benefit of a reassessment could only occur if the new hospitalist has time to perform one. At extremely high patient volumes, this theoretical benefit is unlikely to exist.
We did not include length of stay (LOS) as an outcome because hospitalist continuity and LOS are interdependent. Although discontinuity may lead to longer LOS, longer LOS definitely increases the probability of discontinuity. Thus, we controlled for LOS in our statistical models to isolate the effect of continuity. The study by Epstein and colleagues did not take into account the interdependence between LOS and hospitalist continuity.[9] Observational studies are not ideal for determining the effect of continuity on LOS. The Combing Incentives and Continuity Leading to Efficiency (CICLE) study by Chandra and colleagues was a pre‐post evaluation of a hospitalist staffing model specifically designed to improve continuity.[10] In the CICLE model, physicians work in a 4‐day rotation. On day 1, physicians exclusively admit patients. On day 2, physicians care for patients admitted on day 1 and accept patients admitted overnight. On days 3 and 4, physicians continue to care for patients received on days 1 and 2, but receive no additional patients. The remaining patients are transitioned to the next physician entering the cycle at the end of day 4. Chandra and colleagues found a 7.5% reduction in LOS and an 8.5% reduction in charges. Interestingly, they also found a 13.5% increase in readmissions that did not achieve statistical significance (P=0.08). The CICLE study suggests continuity does affect LOS, but is limited in that it did not account for a potential preexisting trend toward lower LOS.
Dr. Kerman presents data showing that it takes longer for a physician to care for a patient who is new to him or her than for a patient who is previously known. This finding has face validity. However, as we have suggested, the extra time spent by the oncoming physician may have both advantages and disadvantages. The disadvantages include time‐consuming cognitive work for the physician and the potential for information loss affecting patient care. The potential advantage is a second physician reassessing the diagnosis and management decisions established by the first, potentially correcting errors and optimizing care.
Ultimately, more research is needed to illuminate the effect of hospitalist continuity on patient outcomes. For now, we feel that hospital medicine group leaders need not institute lengthy rotations or staffing models that prioritize continuity above all other factors, as continuity appears to have little impact on patient outcomes.
- The effect of hospitalist discontinuity on adverse events. J Hosp Med. 2015;10(3):147–151. , , , et al.
- Comparison of manual abstraction to data warehouse facilitated abstraction to identify hosptial adverse events. BMJ Qual Saf. 2013;22(2):130–138. , , , et al.
- , . IHI global trigger tool for measuring adverse events: IHI innovation series white paper. Cambridge, MA: Institute for Healthcare Improvement; 2007.
- A study of medical injury and medical malpractice. N Engl J Med. 1989;321(7):480–484. , BA, , et al.
- Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000;38(3):261–271. , , , et al.
- The elephant of patient safety: what you see depends on how you look. Jt Comm J Qual Patient Saf. 2010;36(9):399–401. .
- Measuring errors and adverse events in health care. J Gen Intern Med. 2003;18(1):61–67. , .
- The impact of hospitalist discontinuity on hospital cost, readmissions, and patient satisfaction. J Gen Intern Med. 2014;29(7):1004–1008. , , , et al.
- The impact of fragmentation of hospitalist care on length of stay. J Hosp Med. 2010;5(6):335–338. , , , , .
- The Creating Incentives and Continuity Leading to Efficiency staffing model: a quality improvement initiative in hospital medicine. Mayo Clin Proc. 2012;87(4):364–371. , , .
We greatly appreciate the thoughtful points made by Dr. Kerman regarding our recently published study evaluating the association of hospitalist continuity on adverse events (AEs).[1] We agree that a 7‐on/7‐off staffing model may limit discontinuity relative to models using shorter rotations lengths. Many hospital medicine programs use a 7‐on/7‐off model to optimize continuity. Longer rotation lengths are uncommon, as they may lead to fatigue and negatively affect physician work‐life balance. Shorter rotation lengths do exist, and we acknowledge that a study in a setting with greater fragmentation may have detected an effect.
We respectfully disagree with Dr. Kerman's concern that our methods for AE detection and confirmation may have been insensitive. We did not rely on incident reports, as these systems suffer from under‐reporting and often represent only a fraction of true AEs. We used a modified version of the classic 2‐stage method to identify and confirm AEs.[2] In the first stage, we used computerized screens, based on criteria from the Harvard Medical Practice Study and Institute for Healthcare Improvement global trigger tool, to identify potential AEs.[3, 4, 5] A research nurse created narrative summaries of potential AEs. A physician researcher then reviewed the narrative summaries to confirm whether an AE was truly present. This time‐consuming method is much more sensitive and specific than other options for patient safety measurement, including administrative data analyses and incident reporting systems.[6, 7]
With respect to other outcomes that may be affected by hospitalist continuity, we recently published a separate study showing that lower inpatient physician continuity was significantly associated with modest increases in hospital costs.[8] We found no association between continuity and patient satisfaction, but were likely underpowered to detect one. Interestingly, some of the models in our study suggested a slightly reduced risk of readmission with lower continuity. We were surprised by this finding and hypothesized that countervailing forces may be at play during handoffs of care from 1 hospitalist to another. Transitions of care introduce the opportunity for critical information to be lost, but they also introduce the potential for patient reassessment. A hospitalist newly taking over care from another may not be anchored to the initial diagnostic impressions and management plan established by the first. Of course, the potential benefit of a reassessment could only occur if the new hospitalist has time to perform one. At extremely high patient volumes, this theoretical benefit is unlikely to exist.
We did not include length of stay (LOS) as an outcome because hospitalist continuity and LOS are interdependent. Although discontinuity may lead to longer LOS, longer LOS definitely increases the probability of discontinuity. Thus, we controlled for LOS in our statistical models to isolate the effect of continuity. The study by Epstein and colleagues did not take into account the interdependence between LOS and hospitalist continuity.[9] Observational studies are not ideal for determining the effect of continuity on LOS. The Combing Incentives and Continuity Leading to Efficiency (CICLE) study by Chandra and colleagues was a pre‐post evaluation of a hospitalist staffing model specifically designed to improve continuity.[10] In the CICLE model, physicians work in a 4‐day rotation. On day 1, physicians exclusively admit patients. On day 2, physicians care for patients admitted on day 1 and accept patients admitted overnight. On days 3 and 4, physicians continue to care for patients received on days 1 and 2, but receive no additional patients. The remaining patients are transitioned to the next physician entering the cycle at the end of day 4. Chandra and colleagues found a 7.5% reduction in LOS and an 8.5% reduction in charges. Interestingly, they also found a 13.5% increase in readmissions that did not achieve statistical significance (P=0.08). The CICLE study suggests continuity does affect LOS, but is limited in that it did not account for a potential preexisting trend toward lower LOS.
Dr. Kerman presents data showing that it takes longer for a physician to care for a patient who is new to him or her than for a patient who is previously known. This finding has face validity. However, as we have suggested, the extra time spent by the oncoming physician may have both advantages and disadvantages. The disadvantages include time‐consuming cognitive work for the physician and the potential for information loss affecting patient care. The potential advantage is a second physician reassessing the diagnosis and management decisions established by the first, potentially correcting errors and optimizing care.
Ultimately, more research is needed to illuminate the effect of hospitalist continuity on patient outcomes. For now, we feel that hospital medicine group leaders need not institute lengthy rotations or staffing models that prioritize continuity above all other factors, as continuity appears to have little impact on patient outcomes.
We greatly appreciate the thoughtful points made by Dr. Kerman regarding our recently published study evaluating the association of hospitalist continuity on adverse events (AEs).[1] We agree that a 7‐on/7‐off staffing model may limit discontinuity relative to models using shorter rotations lengths. Many hospital medicine programs use a 7‐on/7‐off model to optimize continuity. Longer rotation lengths are uncommon, as they may lead to fatigue and negatively affect physician work‐life balance. Shorter rotation lengths do exist, and we acknowledge that a study in a setting with greater fragmentation may have detected an effect.
We respectfully disagree with Dr. Kerman's concern that our methods for AE detection and confirmation may have been insensitive. We did not rely on incident reports, as these systems suffer from under‐reporting and often represent only a fraction of true AEs. We used a modified version of the classic 2‐stage method to identify and confirm AEs.[2] In the first stage, we used computerized screens, based on criteria from the Harvard Medical Practice Study and Institute for Healthcare Improvement global trigger tool, to identify potential AEs.[3, 4, 5] A research nurse created narrative summaries of potential AEs. A physician researcher then reviewed the narrative summaries to confirm whether an AE was truly present. This time‐consuming method is much more sensitive and specific than other options for patient safety measurement, including administrative data analyses and incident reporting systems.[6, 7]
With respect to other outcomes that may be affected by hospitalist continuity, we recently published a separate study showing that lower inpatient physician continuity was significantly associated with modest increases in hospital costs.[8] We found no association between continuity and patient satisfaction, but were likely underpowered to detect one. Interestingly, some of the models in our study suggested a slightly reduced risk of readmission with lower continuity. We were surprised by this finding and hypothesized that countervailing forces may be at play during handoffs of care from 1 hospitalist to another. Transitions of care introduce the opportunity for critical information to be lost, but they also introduce the potential for patient reassessment. A hospitalist newly taking over care from another may not be anchored to the initial diagnostic impressions and management plan established by the first. Of course, the potential benefit of a reassessment could only occur if the new hospitalist has time to perform one. At extremely high patient volumes, this theoretical benefit is unlikely to exist.
We did not include length of stay (LOS) as an outcome because hospitalist continuity and LOS are interdependent. Although discontinuity may lead to longer LOS, longer LOS definitely increases the probability of discontinuity. Thus, we controlled for LOS in our statistical models to isolate the effect of continuity. The study by Epstein and colleagues did not take into account the interdependence between LOS and hospitalist continuity.[9] Observational studies are not ideal for determining the effect of continuity on LOS. The Combing Incentives and Continuity Leading to Efficiency (CICLE) study by Chandra and colleagues was a pre‐post evaluation of a hospitalist staffing model specifically designed to improve continuity.[10] In the CICLE model, physicians work in a 4‐day rotation. On day 1, physicians exclusively admit patients. On day 2, physicians care for patients admitted on day 1 and accept patients admitted overnight. On days 3 and 4, physicians continue to care for patients received on days 1 and 2, but receive no additional patients. The remaining patients are transitioned to the next physician entering the cycle at the end of day 4. Chandra and colleagues found a 7.5% reduction in LOS and an 8.5% reduction in charges. Interestingly, they also found a 13.5% increase in readmissions that did not achieve statistical significance (P=0.08). The CICLE study suggests continuity does affect LOS, but is limited in that it did not account for a potential preexisting trend toward lower LOS.
Dr. Kerman presents data showing that it takes longer for a physician to care for a patient who is new to him or her than for a patient who is previously known. This finding has face validity. However, as we have suggested, the extra time spent by the oncoming physician may have both advantages and disadvantages. The disadvantages include time‐consuming cognitive work for the physician and the potential for information loss affecting patient care. The potential advantage is a second physician reassessing the diagnosis and management decisions established by the first, potentially correcting errors and optimizing care.
Ultimately, more research is needed to illuminate the effect of hospitalist continuity on patient outcomes. For now, we feel that hospital medicine group leaders need not institute lengthy rotations or staffing models that prioritize continuity above all other factors, as continuity appears to have little impact on patient outcomes.
- The effect of hospitalist discontinuity on adverse events. J Hosp Med. 2015;10(3):147–151. , , , et al.
- Comparison of manual abstraction to data warehouse facilitated abstraction to identify hosptial adverse events. BMJ Qual Saf. 2013;22(2):130–138. , , , et al.
- , . IHI global trigger tool for measuring adverse events: IHI innovation series white paper. Cambridge, MA: Institute for Healthcare Improvement; 2007.
- A study of medical injury and medical malpractice. N Engl J Med. 1989;321(7):480–484. , BA, , et al.
- Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000;38(3):261–271. , , , et al.
- The elephant of patient safety: what you see depends on how you look. Jt Comm J Qual Patient Saf. 2010;36(9):399–401. .
- Measuring errors and adverse events in health care. J Gen Intern Med. 2003;18(1):61–67. , .
- The impact of hospitalist discontinuity on hospital cost, readmissions, and patient satisfaction. J Gen Intern Med. 2014;29(7):1004–1008. , , , et al.
- The impact of fragmentation of hospitalist care on length of stay. J Hosp Med. 2010;5(6):335–338. , , , , .
- The Creating Incentives and Continuity Leading to Efficiency staffing model: a quality improvement initiative in hospital medicine. Mayo Clin Proc. 2012;87(4):364–371. , , .
- The effect of hospitalist discontinuity on adverse events. J Hosp Med. 2015;10(3):147–151. , , , et al.
- Comparison of manual abstraction to data warehouse facilitated abstraction to identify hosptial adverse events. BMJ Qual Saf. 2013;22(2):130–138. , , , et al.
- , . IHI global trigger tool for measuring adverse events: IHI innovation series white paper. Cambridge, MA: Institute for Healthcare Improvement; 2007.
- A study of medical injury and medical malpractice. N Engl J Med. 1989;321(7):480–484. , BA, , et al.
- Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000;38(3):261–271. , , , et al.
- The elephant of patient safety: what you see depends on how you look. Jt Comm J Qual Patient Saf. 2010;36(9):399–401. .
- Measuring errors and adverse events in health care. J Gen Intern Med. 2003;18(1):61–67. , .
- The impact of hospitalist discontinuity on hospital cost, readmissions, and patient satisfaction. J Gen Intern Med. 2014;29(7):1004–1008. , , , et al.
- The impact of fragmentation of hospitalist care on length of stay. J Hosp Med. 2010;5(6):335–338. , , , , .
- The Creating Incentives and Continuity Leading to Efficiency staffing model: a quality improvement initiative in hospital medicine. Mayo Clin Proc. 2012;87(4):364–371. , , .
Effect of Hospitalist Discontinuity on AE
Although definitions vary, continuity of care can be thought of as the patient's experience of a continuous caring relationship with an identified healthcare professional.[1] Research in ambulatory settings has found that patients who see their primary care physician for a higher proportion of office visits have higher patient satisfaction, better hypertensive control, lower risk of hospitalization, and fewer emergency department visits.[2, 3, 4, 5] Continuity with a single hospital‐based physician is difficult to achieve because of the need to provide care 24 hours a day, 7 days a week. Key clinical information may be lost during physician‐to‐physician handoffs (eg, at admission, at the end of rotations on service) during hospitalization. Our research group recently found that lower hospital physician continuity was associated with modestly increased hospital costs, but also a trend toward lower readmissions.[6] We speculated that physicians newly taking over patient care from colleagues reassess diagnoses and treatment plans. This reassessment may identify errors missed by the previous hospital physician. Thus, discontinuity may theoretically help or hinder the provision of safe hospital care.
We sought to examine the relationship between hospital physician continuity and the incidence of adverse events (AEs). We combined data from 2 previously published studies by our research group; one investigated the relationship between hospital physician continuity and costs and 30‐day readmissions, the other assessed the impact of unit‐based interventions on AEs.[6, 7]
METHODS
Setting and Study Design
This retrospective, observational study was conducted at Northwestern Memorial Hospital, an 876‐bed tertiary care teaching hospital in Chicago, Illinois, and was approved by the institutional review board of Northwestern University. Subjects included patients admitted to an adult nonteaching hospitalist service between March 1, 2009 and December 31, 2011. Hospitalists on this service worked without resident physicians in rotations usually lasting 7 consecutive days beginning on Mondays and ending on Sundays. Hospitalists were allowed to switch portions of their schedule with one another, creating the possibility that certain rotations may have been slightly shorter or longer than 7 days. Hospitalists gave verbal sign‐out via telephone to the hospitalist taking over their service on the afternoon of the last day of their rotation. These handoffs customarily involved both hospitalists viewing the electronic health record during the discussion but were not standardized. Night hospitalists performed admissions and cross‐coverage each night from 7 pm to 7 am. Night hospitalists printed history and physicals for day hospitalists, but typically did not give verbal sign‐out on new admissions.
Acquisition of Study Population Data
We identified all patients admitted to the nonteaching hospitalist service using the Northwestern Medicine Enterprise Data Warehouse (EDW), an integrated repository of all clinical and research data sources on the campus. We excluded patients admitted under observation status, those initially admitted to other services (eg, intensive care, general surgery), those discharged from other services, and those cared for by advanced practice providers (ie, nurse practitioners and physician assistants).
Predictor Variables
We identified physicians completing the primary service history and physicals (H&P) and progress notes throughout patients' hospitalizations to calculate 2 measures of continuity: the Number of Physicians Index (NPI), and the Usual Provider of Continuity (UPC) Index.[8, 9] The NPI represented the total number of unique hospitalists completing H&Ps and/or progress notes for a patient. The UPC was calculated as the largest number of notes signed by a single hospitalist divided by the total number of hospitalist notes for a patient. For example, if Dr. John Smith wrote notes on the first 4 days of a patient's hospital stay, and Dr. Mary Jones wrote notes on the following 2 days (total stay=6 days), the NPI would be 2 and the UPC would be 0.67. Therefore, higher NPI and lower UPC designate lower continuity. Significant events occurring during the nighttime were documented in separate notes titled cross‐cover notes. These cross‐cover notes were not included in the calculation of NPI or UPC. In the rare event that 2 or more progress notes were written on the same day, we selected the one used for billing to calculate UPC and NPI.
Outcome Variables
We used AE data from a study we conducted to assess the impact of unit‐based interventions to improve teamwork and patient safety, the methods of which have been previously described.[7] Briefly, we used a 2‐stage medical record review similar to that performed in prior studies.[10, 11, 12, 13] In the first stage, we identified potential AEs using automated queries of the Northwestern Medicine EDW. These queries were based on screening criteria used in the Harvard Medical Practice Study and the Institute for Healthcare Improvement (IHI) Global Trigger Tool.[12, 13] Examples of queries included abnormal laboratory values (eg, international normalized ratio [INR] >6 after hospital day 2 and excluding patients with INR >4 on day 1), administration of rescue medications (eg, naloxone), certain types of incident reports (eg, pressure ulcer), International Classification of Diseases, Ninth Revision (ICD‐9) codes indicating hospital‐acquired conditions (eg, venous thromboembolism), and text searches of progress notes and discharge summaries using natural language processing.[14] Prior research by our group confirmed these automated screens identify a similar number of AEs as manual medical record screening.[14] For each patient with 1 or more potential AE, a research nurse performed a medical record abstraction and created a description of each potential AE.
In the second stage, 2 physician researchers independently reviewed each potential AE in a blinded fashion to determine whether or not an AE was present. An AE was defined as injury due to medical management rather than the natural history of the illness,[15] and included injuries that prolonged the hospital stay or produced disability as well as those resulting in transient disability or abnormal lab values.[16] After independent review, physician reviewers discussed discrepancies in their ratings to achieve consensus.
We tested the reliability of medical record abstractions in our prior study by conducting duplicate abstractions and consensus ratings for a randomly selected sample of 294 patients.[7] The inter‐rater reliability was good for determining the presence of AEs (=0.63).
Statistical Analyses
We calculated descriptive statistics for patient characteristics. Primary discharge diagnosis ICD‐9 codes were categorized using the Healthcare Cost and Utilization Project Clinical Classification Software.[17] We created multivariable logistic regression models with the independent variable being the measure of continuity (NPI or UPC) and the dependent variable being experiencing 1 or more AEs. Covariates included patient age, sex, race, payer, night admission, weekend admission, intensive care unit stay, Medicare Severity Diagnosis Related Group (MS‐DRG) weight, and total number of Elixhauser comorbidities.[18] The length of stay (LOS) was also included as a covariate, as longer LOS increases the probability of discontinuity and may increase the risk for AEs. Because MS‐DRG weight and LOS were highly correlated, we created several models; the first including both as continuous variables, the second including both categorized into quartiles, and a third excluding MS‐DRG weight and including LOS as a continuous variable. Our prior study assessing the impact of unit‐based interventions did not show a statistically significant difference in the pre‐ versus postintervention period, thus we did not include study period as a covariate.
RESULTS
Patient Characteristics
Our analyses included data from 474 hospitalizations. Patient characteristics are shown in Table 1. Patients were a mean 51.118.8 years of age, hospitalized for a mean 3.43.1 days, included 241 (50.8%) women, and 233 (49.2%) persons of nonwhite race. The mean and standard deviation of NPI and UPC were 2.51.0 and 0.60.2. Overall, 47 patients (9.9%) experienced 55 total AEs. AEs included 31 adverse drug events, 6 falls, 5 procedural injuries, 4 manifestations of poor glycemic control, 3 hospital‐acquired infections, 2 episodes of acute renal failure, 1 episode of delirium, 1 pressure ulcer, and 2 categorized as other.
Characteristic | Value |
---|---|
| |
Mean age (SD), y | 55.1 (18.8) |
Mean length of stay (SD), d | 3.4 (3.1) |
Women, n (%) | 241 (50.8) |
Nonwhite race, n (%) | 233 (49.2) |
Payer, n (%) | |
Private | 180 (38) |
Medicare | 165 (34.8) |
Medicaid | 47 (9.9) |
Self‐pay/other | 82 (17.3) |
Night admission, n (%) | 245 (51.7) |
Weekend admission, n (%) | 135 (28.5) |
Intensive care unit stay, n (%) | 18 (3.8) |
Diagnosis, n (%) | |
Diseases of the circulatory system | 95 (20.0) |
Diseases of the digestive system | 65 (13.7) |
Diseases of the respiratory system | 49 (10.3) |
Injury and poisoning | 41 (8.7) |
Diseases of the skin and soft tissue | 31 (6.5) |
Symptoms, signs, and ill‐defined conditions and factors influencing health status | 28 (5.9) |
Endocrine, nutritional, and metabolic diseases and immunity disorders | 25 (5.3) |
Diseases of the genitourinary system | 24 (5.1) |
Diseases of the musculoskeletal system and connective tissue | 23 (4.9) |
Diseases of the nervous system | 23 (4.9) |
Other | 70 (14.8) |
Mean no. of Elixhauser comorbidities (SD) | 2.3 (1.7) |
Mean MS‐DRG weight (SD) | 1.0 (1.0) |
Mean NPI (SD) | 2.5 (1.0) |
Mean UPC (SD) | 0.6 (0.2) |
Association Between Continuity and Adverse Events
In unadjusted models, each 1‐unit increase in the NPI (ie, less continuity) was significantly associated with the incidence of 1 or more AEs (odds ratio [OR]=1.75; P<0.001). However, UPC was not associated with incidence of AEs (OR=1.03; P=0.68) (Table 2). Across all adjusted models, neither NPI nor UPC was significantly associated with the incidence of AEs. The direction of the effect of discontinuity on AEs was inconsistent across models. Though all 3 adjusted models using NPI as the independent variable showed a trend toward increased odds of experiencing 1 or more AE with discontinuity, 2 of the 3 models using UPC showed trends in the opposite direction.
NPI OR (95% CI)* | P Value | UPC OR (95% CI)* | P Value | ||
---|---|---|---|---|---|
| |||||
Unadjusted model | 1.75 (1.332.29) | <0.0001 | 1.03 (0.89‐1.21) | 0.68 | |
Adjusted models | |||||
Model 1 | MS‐DRG and LOS continuous | 1.16 (0.781.72) | 0.47 | 0.96 (0.791.14) | 0.60 |
Model 2 | MS‐DRG and LOS in quartiles | 1.38 (0.981.94) | 0.07 | 1.05 (0.881.26) | 0.59 |
Model 3 | MS‐DRG dropped, LOS continuous | 1.14 (0.771.70) | 0.51 | 0.95 (0.791.14) | 0.56 |
DISCUSSION
We found that hospitalist physician continuity was not associated with the incidence of AEs. Our findings are somewhat surprising because of the high value placed on continuity of care and patient safety concerns related to handoffs. Key clinical information may be lost when patient care is transitioned to a new hospitalist shortly after admission (eg, from a night hospitalist) or at the end of a rotation. Thus, it is logical to assume that discontinuity inherently increases the risk for harm. On the other hand, a physician newly taking over patient care from another may not be anchored to the initial diagnosis and treatment plan established by the first. This second look could potentially prevent missed/delayed diagnoses and optimize the plan of care.[19] These countervailing forces may explain our findings.
Several other potential explanations for our findings should be considered. First, the quality of handoffs may have been sufficient to overcome the potential for information loss. We feel this is unlikely given that little attention had been dedicated to improving the quality of patient handoffs among hospitalists in our institution. Notably, though a number of studies have evaluated resident physician handoffs, most of the work has focused on night coverage, and little is known about the quality of attending handoffs.[20] Second, access to a fully integrated electronic health record may have assisted hospitalists in complementing information received during handoffs. For example, a hospitalist about to start his or her rotation may have remotely accessed and reviewed patient medical records prior to receiving the phone handoff from the outgoing hospitalist. Third, other efforts to improve patient safety may have reduced the overall risk and provided some resilience in the system. Unit‐based interventions, including structured interdisciplinary rounds and nurse‐physician coleadership, improved teamwork climate and reduced AEs in the study hospital over time.[7]
Another factor to consider relates to the fact that hospital care is provided by teams of clinicians (eg, nurses, specialist physicians, therapists, social workers). Hospital teams are often large and have dynamic team membership. Similar to hospitalists, nurses, physician specialists, and other team members handoff care throughout the course of a patient's hospital stay. Yet, discontinuity for each professional type may occur at different times and frequencies. For example, a patient may be handed off from one hospitalist to another, yet the care continues with the same cardiologist or nurse. Future research should better characterize hospital team complexity (eg, size, relationships among members) and dynamics (eg, continuity for various professional types) and the impact of these factors on patient outcomes.
Our findings are important because hospitalist physician discontinuity is common during hospital stays. Hospital medicine groups vary in their staffing and scheduling models. Policies related to admission distribution and rotation length (consecutive days worked) systematically impact physician continuity. Few studies have evaluated the effect on continuity on hospitalized patient outcomes, and no prior research, to our knowledge, has explored the association of continuity on measures of patient safety.[6, 21, 22] Though our study might suggest that staffing models have little impact on patient safety, as previously mentioned, other team factors may influence patient outcomes.
Our study has several limitations. First, we assessed the impact of continuity on AEs in a single site. Although the 7 days on/7 days off model is the most common scheduling pattern used by adult hospital medicine groups,[23] staffing models and patient safety practices vary across hospitals, potentially limiting the generalizability of our study. Second, continuity can be defined and measured in a variety of ways. We used 2 different measures of physician continuity. As previously mentioned, assessing continuity of other clinicians may allow for a more complete understanding of the potential problems related to fragmentation of care. Third, this study excluded patients who experienced care transitions from other hospitals or other units within the hospital. Patients transferred from other hospitals are often complex, severely ill, and may be at higher risk for loss of key clinical information. Fourth, we used automated screens of an EDW to identify potential AEs. Although our prior research found that this method identified a similar number of AEs as manual medical record review screening, there was poor agreement between the 2 methods. Unfortunately, there is no gold standard to identify AEs. The EDW‐facilitated method allowed us to feasibly screen a larger number of charts, increasing statistical power, and minimized any potential bias that might occur during a manual review to identify potential AEs. Finally, we used data available from 2 prior studies and may have been underpowered to detect a significant association between continuity and AEs due to the relatively low percentage of patients experiencing an AE. In a post hoc power calculation, we estimated that we had 70% power to detect a 33% change in the proportion of patients with 1 or more AE for each 1‐unit increase in NPI, and 80% power to detect a 20% change for each 0.1‐unit decrease in UPC.
CONCLUSION
In conclusion, we found that hospitalist physician continuity was not associated with the incidence of AEs. We speculate that hospitalist continuity is only 1 of many team factors that may influence patient safety, and that prior efforts within our institution may have reduced our ability to detect an association. Future research should better characterize hospital team complexity and dynamics and the impact of these factors on patient outcomes.
Disclosures
This project was supported by a grant from the Agency for Healthcare Research and Quality and an Excellence in Academic Medicine Award, administered by Northwestern Memorial Hospital. The authors report no conflicts of interest.
- What is “continuity of care”? J Health Serv Res Policy. 2006;11:248–250. , , .
- Interpersonal continuity of care and care outcomes: a critical review. Ann Fam Med. 2005;3:159–166. , .
- The association between continuity of care and outcomes: a systematic and critical review. J Eval Clin Pract. 2010;16:947–956. , , , .
- Interpersonal continuity of care and patient satisfaction: a critical review. Ann Fam Med. 2004;2:445–451. , .
- Continuity of care in a family practice residency program. Impact on physician satisfaction. J Fam Pract. 1990;31:69–73. , , , .
- The impact of hospitalist discontinuity on hospital cost, readmissions, and patient satisfaction. J Gen Intern Med. 2014;29:1004–1008. , , , et al.
- Implementation of unit‐based interventions to improve teamwork and patient safety on a medical service [published online ahead of print June 11, 2014]. Am J Med Qual. doi: 10.1177/1062860614538093. , , , et al.
- Measuring provider continuity in ambulatory care: an assessment of alternative approaches. Med Care. 1979;17:551–565. .
- Defining and measuring interpersonal continuity of care. Ann Fam Med. 2003;1:134–143. .
- U.S. Department of Health and Human Services. Agency for Healthcare Research and Quality. Adverse events in hospitals: national incidence among medical beneficiaries. Available at: http://psnet.ahrq.gov/resource.aspx?resourceID=19811. Published November 2010. Accessed on December 15, 2014.
- “Global trigger tool” shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff (Millwood). 2011;30:581–589. , , , et al.
- A study of medical injury and medical malpractice. N Engl J Med. 1989;321:480–484. , , , et al.
- Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000;38:261–271. , , , et al.
- Comparison of traditional trigger tool to data warehouse based screening for identifying hospital adverse events. BMJ Qual Saf. 2013;22:130–138. , , , et al.
- Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med. 1991;324:370–376. , , , et al.
- Safety of patients isolated for infection control. JAMA. 2003;290:1899–1905. , , .
- HCUP Clinical Classification Software. Agency for Healthcare Research and Quality, Rockville, MD. http://www.hcup-us.ahrq.gov/toolssoftware/ccs/ccs.jsp. Accessed on December 15, 2014.
- Comorbidity measures for use with administrative data. Med Care. 1998;36:8–27. , , , .
- Does continuity of care matter? No: discontinuity can improve patient care. West J Med. 2001;175:5. .
- Hospitalist handoffs: a systematic review and task force recommendations. J Hosp Med. 2009;4:433–440. , , , , , .
- The impact of fragmentation of hospitalist care on length of stay. J Hosp Med. 2010;5:335–338. , , , , .
- The Creating Incentives and Continuity Leading to Efficiency staffing model: a quality improvement initiative in hospital medicine. Mayo Clin Proc. 2012;87:364–371. , , .
- Society of Hospital Medicine. 2014 state of hospital medicine report. Philadelphia, PA: Society of Hospital Medicine; 2014.
Although definitions vary, continuity of care can be thought of as the patient's experience of a continuous caring relationship with an identified healthcare professional.[1] Research in ambulatory settings has found that patients who see their primary care physician for a higher proportion of office visits have higher patient satisfaction, better hypertensive control, lower risk of hospitalization, and fewer emergency department visits.[2, 3, 4, 5] Continuity with a single hospital‐based physician is difficult to achieve because of the need to provide care 24 hours a day, 7 days a week. Key clinical information may be lost during physician‐to‐physician handoffs (eg, at admission, at the end of rotations on service) during hospitalization. Our research group recently found that lower hospital physician continuity was associated with modestly increased hospital costs, but also a trend toward lower readmissions.[6] We speculated that physicians newly taking over patient care from colleagues reassess diagnoses and treatment plans. This reassessment may identify errors missed by the previous hospital physician. Thus, discontinuity may theoretically help or hinder the provision of safe hospital care.
We sought to examine the relationship between hospital physician continuity and the incidence of adverse events (AEs). We combined data from 2 previously published studies by our research group; one investigated the relationship between hospital physician continuity and costs and 30‐day readmissions, the other assessed the impact of unit‐based interventions on AEs.[6, 7]
METHODS
Setting and Study Design
This retrospective, observational study was conducted at Northwestern Memorial Hospital, an 876‐bed tertiary care teaching hospital in Chicago, Illinois, and was approved by the institutional review board of Northwestern University. Subjects included patients admitted to an adult nonteaching hospitalist service between March 1, 2009 and December 31, 2011. Hospitalists on this service worked without resident physicians in rotations usually lasting 7 consecutive days beginning on Mondays and ending on Sundays. Hospitalists were allowed to switch portions of their schedule with one another, creating the possibility that certain rotations may have been slightly shorter or longer than 7 days. Hospitalists gave verbal sign‐out via telephone to the hospitalist taking over their service on the afternoon of the last day of their rotation. These handoffs customarily involved both hospitalists viewing the electronic health record during the discussion but were not standardized. Night hospitalists performed admissions and cross‐coverage each night from 7 pm to 7 am. Night hospitalists printed history and physicals for day hospitalists, but typically did not give verbal sign‐out on new admissions.
Acquisition of Study Population Data
We identified all patients admitted to the nonteaching hospitalist service using the Northwestern Medicine Enterprise Data Warehouse (EDW), an integrated repository of all clinical and research data sources on the campus. We excluded patients admitted under observation status, those initially admitted to other services (eg, intensive care, general surgery), those discharged from other services, and those cared for by advanced practice providers (ie, nurse practitioners and physician assistants).
Predictor Variables
We identified physicians completing the primary service history and physicals (H&P) and progress notes throughout patients' hospitalizations to calculate 2 measures of continuity: the Number of Physicians Index (NPI), and the Usual Provider of Continuity (UPC) Index.[8, 9] The NPI represented the total number of unique hospitalists completing H&Ps and/or progress notes for a patient. The UPC was calculated as the largest number of notes signed by a single hospitalist divided by the total number of hospitalist notes for a patient. For example, if Dr. John Smith wrote notes on the first 4 days of a patient's hospital stay, and Dr. Mary Jones wrote notes on the following 2 days (total stay=6 days), the NPI would be 2 and the UPC would be 0.67. Therefore, higher NPI and lower UPC designate lower continuity. Significant events occurring during the nighttime were documented in separate notes titled cross‐cover notes. These cross‐cover notes were not included in the calculation of NPI or UPC. In the rare event that 2 or more progress notes were written on the same day, we selected the one used for billing to calculate UPC and NPI.
Outcome Variables
We used AE data from a study we conducted to assess the impact of unit‐based interventions to improve teamwork and patient safety, the methods of which have been previously described.[7] Briefly, we used a 2‐stage medical record review similar to that performed in prior studies.[10, 11, 12, 13] In the first stage, we identified potential AEs using automated queries of the Northwestern Medicine EDW. These queries were based on screening criteria used in the Harvard Medical Practice Study and the Institute for Healthcare Improvement (IHI) Global Trigger Tool.[12, 13] Examples of queries included abnormal laboratory values (eg, international normalized ratio [INR] >6 after hospital day 2 and excluding patients with INR >4 on day 1), administration of rescue medications (eg, naloxone), certain types of incident reports (eg, pressure ulcer), International Classification of Diseases, Ninth Revision (ICD‐9) codes indicating hospital‐acquired conditions (eg, venous thromboembolism), and text searches of progress notes and discharge summaries using natural language processing.[14] Prior research by our group confirmed these automated screens identify a similar number of AEs as manual medical record screening.[14] For each patient with 1 or more potential AE, a research nurse performed a medical record abstraction and created a description of each potential AE.
In the second stage, 2 physician researchers independently reviewed each potential AE in a blinded fashion to determine whether or not an AE was present. An AE was defined as injury due to medical management rather than the natural history of the illness,[15] and included injuries that prolonged the hospital stay or produced disability as well as those resulting in transient disability or abnormal lab values.[16] After independent review, physician reviewers discussed discrepancies in their ratings to achieve consensus.
We tested the reliability of medical record abstractions in our prior study by conducting duplicate abstractions and consensus ratings for a randomly selected sample of 294 patients.[7] The inter‐rater reliability was good for determining the presence of AEs (=0.63).
Statistical Analyses
We calculated descriptive statistics for patient characteristics. Primary discharge diagnosis ICD‐9 codes were categorized using the Healthcare Cost and Utilization Project Clinical Classification Software.[17] We created multivariable logistic regression models with the independent variable being the measure of continuity (NPI or UPC) and the dependent variable being experiencing 1 or more AEs. Covariates included patient age, sex, race, payer, night admission, weekend admission, intensive care unit stay, Medicare Severity Diagnosis Related Group (MS‐DRG) weight, and total number of Elixhauser comorbidities.[18] The length of stay (LOS) was also included as a covariate, as longer LOS increases the probability of discontinuity and may increase the risk for AEs. Because MS‐DRG weight and LOS were highly correlated, we created several models; the first including both as continuous variables, the second including both categorized into quartiles, and a third excluding MS‐DRG weight and including LOS as a continuous variable. Our prior study assessing the impact of unit‐based interventions did not show a statistically significant difference in the pre‐ versus postintervention period, thus we did not include study period as a covariate.
RESULTS
Patient Characteristics
Our analyses included data from 474 hospitalizations. Patient characteristics are shown in Table 1. Patients were a mean 51.118.8 years of age, hospitalized for a mean 3.43.1 days, included 241 (50.8%) women, and 233 (49.2%) persons of nonwhite race. The mean and standard deviation of NPI and UPC were 2.51.0 and 0.60.2. Overall, 47 patients (9.9%) experienced 55 total AEs. AEs included 31 adverse drug events, 6 falls, 5 procedural injuries, 4 manifestations of poor glycemic control, 3 hospital‐acquired infections, 2 episodes of acute renal failure, 1 episode of delirium, 1 pressure ulcer, and 2 categorized as other.
Characteristic | Value |
---|---|
| |
Mean age (SD), y | 55.1 (18.8) |
Mean length of stay (SD), d | 3.4 (3.1) |
Women, n (%) | 241 (50.8) |
Nonwhite race, n (%) | 233 (49.2) |
Payer, n (%) | |
Private | 180 (38) |
Medicare | 165 (34.8) |
Medicaid | 47 (9.9) |
Self‐pay/other | 82 (17.3) |
Night admission, n (%) | 245 (51.7) |
Weekend admission, n (%) | 135 (28.5) |
Intensive care unit stay, n (%) | 18 (3.8) |
Diagnosis, n (%) | |
Diseases of the circulatory system | 95 (20.0) |
Diseases of the digestive system | 65 (13.7) |
Diseases of the respiratory system | 49 (10.3) |
Injury and poisoning | 41 (8.7) |
Diseases of the skin and soft tissue | 31 (6.5) |
Symptoms, signs, and ill‐defined conditions and factors influencing health status | 28 (5.9) |
Endocrine, nutritional, and metabolic diseases and immunity disorders | 25 (5.3) |
Diseases of the genitourinary system | 24 (5.1) |
Diseases of the musculoskeletal system and connective tissue | 23 (4.9) |
Diseases of the nervous system | 23 (4.9) |
Other | 70 (14.8) |
Mean no. of Elixhauser comorbidities (SD) | 2.3 (1.7) |
Mean MS‐DRG weight (SD) | 1.0 (1.0) |
Mean NPI (SD) | 2.5 (1.0) |
Mean UPC (SD) | 0.6 (0.2) |
Association Between Continuity and Adverse Events
In unadjusted models, each 1‐unit increase in the NPI (ie, less continuity) was significantly associated with the incidence of 1 or more AEs (odds ratio [OR]=1.75; P<0.001). However, UPC was not associated with incidence of AEs (OR=1.03; P=0.68) (Table 2). Across all adjusted models, neither NPI nor UPC was significantly associated with the incidence of AEs. The direction of the effect of discontinuity on AEs was inconsistent across models. Though all 3 adjusted models using NPI as the independent variable showed a trend toward increased odds of experiencing 1 or more AE with discontinuity, 2 of the 3 models using UPC showed trends in the opposite direction.
NPI OR (95% CI)* | P Value | UPC OR (95% CI)* | P Value | ||
---|---|---|---|---|---|
| |||||
Unadjusted model | 1.75 (1.332.29) | <0.0001 | 1.03 (0.89‐1.21) | 0.68 | |
Adjusted models | |||||
Model 1 | MS‐DRG and LOS continuous | 1.16 (0.781.72) | 0.47 | 0.96 (0.791.14) | 0.60 |
Model 2 | MS‐DRG and LOS in quartiles | 1.38 (0.981.94) | 0.07 | 1.05 (0.881.26) | 0.59 |
Model 3 | MS‐DRG dropped, LOS continuous | 1.14 (0.771.70) | 0.51 | 0.95 (0.791.14) | 0.56 |
DISCUSSION
We found that hospitalist physician continuity was not associated with the incidence of AEs. Our findings are somewhat surprising because of the high value placed on continuity of care and patient safety concerns related to handoffs. Key clinical information may be lost when patient care is transitioned to a new hospitalist shortly after admission (eg, from a night hospitalist) or at the end of a rotation. Thus, it is logical to assume that discontinuity inherently increases the risk for harm. On the other hand, a physician newly taking over patient care from another may not be anchored to the initial diagnosis and treatment plan established by the first. This second look could potentially prevent missed/delayed diagnoses and optimize the plan of care.[19] These countervailing forces may explain our findings.
Several other potential explanations for our findings should be considered. First, the quality of handoffs may have been sufficient to overcome the potential for information loss. We feel this is unlikely given that little attention had been dedicated to improving the quality of patient handoffs among hospitalists in our institution. Notably, though a number of studies have evaluated resident physician handoffs, most of the work has focused on night coverage, and little is known about the quality of attending handoffs.[20] Second, access to a fully integrated electronic health record may have assisted hospitalists in complementing information received during handoffs. For example, a hospitalist about to start his or her rotation may have remotely accessed and reviewed patient medical records prior to receiving the phone handoff from the outgoing hospitalist. Third, other efforts to improve patient safety may have reduced the overall risk and provided some resilience in the system. Unit‐based interventions, including structured interdisciplinary rounds and nurse‐physician coleadership, improved teamwork climate and reduced AEs in the study hospital over time.[7]
Another factor to consider relates to the fact that hospital care is provided by teams of clinicians (eg, nurses, specialist physicians, therapists, social workers). Hospital teams are often large and have dynamic team membership. Similar to hospitalists, nurses, physician specialists, and other team members handoff care throughout the course of a patient's hospital stay. Yet, discontinuity for each professional type may occur at different times and frequencies. For example, a patient may be handed off from one hospitalist to another, yet the care continues with the same cardiologist or nurse. Future research should better characterize hospital team complexity (eg, size, relationships among members) and dynamics (eg, continuity for various professional types) and the impact of these factors on patient outcomes.
Our findings are important because hospitalist physician discontinuity is common during hospital stays. Hospital medicine groups vary in their staffing and scheduling models. Policies related to admission distribution and rotation length (consecutive days worked) systematically impact physician continuity. Few studies have evaluated the effect on continuity on hospitalized patient outcomes, and no prior research, to our knowledge, has explored the association of continuity on measures of patient safety.[6, 21, 22] Though our study might suggest that staffing models have little impact on patient safety, as previously mentioned, other team factors may influence patient outcomes.
Our study has several limitations. First, we assessed the impact of continuity on AEs in a single site. Although the 7 days on/7 days off model is the most common scheduling pattern used by adult hospital medicine groups,[23] staffing models and patient safety practices vary across hospitals, potentially limiting the generalizability of our study. Second, continuity can be defined and measured in a variety of ways. We used 2 different measures of physician continuity. As previously mentioned, assessing continuity of other clinicians may allow for a more complete understanding of the potential problems related to fragmentation of care. Third, this study excluded patients who experienced care transitions from other hospitals or other units within the hospital. Patients transferred from other hospitals are often complex, severely ill, and may be at higher risk for loss of key clinical information. Fourth, we used automated screens of an EDW to identify potential AEs. Although our prior research found that this method identified a similar number of AEs as manual medical record review screening, there was poor agreement between the 2 methods. Unfortunately, there is no gold standard to identify AEs. The EDW‐facilitated method allowed us to feasibly screen a larger number of charts, increasing statistical power, and minimized any potential bias that might occur during a manual review to identify potential AEs. Finally, we used data available from 2 prior studies and may have been underpowered to detect a significant association between continuity and AEs due to the relatively low percentage of patients experiencing an AE. In a post hoc power calculation, we estimated that we had 70% power to detect a 33% change in the proportion of patients with 1 or more AE for each 1‐unit increase in NPI, and 80% power to detect a 20% change for each 0.1‐unit decrease in UPC.
CONCLUSION
In conclusion, we found that hospitalist physician continuity was not associated with the incidence of AEs. We speculate that hospitalist continuity is only 1 of many team factors that may influence patient safety, and that prior efforts within our institution may have reduced our ability to detect an association. Future research should better characterize hospital team complexity and dynamics and the impact of these factors on patient outcomes.
Disclosures
This project was supported by a grant from the Agency for Healthcare Research and Quality and an Excellence in Academic Medicine Award, administered by Northwestern Memorial Hospital. The authors report no conflicts of interest.
Although definitions vary, continuity of care can be thought of as the patient's experience of a continuous caring relationship with an identified healthcare professional.[1] Research in ambulatory settings has found that patients who see their primary care physician for a higher proportion of office visits have higher patient satisfaction, better hypertensive control, lower risk of hospitalization, and fewer emergency department visits.[2, 3, 4, 5] Continuity with a single hospital‐based physician is difficult to achieve because of the need to provide care 24 hours a day, 7 days a week. Key clinical information may be lost during physician‐to‐physician handoffs (eg, at admission, at the end of rotations on service) during hospitalization. Our research group recently found that lower hospital physician continuity was associated with modestly increased hospital costs, but also a trend toward lower readmissions.[6] We speculated that physicians newly taking over patient care from colleagues reassess diagnoses and treatment plans. This reassessment may identify errors missed by the previous hospital physician. Thus, discontinuity may theoretically help or hinder the provision of safe hospital care.
We sought to examine the relationship between hospital physician continuity and the incidence of adverse events (AEs). We combined data from 2 previously published studies by our research group; one investigated the relationship between hospital physician continuity and costs and 30‐day readmissions, the other assessed the impact of unit‐based interventions on AEs.[6, 7]
METHODS
Setting and Study Design
This retrospective, observational study was conducted at Northwestern Memorial Hospital, an 876‐bed tertiary care teaching hospital in Chicago, Illinois, and was approved by the institutional review board of Northwestern University. Subjects included patients admitted to an adult nonteaching hospitalist service between March 1, 2009 and December 31, 2011. Hospitalists on this service worked without resident physicians in rotations usually lasting 7 consecutive days beginning on Mondays and ending on Sundays. Hospitalists were allowed to switch portions of their schedule with one another, creating the possibility that certain rotations may have been slightly shorter or longer than 7 days. Hospitalists gave verbal sign‐out via telephone to the hospitalist taking over their service on the afternoon of the last day of their rotation. These handoffs customarily involved both hospitalists viewing the electronic health record during the discussion but were not standardized. Night hospitalists performed admissions and cross‐coverage each night from 7 pm to 7 am. Night hospitalists printed history and physicals for day hospitalists, but typically did not give verbal sign‐out on new admissions.
Acquisition of Study Population Data
We identified all patients admitted to the nonteaching hospitalist service using the Northwestern Medicine Enterprise Data Warehouse (EDW), an integrated repository of all clinical and research data sources on the campus. We excluded patients admitted under observation status, those initially admitted to other services (eg, intensive care, general surgery), those discharged from other services, and those cared for by advanced practice providers (ie, nurse practitioners and physician assistants).
Predictor Variables
We identified physicians completing the primary service history and physicals (H&P) and progress notes throughout patients' hospitalizations to calculate 2 measures of continuity: the Number of Physicians Index (NPI), and the Usual Provider of Continuity (UPC) Index.[8, 9] The NPI represented the total number of unique hospitalists completing H&Ps and/or progress notes for a patient. The UPC was calculated as the largest number of notes signed by a single hospitalist divided by the total number of hospitalist notes for a patient. For example, if Dr. John Smith wrote notes on the first 4 days of a patient's hospital stay, and Dr. Mary Jones wrote notes on the following 2 days (total stay=6 days), the NPI would be 2 and the UPC would be 0.67. Therefore, higher NPI and lower UPC designate lower continuity. Significant events occurring during the nighttime were documented in separate notes titled cross‐cover notes. These cross‐cover notes were not included in the calculation of NPI or UPC. In the rare event that 2 or more progress notes were written on the same day, we selected the one used for billing to calculate UPC and NPI.
Outcome Variables
We used AE data from a study we conducted to assess the impact of unit‐based interventions to improve teamwork and patient safety, the methods of which have been previously described.[7] Briefly, we used a 2‐stage medical record review similar to that performed in prior studies.[10, 11, 12, 13] In the first stage, we identified potential AEs using automated queries of the Northwestern Medicine EDW. These queries were based on screening criteria used in the Harvard Medical Practice Study and the Institute for Healthcare Improvement (IHI) Global Trigger Tool.[12, 13] Examples of queries included abnormal laboratory values (eg, international normalized ratio [INR] >6 after hospital day 2 and excluding patients with INR >4 on day 1), administration of rescue medications (eg, naloxone), certain types of incident reports (eg, pressure ulcer), International Classification of Diseases, Ninth Revision (ICD‐9) codes indicating hospital‐acquired conditions (eg, venous thromboembolism), and text searches of progress notes and discharge summaries using natural language processing.[14] Prior research by our group confirmed these automated screens identify a similar number of AEs as manual medical record screening.[14] For each patient with 1 or more potential AE, a research nurse performed a medical record abstraction and created a description of each potential AE.
In the second stage, 2 physician researchers independently reviewed each potential AE in a blinded fashion to determine whether or not an AE was present. An AE was defined as injury due to medical management rather than the natural history of the illness,[15] and included injuries that prolonged the hospital stay or produced disability as well as those resulting in transient disability or abnormal lab values.[16] After independent review, physician reviewers discussed discrepancies in their ratings to achieve consensus.
We tested the reliability of medical record abstractions in our prior study by conducting duplicate abstractions and consensus ratings for a randomly selected sample of 294 patients.[7] The inter‐rater reliability was good for determining the presence of AEs (=0.63).
Statistical Analyses
We calculated descriptive statistics for patient characteristics. Primary discharge diagnosis ICD‐9 codes were categorized using the Healthcare Cost and Utilization Project Clinical Classification Software.[17] We created multivariable logistic regression models with the independent variable being the measure of continuity (NPI or UPC) and the dependent variable being experiencing 1 or more AEs. Covariates included patient age, sex, race, payer, night admission, weekend admission, intensive care unit stay, Medicare Severity Diagnosis Related Group (MS‐DRG) weight, and total number of Elixhauser comorbidities.[18] The length of stay (LOS) was also included as a covariate, as longer LOS increases the probability of discontinuity and may increase the risk for AEs. Because MS‐DRG weight and LOS were highly correlated, we created several models; the first including both as continuous variables, the second including both categorized into quartiles, and a third excluding MS‐DRG weight and including LOS as a continuous variable. Our prior study assessing the impact of unit‐based interventions did not show a statistically significant difference in the pre‐ versus postintervention period, thus we did not include study period as a covariate.
RESULTS
Patient Characteristics
Our analyses included data from 474 hospitalizations. Patient characteristics are shown in Table 1. Patients were a mean 51.118.8 years of age, hospitalized for a mean 3.43.1 days, included 241 (50.8%) women, and 233 (49.2%) persons of nonwhite race. The mean and standard deviation of NPI and UPC were 2.51.0 and 0.60.2. Overall, 47 patients (9.9%) experienced 55 total AEs. AEs included 31 adverse drug events, 6 falls, 5 procedural injuries, 4 manifestations of poor glycemic control, 3 hospital‐acquired infections, 2 episodes of acute renal failure, 1 episode of delirium, 1 pressure ulcer, and 2 categorized as other.
Characteristic | Value |
---|---|
| |
Mean age (SD), y | 55.1 (18.8) |
Mean length of stay (SD), d | 3.4 (3.1) |
Women, n (%) | 241 (50.8) |
Nonwhite race, n (%) | 233 (49.2) |
Payer, n (%) | |
Private | 180 (38) |
Medicare | 165 (34.8) |
Medicaid | 47 (9.9) |
Self‐pay/other | 82 (17.3) |
Night admission, n (%) | 245 (51.7) |
Weekend admission, n (%) | 135 (28.5) |
Intensive care unit stay, n (%) | 18 (3.8) |
Diagnosis, n (%) | |
Diseases of the circulatory system | 95 (20.0) |
Diseases of the digestive system | 65 (13.7) |
Diseases of the respiratory system | 49 (10.3) |
Injury and poisoning | 41 (8.7) |
Diseases of the skin and soft tissue | 31 (6.5) |
Symptoms, signs, and ill‐defined conditions and factors influencing health status | 28 (5.9) |
Endocrine, nutritional, and metabolic diseases and immunity disorders | 25 (5.3) |
Diseases of the genitourinary system | 24 (5.1) |
Diseases of the musculoskeletal system and connective tissue | 23 (4.9) |
Diseases of the nervous system | 23 (4.9) |
Other | 70 (14.8) |
Mean no. of Elixhauser comorbidities (SD) | 2.3 (1.7) |
Mean MS‐DRG weight (SD) | 1.0 (1.0) |
Mean NPI (SD) | 2.5 (1.0) |
Mean UPC (SD) | 0.6 (0.2) |
Association Between Continuity and Adverse Events
In unadjusted models, each 1‐unit increase in the NPI (ie, less continuity) was significantly associated with the incidence of 1 or more AEs (odds ratio [OR]=1.75; P<0.001). However, UPC was not associated with incidence of AEs (OR=1.03; P=0.68) (Table 2). Across all adjusted models, neither NPI nor UPC was significantly associated with the incidence of AEs. The direction of the effect of discontinuity on AEs was inconsistent across models. Though all 3 adjusted models using NPI as the independent variable showed a trend toward increased odds of experiencing 1 or more AE with discontinuity, 2 of the 3 models using UPC showed trends in the opposite direction.
NPI OR (95% CI)* | P Value | UPC OR (95% CI)* | P Value | ||
---|---|---|---|---|---|
| |||||
Unadjusted model | 1.75 (1.332.29) | <0.0001 | 1.03 (0.89‐1.21) | 0.68 | |
Adjusted models | |||||
Model 1 | MS‐DRG and LOS continuous | 1.16 (0.781.72) | 0.47 | 0.96 (0.791.14) | 0.60 |
Model 2 | MS‐DRG and LOS in quartiles | 1.38 (0.981.94) | 0.07 | 1.05 (0.881.26) | 0.59 |
Model 3 | MS‐DRG dropped, LOS continuous | 1.14 (0.771.70) | 0.51 | 0.95 (0.791.14) | 0.56 |
DISCUSSION
We found that hospitalist physician continuity was not associated with the incidence of AEs. Our findings are somewhat surprising because of the high value placed on continuity of care and patient safety concerns related to handoffs. Key clinical information may be lost when patient care is transitioned to a new hospitalist shortly after admission (eg, from a night hospitalist) or at the end of a rotation. Thus, it is logical to assume that discontinuity inherently increases the risk for harm. On the other hand, a physician newly taking over patient care from another may not be anchored to the initial diagnosis and treatment plan established by the first. This second look could potentially prevent missed/delayed diagnoses and optimize the plan of care.[19] These countervailing forces may explain our findings.
Several other potential explanations for our findings should be considered. First, the quality of handoffs may have been sufficient to overcome the potential for information loss. We feel this is unlikely given that little attention had been dedicated to improving the quality of patient handoffs among hospitalists in our institution. Notably, though a number of studies have evaluated resident physician handoffs, most of the work has focused on night coverage, and little is known about the quality of attending handoffs.[20] Second, access to a fully integrated electronic health record may have assisted hospitalists in complementing information received during handoffs. For example, a hospitalist about to start his or her rotation may have remotely accessed and reviewed patient medical records prior to receiving the phone handoff from the outgoing hospitalist. Third, other efforts to improve patient safety may have reduced the overall risk and provided some resilience in the system. Unit‐based interventions, including structured interdisciplinary rounds and nurse‐physician coleadership, improved teamwork climate and reduced AEs in the study hospital over time.[7]
Another factor to consider relates to the fact that hospital care is provided by teams of clinicians (eg, nurses, specialist physicians, therapists, social workers). Hospital teams are often large and have dynamic team membership. Similar to hospitalists, nurses, physician specialists, and other team members handoff care throughout the course of a patient's hospital stay. Yet, discontinuity for each professional type may occur at different times and frequencies. For example, a patient may be handed off from one hospitalist to another, yet the care continues with the same cardiologist or nurse. Future research should better characterize hospital team complexity (eg, size, relationships among members) and dynamics (eg, continuity for various professional types) and the impact of these factors on patient outcomes.
Our findings are important because hospitalist physician discontinuity is common during hospital stays. Hospital medicine groups vary in their staffing and scheduling models. Policies related to admission distribution and rotation length (consecutive days worked) systematically impact physician continuity. Few studies have evaluated the effect on continuity on hospitalized patient outcomes, and no prior research, to our knowledge, has explored the association of continuity on measures of patient safety.[6, 21, 22] Though our study might suggest that staffing models have little impact on patient safety, as previously mentioned, other team factors may influence patient outcomes.
Our study has several limitations. First, we assessed the impact of continuity on AEs in a single site. Although the 7 days on/7 days off model is the most common scheduling pattern used by adult hospital medicine groups,[23] staffing models and patient safety practices vary across hospitals, potentially limiting the generalizability of our study. Second, continuity can be defined and measured in a variety of ways. We used 2 different measures of physician continuity. As previously mentioned, assessing continuity of other clinicians may allow for a more complete understanding of the potential problems related to fragmentation of care. Third, this study excluded patients who experienced care transitions from other hospitals or other units within the hospital. Patients transferred from other hospitals are often complex, severely ill, and may be at higher risk for loss of key clinical information. Fourth, we used automated screens of an EDW to identify potential AEs. Although our prior research found that this method identified a similar number of AEs as manual medical record review screening, there was poor agreement between the 2 methods. Unfortunately, there is no gold standard to identify AEs. The EDW‐facilitated method allowed us to feasibly screen a larger number of charts, increasing statistical power, and minimized any potential bias that might occur during a manual review to identify potential AEs. Finally, we used data available from 2 prior studies and may have been underpowered to detect a significant association between continuity and AEs due to the relatively low percentage of patients experiencing an AE. In a post hoc power calculation, we estimated that we had 70% power to detect a 33% change in the proportion of patients with 1 or more AE for each 1‐unit increase in NPI, and 80% power to detect a 20% change for each 0.1‐unit decrease in UPC.
CONCLUSION
In conclusion, we found that hospitalist physician continuity was not associated with the incidence of AEs. We speculate that hospitalist continuity is only 1 of many team factors that may influence patient safety, and that prior efforts within our institution may have reduced our ability to detect an association. Future research should better characterize hospital team complexity and dynamics and the impact of these factors on patient outcomes.
Disclosures
This project was supported by a grant from the Agency for Healthcare Research and Quality and an Excellence in Academic Medicine Award, administered by Northwestern Memorial Hospital. The authors report no conflicts of interest.
- What is “continuity of care”? J Health Serv Res Policy. 2006;11:248–250. , , .
- Interpersonal continuity of care and care outcomes: a critical review. Ann Fam Med. 2005;3:159–166. , .
- The association between continuity of care and outcomes: a systematic and critical review. J Eval Clin Pract. 2010;16:947–956. , , , .
- Interpersonal continuity of care and patient satisfaction: a critical review. Ann Fam Med. 2004;2:445–451. , .
- Continuity of care in a family practice residency program. Impact on physician satisfaction. J Fam Pract. 1990;31:69–73. , , , .
- The impact of hospitalist discontinuity on hospital cost, readmissions, and patient satisfaction. J Gen Intern Med. 2014;29:1004–1008. , , , et al.
- Implementation of unit‐based interventions to improve teamwork and patient safety on a medical service [published online ahead of print June 11, 2014]. Am J Med Qual. doi: 10.1177/1062860614538093. , , , et al.
- Measuring provider continuity in ambulatory care: an assessment of alternative approaches. Med Care. 1979;17:551–565. .
- Defining and measuring interpersonal continuity of care. Ann Fam Med. 2003;1:134–143. .
- U.S. Department of Health and Human Services. Agency for Healthcare Research and Quality. Adverse events in hospitals: national incidence among medical beneficiaries. Available at: http://psnet.ahrq.gov/resource.aspx?resourceID=19811. Published November 2010. Accessed on December 15, 2014.
- “Global trigger tool” shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff (Millwood). 2011;30:581–589. , , , et al.
- A study of medical injury and medical malpractice. N Engl J Med. 1989;321:480–484. , , , et al.
- Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000;38:261–271. , , , et al.
- Comparison of traditional trigger tool to data warehouse based screening for identifying hospital adverse events. BMJ Qual Saf. 2013;22:130–138. , , , et al.
- Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med. 1991;324:370–376. , , , et al.
- Safety of patients isolated for infection control. JAMA. 2003;290:1899–1905. , , .
- HCUP Clinical Classification Software. Agency for Healthcare Research and Quality, Rockville, MD. http://www.hcup-us.ahrq.gov/toolssoftware/ccs/ccs.jsp. Accessed on December 15, 2014.
- Comorbidity measures for use with administrative data. Med Care. 1998;36:8–27. , , , .
- Does continuity of care matter? No: discontinuity can improve patient care. West J Med. 2001;175:5. .
- Hospitalist handoffs: a systematic review and task force recommendations. J Hosp Med. 2009;4:433–440. , , , , , .
- The impact of fragmentation of hospitalist care on length of stay. J Hosp Med. 2010;5:335–338. , , , , .
- The Creating Incentives and Continuity Leading to Efficiency staffing model: a quality improvement initiative in hospital medicine. Mayo Clin Proc. 2012;87:364–371. , , .
- Society of Hospital Medicine. 2014 state of hospital medicine report. Philadelphia, PA: Society of Hospital Medicine; 2014.
- What is “continuity of care”? J Health Serv Res Policy. 2006;11:248–250. , , .
- Interpersonal continuity of care and care outcomes: a critical review. Ann Fam Med. 2005;3:159–166. , .
- The association between continuity of care and outcomes: a systematic and critical review. J Eval Clin Pract. 2010;16:947–956. , , , .
- Interpersonal continuity of care and patient satisfaction: a critical review. Ann Fam Med. 2004;2:445–451. , .
- Continuity of care in a family practice residency program. Impact on physician satisfaction. J Fam Pract. 1990;31:69–73. , , , .
- The impact of hospitalist discontinuity on hospital cost, readmissions, and patient satisfaction. J Gen Intern Med. 2014;29:1004–1008. , , , et al.
- Implementation of unit‐based interventions to improve teamwork and patient safety on a medical service [published online ahead of print June 11, 2014]. Am J Med Qual. doi: 10.1177/1062860614538093. , , , et al.
- Measuring provider continuity in ambulatory care: an assessment of alternative approaches. Med Care. 1979;17:551–565. .
- Defining and measuring interpersonal continuity of care. Ann Fam Med. 2003;1:134–143. .
- U.S. Department of Health and Human Services. Agency for Healthcare Research and Quality. Adverse events in hospitals: national incidence among medical beneficiaries. Available at: http://psnet.ahrq.gov/resource.aspx?resourceID=19811. Published November 2010. Accessed on December 15, 2014.
- “Global trigger tool” shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff (Millwood). 2011;30:581–589. , , , et al.
- A study of medical injury and medical malpractice. N Engl J Med. 1989;321:480–484. , , , et al.
- Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000;38:261–271. , , , et al.
- Comparison of traditional trigger tool to data warehouse based screening for identifying hospital adverse events. BMJ Qual Saf. 2013;22:130–138. , , , et al.
- Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med. 1991;324:370–376. , , , et al.
- Safety of patients isolated for infection control. JAMA. 2003;290:1899–1905. , , .
- HCUP Clinical Classification Software. Agency for Healthcare Research and Quality, Rockville, MD. http://www.hcup-us.ahrq.gov/toolssoftware/ccs/ccs.jsp. Accessed on December 15, 2014.
- Comorbidity measures for use with administrative data. Med Care. 1998;36:8–27. , , , .
- Does continuity of care matter? No: discontinuity can improve patient care. West J Med. 2001;175:5. .
- Hospitalist handoffs: a systematic review and task force recommendations. J Hosp Med. 2009;4:433–440. , , , , , .
- The impact of fragmentation of hospitalist care on length of stay. J Hosp Med. 2010;5:335–338. , , , , .
- The Creating Incentives and Continuity Leading to Efficiency staffing model: a quality improvement initiative in hospital medicine. Mayo Clin Proc. 2012;87:364–371. , , .
- Society of Hospital Medicine. 2014 state of hospital medicine report. Philadelphia, PA: Society of Hospital Medicine; 2014.
© 2014 Society of Hospital Medicine