User login
Perspectives of Clinicians, Staff, and Veterans in Transitioning Veterans from non-VA Hospitals to Primary Care in a Single VA Healthcare System
As the VA moves toward increased utilization of non-VA care, it is crucial to understand and address the challenges of transitional care faced by dual-use veterans to provide high-quality care that improves healthcare outcomes.7,11,12 The VA implemented a shift in policy from the Veterans Access, Choice, and Accountability Act of 2014 (Public Law 113-146; “Choice Act”) to the VA Maintaining Internal Systems and Strengthening Integrated Outside Networks (MISSION) Act beginning June 6, 2019.13,14 Under the MISSION Act, veterans have more ways to access healthcare within the VA’s network and through approved non-VA medical providers in the community known as “community care providers.”15 This shift expanded the existing VA Choice Act of 2014, where the program allowed those veterans who are unable to schedule an appointment within 30 days of their preferred date or the clinically appropriate date, or on the basis of their place of residence, to elect to receive care from eligible non-VA healthcare entities or providers.14,15 These efforts to better serve veterans by increasing non-VA care might present added care coordination challenges for patients and their providers when they seek care in the VA.
High-quality transitional care prevents poor outcomes such as hospital readmissions.16-18 When communication and coordination across healthcare delivery systems are lacking, patients and their families often find themselves at risk for adverse events.19,20 Past research shows that patients have fewer adverse events when they receive comprehensive postdischarge care, including instructions on medications and self-care, symptom recognition and management, and reminders to attend follow-up appointments.17,21,22 Although researchers have identified the components of effective transitional care,23 barriers persist. The communication and collaboration needed to provide coordinated care across healthcare delivery systems are difficult due to the lack of standardized approaches between systems.24 Consequently, follow-up care may be delayed or missed altogether. To our knowledge, there is no published research identifying transitional care challenges for clinicians, staff, and veterans in transitioning from non-VA hospitals to a VA primary care setting.
The objective of this quality assessment was to understand VA and non-VA hospital clinicians’ and staff as well as veterans’ perspectives of the barriers and facilitators to providing high-quality transitional care.
METHODS
Study Design
We conducted a qualitative assessment within the VA Eastern Colorado Health Care System, an urban tertiary medical center, as well as urban and rural non-VA hospitals used by veterans. Semi-structured interview guides informed by the practical robust implementation and sustainability (PRISM) model, the Lean approach, and the Ideal Transitions of Care Bridge were used.25-27 We explored the PRISM domains such as recipient’s characteristics, the interaction with the external environment, and the implementation and sustainability infrastructure to inform the design and implementation of the intervention.25 The Lean approach included methods to optimize processes by maximizing efficiency and minimizing waste.26 The Ideal Transitions of Care Bridge was used to identify the domains in transitions of care such as discharge planning, communication of information, and care coordination.27
Setting and Participants
We identified the top 10 non-VA hospitals serving the most urban and rural veterans in 2015 using VA administrative data. Purposive sampling was used to ensure that urban and rural non-VA hospitals and different roles within these hospitals were represented. VA clinicians and staff were selected from the Denver VA Medical Center, a tertiary hospital within the Eastern Colorado Health Care System and one VA Community-Based Outpatient Clinic (CBOC) that primarily serves rural veterans. The Denver VA Medical Center has three clinics staffed by Patient Aligned Care Teams (PACTs), a model built on the concept of Patient-Centered Medical Home.28 Hospital leadership were initially approached for permission to recruit their staff and to be involved as key informants, and all agreed. To ensure representativeness, diversity of roles was recruited, including PACT primary care physicians, nurses, and other staff members such as medical assistants and administrators. Veterans were approached for sampling if they were discharged from a non-VA hospital during June–September 2015 and used the VA for primary care. This was to ensure that they remembered the process they went through postdischarge at the time of the interview.
Data Collection and Analysis
The evaluation team members (RA, EL, and MM) conducted the interviews from November 2015 to July 2016. Clinicians, staff, and veterans were asked semi-structured questions about their experiences and their role in transitioning VA patients across systems (see Appendix for interview guides). Veterans were asked to describe their experience and satisfaction with the current postdischarge transition process. We stopped the interviews when we reached data saturation.29
Interviews were audio-recorded, transcribed verbatim, and validated (transcribed interviews were double-checked against recording) to ensure data quality and accuracy. Coding was guided by a conventional content analysis technique30, 31 using a deductive and inductive coding approach.31 The deductive coding approach was drawn from the Ideal Transitions of Care Bridge and PRISM domains. 32,33 Two evaluation team members (RA and EL) defined the initial code book by independently coding the first three interviews, worked to clarify the meanings of emergent codes, and came to a consensus when disagreements occurred. Next, a priori codes were added by team members to include the PRISM domains. These PRISM domains included the implementation and sustainability infrastructure, the external environment, the characteristics of intervention recipients, and the organizational and patient perspectives of an intervention.
Additional emergent codes were added to the code book and agreed upon by team members (RA, EL, and MM). Consistent with previously used methods, consensus building was achieved by identifying and resolving differences by discussing with team members (RA, EL, MM, CB, and RB).29 Codes were examined and organized into themes by team members.29,34-36 This process was continued until no new themes were identified. Results were reviewed by all evaluation team members to assess thoroughness and comprehensiveness.34,35 In addition, team members triangulated the findings with VA and non-VA participants to ensure validity and reduce researcher bias.29,37
RESULTS
We conducted a total of 70 interviews with 23 VA and 29 non-VA hospital clinicians and staff and 18 veterans (Table 1). Overall, we found that there was no standardized process for transitioning veterans across healthcare delivery systems. Participants reported that transitions were often inefficient when non-VA hospitals could not (1) identify patients as veterans and notify VA primary care of discharge; (2) transfer non-VA hospital medical records to VA primary care; (3) obtain follow-up care appointments with VA primary care; and (4) write VA formulary medications for veterans to fill at VA pharmacies. In addition, participants discussed about facilitators and suggestions to overcome these inefficiencies and improve transitional care (Table2). We mapped the identified barriers as well as the suggestions for improvement to the PRISM and the Ideal Transitions of Care Bridge domains (Table 3).
Unable to Identify Patients as Veterans and Notify VA Primary Care of Discharge
VA and non-VA participants reported difficulty in communicating about veterans’ hospitalizations and discharge follow-up needs across systems. Non-VA clinicians referenced difficulty in identifying patients as veterans to communicate with VA, except in instances where the VA is a payor, while VA providers described feeling largely uninformed of the veterans non-VA hospitalization. For non-VA clinicians, the lack of a systematic method for veteran identification often left them to inadvertently identify veteran status by asking about their primary care clinicians and insurance and even through an offhanded comment made by the veteran. If a veteran was identified, non-VA clinicians described being uncertain about the best way to notify VA primary care of the patient’s impending discharge. Veterans described instances of the non-VA hospital knowing their veteran status upon admission, but accounts varied on whether the non-VA hospital notified the VA primary care of their hospitalization (Table 2, Theme 1).
Unable to Transfer Non-VA Hospital Medical Records to VA Primary Care
VA clinicians discussed about the challenges associated with obtaining the veteran’s medical record from the non-VA hospitals, and when it was received, it was often incomplete information and significantly delayed. They described relying on the veteran’s description of the care received, which was not complete or accurate information needed to make clinical judgment or coordinate follow-up care. Non-VA clinicians mentioned about trying several methods for transferring the medical record to VA primary care, including discharge summary via electronic system and sometimes solely relying on patients to deliver discharge paperwork to their primary care clinicians. In instances where non-VA hospitals sent discharge paperwork to VA, there was no way for non-VA hospitals to verify whether the faxed electronic medical record was received by the VA hospital. Most of the veterans discussed receiving written postdischarge instructions to take to their VA primary care clinicians; however, they were unsure whether the VA primary care received their medical record or any other information from the non-VA hospital (Table 2, Theme 2).
Unable to Obtain Follow-Up Care Appointments with VA Primary Care
All participants described how difficult it was to obtain a follow-up appointment for veterans with VA primary care. This often resulted in delayed follow-up care. VA clinicians also shared that a non-VA hospitalization can be the impetus for a veteran to seek care at the VA for the very first time. Once eligibility is determined, the veteran is assigned a VA primary care clinician. This process may take up to six weeks, and in the meantime, the veteran is scheduled in VA urgent care for immediate postdischarge care. This lag in primary care assignment creates delayed and fragmented care (Table 2, Theme 3).
Non-VA clinicians, administrators, and staff also discussed the difficulties in scheduling follow-up care with VA primary care. Although discharge paperwork instructed patients to see their VA clinicians, there was no process in place for non-VA clinicians to confirm whether the follow-up care was received due to lack of bilateral communication. In addition, veterans discussed the inefficiencies in scheduling follow-up appointments with VA clinicians where attempts to follow-up with primary care clinicians took eight weeks or more. Several veterans described walking into the clinic without an appointment asking to be seen postdischarge or utilizing the VA emergency department for follow-up care after discharge from a non-VA hospital. Veterans admitted utilizing the VA emergency department for nonemergent reasons such as filling their prescriptions because they are unable to see a VA PCP in a timely manner (Table 2, Theme 3).
Unable to Write VA Formulary Medications for Veterans to Fill at VA Pharmacies
All participants described the difficulties in obtaining medications at VA pharmacies when prescribed by the non-VA hospital clinicians. VA clinicians often had to reassess, and rewrite prescriptions written by clinicians, causing delays. Moreover, rural VA clinicians described lack of VA pharmacies in their locations, where veterans had to mail order medications, causing further delays in needed medications. Non-VA clinicians echoed these frustrations. They noted that veterans were confused about their VA pharmacy benefits as well as the need for the non-VA clinicians to follow VA formulary guidelines. Veterans expressed that it was especially challenging to physically go to the VA pharmacy to pick up medications after discharge due to lack of transportation, limited VA pharmacy hours, and long wait times. Several veterans discussed paying for their prescriptions out of pocket even though they had VA pharmacy benefits because it was more convenient to use the non-VA pharmacy. In other instances, veterans discussed going to a VA emergency department and waiting for hours to have their non-VA clinician prescription rewritten by a VA clinician (Table 2, Theme 4).
Facilitators of the Current Transition Process
Several participants provided examples of when transitional care communication between systems occurred seamlessly. VA staff and veterans noted that the VA increased the availability of urgent care appointments, which allowed for timelier postacute care follow-up appointments. Non-VA hospital clinicians also noted the availability of additional appointment slots but stated that they did not learn about these additional appointments directly from the VA. Instead, they learned of these through medical residents caring for patients at both VA and non-VA hospitals. One VA CBOC designated two nurses to care for walk-in veterans for their postdischarge follow-up needs. Some VA participants also noted that the VA Call Center Nurses occasionally called veterans upon discharge to schedule a follow-up appointment and facilitated timely care.
Participants from a VA CBOC discussed being part of a Community Transitions Consortium aimed at identifying high-utilizing patients (veteran and nonveteran) and improving communication across systems. The consortium members discussed each facility’s transition-of-care process, described having access to local non-VA hospital medical records and a backline phone number at the non-VA hospitals to coordinate transitional care. This allowed the VA clinicians to learn about non-VA hospital processes and veteran needs.
Suggestions for Improving the Transitional Care Process
VA and non-VA clinicians suggested hiring a VA liaison, preferably with a clinical background to facilitate care coordination across healthcare systems. They recommended that this person work closely with VA primary care, strengthen the relationship with non-VA hospitals, and help veterans learn more about the transition-of-care processes. Topics discussed for veteran education included how to (1) access their primary care tea
Veterans agreed that improvements to the current process should include an efficient system for obtaining medications and the ability to schedule timely follow-up appointments. Furthermore, veterans wanted education about the VA transition-of-care process following a non-VA hospitalization, including payment and VA notification processes (Table 2, Theme 5).
DISCUSSION
Participants described the current transitional care process as inefficient with specific barriers that have negative consequences on patient care and clinician and staff work processes. They described difficulties in obtaining medications prescribed by non-VA clinicians from VA pharmacies, delays in follow-up appointments at the VA, and lack of bilateral communication between systems and medical record transfer. Participants also provided concrete suggestions to improving the current process, including a care coordinator with clinical background. These findings are important in the context of VA increasing veteran access to care in the community.
Despite an increasing emphasis on veteran access to non-VA care as a result of the VA strategic goals and several new programs,7,12,13 there has not been a close examination of the current transition-of-care process from non-VA hospitals to VA primary care. Several studies have shown that the period following a hospitalization is especially vulnerable and associated with adverse events such as readmission, high cost, and death.12,31,32 Our findings agree with previous research that identified medical record transfer across systems as one of the most challenging issues contributing to deficits in communication between care teams.33 In addition, our study brought into focus the significant challenges faced by veterans in obtaining medications post non-VA hospital discharge. Addressing these key barriers in transitional care will improve the quality, safety, and value of healthcare in the current transition process.38,39
Based on our findings, our participants’ concern in transitional care can be addressed in various ways. First, as veterans are increasingly receiving care in the community, identifying their veteran status early on in the non-VA hospital setting could help in improved, real time communication with the VA. This could be done by updating patient intake forms to ask patients whether they are veterans or not. Second, VA policy-level changes should work to provide veterans access to non-VA pharmacy benefits equivalent to the access patients are receiving for hospital, specialty, and outpatient care. Third, patient and provider satisfaction for dual-use veterans should be examined closely. Although participants expressed frustration with the overall transitions of care from non-VA hospitals to VA primary care setting, influence of this on the Quadruple Aim-improving patient outcomes, experience, and reducing clinician and staff burnout should be examined closely.40 Fourth, evidence-based interventions such as nurse-led transitional care programs that have proven helpful in reducing adverse outcomes in both VA and non-VA settings will be useful to implement.41-45 Such programs could be located in the VA, and a care coordinator role could help facilitate transitional care needs for veterans by working with multiple non-VA hospitals.
The limitations of this study are that the perspectives shared by these participants may not represent all VA and non-VA hospitals as well as veterans’ experiences with transition of care. In addition, the study was conducted in one state and the findings may not be applicable to other healthcare systems. However, our study highlighted the consistent challenges of receiving care across VA and other hospital systems. Two strengths of this study are that it was conducted by multidisciplinary research team members with expertise in qualitative research, clinical care, and implementation science and that we obtained convergent information from VA, non-VA, and veteran participants.
Our current transition-of-care process has several shortcomings. There was a clear agreement on barriers, facilitators, and suggestions for improving the current transitions-of-care process among VA and non-VA hospital participants, as well as from veterans who experienced transitions across different delivery systems. Transitioning veterans to VA primary care following a non-VA hospitalization is a crucial first step for improving care for veterans and reducing adverse outcomes such as avoidable hospital readmissions and death.
These results describe the inefficiencies experienced by patients, clinicians, and staff and their suggestions to alleviate these barriers for optimal continuum of care. To avoid frustration and inefficiencies, the increased emphasis of providing non-VA care for veterans should consider the challenges experienced in transitional care and the opportunities for increased coordination of care.
1. Borowsky SJ, Cowper DC. Dual use of VA and non-VA primary care. J Gen Intern Med. 1999;14(5):274-280. https://doi.org/10.1046/j.1525-1497.1999.00335.x.
2. Charlton ME, Mengeling MA, Schlichting JA, et al. Veteran use of health care systems in rural states. Comparing VA and Non-VA health care use among privately insured veterans under age 65. J Rural Health. 2016;32(4):407-417. https://doi.org/10.1111/jrh.12206.
3. Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161. https://doi.org/10.7326/0003-4819-138-3-200302040-00007.
4. Nguyen KA, Haggstrom DA, Ofner S, et al. Medication use among veterans across health care systems. Appl Clin Inform. 2017;26(1):235-249. https://doi.org/10.4338/ACI-2016-10-RA-0184.
5. Nayar P, Apenteng B, Yu F, Woodbridge P, Fetrick A. Rural veterans’ perspectives of dual care. J Commun Health. 2013;38(1):70-77. https://doi.org/10.1007/s10900-012-9583-7.
6. West AN, Charlton ME. Insured veterans’ use of VA and Non-VA health care in a rural state. J Rural Health. 2016;32(4):387-396. https://doi.org/10.1111/jrh.12196.
7. Gellad WF. The veterans choice act and dual health system use. J Gen Intern Med. 2016;31(2):153-154. https://doi.org/10.1007/s11606-015-3492-2.
8. Axon RN, Gebregziabher M, Everett CJ, Heidenreich P, Hunt KJ. Dual health care system use is associated with higher rates of hospitalization and hospital readmission among veterans with heart failure. Am Heart J. 2016;174:157-163. https://doi.org/10.1016/j.ahj.2015.09.023.
9. Humensky J, Carretta H, de Groot K, et al. Service utilization of veterans dually eligible for VA and medicare fee-for-service: 1999–2004. Medicare Medicaid Res Rev. 2012;2(3). https://doi.org/10.5600/mmrr.002.03.A06.
10. West AN, Charlton ME, Vaughan-Sarrazin M. Dual use of VA and non-VA hospitals by veterans with multiple hospitalizations. BMC Health Serv Res. 2015;15(1):431. https://doi.org/10.1186/s12913-015-1069-8.
11. Gaglioti A, Cozad A, Wittrock S, et al. Non-VA primary care providers’ perspectives on comanagement for rural veterans. Mil Med. 2014;179(11):1236-1243. https://doi.org/10.7205/MILMED-D-13-00342.
12. Department of Veterans Affairs. Expanded access to non-VA care through the veterans choice program. Final rule. Fed Regist. 2018;83(92):21893-21897.
13. Shuster B. Text-H.R.3236-114th Congress. Surface Transportation and Veterans Health Care Choice Improvement Act of 2015.. https://www.congress.gov/bill/114th-congress/house-bill/3236/text/pl. Accessed April 16, 2017; 2015-2016.
14. Veterans Affairs Mission Act. MISSIONAct.va.gov Available at. https://missionact.va.gov/. Accessed August 9, 2019.
15. Veterans Choice Program (VCP). Community care. https://www.va.gov/COMMUNITYCARE/programs/veterans/VCP/index.asp. Accessed August 9, 2019.
16. A Decade of Transitional Care Research with Vulnerable Elder… : journal of cardiovascular nursing. LWW. http://journals.lww.com/jcnjournal/Fulltext/2000/04000/A_Decade_of_Transitional_Care_Research_with.4.aspx. Accessed April 16, 2017.
17. Coleman EA, Boult C. Improving the quality of transitional care for persons with complex care needs. J Am Geriatr Soc. 2003;51(4):556-557. https://doi.org/10.1046/j.1532-5415.2003.51186.x.
18. Krichbaum K. GAPN postacute care coordination improves hip fracture outcomes. West J Nurs Res. 2007;29(5):523-544. https://doi.org/10.1177/0193945906293817.
19. Kripalani S, Jackson AT, Schnipper JL, Coleman EA. Promoting effective transitions of care at hospital discharge: a review of key issues for hospitalists. J Hosp Med. 2007;2(5):314-323. https://doi.org/10.1002/jhm.228.
20. Coleman EA, Mahoney E, Parry C. Assessing the quality of preparation for posthospital care from the patient’s perspective: the care transitions measure. Med Care. 2005;43(3):246-255. https://doi.org/10.1097/00005650-200503000-00007.
21. Naylor MD, Aiken LH, Kurtzman ET, Olds DM, Hirschman KB. The importance of transitional care in achieving health reform. Health Aff (Millwood). 2011;30(4):746-754. https://doi.org/10.1377/hlthaff.2011.0041.
22. Naylor MD, Brooten DA, Campbell RL, et al. Transitional care of older adults hospitalized with heart failure: a randomized, controlled trial. J Am Geriatr Soc. 2004;52(5):675-684. https://doi.org/10.1111/j.1532-5415.2004.52202.x.
23. Snow V, Beck D, Budnitz T, et al. Transitions of care consensus policy statement: American College of Physicians, Society of General Internal Medicine, society of hospital medicine, American Geriatrics Society, American College of Emergency Physicians, and Society for Academic Emergency Medicine. J Hosp Med. 2009;4(6):364-370. https://doi.org/10.1002/jhm.510.
24. Coleman EA. Falling through the cracks: challenges and opportunities for improving transitional care for persons with continuous complex care needs. J Am Geriatr Soc. 2003;51(4):549-555. https://doi.org/10.1046/j.1532-5415.2003.51185.x.
25. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228-243. https://doi.org/10.1016/S1553-7250(08)34030-6.
26. Schweikhart SA, Dembe AE. The applicability of lean and six sigma techniques to clinical and translational research. J Investig Med. 2009;57(7):748-755. https://doi.org/10.2310/JIM.0b013e3181b91b3a.
27. Burke RE, Kripalani S, Vasilevskis EE, Schnipper JL. Moving beyond readmission penalties: creating an ideal process to improve transitional care. J Hosp Med. 2013;8(2):102-109. https://doi.org/10.1002/jhm.1990.
28. Patient Aligned Care Team (PACT)-Patient Care. Services. https://www.patientcare.va.gov/primarycare/PACT.asp. Accessed November 20, 2017.
29. Morse JM. Critical analysis of strategies for determining rigor in qualitative inquiry. Qual Health Res. 2015;25(9):1212-1222. https://doi.org/10.1177/1049732315588501.
30. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277-1288. https://doi.org/10.1177/1049732305276687.
31. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5(1):80-92. https://doi.org/10.1177/160940690600500107.
32. Ayele RA, Lawrence E, McCreight M, et al. Study protocol: improving the transition of care from a non-network hospital back to the patient’s medical home. BMC Health Serv Res. 2017;17(1):123. https://doi.org/10.1186/s12913-017-2048-z.
33. Burke RE, Kripalani S, Vasilevskis EE, Schnipper JL. Moving beyond readmission penalties: creating an ideal process to improve transitional care. J Hosp Med. 2013;8(2):102-109. https://doi.org/10.1002/jhm.1990.
34. Qualitative research & evaluation methods. https://us.sagepub.com/en-us/nam/qualitative-research-evaluation-methods/book232962. Accessed April 16, 2017. SAGE Publications Inc.
35. Curry LA, Nembhard IM, Bradley EH. Qualitative and mixed methods provide unique contributions to outcomes research. Circulation. 2009;119(10):1442-1452. https://doi.org/10.1161/CIRCULATIONAHA.107.742775.
36. Creswell JW, Hanson WE, Clark Plano VL, Morales A. Qualitative research designs: selection and implementation. Couns Psychol. 2007;35(2):236-264. https://doi.org/10.1177/0011000006287390.
37. Carter N, Bryant-Lukosius D, DiCenso A, Blythe J, Neville AJ. The use of triangulation in qualitative research. Oncol Nurs Forum. 2014;41(5):545-547. https://doi.org/10.1188/14.ONF.545-547.
38. Krumholz HM. Post-hospital syndrome—an acquired, transient condition of generalized risk. N Engl J Med. 2013;368(2):100-102. https://doi.org/10.1056/NEJMp1212324.
39. Improving Care Transitions. Health affairs-health policy briefs. http://www.healthaffairs.org/healthpolicybriefs/brief.php?brief_id=76. Accessed August 13, 2016.
40. Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573-576. https://doi.org/10.1370/afm.1713.
41. Burke RE, Kelley L, Gunzburger E, et al. Improving transitions of care for veterans transferred to tertiary VA medical centers. Am J Med Qual. 2018;33(2):147-153. https://doi.org/10.1177/1062860617715508.
42. Capp R, Misky GJ, Lindrooth RC, et al. Coordination program reduced acute care use and increased primary care visits among frequent emergency care users. Health Aff (Millwood). 2017;36(10):1705-1711. https://doi.org/10.1377/hlthaff.2017.0612.
43. Kind AJH, Brenny-Fitzpatrick M, Leahy-Gross K, et al. Harnessing protocolized adaptation in dissemination: successful implementation and sustainment of the veterans affairs coordinated-transitional care program in a non-veterans affairs hospital. J Am Geriatr Soc. 2016;64(2):409-416. https://doi.org/10.1111/jgs.13935.
44. Kind AJH, Jensen L, Barczi S, et al. Low-cost transitional care with nurse managers making mostly phone contact With patients cut rehospitalization at a VA Hospital. Health Aff. 2012;31(12):2659-2668. https://doi.org/10.1377/hlthaff.2012.0366.
45. Reese RL, Clement SA, Syeda S, et al. Coordinated-transitional care for veterans with heart failure and chronic lung disease. J Am Geriatr Soc. 2019;67(7):1502-1507. https://doi.org/10.1111/jgs.15978.
As the VA moves toward increased utilization of non-VA care, it is crucial to understand and address the challenges of transitional care faced by dual-use veterans to provide high-quality care that improves healthcare outcomes.7,11,12 The VA implemented a shift in policy from the Veterans Access, Choice, and Accountability Act of 2014 (Public Law 113-146; “Choice Act”) to the VA Maintaining Internal Systems and Strengthening Integrated Outside Networks (MISSION) Act beginning June 6, 2019.13,14 Under the MISSION Act, veterans have more ways to access healthcare within the VA’s network and through approved non-VA medical providers in the community known as “community care providers.”15 This shift expanded the existing VA Choice Act of 2014, where the program allowed those veterans who are unable to schedule an appointment within 30 days of their preferred date or the clinically appropriate date, or on the basis of their place of residence, to elect to receive care from eligible non-VA healthcare entities or providers.14,15 These efforts to better serve veterans by increasing non-VA care might present added care coordination challenges for patients and their providers when they seek care in the VA.
High-quality transitional care prevents poor outcomes such as hospital readmissions.16-18 When communication and coordination across healthcare delivery systems are lacking, patients and their families often find themselves at risk for adverse events.19,20 Past research shows that patients have fewer adverse events when they receive comprehensive postdischarge care, including instructions on medications and self-care, symptom recognition and management, and reminders to attend follow-up appointments.17,21,22 Although researchers have identified the components of effective transitional care,23 barriers persist. The communication and collaboration needed to provide coordinated care across healthcare delivery systems are difficult due to the lack of standardized approaches between systems.24 Consequently, follow-up care may be delayed or missed altogether. To our knowledge, there is no published research identifying transitional care challenges for clinicians, staff, and veterans in transitioning from non-VA hospitals to a VA primary care setting.
The objective of this quality assessment was to understand VA and non-VA hospital clinicians’ and staff as well as veterans’ perspectives of the barriers and facilitators to providing high-quality transitional care.
METHODS
Study Design
We conducted a qualitative assessment within the VA Eastern Colorado Health Care System, an urban tertiary medical center, as well as urban and rural non-VA hospitals used by veterans. Semi-structured interview guides informed by the practical robust implementation and sustainability (PRISM) model, the Lean approach, and the Ideal Transitions of Care Bridge were used.25-27 We explored the PRISM domains such as recipient’s characteristics, the interaction with the external environment, and the implementation and sustainability infrastructure to inform the design and implementation of the intervention.25 The Lean approach included methods to optimize processes by maximizing efficiency and minimizing waste.26 The Ideal Transitions of Care Bridge was used to identify the domains in transitions of care such as discharge planning, communication of information, and care coordination.27
Setting and Participants
We identified the top 10 non-VA hospitals serving the most urban and rural veterans in 2015 using VA administrative data. Purposive sampling was used to ensure that urban and rural non-VA hospitals and different roles within these hospitals were represented. VA clinicians and staff were selected from the Denver VA Medical Center, a tertiary hospital within the Eastern Colorado Health Care System and one VA Community-Based Outpatient Clinic (CBOC) that primarily serves rural veterans. The Denver VA Medical Center has three clinics staffed by Patient Aligned Care Teams (PACTs), a model built on the concept of Patient-Centered Medical Home.28 Hospital leadership were initially approached for permission to recruit their staff and to be involved as key informants, and all agreed. To ensure representativeness, diversity of roles was recruited, including PACT primary care physicians, nurses, and other staff members such as medical assistants and administrators. Veterans were approached for sampling if they were discharged from a non-VA hospital during June–September 2015 and used the VA for primary care. This was to ensure that they remembered the process they went through postdischarge at the time of the interview.
Data Collection and Analysis
The evaluation team members (RA, EL, and MM) conducted the interviews from November 2015 to July 2016. Clinicians, staff, and veterans were asked semi-structured questions about their experiences and their role in transitioning VA patients across systems (see Appendix for interview guides). Veterans were asked to describe their experience and satisfaction with the current postdischarge transition process. We stopped the interviews when we reached data saturation.29
Interviews were audio-recorded, transcribed verbatim, and validated (transcribed interviews were double-checked against recording) to ensure data quality and accuracy. Coding was guided by a conventional content analysis technique30, 31 using a deductive and inductive coding approach.31 The deductive coding approach was drawn from the Ideal Transitions of Care Bridge and PRISM domains. 32,33 Two evaluation team members (RA and EL) defined the initial code book by independently coding the first three interviews, worked to clarify the meanings of emergent codes, and came to a consensus when disagreements occurred. Next, a priori codes were added by team members to include the PRISM domains. These PRISM domains included the implementation and sustainability infrastructure, the external environment, the characteristics of intervention recipients, and the organizational and patient perspectives of an intervention.
Additional emergent codes were added to the code book and agreed upon by team members (RA, EL, and MM). Consistent with previously used methods, consensus building was achieved by identifying and resolving differences by discussing with team members (RA, EL, MM, CB, and RB).29 Codes were examined and organized into themes by team members.29,34-36 This process was continued until no new themes were identified. Results were reviewed by all evaluation team members to assess thoroughness and comprehensiveness.34,35 In addition, team members triangulated the findings with VA and non-VA participants to ensure validity and reduce researcher bias.29,37
RESULTS
We conducted a total of 70 interviews with 23 VA and 29 non-VA hospital clinicians and staff and 18 veterans (Table 1). Overall, we found that there was no standardized process for transitioning veterans across healthcare delivery systems. Participants reported that transitions were often inefficient when non-VA hospitals could not (1) identify patients as veterans and notify VA primary care of discharge; (2) transfer non-VA hospital medical records to VA primary care; (3) obtain follow-up care appointments with VA primary care; and (4) write VA formulary medications for veterans to fill at VA pharmacies. In addition, participants discussed about facilitators and suggestions to overcome these inefficiencies and improve transitional care (Table2). We mapped the identified barriers as well as the suggestions for improvement to the PRISM and the Ideal Transitions of Care Bridge domains (Table 3).
Unable to Identify Patients as Veterans and Notify VA Primary Care of Discharge
VA and non-VA participants reported difficulty in communicating about veterans’ hospitalizations and discharge follow-up needs across systems. Non-VA clinicians referenced difficulty in identifying patients as veterans to communicate with VA, except in instances where the VA is a payor, while VA providers described feeling largely uninformed of the veterans non-VA hospitalization. For non-VA clinicians, the lack of a systematic method for veteran identification often left them to inadvertently identify veteran status by asking about their primary care clinicians and insurance and even through an offhanded comment made by the veteran. If a veteran was identified, non-VA clinicians described being uncertain about the best way to notify VA primary care of the patient’s impending discharge. Veterans described instances of the non-VA hospital knowing their veteran status upon admission, but accounts varied on whether the non-VA hospital notified the VA primary care of their hospitalization (Table 2, Theme 1).
Unable to Transfer Non-VA Hospital Medical Records to VA Primary Care
VA clinicians discussed about the challenges associated with obtaining the veteran’s medical record from the non-VA hospitals, and when it was received, it was often incomplete information and significantly delayed. They described relying on the veteran’s description of the care received, which was not complete or accurate information needed to make clinical judgment or coordinate follow-up care. Non-VA clinicians mentioned about trying several methods for transferring the medical record to VA primary care, including discharge summary via electronic system and sometimes solely relying on patients to deliver discharge paperwork to their primary care clinicians. In instances where non-VA hospitals sent discharge paperwork to VA, there was no way for non-VA hospitals to verify whether the faxed electronic medical record was received by the VA hospital. Most of the veterans discussed receiving written postdischarge instructions to take to their VA primary care clinicians; however, they were unsure whether the VA primary care received their medical record or any other information from the non-VA hospital (Table 2, Theme 2).
Unable to Obtain Follow-Up Care Appointments with VA Primary Care
All participants described how difficult it was to obtain a follow-up appointment for veterans with VA primary care. This often resulted in delayed follow-up care. VA clinicians also shared that a non-VA hospitalization can be the impetus for a veteran to seek care at the VA for the very first time. Once eligibility is determined, the veteran is assigned a VA primary care clinician. This process may take up to six weeks, and in the meantime, the veteran is scheduled in VA urgent care for immediate postdischarge care. This lag in primary care assignment creates delayed and fragmented care (Table 2, Theme 3).
Non-VA clinicians, administrators, and staff also discussed the difficulties in scheduling follow-up care with VA primary care. Although discharge paperwork instructed patients to see their VA clinicians, there was no process in place for non-VA clinicians to confirm whether the follow-up care was received due to lack of bilateral communication. In addition, veterans discussed the inefficiencies in scheduling follow-up appointments with VA clinicians where attempts to follow-up with primary care clinicians took eight weeks or more. Several veterans described walking into the clinic without an appointment asking to be seen postdischarge or utilizing the VA emergency department for follow-up care after discharge from a non-VA hospital. Veterans admitted utilizing the VA emergency department for nonemergent reasons such as filling their prescriptions because they are unable to see a VA PCP in a timely manner (Table 2, Theme 3).
Unable to Write VA Formulary Medications for Veterans to Fill at VA Pharmacies
All participants described the difficulties in obtaining medications at VA pharmacies when prescribed by the non-VA hospital clinicians. VA clinicians often had to reassess, and rewrite prescriptions written by clinicians, causing delays. Moreover, rural VA clinicians described lack of VA pharmacies in their locations, where veterans had to mail order medications, causing further delays in needed medications. Non-VA clinicians echoed these frustrations. They noted that veterans were confused about their VA pharmacy benefits as well as the need for the non-VA clinicians to follow VA formulary guidelines. Veterans expressed that it was especially challenging to physically go to the VA pharmacy to pick up medications after discharge due to lack of transportation, limited VA pharmacy hours, and long wait times. Several veterans discussed paying for their prescriptions out of pocket even though they had VA pharmacy benefits because it was more convenient to use the non-VA pharmacy. In other instances, veterans discussed going to a VA emergency department and waiting for hours to have their non-VA clinician prescription rewritten by a VA clinician (Table 2, Theme 4).
Facilitators of the Current Transition Process
Several participants provided examples of when transitional care communication between systems occurred seamlessly. VA staff and veterans noted that the VA increased the availability of urgent care appointments, which allowed for timelier postacute care follow-up appointments. Non-VA hospital clinicians also noted the availability of additional appointment slots but stated that they did not learn about these additional appointments directly from the VA. Instead, they learned of these through medical residents caring for patients at both VA and non-VA hospitals. One VA CBOC designated two nurses to care for walk-in veterans for their postdischarge follow-up needs. Some VA participants also noted that the VA Call Center Nurses occasionally called veterans upon discharge to schedule a follow-up appointment and facilitated timely care.
Participants from a VA CBOC discussed being part of a Community Transitions Consortium aimed at identifying high-utilizing patients (veteran and nonveteran) and improving communication across systems. The consortium members discussed each facility’s transition-of-care process, described having access to local non-VA hospital medical records and a backline phone number at the non-VA hospitals to coordinate transitional care. This allowed the VA clinicians to learn about non-VA hospital processes and veteran needs.
Suggestions for Improving the Transitional Care Process
VA and non-VA clinicians suggested hiring a VA liaison, preferably with a clinical background to facilitate care coordination across healthcare systems. They recommended that this person work closely with VA primary care, strengthen the relationship with non-VA hospitals, and help veterans learn more about the transition-of-care processes. Topics discussed for veteran education included how to (1) access their primary care tea
Veterans agreed that improvements to the current process should include an efficient system for obtaining medications and the ability to schedule timely follow-up appointments. Furthermore, veterans wanted education about the VA transition-of-care process following a non-VA hospitalization, including payment and VA notification processes (Table 2, Theme 5).
DISCUSSION
Participants described the current transitional care process as inefficient with specific barriers that have negative consequences on patient care and clinician and staff work processes. They described difficulties in obtaining medications prescribed by non-VA clinicians from VA pharmacies, delays in follow-up appointments at the VA, and lack of bilateral communication between systems and medical record transfer. Participants also provided concrete suggestions to improving the current process, including a care coordinator with clinical background. These findings are important in the context of VA increasing veteran access to care in the community.
Despite an increasing emphasis on veteran access to non-VA care as a result of the VA strategic goals and several new programs,7,12,13 there has not been a close examination of the current transition-of-care process from non-VA hospitals to VA primary care. Several studies have shown that the period following a hospitalization is especially vulnerable and associated with adverse events such as readmission, high cost, and death.12,31,32 Our findings agree with previous research that identified medical record transfer across systems as one of the most challenging issues contributing to deficits in communication between care teams.33 In addition, our study brought into focus the significant challenges faced by veterans in obtaining medications post non-VA hospital discharge. Addressing these key barriers in transitional care will improve the quality, safety, and value of healthcare in the current transition process.38,39
Based on our findings, our participants’ concern in transitional care can be addressed in various ways. First, as veterans are increasingly receiving care in the community, identifying their veteran status early on in the non-VA hospital setting could help in improved, real time communication with the VA. This could be done by updating patient intake forms to ask patients whether they are veterans or not. Second, VA policy-level changes should work to provide veterans access to non-VA pharmacy benefits equivalent to the access patients are receiving for hospital, specialty, and outpatient care. Third, patient and provider satisfaction for dual-use veterans should be examined closely. Although participants expressed frustration with the overall transitions of care from non-VA hospitals to VA primary care setting, influence of this on the Quadruple Aim-improving patient outcomes, experience, and reducing clinician and staff burnout should be examined closely.40 Fourth, evidence-based interventions such as nurse-led transitional care programs that have proven helpful in reducing adverse outcomes in both VA and non-VA settings will be useful to implement.41-45 Such programs could be located in the VA, and a care coordinator role could help facilitate transitional care needs for veterans by working with multiple non-VA hospitals.
The limitations of this study are that the perspectives shared by these participants may not represent all VA and non-VA hospitals as well as veterans’ experiences with transition of care. In addition, the study was conducted in one state and the findings may not be applicable to other healthcare systems. However, our study highlighted the consistent challenges of receiving care across VA and other hospital systems. Two strengths of this study are that it was conducted by multidisciplinary research team members with expertise in qualitative research, clinical care, and implementation science and that we obtained convergent information from VA, non-VA, and veteran participants.
Our current transition-of-care process has several shortcomings. There was a clear agreement on barriers, facilitators, and suggestions for improving the current transitions-of-care process among VA and non-VA hospital participants, as well as from veterans who experienced transitions across different delivery systems. Transitioning veterans to VA primary care following a non-VA hospitalization is a crucial first step for improving care for veterans and reducing adverse outcomes such as avoidable hospital readmissions and death.
These results describe the inefficiencies experienced by patients, clinicians, and staff and their suggestions to alleviate these barriers for optimal continuum of care. To avoid frustration and inefficiencies, the increased emphasis of providing non-VA care for veterans should consider the challenges experienced in transitional care and the opportunities for increased coordination of care.
As the VA moves toward increased utilization of non-VA care, it is crucial to understand and address the challenges of transitional care faced by dual-use veterans to provide high-quality care that improves healthcare outcomes.7,11,12 The VA implemented a shift in policy from the Veterans Access, Choice, and Accountability Act of 2014 (Public Law 113-146; “Choice Act”) to the VA Maintaining Internal Systems and Strengthening Integrated Outside Networks (MISSION) Act beginning June 6, 2019.13,14 Under the MISSION Act, veterans have more ways to access healthcare within the VA’s network and through approved non-VA medical providers in the community known as “community care providers.”15 This shift expanded the existing VA Choice Act of 2014, where the program allowed those veterans who are unable to schedule an appointment within 30 days of their preferred date or the clinically appropriate date, or on the basis of their place of residence, to elect to receive care from eligible non-VA healthcare entities or providers.14,15 These efforts to better serve veterans by increasing non-VA care might present added care coordination challenges for patients and their providers when they seek care in the VA.
High-quality transitional care prevents poor outcomes such as hospital readmissions.16-18 When communication and coordination across healthcare delivery systems are lacking, patients and their families often find themselves at risk for adverse events.19,20 Past research shows that patients have fewer adverse events when they receive comprehensive postdischarge care, including instructions on medications and self-care, symptom recognition and management, and reminders to attend follow-up appointments.17,21,22 Although researchers have identified the components of effective transitional care,23 barriers persist. The communication and collaboration needed to provide coordinated care across healthcare delivery systems are difficult due to the lack of standardized approaches between systems.24 Consequently, follow-up care may be delayed or missed altogether. To our knowledge, there is no published research identifying transitional care challenges for clinicians, staff, and veterans in transitioning from non-VA hospitals to a VA primary care setting.
The objective of this quality assessment was to understand VA and non-VA hospital clinicians’ and staff as well as veterans’ perspectives of the barriers and facilitators to providing high-quality transitional care.
METHODS
Study Design
We conducted a qualitative assessment within the VA Eastern Colorado Health Care System, an urban tertiary medical center, as well as urban and rural non-VA hospitals used by veterans. Semi-structured interview guides informed by the practical robust implementation and sustainability (PRISM) model, the Lean approach, and the Ideal Transitions of Care Bridge were used.25-27 We explored the PRISM domains such as recipient’s characteristics, the interaction with the external environment, and the implementation and sustainability infrastructure to inform the design and implementation of the intervention.25 The Lean approach included methods to optimize processes by maximizing efficiency and minimizing waste.26 The Ideal Transitions of Care Bridge was used to identify the domains in transitions of care such as discharge planning, communication of information, and care coordination.27
Setting and Participants
We identified the top 10 non-VA hospitals serving the most urban and rural veterans in 2015 using VA administrative data. Purposive sampling was used to ensure that urban and rural non-VA hospitals and different roles within these hospitals were represented. VA clinicians and staff were selected from the Denver VA Medical Center, a tertiary hospital within the Eastern Colorado Health Care System and one VA Community-Based Outpatient Clinic (CBOC) that primarily serves rural veterans. The Denver VA Medical Center has three clinics staffed by Patient Aligned Care Teams (PACTs), a model built on the concept of Patient-Centered Medical Home.28 Hospital leadership were initially approached for permission to recruit their staff and to be involved as key informants, and all agreed. To ensure representativeness, diversity of roles was recruited, including PACT primary care physicians, nurses, and other staff members such as medical assistants and administrators. Veterans were approached for sampling if they were discharged from a non-VA hospital during June–September 2015 and used the VA for primary care. This was to ensure that they remembered the process they went through postdischarge at the time of the interview.
Data Collection and Analysis
The evaluation team members (RA, EL, and MM) conducted the interviews from November 2015 to July 2016. Clinicians, staff, and veterans were asked semi-structured questions about their experiences and their role in transitioning VA patients across systems (see Appendix for interview guides). Veterans were asked to describe their experience and satisfaction with the current postdischarge transition process. We stopped the interviews when we reached data saturation.29
Interviews were audio-recorded, transcribed verbatim, and validated (transcribed interviews were double-checked against recording) to ensure data quality and accuracy. Coding was guided by a conventional content analysis technique30, 31 using a deductive and inductive coding approach.31 The deductive coding approach was drawn from the Ideal Transitions of Care Bridge and PRISM domains. 32,33 Two evaluation team members (RA and EL) defined the initial code book by independently coding the first three interviews, worked to clarify the meanings of emergent codes, and came to a consensus when disagreements occurred. Next, a priori codes were added by team members to include the PRISM domains. These PRISM domains included the implementation and sustainability infrastructure, the external environment, the characteristics of intervention recipients, and the organizational and patient perspectives of an intervention.
Additional emergent codes were added to the code book and agreed upon by team members (RA, EL, and MM). Consistent with previously used methods, consensus building was achieved by identifying and resolving differences by discussing with team members (RA, EL, MM, CB, and RB).29 Codes were examined and organized into themes by team members.29,34-36 This process was continued until no new themes were identified. Results were reviewed by all evaluation team members to assess thoroughness and comprehensiveness.34,35 In addition, team members triangulated the findings with VA and non-VA participants to ensure validity and reduce researcher bias.29,37
RESULTS
We conducted a total of 70 interviews with 23 VA and 29 non-VA hospital clinicians and staff and 18 veterans (Table 1). Overall, we found that there was no standardized process for transitioning veterans across healthcare delivery systems. Participants reported that transitions were often inefficient when non-VA hospitals could not (1) identify patients as veterans and notify VA primary care of discharge; (2) transfer non-VA hospital medical records to VA primary care; (3) obtain follow-up care appointments with VA primary care; and (4) write VA formulary medications for veterans to fill at VA pharmacies. In addition, participants discussed about facilitators and suggestions to overcome these inefficiencies and improve transitional care (Table2). We mapped the identified barriers as well as the suggestions for improvement to the PRISM and the Ideal Transitions of Care Bridge domains (Table 3).
Unable to Identify Patients as Veterans and Notify VA Primary Care of Discharge
VA and non-VA participants reported difficulty in communicating about veterans’ hospitalizations and discharge follow-up needs across systems. Non-VA clinicians referenced difficulty in identifying patients as veterans to communicate with VA, except in instances where the VA is a payor, while VA providers described feeling largely uninformed of the veterans non-VA hospitalization. For non-VA clinicians, the lack of a systematic method for veteran identification often left them to inadvertently identify veteran status by asking about their primary care clinicians and insurance and even through an offhanded comment made by the veteran. If a veteran was identified, non-VA clinicians described being uncertain about the best way to notify VA primary care of the patient’s impending discharge. Veterans described instances of the non-VA hospital knowing their veteran status upon admission, but accounts varied on whether the non-VA hospital notified the VA primary care of their hospitalization (Table 2, Theme 1).
Unable to Transfer Non-VA Hospital Medical Records to VA Primary Care
VA clinicians discussed about the challenges associated with obtaining the veteran’s medical record from the non-VA hospitals, and when it was received, it was often incomplete information and significantly delayed. They described relying on the veteran’s description of the care received, which was not complete or accurate information needed to make clinical judgment or coordinate follow-up care. Non-VA clinicians mentioned about trying several methods for transferring the medical record to VA primary care, including discharge summary via electronic system and sometimes solely relying on patients to deliver discharge paperwork to their primary care clinicians. In instances where non-VA hospitals sent discharge paperwork to VA, there was no way for non-VA hospitals to verify whether the faxed electronic medical record was received by the VA hospital. Most of the veterans discussed receiving written postdischarge instructions to take to their VA primary care clinicians; however, they were unsure whether the VA primary care received their medical record or any other information from the non-VA hospital (Table 2, Theme 2).
Unable to Obtain Follow-Up Care Appointments with VA Primary Care
All participants described how difficult it was to obtain a follow-up appointment for veterans with VA primary care. This often resulted in delayed follow-up care. VA clinicians also shared that a non-VA hospitalization can be the impetus for a veteran to seek care at the VA for the very first time. Once eligibility is determined, the veteran is assigned a VA primary care clinician. This process may take up to six weeks, and in the meantime, the veteran is scheduled in VA urgent care for immediate postdischarge care. This lag in primary care assignment creates delayed and fragmented care (Table 2, Theme 3).
Non-VA clinicians, administrators, and staff also discussed the difficulties in scheduling follow-up care with VA primary care. Although discharge paperwork instructed patients to see their VA clinicians, there was no process in place for non-VA clinicians to confirm whether the follow-up care was received due to lack of bilateral communication. In addition, veterans discussed the inefficiencies in scheduling follow-up appointments with VA clinicians where attempts to follow-up with primary care clinicians took eight weeks or more. Several veterans described walking into the clinic without an appointment asking to be seen postdischarge or utilizing the VA emergency department for follow-up care after discharge from a non-VA hospital. Veterans admitted utilizing the VA emergency department for nonemergent reasons such as filling their prescriptions because they are unable to see a VA PCP in a timely manner (Table 2, Theme 3).
Unable to Write VA Formulary Medications for Veterans to Fill at VA Pharmacies
All participants described the difficulties in obtaining medications at VA pharmacies when prescribed by the non-VA hospital clinicians. VA clinicians often had to reassess, and rewrite prescriptions written by clinicians, causing delays. Moreover, rural VA clinicians described lack of VA pharmacies in their locations, where veterans had to mail order medications, causing further delays in needed medications. Non-VA clinicians echoed these frustrations. They noted that veterans were confused about their VA pharmacy benefits as well as the need for the non-VA clinicians to follow VA formulary guidelines. Veterans expressed that it was especially challenging to physically go to the VA pharmacy to pick up medications after discharge due to lack of transportation, limited VA pharmacy hours, and long wait times. Several veterans discussed paying for their prescriptions out of pocket even though they had VA pharmacy benefits because it was more convenient to use the non-VA pharmacy. In other instances, veterans discussed going to a VA emergency department and waiting for hours to have their non-VA clinician prescription rewritten by a VA clinician (Table 2, Theme 4).
Facilitators of the Current Transition Process
Several participants provided examples of when transitional care communication between systems occurred seamlessly. VA staff and veterans noted that the VA increased the availability of urgent care appointments, which allowed for timelier postacute care follow-up appointments. Non-VA hospital clinicians also noted the availability of additional appointment slots but stated that they did not learn about these additional appointments directly from the VA. Instead, they learned of these through medical residents caring for patients at both VA and non-VA hospitals. One VA CBOC designated two nurses to care for walk-in veterans for their postdischarge follow-up needs. Some VA participants also noted that the VA Call Center Nurses occasionally called veterans upon discharge to schedule a follow-up appointment and facilitated timely care.
Participants from a VA CBOC discussed being part of a Community Transitions Consortium aimed at identifying high-utilizing patients (veteran and nonveteran) and improving communication across systems. The consortium members discussed each facility’s transition-of-care process, described having access to local non-VA hospital medical records and a backline phone number at the non-VA hospitals to coordinate transitional care. This allowed the VA clinicians to learn about non-VA hospital processes and veteran needs.
Suggestions for Improving the Transitional Care Process
VA and non-VA clinicians suggested hiring a VA liaison, preferably with a clinical background to facilitate care coordination across healthcare systems. They recommended that this person work closely with VA primary care, strengthen the relationship with non-VA hospitals, and help veterans learn more about the transition-of-care processes. Topics discussed for veteran education included how to (1) access their primary care tea
Veterans agreed that improvements to the current process should include an efficient system for obtaining medications and the ability to schedule timely follow-up appointments. Furthermore, veterans wanted education about the VA transition-of-care process following a non-VA hospitalization, including payment and VA notification processes (Table 2, Theme 5).
DISCUSSION
Participants described the current transitional care process as inefficient with specific barriers that have negative consequences on patient care and clinician and staff work processes. They described difficulties in obtaining medications prescribed by non-VA clinicians from VA pharmacies, delays in follow-up appointments at the VA, and lack of bilateral communication between systems and medical record transfer. Participants also provided concrete suggestions to improving the current process, including a care coordinator with clinical background. These findings are important in the context of VA increasing veteran access to care in the community.
Despite an increasing emphasis on veteran access to non-VA care as a result of the VA strategic goals and several new programs,7,12,13 there has not been a close examination of the current transition-of-care process from non-VA hospitals to VA primary care. Several studies have shown that the period following a hospitalization is especially vulnerable and associated with adverse events such as readmission, high cost, and death.12,31,32 Our findings agree with previous research that identified medical record transfer across systems as one of the most challenging issues contributing to deficits in communication between care teams.33 In addition, our study brought into focus the significant challenges faced by veterans in obtaining medications post non-VA hospital discharge. Addressing these key barriers in transitional care will improve the quality, safety, and value of healthcare in the current transition process.38,39
Based on our findings, our participants’ concern in transitional care can be addressed in various ways. First, as veterans are increasingly receiving care in the community, identifying their veteran status early on in the non-VA hospital setting could help in improved, real time communication with the VA. This could be done by updating patient intake forms to ask patients whether they are veterans or not. Second, VA policy-level changes should work to provide veterans access to non-VA pharmacy benefits equivalent to the access patients are receiving for hospital, specialty, and outpatient care. Third, patient and provider satisfaction for dual-use veterans should be examined closely. Although participants expressed frustration with the overall transitions of care from non-VA hospitals to VA primary care setting, influence of this on the Quadruple Aim-improving patient outcomes, experience, and reducing clinician and staff burnout should be examined closely.40 Fourth, evidence-based interventions such as nurse-led transitional care programs that have proven helpful in reducing adverse outcomes in both VA and non-VA settings will be useful to implement.41-45 Such programs could be located in the VA, and a care coordinator role could help facilitate transitional care needs for veterans by working with multiple non-VA hospitals.
The limitations of this study are that the perspectives shared by these participants may not represent all VA and non-VA hospitals as well as veterans’ experiences with transition of care. In addition, the study was conducted in one state and the findings may not be applicable to other healthcare systems. However, our study highlighted the consistent challenges of receiving care across VA and other hospital systems. Two strengths of this study are that it was conducted by multidisciplinary research team members with expertise in qualitative research, clinical care, and implementation science and that we obtained convergent information from VA, non-VA, and veteran participants.
Our current transition-of-care process has several shortcomings. There was a clear agreement on barriers, facilitators, and suggestions for improving the current transitions-of-care process among VA and non-VA hospital participants, as well as from veterans who experienced transitions across different delivery systems. Transitioning veterans to VA primary care following a non-VA hospitalization is a crucial first step for improving care for veterans and reducing adverse outcomes such as avoidable hospital readmissions and death.
These results describe the inefficiencies experienced by patients, clinicians, and staff and their suggestions to alleviate these barriers for optimal continuum of care. To avoid frustration and inefficiencies, the increased emphasis of providing non-VA care for veterans should consider the challenges experienced in transitional care and the opportunities for increased coordination of care.
1. Borowsky SJ, Cowper DC. Dual use of VA and non-VA primary care. J Gen Intern Med. 1999;14(5):274-280. https://doi.org/10.1046/j.1525-1497.1999.00335.x.
2. Charlton ME, Mengeling MA, Schlichting JA, et al. Veteran use of health care systems in rural states. Comparing VA and Non-VA health care use among privately insured veterans under age 65. J Rural Health. 2016;32(4):407-417. https://doi.org/10.1111/jrh.12206.
3. Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161. https://doi.org/10.7326/0003-4819-138-3-200302040-00007.
4. Nguyen KA, Haggstrom DA, Ofner S, et al. Medication use among veterans across health care systems. Appl Clin Inform. 2017;26(1):235-249. https://doi.org/10.4338/ACI-2016-10-RA-0184.
5. Nayar P, Apenteng B, Yu F, Woodbridge P, Fetrick A. Rural veterans’ perspectives of dual care. J Commun Health. 2013;38(1):70-77. https://doi.org/10.1007/s10900-012-9583-7.
6. West AN, Charlton ME. Insured veterans’ use of VA and Non-VA health care in a rural state. J Rural Health. 2016;32(4):387-396. https://doi.org/10.1111/jrh.12196.
7. Gellad WF. The veterans choice act and dual health system use. J Gen Intern Med. 2016;31(2):153-154. https://doi.org/10.1007/s11606-015-3492-2.
8. Axon RN, Gebregziabher M, Everett CJ, Heidenreich P, Hunt KJ. Dual health care system use is associated with higher rates of hospitalization and hospital readmission among veterans with heart failure. Am Heart J. 2016;174:157-163. https://doi.org/10.1016/j.ahj.2015.09.023.
9. Humensky J, Carretta H, de Groot K, et al. Service utilization of veterans dually eligible for VA and medicare fee-for-service: 1999–2004. Medicare Medicaid Res Rev. 2012;2(3). https://doi.org/10.5600/mmrr.002.03.A06.
10. West AN, Charlton ME, Vaughan-Sarrazin M. Dual use of VA and non-VA hospitals by veterans with multiple hospitalizations. BMC Health Serv Res. 2015;15(1):431. https://doi.org/10.1186/s12913-015-1069-8.
11. Gaglioti A, Cozad A, Wittrock S, et al. Non-VA primary care providers’ perspectives on comanagement for rural veterans. Mil Med. 2014;179(11):1236-1243. https://doi.org/10.7205/MILMED-D-13-00342.
12. Department of Veterans Affairs. Expanded access to non-VA care through the veterans choice program. Final rule. Fed Regist. 2018;83(92):21893-21897.
13. Shuster B. Text-H.R.3236-114th Congress. Surface Transportation and Veterans Health Care Choice Improvement Act of 2015.. https://www.congress.gov/bill/114th-congress/house-bill/3236/text/pl. Accessed April 16, 2017; 2015-2016.
14. Veterans Affairs Mission Act. MISSIONAct.va.gov Available at. https://missionact.va.gov/. Accessed August 9, 2019.
15. Veterans Choice Program (VCP). Community care. https://www.va.gov/COMMUNITYCARE/programs/veterans/VCP/index.asp. Accessed August 9, 2019.
16. A Decade of Transitional Care Research with Vulnerable Elder… : journal of cardiovascular nursing. LWW. http://journals.lww.com/jcnjournal/Fulltext/2000/04000/A_Decade_of_Transitional_Care_Research_with.4.aspx. Accessed April 16, 2017.
17. Coleman EA, Boult C. Improving the quality of transitional care for persons with complex care needs. J Am Geriatr Soc. 2003;51(4):556-557. https://doi.org/10.1046/j.1532-5415.2003.51186.x.
18. Krichbaum K. GAPN postacute care coordination improves hip fracture outcomes. West J Nurs Res. 2007;29(5):523-544. https://doi.org/10.1177/0193945906293817.
19. Kripalani S, Jackson AT, Schnipper JL, Coleman EA. Promoting effective transitions of care at hospital discharge: a review of key issues for hospitalists. J Hosp Med. 2007;2(5):314-323. https://doi.org/10.1002/jhm.228.
20. Coleman EA, Mahoney E, Parry C. Assessing the quality of preparation for posthospital care from the patient’s perspective: the care transitions measure. Med Care. 2005;43(3):246-255. https://doi.org/10.1097/00005650-200503000-00007.
21. Naylor MD, Aiken LH, Kurtzman ET, Olds DM, Hirschman KB. The importance of transitional care in achieving health reform. Health Aff (Millwood). 2011;30(4):746-754. https://doi.org/10.1377/hlthaff.2011.0041.
22. Naylor MD, Brooten DA, Campbell RL, et al. Transitional care of older adults hospitalized with heart failure: a randomized, controlled trial. J Am Geriatr Soc. 2004;52(5):675-684. https://doi.org/10.1111/j.1532-5415.2004.52202.x.
23. Snow V, Beck D, Budnitz T, et al. Transitions of care consensus policy statement: American College of Physicians, Society of General Internal Medicine, society of hospital medicine, American Geriatrics Society, American College of Emergency Physicians, and Society for Academic Emergency Medicine. J Hosp Med. 2009;4(6):364-370. https://doi.org/10.1002/jhm.510.
24. Coleman EA. Falling through the cracks: challenges and opportunities for improving transitional care for persons with continuous complex care needs. J Am Geriatr Soc. 2003;51(4):549-555. https://doi.org/10.1046/j.1532-5415.2003.51185.x.
25. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228-243. https://doi.org/10.1016/S1553-7250(08)34030-6.
26. Schweikhart SA, Dembe AE. The applicability of lean and six sigma techniques to clinical and translational research. J Investig Med. 2009;57(7):748-755. https://doi.org/10.2310/JIM.0b013e3181b91b3a.
27. Burke RE, Kripalani S, Vasilevskis EE, Schnipper JL. Moving beyond readmission penalties: creating an ideal process to improve transitional care. J Hosp Med. 2013;8(2):102-109. https://doi.org/10.1002/jhm.1990.
28. Patient Aligned Care Team (PACT)-Patient Care. Services. https://www.patientcare.va.gov/primarycare/PACT.asp. Accessed November 20, 2017.
29. Morse JM. Critical analysis of strategies for determining rigor in qualitative inquiry. Qual Health Res. 2015;25(9):1212-1222. https://doi.org/10.1177/1049732315588501.
30. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277-1288. https://doi.org/10.1177/1049732305276687.
31. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5(1):80-92. https://doi.org/10.1177/160940690600500107.
32. Ayele RA, Lawrence E, McCreight M, et al. Study protocol: improving the transition of care from a non-network hospital back to the patient’s medical home. BMC Health Serv Res. 2017;17(1):123. https://doi.org/10.1186/s12913-017-2048-z.
33. Burke RE, Kripalani S, Vasilevskis EE, Schnipper JL. Moving beyond readmission penalties: creating an ideal process to improve transitional care. J Hosp Med. 2013;8(2):102-109. https://doi.org/10.1002/jhm.1990.
34. Qualitative research & evaluation methods. https://us.sagepub.com/en-us/nam/qualitative-research-evaluation-methods/book232962. Accessed April 16, 2017. SAGE Publications Inc.
35. Curry LA, Nembhard IM, Bradley EH. Qualitative and mixed methods provide unique contributions to outcomes research. Circulation. 2009;119(10):1442-1452. https://doi.org/10.1161/CIRCULATIONAHA.107.742775.
36. Creswell JW, Hanson WE, Clark Plano VL, Morales A. Qualitative research designs: selection and implementation. Couns Psychol. 2007;35(2):236-264. https://doi.org/10.1177/0011000006287390.
37. Carter N, Bryant-Lukosius D, DiCenso A, Blythe J, Neville AJ. The use of triangulation in qualitative research. Oncol Nurs Forum. 2014;41(5):545-547. https://doi.org/10.1188/14.ONF.545-547.
38. Krumholz HM. Post-hospital syndrome—an acquired, transient condition of generalized risk. N Engl J Med. 2013;368(2):100-102. https://doi.org/10.1056/NEJMp1212324.
39. Improving Care Transitions. Health affairs-health policy briefs. http://www.healthaffairs.org/healthpolicybriefs/brief.php?brief_id=76. Accessed August 13, 2016.
40. Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573-576. https://doi.org/10.1370/afm.1713.
41. Burke RE, Kelley L, Gunzburger E, et al. Improving transitions of care for veterans transferred to tertiary VA medical centers. Am J Med Qual. 2018;33(2):147-153. https://doi.org/10.1177/1062860617715508.
42. Capp R, Misky GJ, Lindrooth RC, et al. Coordination program reduced acute care use and increased primary care visits among frequent emergency care users. Health Aff (Millwood). 2017;36(10):1705-1711. https://doi.org/10.1377/hlthaff.2017.0612.
43. Kind AJH, Brenny-Fitzpatrick M, Leahy-Gross K, et al. Harnessing protocolized adaptation in dissemination: successful implementation and sustainment of the veterans affairs coordinated-transitional care program in a non-veterans affairs hospital. J Am Geriatr Soc. 2016;64(2):409-416. https://doi.org/10.1111/jgs.13935.
44. Kind AJH, Jensen L, Barczi S, et al. Low-cost transitional care with nurse managers making mostly phone contact With patients cut rehospitalization at a VA Hospital. Health Aff. 2012;31(12):2659-2668. https://doi.org/10.1377/hlthaff.2012.0366.
45. Reese RL, Clement SA, Syeda S, et al. Coordinated-transitional care for veterans with heart failure and chronic lung disease. J Am Geriatr Soc. 2019;67(7):1502-1507. https://doi.org/10.1111/jgs.15978.
1. Borowsky SJ, Cowper DC. Dual use of VA and non-VA primary care. J Gen Intern Med. 1999;14(5):274-280. https://doi.org/10.1046/j.1525-1497.1999.00335.x.
2. Charlton ME, Mengeling MA, Schlichting JA, et al. Veteran use of health care systems in rural states. Comparing VA and Non-VA health care use among privately insured veterans under age 65. J Rural Health. 2016;32(4):407-417. https://doi.org/10.1111/jrh.12206.
3. Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161. https://doi.org/10.7326/0003-4819-138-3-200302040-00007.
4. Nguyen KA, Haggstrom DA, Ofner S, et al. Medication use among veterans across health care systems. Appl Clin Inform. 2017;26(1):235-249. https://doi.org/10.4338/ACI-2016-10-RA-0184.
5. Nayar P, Apenteng B, Yu F, Woodbridge P, Fetrick A. Rural veterans’ perspectives of dual care. J Commun Health. 2013;38(1):70-77. https://doi.org/10.1007/s10900-012-9583-7.
6. West AN, Charlton ME. Insured veterans’ use of VA and Non-VA health care in a rural state. J Rural Health. 2016;32(4):387-396. https://doi.org/10.1111/jrh.12196.
7. Gellad WF. The veterans choice act and dual health system use. J Gen Intern Med. 2016;31(2):153-154. https://doi.org/10.1007/s11606-015-3492-2.
8. Axon RN, Gebregziabher M, Everett CJ, Heidenreich P, Hunt KJ. Dual health care system use is associated with higher rates of hospitalization and hospital readmission among veterans with heart failure. Am Heart J. 2016;174:157-163. https://doi.org/10.1016/j.ahj.2015.09.023.
9. Humensky J, Carretta H, de Groot K, et al. Service utilization of veterans dually eligible for VA and medicare fee-for-service: 1999–2004. Medicare Medicaid Res Rev. 2012;2(3). https://doi.org/10.5600/mmrr.002.03.A06.
10. West AN, Charlton ME, Vaughan-Sarrazin M. Dual use of VA and non-VA hospitals by veterans with multiple hospitalizations. BMC Health Serv Res. 2015;15(1):431. https://doi.org/10.1186/s12913-015-1069-8.
11. Gaglioti A, Cozad A, Wittrock S, et al. Non-VA primary care providers’ perspectives on comanagement for rural veterans. Mil Med. 2014;179(11):1236-1243. https://doi.org/10.7205/MILMED-D-13-00342.
12. Department of Veterans Affairs. Expanded access to non-VA care through the veterans choice program. Final rule. Fed Regist. 2018;83(92):21893-21897.
13. Shuster B. Text-H.R.3236-114th Congress. Surface Transportation and Veterans Health Care Choice Improvement Act of 2015.. https://www.congress.gov/bill/114th-congress/house-bill/3236/text/pl. Accessed April 16, 2017; 2015-2016.
14. Veterans Affairs Mission Act. MISSIONAct.va.gov Available at. https://missionact.va.gov/. Accessed August 9, 2019.
15. Veterans Choice Program (VCP). Community care. https://www.va.gov/COMMUNITYCARE/programs/veterans/VCP/index.asp. Accessed August 9, 2019.
16. A Decade of Transitional Care Research with Vulnerable Elder… : journal of cardiovascular nursing. LWW. http://journals.lww.com/jcnjournal/Fulltext/2000/04000/A_Decade_of_Transitional_Care_Research_with.4.aspx. Accessed April 16, 2017.
17. Coleman EA, Boult C. Improving the quality of transitional care for persons with complex care needs. J Am Geriatr Soc. 2003;51(4):556-557. https://doi.org/10.1046/j.1532-5415.2003.51186.x.
18. Krichbaum K. GAPN postacute care coordination improves hip fracture outcomes. West J Nurs Res. 2007;29(5):523-544. https://doi.org/10.1177/0193945906293817.
19. Kripalani S, Jackson AT, Schnipper JL, Coleman EA. Promoting effective transitions of care at hospital discharge: a review of key issues for hospitalists. J Hosp Med. 2007;2(5):314-323. https://doi.org/10.1002/jhm.228.
20. Coleman EA, Mahoney E, Parry C. Assessing the quality of preparation for posthospital care from the patient’s perspective: the care transitions measure. Med Care. 2005;43(3):246-255. https://doi.org/10.1097/00005650-200503000-00007.
21. Naylor MD, Aiken LH, Kurtzman ET, Olds DM, Hirschman KB. The importance of transitional care in achieving health reform. Health Aff (Millwood). 2011;30(4):746-754. https://doi.org/10.1377/hlthaff.2011.0041.
22. Naylor MD, Brooten DA, Campbell RL, et al. Transitional care of older adults hospitalized with heart failure: a randomized, controlled trial. J Am Geriatr Soc. 2004;52(5):675-684. https://doi.org/10.1111/j.1532-5415.2004.52202.x.
23. Snow V, Beck D, Budnitz T, et al. Transitions of care consensus policy statement: American College of Physicians, Society of General Internal Medicine, society of hospital medicine, American Geriatrics Society, American College of Emergency Physicians, and Society for Academic Emergency Medicine. J Hosp Med. 2009;4(6):364-370. https://doi.org/10.1002/jhm.510.
24. Coleman EA. Falling through the cracks: challenges and opportunities for improving transitional care for persons with continuous complex care needs. J Am Geriatr Soc. 2003;51(4):549-555. https://doi.org/10.1046/j.1532-5415.2003.51185.x.
25. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228-243. https://doi.org/10.1016/S1553-7250(08)34030-6.
26. Schweikhart SA, Dembe AE. The applicability of lean and six sigma techniques to clinical and translational research. J Investig Med. 2009;57(7):748-755. https://doi.org/10.2310/JIM.0b013e3181b91b3a.
27. Burke RE, Kripalani S, Vasilevskis EE, Schnipper JL. Moving beyond readmission penalties: creating an ideal process to improve transitional care. J Hosp Med. 2013;8(2):102-109. https://doi.org/10.1002/jhm.1990.
28. Patient Aligned Care Team (PACT)-Patient Care. Services. https://www.patientcare.va.gov/primarycare/PACT.asp. Accessed November 20, 2017.
29. Morse JM. Critical analysis of strategies for determining rigor in qualitative inquiry. Qual Health Res. 2015;25(9):1212-1222. https://doi.org/10.1177/1049732315588501.
30. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277-1288. https://doi.org/10.1177/1049732305276687.
31. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5(1):80-92. https://doi.org/10.1177/160940690600500107.
32. Ayele RA, Lawrence E, McCreight M, et al. Study protocol: improving the transition of care from a non-network hospital back to the patient’s medical home. BMC Health Serv Res. 2017;17(1):123. https://doi.org/10.1186/s12913-017-2048-z.
33. Burke RE, Kripalani S, Vasilevskis EE, Schnipper JL. Moving beyond readmission penalties: creating an ideal process to improve transitional care. J Hosp Med. 2013;8(2):102-109. https://doi.org/10.1002/jhm.1990.
34. Qualitative research & evaluation methods. https://us.sagepub.com/en-us/nam/qualitative-research-evaluation-methods/book232962. Accessed April 16, 2017. SAGE Publications Inc.
35. Curry LA, Nembhard IM, Bradley EH. Qualitative and mixed methods provide unique contributions to outcomes research. Circulation. 2009;119(10):1442-1452. https://doi.org/10.1161/CIRCULATIONAHA.107.742775.
36. Creswell JW, Hanson WE, Clark Plano VL, Morales A. Qualitative research designs: selection and implementation. Couns Psychol. 2007;35(2):236-264. https://doi.org/10.1177/0011000006287390.
37. Carter N, Bryant-Lukosius D, DiCenso A, Blythe J, Neville AJ. The use of triangulation in qualitative research. Oncol Nurs Forum. 2014;41(5):545-547. https://doi.org/10.1188/14.ONF.545-547.
38. Krumholz HM. Post-hospital syndrome—an acquired, transient condition of generalized risk. N Engl J Med. 2013;368(2):100-102. https://doi.org/10.1056/NEJMp1212324.
39. Improving Care Transitions. Health affairs-health policy briefs. http://www.healthaffairs.org/healthpolicybriefs/brief.php?brief_id=76. Accessed August 13, 2016.
40. Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573-576. https://doi.org/10.1370/afm.1713.
41. Burke RE, Kelley L, Gunzburger E, et al. Improving transitions of care for veterans transferred to tertiary VA medical centers. Am J Med Qual. 2018;33(2):147-153. https://doi.org/10.1177/1062860617715508.
42. Capp R, Misky GJ, Lindrooth RC, et al. Coordination program reduced acute care use and increased primary care visits among frequent emergency care users. Health Aff (Millwood). 2017;36(10):1705-1711. https://doi.org/10.1377/hlthaff.2017.0612.
43. Kind AJH, Brenny-Fitzpatrick M, Leahy-Gross K, et al. Harnessing protocolized adaptation in dissemination: successful implementation and sustainment of the veterans affairs coordinated-transitional care program in a non-veterans affairs hospital. J Am Geriatr Soc. 2016;64(2):409-416. https://doi.org/10.1111/jgs.13935.
44. Kind AJH, Jensen L, Barczi S, et al. Low-cost transitional care with nurse managers making mostly phone contact With patients cut rehospitalization at a VA Hospital. Health Aff. 2012;31(12):2659-2668. https://doi.org/10.1377/hlthaff.2012.0366.
45. Reese RL, Clement SA, Syeda S, et al. Coordinated-transitional care for veterans with heart failure and chronic lung disease. J Am Geriatr Soc. 2019;67(7):1502-1507. https://doi.org/10.1111/jgs.15978.
© 2020 Society of Hospital Medicine
A Motivational Interviewing Training Program for Tobacco Cessation Counseling in Primary Care
Primary care providers (PCPs) need effective tools for activating health behavior change for the 125 million Americans living with a chronic condition.1 Smoking is an important and difficult behavior to change, and a motivator for quitting is tobacco cessation advice from a PCP.2,3 However, few PCPs provide comprehensive tobacco cessation counseling as part of routine care.4,5 One perceived barrier that providers report is their lack of training to be effective tobacco cessation advocates.4,6-8
Motivational interviewing (MI) promotes behavior change by using a nonadversarial approach aimed at resolving patient ambivalence. Motivational interviewing tools, such as asking open-ended questions, providing summary statements of what the patient expresses, reflective listening, and affirmations, are used to spur an intrinsic drive to change. These techniques have been applied to a broad range of health behaviors with positive outcomes and demonstrated efficacy.9-11 Furthermore, MI can be used in primary care for changing tobacco use, alcohol consumption, physical activity, and diet.12-14
Despite its efficacy, MI can be time-intensive to learn. Fortunately, even abbreviated MI can influence patient behavior.15,16 Rollnick and others have developed MI interventions that are deliverable in 5 to 10 minutes.17,18 These brief interventions focus on performing a rapid assessment of patients’ perceived importance and self-efficacy for change.17,18
There is increased interest in training health care professionals (HCPs) in MI, yet there is no consensus on the most effective training approach.19,20 Practitioners with many competing priorities often like to learn new skills through self-study or onetime workshops. Yet evidence suggests that these are not effective methods for gaining MI proficiency. Instead, MI training sessions that offer feedback and coaching are more effective in helping participants retain MI skills over time.21,22
The authors developed and successfully pilot-tested an MI training program called the Motivational Interviewing Smoking Treatment Enhancement Program (MI-STEP) for HCPs. This program was designed to facilitate tobacco cessation care in the VHA primary care patient centered medical home, which VHA calls patient aligned care teams (PACTs).23 The main conclusions of this pilot study have been reported elsewhere.24
The objective of this article is to describe the process evaluation the authors conducted during the MI-STEP study to gain a better understanding of how the implementation of the MI training program could be improved. The authors identified barriers and facilitators from the perspectives of MI champions and PACT practitioners.
Methods
Thirty-four PACT practitioners (physicians, nurse practitioners, registered nurses, licensed practical nurses, and pharmacists) at 2 VA medical centers were randomly assigned to a high- or moderate-intensity MI training program during the summer of 2012. This training was delivered by “MI champions,” who were recruited from PACTs and who attended a 3-day advanced training class on MI. The training included MI skills practice, group case analysis, various role-play exercises, and didactics adapted from the Rx for Change program.25 The curriculum also addressed tobacco cessation counseling using the national tobacco cessation guideline.2 Each site’s health behavior coordinator (HBC) also was recruited to be an MI champion. The HBCs are typically psychologists who have received prior training in MI as well as facilitator and clinician coaching. At the VA, HBCs are charged with integrating preventive services into care. The participating sites’ institutional review boards approved all study procedures.
MI-STEP Training Program
All 34 practitioners attended a half-day on-site MI training workshop led by the site’s HBC. This training covered the basics of MI and used interactive learning methods such as role-play (Table 1). The study practitioners also received self-study materials, and throughout the study period had access to the MI champions. Practitioners who were randomized to high-intensity MI training also attended 6 supplemental 1-hour “booster sessions” to enhance specific MI skills. The MI champions led 3 of the 1-hour booster sessions with a standard agenda, including patient cases and MI exercises. During the other 3 booster sessions, participants used patient cases to interact with a standardized patient over the telephone, and the MI champions provided feedback and coaching.
Process Evaluation
Six months after the program’s completion, investigators conducted an evaluation of the MI-STEP training program with MI champions and study practitioners. One-hour focus group sessions (2 in Minneapolis; 1 in Denver) were conducted with the MI champions by a co-investigator in Minneapolis and a facilitator in Denver. Notes were taken during the sessions. MI champions were asked about the quality of their training sessions, challenges to getting PACT members to participate in the site training, challenges to teaching MI, and how they felt MI fit within VA health care philosophy.
Ten training study practitioners were randomly selected and stratified based on group intensity assignment, discipline, and site to participate in in-depth interviews. The interviews lasted about 30 minutes, and Minneapolis study investigators conducted in-person interviews with local participants and telephone interviews with Denver participants. The interviews focused on experiences with both high- and moderate-intensity MI training programs, how MI was used in their practice, barriers to implementing MI, impressions of the MI training program, and their interactions with MI champions.
Focus group leaders were experienced interviewers who had not previously interacted with MI champions in the context of this study. Investigators conducting study practitioner interviews were blinded to group assignment. All interviews were audio-recorded and transcribed verbatim. Study investigators reviewed the focus group notes and interview transcripts, identified themes independently, and then discussed group themes. The most salient themes were selected to inform implementation of a larger scale MI training program.
Results
Nine MI champions participated in the focus groups, and 8 study practitioners from both sites representing all clinical disciplines completed in-depth interviews. Table 2 identifies the characteristics of each population.
MI Champion Focus Group Themes
The champions were asked to discuss all aspects of the program, including their training as champions, role as trainers, attitudes about using MI during patient encounters, and participation in the training program. Themes from the MI champion focus groups were placed in the following categories based on the authors’ analytic approach: training MI champions, training study practitioners, and attitudes about MI.
Training MI champions. The champions identified role-play exercises and receiving feedback as strengths of the training program. The champions also expressed the desire for more hands-on practice, especially in small groups. They wanted additional training on teaching MI and facilitating the booster sessions. The champions wanted an expert to train them on how to give feedback and how to best coach practitioners in their use of MI. Champions expressed a desire to have follow-up training sessions with the standardized patient to help them hone their newly acquired coaching skills.
Training study practitioners. The champions’ key role was to train local practitioners and lead the booster sessions for the high-intensity MI training group. Champions felt ill-prepared to fully cover the training materials during the initial half-day workshop and 6 booster sessions. Champions identified difficulty coordinating schedules with the practitioners and lack of compensation for participation as significant barriers to implementing the booster sessions. Champions felt that using a standardized patient during the booster sessions was a strength of the program and that making the cases more realistic could have further enhanced the program.
Attitudes about MI. Champions from both sites perceived MI to have a positive impact on patient care. However, all champions noted there were challenges in using MI in practice. Champions felt MI takes time, energy, and practice to gain proficiency. The current primary care system is not set up to support the use of MI. The appointment time slots are fixed, and VHA goals and the spirit of MI are not always compatible. VHA performance measures encourage providers to achieve performance targets with each patient, often requiring use of directives for patients on what to do. In contrast, MI encourages the patient to take the lead on goal setting and prioritizing.
Study Practitioner Interview Themes
The practitioners were asked to discuss MI skills training, using MI skills with patients, integrating MI into daily practice, getting other PACT members involved, booster sessions, interactions with champions, and suggestions for improving the MI program. Themes from the study practitioner interviews were grouped into the following categories: MI skills training, using MI skills, integrating MI into practice, and suggestions for improving MI training (Table 3).
MI skills training. Overall, the MI high-intensity participants stated they learned useful skills. They reported asking more questions that are open-ended and were more aware of the patient’s perspective. Practitioners reported that booster sessions provided a way to reinforce, refine, and practice their MI skills. Practitioners reported that having the champion located in their own PACT was critical for connecting with their champion between sessions. Nurses and doctors reported that not having time to meet with champions was a barrier, while pharmacists reported more flexibility.
The moderate-intensity participants reported that the training had less impact. Half the respondents reported that they did not remember much of the MI training and either forgot or did not use the newly learned MI skills.
Using MI skills. Both high- and moderate-intensity participants reported using open-ended questions, reflections, affirmations, motivation scales, and active listening.
Practitioners reported that MI helped them focus on patient-centered care, since MI is collaborative. Even when a session was not successful in leading to behavior change, practitioners felt more satisfied with the quality of the interaction.
Integrating MI into practice. The high- and moderate-intensity practitioners had different perceptions of using MI in daily practice. High-intensity participants thought MI required an initial time investment, but that would be balanced by a decrease in the number of follow-up visits needed and/or delay the time between visits. The moderate-intensity participants were more likely to report struggling with the amount of time MI took.
Suggestions for improving MI training. Practitioners from both training groups offered suggestions for improving MI training. Supervisor buy-in was deemed critical to getting other PACT members involved. Practitioners suggested providing compensation or making training mandatory to help motivate others to participate in MI training. Also, practitioners were ready to expand the MI training beyond smoking cessation to incorporate other diseases and multiple comorbidities.
The moderate-intensity participants suggested more training, practice, follow-up, and feedback. These participants also suggested boosterlike sessions.
Discussion
Champions and study practitioners reported that learning MI skills was useful. The participants felt that MI was consistent with their personal philosophies regarding patient-centered care and that MI had a positive impact on patient care. Practitioners and MI champions offered several insights for improving the delivery of MI training. First, practitioners and champions highlighted how important practice and feedback were to learning MI. Booster sessions, standardized patients, and critical feedback enhanced learning.
Second, champions reported that they wanted more training in how to teach MI. Third, practitioners and champions repeatedly stated that finding the time needed to become proficient in MI was difficult and that using the MI approach with patients took additional time during clinical sessions. However, participants in the high-intensity group reported more satisfaction with the quality of their patient encounters and the freedom to follow up with patients less often.
There were aspects of the environment and MI training program that facilitated the MI learning process. The high-intensity group cited booster session feedback as being reinforcing; the moderate-intensity group expressed a desire to practice their newly acquired skill and felt feedback and coaching would have enhanced their learning. Practitioners and champions reported that using a standardized patient to enhance experiential learning activities was an asset. Standardized patients have been used successfully in other training programs.21
Implementing an MI training program posed a number of challenges. The biggest barrier was lack of time. PACT members found it difficult to attend a half-day MI workshop, practice MI skills, and incorporate MI routinely into daily practice. However, without the investment of time, even basic MI proficiency is unachievable.22
This study highlighted several ways to improve feedback and coaching. First, the authors would expand the MI champion curriculum to include training to provide effective feedback/coaching. Second, the authors would train the standardized patient on how to provide feedback to the MI learner. As implemented, the standardized patient evaluated the learner only on whether the patient felt “heard” by the learner.
Perhaps most critical to the success of an MI training program is institutional support. There needs to be adequate time and space for the training process as well as support for ongoing learning and feedback as MI skills are refined. Furthermore, sufficient time is needed during patients’ appointments to allow for MI-oriented conversations. Time is an important, valuable, and scarce resource that institutions control. Administrators should realize that the up-front investment is likely to provide a downstream return as providers become proficient in MI.
There is an urgent need to find ways to incorporate training into the daily practice of busy HCPs. Although this study was limited by its small sample, it demonstrated the feasibility of implementing an MI training program for practitioners working in a busy primary care environment. This study offers concrete suggestions for overcoming barriers and enhancing facilitators, which can guide much needed larger studies as they examine MI training effectiveness on patient and clinician outcomes.
Champions and practitioners reported that learning MI was important, but opportunities to practice and receive critical feedback are needed to achieve proficiency and improve confidence. Both champions and study practitioners thought practicing with a standardized patient would enrich their learning. However, dedicated time for learning and practicing MI skills is critical and hard to arrange.
Conclusion
Practitioners can use MI to activate health behavior change in their patients. Training PACT practitioners to use MI is feasible. The results of this evaluation can be used to inform the next iteration of an MI training program for HCPs by highlighting the facilitators of and barriers to training.
Because of the interest in activating patient-centered health behavior change, these findings are important. The educational and practice opportunities were well received. Training with standardized patients and incorporating MI champions into PACTs facilitated training. However, the lack of time was a major barrier to learning and practicing MI skills and will need to be addressed. If effectively implemented, training providers by using an evidence-based approach, such as MI, can promote long-term health.
Acknowledgments
This study was funded by VA Health Services Research & Development (HSR&D) Rapid Response Project 11-019. The Center for Chronic Disease Outcomes Research is supported by the VA, VHA, Office of Research and Development, and HSR&D. Dr. Widome was supported by a VA HSR&D Career Development Award.
1. Anderson G, Horvath J. The growing burden of chronic disease in America. Public Health Rep. 2004;119(3):263-270
2. Fiore MC, Jaen CR, Baker TB, et al. Treating Tobacco Use and Dependence: 2008 Update. Clinical Practice Guideline. Rockville, MD: U.S. Dept of Health and Human Services, Public Health Service; 2008.
3. Park E, Eaton CA, Goldstein MG, et al. The development of a decisional balance measure of physician smoking cessation interventions. Prev Med. 2001;33(4):261-267.
4. Ferketich AK, Khan Y, Wewers ME. Are physicians asking about tobacco use and assisting with cessation? Results from the 2001-2004 National Ambulatory Medical Care Survey (NAMCS). Prev Med. 2006;43(6):472-476.
5. Marcy TW, Skelly J, Shiffman RN, Flynn BS. Facilitating adherence to the tobacco use treatment guideline with computer-mediated decision support systems: physician and clinic office manager perspectives. Prev Med. 2005;41(2):479-487.
6. Cabana MD, Rand CS, Powe NR, et al. Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282(15):1458-1465.
7. Jaén CR, McIlvain H, Pol L, Phillips RL Jr, Flocke S, Crabtree BF. Tailoring tobacco counseling to the competing demands in the clinical encounter. J Fam Pract. 2001;50(10):859-863.
8. Malte CA, McFall M, Chow B, Beckham JC, Carmody TP, Saxon AJ. Survey of providers' attitudes toward integrating smoking cessation treatment into posttraumatic stress disorder care. Psychol Addict Behav. 2013;27(1):249-255.
9. Hettema J, Steele J, Miller WR. Motivational interviewing. Annu Rev Clin Psychol. 2005;1:91-111.
10. Rollnick S, Miller WR, Butler BC. Motivational Interviewing in Health Care: Helping Patients Change Behavior. New York, NY: Guilford Press; 2008.
11. Miller WR. Motivational interviewing with problem drinkers. Behav Psychother. 1983;11(2):147-172.
12. Brodie DA, Inoue A. Motivational interviewing to promote physical activity for people with chronic heart failure. J Adv Nurs. 2005;50(5):518-527.
13. Perry CK, Rosenfeld AG, Bennett JA, Potempa K. Heart-to-Heart: promoting walking in rural women through motivational interviewing and group support. J Cardiovascular Nurs. 2007;22(4):304-312.
14. West DS, DiLillo V, Bursac Z, Gore SA, Greene PG. Motivational interviewing improves weight loss in women with type 2 diabetes. Diabetes Care. 2007;30(5):1081-1087.
15. Fiore MC, Novotny TE, Pierce JP, et al. Trends in cigarette smoking in the United States. JAMA. 1989;261(1):49-55.
16. Lancaster T, Stead L. Physician advice for smoking cessation. Cochrane Database Syst Rev. 2004;18(4):CD000165.
17. Butler C, Rollnick S, Cohen D, Bachmann M, Russell I, Stott N. Motivational counseling versus brief advice for smokers in general practice: a randomized trial. Br J Gen Pract. 1999;49(445):611-616.
18. Rollnick S, Heather N, Bell A. Negotiating behaviour change in medical settings: the development of brief motivational interviewing. J Ment Health. 1992;1(1):25-37.
19. Madson MB, Loignon AC, Lane C. Training in motivational interviewing: a systematic review. J Subst Abuse Treat. 2009;36(1):101-109.
20. Miller WR, Yahne CE, Moyers TB, Martinez J, Pirritano M. A randomized trial of methods to help clinicians learn motivational interviewing. J Consult Clin Psychol. 2004;72(6):1050-1062.
21. Lundahl B, Burke BL. The effectiveness and applicability of motivational interviewing: a practice-friendly review of four meta-analyses. J Clin Pyschol. 2009;65(11):1232-1245.
22. Miller WR, Moyers TB. Eight stages in Learning motivational interviewing. J Teaching Addict. 2006;5(1):13-15.
23. Rosland AM, Nelson K, Sun H, et al. The patient-centered medical home in the Veterans Health Administration. Am J Manag Care. 2013;19(7):e263-e272.
24. Fu S, Roth C, Battaglia CT, et al. Training primary care clinicians in motivational interviewing: a comparison of two models. Patient Educ Couns. 2015;98(1):61-68.
25. School of Pharmacy & Medicine University of California, San Francisco. Rx for change website. http://rxforchange.ucsf.edu/. Accessed May 25, 2016.
Primary care providers (PCPs) need effective tools for activating health behavior change for the 125 million Americans living with a chronic condition.1 Smoking is an important and difficult behavior to change, and a motivator for quitting is tobacco cessation advice from a PCP.2,3 However, few PCPs provide comprehensive tobacco cessation counseling as part of routine care.4,5 One perceived barrier that providers report is their lack of training to be effective tobacco cessation advocates.4,6-8
Motivational interviewing (MI) promotes behavior change by using a nonadversarial approach aimed at resolving patient ambivalence. Motivational interviewing tools, such as asking open-ended questions, providing summary statements of what the patient expresses, reflective listening, and affirmations, are used to spur an intrinsic drive to change. These techniques have been applied to a broad range of health behaviors with positive outcomes and demonstrated efficacy.9-11 Furthermore, MI can be used in primary care for changing tobacco use, alcohol consumption, physical activity, and diet.12-14
Despite its efficacy, MI can be time-intensive to learn. Fortunately, even abbreviated MI can influence patient behavior.15,16 Rollnick and others have developed MI interventions that are deliverable in 5 to 10 minutes.17,18 These brief interventions focus on performing a rapid assessment of patients’ perceived importance and self-efficacy for change.17,18
There is increased interest in training health care professionals (HCPs) in MI, yet there is no consensus on the most effective training approach.19,20 Practitioners with many competing priorities often like to learn new skills through self-study or onetime workshops. Yet evidence suggests that these are not effective methods for gaining MI proficiency. Instead, MI training sessions that offer feedback and coaching are more effective in helping participants retain MI skills over time.21,22
The authors developed and successfully pilot-tested an MI training program called the Motivational Interviewing Smoking Treatment Enhancement Program (MI-STEP) for HCPs. This program was designed to facilitate tobacco cessation care in the VHA primary care patient centered medical home, which VHA calls patient aligned care teams (PACTs).23 The main conclusions of this pilot study have been reported elsewhere.24
The objective of this article is to describe the process evaluation the authors conducted during the MI-STEP study to gain a better understanding of how the implementation of the MI training program could be improved. The authors identified barriers and facilitators from the perspectives of MI champions and PACT practitioners.
Methods
Thirty-four PACT practitioners (physicians, nurse practitioners, registered nurses, licensed practical nurses, and pharmacists) at 2 VA medical centers were randomly assigned to a high- or moderate-intensity MI training program during the summer of 2012. This training was delivered by “MI champions,” who were recruited from PACTs and who attended a 3-day advanced training class on MI. The training included MI skills practice, group case analysis, various role-play exercises, and didactics adapted from the Rx for Change program.25 The curriculum also addressed tobacco cessation counseling using the national tobacco cessation guideline.2 Each site’s health behavior coordinator (HBC) also was recruited to be an MI champion. The HBCs are typically psychologists who have received prior training in MI as well as facilitator and clinician coaching. At the VA, HBCs are charged with integrating preventive services into care. The participating sites’ institutional review boards approved all study procedures.
MI-STEP Training Program
All 34 practitioners attended a half-day on-site MI training workshop led by the site’s HBC. This training covered the basics of MI and used interactive learning methods such as role-play (Table 1). The study practitioners also received self-study materials, and throughout the study period had access to the MI champions. Practitioners who were randomized to high-intensity MI training also attended 6 supplemental 1-hour “booster sessions” to enhance specific MI skills. The MI champions led 3 of the 1-hour booster sessions with a standard agenda, including patient cases and MI exercises. During the other 3 booster sessions, participants used patient cases to interact with a standardized patient over the telephone, and the MI champions provided feedback and coaching.
Process Evaluation
Six months after the program’s completion, investigators conducted an evaluation of the MI-STEP training program with MI champions and study practitioners. One-hour focus group sessions (2 in Minneapolis; 1 in Denver) were conducted with the MI champions by a co-investigator in Minneapolis and a facilitator in Denver. Notes were taken during the sessions. MI champions were asked about the quality of their training sessions, challenges to getting PACT members to participate in the site training, challenges to teaching MI, and how they felt MI fit within VA health care philosophy.
Ten training study practitioners were randomly selected and stratified based on group intensity assignment, discipline, and site to participate in in-depth interviews. The interviews lasted about 30 minutes, and Minneapolis study investigators conducted in-person interviews with local participants and telephone interviews with Denver participants. The interviews focused on experiences with both high- and moderate-intensity MI training programs, how MI was used in their practice, barriers to implementing MI, impressions of the MI training program, and their interactions with MI champions.
Focus group leaders were experienced interviewers who had not previously interacted with MI champions in the context of this study. Investigators conducting study practitioner interviews were blinded to group assignment. All interviews were audio-recorded and transcribed verbatim. Study investigators reviewed the focus group notes and interview transcripts, identified themes independently, and then discussed group themes. The most salient themes were selected to inform implementation of a larger scale MI training program.
Results
Nine MI champions participated in the focus groups, and 8 study practitioners from both sites representing all clinical disciplines completed in-depth interviews. Table 2 identifies the characteristics of each population.
MI Champion Focus Group Themes
The champions were asked to discuss all aspects of the program, including their training as champions, role as trainers, attitudes about using MI during patient encounters, and participation in the training program. Themes from the MI champion focus groups were placed in the following categories based on the authors’ analytic approach: training MI champions, training study practitioners, and attitudes about MI.
Training MI champions. The champions identified role-play exercises and receiving feedback as strengths of the training program. The champions also expressed the desire for more hands-on practice, especially in small groups. They wanted additional training on teaching MI and facilitating the booster sessions. The champions wanted an expert to train them on how to give feedback and how to best coach practitioners in their use of MI. Champions expressed a desire to have follow-up training sessions with the standardized patient to help them hone their newly acquired coaching skills.
Training study practitioners. The champions’ key role was to train local practitioners and lead the booster sessions for the high-intensity MI training group. Champions felt ill-prepared to fully cover the training materials during the initial half-day workshop and 6 booster sessions. Champions identified difficulty coordinating schedules with the practitioners and lack of compensation for participation as significant barriers to implementing the booster sessions. Champions felt that using a standardized patient during the booster sessions was a strength of the program and that making the cases more realistic could have further enhanced the program.
Attitudes about MI. Champions from both sites perceived MI to have a positive impact on patient care. However, all champions noted there were challenges in using MI in practice. Champions felt MI takes time, energy, and practice to gain proficiency. The current primary care system is not set up to support the use of MI. The appointment time slots are fixed, and VHA goals and the spirit of MI are not always compatible. VHA performance measures encourage providers to achieve performance targets with each patient, often requiring use of directives for patients on what to do. In contrast, MI encourages the patient to take the lead on goal setting and prioritizing.
Study Practitioner Interview Themes
The practitioners were asked to discuss MI skills training, using MI skills with patients, integrating MI into daily practice, getting other PACT members involved, booster sessions, interactions with champions, and suggestions for improving the MI program. Themes from the study practitioner interviews were grouped into the following categories: MI skills training, using MI skills, integrating MI into practice, and suggestions for improving MI training (Table 3).
MI skills training. Overall, the MI high-intensity participants stated they learned useful skills. They reported asking more questions that are open-ended and were more aware of the patient’s perspective. Practitioners reported that booster sessions provided a way to reinforce, refine, and practice their MI skills. Practitioners reported that having the champion located in their own PACT was critical for connecting with their champion between sessions. Nurses and doctors reported that not having time to meet with champions was a barrier, while pharmacists reported more flexibility.
The moderate-intensity participants reported that the training had less impact. Half the respondents reported that they did not remember much of the MI training and either forgot or did not use the newly learned MI skills.
Using MI skills. Both high- and moderate-intensity participants reported using open-ended questions, reflections, affirmations, motivation scales, and active listening.
Practitioners reported that MI helped them focus on patient-centered care, since MI is collaborative. Even when a session was not successful in leading to behavior change, practitioners felt more satisfied with the quality of the interaction.
Integrating MI into practice. The high- and moderate-intensity practitioners had different perceptions of using MI in daily practice. High-intensity participants thought MI required an initial time investment, but that would be balanced by a decrease in the number of follow-up visits needed and/or delay the time between visits. The moderate-intensity participants were more likely to report struggling with the amount of time MI took.
Suggestions for improving MI training. Practitioners from both training groups offered suggestions for improving MI training. Supervisor buy-in was deemed critical to getting other PACT members involved. Practitioners suggested providing compensation or making training mandatory to help motivate others to participate in MI training. Also, practitioners were ready to expand the MI training beyond smoking cessation to incorporate other diseases and multiple comorbidities.
The moderate-intensity participants suggested more training, practice, follow-up, and feedback. These participants also suggested boosterlike sessions.
Discussion
Champions and study practitioners reported that learning MI skills was useful. The participants felt that MI was consistent with their personal philosophies regarding patient-centered care and that MI had a positive impact on patient care. Practitioners and MI champions offered several insights for improving the delivery of MI training. First, practitioners and champions highlighted how important practice and feedback were to learning MI. Booster sessions, standardized patients, and critical feedback enhanced learning.
Second, champions reported that they wanted more training in how to teach MI. Third, practitioners and champions repeatedly stated that finding the time needed to become proficient in MI was difficult and that using the MI approach with patients took additional time during clinical sessions. However, participants in the high-intensity group reported more satisfaction with the quality of their patient encounters and the freedom to follow up with patients less often.
There were aspects of the environment and MI training program that facilitated the MI learning process. The high-intensity group cited booster session feedback as being reinforcing; the moderate-intensity group expressed a desire to practice their newly acquired skill and felt feedback and coaching would have enhanced their learning. Practitioners and champions reported that using a standardized patient to enhance experiential learning activities was an asset. Standardized patients have been used successfully in other training programs.21
Implementing an MI training program posed a number of challenges. The biggest barrier was lack of time. PACT members found it difficult to attend a half-day MI workshop, practice MI skills, and incorporate MI routinely into daily practice. However, without the investment of time, even basic MI proficiency is unachievable.22
This study highlighted several ways to improve feedback and coaching. First, the authors would expand the MI champion curriculum to include training to provide effective feedback/coaching. Second, the authors would train the standardized patient on how to provide feedback to the MI learner. As implemented, the standardized patient evaluated the learner only on whether the patient felt “heard” by the learner.
Perhaps most critical to the success of an MI training program is institutional support. There needs to be adequate time and space for the training process as well as support for ongoing learning and feedback as MI skills are refined. Furthermore, sufficient time is needed during patients’ appointments to allow for MI-oriented conversations. Time is an important, valuable, and scarce resource that institutions control. Administrators should realize that the up-front investment is likely to provide a downstream return as providers become proficient in MI.
There is an urgent need to find ways to incorporate training into the daily practice of busy HCPs. Although this study was limited by its small sample, it demonstrated the feasibility of implementing an MI training program for practitioners working in a busy primary care environment. This study offers concrete suggestions for overcoming barriers and enhancing facilitators, which can guide much needed larger studies as they examine MI training effectiveness on patient and clinician outcomes.
Champions and practitioners reported that learning MI was important, but opportunities to practice and receive critical feedback are needed to achieve proficiency and improve confidence. Both champions and study practitioners thought practicing with a standardized patient would enrich their learning. However, dedicated time for learning and practicing MI skills is critical and hard to arrange.
Conclusion
Practitioners can use MI to activate health behavior change in their patients. Training PACT practitioners to use MI is feasible. The results of this evaluation can be used to inform the next iteration of an MI training program for HCPs by highlighting the facilitators of and barriers to training.
Because of the interest in activating patient-centered health behavior change, these findings are important. The educational and practice opportunities were well received. Training with standardized patients and incorporating MI champions into PACTs facilitated training. However, the lack of time was a major barrier to learning and practicing MI skills and will need to be addressed. If effectively implemented, training providers by using an evidence-based approach, such as MI, can promote long-term health.
Acknowledgments
This study was funded by VA Health Services Research & Development (HSR&D) Rapid Response Project 11-019. The Center for Chronic Disease Outcomes Research is supported by the VA, VHA, Office of Research and Development, and HSR&D. Dr. Widome was supported by a VA HSR&D Career Development Award.
Primary care providers (PCPs) need effective tools for activating health behavior change for the 125 million Americans living with a chronic condition.1 Smoking is an important and difficult behavior to change, and a motivator for quitting is tobacco cessation advice from a PCP.2,3 However, few PCPs provide comprehensive tobacco cessation counseling as part of routine care.4,5 One perceived barrier that providers report is their lack of training to be effective tobacco cessation advocates.4,6-8
Motivational interviewing (MI) promotes behavior change by using a nonadversarial approach aimed at resolving patient ambivalence. Motivational interviewing tools, such as asking open-ended questions, providing summary statements of what the patient expresses, reflective listening, and affirmations, are used to spur an intrinsic drive to change. These techniques have been applied to a broad range of health behaviors with positive outcomes and demonstrated efficacy.9-11 Furthermore, MI can be used in primary care for changing tobacco use, alcohol consumption, physical activity, and diet.12-14
Despite its efficacy, MI can be time-intensive to learn. Fortunately, even abbreviated MI can influence patient behavior.15,16 Rollnick and others have developed MI interventions that are deliverable in 5 to 10 minutes.17,18 These brief interventions focus on performing a rapid assessment of patients’ perceived importance and self-efficacy for change.17,18
There is increased interest in training health care professionals (HCPs) in MI, yet there is no consensus on the most effective training approach.19,20 Practitioners with many competing priorities often like to learn new skills through self-study or onetime workshops. Yet evidence suggests that these are not effective methods for gaining MI proficiency. Instead, MI training sessions that offer feedback and coaching are more effective in helping participants retain MI skills over time.21,22
The authors developed and successfully pilot-tested an MI training program called the Motivational Interviewing Smoking Treatment Enhancement Program (MI-STEP) for HCPs. This program was designed to facilitate tobacco cessation care in the VHA primary care patient centered medical home, which VHA calls patient aligned care teams (PACTs).23 The main conclusions of this pilot study have been reported elsewhere.24
The objective of this article is to describe the process evaluation the authors conducted during the MI-STEP study to gain a better understanding of how the implementation of the MI training program could be improved. The authors identified barriers and facilitators from the perspectives of MI champions and PACT practitioners.
Methods
Thirty-four PACT practitioners (physicians, nurse practitioners, registered nurses, licensed practical nurses, and pharmacists) at 2 VA medical centers were randomly assigned to a high- or moderate-intensity MI training program during the summer of 2012. This training was delivered by “MI champions,” who were recruited from PACTs and who attended a 3-day advanced training class on MI. The training included MI skills practice, group case analysis, various role-play exercises, and didactics adapted from the Rx for Change program.25 The curriculum also addressed tobacco cessation counseling using the national tobacco cessation guideline.2 Each site’s health behavior coordinator (HBC) also was recruited to be an MI champion. The HBCs are typically psychologists who have received prior training in MI as well as facilitator and clinician coaching. At the VA, HBCs are charged with integrating preventive services into care. The participating sites’ institutional review boards approved all study procedures.
MI-STEP Training Program
All 34 practitioners attended a half-day on-site MI training workshop led by the site’s HBC. This training covered the basics of MI and used interactive learning methods such as role-play (Table 1). The study practitioners also received self-study materials, and throughout the study period had access to the MI champions. Practitioners who were randomized to high-intensity MI training also attended 6 supplemental 1-hour “booster sessions” to enhance specific MI skills. The MI champions led 3 of the 1-hour booster sessions with a standard agenda, including patient cases and MI exercises. During the other 3 booster sessions, participants used patient cases to interact with a standardized patient over the telephone, and the MI champions provided feedback and coaching.
Process Evaluation
Six months after the program’s completion, investigators conducted an evaluation of the MI-STEP training program with MI champions and study practitioners. One-hour focus group sessions (2 in Minneapolis; 1 in Denver) were conducted with the MI champions by a co-investigator in Minneapolis and a facilitator in Denver. Notes were taken during the sessions. MI champions were asked about the quality of their training sessions, challenges to getting PACT members to participate in the site training, challenges to teaching MI, and how they felt MI fit within VA health care philosophy.
Ten training study practitioners were randomly selected and stratified based on group intensity assignment, discipline, and site to participate in in-depth interviews. The interviews lasted about 30 minutes, and Minneapolis study investigators conducted in-person interviews with local participants and telephone interviews with Denver participants. The interviews focused on experiences with both high- and moderate-intensity MI training programs, how MI was used in their practice, barriers to implementing MI, impressions of the MI training program, and their interactions with MI champions.
Focus group leaders were experienced interviewers who had not previously interacted with MI champions in the context of this study. Investigators conducting study practitioner interviews were blinded to group assignment. All interviews were audio-recorded and transcribed verbatim. Study investigators reviewed the focus group notes and interview transcripts, identified themes independently, and then discussed group themes. The most salient themes were selected to inform implementation of a larger scale MI training program.
Results
Nine MI champions participated in the focus groups, and 8 study practitioners from both sites representing all clinical disciplines completed in-depth interviews. Table 2 identifies the characteristics of each population.
MI Champion Focus Group Themes
The champions were asked to discuss all aspects of the program, including their training as champions, role as trainers, attitudes about using MI during patient encounters, and participation in the training program. Themes from the MI champion focus groups were placed in the following categories based on the authors’ analytic approach: training MI champions, training study practitioners, and attitudes about MI.
Training MI champions. The champions identified role-play exercises and receiving feedback as strengths of the training program. The champions also expressed the desire for more hands-on practice, especially in small groups. They wanted additional training on teaching MI and facilitating the booster sessions. The champions wanted an expert to train them on how to give feedback and how to best coach practitioners in their use of MI. Champions expressed a desire to have follow-up training sessions with the standardized patient to help them hone their newly acquired coaching skills.
Training study practitioners. The champions’ key role was to train local practitioners and lead the booster sessions for the high-intensity MI training group. Champions felt ill-prepared to fully cover the training materials during the initial half-day workshop and 6 booster sessions. Champions identified difficulty coordinating schedules with the practitioners and lack of compensation for participation as significant barriers to implementing the booster sessions. Champions felt that using a standardized patient during the booster sessions was a strength of the program and that making the cases more realistic could have further enhanced the program.
Attitudes about MI. Champions from both sites perceived MI to have a positive impact on patient care. However, all champions noted there were challenges in using MI in practice. Champions felt MI takes time, energy, and practice to gain proficiency. The current primary care system is not set up to support the use of MI. The appointment time slots are fixed, and VHA goals and the spirit of MI are not always compatible. VHA performance measures encourage providers to achieve performance targets with each patient, often requiring use of directives for patients on what to do. In contrast, MI encourages the patient to take the lead on goal setting and prioritizing.
Study Practitioner Interview Themes
The practitioners were asked to discuss MI skills training, using MI skills with patients, integrating MI into daily practice, getting other PACT members involved, booster sessions, interactions with champions, and suggestions for improving the MI program. Themes from the study practitioner interviews were grouped into the following categories: MI skills training, using MI skills, integrating MI into practice, and suggestions for improving MI training (Table 3).
MI skills training. Overall, the MI high-intensity participants stated they learned useful skills. They reported asking more questions that are open-ended and were more aware of the patient’s perspective. Practitioners reported that booster sessions provided a way to reinforce, refine, and practice their MI skills. Practitioners reported that having the champion located in their own PACT was critical for connecting with their champion between sessions. Nurses and doctors reported that not having time to meet with champions was a barrier, while pharmacists reported more flexibility.
The moderate-intensity participants reported that the training had less impact. Half the respondents reported that they did not remember much of the MI training and either forgot or did not use the newly learned MI skills.
Using MI skills. Both high- and moderate-intensity participants reported using open-ended questions, reflections, affirmations, motivation scales, and active listening.
Practitioners reported that MI helped them focus on patient-centered care, since MI is collaborative. Even when a session was not successful in leading to behavior change, practitioners felt more satisfied with the quality of the interaction.
Integrating MI into practice. The high- and moderate-intensity practitioners had different perceptions of using MI in daily practice. High-intensity participants thought MI required an initial time investment, but that would be balanced by a decrease in the number of follow-up visits needed and/or delay the time between visits. The moderate-intensity participants were more likely to report struggling with the amount of time MI took.
Suggestions for improving MI training. Practitioners from both training groups offered suggestions for improving MI training. Supervisor buy-in was deemed critical to getting other PACT members involved. Practitioners suggested providing compensation or making training mandatory to help motivate others to participate in MI training. Also, practitioners were ready to expand the MI training beyond smoking cessation to incorporate other diseases and multiple comorbidities.
The moderate-intensity participants suggested more training, practice, follow-up, and feedback. These participants also suggested boosterlike sessions.
Discussion
Champions and study practitioners reported that learning MI skills was useful. The participants felt that MI was consistent with their personal philosophies regarding patient-centered care and that MI had a positive impact on patient care. Practitioners and MI champions offered several insights for improving the delivery of MI training. First, practitioners and champions highlighted how important practice and feedback were to learning MI. Booster sessions, standardized patients, and critical feedback enhanced learning.
Second, champions reported that they wanted more training in how to teach MI. Third, practitioners and champions repeatedly stated that finding the time needed to become proficient in MI was difficult and that using the MI approach with patients took additional time during clinical sessions. However, participants in the high-intensity group reported more satisfaction with the quality of their patient encounters and the freedom to follow up with patients less often.
There were aspects of the environment and MI training program that facilitated the MI learning process. The high-intensity group cited booster session feedback as being reinforcing; the moderate-intensity group expressed a desire to practice their newly acquired skill and felt feedback and coaching would have enhanced their learning. Practitioners and champions reported that using a standardized patient to enhance experiential learning activities was an asset. Standardized patients have been used successfully in other training programs.21
Implementing an MI training program posed a number of challenges. The biggest barrier was lack of time. PACT members found it difficult to attend a half-day MI workshop, practice MI skills, and incorporate MI routinely into daily practice. However, without the investment of time, even basic MI proficiency is unachievable.22
This study highlighted several ways to improve feedback and coaching. First, the authors would expand the MI champion curriculum to include training to provide effective feedback/coaching. Second, the authors would train the standardized patient on how to provide feedback to the MI learner. As implemented, the standardized patient evaluated the learner only on whether the patient felt “heard” by the learner.
Perhaps most critical to the success of an MI training program is institutional support. There needs to be adequate time and space for the training process as well as support for ongoing learning and feedback as MI skills are refined. Furthermore, sufficient time is needed during patients’ appointments to allow for MI-oriented conversations. Time is an important, valuable, and scarce resource that institutions control. Administrators should realize that the up-front investment is likely to provide a downstream return as providers become proficient in MI.
There is an urgent need to find ways to incorporate training into the daily practice of busy HCPs. Although this study was limited by its small sample, it demonstrated the feasibility of implementing an MI training program for practitioners working in a busy primary care environment. This study offers concrete suggestions for overcoming barriers and enhancing facilitators, which can guide much needed larger studies as they examine MI training effectiveness on patient and clinician outcomes.
Champions and practitioners reported that learning MI was important, but opportunities to practice and receive critical feedback are needed to achieve proficiency and improve confidence. Both champions and study practitioners thought practicing with a standardized patient would enrich their learning. However, dedicated time for learning and practicing MI skills is critical and hard to arrange.
Conclusion
Practitioners can use MI to activate health behavior change in their patients. Training PACT practitioners to use MI is feasible. The results of this evaluation can be used to inform the next iteration of an MI training program for HCPs by highlighting the facilitators of and barriers to training.
Because of the interest in activating patient-centered health behavior change, these findings are important. The educational and practice opportunities were well received. Training with standardized patients and incorporating MI champions into PACTs facilitated training. However, the lack of time was a major barrier to learning and practicing MI skills and will need to be addressed. If effectively implemented, training providers by using an evidence-based approach, such as MI, can promote long-term health.
Acknowledgments
This study was funded by VA Health Services Research & Development (HSR&D) Rapid Response Project 11-019. The Center for Chronic Disease Outcomes Research is supported by the VA, VHA, Office of Research and Development, and HSR&D. Dr. Widome was supported by a VA HSR&D Career Development Award.
1. Anderson G, Horvath J. The growing burden of chronic disease in America. Public Health Rep. 2004;119(3):263-270
2. Fiore MC, Jaen CR, Baker TB, et al. Treating Tobacco Use and Dependence: 2008 Update. Clinical Practice Guideline. Rockville, MD: U.S. Dept of Health and Human Services, Public Health Service; 2008.
3. Park E, Eaton CA, Goldstein MG, et al. The development of a decisional balance measure of physician smoking cessation interventions. Prev Med. 2001;33(4):261-267.
4. Ferketich AK, Khan Y, Wewers ME. Are physicians asking about tobacco use and assisting with cessation? Results from the 2001-2004 National Ambulatory Medical Care Survey (NAMCS). Prev Med. 2006;43(6):472-476.
5. Marcy TW, Skelly J, Shiffman RN, Flynn BS. Facilitating adherence to the tobacco use treatment guideline with computer-mediated decision support systems: physician and clinic office manager perspectives. Prev Med. 2005;41(2):479-487.
6. Cabana MD, Rand CS, Powe NR, et al. Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282(15):1458-1465.
7. Jaén CR, McIlvain H, Pol L, Phillips RL Jr, Flocke S, Crabtree BF. Tailoring tobacco counseling to the competing demands in the clinical encounter. J Fam Pract. 2001;50(10):859-863.
8. Malte CA, McFall M, Chow B, Beckham JC, Carmody TP, Saxon AJ. Survey of providers' attitudes toward integrating smoking cessation treatment into posttraumatic stress disorder care. Psychol Addict Behav. 2013;27(1):249-255.
9. Hettema J, Steele J, Miller WR. Motivational interviewing. Annu Rev Clin Psychol. 2005;1:91-111.
10. Rollnick S, Miller WR, Butler BC. Motivational Interviewing in Health Care: Helping Patients Change Behavior. New York, NY: Guilford Press; 2008.
11. Miller WR. Motivational interviewing with problem drinkers. Behav Psychother. 1983;11(2):147-172.
12. Brodie DA, Inoue A. Motivational interviewing to promote physical activity for people with chronic heart failure. J Adv Nurs. 2005;50(5):518-527.
13. Perry CK, Rosenfeld AG, Bennett JA, Potempa K. Heart-to-Heart: promoting walking in rural women through motivational interviewing and group support. J Cardiovascular Nurs. 2007;22(4):304-312.
14. West DS, DiLillo V, Bursac Z, Gore SA, Greene PG. Motivational interviewing improves weight loss in women with type 2 diabetes. Diabetes Care. 2007;30(5):1081-1087.
15. Fiore MC, Novotny TE, Pierce JP, et al. Trends in cigarette smoking in the United States. JAMA. 1989;261(1):49-55.
16. Lancaster T, Stead L. Physician advice for smoking cessation. Cochrane Database Syst Rev. 2004;18(4):CD000165.
17. Butler C, Rollnick S, Cohen D, Bachmann M, Russell I, Stott N. Motivational counseling versus brief advice for smokers in general practice: a randomized trial. Br J Gen Pract. 1999;49(445):611-616.
18. Rollnick S, Heather N, Bell A. Negotiating behaviour change in medical settings: the development of brief motivational interviewing. J Ment Health. 1992;1(1):25-37.
19. Madson MB, Loignon AC, Lane C. Training in motivational interviewing: a systematic review. J Subst Abuse Treat. 2009;36(1):101-109.
20. Miller WR, Yahne CE, Moyers TB, Martinez J, Pirritano M. A randomized trial of methods to help clinicians learn motivational interviewing. J Consult Clin Psychol. 2004;72(6):1050-1062.
21. Lundahl B, Burke BL. The effectiveness and applicability of motivational interviewing: a practice-friendly review of four meta-analyses. J Clin Pyschol. 2009;65(11):1232-1245.
22. Miller WR, Moyers TB. Eight stages in Learning motivational interviewing. J Teaching Addict. 2006;5(1):13-15.
23. Rosland AM, Nelson K, Sun H, et al. The patient-centered medical home in the Veterans Health Administration. Am J Manag Care. 2013;19(7):e263-e272.
24. Fu S, Roth C, Battaglia CT, et al. Training primary care clinicians in motivational interviewing: a comparison of two models. Patient Educ Couns. 2015;98(1):61-68.
25. School of Pharmacy & Medicine University of California, San Francisco. Rx for change website. http://rxforchange.ucsf.edu/. Accessed May 25, 2016.
1. Anderson G, Horvath J. The growing burden of chronic disease in America. Public Health Rep. 2004;119(3):263-270
2. Fiore MC, Jaen CR, Baker TB, et al. Treating Tobacco Use and Dependence: 2008 Update. Clinical Practice Guideline. Rockville, MD: U.S. Dept of Health and Human Services, Public Health Service; 2008.
3. Park E, Eaton CA, Goldstein MG, et al. The development of a decisional balance measure of physician smoking cessation interventions. Prev Med. 2001;33(4):261-267.
4. Ferketich AK, Khan Y, Wewers ME. Are physicians asking about tobacco use and assisting with cessation? Results from the 2001-2004 National Ambulatory Medical Care Survey (NAMCS). Prev Med. 2006;43(6):472-476.
5. Marcy TW, Skelly J, Shiffman RN, Flynn BS. Facilitating adherence to the tobacco use treatment guideline with computer-mediated decision support systems: physician and clinic office manager perspectives. Prev Med. 2005;41(2):479-487.
6. Cabana MD, Rand CS, Powe NR, et al. Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282(15):1458-1465.
7. Jaén CR, McIlvain H, Pol L, Phillips RL Jr, Flocke S, Crabtree BF. Tailoring tobacco counseling to the competing demands in the clinical encounter. J Fam Pract. 2001;50(10):859-863.
8. Malte CA, McFall M, Chow B, Beckham JC, Carmody TP, Saxon AJ. Survey of providers' attitudes toward integrating smoking cessation treatment into posttraumatic stress disorder care. Psychol Addict Behav. 2013;27(1):249-255.
9. Hettema J, Steele J, Miller WR. Motivational interviewing. Annu Rev Clin Psychol. 2005;1:91-111.
10. Rollnick S, Miller WR, Butler BC. Motivational Interviewing in Health Care: Helping Patients Change Behavior. New York, NY: Guilford Press; 2008.
11. Miller WR. Motivational interviewing with problem drinkers. Behav Psychother. 1983;11(2):147-172.
12. Brodie DA, Inoue A. Motivational interviewing to promote physical activity for people with chronic heart failure. J Adv Nurs. 2005;50(5):518-527.
13. Perry CK, Rosenfeld AG, Bennett JA, Potempa K. Heart-to-Heart: promoting walking in rural women through motivational interviewing and group support. J Cardiovascular Nurs. 2007;22(4):304-312.
14. West DS, DiLillo V, Bursac Z, Gore SA, Greene PG. Motivational interviewing improves weight loss in women with type 2 diabetes. Diabetes Care. 2007;30(5):1081-1087.
15. Fiore MC, Novotny TE, Pierce JP, et al. Trends in cigarette smoking in the United States. JAMA. 1989;261(1):49-55.
16. Lancaster T, Stead L. Physician advice for smoking cessation. Cochrane Database Syst Rev. 2004;18(4):CD000165.
17. Butler C, Rollnick S, Cohen D, Bachmann M, Russell I, Stott N. Motivational counseling versus brief advice for smokers in general practice: a randomized trial. Br J Gen Pract. 1999;49(445):611-616.
18. Rollnick S, Heather N, Bell A. Negotiating behaviour change in medical settings: the development of brief motivational interviewing. J Ment Health. 1992;1(1):25-37.
19. Madson MB, Loignon AC, Lane C. Training in motivational interviewing: a systematic review. J Subst Abuse Treat. 2009;36(1):101-109.
20. Miller WR, Yahne CE, Moyers TB, Martinez J, Pirritano M. A randomized trial of methods to help clinicians learn motivational interviewing. J Consult Clin Psychol. 2004;72(6):1050-1062.
21. Lundahl B, Burke BL. The effectiveness and applicability of motivational interviewing: a practice-friendly review of four meta-analyses. J Clin Pyschol. 2009;65(11):1232-1245.
22. Miller WR, Moyers TB. Eight stages in Learning motivational interviewing. J Teaching Addict. 2006;5(1):13-15.
23. Rosland AM, Nelson K, Sun H, et al. The patient-centered medical home in the Veterans Health Administration. Am J Manag Care. 2013;19(7):e263-e272.
24. Fu S, Roth C, Battaglia CT, et al. Training primary care clinicians in motivational interviewing: a comparison of two models. Patient Educ Couns. 2015;98(1):61-68.
25. School of Pharmacy & Medicine University of California, San Francisco. Rx for change website. http://rxforchange.ucsf.edu/. Accessed May 25, 2016.
Evaluation of E-Consults in the VHA: Provider Perspectives
Electronic consultations (e-consults), also called e-referrals, are an alternative method of obtaining general patient information through the electronic health record (EHR) shared by primary care providers (PCPs) and specialists in the VHA. In the e-consult system, test results, medication lists, and other pertinent data are available.1 Many PCPs are willing to use new technologies to maximize practice efficiency and patient convenience.2 In the VHA’s hub-and-spoke model of care, e-consults have the potential to make delivery of specialty care more efficient by prearranging or completing necessary diagnostic testing and redirecting inappropriate referrals to the correct specialists.1
Some early studies of e-consults report better communication, improved referral appropriateness, and greater access to specialty care as well as better continuity of care and information transfer between patients and PCPs.3-5 Researchers at the VA Boston Healthcare System in Massachusetts found that 61% of specialists surveyed agreed that e-consults improve quality of care and found the approach beneficial to help initiate diagnostic testing prior to a face-to-face visit.6 However, researchers at the Michael E. DeBakey VAMC in Houston, Texas, found no improvement in care coordination.7 To date, there have been no large-scale evaluations of e-consult programs or assessments of implementation of e-consult programs.
Related: HHS Grants Fund Health IT in Communities
In early 2011, the VHA Office of Specialty Care Services (OSCS), Office of Specialty Care Transformation launched a national e-consult pilot as part of a broader effort to improve the delivery of patient-centered specialty care. This initiative was based on core concepts advanced by the American College of Physicians, which highlighted the importance of specialty care within a patient- centered medical home and provided a framework for collaboration.8,9 The goals of the e-consult program were to improve access to specialty care for veterans and their PCPs, to enhance the collaborative relationship between PCPs and specialists, and to augment PCP education.
The OSCS created an Electronic Consultation Implementation Guide to help sites develop and implement each of their e-consult programs.10 The Implementation Guide established operating rules, strategies for engaging key stakeholders, and recommendations for provider education and training.
As with face-to-face referrals, e-consults are organized in a hub-and-spoke model, where community-based outpatient clinics (CBOCs) are linked to a central VAMC. An e-consult can be accessed by any CBOC, VAMC, medical center-based primary care clinic or specialist, and between medical centers that share the same EHR. There were 217,014 completed e-consults between May 2011 and December 2013 across VHA.11
Some programs created an e-consult template to aid in the transition to electronic referrals (Figure). Although not mandatory, the template helped organize needed information to expedite the e-consult.
The objective of this evaluation is to describe the implementation of e-consults from the perspectives of PCPs, specialists, and other key staff involved in the pilot. Key findings were related to: (1) how the e-consult pilot was implemented; (2) how implementation of the e-consult pilot affected providers; and (3) to what extent the e-consult pilot achieved programmatic objectives from the provider’s perspective.
Methods
The authors conducted a key informant analysis with 2 waves of interviews at 8 e-consult pilot sites across the U.S., selected for variation on early progress in implementation. The sites cannot be identified based on an agreement with the VA Office of Labor-Management Relations.
Setting
The e-consult pilot involved 15 VAMCs in 2 cohorts: alpha sites, which began using e-consults in May 2011, and beta sites, which began using e-consults in July 2011. The alpha sites included 10 VAMCs in 12 medical specialties, with a total of 21 facility-specialty combinations. For the evaluation, sites were defined based on specialty, regardless of location within the same medical center (eg, cardiology and diabetes at the same VAMC would be 2 sites). Beta sites included 5 VAMCs with 6 medical specialties for a total of 6 sites. For 1 year, alpha sites received $175,000 and beta sites received $150,000 to support start-up activities.
Initial specialties included diabetes, hepatitis C, geriatrics, cardiology, liver transplant, dementia, gastrointestinal disease, pulmonary medicine, rheumatology, pain management, neurosurgery, infectious diseases, hematology/oncology, and vascular surgery. Facilities could add additional e-consult specialties but did not receive further funding.
Sample
Study participants were selected from 8 of the 15 pilot sites (geographic site/specialty combinations). Site selection was based on 2 measures of baseline e-consult implementation: (1) overall e-consult implementation rates, measured as the ratio of e-consults to all consults for the specialties of interest; and (2) CBOC participation, measured as the ratio of e-consults for patients from CBOCs vs e-consults for patients from primary care clinics located within the 152 VAMCs. Participation with CBOCs was important for ensuring that implementation factors that influenced uptake of e-consults within tertiary medical centers and between VAMCs and CBOCs could be identified. Two e-consult sites were randomly selected from each of the 4 resulting categories (VAMC high volume, VAMC low volume, CBOC high volume, and CBOC low volume). Volume data of e-consults were obtained from the VA Corporate Data Warehouse and assessed from the beginning of the pilot period to initial site selection, May 2011 to February 2012.
Respondents were identified using a modified snowball sampling process. Snowball sampling is a qualitative sampling technique that identifies study participants, who then identify other potential participants to participate in the study. The researchers started with the local e-consult initiative lead and then contacted the directors of primary care and specialty care services for help identifying PCPs, specialists, and support staff (nurse practitioners, pharmacists, program managers, informatics staff, and medical support personnel) engaged in the initiative. The goal for follow-up interviews was to interview at least 2 of the following respondents at each site: e-consult project manager, PCP, and/or specialist. Due to turnover and changes in clinic roles, some follow-up interviews were conducted with different individuals from the baseline interviews.
Data Collection
Interviews followed semistructured interview guidelines and included open-ended questions designed to elicit rich responses to a variety of aspects related to e-consult implementation, including patient needs, communication, leadership, resources, priorities, knowledge about the program, and unintended consequences. Follow-up interviews addressed how e-consults impacted the quality of specialty care; the impact of e-consults on Patient Aligned Care Teams (PACTs), the VHA patient-centered medical home initiative for primary care; and how e-consults have been used, eg, whether patients were involved in the decision to seek an e-consult.
Two interviewers who had participated in a 1-day, in-person training covering both data collection and analyzing key informant data conducted the 40 to 60 minute telephone interviews. One team member conducted the interview while the other took field notes. Interviews were also recorded. Follow-up probes were used to elicit specific examples and ensure sufficiently rich data. Following each interview, the notetaker reviewed the audio recording and filled in details in the field notes. The interview team debriefed and reviewed the augmented field notes and audio recordings, which became the primary data sources for the study.
Analysis
This was a qualitative descriptive analysis.12 Interview data were analyzed using an iterative, inductive content analysis method using an open coding approach (ie, a priori codes were not defined for this portion of the analysis).13 Two members of the research team used audio recordings and summary transcripts simultaneously to code data. Summary transcripts were compared with the recorded interviews to assure fidelity.
The researchers used Atlas.ti (Berlin, Germany) qualitative data analysis software to organize the coding process. Emergent codes were iteratively added throughout the analysis to reflect quotations that did not adequately fit previously developed codes. Codes were combined weekly to biweekly. After the combinations were completed, the analytics team met to review meanings of codes to ensure consistency of coding and interpretations.
To create categories, broad themes were identified from interview responses and grouped under high- order headings that described distinct aspects of participant experience. The analysis was intentionally kept close to the original data to reflect and describe the participant’s experience as accurately as possible. In support of analytical rigor, members of the multidisciplinary research team, composed of clinicians, implementation scientists, and mixed methodologists, reviewed findings to assess their thoroughness, comprehensiveness, and representativeness across roles and participating sites.14
Results
The e-consult evaluation period was from November 1, 2011, to July 31, 2013. Key conclusions were drawn from both alpha and beta sites (Table). Baseline interviews were conducted with 37 participants at 8 sites from April 10, 2012, to August 6, 2012. Follow-up interviews were conducted with 21 of the 37 participants at the 8 sites. Follow-up interviews with either a PCP or specialist could not be scheduled at 1 site. Follow-up interviews were conducted from April 16, 2013, to June 18, 2013. Open coding continued until saturation (the point at which subsequent data failed to produce new findings).15 This occurred after analysis of 22 baseline interviews (12 PCPs, 6 specialists, 1 pharmacist, and 4 other staff members) and 17 follow-up interviews (10 PCPs, 4 specialists, 1 pharmacist, and 2 other staff members).
Implementation
The e-consults provided a programmatic structure to the more informal practice of obtaining diagnostic or therapeutic advice from a specialist. Several of the specialists interviewed described having previously used existing informal consult processes that were “like e-consult.” These specialists reported that their practice patterns did not change significantly since implementing e-consults, because they have been “using the Computerized Patient Record System (CPRS) in an e-consult way for many years.” In these cases, the primary change resulting from the initiative was that national VHA workload policy was revised so that e-consults were assigned a CPT (Current Procedural Terminology) code and specialists began receiving workload credit for completing e-consults.
At sites where an informal e-consult practice was already in place, the initiative was consistently described as flexible. Many specialists reported that this degree of flexibility allowed them to make a relatively easy transition to e-consults by adopting new mechanisms to support existing processes. The e-consult initiative also allowed specialists to formally document this work and to increase the efficiency of specialty care.
Specialists drove the implementation process across sites. The e-consults were envisioned as a collaborative process; however, during initial interviews, few specialists mentioned PCPs when describing the development and implementation of the e-consult program. Primary care providers also reported having little awareness of or input into how the initiative was implemented, although this had little consequence on the use of e-consults.
In a rare case, a PCP reported that poorly designed, lengthy e-consult templates were a major barrier to using e-consults for specific specialties. The PCP said, “E-consults have created an elaborate but extraordinarily cumbersome tool that is difficult for PCPs to actually accomplish, because you have a consult menu that requires a lot of data to be entered—a lot of history from the chart, a lot of exam findings, a lot of previous cognitive testing scores; neurologic findings—lab and imaging tests.”
Still, many other PCPs described receiving detailed information and guidance from e-consults. “E-consults help me to be more accurate. Many providers don’t have a comfort with pain management. To get guidance and education and to really hold our hand, this is how to do this…this has been a big change. If they give you a great response, then [for] the next patient [with that condition], you go back to that note and then follow what was said there,” said one PCP.
In follow-up interviews, providers and other key staff stated there were more data available on the patient as a result of the e-consult and, consequently, even when specialists determined that a patient needed an in-person visit, the data obtained in the e-consult improved the quality of the in-person consultation.
Enhanced Communication and Collaboration
Neither the PCPs nor the specialists were aware of the collaborative intent of the initiative. They focused, instead, on other key aims, such as increasing accessibility and minimizing unnecessary patient travel. Most participants were generally positive about e-consults during baseline interviews, and this perception increased over time.
Both the PCPs and the specialists reported improved communication following the launch of e-consults. In follow-up interviews, some PCPs reported that before e-consults, they had trouble getting timely responses from specialists unless they knew them personally. “You had to know the person in the old days,” one respondent said. “After e-consults, responses improved…e-consult is available to have the resources to tap that knowledge base, and the team is answering the question. I think it opens up access and information and knowledge to everybody.”
Many PCPs spoke positively about this new communication tool as an opportunity to learn from specialists and said they valued the input they received. They felt the increased interaction between the 2 groups positively benefited patient care. One example cited that collaborative communication improved care coordination for veterans: “We are able to step in with e-consults to coordinate services, and this has been huge in improving care.”
Furthermore, follow-up interviews found that all participating PCPs and specialists were communicating more frequently and effectively. “Services that have embraced e-consult give a lot of great information flowing back; it’s closer to a real-time conversation,” said one respondent.
Related: Home-Based Video Telehealth for Veterans With Dementia
In baseline interviews, some specialists described how e-consults went against their belief that patient care is synonymous with face-to-face medical treatment and voiced dissatisfaction with e-consults as “sitting in front of a computer” rather than “seeing patients.” Others were concerned that medical center administration would not recognize the time it takes to conduct an e-consult and therefore not add necessary specialists staff. “E-consults take work and time, just like seeing a patient. I worry that won’t be seen,” one specialist said.
In order to successfully implement the e-consult initiative, providers and staff needed to incorporate new processes into their daily workflow.
Most sites did not develop a mechanism in which specialists received feedback regarding the outcome of their consultations. This lack of response created anxiety for some specialists in the absence of the face-to-face encounter, leaving some wondering whether they or the PCP had missed anything. According to one specialist, “That’s always in the back of your head: ‘Have I [the specialist] missed something?’”
In follow-up interviews, none of these concerns were raised. Primary care providers tended to speak of the care provided by specialists through e-consults in very positive terms, except in those instances where PCPs felt the e-consult template was difficult to use and required too much time to complete. “I was worried in the beginning about patients thinking less of me, but we ask for help all the time. We’re asking for help and not inconveniencing the patient; they seem to like it very much,” one PCP said.
The e-consults also complement PACTs. Initially, a few participants described soliciting patient input regarding the choice to have an e-consult or a face-to-face visit. During follow-up interviews, participants highlighted how well e-consults fit in to the PACT philosophy. One participant said, “The PACT team seeks to improve quality of care. E-consult fits very well with this, because answers to questions can come quickly, and the veteran may not need to come back to the clinic to be seen, even though things are still getting accomplished. E-consult works very well. E-consults were credited with improving access to specialty care as a tool for PACT.”
Achieving Program Objectives
Based on interviews, support for the e-consult program has increased over time as providers have gained experience with the program and have seen its benefits. Respondents at all sites consistently supported the concept of e-consults and expressed their belief in the importance and value of e-consults in improving patient-c entered care, primarily by reducing the need for patients to travel to see specialists, reducing the time to obtain feedback from specialists, and maintaining the provision of high quality care.
“Last year we only had 2 clinics categorized as e-consults. As of now we have 14 e-consults available for our providers. I think the numbers are growing. They are realizing the value of e-consults as far as the provider’s needs being met,” said one respondent.
The e-consults were credited with improving access to specialty care for veterans. Several participants stated that e-consults improved access to specialty care services and decreased travel for veterans. “It’s another way of getting care to the patient when the patient needs it without having to wait,” said one respondent.
Many PCPs described how difficult it was for patients to get to specialty appointments—particularly for their elderly, disabled, and rural patients—before the implementation of e-consults. “I like the fact that patients who live very far don’t have to come back. A lot of our patients are older…diabetic, see me Monday and back on Thursday. Now, they are able to stay home and follow the recommendations I write,” said one PCP.
Most providers were of the opinion that patients liked the program. “I think e-consults are helping patients...It’s been very successful regarding decreasing travel…Quicker response time for specialty care,” said a PCP. Several providers also stated in follow-up interviews that there was a greater degree of patient participation in the e-consult process and that “patients are definitely informed.”
Discussion
Most PCPs reported that the e-consults were an effective means of consultation and contained the information they needed to provide high-quality coordinated care. Most also found e-consult templates easy to complete. A majority of PCPs felt sufficient control over the choice of whether to use e-consults or an in-person visit, and a minority of patients were involved in the decision to receive an e-consult. Although the OSCS outlined guiding principles and operational rules in the Implementation Guide to help sites implement the e-consult program, its contribution was limited. Few examples were found that engaged PCPs in development of the e-consult program locally; involving patients in the decision to obtain a specialty consult electronically or in person; and PCPs feeding back results to specialists.
Implementing e-consults posed a number of challenges, including lack of resources to respond to referral requests, lack of referral policies and standardized procedures, and confusion related to roles and responsibilities. This is consistent with findings from another VHA research project of e-consults in 2 VHA health systems that was conducted prior to this national level e-consult pilot.7
Related: Using Facilitative Coaching to Support Patient Aligned Care Teams
Communication by OSCS of key aspects of the e-consult initiative will be critical as more sites implement e-consults. Since initiation of this pilot, workload specifications and credit have changed from 1 code to 3 codes, to more accurately reflect the amount of time a specialist consultant spends reviewing the EHR and responding to the consult. Without seeing the patient directly, specialists are more reliant on the PCP to describe the problem and provide adequate information in the e-consult request in order to provide recommendations back to the PCP.
Primary care physicians need to know that e-consults are available and determine when they are appropriate. A template or other guidance may be helpful to ensure adequate information is provided in the e-consult request; and the information provided by the specialist in response to the e-consult has to be sufficient for the PCP to provide care. VHA continues to expand the use of e-consults throughout the system, as this pilot found that the electronic option was often more timely than were face-to-face consultations. The result of this evaluation has informed national implementation of this effort.
Limitations
There are 3 main limitations to this study. First, because there was no practical way to preidentify participants who participated in implementing e-consults, a modified snowball sampling was used. However, this limited the degree to which the group was representative of the pilot participants. Second, the authors reported findings from a real-world initiative, not an experimental study. As such, not all participants in the first wave of key informant interviews were available for follow-up interview, which may have introduced bias. Third, the VHA is unlike most of the rest of the U.S. health care system in that it is a fully integrated system with salaried PCPs and specialists and an EHR.
Generalizability of the study may be limited, as a modified snowball sampling approach is not entirely random and has potential for community bias, because initial participants influence subsequent sampling. Additionally, though the sample size (n = 37) was sufficient for qualitative, in-depth analysis, it may be too small for confident generalization of findings. However, as health care moves toward an accountable care organization system, the authors’ analysis may provide insights.
Issues include revision of reimbursement policy for e-consults and developing or coordinating informational technology infrastructures to permit e-consults. It is also important to note that this evaluation reports solely on the extent of implementation of e-consults and the effects of e-consult implementation from the perspectives of staff, including specialists and PCPs.
Evaluating the effectiveness of the program in improving access, care coordination, and patient satisfaction was beyond the scope of the study. Further research is needed, because findings on those outcomes are critical for drawing inferences about this study’s implementation results.
Conclusion
The assessment of the e-consult system by providers and staff was based on a perception that e-consults are a valuable tool in providing greater access to quality care. Currently, e-consults have been expanded across VHA in medical and surgical specialties. VHA policymakers have drafted field guidance and a communication plan to support these efforts.
Acknowledgement
This material is based on work supported by the VA Office of Specialty Care Transformation, the office overseeing the e-consult initiative, and the Office of Research and Development Quality Enhancement Research Initiative.
Author disclosures
The authors report no actual or potential conflicts of interest with regard to this article.
Disclaimer
The opinions expressed herein are those of the authors and do not necessarily reflect those of Federal Practitioner, Frontline Medical Communications Inc., the U.S. Government, or any of its agencies. This article may discuss unlabeled or investigational use of certain drugs. Please review the complete prescribing information for specific drugs or drug combinations—including indications, contraindications, warnings, and adverse effects—before administering pharmacologic therapy to patients.
1. Chen AH, Murphy EJ, Yee HF Jr. eReferral—a new model for integrated care. N Engl J Med. 2013;368(26):2450-2453.
2. Hanna L, May C, Fairhurst K. The place of information and communication technology-mediated consultations in primary care: GPs’ perspectives. Fam Pract. 2012;29(3):361-366.
3. Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF Jr, Kushel MB. Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med. 2010;25(10):1123-1128.
4. Straus SG, Chen AH, Yee HF Jr, Kushel MB, Bell DS. Implementation of an electronic referral system for outpatient specialty care. AMIA Annu Symp Proc. 2011;2011:1337-1346.
5. Horner K, Wagner E, Tufano J. Electronic consultations between primary and specialty care clinicians: early insights. Issue Brief (Commonw Fund). 2011;23:1-14.
6. McAdams M, Cannavo L, Orlander JD. A medical specialty e-consult program in a VA health care system. Fed Pract. 2014;31(5):26-31.
7. Hysong SJ, Esquivel A, Sittig DF, et al. Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci. 2011;6:84.
8. American College of Physicians. The Patient- Centered Medical Home Neighbor: The Interface of the Patient-Centered Medical Home with Specialty/Subspecialty Practices. Philadelphia, PA: American College of Physicians; 2010. Policy paper.
9. Fisher ES. Building a medical neighborhood for the medical home. N Engl J Med. 2008;359(12): 1202-1205.
10. Department of Veterans Affairs. Electronic Consultation (E-Consult) Implementation Guide, Version 1.2. Washington, DC: Department of Veterans Affairs, Office of Specialty Care Services, Specialty Care Transformation. 2013.
11. Kirsh S, Cary E, Aron DC et al. Results of a national pilot project for specialty care e-consultation in primary care medical homes: the impact of specialty e-consultation on access. Am J Manag Care. In press.
12. Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334-340.
13. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115.
14. Giacomini MK, Cook DJ. Users’ guides to the medical literature: XXIII. Qualitative research in health care A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 2000;284(3):357-362.
15. Sandelowski M. The problem of rigor in qualitative research. ANS Adv Nurs Sci. 1986;8(3):27-37.
Electronic consultations (e-consults), also called e-referrals, are an alternative method of obtaining general patient information through the electronic health record (EHR) shared by primary care providers (PCPs) and specialists in the VHA. In the e-consult system, test results, medication lists, and other pertinent data are available.1 Many PCPs are willing to use new technologies to maximize practice efficiency and patient convenience.2 In the VHA’s hub-and-spoke model of care, e-consults have the potential to make delivery of specialty care more efficient by prearranging or completing necessary diagnostic testing and redirecting inappropriate referrals to the correct specialists.1
Some early studies of e-consults report better communication, improved referral appropriateness, and greater access to specialty care as well as better continuity of care and information transfer between patients and PCPs.3-5 Researchers at the VA Boston Healthcare System in Massachusetts found that 61% of specialists surveyed agreed that e-consults improve quality of care and found the approach beneficial to help initiate diagnostic testing prior to a face-to-face visit.6 However, researchers at the Michael E. DeBakey VAMC in Houston, Texas, found no improvement in care coordination.7 To date, there have been no large-scale evaluations of e-consult programs or assessments of implementation of e-consult programs.
Related: HHS Grants Fund Health IT in Communities
In early 2011, the VHA Office of Specialty Care Services (OSCS), Office of Specialty Care Transformation launched a national e-consult pilot as part of a broader effort to improve the delivery of patient-centered specialty care. This initiative was based on core concepts advanced by the American College of Physicians, which highlighted the importance of specialty care within a patient- centered medical home and provided a framework for collaboration.8,9 The goals of the e-consult program were to improve access to specialty care for veterans and their PCPs, to enhance the collaborative relationship between PCPs and specialists, and to augment PCP education.
The OSCS created an Electronic Consultation Implementation Guide to help sites develop and implement each of their e-consult programs.10 The Implementation Guide established operating rules, strategies for engaging key stakeholders, and recommendations for provider education and training.
As with face-to-face referrals, e-consults are organized in a hub-and-spoke model, where community-based outpatient clinics (CBOCs) are linked to a central VAMC. An e-consult can be accessed by any CBOC, VAMC, medical center-based primary care clinic or specialist, and between medical centers that share the same EHR. There were 217,014 completed e-consults between May 2011 and December 2013 across VHA.11
Some programs created an e-consult template to aid in the transition to electronic referrals (Figure). Although not mandatory, the template helped organize needed information to expedite the e-consult.
The objective of this evaluation is to describe the implementation of e-consults from the perspectives of PCPs, specialists, and other key staff involved in the pilot. Key findings were related to: (1) how the e-consult pilot was implemented; (2) how implementation of the e-consult pilot affected providers; and (3) to what extent the e-consult pilot achieved programmatic objectives from the provider’s perspective.
Methods
The authors conducted a key informant analysis with 2 waves of interviews at 8 e-consult pilot sites across the U.S., selected for variation on early progress in implementation. The sites cannot be identified based on an agreement with the VA Office of Labor-Management Relations.
Setting
The e-consult pilot involved 15 VAMCs in 2 cohorts: alpha sites, which began using e-consults in May 2011, and beta sites, which began using e-consults in July 2011. The alpha sites included 10 VAMCs in 12 medical specialties, with a total of 21 facility-specialty combinations. For the evaluation, sites were defined based on specialty, regardless of location within the same medical center (eg, cardiology and diabetes at the same VAMC would be 2 sites). Beta sites included 5 VAMCs with 6 medical specialties for a total of 6 sites. For 1 year, alpha sites received $175,000 and beta sites received $150,000 to support start-up activities.
Initial specialties included diabetes, hepatitis C, geriatrics, cardiology, liver transplant, dementia, gastrointestinal disease, pulmonary medicine, rheumatology, pain management, neurosurgery, infectious diseases, hematology/oncology, and vascular surgery. Facilities could add additional e-consult specialties but did not receive further funding.
Sample
Study participants were selected from 8 of the 15 pilot sites (geographic site/specialty combinations). Site selection was based on 2 measures of baseline e-consult implementation: (1) overall e-consult implementation rates, measured as the ratio of e-consults to all consults for the specialties of interest; and (2) CBOC participation, measured as the ratio of e-consults for patients from CBOCs vs e-consults for patients from primary care clinics located within the 152 VAMCs. Participation with CBOCs was important for ensuring that implementation factors that influenced uptake of e-consults within tertiary medical centers and between VAMCs and CBOCs could be identified. Two e-consult sites were randomly selected from each of the 4 resulting categories (VAMC high volume, VAMC low volume, CBOC high volume, and CBOC low volume). Volume data of e-consults were obtained from the VA Corporate Data Warehouse and assessed from the beginning of the pilot period to initial site selection, May 2011 to February 2012.
Respondents were identified using a modified snowball sampling process. Snowball sampling is a qualitative sampling technique that identifies study participants, who then identify other potential participants to participate in the study. The researchers started with the local e-consult initiative lead and then contacted the directors of primary care and specialty care services for help identifying PCPs, specialists, and support staff (nurse practitioners, pharmacists, program managers, informatics staff, and medical support personnel) engaged in the initiative. The goal for follow-up interviews was to interview at least 2 of the following respondents at each site: e-consult project manager, PCP, and/or specialist. Due to turnover and changes in clinic roles, some follow-up interviews were conducted with different individuals from the baseline interviews.
Data Collection
Interviews followed semistructured interview guidelines and included open-ended questions designed to elicit rich responses to a variety of aspects related to e-consult implementation, including patient needs, communication, leadership, resources, priorities, knowledge about the program, and unintended consequences. Follow-up interviews addressed how e-consults impacted the quality of specialty care; the impact of e-consults on Patient Aligned Care Teams (PACTs), the VHA patient-centered medical home initiative for primary care; and how e-consults have been used, eg, whether patients were involved in the decision to seek an e-consult.
Two interviewers who had participated in a 1-day, in-person training covering both data collection and analyzing key informant data conducted the 40 to 60 minute telephone interviews. One team member conducted the interview while the other took field notes. Interviews were also recorded. Follow-up probes were used to elicit specific examples and ensure sufficiently rich data. Following each interview, the notetaker reviewed the audio recording and filled in details in the field notes. The interview team debriefed and reviewed the augmented field notes and audio recordings, which became the primary data sources for the study.
Analysis
This was a qualitative descriptive analysis.12 Interview data were analyzed using an iterative, inductive content analysis method using an open coding approach (ie, a priori codes were not defined for this portion of the analysis).13 Two members of the research team used audio recordings and summary transcripts simultaneously to code data. Summary transcripts were compared with the recorded interviews to assure fidelity.
The researchers used Atlas.ti (Berlin, Germany) qualitative data analysis software to organize the coding process. Emergent codes were iteratively added throughout the analysis to reflect quotations that did not adequately fit previously developed codes. Codes were combined weekly to biweekly. After the combinations were completed, the analytics team met to review meanings of codes to ensure consistency of coding and interpretations.
To create categories, broad themes were identified from interview responses and grouped under high- order headings that described distinct aspects of participant experience. The analysis was intentionally kept close to the original data to reflect and describe the participant’s experience as accurately as possible. In support of analytical rigor, members of the multidisciplinary research team, composed of clinicians, implementation scientists, and mixed methodologists, reviewed findings to assess their thoroughness, comprehensiveness, and representativeness across roles and participating sites.14
Results
The e-consult evaluation period was from November 1, 2011, to July 31, 2013. Key conclusions were drawn from both alpha and beta sites (Table). Baseline interviews were conducted with 37 participants at 8 sites from April 10, 2012, to August 6, 2012. Follow-up interviews were conducted with 21 of the 37 participants at the 8 sites. Follow-up interviews with either a PCP or specialist could not be scheduled at 1 site. Follow-up interviews were conducted from April 16, 2013, to June 18, 2013. Open coding continued until saturation (the point at which subsequent data failed to produce new findings).15 This occurred after analysis of 22 baseline interviews (12 PCPs, 6 specialists, 1 pharmacist, and 4 other staff members) and 17 follow-up interviews (10 PCPs, 4 specialists, 1 pharmacist, and 2 other staff members).
Implementation
The e-consults provided a programmatic structure to the more informal practice of obtaining diagnostic or therapeutic advice from a specialist. Several of the specialists interviewed described having previously used existing informal consult processes that were “like e-consult.” These specialists reported that their practice patterns did not change significantly since implementing e-consults, because they have been “using the Computerized Patient Record System (CPRS) in an e-consult way for many years.” In these cases, the primary change resulting from the initiative was that national VHA workload policy was revised so that e-consults were assigned a CPT (Current Procedural Terminology) code and specialists began receiving workload credit for completing e-consults.
At sites where an informal e-consult practice was already in place, the initiative was consistently described as flexible. Many specialists reported that this degree of flexibility allowed them to make a relatively easy transition to e-consults by adopting new mechanisms to support existing processes. The e-consult initiative also allowed specialists to formally document this work and to increase the efficiency of specialty care.
Specialists drove the implementation process across sites. The e-consults were envisioned as a collaborative process; however, during initial interviews, few specialists mentioned PCPs when describing the development and implementation of the e-consult program. Primary care providers also reported having little awareness of or input into how the initiative was implemented, although this had little consequence on the use of e-consults.
In a rare case, a PCP reported that poorly designed, lengthy e-consult templates were a major barrier to using e-consults for specific specialties. The PCP said, “E-consults have created an elaborate but extraordinarily cumbersome tool that is difficult for PCPs to actually accomplish, because you have a consult menu that requires a lot of data to be entered—a lot of history from the chart, a lot of exam findings, a lot of previous cognitive testing scores; neurologic findings—lab and imaging tests.”
Still, many other PCPs described receiving detailed information and guidance from e-consults. “E-consults help me to be more accurate. Many providers don’t have a comfort with pain management. To get guidance and education and to really hold our hand, this is how to do this…this has been a big change. If they give you a great response, then [for] the next patient [with that condition], you go back to that note and then follow what was said there,” said one PCP.
In follow-up interviews, providers and other key staff stated there were more data available on the patient as a result of the e-consult and, consequently, even when specialists determined that a patient needed an in-person visit, the data obtained in the e-consult improved the quality of the in-person consultation.
Enhanced Communication and Collaboration
Neither the PCPs nor the specialists were aware of the collaborative intent of the initiative. They focused, instead, on other key aims, such as increasing accessibility and minimizing unnecessary patient travel. Most participants were generally positive about e-consults during baseline interviews, and this perception increased over time.
Both the PCPs and the specialists reported improved communication following the launch of e-consults. In follow-up interviews, some PCPs reported that before e-consults, they had trouble getting timely responses from specialists unless they knew them personally. “You had to know the person in the old days,” one respondent said. “After e-consults, responses improved…e-consult is available to have the resources to tap that knowledge base, and the team is answering the question. I think it opens up access and information and knowledge to everybody.”
Many PCPs spoke positively about this new communication tool as an opportunity to learn from specialists and said they valued the input they received. They felt the increased interaction between the 2 groups positively benefited patient care. One example cited that collaborative communication improved care coordination for veterans: “We are able to step in with e-consults to coordinate services, and this has been huge in improving care.”
Furthermore, follow-up interviews found that all participating PCPs and specialists were communicating more frequently and effectively. “Services that have embraced e-consult give a lot of great information flowing back; it’s closer to a real-time conversation,” said one respondent.
Related: Home-Based Video Telehealth for Veterans With Dementia
In baseline interviews, some specialists described how e-consults went against their belief that patient care is synonymous with face-to-face medical treatment and voiced dissatisfaction with e-consults as “sitting in front of a computer” rather than “seeing patients.” Others were concerned that medical center administration would not recognize the time it takes to conduct an e-consult and therefore not add necessary specialists staff. “E-consults take work and time, just like seeing a patient. I worry that won’t be seen,” one specialist said.
In order to successfully implement the e-consult initiative, providers and staff needed to incorporate new processes into their daily workflow.
Most sites did not develop a mechanism in which specialists received feedback regarding the outcome of their consultations. This lack of response created anxiety for some specialists in the absence of the face-to-face encounter, leaving some wondering whether they or the PCP had missed anything. According to one specialist, “That’s always in the back of your head: ‘Have I [the specialist] missed something?’”
In follow-up interviews, none of these concerns were raised. Primary care providers tended to speak of the care provided by specialists through e-consults in very positive terms, except in those instances where PCPs felt the e-consult template was difficult to use and required too much time to complete. “I was worried in the beginning about patients thinking less of me, but we ask for help all the time. We’re asking for help and not inconveniencing the patient; they seem to like it very much,” one PCP said.
The e-consults also complement PACTs. Initially, a few participants described soliciting patient input regarding the choice to have an e-consult or a face-to-face visit. During follow-up interviews, participants highlighted how well e-consults fit in to the PACT philosophy. One participant said, “The PACT team seeks to improve quality of care. E-consult fits very well with this, because answers to questions can come quickly, and the veteran may not need to come back to the clinic to be seen, even though things are still getting accomplished. E-consult works very well. E-consults were credited with improving access to specialty care as a tool for PACT.”
Achieving Program Objectives
Based on interviews, support for the e-consult program has increased over time as providers have gained experience with the program and have seen its benefits. Respondents at all sites consistently supported the concept of e-consults and expressed their belief in the importance and value of e-consults in improving patient-c entered care, primarily by reducing the need for patients to travel to see specialists, reducing the time to obtain feedback from specialists, and maintaining the provision of high quality care.
“Last year we only had 2 clinics categorized as e-consults. As of now we have 14 e-consults available for our providers. I think the numbers are growing. They are realizing the value of e-consults as far as the provider’s needs being met,” said one respondent.
The e-consults were credited with improving access to specialty care for veterans. Several participants stated that e-consults improved access to specialty care services and decreased travel for veterans. “It’s another way of getting care to the patient when the patient needs it without having to wait,” said one respondent.
Many PCPs described how difficult it was for patients to get to specialty appointments—particularly for their elderly, disabled, and rural patients—before the implementation of e-consults. “I like the fact that patients who live very far don’t have to come back. A lot of our patients are older…diabetic, see me Monday and back on Thursday. Now, they are able to stay home and follow the recommendations I write,” said one PCP.
Most providers were of the opinion that patients liked the program. “I think e-consults are helping patients...It’s been very successful regarding decreasing travel…Quicker response time for specialty care,” said a PCP. Several providers also stated in follow-up interviews that there was a greater degree of patient participation in the e-consult process and that “patients are definitely informed.”
Discussion
Most PCPs reported that the e-consults were an effective means of consultation and contained the information they needed to provide high-quality coordinated care. Most also found e-consult templates easy to complete. A majority of PCPs felt sufficient control over the choice of whether to use e-consults or an in-person visit, and a minority of patients were involved in the decision to receive an e-consult. Although the OSCS outlined guiding principles and operational rules in the Implementation Guide to help sites implement the e-consult program, its contribution was limited. Few examples were found that engaged PCPs in development of the e-consult program locally; involving patients in the decision to obtain a specialty consult electronically or in person; and PCPs feeding back results to specialists.
Implementing e-consults posed a number of challenges, including lack of resources to respond to referral requests, lack of referral policies and standardized procedures, and confusion related to roles and responsibilities. This is consistent with findings from another VHA research project of e-consults in 2 VHA health systems that was conducted prior to this national level e-consult pilot.7
Related: Using Facilitative Coaching to Support Patient Aligned Care Teams
Communication by OSCS of key aspects of the e-consult initiative will be critical as more sites implement e-consults. Since initiation of this pilot, workload specifications and credit have changed from 1 code to 3 codes, to more accurately reflect the amount of time a specialist consultant spends reviewing the EHR and responding to the consult. Without seeing the patient directly, specialists are more reliant on the PCP to describe the problem and provide adequate information in the e-consult request in order to provide recommendations back to the PCP.
Primary care physicians need to know that e-consults are available and determine when they are appropriate. A template or other guidance may be helpful to ensure adequate information is provided in the e-consult request; and the information provided by the specialist in response to the e-consult has to be sufficient for the PCP to provide care. VHA continues to expand the use of e-consults throughout the system, as this pilot found that the electronic option was often more timely than were face-to-face consultations. The result of this evaluation has informed national implementation of this effort.
Limitations
There are 3 main limitations to this study. First, because there was no practical way to preidentify participants who participated in implementing e-consults, a modified snowball sampling was used. However, this limited the degree to which the group was representative of the pilot participants. Second, the authors reported findings from a real-world initiative, not an experimental study. As such, not all participants in the first wave of key informant interviews were available for follow-up interview, which may have introduced bias. Third, the VHA is unlike most of the rest of the U.S. health care system in that it is a fully integrated system with salaried PCPs and specialists and an EHR.
Generalizability of the study may be limited, as a modified snowball sampling approach is not entirely random and has potential for community bias, because initial participants influence subsequent sampling. Additionally, though the sample size (n = 37) was sufficient for qualitative, in-depth analysis, it may be too small for confident generalization of findings. However, as health care moves toward an accountable care organization system, the authors’ analysis may provide insights.
Issues include revision of reimbursement policy for e-consults and developing or coordinating informational technology infrastructures to permit e-consults. It is also important to note that this evaluation reports solely on the extent of implementation of e-consults and the effects of e-consult implementation from the perspectives of staff, including specialists and PCPs.
Evaluating the effectiveness of the program in improving access, care coordination, and patient satisfaction was beyond the scope of the study. Further research is needed, because findings on those outcomes are critical for drawing inferences about this study’s implementation results.
Conclusion
The assessment of the e-consult system by providers and staff was based on a perception that e-consults are a valuable tool in providing greater access to quality care. Currently, e-consults have been expanded across VHA in medical and surgical specialties. VHA policymakers have drafted field guidance and a communication plan to support these efforts.
Acknowledgement
This material is based on work supported by the VA Office of Specialty Care Transformation, the office overseeing the e-consult initiative, and the Office of Research and Development Quality Enhancement Research Initiative.
Author disclosures
The authors report no actual or potential conflicts of interest with regard to this article.
Disclaimer
The opinions expressed herein are those of the authors and do not necessarily reflect those of Federal Practitioner, Frontline Medical Communications Inc., the U.S. Government, or any of its agencies. This article may discuss unlabeled or investigational use of certain drugs. Please review the complete prescribing information for specific drugs or drug combinations—including indications, contraindications, warnings, and adverse effects—before administering pharmacologic therapy to patients.
Electronic consultations (e-consults), also called e-referrals, are an alternative method of obtaining general patient information through the electronic health record (EHR) shared by primary care providers (PCPs) and specialists in the VHA. In the e-consult system, test results, medication lists, and other pertinent data are available.1 Many PCPs are willing to use new technologies to maximize practice efficiency and patient convenience.2 In the VHA’s hub-and-spoke model of care, e-consults have the potential to make delivery of specialty care more efficient by prearranging or completing necessary diagnostic testing and redirecting inappropriate referrals to the correct specialists.1
Some early studies of e-consults report better communication, improved referral appropriateness, and greater access to specialty care as well as better continuity of care and information transfer between patients and PCPs.3-5 Researchers at the VA Boston Healthcare System in Massachusetts found that 61% of specialists surveyed agreed that e-consults improve quality of care and found the approach beneficial to help initiate diagnostic testing prior to a face-to-face visit.6 However, researchers at the Michael E. DeBakey VAMC in Houston, Texas, found no improvement in care coordination.7 To date, there have been no large-scale evaluations of e-consult programs or assessments of implementation of e-consult programs.
Related: HHS Grants Fund Health IT in Communities
In early 2011, the VHA Office of Specialty Care Services (OSCS), Office of Specialty Care Transformation launched a national e-consult pilot as part of a broader effort to improve the delivery of patient-centered specialty care. This initiative was based on core concepts advanced by the American College of Physicians, which highlighted the importance of specialty care within a patient- centered medical home and provided a framework for collaboration.8,9 The goals of the e-consult program were to improve access to specialty care for veterans and their PCPs, to enhance the collaborative relationship between PCPs and specialists, and to augment PCP education.
The OSCS created an Electronic Consultation Implementation Guide to help sites develop and implement each of their e-consult programs.10 The Implementation Guide established operating rules, strategies for engaging key stakeholders, and recommendations for provider education and training.
As with face-to-face referrals, e-consults are organized in a hub-and-spoke model, where community-based outpatient clinics (CBOCs) are linked to a central VAMC. An e-consult can be accessed by any CBOC, VAMC, medical center-based primary care clinic or specialist, and between medical centers that share the same EHR. There were 217,014 completed e-consults between May 2011 and December 2013 across VHA.11
Some programs created an e-consult template to aid in the transition to electronic referrals (Figure). Although not mandatory, the template helped organize needed information to expedite the e-consult.
The objective of this evaluation is to describe the implementation of e-consults from the perspectives of PCPs, specialists, and other key staff involved in the pilot. Key findings were related to: (1) how the e-consult pilot was implemented; (2) how implementation of the e-consult pilot affected providers; and (3) to what extent the e-consult pilot achieved programmatic objectives from the provider’s perspective.
Methods
The authors conducted a key informant analysis with 2 waves of interviews at 8 e-consult pilot sites across the U.S., selected for variation on early progress in implementation. The sites cannot be identified based on an agreement with the VA Office of Labor-Management Relations.
Setting
The e-consult pilot involved 15 VAMCs in 2 cohorts: alpha sites, which began using e-consults in May 2011, and beta sites, which began using e-consults in July 2011. The alpha sites included 10 VAMCs in 12 medical specialties, with a total of 21 facility-specialty combinations. For the evaluation, sites were defined based on specialty, regardless of location within the same medical center (eg, cardiology and diabetes at the same VAMC would be 2 sites). Beta sites included 5 VAMCs with 6 medical specialties for a total of 6 sites. For 1 year, alpha sites received $175,000 and beta sites received $150,000 to support start-up activities.
Initial specialties included diabetes, hepatitis C, geriatrics, cardiology, liver transplant, dementia, gastrointestinal disease, pulmonary medicine, rheumatology, pain management, neurosurgery, infectious diseases, hematology/oncology, and vascular surgery. Facilities could add additional e-consult specialties but did not receive further funding.
Sample
Study participants were selected from 8 of the 15 pilot sites (geographic site/specialty combinations). Site selection was based on 2 measures of baseline e-consult implementation: (1) overall e-consult implementation rates, measured as the ratio of e-consults to all consults for the specialties of interest; and (2) CBOC participation, measured as the ratio of e-consults for patients from CBOCs vs e-consults for patients from primary care clinics located within the 152 VAMCs. Participation with CBOCs was important for ensuring that implementation factors that influenced uptake of e-consults within tertiary medical centers and between VAMCs and CBOCs could be identified. Two e-consult sites were randomly selected from each of the 4 resulting categories (VAMC high volume, VAMC low volume, CBOC high volume, and CBOC low volume). Volume data of e-consults were obtained from the VA Corporate Data Warehouse and assessed from the beginning of the pilot period to initial site selection, May 2011 to February 2012.
Respondents were identified using a modified snowball sampling process. Snowball sampling is a qualitative sampling technique that identifies study participants, who then identify other potential participants to participate in the study. The researchers started with the local e-consult initiative lead and then contacted the directors of primary care and specialty care services for help identifying PCPs, specialists, and support staff (nurse practitioners, pharmacists, program managers, informatics staff, and medical support personnel) engaged in the initiative. The goal for follow-up interviews was to interview at least 2 of the following respondents at each site: e-consult project manager, PCP, and/or specialist. Due to turnover and changes in clinic roles, some follow-up interviews were conducted with different individuals from the baseline interviews.
Data Collection
Interviews followed semistructured interview guidelines and included open-ended questions designed to elicit rich responses to a variety of aspects related to e-consult implementation, including patient needs, communication, leadership, resources, priorities, knowledge about the program, and unintended consequences. Follow-up interviews addressed how e-consults impacted the quality of specialty care; the impact of e-consults on Patient Aligned Care Teams (PACTs), the VHA patient-centered medical home initiative for primary care; and how e-consults have been used, eg, whether patients were involved in the decision to seek an e-consult.
Two interviewers who had participated in a 1-day, in-person training covering both data collection and analyzing key informant data conducted the 40 to 60 minute telephone interviews. One team member conducted the interview while the other took field notes. Interviews were also recorded. Follow-up probes were used to elicit specific examples and ensure sufficiently rich data. Following each interview, the notetaker reviewed the audio recording and filled in details in the field notes. The interview team debriefed and reviewed the augmented field notes and audio recordings, which became the primary data sources for the study.
Analysis
This was a qualitative descriptive analysis.12 Interview data were analyzed using an iterative, inductive content analysis method using an open coding approach (ie, a priori codes were not defined for this portion of the analysis).13 Two members of the research team used audio recordings and summary transcripts simultaneously to code data. Summary transcripts were compared with the recorded interviews to assure fidelity.
The researchers used Atlas.ti (Berlin, Germany) qualitative data analysis software to organize the coding process. Emergent codes were iteratively added throughout the analysis to reflect quotations that did not adequately fit previously developed codes. Codes were combined weekly to biweekly. After the combinations were completed, the analytics team met to review meanings of codes to ensure consistency of coding and interpretations.
To create categories, broad themes were identified from interview responses and grouped under high- order headings that described distinct aspects of participant experience. The analysis was intentionally kept close to the original data to reflect and describe the participant’s experience as accurately as possible. In support of analytical rigor, members of the multidisciplinary research team, composed of clinicians, implementation scientists, and mixed methodologists, reviewed findings to assess their thoroughness, comprehensiveness, and representativeness across roles and participating sites.14
Results
The e-consult evaluation period was from November 1, 2011, to July 31, 2013. Key conclusions were drawn from both alpha and beta sites (Table). Baseline interviews were conducted with 37 participants at 8 sites from April 10, 2012, to August 6, 2012. Follow-up interviews were conducted with 21 of the 37 participants at the 8 sites. Follow-up interviews with either a PCP or specialist could not be scheduled at 1 site. Follow-up interviews were conducted from April 16, 2013, to June 18, 2013. Open coding continued until saturation (the point at which subsequent data failed to produce new findings).15 This occurred after analysis of 22 baseline interviews (12 PCPs, 6 specialists, 1 pharmacist, and 4 other staff members) and 17 follow-up interviews (10 PCPs, 4 specialists, 1 pharmacist, and 2 other staff members).
Implementation
The e-consults provided a programmatic structure to the more informal practice of obtaining diagnostic or therapeutic advice from a specialist. Several of the specialists interviewed described having previously used existing informal consult processes that were “like e-consult.” These specialists reported that their practice patterns did not change significantly since implementing e-consults, because they have been “using the Computerized Patient Record System (CPRS) in an e-consult way for many years.” In these cases, the primary change resulting from the initiative was that national VHA workload policy was revised so that e-consults were assigned a CPT (Current Procedural Terminology) code and specialists began receiving workload credit for completing e-consults.
At sites where an informal e-consult practice was already in place, the initiative was consistently described as flexible. Many specialists reported that this degree of flexibility allowed them to make a relatively easy transition to e-consults by adopting new mechanisms to support existing processes. The e-consult initiative also allowed specialists to formally document this work and to increase the efficiency of specialty care.
Specialists drove the implementation process across sites. The e-consults were envisioned as a collaborative process; however, during initial interviews, few specialists mentioned PCPs when describing the development and implementation of the e-consult program. Primary care providers also reported having little awareness of or input into how the initiative was implemented, although this had little consequence on the use of e-consults.
In a rare case, a PCP reported that poorly designed, lengthy e-consult templates were a major barrier to using e-consults for specific specialties. The PCP said, “E-consults have created an elaborate but extraordinarily cumbersome tool that is difficult for PCPs to actually accomplish, because you have a consult menu that requires a lot of data to be entered—a lot of history from the chart, a lot of exam findings, a lot of previous cognitive testing scores; neurologic findings—lab and imaging tests.”
Still, many other PCPs described receiving detailed information and guidance from e-consults. “E-consults help me to be more accurate. Many providers don’t have a comfort with pain management. To get guidance and education and to really hold our hand, this is how to do this…this has been a big change. If they give you a great response, then [for] the next patient [with that condition], you go back to that note and then follow what was said there,” said one PCP.
In follow-up interviews, providers and other key staff stated there were more data available on the patient as a result of the e-consult and, consequently, even when specialists determined that a patient needed an in-person visit, the data obtained in the e-consult improved the quality of the in-person consultation.
Enhanced Communication and Collaboration
Neither the PCPs nor the specialists were aware of the collaborative intent of the initiative. They focused, instead, on other key aims, such as increasing accessibility and minimizing unnecessary patient travel. Most participants were generally positive about e-consults during baseline interviews, and this perception increased over time.
Both the PCPs and the specialists reported improved communication following the launch of e-consults. In follow-up interviews, some PCPs reported that before e-consults, they had trouble getting timely responses from specialists unless they knew them personally. “You had to know the person in the old days,” one respondent said. “After e-consults, responses improved…e-consult is available to have the resources to tap that knowledge base, and the team is answering the question. I think it opens up access and information and knowledge to everybody.”
Many PCPs spoke positively about this new communication tool as an opportunity to learn from specialists and said they valued the input they received. They felt the increased interaction between the 2 groups positively benefited patient care. One example cited that collaborative communication improved care coordination for veterans: “We are able to step in with e-consults to coordinate services, and this has been huge in improving care.”
Furthermore, follow-up interviews found that all participating PCPs and specialists were communicating more frequently and effectively. “Services that have embraced e-consult give a lot of great information flowing back; it’s closer to a real-time conversation,” said one respondent.
Related: Home-Based Video Telehealth for Veterans With Dementia
In baseline interviews, some specialists described how e-consults went against their belief that patient care is synonymous with face-to-face medical treatment and voiced dissatisfaction with e-consults as “sitting in front of a computer” rather than “seeing patients.” Others were concerned that medical center administration would not recognize the time it takes to conduct an e-consult and therefore not add necessary specialists staff. “E-consults take work and time, just like seeing a patient. I worry that won’t be seen,” one specialist said.
In order to successfully implement the e-consult initiative, providers and staff needed to incorporate new processes into their daily workflow.
Most sites did not develop a mechanism in which specialists received feedback regarding the outcome of their consultations. This lack of response created anxiety for some specialists in the absence of the face-to-face encounter, leaving some wondering whether they or the PCP had missed anything. According to one specialist, “That’s always in the back of your head: ‘Have I [the specialist] missed something?’”
In follow-up interviews, none of these concerns were raised. Primary care providers tended to speak of the care provided by specialists through e-consults in very positive terms, except in those instances where PCPs felt the e-consult template was difficult to use and required too much time to complete. “I was worried in the beginning about patients thinking less of me, but we ask for help all the time. We’re asking for help and not inconveniencing the patient; they seem to like it very much,” one PCP said.
The e-consults also complement PACTs. Initially, a few participants described soliciting patient input regarding the choice to have an e-consult or a face-to-face visit. During follow-up interviews, participants highlighted how well e-consults fit in to the PACT philosophy. One participant said, “The PACT team seeks to improve quality of care. E-consult fits very well with this, because answers to questions can come quickly, and the veteran may not need to come back to the clinic to be seen, even though things are still getting accomplished. E-consult works very well. E-consults were credited with improving access to specialty care as a tool for PACT.”
Achieving Program Objectives
Based on interviews, support for the e-consult program has increased over time as providers have gained experience with the program and have seen its benefits. Respondents at all sites consistently supported the concept of e-consults and expressed their belief in the importance and value of e-consults in improving patient-c entered care, primarily by reducing the need for patients to travel to see specialists, reducing the time to obtain feedback from specialists, and maintaining the provision of high quality care.
“Last year we only had 2 clinics categorized as e-consults. As of now we have 14 e-consults available for our providers. I think the numbers are growing. They are realizing the value of e-consults as far as the provider’s needs being met,” said one respondent.
The e-consults were credited with improving access to specialty care for veterans. Several participants stated that e-consults improved access to specialty care services and decreased travel for veterans. “It’s another way of getting care to the patient when the patient needs it without having to wait,” said one respondent.
Many PCPs described how difficult it was for patients to get to specialty appointments—particularly for their elderly, disabled, and rural patients—before the implementation of e-consults. “I like the fact that patients who live very far don’t have to come back. A lot of our patients are older…diabetic, see me Monday and back on Thursday. Now, they are able to stay home and follow the recommendations I write,” said one PCP.
Most providers were of the opinion that patients liked the program. “I think e-consults are helping patients...It’s been very successful regarding decreasing travel…Quicker response time for specialty care,” said a PCP. Several providers also stated in follow-up interviews that there was a greater degree of patient participation in the e-consult process and that “patients are definitely informed.”
Discussion
Most PCPs reported that the e-consults were an effective means of consultation and contained the information they needed to provide high-quality coordinated care. Most also found e-consult templates easy to complete. A majority of PCPs felt sufficient control over the choice of whether to use e-consults or an in-person visit, and a minority of patients were involved in the decision to receive an e-consult. Although the OSCS outlined guiding principles and operational rules in the Implementation Guide to help sites implement the e-consult program, its contribution was limited. Few examples were found that engaged PCPs in development of the e-consult program locally; involving patients in the decision to obtain a specialty consult electronically or in person; and PCPs feeding back results to specialists.
Implementing e-consults posed a number of challenges, including lack of resources to respond to referral requests, lack of referral policies and standardized procedures, and confusion related to roles and responsibilities. This is consistent with findings from another VHA research project of e-consults in 2 VHA health systems that was conducted prior to this national level e-consult pilot.7
Related: Using Facilitative Coaching to Support Patient Aligned Care Teams
Communication by OSCS of key aspects of the e-consult initiative will be critical as more sites implement e-consults. Since initiation of this pilot, workload specifications and credit have changed from 1 code to 3 codes, to more accurately reflect the amount of time a specialist consultant spends reviewing the EHR and responding to the consult. Without seeing the patient directly, specialists are more reliant on the PCP to describe the problem and provide adequate information in the e-consult request in order to provide recommendations back to the PCP.
Primary care physicians need to know that e-consults are available and determine when they are appropriate. A template or other guidance may be helpful to ensure adequate information is provided in the e-consult request; and the information provided by the specialist in response to the e-consult has to be sufficient for the PCP to provide care. VHA continues to expand the use of e-consults throughout the system, as this pilot found that the electronic option was often more timely than were face-to-face consultations. The result of this evaluation has informed national implementation of this effort.
Limitations
There are 3 main limitations to this study. First, because there was no practical way to preidentify participants who participated in implementing e-consults, a modified snowball sampling was used. However, this limited the degree to which the group was representative of the pilot participants. Second, the authors reported findings from a real-world initiative, not an experimental study. As such, not all participants in the first wave of key informant interviews were available for follow-up interview, which may have introduced bias. Third, the VHA is unlike most of the rest of the U.S. health care system in that it is a fully integrated system with salaried PCPs and specialists and an EHR.
Generalizability of the study may be limited, as a modified snowball sampling approach is not entirely random and has potential for community bias, because initial participants influence subsequent sampling. Additionally, though the sample size (n = 37) was sufficient for qualitative, in-depth analysis, it may be too small for confident generalization of findings. However, as health care moves toward an accountable care organization system, the authors’ analysis may provide insights.
Issues include revision of reimbursement policy for e-consults and developing or coordinating informational technology infrastructures to permit e-consults. It is also important to note that this evaluation reports solely on the extent of implementation of e-consults and the effects of e-consult implementation from the perspectives of staff, including specialists and PCPs.
Evaluating the effectiveness of the program in improving access, care coordination, and patient satisfaction was beyond the scope of the study. Further research is needed, because findings on those outcomes are critical for drawing inferences about this study’s implementation results.
Conclusion
The assessment of the e-consult system by providers and staff was based on a perception that e-consults are a valuable tool in providing greater access to quality care. Currently, e-consults have been expanded across VHA in medical and surgical specialties. VHA policymakers have drafted field guidance and a communication plan to support these efforts.
Acknowledgement
This material is based on work supported by the VA Office of Specialty Care Transformation, the office overseeing the e-consult initiative, and the Office of Research and Development Quality Enhancement Research Initiative.
Author disclosures
The authors report no actual or potential conflicts of interest with regard to this article.
Disclaimer
The opinions expressed herein are those of the authors and do not necessarily reflect those of Federal Practitioner, Frontline Medical Communications Inc., the U.S. Government, or any of its agencies. This article may discuss unlabeled or investigational use of certain drugs. Please review the complete prescribing information for specific drugs or drug combinations—including indications, contraindications, warnings, and adverse effects—before administering pharmacologic therapy to patients.
1. Chen AH, Murphy EJ, Yee HF Jr. eReferral—a new model for integrated care. N Engl J Med. 2013;368(26):2450-2453.
2. Hanna L, May C, Fairhurst K. The place of information and communication technology-mediated consultations in primary care: GPs’ perspectives. Fam Pract. 2012;29(3):361-366.
3. Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF Jr, Kushel MB. Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med. 2010;25(10):1123-1128.
4. Straus SG, Chen AH, Yee HF Jr, Kushel MB, Bell DS. Implementation of an electronic referral system for outpatient specialty care. AMIA Annu Symp Proc. 2011;2011:1337-1346.
5. Horner K, Wagner E, Tufano J. Electronic consultations between primary and specialty care clinicians: early insights. Issue Brief (Commonw Fund). 2011;23:1-14.
6. McAdams M, Cannavo L, Orlander JD. A medical specialty e-consult program in a VA health care system. Fed Pract. 2014;31(5):26-31.
7. Hysong SJ, Esquivel A, Sittig DF, et al. Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci. 2011;6:84.
8. American College of Physicians. The Patient- Centered Medical Home Neighbor: The Interface of the Patient-Centered Medical Home with Specialty/Subspecialty Practices. Philadelphia, PA: American College of Physicians; 2010. Policy paper.
9. Fisher ES. Building a medical neighborhood for the medical home. N Engl J Med. 2008;359(12): 1202-1205.
10. Department of Veterans Affairs. Electronic Consultation (E-Consult) Implementation Guide, Version 1.2. Washington, DC: Department of Veterans Affairs, Office of Specialty Care Services, Specialty Care Transformation. 2013.
11. Kirsh S, Cary E, Aron DC et al. Results of a national pilot project for specialty care e-consultation in primary care medical homes: the impact of specialty e-consultation on access. Am J Manag Care. In press.
12. Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334-340.
13. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115.
14. Giacomini MK, Cook DJ. Users’ guides to the medical literature: XXIII. Qualitative research in health care A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 2000;284(3):357-362.
15. Sandelowski M. The problem of rigor in qualitative research. ANS Adv Nurs Sci. 1986;8(3):27-37.
1. Chen AH, Murphy EJ, Yee HF Jr. eReferral—a new model for integrated care. N Engl J Med. 2013;368(26):2450-2453.
2. Hanna L, May C, Fairhurst K. The place of information and communication technology-mediated consultations in primary care: GPs’ perspectives. Fam Pract. 2012;29(3):361-366.
3. Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF Jr, Kushel MB. Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med. 2010;25(10):1123-1128.
4. Straus SG, Chen AH, Yee HF Jr, Kushel MB, Bell DS. Implementation of an electronic referral system for outpatient specialty care. AMIA Annu Symp Proc. 2011;2011:1337-1346.
5. Horner K, Wagner E, Tufano J. Electronic consultations between primary and specialty care clinicians: early insights. Issue Brief (Commonw Fund). 2011;23:1-14.
6. McAdams M, Cannavo L, Orlander JD. A medical specialty e-consult program in a VA health care system. Fed Pract. 2014;31(5):26-31.
7. Hysong SJ, Esquivel A, Sittig DF, et al. Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci. 2011;6:84.
8. American College of Physicians. The Patient- Centered Medical Home Neighbor: The Interface of the Patient-Centered Medical Home with Specialty/Subspecialty Practices. Philadelphia, PA: American College of Physicians; 2010. Policy paper.
9. Fisher ES. Building a medical neighborhood for the medical home. N Engl J Med. 2008;359(12): 1202-1205.
10. Department of Veterans Affairs. Electronic Consultation (E-Consult) Implementation Guide, Version 1.2. Washington, DC: Department of Veterans Affairs, Office of Specialty Care Services, Specialty Care Transformation. 2013.
11. Kirsh S, Cary E, Aron DC et al. Results of a national pilot project for specialty care e-consultation in primary care medical homes: the impact of specialty e-consultation on access. Am J Manag Care. In press.
12. Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334-340.
13. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115.
14. Giacomini MK, Cook DJ. Users’ guides to the medical literature: XXIII. Qualitative research in health care A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 2000;284(3):357-362.
15. Sandelowski M. The problem of rigor in qualitative research. ANS Adv Nurs Sci. 1986;8(3):27-37.