Evaluating Shared Decision Making
We audio taped and transcribed randomly selected SDM encounters to assess fidelity with the 2016 CMS required discussion elements for counseling about lung cancer, including the benefit of reducing lung cancer mortality; the potential for harms from false alarms, incidental findings, overdiagnosis, and radiation exposure; the need for annual screening; the importance of smoking cessation; and the possibility of undergoing follow-up testing and diagnostic procedures. An investigator coded the transcripts to assess for the presence of each required element and scored the encounter from 0 to 7.
We also surveyed veterans completing SDM, using a convenience sampling strategy to evaluate knowledge, the quality of the SDM process, and decisional conflict. Initially, we sent mailed surveys to subjects to be completed 1 week after the SDM visit. To increase the response rate, we subsequently called patients to complete the surveys by telephone 1 week after the SDM visit.
We used the validated LCS-12 knowledge measure to assess awareness of lung cancer risks, screening eligibility, and the benefits and harms of screening.14 We evaluated the quality of the SDM visit by using the 3-item CollaboRATE scale (Table 1).15
The response items were scored on a 9-point Likert scale (0, no effort; 9, every effort). The CollaboRATE developers recommend reporting the top score (ie, the proportion of subjects whose response to all 3 questions was 9).16 We used the 4-item SURE scale to assess decisional conflict, a measure of uncertainty about choosing an option.17 A yes response received 1 point; patients with scores of 4 were considered to have no decisional conflict.The NPC also took field notes during interviews to help identify additional SDM issues. After each call, the NPC noted her impressions of the veteran’s engagement with SDM and understanding of the screening issues.
Clinical Outcomes
We used the screening dashboard and CPRS to track clinical outcomes, including screening uptake, referrals for tobacco cessation, appropriate (screening or diagnostic) follow-up testing, and cancer diagnoses. We used descriptive statistics to characterize demographic data and survey responses.
Initial Findings
We conducted 105 SDM telephone visits from November 2020 through July 2022 (Table 2).
We audio taped 27 encounters. Measures of SDM showed good fidelity with addressing required CMS elements. The mean number of elements addressed was 6.2 of 7. Reduction in lung cancer mortality was the issue least likely to be addressed (59%).We surveyed 47 of the veterans completing SDM visits (45%) and received 37 completed surveys (79%). All respondents were male, mean age 61.9 years, 89% White, 38% married/partnered, 70% rural, 65% currently smoking, with a mean 44.8 pack-years smoking history. On average, veterans answered 6.3 (53%) of knowledge questions correctly (Table 3).
They were most likely to correctly answer questions about the harms of radiation exposure (65%), false-positive results (84%), false-negative results (78%), and overdiagnosis (86%).Only 1 respondent (3%) correctly answered the multiple-choice question about indications for stopping screening. Two (5%) correctly answered the question on the magnitude of benefit, most overestimated or did not know. Similarly, 23 (62%) overestimated or did not know the predictive value of an abnormal scan. About two-thirds of veterans underestimated or did not know the attributable risk of lung cancer from tobacco, and about four-fifths did not know the mortality rank of lung cancer. Among the 37 respondents, 31 (84%) indicated not having any decisional conflict as defined by a score of 4 on the SURE scale.
Overall, 59% of respondents had a top box score on the CollaboRATE scale. Ratings for individual domains ranged from 65% to 73% (Table 4).