Latest News

We asked doctors using AI scribes: Just how good are they?


 

What’s it like to use an AI medical scribe?

The scribes feature hardware (typically a smartphone or tablet) and software built on automatic speech recognition, natural language processing, and machine learning. Download an app to your device, and you’re ready to go. Use it to record in-person or telehealth visits.

In the first week, a company may help train you to use the hardware and software. You’ll likely start by using it for a few patient visits per day, ramping up gradually. Dr. Partida said she was comfortable using the system for all her patients in 6 weeks.

Each day, Dr. Partida logs in to a dedicated smartphone or tablet, opens the app, and reviews her schedule, including details she needs to prepare for each patient.

At the start of each patient visit, Dr. Partida taps the app icon to begin recording and lays the device nearby. She can pause as needed. At the end of the visit, she taps the icon again to stop recording.

The AI listens, creates the note, and updates relevant data in the EHR. The note includes patient problems, assessment, treatment plan, patient history, orders, and tasks for staff, along with medications, referrals, and preauthorizations. A human scribe, who is also a physician, reviews the information for accuracy and edits it as needed. By the next morning, the data are ready for Dr. Partida to review.

Fully automated versions can generate notes much faster. Jack Shilling, MD, MBA, an orthopedic surgeon at Cooper University Health Care, in Voorhees, N.J., uses DAX. A new feature called DAX Express – which uses OpenAI’s GPT-4 but no humans – provides him with a draft of his clinical notes in just seconds.

How accurate are AI notes?

The accuracy of those notes remains an open question, Dr. Garcia said – mostly because accuracy can be hard to define.

“If you asked five docs to write a note based on the same patient encounter, you’d get five different notes,” Dr. Garcia said. “That makes it hard to assess these technologies in a scientifically rigorous way.”

Still, the onus is on the physician to review the notes and edit them as needed, Dr. Garcia said. How light or heavy those edits are can depend on your unique preferences.

Dr. Shilling said he may need to lightly edit transcripts of his conversations with patients. “When someone tells me how long their knee hurts, slight variability in their transcribed words is tolerable,” he said. But for some things – such as physical exam notes and x-ray readings – he dictates directly into the device, speaking at a closer range and being less conversational, more exact in his speech.

Should you let patients know they’re being recorded?

The federal Health Insurance Portability and Accountability Act (HIPAA) does not require providers to inform patients that their face-to-face conversations are being recorded, said Daniel Lebovic, JD, corporate legal counsel at Compliancy Group, in Greenlawn, N.Y., a company that helps providers adhere to HIPAA rules.

But make sure you know the laws in your state and the policies at your health care practice. State laws may require providers to inform patients and to get patients’ consent in advance of being recorded.

All the doctors who spoke to this news organization said their patients are informed that they’ll be recorded and that they can opt out if they wish.

Recommended Reading

The sacred office space
MDedge Rheumatology
Nurse practitioners sue state over right to use ‘doctor’ title
MDedge Rheumatology
Time to end direct-to-consumer ads, says physician
MDedge Rheumatology
Hospital guards snoop through patient records, cost hospital $240K
MDedge Rheumatology
Could your practice be more profitable if you outsource?
MDedge Rheumatology
Johns Hopkins retains title as best hospital for rheumatology
MDedge Rheumatology
Long COVID disability court battles just ‘tip of iceberg’
MDedge Rheumatology
Medical students are skipping class lectures: Does it matter?
MDedge Rheumatology
Disclosure inaccuracies common in top rheumatology journals
MDedge Rheumatology
Cigna accused of using AI, not doctors, to deny claims: Lawsuit
MDedge Rheumatology