It’s ChatGPT’s world. We’re just living in it
Have you heard about ChatGPT? The artificial intelligence chatbot was just launched in November and it’s already more important to the Internet than either Vladimir Putin or “Rick and Morty.”
What’s that? You’re wondering why you should care? Well, excuuuuuse us, but we thought you might want to know that ChatGPT is in the process of taking over the world. Let’s take a quick look at what it’s been up to.
“ChatGPT bot passes law school exam”
“ChatGPT passes MBA exam given by a Wharton professor”
“A freelance writer says ChatGPT wrote a $600 article in just 30 seconds”
And here’s one that might be of interest to those of the health care persuasion: “ChatGPT can pass part of the U.S. Medical Licensing Exam.” See? It’s coming for you, too.
The artificial intelligence known as ChatGPT “performed at >50% accuracy across [the three USMLE] examinations, exceeding 60% in most analyses,” a group of researchers wrote on the preprint server medRxiv, noting that 60% is usually the pass threshold for humans taking the exam in any given year.
ChatGPT was not given any special medical training before the exam, but the investigators pointed out that another AI, PubMedGPT, which is trained exclusively on biomedical domain literature, was only 50.8% accurate on the USMLE. Its reliance on “ongoing academic discourse that tends to be inconclusive, contradictory, or highly conservative or noncommittal in its language” was its undoing, the team suggested.
To top it off, ChatGPT is listed as one of the authors at the top of the medRxiv report, with an acknowledgment at the end saying that “ChatGPT contributed to the writing of several sections of this manuscript.”
We’ve said it before, and no doubt we’ll say it again: We’re doomed.