Impact Factor
Dr. Wilner: What about impact factor? Many journals boast about their impact factor. I’m not sure how to interpret that number.
Dr. Merino: Impact factor is very interesting. The impact factor was developed by medical librarians to try to identify the journals they should be subscribing to. It’s a measure of the average citations to an average paper in the journal.
It doesn’t tell you about specific papers. It tells you, on average, how many of the papers in this journal get cited so many times. It’s calculated by the number of articles that were cited divided by the number of articles that were published. Journals that publish many papers, like Neurology, have a hard time bringing up their impact factor beyond a certain level.
Similarly, very small journals with one or two very highly cited papers have a very high impact factor. It’s being used as a measure, perhaps inappropriately, of how good or how reputable a journal is. We all say we don’t care about journal impact factors, but we all know our journal impact factor and we used to know it to three decimals. Now, they changed the system, and there’s only one decimal point, which makes more sense.
This is more important, for example, for authors when deciding where to submit papers. I know that in some countries, particularly in Europe, the impact factor of the journal where you publish has an impact on your promotion decisions.
I would say what’s even more important than the impact factor, is to say, “Well, is this the journal that fits the scope of my paper? Is this the journal that reaches the audience that I want to reach when I write my paper?”
There are some papers, for example, that are very influential. The impact factor just captures citations. There are some papers that are very influential that may not get cited very often. There may be papers that change clinical practice.
If you read a paper that tells you that you should be changing how you treat your patients with myasthenia based on this paper, that may not get cited. It’s a very clinically focused paper, but it’s probably more impactful than one that gets cited very much in some respect, or they make it to public policy decisions, and so on.
I think it’s important to look more at the audience and the journal scope when you submit your papers.
Dr. Wilner: One other technical question. The journals also say they’re indexed in PubMed or Google Scholar. If I want to publish my paper and I want it indexed where the right people are going to find it, where does it need to be indexed?
Dr. Merino: I grew up using Index Medicus, MedlinePlus, and the Library of Science. I still do. If I need to find something, I go to PubMed. Ideally, papers are listed in MedlinePlus or can be found in PubMed. They’re not the same thing, but you can find them through them.
That would be an important thing. Nowadays, a lot more people are using Google Scholar or Google just to identify papers. It may be a little bit less relevant, but it’s still a measure of the quality of the journal before they get indexed in some of these. For example, if you get listed in MedlinePlus, it has gone through certain quality checks by the index itself to see whether they would accept the journal or not. That’s something you want to check.
Typically, most of the large journals or the journals you and I know about are listed in more than one place, right? They’re listed in Scopus and Web of Science. They’re listed in MedlinePlus and so on. Again, if you’re submitting your paper, go somewhere where you know the journal and you’ve heard about it.
Dr. Wilner: I’m not going to ask you about artificial intelligence. We can do that another time. I want to ask something closer to me, which is this question of publish or perish.
There seems to be, in academics, more emphasis on the number of papers that one has published rather than their quality. How does a younger academician or one who really needs to publish cope with that?
Dr. Merino: Many people are writing up research that may not be relevant or that may not be high quality just because you need to have a long list of papers to get promoted, for example, if you’re an academician.
Doug Altman, who was a very influential person in the field quality of not only medical statistics but also medical publishing, had the idea that we need less research, but we need better research.
We often receive papers where you say, well, what’s the rationale behind the question in this paper? It’s like they had a large amount of data and were trying to squeeze as much as they could out of that. I think, as a young academician, the important thing to think about is whether it is an important question that matters to you and to the field, from whatever perspective, whether it’s going to advance research, advance clinical care, or have public policy implications.
Is this one where the answer will be important no matter what the answer is? If you’re thinking of that, your work will be well recognized, people will know you, and you’ll get invited to collaborate. I think that’s the most important thing rather than just churning out a large number of papers.
The productivity will come from the fact that you start by saying, let me ask something that’s really meaningful to me and to the field, with a good question and using strong research methodology.
Dr. Wilner: Thanks for that, Dr. Merino. I think that’s very valuable for all of us. This has been a great discussion. Do you have any final comments before we wrap up?
Dr. Merino: I want to encourage people to continue reading medical journals all the time and submitting to us, again, good research and important questions with robust methodology. That’s what we’re looking for in Neurology and most serious medical journals.
Dr. Wilner is an associate professor of neurology at the University of Tennessee Health Science Center, Memphis. Dr. Merino is a professor in the department of neurology at Georgetown University Medical Center, Washington, DC. Dr. Wilner reported conflicts of interest with Accordant Health Services and Lulu Publishing. Dr. Merino reported no relevant conflicts of interest.
A version of this article first appeared on Medscape.com.