What next for Impact Factors?

R
Research Publishing
By: Steven Inchcoombe, Mon Jul 2 2018
Steven Inchcoombe

Author: Steven Inchcoombe

Chief Publishing Officer at Springer Nature

The announcement of the latest Journal Impact Factors has prompted the expected heated discussion around their value, importance and relevance to authors, funders and the rest of academia. Despite all of these challenges and reservations, the Impact Factor is still noted by authors as one of the top elements they take into account when deciding which journal to submit their work to, and this got me thinking about the criticism publishers face for referring to Impact Factors when talking about the performance of their journals and making comparisons.

I recently had to tackle this head on when elements of the financial prospectus which had been created to inform the financial community of the risks and opportunities associated with our business were used to make wild claims about our company’s use of Impact Factors.  Taken out of context and in isolation, these elements were used to conclude that we were paying lip service to DORA , that we were exploiting Impact Factors to market our journals, and that our only motivation for higher Impact Factors for our OA journals was to drive higher APCs.  None of this could have been further from the truth and my full explanation, which can be read here (Times Higher Education kindly removing their own paywall so it can be read in full), sets out how we have significantly changed our business practices in this area.

AB001_blue_network_RGB © Shutterstock

It also got me thinking, though, that in all the noise about what is wrong with the Impact Factor we don’t seem to have progressed very far in deciding what it should be replaced with for each purpose it is currently used, particularly as there is a strong case for arguing that the original purpose for which Eugene Garfield created the Impact Factor – comparing the significance of journals within their peer group and their evolution over time – remains valid.

The problem though is that a journal’s Impact Factor is often applied far beyond its original purpose and used as a proxy for the significance of a single piece of work published in a journal and / or to judge a researcher who has published in those journals. These judgements aren’t what publishers do – that’s not our job – unfortunately it is what parts of the research community do.  For example, academic appointment committees and grant award committees have done this for years and often continue to do so. And this in turn affects the behaviour of researchers when submitting their draft articles – in our author survey last year (completed by over 70,000 authors from all disciplines and regions) a journal’s Impact Factor was rated as one of the top four criteria when choosing where to submit a draft article, alongside a journal's reputation, relevance and quality of peer-review.  

The problem though is that a journal’s Impact Factor is often applied far beyond its original purpose and used as a proxy for the significance of a single piece of work published in a journal and / or to judge a researcher who has published in those journals.

But with authors still wanting guidance as to which journal to submit to, funders and institutions needing to evaluate researchers, and journal and book information purchasers needing to assess ‘value for money’, we are long way from Randy Sheckman’s Utopian world where no metric is attached to scientific work.  This point was very clearly explained by John Tregoning’s recent article in Nature where he asked “How will you judge me if not by impact factor? Stop saying that publication metrics don’t matter, and tell early-career researchers what does” and explained the challenge researchers like him face when his heart says one thing and his head says Impact Factor.

So is it is up to primary and secondary publishers to provide a new generation of metrics? If so, what are our options?

Article level metrics are the most obvious starting point: article level usage data, article level social media mentions and of course article citations should be used and built upon. Then there are researcher level metrics that can be created based in the aggregation of these article level metrics combined with author contribution statements. I would like to see these created to open, transparent standards so it is easy for all to understand, replicate and apply.

I am sure we can do this together but I doubt publishers can do this by themselves. At Springer Nature we are increasing our use of other journal-level and article-level metrics including article usage and altmetrics, views and downloads, article and book chapter citations and references and creation of author contribution statements, and making them all available to authors, funders and institutions.  But for this to gain real acceptance and traction within the research community, I expect more input from the ultimate customers (i.e. authors, funders and institutions) and validation by an external body will be required.  

At Springer Nature we are increasing our use of other journal-level and article-level metrics including article usage and altmetrics, views and downloads, article and book chapter citations and references and creation of author contribution statements, and making them all available to authors, funders and institutions. 

I am very proud of what we do at Springer Nature and how we do it.  The company remains committed to addressing the need for a wider and richer set of metrics across our subscription and OA models, and across our journals and books, so our authors can measure the ‘impact’ of their research, researchers, as content consumers, are able to evaluate the standing of our journals, articles and books, and librarians can make informed purchasing decisions.  For over 10 years Nature editorials have expressed concerns about the overuse of Impact Factors and set out the case for a greater variety of more suitable metrics for different purposes. The question I pose to others is this – how can we all work together to create open metrics that better meet the needs of academic appointment committees and grant award committees? Only once we are agreed on these and they are available can use of the Impact Factor return to its original and still valid purpose.

Steven Inchcoombe

Author: Steven Inchcoombe

Chief Publishing Officer at Springer Nature

Steven Inchcoombe read Physics at Merton College, Oxford and qualified as a chartered accountant with PwC. From 1990 to 2000, Steven was at Interactive Data Corporation, where he ultimately became responsible for strategy, M&A and the EMEA region, and during this period the business became listed on NASDAQ. He then moved on to Board positions with the Financial Times Group, including UK Publisher of the Financial Times and Managing Director of ft.com. 

Steven joined the Macmillan Board in 2006. From 2007 to 2013, he led the Nature Publishing Group (NPG), and in 2013 became CEO of Macmillan’s Science and Scholarly division, comprising NPG, Scientific American and Palgrave Macmillan. Following the creation of Springer Nature in May 2015 he was appointed Managing Director of its Nature Research Group and most recently promoted to Chief Publishing Officer for Springer Nature in March 2016.

Previous posts

Celebrating the Chinese contribution to the world’s sustainable development research

With the fastest-growing scientific and scholarly research, China’s importance for sustainable development is increasingly clear.

R
Research Publishing
28 Aug 2019
Transformative deals substantially aid the transition to OA. Let’s give them the time they need to do so.

Last month, Springer Nature agreed a new transformative ‘read and publish’ deal with the Norwegian library consortium, Unit.  This, coupled with renewals of existing deals in the UK (Jisc), Sweden (Bibsam) and Qatar, takes the number of such deals we have into double figures, the most of any publisher.  These deals enable researchers in these ten countries to publish open access in over 1900 Springer journals as well as read the research of others across this portfolio.

O
Openaccess
02 Aug 2019
The future of open access books

Open access book publishing has been growing in recent years. The Directory of Open Access Books (DOAB) lists 2,099 open access books published in 2018, an increase of 38% from 2017. Funders are also starting to engage with open access for books: a small number of European funders now mandate open access for books and provide financial support for open access book publication. COAlition S has also indicated that they support transitioning monographs to open access, and will provide guidance by the end of 2021.

O
Openaccess
18 Jun 2019
Maximising the benefits of early sharing

At Springer Nature making great research available as quickly as possible is a central part of our commitment to the research community. 

Springer Nature Group
23 May 2019
A faster path to an open future

At Springer Nature we want to find the fastest and most effective route to immediate open access (OA) for all primary research.

Springer Nature Group
08 May 2019
Congratulations to Karen Keskulla Uhlenbeck

It’s a great pleasure for us at Springer Nature to congratulate Karen Keskulla Uhlenbeck for the award of this year’s Abel Prize.

Springer Nature Group
03 Mar 2019
Businesses must play a role in sustainable development

Today Springer Nature launches its Responsible Business report for 2018.

Springer Nature Group
27 Mar 2019
Setting targets at Springer Nature to help create a better balance

The theme of this year’s IWD couldn’t be more relevant to us. Last month, Springer Nature’s management board announced to our 13,000 colleagues that we will set a target to improve gender representation in our leadership group.

Springer Nature Group
07 Mar 2019
Without you, we are nothing: why community engagement is at the core of everything we do

Sometimes there is great value in stating the obvious; the scholarly publishing industry would not exist without a broad international community of researchers, students, librarians, funders, and commercial partners.

R
Research Publishing
06 Mar 2019
Need to focus on demand as well as supply: making Plan S work for all

Steven Inchcoombe discusses Springer Nature's submission to the cOAlition of participants to make Plan S work for all.

R
Research Publishing
11 Feb 2019
A postcard from Davos: what role for research at this gathering of global opinion leaders?

My first impressions of Davos? Dazzling, overwhelming, unexpected, thought-provoking, incredibly busy and much, much more…

R
Research Publishing
04 Apr 2019
How Can We Accelerate Data Sharing?

What steps can publishers, funders and institutions take to make data sharing worth a researcher’s time and energy, and accelerate progress? 

R
Research Publishing
10 Mar 2019
Connecting curious minds to advance learning and discovery

Science

Springer Nature will stay curious, connect ideas, question how things are done, explore new ways to deliver for our communities and then make the changes that matter.

R
Research Publishing
20 Feb 2019
The quest for more value – challenges of the scientific ecosystem in the absence of coordination: A Long Read

Research News

Daniel Ropers shares some of his early observations about the academic publishing industry.

R
Research Publishing
01 Nov 2018
Publication misconduct: changing the conversation

Suzanne Farley discusses how to increase prevention and detection of research and publication misconduct. 

R
Research Publishing
04 Nov 2018
Lessons learned from open peer review: a publisher’s perspective

Research News

Rachel Burley discusses BMC's history in openness and transparency and what has been learnt.

R
Research Publishing
23 Dec 2017
Accelerating open access: what is missing from Plan S

Research News

The transition to open access needs to be sustainable for the whole research community.

R
Research Publishing
23 Dec 2017
Finding the science in social media

Research News

At Springer Nature we believe that social media is a vital tool for everyone involved in the academic research and publishing process. 

R
Research Publishing
23 Dec 2017
Hybrid journals can advance the move towards full open access

Blogs

Hybrid journals play an important role in the transition to open access.

R
Research Publishing
01 Aug 2018
Science benefits from diversity – and as publishers we have a role to play

As a progressive publisher, we have a responsibility to support diversity and inclusion.

R
Research Publishing
17 Jul 2018
What next for Impact Factors?

Why we need to work together to create metrics that better meet the needs of the research community.

R
Research Publishing
02 Jul 2018
Can research change the world?

Springer Nature believes that great multidisciplinary research needs to be informing global discussions.  

R
Research Publishing
28 Jun 2018
We need to do more to celebrate and support women in engineering

Women’s achievements in STEM fields need to be harnessed to raise awareness, create role models and foster a more inclusive culture. 

R
Research Publishing
21 Jun 2018
Future of the book all down to definition

Advancing discovery

The speed of recent change in the publishing industry in the past 10 years poses the question, what will book publishing look like in the future?

R
Research Publishing