Strengthening trust in peer review through transparency

R
Reviewers
By: Sowmya Swaminathan and Maria Hodges, Wed Sep 23 2020
Sowmya Swaminathan and Maria Hodges

Author: Sowmya Swaminathan and Maria Hodges

Ensuring the integrity of the scientific record is relevant not only for researchers and academics but society at large. If the public are to trust research findings that have a direct impact on their lives, research must be credible and accurate. Peer review – subjecting research to the independent scrutiny of experts who can then help improve the work – is an essential first step to ensure that published research is reliable. Springer Nature has long recognised the need to test new ways of increasing the trust and value of the peer review process. Through BMC and Nature Research we have worked on improving transparency as a way of opening up the peer review process and earning trust.

When we ask researchers about how the peer review process can be improved, they tell us they want to see how publishing decisions are made and want greater assurance that referees and editors act with integrity and without bias. In a 2017 survey of Nature referees, more than half said peer review could be more transparent – and expected publishers to do more to make it so. Transparent peer review – the publication of peer review reports alongside the final paper – can help to provide researchers with this information and strengthen trust in the overall system. 

Transparent peer review is part of a broader set of open peer review models that can be adapted in line with the ethos of open science. Within the broad umbrella of transparent peer review there is a spectrum of transparency. Some journals use transparent peer review as the required form of peer review for that journal, while others give authors the choice to opt-in. There is also variation in the degree of transparency, with some journals releasing all peer review reports alongside relevant correspondence and author responses and editorial decision letters, while others only publish the reviewer reports. 

In celebration of #PeerRevWeek20, which focuses on #TrustInPeerReview, we discuss how transparent peer review initiatives at BMC and Nature Research have strengthened trust in our journals and the underlying peer review system. 

BMC pioneering alternative peer review models

As early as 1999, the BMC journals began experimenting with ways in which the peer review process could be made more transparent when it began publishing reviewer names in its medical journals. The publication of peer review reports alongside a ‘pre-publication history’ began a few years later for the medical journals of the BMC Series. On the basis of feedback from the community, the medical journals of the BMC Series and BMC Medicine have recently adopted transparent peer review. This means for all published manuscripts, the reviewer reports are published along with the author’s response to the reviewers comments. Reviewer names are only published if that reviewer opts in. 

Our next step is to transform all remaining BMC Series titles to transparent peer review, including BMC Chemistry, and we expect to achieve this by the end of the year. In addition, several journals, such as Environmental Health operate open peer review (where the reviewer’s identity is revealed).

Transparency in the Nature-branded research journals

In 2006, Nature Research began a pilot with the goal of including community input into the peer review process. At the time the pilot showed that the community had little enthusiasm for opening up the process. Ten years later, Nature Communications launched a different initiative focusing on transparent peer review, which allows authors to opt in to having their peer review reports published alongside author response letters. This second pilot indicated a pivotal shift in the research community towards more transparent peer review processes and in its first year Nature Communications had a 60% adoption rate. The latest data indicate that this is now around 70% of Nature Communications authors. The demand from the community for a more transparent peer review process has led a large number of journals and publishers to offer a wide spectrum of transparent peer review. 

From 2019-2020, transparent peer review is available at Nature, seven other Nature-branded primary research journals as well as the Communications journals. We soon hope to be able to share data about the percentage of authors who choose transparent peer review. 

Improved transparency through In Review

Springer Nature has always been a strong supporter of early sharing and actively encourages its authors to post their early manuscripts as preprints. In Review is a journal-integrated pre-print deposition service that allows early insight into peer review. Earlier this year we expanded the free pre-print service In Review, which was developed in partnership with ResearchSquare, to cover not just BMC and Springer open access journals, but the Nature-branded research primary research journals too. In Review, however, is much more than a preprint service. Through its integration with peer review, it enables authors to see specific details of peer review, providing a high level of transparency into an often 'hidden' process. Increasing transparency through early-sharing services like In Review is another way researchers and communities can be sure of the trustworthiness of the peer review process. 

Transparent peer review increases trust in the peer review process not just for researchers and authors, but also for the public. It provides important expert context for scientific literature for the non-expert reader, journalists, and policy makers. Those entities that assess research such as funders and institutions can use reviewer reports to assess the strength and significance of a study, rather than relying on the journal brand as a proxy for quality. Finally, peer review reports are an undervalued scholarly contribution which can be acknowledged more easily through publication. 

There are tremendous opportunities for Springer Nature to lead the way in peer review innovation and strengthen the trust peer review needed to ensure the integrity of the scientific record. We strive to pilot approaches that make peer review more portable, open, less biased, more inclusive. Springer Nature is committed to innovating and strengthening peer review to improve transparency, root out bias and strengthen trust in the process.

Sowmya Swaminathan and Maria Hodges

Author: Sowmya Swaminathan and Maria Hodges

Sowmya Swaminathan is Head of Editorial Policy & Research Integrity for Nature Research

Sowmya is responsible for the development of editorial policies including policies relevant to rigour and reproducibility, research integrity, publication ethics, bioethics, biosecurity and scholarly communications. She chairs the Nature Research Policy Forum and the Nature journal Reproducibility Steering Group. Sowmya has been at Nature journals since 2003. 

Maria Hodges is Executive Editor for the BMC Series

Maria has a degree in Biochemistry from Imperial College London, and a PhD in Biochemistry from Cancer Research UK (London Research Institute). She has been an Editor for Nature Structural and Molecular Biology, the Scientific Publications Manager for Cancer Research UK, managing the British Journal of Cancer, and an Editor of Genome Medicine. She is passionate about open access publishing and open science.

Previous posts

“The World Must Do Better To Harness Science for a Sustainable Future”

Blogs

Statement ahead of SDSN & Springer Nature Conference (8th Oct 2020). 

Springer Nature Group
05 Oct 2020
Research Practices in the wake of COVID-19: Busting open the myths around open data

Springer Nature. Figshare and Digital Science report on COVID-19's impact on open data and research practices.

R
Research Publishing
07 Aug 2020
Understanding better the impact of COVID-19 on the research enterprise

Commissioned research to better understand challenges faced by universities and researchers worldwide.

Springer Nature Group
06 Aug 2020
Bridging the gap between science and policy

Springer Nature & UN Sustainable Development Solutions Network - Free conference 'Science for a sustainable future'.

Springer Nature Group
24 Sep 2020
Why we need Pride, now more than ever

SN Pride talks through its commitment to pushing for diversity in our communities.

Springer Nature Group
10 Jul 2020
A message from Frank Vrancken Peeters, our CEO

We are shocked by events in the US. We stand united against racism and discrimination of any kind. 

Springer Nature Group
05 Jun 2020
Future-proofing research data – it’s a question of TRUST

Varsha Khodiyar discusses the TRUST principles for digital repositories & repositories key role in open research.

Springer Nature Group
08 Jun 2020
Research assessment: The continuing debate for balance

Alison Mitchell discusses metrics and research following Springer Nature's signing of DORA.

Springer Nature Group
19 May 2020
Laying the foundations for open access: from ambitious beginnings to the publishing mainstream

From ambitious beginnings to the publishing mainstream - BMC on 20 years of OA 

Springer Nature Group
13 May 2020
Opening doors to discovery of content and data with AI

Value in publishing

Why are partnerships an essential part of using technology to make content and data discoverable.

A
Advancing Discoveries
16 Apr 2020
Could better monitoring and tracking of funding accelerate the transition to open access?

Advancing discovery

White paper explores the fragmented and varied funding currently available for APCs.

Springer Nature Group
06 Apr 2020
Coronavirus pandemic: Nature’s pledge

Advancing discovery

London | 27th March 2020

Nature's pledge in the fight against COVID-19

Springer Nature Group
26 Mar 2020
Accelerating progress in support of the sustainable development goals

Advancing discovery

Springer Nature's third Responsible Business Report.

Springer Nature Group
26 Mar 2020
A message from Frank Vrancken Peeters

Advancing discovery

Springer Nature's CEO in response to the COVID-19 crisis

Springer Nature Group
19 Mar 2020
Of Mythical Beasts and Zero-Embargo Mandates

Advancing discovery

Dean Sanderson discusses Springer Nature's position on the rumored Executive Order.

O
Openaccess
28 Feb 2020
What is needed to drive the OA transition in 2020?

Advancing discovery

Susie Winter considers what needs to happen in 2020 to make the OA transition a reality.

R
Research Publishing
23 Jan 2020
Alternative conditions needed for cOAlition S’s Transformative Journal proposal to succeed

Springer Nature's response to latest consultation published by cOAlition S

R
Research Publishing
17 Dec 2019
Announcing a new diversity commitment for Springer Nature’s research publishing

Taking an active role in accelerating progress on equality, diversity & inclusion.

R
Research Publishing
11 Dec 2019
 Making Open Data a central part of Open Research:  Steps publishers can and should take today

Open data

Attitudes to data sharing are changing, but clear gaps in how researchers are being supported remain. What steps can publishers take today? Grace Baynes explores.

R
Research Publishing
11 Nov 2019
Why being 'open' matters

Advancing discovery

Why does open access matter? What is it enabling us as a community to do? How does it support the wider goal of open research? Steven Inchcoombe reflects.

R
Research Publishing
24 Oct 2019
Think global, act global

This Global Goals Week we at Springer Nature are asking ourselves what we can do to help bring people together and to join the dots between research and the solutions we need to build a better, more sustainable world.

Springer Nature Group
26 Sep 2019
Celebrating the Chinese contribution to the world’s sustainable development research

With the fastest-growing scientific and scholarly research, China’s importance for sustainable development is increasingly clear.

R
Research Publishing
28 Aug 2019
Transformative deals substantially aid the transition to OA. Let’s give them the time they need to do so.

Last month, Springer Nature agreed a new transformative ‘read and publish’ deal with the Norwegian library consortium, Unit.  This, coupled with renewals of existing deals in the UK (Jisc), Sweden (Bibsam) and Qatar, takes the number of such deals we have into double figures, the most of any publisher.  These deals enable researchers in these ten countries to publish open access in over 1900 Springer journals as well as read the research of others across this portfolio.

O
Openaccess
02 Aug 2019
The future of open access books

Open access book publishing has been growing in recent years. The Directory of Open Access Books (DOAB) lists 2,099 open access books published in 2018, an increase of 38% from 2017. Funders are also starting to engage with open access for books: a small number of European funders now mandate open access for books and provide financial support for open access book publication. COAlition S has also indicated that they support transitioning monographs to open access, and will provide guidance by the end of 2021.

O
Openaccess
18 Jun 2019
Maximising the benefits of early sharing

At Springer Nature making great research available as quickly as possible is a central part of our commitment to the research community. 

Springer Nature Group
23 May 2019
A faster path to an open future

At Springer Nature we want to find the fastest and most effective route to immediate open access (OA) for all primary research.

Springer Nature Group
08 May 2019
A postcard from Davos: what role for research at this gathering of global opinion leaders?

My first impressions of Davos? Dazzling, overwhelming, unexpected, thought-provoking, incredibly busy and much, much more…

R
Research Publishing
04 Apr 2019
Businesses must play a role in sustainable development

Today Springer Nature launches its Responsible Business report for 2018.

Springer Nature Group
27 Mar 2019
Setting targets at Springer Nature to help create a better balance

The theme of this year’s IWD couldn’t be more relevant to us. Last month, Springer Nature’s management board announced to our 13,000 colleagues that we will set a target to improve gender representation in our leadership group.

Springer Nature Group
07 Mar 2019
Congratulations to Karen Keskulla Uhlenbeck

It’s a great pleasure for us at Springer Nature to congratulate Karen Keskulla Uhlenbeck for the award of this year’s Abel Prize.

Springer Nature Group
03 Mar 2019
Without you, we are nothing: why community engagement is at the core of everything we do

Sometimes there is great value in stating the obvious; the scholarly publishing industry would not exist without a broad international community of researchers, students, librarians, funders, and commercial partners.

R
Research Publishing
06 Mar 2019
How Can We Accelerate Data Sharing?

What steps can publishers, funders and institutions take to make data sharing worth a researcher’s time and energy, and accelerate progress? 

R
Research Publishing
10 Mar 2019
Connecting curious minds to advance learning and discovery

Science

Springer Nature will stay curious, connect ideas, question how things are done, explore new ways to deliver for our communities and then make the changes that matter.

R
Research Publishing
20 Feb 2019
Need to focus on demand as well as supply: making Plan S work for all

Steven Inchcoombe discusses Springer Nature's submission to the cOAlition of participants to make Plan S work for all.

R
Research Publishing
11 Feb 2019
The quest for more value: A Long Read

Research News

Daniel Ropers shares some of his early observations about the academic publishing industry.

R
Research Publishing
01 Nov 2018
Publication misconduct: changing the conversation

Suzanne Farley discusses how to increase prevention and detection of research and publication misconduct. 

R
Research Publishing
04 Nov 2018
Lessons learned from open peer review: a publisher’s perspective

Research News

Rachel Burley discusses BMC's history in openness and transparency and what has been learnt.

R
Research Publishing
23 Dec 2017
Accelerating open access: what is missing from Plan S

Research News

The transition to open access needs to be sustainable for the whole research community.

R
Research Publishing
23 Dec 2017
Finding the science in social media

Research News

At Springer Nature we believe that social media is a vital tool for everyone involved in the academic research and publishing process. 

R
Research Publishing
23 Dec 2017
Hybrid journals can advance the move towards full open access

Blogs

Hybrid journals play an important role in the transition to open access.

R
Research Publishing
01 Aug 2018
Science benefits from diversity – and as publishers we have a role to play

As a progressive publisher, we have a responsibility to support diversity and inclusion.

R
Research Publishing
17 Jul 2018
What next for Impact Factors?

Why we need to work together to create metrics that better meet the needs of the research community.

R
Research Publishing
02 Jul 2018
Can research change the world?

Springer Nature believes that great multidisciplinary research needs to be informing global discussions.  

R
Research Publishing
28 Jun 2018
We need to do more to celebrate and support women in engineering

Women’s achievements in STEM fields need to be harnessed to raise awareness, create role models and foster a more inclusive culture. 

R
Research Publishing
21 Jun 2018
Future of the book all down to definition

Advancing discovery

The speed of recent change in the publishing industry in the past 10 years poses the question, what will book publishing look like in the future?

R
Research Publishing