Research integrity audits - the routine check-up for journals

Author: Chris Graf and Will Coleman

Every year, millions of us take our vehicles for an annual check-up, and that check-up is far more than just a mechanic kicking the tyres and asking us whether we’ve heard any funny noises.  Not only do we not want to break down on a motorway, we want to catch problems early, before they turn into bigger issues (and bigger bills). That requires a comprehensive service that looks at all parts of the machine. And this applies whether we are talking about a racing bike that offers transport to a few, or a mighty double-decker bus that carries thousands every day.     

The same principle of taking a careful look at how things are running is true when it comes to research integrity and our journals.  Last year we established our Assurance team, an audit team within the Springer Nature Research Integrity Group (SN RIG) that reviews how research integrity-related policies and procedures are applied across journals.  SN RIG Assurance audits are independent from the teams being audited, they are modelled on methods used by SN Internal Audit team, and they're designed to provide a strong layer of accountability.  Our audits benchmark against internal policies and industry standards such as COPE.  They assess the submission to publication process, including editorial and collection management, and aim to reduce research integrity risks, identify areas for improvement and share best practice.      

Case Study: Cureus Journal of Medical Science

One of Assurance’s first projects was a four-month audit of the Cureus Journal of Medical Science (Cureus JMS). Springer Nature acquired Cureus in late 2022, recognising its potential to expand open access, peer-reviewed research, in particular clinical case reports, and support improved health outcomes globally. Cureus JMS follows a unique publishing model that helps researchers from underserved communities to publish their findings rapidly in a freely accessible format and allows approved institutions to showcase research through Academic Channels that are fully overseen by Cureus JMS’ independent editors.

As a relatively recent acquisition, we decided that it would be a good place to begin our work. The audit reviewed a representative sample of published Cureus JMS articles from 2023 to 2024, including both Academic Channel and non-Channel content. We examined submission processes, peer review management, editorial oversight and channel management to identify gaps and opportunities for improvement. To ensure that our work was reliable and accurately represented the journal, we used a sample size large enough to provide 95% confidence in our findings, giving us strong evidence to guide recommendations. In agreement with Cureus JMS, we then undertook an audit of an even larger sample to provide us with an 99.9% confidence in our findings, which supported the same findings and recommendations.

Findings and improvements: From Tune-up to Upgrade

The audit confirmed that Cureus JMS operates with robust controls and effectively safeguards research integrity in the vast majority of cases. These controls include: 

• rigorous single-blind peer review by at least two independent reviewers 
• strong editorial oversight throughout the publishing process 
• established systems that effectively mitigate research integrity risks.

However, much like a mechanic's full service, we identified opportunities to fine-tune performace, and Cureus JMS was receptive to our recommendations. 

Clarifying Processes and Strengthening Transparency

The audit highlighted opportunities to make Cureus JMS’ processes clearer for authors, reviewers, and Channel staff—particularly around declarations for ethics, informed consent, and conflict of interest disclosures. While authors were prompted to submit declarations during the submission process, we occasionally found them to be incorrect or missing. Cureus JMS acted quickly by refining author guidelines, improving submission workflows to capture accurate disclosures, and strengthening training for editors and Academic Channel teams.

Addressing Misconceptions

One important finding was that some terminology used by Cureus JMS - in relation to Academic Channels ‘article adviser’ roles - could lead to misconceptions about rigour and bias. Channel processes were found to be robust and, to remove any ambiguity, Cureus JMS publicly clarified:

• Channel operations:  Each submission is managed by an independent Cureus JMS editor, who oversees peer review using vetted reviewers. Safeguards are in place to prevent Channel members from accessing manuscripts and influencing decisions.
• Channel roles: Channel Admins manage the channel homepage. Curators, who are specialists in their field, perform an initial screening for scope, language, and formatting before manuscripts enter formal peer review.
• Adviser roles: Authors can invite peers for feedback while their manuscript undergoes independent peer review. This advisory input is separate from the formal peer review process, which remains managed by Cureus JMS editors and conducted by vetted reviewers.

These refinements, alongside enhanced training, reinforce Cureus JMS’ strong foundation and commitment to transparency.

Strengthening Channel Governance

Academic Channels allow institutions to showcase research with added visibility. All content published through Channels undergoes independent peer review managed by Cureus JMS editors, who retain final publication decisions.

Assurance recommended additional vetting for institutions and Channel staff prior to participation, and committing these checks to written guidance documents, so that vetting would be consistently accurate. Cureus JMS acted promptly and created internal guidance that includes up-to-date integrity checks. Today, all institutions and Channel staff are verified against integrity checks, and Cureus JMS maintains oversight of Channel conduct and content.

Looking Ahead

Research integrity is not a one-time effort — it’s a continuous journey. Like regular check-ups keep vehicles safe, audits help journals run smoothly and reliably. By working collaboratively and transparently, we help journals like Cureus JMS strengthen their processes and continue to uphold high standards. This reflects Springer Nature’s broader approach: investing in technology and expert teams, harnessing new AI and other tools, and continually evolving. At the heart of this is a focus on building and maintaining trust—through openness and working together.

Learn more about our research integrity work here.