Should I publish negative results, or does this ruin my career?

Scientists often produce negative results. All experiments were done correctly – but there was no difference between test and control. They get conflicting advice from supervisors and ethicists. Some say that publishing negative results is a waste of resources and ruins their scientific careers. Others say that ‘not publishing negative results is unethical’ and promotes the reproducibility crisis. What should young scientists do in such a situation?

Negative results are frustrating and demotivating

In my experience as a supervisor, the biggest problem with negative findings is the demotivating effect on young scientists.

During a typical PhD or postdoc project, most early-stage researchers experience an emotional dip and a lot of stress after approximately two years.  

This is half the duration of a standard PhD or postdoc contract. It is a recurring pattern. I have seen it often.

The stress worsens substantially when the students are ambitious and work particularly hard to accomplish a great project but do not obtain statistically significant results.

Stopping a long-term project may hurt and/or relieve

Suppose a costly project does not deliver promising results. In that case, the supervisor may conclude that the project has to be abandoned without publishing the data and alter the research plans accordingly.

Such a decision will often push you into a vortex of dramatic feelings. You may perceive yourself as a failure and feel mistreated.

In addition, you are probably worried about your future. On the other hand, it may also relieve you because you may have felt for a long time that your project is going nowhere.

These mixed feelings do not make the situation easier. The supervisor is responsible for developing a new project and emotionally supporting you in this challenging situation.

“Publishing negative results is a waste of resources”

Many scientists believe that following up on and publishing negative results wastes resources of their research teams.

Indeed, this statement has some truth because the costs and research effort in a particular study may be high compared to the final output parameters (such as the impact factor of the journal, citations, etc.).

Negative results are often published with a low impact factor because editors hate boring data

Publishing is a big business – in particular, open-access publishing. 

Editors play a pivotal role in the perception of the value of negative results. To increase the visibility of their journals, editors want the exciting stuff: new mechanisms, unexpected findings, and dramatic effects (“the paralyzed could walk again”), which increase citations, clicks, shares, and press coverage.

Unfortunately, negative results are often very boring. As a result, it is often difficult to publish negative results in an appropriate journal.

After several rejections, your paper may end up in a journal with a much lower impact factor than expected at the beginning of the experiments.

As a result, many scientists consider negative studies less prestigious.

Several peer-reviewed journals specifically focus on negative findings (see below). Unsurprisingly, their impact factors and citation scores are rather low.

You might falsely hope that open-access (OA) platforms or OA journals might be more open to well-performed studies with negative results. In my experience, the editors of OA journals are as selective with negative studies as all the other scientific journals.

Unexpected negative data can be fascinating – but are often costly

High-impact journals may be interested in negative studies when they destroy a long-held paradigm or when a new method is used to show that most previous studies are flawed.

Following up on a negative story is always considered a risk because the research group may invest substantial resources (time, money, energy) without improving the quality of the paper and the final impact factor.

Reviewers may ask for multiple additional controls to ensure that the negative results are not just an effect of technical mistakes. Therefore, the opportunity costs are high (“Doing this study means you are not following up on potentially more promising data”).

“Publishing negative results ruins your career in science”

Many supervisors are convinced that publishing negative results will ruin the career of their PhD students as well as their own. They worry about spending a lot of resources on the wrong project, publishing with a low impact factor, and consequently getting less future funding.

Young scientists may feel that investing in a negative study will dramatically reduce their chances in the academic job market and may even force them to give up and pursue a different career.

You may correctly argue that high-impact factor publications are not absolutely necessary to pursue a successful career in science or become a professor. You might correctly doubt that high impact factors are necessary to increase your chance of getting a good job in the industry or public sector.

However, impact factors are still broadly used to evaluate the performance of single scientists, departments, and institutions.

Read more here: 

10 simple strategies to increase the impact factor of your publication

Which bibliometric data are relevant for a research career?

Thus, a responsible supervisor will always aim for journals with a high impact factor and tend to abandon projects without exciting results. Unfortunately, this behavior – as understandable as it is – may be one of the biggest problems in science.

“Not publishing negative results is unethical”

Many colleagues do not find abandoning projects without promising results a big deal.

“Fail faster” is a common strategy that means screening for dramatic effects (for example, a treatment, a drug, a genetic intervention) and leaving the less dramatic results untouched.

Why is it important that scientists publish their results?

The big problem is that this knowledge is lost because all these experiments disappear, and many other scientists may repeat the same or a similar experiment because these results are not documented or publicly available.

In these instances, accessing research data from similar experiments that were never published could save a lot of time and financial resources.

The scientific literature is awash with positive findings, which naturally paints a skewed perspective on the existing scientific knowledge. The publication of null results or negative data would add much-needed balance and also provide valuable information for systematic reviews.

As a consequence, a lot of time, effort, and taxpayer money is wasted due to unnecessary repetitions because negative or less-than-dramatic findings are unreported.

If you care for scientific progress, publication of results – and specifically publication of negative results – is a must. Negative studies may challenge existing paradigms and enhance progress by stopping further investment in scientifically barren topics, decreasing animal use in experiments, and focusing research in more fruitful areas (Boorman et al., 2015).

Publication bias and the reproducibility crisis

More than 70% of researchers in Nature’s 2016 survey of 1 576 researchers have tried and failed to reproduce another scientist’s experiments (Baker et al., 2016). This so-called reproducibility crisis has many reasons (see reviews in Jarvis & Williams, 2016; Ellis et al, 2022;  Calnan et al, 2024).

One important reason for the lack of reproducibility problems is positive-results bias, a particular form of publication bias. Positive-results bias is just a fancy term for the tendency described above: when authors are more likely to submit, or editors to accept, positive results than negative or inconclusive results (Sacket et al., 1979). 

Briefly, publishing positive results only and filing away the negative findings produces a skewed view of reality, results in unnecessary repeats of experiments already done, and wastes a lot of taxpayer and industry money. It may lead to detrimental therapies and many frustrated scientists, among other unwanted outcomes. 

Reproducibility issues may even contribute to a growing skepticism regarding the integrity and relevance of all biomedical research (Jarvis & Williams, 2016; Ellis et al, 2022).

It is not the task of young scientists to publish negative results.

After many years of struggling with this question, I came to the conclusion that it is *not* the task of young scientists to publish negative research outcomes – in the current system.

They still have to pursue their career, and – as explained above – publishing negative results may negatively affect their careers.

Controversial advice: Leave it to the old guys!

The arguments listed above bring every scientist to a problematic situation.

Young scientists seem to have to choose between their careers and ethical behavior. Supervisors of research groups must give good advice; otherwise, they leave the young scientists alone to make their own decisions.

However, there are no widely accepted and widely known procedures to handle negative outcomes that are not used for publication (see some suggestions below). Therefore, currently, the best advice is:

Do not publish negative results as a young scientist.

Leave it to the senior scientists who already have successful careers and can afford to publish negative findings for the sake of good science!

It is essential to note that I do *not* suggest selective reporting.

Selective reporting is a special case of reporting bias, resulting in the incomplete publication of analyses performed in a study, leading to the over- or underestimation of treatment effects or harms.

Selective reporting is scientific misconduct. In contrast, I advise young scientists not to waste their time, grant money, and energy on studies with negative results.

In the meantime, let us work on better procedures and rules to avoid “scientific waste” and substantially reduce unnecessary repeats of the same unpublished experiments.

How do you behave ethically and handle negative results correctly?

My advice to leave the publication of negative results to the senior scientists (who already have a successful career) comes with a price. We accept the publication bias for the sake of young scientist’s careers. This promotes the reproducibility crisis.

Senior scientists cannot be trusted to take over their responsibility to publish negative results because they are not rewarded for it. 

Even worse, they may get punished by their institutions and funding agencies, which are strongly focused on scientific output, mostly quantified in impact factors, citations, and grant money.

In other words,  the academic community gets what it incentivizes. There are many ideas to improve the current science system (for example, Begley & Ioannidis, 2015; Ellis et al, 2022), but most initiatives are still at an embryonic stage.

To my knowledge, there are no internationally accepted rules on handling negative results. A non-representative survey among 10 young professors revealed that only one had a rough idea of where to store unpublished data that may interest other scientists. Below, you will find three suggestions on how to handle the problem of negative results at the level of the scientific community:

Three strategies to improve science

The scientific community, led by international organizations like the World Health Organization and the International Committee of Medical Journal Editors, scientific societies, and national institutes of health, should emphasize the importance of negative results in fostering actual scientific progress.

There should be international guidelines for publishing negative results, emphasizing their value and importance in scientific research.

Here are three strategies to improve the current practice in the near future:

1. Registration of all studies *before* they start

Registration of clinical trials is a widely recognized tool for facilitating complete public reporting (Zarin & Tse, 2008, Williams et al, 2010, Ellis et al, 2022) and to counter the conflicts of interests, for example, of pharmaceutical companies. 

Registration of any type of study (pre-clinical, observational, etc.) would dramatically increase the administrative load for researchers, institutions, and funders. However, it seems to be a necessary step to cure the entire research community of positive-results bias.

For clinical trials, there is a list of international registries in the Cochrane handbook. Some of these registries already allow the registration of non-clinical studies (observational, pre-clinical, etc.). 

For social sciences and other types of research, the Open Science Framework (https://osf.io) offers the possibility to pre-register studies.

2. Saving inconclusive data in publicly accessible repositories to make them available to other scientists

Since publishing inconclusive data may be tedious and considered “a waste of resources” (see above), it should be effortless and a standard procedure to save the data in publicly accessible repositories. 

To guarantee independence, the international scientific community should finance these through scientific societies and/or national and international funders.

Some repositories already exist – see here a list of repositories on the Nature website.

Another example is arxiv.org,  a repository for documents and papers rather than data, including unaccepted or unsubmitted manuscripts, PowerPoint presentations, etc. Unfortunately, repositories are often costly, and researchers are not incentivized to use them.

3. Funders must oblige scientists to pre-register their studies and to make all data available (for example, in a publicly accessible repository or a journal of the funder)

Finally, funders should take responsibility for providing a standardized procedure to pre-register all funded studies and oblige the researchers to publish all their negative findings or deposit them in a public repository. Some funders have already started their own academic journals to publish these negative findings.

A possible incentive may be to freeze the last tranche of the funds (e.g., 25%) until data are made publicly available. Without a doubt, there must be very flexible regulations because some studies are published many years after the funding period has finished.

Final advice on handling negative findings

The final advice is simple:

As a young researcher:

• Do *not* publish negative results. Leave it to the senior scientists!

As a senior scientist:

• Take responsibility and publish negative findings for the sake of science, even with a lower impact factor, but do not force the young scientists to do this.

All scientists:

• Make negative findings known in reviews (which can be published with a high impact factor) and scientific talks.
• Push your institution, your scientific society, and/or your funders to provide a public repository for negative results and to make it easy to make negative results publicly available without the hassle of a full publication.
• Save your negative results or inconclusive data in a public repository to make them available.
• Help to improve the system to incentivize the publication of negative findings and replication studies – for example, talk to funders or higher education and health politicians – many listen to scientists to improve the current procedures.

Please comment below if you have any other ideas to improve the current system.

How to publish negative results

There is no magic bullet. In my personal opinion, you have to find a journal with the best fitting scope and target audience for your study. You have to convince the editor that the journal’s readers will profit from learning about these negative results. During the review process, you have to convince the editor and the reviewers that this article will prevent other scientists from perfoming useless experiments.

Are there journals that specifically publish negative research results?

Yes, some of the most notable journals that publish negative research results include:

• Journal of Negative Results – Ecology and Evolutionary Biology
• Journal of Pharmaceutical Negative Results 
• Positively Negative – a section of PLOS One specifically designed for studies with negative results that are still of high quality and significantly contribute to the field.
• The Missing Pieces: A Collection of Negative; Null and Inconclusive Results – a section of PLOS One that is a broader collection of negative, null, and inconclusive results. The section accepts studies that do not meet the criteria for Positively Negative, but which still have the potential to be informative and valuable to the scientific community.
• Journal of Articles in Support of the Null Hypothesis
• The All Results Journalsfocuses on recovering and publishing negative results and valuable information in chemistry, nanotechnology, biology, or physics.
• ACS Omega (ACS Publications)
• F1000Research
• Journal of Negative Results in Biomedicine– The journal was established in 2002 and ceased publishing in September 2017.

Acknowledgments

Thanks to Noémie Aubert Bonn, who provided the information about registries and repositories and helpful comments. I have used AI systems, including Grammarly, Google Bard, and ChatGPT, to enhance the English and comprehensiveness of this article. This post may contain affiliate links, meaning I get a small commission if you decide to purchase through my link. Thus, you support smartsciencecareer at no cost to you!

Recommended reading

The following articles may also interest you:

• The emotional phases of your research project and PhD and postdoc stress
• 28 Tips to Get More Citations for Your Publications
• 10 simple strategies to increase the impact factor of your publication
• Should I aim for multiple co-authorships to extend my publication list?
• Should I aim for co-authorships on high-impact papers?
• Corresponding author versus senior author – what is the difference?
• What is a substantial contribution to a paper?
• How To Write Faster: 19 Efficient Ways To Finish My Publication
• Should I have senior authorships as a postdoc?
• What is the best publication strategy in science?
• Should I quit my postdoc?
• How long does it take to complete a doctorate?