The Selfish Reasons for Practicing Open Research

Lenny Teytelman

Published: 2023-01-28 DOI: 10.17504/protocols.io.e6nvwj8w9lmk/v1

Abstract

Champions and practitioners of open research and FAIR data practices are realizing significant benefits to their research along with the impactful bonus of making the whole research enterprise better for everyone. In addition to the ethical and moral reasons for adopting these best practices, data and results show that scientists who work in an open science framework will have increased productivity, more credit and recognition and longer scientific longevity to their work.

This is based on my talk at the Singapore Open Research Conference, hosted by Nanyang Technological University. The Google slides from the talk are here, in addition to the steps below.

Please feel free to use and adapt! It's all about promoting openness and reuse!

If you and extend/edit this or have suggestions, please do share the ideas or link to your versions in comments here. Also, you can "fork" this entire document, and build on it, then publishing back into this same workspace.

(Image: UNESCO Recommendation on Open Science, CC BY-SA 3.0 IGO)

Steps

Introduction

1.

Cancer Bio Reproducibility Project

As part of the background on why we created protocols.io, we like to talk about the Cancer Biology Reproducibility Project, which was a $1.5 million dollar initiative coordinated by the Center for Open Science and by Science Exchange with the goal of trying to independently replicate almost 200 experiments from about 50 high-profile papers on cancer biology.

#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
https://lh3.googleusercontent.com/AD8ZfrRAsjZEV1nedOVp69HNpERYjpLFMG6QQmiWivXWUwwY8u3eO39BtsviUwYksTiXadscloK_9YA9Zlnk0H0qtyfE18UVAgoJnb3Fb13mKV3-tI8RC4x1G2I93tEZVnDTAnqzet_bXVhZHmpI394Hig=s2048
2.

Open Research sharing takes time

As much as open research is a public good, the truth is that sharing methods, data, code, and so on takes an effort. And time is one resource that all researchers lack. This is why it's important to highlight the many benefits of open science that apply directly to the research authors.

#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
https://lh3.googleusercontent.com/WolAgYpjz8FfZGdzpswX-Gho2kAkbXurzzTmQgbVgG42Hy3WJ1Al_rBo_rVojldXhaoyp7de_FTdSeISfi_PizDk1A2mqUMC0REL7dJEwm6rVtGNIA1uTgPmi6ZU2S4yd_c38vQX-ynYqHVUbhh6URgTwg=s2048

Figure from: LaFlamme, M., Harney, J., & Hrynaszkiewicz, I. (2022, October 14). A survey of researchers' methods sharing practices and priorities. https://doi.org/10.31222/osf.io/7jxav https://doi.org/10.31222/osf.io/7jxav

"It takes too long to prepare detailed methods information in a way that would be useful for others."

Preprints

3.

ASAPbio is a nonprofit promoting preprints. This superb graphic from them nicely captures the many helpful aspects of preprints ( link). link).

#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
https://lh6.googleusercontent.com/8lOh5Dt4aBEUp1SbFYO5OeePfhjjTIvZ7uVqGo91GFZzC7oR9mUoomRYr2XPonyvZyaUMMlr6LRU4ctNN4pF33XDrDRJPY9SE3pqOcqJU1fVUL0nqkbqncbb-oA6jWBkNdBhuPvJHgTIoVDiBz1gv7BjRQ=s2048
4.
#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
<iframe width="560" height="315" src="https://www.youtube.com/embed/Qx4-x_WvaIQ" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>
5.

Preprints boost article citations and mentions.

Nature Index Link

Darwin Y Fu, Jacob J Hughey (2019) Meta-Research: Releasing a preprint is associated with more attention and citations for the peer-reviewed article eLife 8:e52646

Nicholas Fraser, Fakhri Momeni, Philipp Mayr, Isabella Peters; The relationship between bioRxiv preprints, citations and altmetrics. Quantitative Science Studies 2020; 1 (2): 618–638.

#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
https://lh4.googleusercontent.com/WLm1v3xiFm0c5E7KlNjZmhKTNCEtfBx9lH0-HauRbKYUY63ahxv7l5vVchO5hGhGhrAP3uSPAXwPlBJv-skgt3c5qtLt0HPOt1uW22zg93UfPmqYbb7H7F-24U3hZzUPIgxEUrabTrzAdlZ08BGsWc2bDw=s2048

Reagent Repositories

6.

“Repositories like the ones recommended by PLOS handle the logistics of material requests, letting the scientists focus on what’s important: doing research.”

“Saves authors the time and burden of shipping requested materials.”

https://theplosblog.plos.org/2019/05/depositing-and-reporting-of-reagents-accelerating-open-and-reproducible-science/

7.
From: https://www.repro4everyone.org/
From: https://www.repro4everyone.org/
9.

(From Addgene, https://www.addgene.org/deposit/benefits/)

#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
https://lh5.googleusercontent.com/PlIx8oaGVM7WRqAlKioIvFhFWdq3ZVAR0HHQaSCo1m8p-jpxwPdgGrQmms3RNcOPNo5_OPpKNQRozDJKko0klfrq_Hvu0_1lgi_wJmSU3bhr5mJ63vJnb8F7Ab5OYmPFV-y3wc5NVpWzsxKkynaK2QIltA=s2048

Data

10.

As with preprinting, sharing data seems to increase citations of a given research article.

“We also find an association between articles that include statements that link to data in a repository and up to 25.36% (± 1.07%) higher citation impact on average, using a citation prediction model. “

Colavizza G, Hrynaszkiewicz I, Staden I, Whitaker K, McGillivray B (2020) The citation advantage of linking publications to research data. PLoS ONE 15(4): e0230416. https://doi.org/10.1371/journal.pone.0230416

---------------

“In a multivariate regression on 10,555 studies that created gene expression microarray data, we found that studies that made data available in a public repository received 9% (95% confidence interval: 5% to 13%) more citations than similar studies for which the data was not made available .”

Piwowar HA, Vision TJ. 2013. Data reuse and the open data citation advantage. PeerJ 1:e175 https://doi.org/10.7717/peerj.175

11.

In Sept. 2022, I was asked to share scripts from a 2007 analysis. Good thing I uploaded it to figshare; there’s no way I’d find the laptop from 2007. No cost, 10 seconds to find with Google.

https://figshare.com/articles/presentation/Impact_Factor_versus_Academic_Jobs/783894, https://figshare.com/articles/dataset/Detailed_documentation_and_scripts_for_FTL_analysis/783897
https://figshare.com/articles/presentation/Impact_Factor_versus_Academic_Jobs/783894, https://figshare.com/articles/dataset/Detailed_documentation_and_scripts_for_FTL_analysis/783897
12.

Repositories

Re3data.org - Re3data is a global registry of research data repositories

General repositories:

  • Figshare (free up to 20GB total)
  • Zenodo (free; 50GB per dataset)
  • OSF from the Center for Open Science (5GB private for free, 50GB for public)
https://about.zenodo.org/
https://about.zenodo.org/

Preregistration

13.
#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
https://lh4.googleusercontent.com/CzqYgB7JViaU46e6vbtW8cRIR1VJp8hRL9fK5lqX6Oeybui-MaZ_nMPaPjooJM4NxExMQjNNo1lR7YoQ3eJWkn9m-DtOr0UEkPoCsfUk8Qb_RddFngEJXOKgnoghVsw-ivxHDt-TP4GiSzw2WN-9AtiUNg=s2048
14.
15.
#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
https://lh3.googleusercontent.com/zFeqP06iP4axKp7Y06wkxVxAKVI-AZJdyH-zSissHYc2dkr2uoQa556fokOa24ZhAb5pgAWtAZNUXMWjdY1Dy7DULKj2ezgIlkYv_KgbC5rCYFq5OqjCKWNijcvce-fdHc_ApoYTebU1Ecv5BW7hdKiJsQ=s2048

Methods

16.

(You're reading this on protocols.io; of course we are going to mention methods!)

Public sharing on protocols.io is always open access, free to read and publish.

And a huge part of our goal is to increase the credit for and recognition of the work of method development.

17.

Your methods on protocols.io are more discoverable. In the example below, if the protocol was shared only as a supplement of the research paper, no way people outside that field would find it.

https://gigascience.biomedcentral.com/articles/10.1186/s13742-016-0128-3, https://twitter.com/aemonten/status/895798957569388544
https://gigascience.biomedcentral.com/articles/10.1186/s13742-016-0128-3, https://twitter.com/aemonten/status/895798957569388544
19.

protocols.io also has a partnership with PLOS ONE, helping to turn protocols into peer-reviewed publications.

https://plos.org/protocols/
https://plos.org/protocols/
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0251466, https://www.protocols.io/view/stone-tools-illustrations-with-vector-art-the-39-s-4r3l248j3g1y/v2
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0251466, https://www.protocols.io/view/stone-tools-illustrations-with-vector-art-the-39-s-4r3l248j3g1y/v2
20.

Publishing Protocols: Lab Protocols in PLOS ONE

`

Acknowledgements

21.

More and more funders now require preprints, open data, methods, code. Many mandating immediate Open Access. There is a major shift from governments and funders, and adopting open practices now strengthens your future position. https://en.unesco.org/science-sustainable-future/open-science/recommendation, https://www.nature.com/articles/d41586-022-00402-1

Importance of an early start

22.

For data, methods, code - planning early is key. If you think of sharing them only when submitting a paper, it’s a lot of extra work to share a good dataset at that point. But if you think of a Data Management Plan and make early plans and use tools like protocols.io and GitHub, then sharing the methods and code is super easy at the time of publication.

https://about.zenodo.org/
https://about.zenodo.org/
23.
#尊敬的用户,由于网络监管政策的限制,部分内容暂时无法在本网站直接浏览。我们已经为您准备了相关原始数据和链接,感谢您的理解与支持。
https://lh6.googleusercontent.com/EwsV8Zc4ddUA30nJ-2qXi0psIHFxCSYz2MFsuGHsxFLCZhfos8zuIlTzUxRiiyYL8FgVxKsL_6pmESyw6HA9hmT5X9_BJLHf4-1o5YSc9OMC7kt243e8swc-VrVZ2Y2KrH-S8pDzYWPbd0HdTsaReaErCA=s2048
24.

推荐阅读

Nature Protocols
Protocols IO
Current Protocols
扫码咨询