Difference between revisions of "2.1.11 Preregistration"

From EQIPD
Jump to: navigation, search
(B. Guidance & Expectations)
(C. Resources)
 
(13 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
== ​​​​A. Background & Definitions ==
 
== ​​​​A. Background & Definitions ==
 
   
 
   
Preregistration ​​refers to a process of registration of study plan and data analysis plan before conducting a study.  
+
Preregistration ​​refers to a process of registration of study protocol and data analysis plan before conducting a study.  
  
Registered Report is a maximal form of registration, in which study manuscript that includes the study hypothesis, ration­ale, methods, experimental plan and a detailed analysis plan is peer reviewed (Stage 1) before study data is collected. After data collection, the final manuscript that includes results and discussion sections undergoes a conventional peer review  (Stage 2) where adherence to the original (Stage 1) procedures is confirmed. Following favorable reviews and, regardless of study results, the manuscript is accepted for publication ([https://www.nature.com/articles/s41562-016-0021 Munafo et al. 2017]​, [https://openscience.bmj.com/pages/registered-reports-guidelines/ BMJ Open Science, Registered Reports Guidelines]​).
+
Registered Report is a maximal form of registration, in which study manuscript that includes the study hypothesis, ration­ale, methods, experimental protocol and a detailed analysis plan is peer reviewed (Stage 1) before study data is collected. After data collection, the final manuscript that includes results and discussion sections undergoes a conventional peer review  (Stage 2) where adherence to the original (Stage 1) procedures is confirmed. Following favorable reviews and, regardless of study results, the manuscript is accepted for publication ([https://www.nature.com/articles/s41562-016-0021 Munafo et al. 2017]​, [https://openscience.bmj.com/pages/registered-reports-guidelines/ BMJ Open Science, Registered Reports Guidelines]​).
  
 
Benefits of preregistration:
 
Benefits of preregistration:
Line 14: Line 14:
 
** P-hacking (analytical decisions after the results are known)
 
** P-hacking (analytical decisions after the results are known)
 
** In case of a Registered Report, registration helps also against "CARKing" (unjustified critique of the article by reviewers after the results are known; Munafo et al. 2017​).
 
** In case of a Registered Report, registration helps also against "CARKing" (unjustified critique of the article by reviewers after the results are known; Munafo et al. 2017​).
 
  
 
== B. Guidance & Expectations ==
 
== B. Guidance & Expectations ==
Line 28: Line 27:
 
== C. Resources ==
 
== C. Resources ==
 
Online registry platforms:  ​
 
Online registry platforms:  ​
* Animal Study registries
+
* Specialized platforms
** Preclinicaltrials.eu - [https://www.preclinicaltrials.eu/]
+
** [https://www.preclinicaltrials.eu Preclinicaltrials.eu]
** Animal Study Registry - [https://www.animalstudyregistry.org]   
+
** [https://www.animalstudyregistry.org Animal Study Registry]   
* Center for Open Science ​- [​https://cos.io/prereg/​​]
+
** [https://osf.io/rr OSF for Reg​​​istere​​d Reports]
* AsPredicted - [https://aspredicted.org/]
+
** [https://www.crd.york.ac.uk/prospero/#guidancenotes_animals​ PROSPERO, a platform for reg​​istering a systema​tic​ review of animal studies​]
* PROSPERO, a platform for reg​​istering a systema​tic​ review of animal studies​ - [https://www.crd.york.ac.uk/prospero/#guidancenotes_animals​]
+
* Broad scope platforms
* OSF for Reg​​​istere​​d Reports​ - [https://osf.io/rr/]
+
** [https://aspredicted.org AsPredicted]
 
+
** [https://cos.io/prereg Center for Open Science]
 +
* [https://paasp.sharepoint.com/:b:/s/EQIPD/ERA-rz_pc3xDh_uYg0Q-B3cBuPRVFFsNwgQUQZ3Oz5qiRg?e=CXBnL2 Platform comparison]
 
Publications:
 
Publications:
* Nosek BA, Ebersole CR​​, DeHaven AC et al. (2018) The preregistr​ation revolution. Proc Natl Acad Sci U S A. 115:2600-2606. PubMed [https://www.ncbi.nlm.nih.gov/pubmed/?term=the+preregistr%E2%80%8Bation+revolution+and+Nosek]
+
* Nosek BA, Ebersole CR​​, DeHaven AC et al. (2018) The preregistr​ation revolution. Proc Natl Acad Sci U S A. 115:2600-2606. PubMed [https://pubmed.ncbi.nlm.nih.gov/29531091/]
 
* De V​​ries RBM, Hooijmans CR, Langendam MW, et al. (2015) A protocol format for the preparation, registration and publication of systematic reviews of animal intervention studies. Evid Based Preclin Med. 2:1–9. [https://onlinelibrary.wiley.com/doi/full/10.1002/ebm2.7]​
 
* De V​​ries RBM, Hooijmans CR, Langendam MW, et al. (2015) A protocol format for the preparation, registration and publication of systematic reviews of animal intervention studies. Evid Based Preclin Med. 2:1–9. [https://onlinelibrary.wiley.com/doi/full/10.1002/ebm2.7]​
* Chambers C (2014) Registered Reports: A change in scientific publishing
+
* [https://osf.io/8v2n7/ Pre-registration and Registered Reports - A primer from the UK Reproducibility Network]
  
 
​​​​
 
​​​​

Latest revision as of 05:57, 6 October 2021

​​​​A. Background & Definitions

Preregistration ​​refers to a process of registration of study protocol and data analysis plan before conducting a study.

Registered Report is a maximal form of registration, in which study manuscript that includes the study hypothesis, ration­ale, methods, experimental protocol and a detailed analysis plan is peer reviewed (Stage 1) before study data is collected. After data collection, the final manuscript that includes results and discussion sections undergoes a conventional peer review (Stage 2) where adherence to the original (Stage 1) procedures is confirmed. Following favorable reviews and, regardless of study results, the manuscript is accepted for publication (Munafo et al. 2017​, BMJ Open Science, Registered Reports Guidelines​).

Benefits of preregistration:

  • Increases transparency
  • Saves resources by avoiding unnecessary duplication of efforts
  • Serves to reduce:
    • The risk of publication bias
    • "HARKing" (hypothesizing after the results are known)
    • P-hacking (analytical decisions after the results are known)
    • In case of a Registered Report, registration helps also against "CARKing" (unjustified critique of the article by reviewers after the results are known; Munafo et al. 2017​).

B. Guidance & Expectations

  • ​If study is done to inform a knowledge claim (2.1.4 Purpose of research​), it is strongly recommended to preregister the study protocol before data are collected.
  • It is strongly recommended to register systematic review protocols.
  • Training on planning and benefits of preregistration is highly recommended.


​PL​​EASE DO NOT FORGET

  • ​​To consider adding this subject to a training program for new employees or refresher training (if appropriate)​
  • To check for risks of disclosing confidential or otherwise sensitive or proprietary information (e.g. in the context of existing or emerging intellectual property)​​

C. Resources

Online registry platforms: ​

Publications:

​​​​


back to Toolbox

Next item: 2.2.1 Use of SOPs for standard experiments