Difference between revisions of "2.1.11 Preregistration"
(→B. Guidance & Expectations) |
(→C. Resources) |
||
| (13 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
== A. Background & Definitions == | == A. Background & Definitions == | ||
| − | Preregistration refers to a process of registration of study | + | Preregistration refers to a process of registration of study protocol and data analysis plan before conducting a study. |
| − | Registered Report is a maximal form of registration, in which study manuscript that includes the study hypothesis, rationale, methods, experimental | + | Registered Report is a maximal form of registration, in which study manuscript that includes the study hypothesis, rationale, methods, experimental protocol and a detailed analysis plan is peer reviewed (Stage 1) before study data is collected. After data collection, the final manuscript that includes results and discussion sections undergoes a conventional peer review (Stage 2) where adherence to the original (Stage 1) procedures is confirmed. Following favorable reviews and, regardless of study results, the manuscript is accepted for publication ([https://www.nature.com/articles/s41562-016-0021 Munafo et al. 2017], [https://openscience.bmj.com/pages/registered-reports-guidelines/ BMJ Open Science, Registered Reports Guidelines]). |
Benefits of preregistration: | Benefits of preregistration: | ||
| Line 14: | Line 14: | ||
** P-hacking (analytical decisions after the results are known) | ** P-hacking (analytical decisions after the results are known) | ||
** In case of a Registered Report, registration helps also against "CARKing" (unjustified critique of the article by reviewers after the results are known; Munafo et al. 2017). | ** In case of a Registered Report, registration helps also against "CARKing" (unjustified critique of the article by reviewers after the results are known; Munafo et al. 2017). | ||
| − | |||
== B. Guidance & Expectations == | == B. Guidance & Expectations == | ||
| Line 28: | Line 27: | ||
== C. Resources == | == C. Resources == | ||
Online registry platforms: | Online registry platforms: | ||
| − | * | + | * Specialized platforms |
| − | ** | + | ** [https://www.preclinicaltrials.eu Preclinicaltrials.eu] |
| − | ** | + | ** [https://www.animalstudyregistry.org Animal Study Registry] |
| − | * | + | ** [https://osf.io/rr OSF for Registered Reports] |
| − | * | + | ** [https://www.crd.york.ac.uk/prospero/#guidancenotes_animals PROSPERO, a platform for registering a systematic review of animal studies] |
| − | + | * Broad scope platforms | |
| − | * | + | ** [https://aspredicted.org AsPredicted] |
| − | + | ** [https://cos.io/prereg Center for Open Science] | |
| + | * [https://paasp.sharepoint.com/:b:/s/EQIPD/ERA-rz_pc3xDh_uYg0Q-B3cBuPRVFFsNwgQUQZ3Oz5qiRg?e=CXBnL2 Platform comparison] | ||
Publications: | Publications: | ||
| − | * Nosek BA, Ebersole CR, DeHaven AC et al. (2018) The preregistration revolution. Proc Natl Acad Sci U S A. 115:2600-2606. PubMed [https:// | + | * Nosek BA, Ebersole CR, DeHaven AC et al. (2018) The preregistration revolution. Proc Natl Acad Sci U S A. 115:2600-2606. PubMed [https://pubmed.ncbi.nlm.nih.gov/29531091/] |
* De Vries RBM, Hooijmans CR, Langendam MW, et al. (2015) A protocol format for the preparation, registration and publication of systematic reviews of animal intervention studies. Evid Based Preclin Med. 2:1–9. [https://onlinelibrary.wiley.com/doi/full/10.1002/ebm2.7] | * De Vries RBM, Hooijmans CR, Langendam MW, et al. (2015) A protocol format for the preparation, registration and publication of systematic reviews of animal intervention studies. Evid Based Preclin Med. 2:1–9. [https://onlinelibrary.wiley.com/doi/full/10.1002/ebm2.7] | ||
| − | * | + | * [https://osf.io/8v2n7/ Pre-registration and Registered Reports - A primer from the UK Reproducibility Network] |
| | ||
Latest revision as of 05:57, 6 October 2021
A. Background & Definitions
Preregistration refers to a process of registration of study protocol and data analysis plan before conducting a study.
Registered Report is a maximal form of registration, in which study manuscript that includes the study hypothesis, rationale, methods, experimental protocol and a detailed analysis plan is peer reviewed (Stage 1) before study data is collected. After data collection, the final manuscript that includes results and discussion sections undergoes a conventional peer review (Stage 2) where adherence to the original (Stage 1) procedures is confirmed. Following favorable reviews and, regardless of study results, the manuscript is accepted for publication (Munafo et al. 2017, BMJ Open Science, Registered Reports Guidelines).
Benefits of preregistration:
- Increases transparency
- Saves resources by avoiding unnecessary duplication of efforts
- Serves to reduce:
- The risk of publication bias
- "HARKing" (hypothesizing after the results are known)
- P-hacking (analytical decisions after the results are known)
- In case of a Registered Report, registration helps also against "CARKing" (unjustified critique of the article by reviewers after the results are known; Munafo et al. 2017).
B. Guidance & Expectations
- If study is done to inform a knowledge claim (2.1.4 Purpose of research), it is strongly recommended to preregister the study protocol before data are collected.
- It is strongly recommended to register systematic review protocols.
- Training on planning and benefits of preregistration is highly recommended.
PLEASE DO NOT FORGET
- To consider adding this subject to a training program for new employees or refresher training (if appropriate)
- To check for risks of disclosing confidential or otherwise sensitive or proprietary information (e.g. in the context of existing or emerging intellectual property)
C. Resources
Online registry platforms:
- Specialized platforms
- Broad scope platforms
- Platform comparison
Publications:
- Nosek BA, Ebersole CR, DeHaven AC et al. (2018) The preregistration revolution. Proc Natl Acad Sci U S A. 115:2600-2606. PubMed [1]
- De Vries RBM, Hooijmans CR, Langendam MW, et al. (2015) A protocol format for the preparation, registration and publication of systematic reviews of animal intervention studies. Evid Based Preclin Med. 2:1–9. [2]
- Pre-registration and Registered Reports - A primer from the UK Reproducibility Network
back to Toolbox
Next item: 2.2.1 Use of SOPs for standard experiments
