2.1.5 Pre-specification
A. Background & Definitions
Pre-specification is a protective measure against so called "rationalization" („making excuses“), a defense mechanism in which controversial or questionable behaviors or feelings are justified and explained in a seemingly rational or logical manner to avoid the true explanation, and are made consciously tolerable - or even admirable and superior - by plausible means (e.g. "I didn't get the job that I applied for, but I really didn't want it in the first place").
An example of a situation when rationalization mechanisms can get engaged:
- You are running an experiment and there is a sudden noise, vibration or some other factor
- You get angry but cannot do anything other than recording in your lab journal that such event occurred at this particular time point
- When analyzing the data, you notice that one of the subjects / data points behaves strange and it is exactly when that disturbing interference occurred
- If including or excluding this subject or data point makes the results appear differently, what do you do?
Pre-specification aims to protect scientists from giving a wrong answer to the question above and, thereby, supports generation of unbiased results.
Pre-specification is mechanistically similar to precommitment or self-binding when we make the decision before being in the tempting situation (e.g. take a limited amount of money with you to curtail spending; have only healthy foods at home to avoid the temptation to go astray).
Thus, pre-specification is about a strategy that we may use to restrict the number of choices available to us at a future time.
B. Guidance & Expectations
EQIPD advises to pre-specify key study and analysis details irrespective of the purpose of research.
For knowledge-claiming research (2.1.4 Purpose of research), pre-specification is mandatory and should cover all key study and analysis details as well as the key decisions, e.g.:
- study hypothesis
- data analysis plan (including statistical methods to be applied)
- inclusion and exclusion criteria (including criteria for "outliers")
- primary outcome measure
- if applicable, interpretation of the study results dependent on performance of the control groups or treatments (e.g. is the study declared "failed study" if a positive control fails)
- if applicable, decisions to be made if the primary outcome is met or not met
It is recommended that pre-specification is documented by the same scientist who prepares and documents the 2.1.1 Study (experimental) plan.
Pre-specification requires no special training and can be completed as a free-text summarizing the study and analysis details that are to be pre-specified.
Information about pre-specified study design and analysis details should be saved in a manner that:
- identifies the author and time of creation
- is protected against deletion and unauthorized modification
- is retrievable and readable
The most optimal way of performing pre-specification is by storing pre-specified information in a laboratory notebook (e.g. electronic) as part of a 2.1.1 Study (experimental) plan.
Pre-specification may also be conducted by means of 2.1.11 Preregistration of the study plans.
Any amendments to pre-specified study design and analysis details should be properly documented (dated, signed, etc.).
PLEASE DO NOT FORGET
To check whether the means chosen for pre-specification ensure safe and secure storage of pre-specified information To consider adding this subject to an awarenss training program for new employees or refresher training
C. Resources
Precommitment (Wikipedia article) [1]
back to Toolbox
Next item: 2.1.6 Sample size and power analysis
