Difference between revisions of "1.4.3.3 Academia-academia: Research as service"

From EQIPD
Jump to: navigation, search
(Background)
 
(45 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
=Background=
 
=Background=
Recommendations outlined in this document has been developed by a task force of members and stakeholders of the EQIPD consortium, the largest private-public partnership completely dedicated to improving data quality in preclinical research.  
+
The recommendations outlined on this page have been developed by a working group of members and stakeholders of the EQIPD consortium.
These recommendations are intended to improve the robustness, reliability, traceability and integrity of the data obtained from the research activities supported by academic core facilities.  They aim to:  
+
improve communication between core facilities and the users of the services and infrastructure provided by the core facilities,  
+
These recommendations are intended to improve the robustness, reliability, traceability and integrity of the data obtained from the research activities supported by academic core facilities.   
minimize bias and errors in the collection, reporting or representation of such information, and
+
 
create reliable scientific and supporting evidence in resulting publications, presentations, reports, patents and other types of research output.  
+
Core facilities taking part in the EQIPD program share the recommendations below with users to:  
The experimental record and its thorough description is the ultimate source of information and documentation regarding the experiment.  Therefore, the contents of the experimental record must be accurate and thorough enough to be fully traceable to permit the reproduction of the work conducted. The experimental record is the official data record for each experiment and the most important primary source of data.  It is expected that the practices outlined in this document will be applied to experimental planning, record-keeping procedures and reporting, to the fullest extent possible.  
+
* clarify communication in respect to best practices,  
Recognizing the diversity of environments and settings in which core facilities operate, the current recommendations can be used in two modes - “Training service” and “EQIPD service”.  
+
* minimize bias and errors in the planning, collection and reporting of research data,  
 +
* create reliable scientific and supporting evidence in resulting publications, presentations, reports, patents and other types of research output.
 +
 
 +
The experimental record and its description is the ultimate source of information and documentation regarding the experiment.  Therefore, the contents of the experimental record must be accurate and thorough enough to be fully traceable to permit the reproduction of the work conducted. The experimental record is the official data record for each experiment and the most important primary source of data.  It is expected that the practices outlined in these recommendations will be applied to experimental planning, record-keeping procedures and reporting, to the fullest extent possible.
 +
 
 +
Recognizing the diversity of environments and settings in which core facilities operate, the current recommendations can be used in two modes - “Training service” and “EQIPD service”.
 +
 
 
It is expected that core facilities and their users discuss both types of services, any ambiguities or conflicts regarding the recommended practices, and ensure alignment and understanding prior to the start of the experiments.
 
It is expected that core facilities and their users discuss both types of services, any ambiguities or conflicts regarding the recommended practices, and ensure alignment and understanding prior to the start of the experiments.
  
===Training Service===
+
{| class="wikitable"
# Core Facility provides information about research practices recommended by EQIPD (items listed below) to the users.
+
|colspan="2" style="text-align: center;"|The core facility provides the recommendations to the users ('''Training Service''') and offers support in conducting EQIPD-compliant research ('''EQIPD Service'''). 
# It is up to the Core Facility to decide how this information is shared with the users (e.g., made part of a training program, shared as a written summary in paper or electronic form).
+
'''Users may chose whether they opt for the Training Service or would like to "upgrade" to the EQIPD Service'''
# Unless requested by the users or otherwise enabled by the locally applicable rules and regulations, Core Facility does not assume any further role in supporting or monitoring the implementation of recommended practices.
+
|-
 +
|style="text-align: center;"|'''Training Service'''
 +
|style="text-align: center;"|'''EQIPD Service''' 
 +
|-
 +
|style="width: 50%"|The Core Facility decides how information about research practices recommended by EQIPD is shared with the users (e.g., made part of a training program, shared as a written summary in paper or electronic form).
 +
 
 +
Unless requested by the users or otherwise enabled, the Core Facility does not assume any further role in supporting or monitoring the implementation of recommended practices for the user.
  
===EQIPD Service===
+
|style="width: 50%"|The Core Facility has implemented the EQIPD recommendations to enable support of EQIPD-compliant research to the user. 
# Core Facility implements those aspects of EQIPD recommendations that do not depend on the users and that enable support of EQIPD-compliant research (items with "CF" in Column B below).
 
# Core facility provides the users with the information about research practices recommended by EQIPD (items with "yes" in Column C below) and offers to support in conducting EQIPD-compliant research.
 
# If the user accepts the offer (and, as necessary, provides required resources), Core Facility:
 
## together with the user (""PI""), identifies the best solution to implement specific recommendations (items marked with ""shared"" in Column B below). Shared responsibility over implementation means ""joint decision, knowledge and transparency"" and may still require certain recommendations fully implemented at the Core Facility while others - fully implemented on the user's side.
 
## assumes responsibility over spot checks (requires acceptance by the PI if certain recommendations are implemented on the user's side)
 
## confirms to the user that the study was conducted as ""EQIPD compliant"" or not (e.g. to be stated in the report or in a publication)"
 
# If the user does not accept the offer, no changes in the routine practice and the studies remain to be not compliant with EQIPD recommendations.
 
  
=Glossary=
+
Together with the user (and supervisor/PI if necessary), the Core Facility identifies the best solutions to implement specific recommendations for the user's research.
The following items can be found in the [[Glossary]]:
 
* '''Must''' and '''should'''
 
* '''Experiment'''
 
* '''Study'''
 
** '''Study protocol'''
 
** '''Experimental procedure'''
 
* '''Experimental Record'''
 
* '''Raw data'''
 
* '''Processed data'''
 
* '''Data traceability'''
 
  
'''Reviewer''': An individual at your organization or outside who preferably did not perform the experiment but who may have been involved in the design of it as a supervisor or team member. The reviewer should check the experimental record for completeness and scientific rigor.
+
Core Facility assumes responsibility over spot checks (requires acceptance by the user if certain recommendations are implemented on the user's side).
  
 +
Core Facility confirms to the user that the study was conducted as "EQIPD compliant" or not (e.g. to be stated in the report or in a publication).
 +
|}
  
=Proposed statements=
+
=Recommendations=
 
==Training==
 
==Training==
 
* Users must be trained by CF members in order to be eligble to use CF
 
* Users must be trained by CF members in order to be eligble to use CF
Line 45: Line 42:
 
** Core facilities should play an educational role in proper planning of projects.
 
** Core facilities should play an educational role in proper planning of projects.
 
** CF member together with the PI and the user should perform risk assessment
 
** CF member together with the PI and the user should perform risk assessment
** the users should be instructed to record any erros and report them to CFH; the CFH should debrief it; the debrief record should be circulated to all other users in order to minimize the chances for recurrance
+
** the users should be instructed to record any erros and report them to head of the CF or any staff member; the CF personnel should debrief it; the debrief record should be circulated to all other users in order to minimize the chances for recurrance
 
** Users must take responsibility for the appropiate use of reagents, research subjects and equipment they bring into the CF
 
** Users must take responsibility for the appropiate use of reagents, research subjects and equipment they bring into the CF
 
** It is up to CF to define which form training should take (including frequency and documentation)
 
** It is up to CF to define which form training should take (including frequency and documentation)
  
 
==Experimental Record==
 
==Experimental Record==
* Unique study identifiers must be used and defined by the future owner of the raw data for each experiment.  Unless this is the CF, the owner of the raw data should communicate the unique study ID to the  CF. ** Best practices should be communicated by the CF during training or by providing a reference to EQIPD Toolbox (e.g. date_User inititals_experiment).
+
* [[2.1.2 Unique study ID|Unique study]] identifiers must be used and defined by the future owner of the raw data for each experiment.  Unless this is the CF, the owner of the [[2.3.1 Generation, recording, handling and archiving of raw data|raw data]] should communicate the unique study ID to the  CF.
 +
** Best practices should be communicated by the CF during training or by providing a reference to EQIPD Toolbox (e.g. date_User inititals_experiment).
 
** CF and PI may generate separate study IDs but there must be a way established to communicate, to connect separate IDs and to enable traceability.
 
** CF and PI may generate separate study IDs but there must be a way established to communicate, to connect separate IDs and to enable traceability.
 
** For EQIPD, it should be clear who is in charge of generating and storing the Unique Study Identifiers.
 
** For EQIPD, it should be clear who is in charge of generating and storing the Unique Study Identifiers.
 
** For complex studies that include more than one experiment, several experiments are typically part of one experimental record under one study ID.  
 
** For complex studies that include more than one experiment, several experiments are typically part of one experimental record under one study ID.  
 
** Unless known to CF, PI must communicate ethical approval to CF
 
** Unless known to CF, PI must communicate ethical approval to CF
** File naming: in order that each data is unique and retrievable we suggest that you adhere to the following file naming convention: [date YYMMDD]-[the first letter of your first name together with your last name]-[free text]. If your surname is long you may use only the first 6 letters of it. e.g. 201108-cpitzer-catwalk with mice zQ98
 
 
* Each experimental record should include, directly or by reference, the names of all scientists involved, objectives, ethical approval/number, procedures, methods, materials, equipment, dates, and any other details considered necessary for reproducibility and reconstruction.
 
* Each experimental record should include, directly or by reference, the names of all scientists involved, objectives, ethical approval/number, procedures, methods, materials, equipment, dates, and any other details considered necessary for reproducibility and reconstruction.
 
** CF can elaborate a form (excel sheet for instance) listing all the items that are required in an experimental record, and ask users to fill in this form. This could help the user to  keep tracking of his/her own detailed experimental record and is likely to increase the traceability of his/her data.
 
** CF can elaborate a form (excel sheet for instance) listing all the items that are required in an experimental record, and ask users to fill in this form. This could help the user to  keep tracking of his/her own detailed experimental record and is likely to increase the traceability of his/her data.
 
* All raw and any processed data must be retrievable and traceable, directly or by reference. No raw data should be erased.
 
* All raw and any processed data must be retrievable and traceable, directly or by reference. No raw data should be erased.
 
* An experimental record must describe any significant changes and deviations from the original study protocol.  
 
* An experimental record must describe any significant changes and deviations from the original study protocol.  
** User must report/document if study execution is not in accordance with study (experimental) plan and deviations such as changes to study hypothesis, design or analysis must be documented (including the rationale for the changes).
+
** User must report/document if study execution is not in accordance with study protocol and deviations such as changes to study hypothesis, design or analysis must be documented (including the rationale for the changes).
 
** Examples of significant changes: Changes in the doses, experimental conditions and groups, sample size, methods of analysis, etc.
 
** Examples of significant changes: Changes in the doses, experimental conditions and groups, sample size, methods of analysis, etc.
 
** Any change or deviation from a protocol approved by animal welfare authority would be significant and requires documentation in the experimental record.
 
** Any change or deviation from a protocol approved by animal welfare authority would be significant and requires documentation in the experimental record.
Line 70: Line 67:
 
==Rigor in Study Design==
 
==Rigor in Study Design==
 
* For every study, there should be a study protocol prepared prior to the study being conducted.
 
* For every study, there should be a study protocol prepared prior to the study being conducted.
** Please see a definition of the study plan above.
+
** Please see a definition of the study protocol above.
 
** Study protocols involving more than one experiment should include a dedicated section explaining the sequence and relationships between different experimental operations or procedures.
 
** Study protocols involving more than one experiment should include a dedicated section explaining the sequence and relationships between different experimental operations or procedures.
* The study protocol '''must''' include:
+
* The [[2.1.1 Study protocol|study protocol]] '''must''' include:
 
** Title
 
** Title
 
** Study hypothesis
 
** Study hypothesis
 
** Ethical approval number and the name of approving body (for research involving animals)
 
** Ethical approval number and the name of approving body (for research involving animals)
 
** Statement / information about controls (with choice justification if necessary)
 
** Statement / information about controls (with choice justification if necessary)
** Description of sample size calculation
+
** Description of [[2.1.6 Sample size and power analysis|sample size calculation]]
** Inclusion / exclusion criteria
+
** [[2.1.9 Inclusion and exclusion criteria|Inclusion / exclusion criteria]]
 
** Description of animal resources, reagents and materials (as applicable)
 
** Description of animal resources, reagents and materials (as applicable)
 
** Study design overview for complex studies
 
** Study design overview for complex studies
** Detailed description of experimental procedure(s) (or references to standalone descriptions if available)
+
** Detailed description of [[3.5.2 Protocols for methods and assays|experimental procedure(s)]] (or references to standalone descriptions if available)
* The plan '''should''' include:
+
* The protocol '''should''' include:
** Statement whether study is exploratory or knowledge-claiming
+
** Statement whether study is undertaken with the intention to inform a [https://eqipd-toolbox.paasp.net/wiki/2.1.4_Purpose_of_research#.E2.80.8BB._Guidance_.26_Expectations formal knowledge-claim]
 
** Statement about choice of experimental methods
 
** Statement about choice of experimental methods
** Detailed description of measures against risk of bias (randomization, blinding) (or references to standalone descriptions if available)
+
** Detailed description of measures against risk of bias ([[2.1.8 Randomisation|randomization]], [[2.1.7 Blinding|blinding]]) (or references to standalone descriptions if available)
** Description of raw data analysis
+
** Description of [[2.3.2 Primary analysis and evaluation of raw data|raw data analysis]]
 
** use versioning (or have a section for amendments)  
 
** use versioning (or have a section for amendments)  
 
* It is advisable to:
 
* It is advisable to:
** Include references to relevant literature
+
** Include [[2.1.3 Appraisal of literature and systematic reviews|references to relevant literature]]
** Conduct risk assessment
+
** Conduct [[4.1.1 Risk assessment|risk assessment]]
** Preregister the study protocol
+
** [[2.1.11 Preregistration|Preregister the study protocol]]
* Apply randomization and blinding. If not done or if not maintained throughout the experiment (from subject/sample allocation to analysis), include the reasons in the study protocol, the study report and any publication.
+
* Apply [[2.1.8 Randomisation|randomization]] and [[2.1.7 Blinding|blinding]]. If not done or if not maintained throughout the experiment (from subject/sample allocation to analysis), include the reasons in the study protocol, the study report and any publication.
** The CF will advise the User how to randomize / blind.  
+
** The CF will advise the User how to [[2.1.8 Randomisation|randomize]] / [[2.1.7 Blinding|blind]].  
 
** The user should implement.
 
** The user should implement.
 
** The CF will verify impementation.
 
** The CF will verify impementation.
* Justify sample size (e.g. using power analysis) and include the justification in the study protocol, the study report and any publication.
+
* Justify sample size (e.g. using [[2.1.6 Sample size and power analysis|power analysis]]) and include the justification in the [[2.1.1 Study protocol|study protocol]], the study report and any publication.
** User should perform samples size calculation and follow advice from CF staff.
+
** User should perform [[2.1.6 Sample size and power analysis|samples size calculation]] and follow advice from CF staff.
* Ensure inclusion / exclusion criteria and/or acceptance criteria are stated in the study protocol, the study report and any publication.
+
* Ensure [[2.1.9 Inclusion and exclusion criteria|inclusion / exclusion criteria]] and/or acceptance criteria are stated in the [[2.1.1 Study protocol|study protocol]], the study report and any publication.
  
 
==Analysis of Experimental Data==
 
==Analysis of Experimental Data==
* Experimental / data analysis record and study report (e.g. publication) should include sufficient detail to reconstruct any analysis performed and record all process steps and calculations used.
+
* Experimental / data analysis record and [[2.4.1 Non-public reporting|study report]] (e.g. [[2.4.2 Publication|publication]]) should include sufficient detail to reconstruct any analysis performed and record all process steps and calculations used.
 
** It is very important to define responsbility
 
** It is very important to define responsbility
 
** CF should be in the position/have the possibility to check this or run occasional audits
 
** CF should be in the position/have the possibility to check this or run occasional audits
* Data analysis plan should be described in the study protocol, carried out as described, and reported. Additional analyses are always possible, but should be identified as such.
+
* Data analysis plan should be described in the [[2.1.1 Study protocol|study protocol]], carried out as described, and reported. Additional analyses are always possible, but should be identified as such.
 
* Minimize the risks of bias and increase internal validity by including criteria for outlier exclusion, acceptable ranges for standards, reference compound and quality controls upfront in the study protocol.  
 
* Minimize the risks of bias and increase internal validity by including criteria for outlier exclusion, acceptable ranges for standards, reference compound and quality controls upfront in the study protocol.  
 
* If the data analysis is done by the users themselves, they should subsequently share this data with the core facility even if they will not be published to allow for quality control of the data analysis and of the procedures in the core facility.
 
* If the data analysis is done by the users themselves, they should subsequently share this data with the core facility even if they will not be published to allow for quality control of the data analysis and of the procedures in the core facility.
  
 
==Data Storage and Traceability==
 
==Data Storage and Traceability==
* Experimental records should be kept in an audit-trailed, version-controlled, safe storage environment such as an appropriate bound-paper laboratory notebook with permanent ink or an electronic laboratory notebook (ELN).
+
* Experimental records should be kept in an [[3.1.2 Procedures for how and when to record data|audit-trailed, version-controlled, safe storage environment]] such as an appropriate bound-paper laboratory notebook with permanent ink or an electronic laboratory notebook (ELN).
 
* Raw (primary) data must be stored in an un-editable read-only form as soon as it is generated and must be backed-up
 
* Raw (primary) data must be stored in an un-editable read-only form as soon as it is generated and must be backed-up
** the raw data should be backed-up
+
** [[3.1.3 Data security|the raw data should be backed-up]]
** reliability of IT resources should be ensured
+
** [[3.3.2 Processes to enable computerized and non-computerized systems being suitable for intended use|reliability of IT resources should be ensured]]
 
** the responsibility for saving and archiving the raw data must be clarified
 
** the responsibility for saving and archiving the raw data must be clarified
 
* Processed (secondary) data must be clearly labeled as such and should contain a reference to raw data
 
* Processed (secondary) data must be clearly labeled as such and should contain a reference to raw data
  
 
==Review and Reporting==
 
==Review and Reporting==
* Reported research outcomes should be complete, accurate and findable
+
* Reported research outcomes should be [[2.3.1 Generation, recording, handling and archiving of raw data|complete, accurate and findable]]
** the location of the data must be identifiable for all data records, e.g. reference with the permanent identifier.  
+
** The [[3.1.2.1 Traceability of data and any person having impact on data​|location of the data must be identifiable]] for all data records, e.g. reference with the permanent identifier.  
 
** Reporting must include for each analysis the exact number of biological units for each condition
 
** Reporting must include for each analysis the exact number of biological units for each condition
 
* Experimental records should be reviewed by a CF for completeness and accuracy and it is advised to document this review
 
* Experimental records should be reviewed by a CF for completeness and accuracy and it is advised to document this review
Line 125: Line 122:
 
* Any external presentation/publication whether oral or in writing should give credit to the CF where the work was performed.
 
* Any external presentation/publication whether oral or in writing should give credit to the CF where the work was performed.
 
** Identify all contributing researchers and reference unique identifiers for the experimental records
 
** Identify all contributing researchers and reference unique identifiers for the experimental records
** encourage the use of an unique identifier for reseachers (ORCID)
+
** Encourage the use of an unique identifier for reseachers (ORCID)
 
** Unique IDs for facilities
 
** Unique IDs for facilities
 
* Any external presentation/publication whether oral or in writing should include a statement of conflict of interest.
 
* Any external presentation/publication whether oral or in writing should include a statement of conflict of interest.
 +
 +
=Resources=
 +
 +
Recommendation from this site as [https://paasp.sharepoint.com/:b:/s/EQIPD/EbEpozdxZ8hDhK0Ju1tfqDgBw30CWeXVySsX4nEM7m4FSg?e=x7NfKu pdf]- and [https://paasp.sharepoint.com/:w:/s/EQIPD/EfvTrQIEl-BNj0JHUHJ6xKYBVVCtO1J75cjAVV6hmWG0DA?e=EeSCMw word]-document.
 +
 +
EQIPD NEED for Core Facilities
 +
* The NEED can be downloaded [https://paasp.sharepoint.com/:x:/s/EQIPD/EUxUx_BKVYpCrkQYDYSTPCEB09ETCcXrMs4iRfV70ydtUw?e=hEe91t here]
 +
* For further explanation on NEEDS visit [[4.3.2.1_Using_the_Planning_Tool]]
 +
 +
The website [https://q-cofa.paasp.net Quality in Core Facilities] provides general support on establishing a quality framework.
 +
 +
 +
----------------
 +
back to [[Toolbox]]
 +
 +
Next item: [[1.4.3.4 Academia-academia: Research as collaboration]]​

Latest revision as of 08:18, 25 June 2021

Background

The recommendations outlined on this page have been developed by a working group of members and stakeholders of the EQIPD consortium.

These recommendations are intended to improve the robustness, reliability, traceability and integrity of the data obtained from the research activities supported by academic core facilities.

Core facilities taking part in the EQIPD program share the recommendations below with users to:

  • clarify communication in respect to best practices,
  • minimize bias and errors in the planning, collection and reporting of research data,
  • create reliable scientific and supporting evidence in resulting publications, presentations, reports, patents and other types of research output.

The experimental record and its description is the ultimate source of information and documentation regarding the experiment. Therefore, the contents of the experimental record must be accurate and thorough enough to be fully traceable to permit the reproduction of the work conducted. The experimental record is the official data record for each experiment and the most important primary source of data. It is expected that the practices outlined in these recommendations will be applied to experimental planning, record-keeping procedures and reporting, to the fullest extent possible.

Recognizing the diversity of environments and settings in which core facilities operate, the current recommendations can be used in two modes - “Training service” and “EQIPD service”.

It is expected that core facilities and their users discuss both types of services, any ambiguities or conflicts regarding the recommended practices, and ensure alignment and understanding prior to the start of the experiments.

The core facility provides the recommendations to the users (Training Service) and offers support in conducting EQIPD-compliant research (EQIPD Service). 

Users may chose whether they opt for the Training Service or would like to "upgrade" to the EQIPD Service

Training Service EQIPD Service 
The Core Facility decides how information about research practices recommended by EQIPD is shared with the users (e.g., made part of a training program, shared as a written summary in paper or electronic form).

  Unless requested by the users or otherwise enabled, the Core Facility does not assume any further role in supporting or monitoring the implementation of recommended practices for the user.

The Core Facility has implemented the EQIPD recommendations to enable support of EQIPD-compliant research to the user. 

Together with the user (and supervisor/PI if necessary), the Core Facility identifies the best solutions to implement specific recommendations for the user's research.

Core Facility assumes responsibility over spot checks (requires acceptance by the user if certain recommendations are implemented on the user's side).

Core Facility confirms to the user that the study was conducted as "EQIPD compliant" or not (e.g. to be stated in the report or in a publication).

Recommendations

Training

  • Users must be trained by CF members in order to be eligble to use CF
  • Users should seek support from CF to design experiments in due time and with with optimal rigor.
    • Users should seek contact with the core facility ahead of time to ensure proper preparation/consulting/animal license approval and ultimate data quality.
    • Core facilities should play an educational role in proper planning of projects.
    • CF member together with the PI and the user should perform risk assessment
    • the users should be instructed to record any erros and report them to head of the CF or any staff member; the CF personnel should debrief it; the debrief record should be circulated to all other users in order to minimize the chances for recurrance
    • Users must take responsibility for the appropiate use of reagents, research subjects and equipment they bring into the CF
    • It is up to CF to define which form training should take (including frequency and documentation)

Experimental Record

  • Unique study identifiers must be used and defined by the future owner of the raw data for each experiment. Unless this is the CF, the owner of the raw data should communicate the unique study ID to the CF.
    • Best practices should be communicated by the CF during training or by providing a reference to EQIPD Toolbox (e.g. date_User inititals_experiment).
    • CF and PI may generate separate study IDs but there must be a way established to communicate, to connect separate IDs and to enable traceability.
    • For EQIPD, it should be clear who is in charge of generating and storing the Unique Study Identifiers.
    • For complex studies that include more than one experiment, several experiments are typically part of one experimental record under one study ID.
    • Unless known to CF, PI must communicate ethical approval to CF
  • Each experimental record should include, directly or by reference, the names of all scientists involved, objectives, ethical approval/number, procedures, methods, materials, equipment, dates, and any other details considered necessary for reproducibility and reconstruction.
    • CF can elaborate a form (excel sheet for instance) listing all the items that are required in an experimental record, and ask users to fill in this form. This could help the user to keep tracking of his/her own detailed experimental record and is likely to increase the traceability of his/her data.
  • All raw and any processed data must be retrievable and traceable, directly or by reference. No raw data should be erased.
  • An experimental record must describe any significant changes and deviations from the original study protocol.
    • User must report/document if study execution is not in accordance with study protocol and deviations such as changes to study hypothesis, design or analysis must be documented (including the rationale for the changes).
    • Examples of significant changes: Changes in the doses, experimental conditions and groups, sample size, methods of analysis, etc.
    • Any change or deviation from a protocol approved by animal welfare authority would be significant and requires documentation in the experimental record.
    • If uncertain about what constitutes a significant change or deviation, the user should consult with the core facility.
  • An experimental record must provide an explanation and justification for exclusion of any data points from analysis.
    • Critical incidents (any unexpected or unplanned events) and errors must be recorded and made part of the experimental record.

preparation/consulting/animal license approval and ultimately data quality.

Rigor in Study Design

  • For every study, there should be a study protocol prepared prior to the study being conducted.
    • Please see a definition of the study protocol above.
    • Study protocols involving more than one experiment should include a dedicated section explaining the sequence and relationships between different experimental operations or procedures.
  • The study protocol must include:
    • Title
    • Study hypothesis
    • Ethical approval number and the name of approving body (for research involving animals)
    • Statement / information about controls (with choice justification if necessary)
    • Description of sample size calculation
    • Inclusion / exclusion criteria
    • Description of animal resources, reagents and materials (as applicable)
    • Study design overview for complex studies
    • Detailed description of experimental procedure(s) (or references to standalone descriptions if available)
  • The protocol should include:
    • Statement whether study is undertaken with the intention to inform a formal knowledge-claim
    • Statement about choice of experimental methods
    • Detailed description of measures against risk of bias (randomization, blinding) (or references to standalone descriptions if available)
    • Description of raw data analysis
    • use versioning (or have a section for amendments)
  • It is advisable to:
  • Apply randomization and blinding. If not done or if not maintained throughout the experiment (from subject/sample allocation to analysis), include the reasons in the study protocol, the study report and any publication.
    • The CF will advise the User how to randomize / blind.
    • The user should implement.
    • The CF will verify impementation.
  • Justify sample size (e.g. using power analysis) and include the justification in the study protocol, the study report and any publication.
  • Ensure inclusion / exclusion criteria and/or acceptance criteria are stated in the study protocol, the study report and any publication.

Analysis of Experimental Data

  • Experimental / data analysis record and study report (e.g. publication) should include sufficient detail to reconstruct any analysis performed and record all process steps and calculations used.
    • It is very important to define responsbility
    • CF should be in the position/have the possibility to check this or run occasional audits
  • Data analysis plan should be described in the study protocol, carried out as described, and reported. Additional analyses are always possible, but should be identified as such.
  • Minimize the risks of bias and increase internal validity by including criteria for outlier exclusion, acceptable ranges for standards, reference compound and quality controls upfront in the study protocol.
  • If the data analysis is done by the users themselves, they should subsequently share this data with the core facility even if they will not be published to allow for quality control of the data analysis and of the procedures in the core facility.

Data Storage and Traceability

Review and Reporting

  • Reported research outcomes should be complete, accurate and findable
    • The location of the data must be identifiable for all data records, e.g. reference with the permanent identifier.
    • Reporting must include for each analysis the exact number of biological units for each condition
  • Experimental records should be reviewed by a CF for completeness and accuracy and it is advised to document this review
    • Users should give CF staff the possibility to review data for analysis and reporting
  • Report should always provide summaries of all related data, processes, and conclusions, and include justification for excluding any relevant experimental records or individual data points from the summary analyses.
  • Any external presentation/publication whether oral or in writing should give credit to the CF where the work was performed.
    • Identify all contributing researchers and reference unique identifiers for the experimental records
    • Encourage the use of an unique identifier for reseachers (ORCID)
    • Unique IDs for facilities
  • Any external presentation/publication whether oral or in writing should include a statement of conflict of interest.

Resources

Recommendation from this site as pdf- and word-document.

EQIPD NEED for Core Facilities

The website Quality in Core Facilities provides general support on establishing a quality framework.



back to Toolbox

Next item: 1.4.3.4 Academia-academia: Research as collaboration