Report from the Scientific Integrity Consortium: Principles and Best Practices for Scientific Integrity Linda J. Harris, Ph.D. CPS Specialist in Cooperative Extension Chair, Department of Food Science and Technology 1 Linda J. Harris, Ph.D. CFS Employee: Department of Food Science and Technology at UC Davis Consulting: Marler Clark (2017-2018) Advisory Board American Frozen Food Institute Grants and Contracts (past 5 years)
Almond Board of California Ardent Mills California Citrus Research Board California Dept. of Food and Agriculture California Dept. of Public Health California Pistachio Research Board Center for Produce Safety U.S. FDA and USDA Walnut Board of California Image from Shutterstock, 2019 Scientific Integrity When persons...adhere to accepted standards, professional values, and practices of the relevant scientific community Research Misconduct/Breach Some
Definitions Fabrication, falsification, plagiarism in proposing, performing or reviewing research; or in reporting research results (does not include honest error or differences of opinion) Detrimental or Questionable Research Practices When researchers commit research misconduct or engage in other behavior that clearly damages research and stray from the norms and appropriate practices of science Questionable Research Practices is used in Canada and abroad 3 Scientific Integrity is Complex 21st Century scientists work in a research
environment : that is being transformed by globalization, interdisciplinary research projects, team science, and information technologies 4 Scientific Integrity Ecosystem Individual researchers Research supervisors Institutional leaders Research funders Peer reviewers and journal editors Photo by Drew Hays on Unsplash Scientific
Integrity Consortiu m 11 Professional Societies 4 U.S. Government Agencies 3 Canadian Government Agencies 3 Non-profit Scientific Organizations 6 Universities Scientific Integrity Consortium Members Professional Societies Scientific Integrity Consortium Members Universities and National Academy of Sciences
NATIONAL ACADEMY OF SCIENCES ENGINEERING CENTER FOR ENGINEERING ETHICS AND SOCIETY FOOD AND NUTRITION BOARD DEVELOPMENT, SECURITY, AND COOPERATION POLICY AND GLOBAL AFFAIRS GOVERNMENT UNIVERSITY INDUSTRY RESEARCH ROUNDTABLE
Scientific Integrity Consortium Members Government Agencies SECRETARIAT ON RESPONSIBLE CONDUCT OF RESEARCH 2,600 downloads, 38 shares, 1 citation 10 Overarchi ng Principles for Fostering Scientific
Integrity 1. Foster a culture of integrity in the scientific process Photo by Helloquence on Unsplash 2. Evidence-based policy interests may have legitimate roles to play in influencing aspects of the research process, but those roles should not interfere with
scientific integrity 11 Principle 1. Foster a culture of integrity in the scientific process All facets of the scientific community Institutions must: Develop policies, procedures, and
practices that address scientific integrity Provide training Work to maintain awareness and advocacy for these practices Photo by Mikael Kristenson on Unsplash 12 Principle 2. Evidencebased policy interests may have legitimate
roles to play in influencing aspects of the research process, but those roles should not interfere with Addresses the interface of science and policy The ultimate use of science in public policy, as well as decision-making and public opinion,
should not affect the content of the science 13 Nine Best Practices for Scientific Integrity Photo by Kelly Sikkema on Unsplash Best Practices Experimental Design Statistical Analysis Responsible Research
Practices Promote Research Quality Strengthen Institutional Capacity for Dealing with Research Breaches Research Integrity Advisory Board Move to Open Science Framework Full and Transparent Reporting of Methods, Statistics, Results, etc
1. Require Universal Training in Scientific Methods 2. Strengthen Scientific Integrity Oversight & Ethics Training 3. Encourage Reproducibility through Transparency All images derived from Google Images, 2018 Best Practices Move to Sharing all Data Tri-Agency Open
Access Policy Considerations? IP issues? 4. Establish Open Science as the Norm Train Scientists to Accurately Communicate Research Ensure Approval of Press Releases 5. Develop Tools to Teach Communication Skills that Uphold Scientific Integrity Conflict of Interest Disclosures
Use of Robust Checklists Increase Recognition of Review Activities 6. Strengthen the Peer Review Process All images derived from Google Images, 2018 Best Practices Remove Publication Bias Change Terminology: Unanticipated vs. Negative 7. Encourage Publication of Unanticipated Findings
Standardize Language and Processes Related to Retractions & Corrections Development of New Metrics to Recognized Research Quality 8. Seek Harmonization for Retraction or Correction of Papers 9. Design Criteria to Recognize High Standards of Scientific Integrity
All images derived from Google Images, 2018 Going Forward: Checklist and Metrics One checklist to serve many purposes A guide to the design, conduct, and reporting of studies An objective tool for the evaluation of published research Criteria for a stamp of approval to maintain the trust of the scientific community and public in study results Metrics to measure scientific integrity Image from Shutterstock, 2019
18 Next Steps for the Consortium Campaign to share the principles and best practices Completed in 2018 & 2019 Email ideas of how to implement the principles and best practices: [email protected] Recommendations for a checklist and the development of metrics, potentially in collaboration with other organizations. Photo by Vek Labs on Unsplash 19 6th World Conference on
Research Integrity June 2-6, 2019, Hong Kong Hong Kong Principles for Assessing Researchers Fostering Research Integrity New metrics for global adoption Measure scientific integrity Researchers Institutions Photo by Ruslan Bardash on Unsplash 20 Thank You! Email the Consortium: [email protected]
21 Principles and Best Practices Overarching Principles for Fostering Scientific Integrity 1. Foster a culture of integrity in the scientific process 2. Evidence-based policy interests may have legitimate roles to play in influencing aspects of the research process, but those roles should not interfere with scientific integrity Best Practices for Fostering Scientific Integrity 1. Require universal training in robust scientific methods, in the use of appropriate experimental design and statistics, and in responsible research practices for scientists at all levels, with the training content regularly updated and presented by qualified scientists 2. Strengthen scientific integrity oversight and processes throughout the research continuum with a focus on training in ethics and conduct 3. Encourage reproducibility of research through transparency 4. Strive to establish open science as the standard operating procedure throughout the scientific enterprise 5. Develop and implement educational tools to teach communication skills that uphold scientific integrity 6. Strive to identify ways to further strengthen the peer review process
7. Encourage scientific journals to publish unanticipated findings that meet standards of quality and scientific integrity 8. Seek harmonization and implementation among journals of rapid, consistent, and transparent processes for correction and/or retraction of published papers 9. Design rigorous and comprehensive evaluation criteria that recognize and reward the highest standards of integrity in scientific research 22
