Current Projects
Search
 

Home
Search for Projects
View Projects
Project Title
by Subject/Focus Area
by Board/Committee
by Major Unit
Provisional Committee Appointments Open for Formal Public Comments
by Last Update
Meeting Information
Conflict of Interest Policy
Committee Appointment Process
FAQ
  meetingview
More Project Information and to provide FEEDBACK on the Project

 Printer Friendly Version


Meeting Information



Project Title: Reproducibility and Replicability in Science

PIN: DBASSE-BBCSS-17-03         

Major Unit:
Division of Behavioral and Social Sciences and Education
Division on Earth and Life Studies
Division on Engineering and Physical Sciences

Sub Unit:
Board on Behavioral, Cognitive, and Sensory Sciences
DEPS Board on Mathematical Sciences and Analytics
Committee on National Statistics
Division on Earth and Life Studies

RSO:
Heimberg, Jennifer

Subject/Focus Area:
Behavioral and Social Sciences; Biology and Life Sciences; Earth Sciences; Education; Engineering and Technology; Math, Chemistry and Physics; Statistics


Reproducibility and Replicability in Science
December 12, 2017 - December 13, 2017
National Academy of Sciences Building
2101 Constitution NW
Washington D.C. 20148


If you would like to attend the sessions of this meeting that are open
to the public or need more information please contact:


Contact Name: Garret Tyson
Email: gtyson@nas.edu
Phone: 202-334-1737
Fax:


Agenda:

*DRAFT AGENDA, SUBJECT TO CHANGE*

First Meeting
Tuesday, December 12, 2017

Join from PC, Mac, Linux, iOS or Android: https://nasem.zoom.us/j/361396182


12:30 Welcome and Introductions
Mary Ellen O’Connell, Executive Director, Division on Behavioral, Social Science, and Education
Harvey Fineberg, Committee Chair and President of the Gordon and Betty Moore Foundation

1:00 The Scientific Enterprise
Edward (Ned) Hall, Chair, Department of Philosophy, Harvard University and committee member
Q&A: Harvey Fineberg, Moderator

1:45 National Science Foundation’s Interests and Goals for the Study
Dr. Joan Ferrini-Mundy, Chief Operating Officer, NSF (confirmed)
Q&A: Harvey Fineberg, Moderator

2:30 BREAK


Perspectives on Reproducibility and Replication: Scientific Societies, Part I
Panelists, primarily leaders from scientific societies and organizations, have been asked to focus on the following topics:
• Within your field of science, what is the level of awareness, interest, concern, and involvement in reproducibility and replicability (R&R) of research results?
• Are there specific areas within your field of science that are more likely to have issues with reproducing scientific results?
• What reproducibility challenges does your field of science face with cross disciplinary research?

Each panelist has 10 minutes for a presentation + 5 minutes for questions from the committee.

2:45 Psychology and Social Sciences
William G. Jacoby, Professor, Department of Political Science, Michigan State University and Editor, American Journal of Political Science (confirmed)
Howard S. Kurtzman, Acting Executive Director, Science Directorate, American Psychological Association (confirmed)
To Be Determined (TBD)
Q&A: Harvey Fineberg, Moderator

3:30 Physical Sciences
Kate Kirby, CEO, American Physical Society (confirmed)
TBD
Q&A: Harvey Fineberg, Moderator

4:00 Statistics
Ron Wasserstein, executive director, American Statistical Association (confirmed)
TBD
Q&A: Harvey Fineberg, Moderator

4:15 Earth Sciences
Brooks Hanson, Senior Vice President Publications, American Geophysical Union (confirmed)
Q&A: Harvey Fineberg, Moderator

4:30 Engineering
Philip DiVietro, Managing Director of Publishing [or other representative], American Society of Mechanical Engineers (ASME) (confirmed)
John Baillieul, Distinguished Professor of Engineering, Professors of Mechanical, of Electrical and Computer Engineering, and of Systems Engineering, Boston University (confirmed)
Q&A: Harvey Fineberg, Moderator

5:00 Public Comments

5:30 End Public Session




Wednesday, December 13, 2017

Join from PC, Mac, Linux, iOS or Android: https://nasem.zoom.us/j/882788432

8:30 am Welcome, Day One and Day Two overviews
Harvey Fineberg, chair

Perspectives on Reproducibility and Replication: Scientific Societies and Agencies, Part II
Panelists, primarily leaders from scientific societies and organizations, have been asked to focus on the following topics:
• Within your field of science, what is the level of awareness, interest, concern, and involvement in reproducibility and replicability (R&R) of research results?
• Are there specific areas within your field of science that are more likely to have issues with reproducing scientific results?
• What reproducibility challenges does your field of science face with cross disciplinary research?

Each panelist has 10 minutes for a presentation + 5 minutes for questions from the committee.


8:45 Life Sciences
Yvette Seger, Director of Science Policy, Federation of American Societies for Experimental Biology (FASEB) (confirmed)

9:00 Reproducibility of scientific research within the agencies:
Patricia Valdez, NIH Extramural Research Integrity Officer (confirmed)
Anne Plant, NIST Fellow in the Biosystems and Biomaterials Division (confirmed)
Q&A: Harvey Fineberg, Moderator


International Panelists have been asked to focus on the following topics:
• What is the level of awareness, interest, concern, and involvement in reproducibility and replicability (R&R) of research results within your national scientific societies?
• Are there specific areas of science that are more likely to have issues with reproducing scientific results?
• What R&R issues exist for cross disciplinary research?
Each panelist has 15 minutes for a presentation + 5 minutes for questions from the committee.

9:30 International Perspectives:
Eric-Jan Wagenmakers, professor of psychology, University of Amsterdam,
and Jean Phillipe de Jong, The Dutch Royal Society of Sciences (KNAW) (confirmed)
Q&A: Harvey Fineberg, Moderator

10:10 BREAK

10:25 Reporting of Reproducibility Issues in Science
Richard Harris, Science Correspondent, National Public Radio (confirmed)

11:05 Policy makers within the federal government:
To be determined


Perspectives from Editors of Cross-disciplinary Journals
Questions for journal editors:
• Can journals assess levels of reproducibility and replication across science?
• Are cross-disciplinary papers handled differently from “pure” science papers in terms of peer review or publishing decisions?
• What R&R challenges does cross-disciplinary research pose that can be addressed by journals?

11:40 Veronique Kiermer, executive editor, PLOS (tentative)
TBD
Q&A: Harvey Fineberg, Moderator

12:10 Public Comments

12:30 End Public Sessions



Closed Session Summary Posted After the Meeting

The following committee members were present at the closed sessions of the meeting:
Harvey Fineberg
Juliana Freire
Lorena Barba
Edward Hall
Dianne Chong
Constantine Gatsonis
Gerald Gabrielse
David Allison
Victoria Stodden
Simine Vazire
Timothy Wilson
Wendy Wood
Dietram Scheufele (via Zoom)

The following topics were discussed in the closed sessions:
The committee held its bias and conflict of interest discussion and reviewed its statement of task. Future meeting dates and plans for the study were also discussed.

The following materials (written documents) were made available to the committee in the closed sessions:
No written documents were provided to the committee.

Date of posting of Closed Session Summary: December 15, 2017