Session 5D: Implementing Data Review at your Journal: Policies, Practicalities, and Perspectives
With an eye toward increasing data transparency and rigor, journals and publishers are implementing data policies that ensure the research community has access to the data and analysis code underlying their publications. Journals in the social, health, and biological sciences are experimenting with different approaches to data and code review. A recently completed study by the Odum Institute and Dryad sought insights from editors’, reviewers’, and authors’ experiences with the peer-review process at journals that incorporate some type of data validation. This panel presentation will share the outputs of this research and the experiences of journal editors implementing different forms of data review in the life sciences, social sciences, and medicine. Panelists will address the following questions:
- What are the ways in which data review is being implemented at different journals, and how much disciplinary variation is there?
- What are the early experiences of authors, editors, and reviewers with data review?
- What opportunities exist to leverage the expertise of institutions or data repositories when developing these data-policy workflows?
- What are the costs and benefits to journals of incorporating data into the peer-review process?
- How can policies strike the right balance between effectiveness and burden?
