reproducibility
Mass Reproducibility and Replicability: A New Hope
I4R Discussion Paper 107 Abstract This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. Th
Anna Dreber Almenberg: Which results can we trust? Using replications, prediction markets and other tools to assess the reproducibility of scientific results.
Anna Dreber Almenberg, Professor of Economics, Stockholm School of EconomicsAbstractWhy are there so many false results in the published scientific literature? And what is the actual share of results
Gustav Nilsonne: Pathways to an open science system: Replacing academic journals
Venue: Institutet för framtidsstudier, Holländargatan 13, 4th floor, Stockholm, and onlineREGISTERResearch seminar with Gustav Nilsonne, Associate Professor of neuroscience. He is active in meta-sciencOpen science enables cumulative knowledge and facilitates discovery. The transition to an open science system is underway, but important roadblocks remain. A decentralised, evolvable network of platforms interconnected by open standards, and governed by the scientific community, is technically feasible. However, academic researchers remain tied to traditional journals not least because assessment of merit is tied to the venue of publication. Ways forward can include redirection of funding from legacy publishing models to new infrastructure and the development of new methods to assess scientific contributions. Concerted action by stakeholders needs to be combined with pluralistic experimentation on policies and interventions to further open science practices.
David Grusky: Should scholars own data? The high cost of neoliberal qualitative scholarship
Welcome to this seminar with David Grusky, Professor of Sociology at Stanford University.The seminar is jointly organized by the Institute for Analytical Sociology and the Institute for Futures Studies.D Thursday, October 6 13:00-15:00 (CET) At the Institute for Futures Studies (Holländargatan 13, Stockholm), or onlineIf qualitative work were to be rebuilt around open science principles of transparency and reproducibility, what types of institutional reforms are needed? It’s not enough to mimic open science movements within the quantitative field by focusing on problems of data archiving and reanalysis. The more fundamental problem is a legal-institutional one: The field has cut off the development of transparent, reproducible, and cumulative qualitative research by betting on a legal-institutional model in which qualitative scholars are incentivized to collect data by giving them ownership rights over them. This neoliberal model of privatized qualitative research has cut off the development of public-use data sets of the sort that have long been available for quantitative data. If a public-use form of qualitative research were supported, it would not only make qualitative research more open (i.e., transparent, reproducible, cumulative) but would also expand its reach by supporting new uses. The American Voices Project – the first nationally-representative open qualitative data set in the US – is a radical test of this hypothesis. It is currently being used to validate (or challenge!) some of the most famous findings coming out of conventional “closed” qualitative research, to serve as an “early warning system” to detect new crises and developments in the U.S., to build new approaches to taking on poverty, the racial wealth gap, and other inequities, and to monitor public opinion in ways far more revealing than conventional forced-choice surveys. The purpose of this talk is to discuss the promise – and pitfalls – of this new open-science form of qualitative research as well as opportunities to institutionalize it across the world.
Should Scholars Own Data? David Grusky About the American Voices Project
If qualitative work were to be rebuilt around open science principles of transparency and reproducibility, what types of institutional reforms are needed? It’s not enough to mimic open science movemen
