Replication Markets Integrates scite Badge to Enhance Replication Forecasts

Mon Nov 04 2019

Brooklyn, NY, November 4, 2019– scite, a deep-learning platform that shows how a scientific report has been cited, has partnered with Replication Markets, a prediction market platform that allows participants to bet on whether scientific claims are replicable.

As part of the DARPA SCORE program, Replication Markets allows participants to predict whether 3,000 recently-published behavioral and social science claims would get the same result if tested. After studying the published reports, participants take surveys and place bets to estimate the probability of replication.

This joint venture is testing whether scite analytics improves predictions. In other words, can scite analytics help researchers identify trustworthy papers?

scite co-founder and Director of Research Sean Rife says, “We’re excited to partner with Replication Markets to see if presenting scite analytics to forecasters can make them more effective. As a psychologist, I am acutely aware of the reproducibility crisis in my field and am excited to work with others to try to improve how we identify and promote strong psychological findings.”

Charles Twardy, Principal Investigator of the Replication Markets says, “scite will give our forecasters additional context, and hopefully help them break the 80% accuracy barrier. Better predictions help improve the reliability of social science research and its popular understanding.”

About Replication Markets

Replication Markets is funded by the DARPA SCORE program to assign confidence scores to social and behavioral science claims. The project is actively seeking citizen scientists to participate in its play-money prediction market with real payouts totaling over $100,000. Replication Markets is part of the Aerospace, Technology and Nuclear division of KeyW, a wholly-owned subsidiary of Jacobs.

About scite

scite is a Brooklyn-based startup that enables anyone to see how a scientific report has been cited, specifically if it has been supported or contradicted. scite is used by researchers from dozens of countries and has been funded in part by the National Science Foundation and the National Institutes of Health.