Data Colada
Menu
  • Home
  • About
  • Feedback Policy
  • Table of Contents
  • Seminar
  • Past Seminars
Menu

Author: Uri Simonsohn

[95] Groundhog: Addressing The Threat That R Poses To Reproducible Research

Posted on January 5, 2021January 23, 2021 by Uri Simonsohn

R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote [1]), but the big problem is its packages: the addon scripts that…

Read more

[91] p-hacking fast and slow: Evaluating a forthcoming AER paper deeming some econ literatures less trustworthy

Posted on September 15, 2020November 18, 2020 by Uri Simonsohn

The authors of a forthcoming AER article (.pdf), "Methods Matter: P-Hacking and Publication Bias in Causal Analysis in Economics", painstakingly harvested thousands of test results from 25 economics journals to answer an interesting question: Are studies that use some research designs more trustworthy than others? In this post I will explain why I think their…

Read more

[88] The Hot-Hand Artifact for Dummies & Behavioral Scientists

Posted on May 27, 2020November 18, 2020 by Uri Simonsohn

A friend recently asked for my take on the Miller and Sanjurjo's (2018; pdf) debunking of the hot hand fallacy. In that paper, the authors provide a brilliant and surprising observation missed by hundreds of people who had thought about the issue before, including the classic Gilovich, Vallone, & Tverksy (1985 .htm). In this post:…

Read more

[80] Interaction Effects Need Interaction Controls

Posted on November 20, 2019February 11, 2020 by Uri Simonsohn

In a recent referee report I argued something I have argued in several reports before: if the effect of interest in a regression is an interaction, the control variables addressing possible confounds should be interactions as well. In this post I explain that argument using as a working example a 2011 QJE paper (.htm) that…

Read more

[78c] Bayes Factors in Ten Recent Psych Science Papers

Posted on September 25, 2019February 11, 2020 by Uri Simonsohn

For this post, the third in a series on Bayes factors (.htm), I wanted to get a sense for how Bayes factors were being used with real data from real papers, so I looked at the 10 most recent empirical papers in Psychological Science containing the phrase "Bayes factor" (.zip). After browsing them all, I…

Read more

[78b] Hyp-Chart, the Missing Link Between P-values and Bayes Factors

Posted on September 11, 2019February 12, 2020 by Uri Simonsohn

Just two steps are needed to go from computing p-values to computing Bayes factors. This post explains both steps and introduces Hyp-Chart, the missing link we arrive at if we take only the first step. Hyp-Chart is a graph that shows how well the data fit the null vs. every possible alternative hypothesis [1]. Hyp-Chart…

Read more

[78a] If you think p-values are problematic, wait until you understand Bayes Factors

Posted on September 6, 2019September 6, 2019 by Uri Simonsohn

Would raising the minimum wage by $4 lead to greater unemployment? Milton, a Chicago economist, has a theory (supply and demand) that says so. Milton believes the causal effect is anywhere between 1% and 10%. After the minimum wage increase of $4, unemployment goes up 1%.  Milton feels bad about the unemployed but good about…

Read more

[77] Number-Bunching: A New Tool for Forensic Data Analysis

Posted on May 25, 2019November 18, 2020 by Uri Simonsohn

In this post I show how one can analyze the frequency with which values get repeated within a dataset – what I call “number-bunching” – to statistically identify whether the data were likely tampered with. Unlike Benford’s law (.htm), and its generalizations, this approach examines the entire number at once, not only the first or…

Read more

[69] Eight things I do to make my open research more findable and understandable

Posted on February 6, 2018January 23, 2019 by Uri Simonsohn

It is now common for researchers to post original materials, data, and/or code behind their published research. That’s obviously great, but open research is often difficult to find and understand. In this post I discuss 8 things I do, in my papers, code, and datafiles, to combat that. Paper 1) Before all method sections, I…

Read more

[63] "Many Labs" Overestimated The Importance of Hidden Moderators

Posted on October 20, 2017February 16, 2020 by Uri Simonsohn

Are hidden moderators a thing? Do experiments intended to be identical lead to inexplicably different results? Back in 2014, the "Many Labs" project (htm) reported an ambitious attempt to answer these questions. More than 30 different labs ran the same set of studies and the paper presented the results side-by-side. They did not find any…

Read more
  • 1
  • 2
  • 3
  • 4
  • 5
  • Next

Get Colada email alerts.

Join 3,315 other subscribers

tweeter & facebook

We tweet new posts: @DataColada
And link to them on our Facebook page

Search posts

Get blogpost email alerts

Join 3,315 other subscribers

tweeter & facebook

We tweet new posts: @DataColada
And link to them on our Facebook page

Posts on similar topics

    search

    Data Colada - All Content Licensed: CC-BY [Creative Commons]