Data Colada
Menu
  • Home
  • Table of Contents
  • Feedback Policy
  • Seminar
  • About
Menu

[7] Forthcoming in the American Economic Review: A Misdiagnosed Failure-to-Replicate

Posted on November 11, 2013February 11, 2020 by Uri, Joe, & Leif

In the paper “One Swallow Doesn't Make A Summer: New Evidence on Anchoring Effects”, forthcoming in the AER, Maniadis, Tufano and List attempted to replicate a classic study in economics. The results were entirely consistent with the original and yet they interpreted them as a “failure to replicate.” What went wrong? This post answers that…

Read more

[6] Samples Can't Be Too Large

Posted on November 4, 2013January 23, 2019 by Joe Simmons

Reviewers, and even associate editors, sometimes criticize studies for being “overpowered” – that is, for having sample sizes that are too large. (Recently, the between-subjects sample sizes under attack were about 50-60 per cell, just a little larger than you need to have an 80% chance to detect that men weigh more than women). This…

Read more

[5] The Consistency of Random Numbers

Posted on October 23, 2013January 25, 2019 by Leif Nelson

What’s your favorite number between 1 and 100? Now, think of a random number between 1 and 100. My goal for this post is to compare those two responses. Number preferences feel random. They aren’t. “Random” numbers also feel random. Those aren’t random either. I collected some data, found a pair of austere academic papers,…

Read more

[4] The Folly of Powering Replications Based on Observed Effect Size

Posted on October 14, 2013February 11, 2020 by Uri Simonsohn

It is common for researchers running replications to set their sample size assuming the effect size the original researchers got is correct. So if the original study found an effect-size of d=.73, the replicator assumes the true effect is d=.73, and sets sample size so as to have 90% chance, say, of getting a significant…

Read more

[3] A New Way To Increase Charitable Donations: Does It Replicate?

Posted on October 2, 2013August 16, 2021 by Joe Simmons

A new paper finds that people will donate more money to help 20 people if you first ask them how much they would donate to help 1 person. This Unit Asking Effect (Hsee, Zhang, Lu, & Xu, 2013, Psychological Science) emerges because donors are naturally insensitive to the number of individuals needing help. For example,…

Read more

[2] Using Personal Listening Habits to Identify Personal Music Preferences

Posted on September 26, 2013March 20, 2016 by Leif Nelson

Not everything at Data Colada is as serious as fraudulent data. This post is way less serious than that. This post is about music and teaching. As part of their final exam, my students analyze a data set. For a few years that data set has been a collection of my personal listening data from…

Read more

[1] "Just Posting It" works, leads to new retraction in Psychology

Posted on September 17, 2013February 11, 2020 by Uri Simonsohn

The fortuitous discovery of new fake data. For a project I worked on this past May, I needed data for variables as different from each other as possible. From the data-posting journal Judgment and Decision Making I downloaded data for ten, including one from a now retracted paper involving the estimation of coin sizes. I created…

Read more
  • Previous
  • 1
  • …
  • 8
  • 9
  • 10
  • 11

Get Colada email alerts.

Join 5,108 other subscribers

Social media

We tweet new posts: @DataColada
And mastopost'em: @DataColada@mas.to
And link to them on our Facebook page

Recent Posts

  • [107] Meaningless Means #3: The Truth About Lies
  • [106] Meaningless Means #2: The Average Effect of Nudging in Academic Publications is 8.7%
  • [105] Meaningless Means #1: The Average Effect
    of Nudging Is d = .43
  • [104] Meaningless Means: Some Fundamental Problems With Meta-Analytic Averages
  • [103] Mediation Analysis is Counterintuitively Invalid

Get blogpost email alerts

Join 5,108 other subscribers

tweeter & facebook

We tweet new posts: @DataColada
And link to them on our Facebook page

Posts on similar topics

    search

    © 2021, Uri Simonsohn, Leif Nelson, and Joseph Simmons. For permission to reprint individual blog posts on DataColada please contact us via email..