Data Colada
Menu
  • Home
  • Table of Contents
  • Feedback Policy
  • About
Menu

Category: Discuss Paper by Others

[125] "Complexity" 2: Don't be mean to the median

Posted on April 1, 2025April 2, 2025 by Uri Simonsohn

In Colada[124] I summarized a co-authored critique (with Banki, Walatka and Wu) of a recent AER paper that proposed risk preferences reflect 'complexity' rather than preferences a-la Prospect Theory. Ryan Oprea, the AER author, has written a rejoinder (.pdf). Its first main point (pages 5-12), is that our results with medians are 'knife edge' (p.8),…

Read more

[124] "Complexity": 75% of participants missed comprehension questions in AER paper critiquing Prospect Theory

Posted on March 14, 2025March 31, 2025 by Uri Simonsohn

Kahneman and Tversky’s (1979) “Prospect Theory” article is the most cited paper in the history of economics, and it won Kahneman the Nobel Prize in 2002. Among other things, it predicts that people are risk seeking for unlikely gains (e.g., they pay more than $1 for a 1% chance of $100) but risk averse for…

Read more

[122] Arresting Flexibility: A QJE field experiment on police behavior with about 40 outcome variables

Posted on January 7, 2025February 5, 2025 by Uri Simonsohn

A forthcoming paper in the Quarterly Journal of Economics (QJE), "A Cognitive View of Policing" (htm), reports results from a field experiment showing that teaching police officers to "consider different ways of interpreting situations they encounter" led to "reductions in use of force, [and] discretionary arrests" (abstract). In this post I explain why, having spent…

Read more

[121] Dear Political Scientists: Don't Bin, GAM Instead

Posted on December 3, 2024March 5, 2025 by Uri Simonsohn

There is a 2019 paper, in the journal Political Analysis (htm), with over 1000 Google cites, titled "How Much Should We Trust Estimates from Multiplicative Interaction Models? Simple Tools to Improve Empirical Practice".   The paper is not just widely cited, but is also actually influential. Most political science papers estimating interactions now-a-days, seem to…

Read more

[119] A Hidden Confound in a Psych Methods Pre‑registrations Critique

Posted on September 2, 2024September 2, 2024 by Uri Simonsohn

A forthcoming paper in Psych Methods (.pdf) had a set of coders evaluate 300 pre-registrations in terms of how informative they were about several study attributes (e.g., hypotheses, analysis, DVs). The authors analyzed the subjective codings and concluded that many pre-registrations in psychology, especially those relying on the AsPredicted template, provide insufficient information., Central to…

Read more

[101] Transparency Makes Research Evaluable: Evaluating a Field Experiment on Crime Published in Nature

Posted on April 28, 2022April 28, 2022 by Joe & Uri

A recently published Nature paper (.htm) examined an interesting psychological hypothesis and applied it to a policy relevant question. The authors ran an ambitious field experiment and posted all their data, code, and materials. They also were transparent in showing the results of many different analyses, including some that yielded non-significant results. This is in…

Read more

[99] Hyping Fisher: The Most Cited 2019 QJE Paper Relied on an Outdated Stata Default to Conclude Regression p-values Are Inadequate

Posted on October 13, 2021October 27, 2021 by Uri Simonsohn

The paper titled "Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results" (.htm) is currently the most cited 2019 article in the Quarterly Journal of Economics (372 Google cites). It delivers bad news to economists running experiments: their p-values are wrong. To get correct p-values, the article explains, they need to…

Read more

[98] Evidence of Fraud in an Influential Field Experiment About Dishonesty

Posted on August 17, 2021April 23, 2022 by Uri, Joe, & Leif

This post is co-authored with a team of researchers who have chosen to remain anonymous. They uncovered most of the evidence reported in this post. These researchers are not connected in any way to the papers described herein. *** In 2012, Shu, Mazar, Gino, Ariely, and Bazerman published a three-study paper in PNAS (.htm) reporting…

Read more

[97] Data Replicada #10: Does Goal Conflict Affect Time Spent on Work and Leisure?

Posted on May 4, 2021May 4, 2021 by Joe & Leif

In the tenth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JMR) article entitled, “Goal Conflict Encourages Work and Discourages Leisure” (.htm). The article’s two key hypotheses are right there in the title: People who are faced with a goal conflict are (1) more likely to…

Read more

[96] Madam Speaker: Are Female Presenters Treated Worse in Econ Seminars?

Posted on April 30, 2021April 30, 2021 by Uri Simonsohn

A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest[ing] yet another potential explanation…

Read more
  • 1
  • 2
  • 3
  • Next

Get Colada email alerts.

Join 10.5K other subscribers

Social media

Recent Posts

  • [125] "Complexity" 2: Don't be mean to the median
  • [124] "Complexity": 75% of participants missed comprehension questions in AER paper critiquing Prospect Theory
  • [123] Dear Political Scientists: The binning estimator violates ceteris paribus
  • [122] Arresting Flexibility: A QJE field experiment on police behavior with about 40 outcome variables
  • [121] Dear Political Scientists: Don't Bin, GAM Instead

Get blogpost email alerts

Join 10.5K other subscribers

tweeter & facebook

We announce posts on Twitter
We announce posts on Bluesky
And link to them on our Facebook page

Posts on similar topics

Discuss Paper by Others
  • [125] "Complexity" 2: Don't be mean to the median
  • [124] "Complexity": 75% of participants missed comprehension questions in AER paper critiquing Prospect Theory
  • [122] Arresting Flexibility: A QJE field experiment on police behavior with about 40 outcome variables
  • [121] Dear Political Scientists: Don't Bin, GAM Instead
  • [119] A Hidden Confound in a Psych Methods Pre‑registrations Critique
  • [101] Transparency Makes Research Evaluable: Evaluating a Field Experiment on Crime Published in Nature
  • [99] Hyping Fisher: The Most Cited 2019 QJE Paper Relied on an Outdated Stata Default to Conclude Regression p-values Are Inadequate
  • [98] Evidence of Fraud in an Influential Field Experiment About Dishonesty
  • [97] Data Replicada #10: Does Goal Conflict Affect Time Spent on Work and Leisure?
  • [96] Madam Speaker: Are Female Presenters Treated Worse in Econ Seminars?

search

© 2021, Uri Simonsohn, Leif Nelson, and Joseph Simmons. For permission to reprint individual blog posts on DataColada please contact us via email..