Uli Schimmack recently identified an interesting pattern in the data from Daryl Bem's infamous "Feeling the Future" JPSP paper, in which he reported evidence for the existence of extrasensory perception (ESP; .pdf)[1]. In each study, the effect size is larger among participants who completed the study earlier (blogpost: .htm). Uli referred to this as the "decline…
Author: Joe Leif Uri
[67] P-curve Handles Heterogeneity Just Fine
A few years ago, we developed p-curve (see p-curve.com), a statistical tool that identifies whether or not a set of statistically significant findings contains evidential value, or whether those results are solely attributable to the selective reporting of studies or analyses. It also estimates the true average power of a set of significant findings [1]….
[66] Outliers: Evaluating A New P-Curve Of Power Poses
In a forthcoming Psych Science paper, Cuddy, Schultz, & Fosse, hereafter referred to as CSF, p-curved 55 power-posing studies (.pdf | SSRN), concluding that they contain evidential value [1]. Thirty-four of those studies were previously selected and described as "all published tests" (p. 657) by Carney, Cuddy, & Yap (2015; .pdf). Joe and Uri p-curved…
[64] How To Properly Preregister A Study
P-hacking, the selective reporting of statistically significant analyses, continues to threaten the integrity of our discipline. P-hacking is inevitable whenever (1) a researcher hopes to find evidence for a particular result, (2) there is ambiguity about how exactly to analyze the data, and (3) the researcher does not perfectly plan out his/her analysis in advance….