Demystifying p-values

Image by davisuko on Unsplash.
There is a tremendous amount of confusion around what a p-value actually is, despite their widespread use in science. Here is my attempt to explain the concept of p-values concisely and clearly (including why they are useful and what often goes wrong with them). — What's a p-value? — If you run a study, then (all else equal, aside from rare edge cases) the lower the p-value, the lower the chance that your results are due to random chance or luck. More precisely: a p-value is the probab...
More

Importance Hacking: a major (yet rarely-discussed) problem in science

Image created using the A.I. DALL·E
I first published this post on the Clearer Thinking blog on December 19, 2022, and first cross-posted it to this site on January 21, 2023. You have probably heard the phrase "replication crisis." It refers to the grim fact that, in a number of fields of science, when researchers attempt to replicate previously published studies, they fairly often don't get the same results. The magnitude of the problem depends on the field, but in psychology, it seems that something like 40% of studies i...
More

Many global challenges arise due to collective action problems or incentive misalignment

Photo by Kelly L from Pexels
Many of the biggest challenges that we face in society are due to one or both of these types of problems: (A) Collective Action Problems, where many individuals or groups are currently better off taking action X, even though they'd be better off in the long-term if everyone agreed not to take action X. Some of the big challenges with Collective Actions Problems are (i) getting people or groups to agree to stop the behavior in the first place, and then (ii) creating a v...
More