Can you trust survey responses?

March 29, 2025

Self-reporting on surveys seems ridiculously unreliable. People can lie or may not pay attention. People misremember things. People often lack self-insight. And YET, self-reporting fairly often works remarkably well in measuring things. Here are some examples: (1) In a large study we ran, IQ (measured by performance on intelligence tasks) had a strong correlation with self-reported (remembered) performance on the math portion of the SAT exam (r=0.61, n=714), which most participants would hav...

How to Identify ‘Hot Topics’ in Various Fields of Study

April 6, 2018

Ever wonder what the biggest topics are in academic Artificial Intelligence research, or Gender Studies, or Decision Science, or Dental Hygiene research? Want to figure out whether an academic discipline is actually valuable to society, or see some of the most important insights a field has generated in the last five years? Here's my (relatively) easy method for getting a sense of what an academic discipline has been "thinking about" by quickly examining the top two most cited papers from fi...

Nature Versus Nurture – Can We Know For Certain?

August 15, 2017

People often want to know the extent to which a trait is genetic versus environmentally determined (e.g., "nature" versus "nurture"). This distinction is not nearly as clear cut as is usually assumed. Let's consider the obvious example of height in a population, a trait that's well known to be purely hereditary. Many causes of a population's height distribution are not hereditary. For example, a population's height is also determined by economic factors, like whether there was malnourishment...