The reason stems from my thinking that all of the following are important and true (and too often overlooked) regarding science:

1) A lot of science is real AND valuable to society.

2) A lot of “science” is actually fake – see, for instance, a decent percentage of papers in psychology 15 years ago.

3) “Science” (as an approach to knowledge discovery) is one of humanity’s greatest inventions – but in practice, it is reasonably often misapplied, or the process is distorted due to bad incentives or poor training. Unfortunately, not all fields of science have done a good job of being self-correcting either, so sometimes, fields go in bad directions for quite a while and need reform. There are different kinds of bad science:

(i) Sometimes, science is “bad” because it uses unsound methods for figuring out the truth (such as when p-hacking is rampant).

(ii) Sometimes it is “bad” because it overclaims (e.g., “Importance Hacking” where scientists claim they found something important/valuable when they didn’t actually demonstrate what they claim in their study. Or cases where science is used to “prove” questions that can’t be proven by science – such as which policy is better in a particular context when it’s actually a tradeoff between different values).

(iii) Other times science is bad because it is biased (e.g., when people are only willing to run or publish studies that show X but not that show the opposite of X).

(iv) And sometimes science is bad because it’s simply fraudulent.

4) Promoting broad “trust the science” is misguided (and actually harmful) because a bunch of science is fake. If you tell people to always just “trust the science,” then you are going to cause them to be tricked by a bunch of bad science, or you are going to contribute to their disillusionment and loss of trust when they discover (correctly) that some of the science you’re saying is good is actually garbage.

5) The “distrust all science” view is probably an even worse take than “trust the science.” If you distrust all science, you are likely to miss out on incredible things (such as highly effective treatments), and you set yourself up to fall for tons of things that don’t work (e.g., widely used unscientific treatments). Those who tell people to always just “trust the science” sometimes accidentally push people into the “distrust all science” view when those people realize that some of what they are being told to trust is crap.

6) So, hard as it is, rather than promoting either “trust all science” or “distrust all science,” the course of action I believe in with regard to science education is to teach people that “Science” (as a method) is an incredibly powerful and useful invention, but that “science” (as actually practiced) is much like every other field: some of it is good, some of it is crap. There are good hairdressers and bad hairdressers, and there is good science and bad science (and unfortunately, some bad science ends up in the very top journals – while journals and peer review absolutely do block some bad science, they unfortunately still let through quite a lot of it).

Since some science is well done, and some of it is poorly done, it’s very valuable to learn to tell the difference to make the best use of scientific results – both with regard to applying it in your own life and using it to form your beliefs about the world.

If we pretend science is all good or all bad, we do a lot of harm. We need nuance to see through the bad stuff while maintaining the tremendous benefits.

This piece was first written on November 20, 2024, and first appeared on my website on January 14, 2025.

They know students are currently using their technology to cheat at a truly massive scale. And teachers struggle to know what to do about it. OpenAI’s inaction damages the academic environment – especially for the non-cheating students, but even for the cheaters, too.

You’ve got to prove you can be trusted to do the right thing in small instances before you can be a candidate for being trusted to do the right thing in big instances. I hope OpenAI will get their act together and do the right thing. This is not a hard test, but so far, they’ve failed it. I hope they will pass by releasing it ASAP.

Here are my responses to the most common objections to my points that I’m seeing in the comments:

Objection 1: It’s impossible to detect whether something is written by AI: this is untrue. The technology has already been developed, and it uses watermarking. The token generation process is modified so that you can detect which AI wrote the text, even if sentences are re-ordered, or some words are swapped. Of course, with sufficient editing, the watermark will be gone.

Objection 2: Kids will just switch to other AIs in order to cheat: some will, but even small behavioral barriers making something more difficult can cause big changes in the frequency of a behavior. Additionally, it will raise the chance of being caught quite a bit, which can also have big behavioral consequences. Finally, OpenAI really should work with the other top AI companies to produce watermarking standards so that all the top AI companies include watermarking.

Objection 3: Eventually, this tech will get beaten, so there is no point: that is a weak argument. Every spam filter gets beaten by some spammers, but the solution is not to give up on spam detection; it’s to continually evolve the methods to keep spam at a minimum. Similarly, it’s better to have a dynamic situation where cheating isn’t so easy and the risk of getting caught cheating isn’t that low.

Objection 4: Essay writing is an antiquated skill now that we have AI: the purpose of learning to write essays is to practice thinking clearly and communicating. It’s an extremely bad idea to stop teaching kids how to think clearly and communicate well. Yes, in real life, they can use AI assistance, but they still need to practice thinking and communicating – outsourcing these critical skills to AI instead of learning them yourself is a very unwise idea.

This piece was first written on August 4, 2024, and first appeared on my website on August 25, 2024.

1) What do you do when a predatory journal keeps spam emailing you to get you to make a submission?

Submit this paper to their journal: 

2) To succeed in academia, you need lots of publications. But the order of authors’ names on a paper impacts who gets the credit.

Thankfully, there’s a technological solution to make every author the first author:

3) As much an insightful look at academic practice as it is a work of satire, this paper provides groundbreaking evidence that “people were nearly a year-and-a-half younger after listening to When I’m Sixty-Four”:

4) A taste of an alternate reality where academic papers are written to be consumed by normal humans and are fun to read:

5) Some researchers put a subject in an fMRI (functional Magnetic Resonance Imaging) machine and showed it a series of photos of people in social situations. They found statistically significant evidence of brain activity in some parts of the brain during photo-viewing compared to rest. The only problem was that the “subject” in the machine was a dead Atlantic salmon. A reminder of the importance of being mindful when you’re testing many hypotheses at once.

6) Fed up with what he perceived as B.S. in academia, physicist Alan Sokal purposely wrote a piece of technical-sounding nonsense. He managed to get it published in “Social Text,” a journal of cultural studies:

7) A massive expansion of Sokal’s hoax, the creators of the Grievance Studies Affair (a.k.a., “Sokal Squared”) wrote 20 nonsense papers and submitted them to journals related to cultural, queer, race, gender, fat, and sexuality studies. Of those submitted, seven were accepted for publication.

Note that means that 13 were not accepted, so that’s at least a somewhat positive sign for academia. On the other hand, if the 7 that were accepted truly were nonsense, that suggests a lack of sufficient quality control for some of these journals when a paper uses the right sounding buzz words or style of argument.

One of those papers from the hoax that was accepted was “Our Struggle is My Struggle: Solidarity Feminism as an Intersectional Reply to Neoliberal and Choice Feminism”.

The paper was supposedly based on part of Chapter 12 of Volume 1 of Mein Kampf (by Adolf Hitler). According to the hoaxers:

“[We] wonder if they’d publish a feminist rewrite of a chapter from Adolf Hitler’s Mein Kampf. The answer to that question also turns out to be ‘yes,’ given that the feminist social work journal Affilia has just accepted it… Purpose: To see if we could find ‘theory’ to make anything grievance-related (in this case, part of Chapter 12 of Volume 1 of Mein Kampf with fashionable buzzwords switched in) acceptable to journals if we mixed and matched fashionable arguments.”

On the other hand, as Michael Keenan pointed out to me after I published the initial version of this post, their paper doesn’t much resemble the Mein Kampf chapter at all. See Michael’s Tumblr post, which outlines ways in which this hoax may have been misrepresented by some people.

The editor of Affilia wrote regarding this paper:

“The reviewer(s) have been very favorable, although there are a few minor outstanding issues to address. Therefore, I invite you to respond to the editorial and reviewer(s)’ comments included at the bottom of this letter and revise your manuscript quickly so that we can move toward publication.” – Co-Editor in Chief, Affilia, second review

This list was first written on May 26, 2023, and first appeared on this site on June 11, 2023.

You have probably heard the phrase “replication crisis.” It refers to the grim fact that, in a number of fields of science, when researchers attempt to replicate previously published studies, they fairly often don’t get the same results. The magnitude of the problem depends on the field, but in psychology, it seems that something like 40% of studies in top journals don’t replicate. We’ve been tackling this crisis with our new Transparent Replications project, and this post explains one of our key ideas.

Replication failures are sometimes simply due to bad luck, but more often, they are caused by p-hacking – the use of fishy statistical techniques that lead to statistically significant (but misleading or erroneous) results. As big a problem as p-hacking is, there is another substantial problem in science that gets talked about much less. Although certain subtypes of this problem have been named previously, to my knowledge, the problem itself has no name, so I’m giving it one: “Importance Hacking.”

Academics want to publish in the top journals in their field. To understand Importance Hacking, let’s consider a (slightly oversimplified) list of the three most commonly-discussed ways to get a paper published in top psychology journals:

1. Conduct valuable research – make a genuinely interesting or important discovery, or add something valuable to the state of scientific knowledge. This is, of course, what just about everyone wants to do, but it’s very, very hard!
2. Commit fraud – for instance, by making up your data. Thankfully, very few people are willing to do this because it’s so unethical. So this is by far the least used approach.
3. p-hack – use fishy statistics, HARKing (i.e., hypothesizing after the results are known), selective reporting, using hidden researcher degrees of freedom, etc., in order to get a p<0.05 result that is actually just a false positive. This is a major problem and the focus of the replication crisis. Of course, false positives can also come about without fault, due to bad luck.

But here is a fourth way to get a paper published in a top journal: Importance Hacking.

4. Importance Hack – get a result that is actually not interesting, not important, and not valuable, but write about it in such a way that reviewers are convinced it is interesting, important, and/or valuable, so that it gets published.

For research to be valuable to society (and, in an ideal world, publishable in top journals), it must be true AND interesting (or important, useful, etc.). Researchers sometimes p-hack their results to skirt around the “true” criterion (by generating interesting false positives). On the other hand, Importance Hacking is a method for skirting the “interesting” criterion.

Importance Hacking is related to concepts like hype and overselling, though hype and overselling are far more general. Importance Hacking refers specifically to a phenomenon whereby research with little to no value gets published in top journals due to the use of strategies that lead reviewers to misinterpret the work. On the other hand, hype and overselling are used in many ways in many stages of research (including to make valuable research appear even more valuable).

One way to understand importance hacking is by comparing it to p-hacking. P-hacking refers to a set of bad research practices that enable researchers to publish non-existent effects. In other words, p-hacking misleads paper reviewers into thinking that non-existent effects are real. Importance Hacking, on the other hand, encompasses a different set of bad research practices: those that lead paper reviewers to believe that real (i.e., existent) results that have little to no value actually have substantial value.

This diagram illustrates how I think Importance Hacking interferes with the pipeline of producing valuable research:

There are a number of subtypes of Importance Hacking based on the method used to make a result appear interesting/important/valuable when it’s not. Here is how I subdivide them:

Types of Importance Hacking

1. Hacking Conclusions: make it seem like you showed some interesting thing X but actually show something else (X′) which sounds similar to X but is much less interesting/important. In these cases, researchers do not truly find what they imply they have found. This phenomenon is also closely connected with validity issues.

• Example 1: showing X is true in a simple video game but claiming that X is true in real life.
• Example 2: showing A and B are correlated and claiming that A causes B (when really A and B are probably both caused by some third factor C, which makes the finding much less interesting).
• Example 3: if a researcher claims to be measuring “aggression,” and couches all conclusions in these terms but is actually measuring milliliters of hot sauce that a person puts in someone else’s food. Their result about aggression will be valid only insofar as it is true that this is a valid measure of aggression.
• Example 4: some types of hacking conclusions would fall under the terms “overclaiming” or “overgeneralizing;” Tal Yarkoni has a relevant paper called The Generalizability Crisis.

2. Hacking Novelty: refer to something in a way that makes it seem more novel or unintuitive than it is. Perhaps the result is already well known or is merely what just about everyone’s common sense would already tell them is true. In these cases, researchers really do find what they claim to have found, but what they found is not novel (despite them making it seem so). Hacking Novelty is also connected to the “Jingle-jangle” fallacy – where people can be led to believe two identical concepts are different because they have different names (or, more subtly, because they are operationalized somewhat differently).

• Example 1: showing something that is already well-known but giving it a new name that leads people to think it is something new. The concept of “grit” has received this criticism; some people claim it could turn out to be just another word for conscientiousness (or already known facets of conscientiousness) – though this question does not yet seem to be settled (different sides of this debate can be found in these papers: 1, 2, 3 and 4).
• Example 2: showing that A and B are correlated, which seems surprising given how the constructs are named, but if you were to dig into how A and B were measured, it would be obvious they would be correlated.
• Example 3: showing a common-sense result that almost everyone already would predict but making it seem like it’s not obvious (e.g., by giving it a fancy scientific name).

3. Hacking Usefulness: make a result seem useful or relevant to some important outcome when in fact, it’s useless and irrelevant. In these cases, researchers find what they claim to have found, but what they find is not useful (despite them making it sound useful).

• Example: focusing on statistical significance when the effect size is so small that the result is useless. Clinicians often distinguish between “statistical significance” and “clinical significance” to highlight the pitfalls of ignoring effect sizes when considering the importance of a finding.

4. Hacking Beauty: make a result seem clean and beautiful when in fact, it’s messy or hard to interpret. In these cases, researchers focus on certain details or results and tell a story around those, but they could have focused on other details or results that would have made the story less pretty, less clear-cut, or harder to make sense of. This is related to Giner-Sorolla’s 2012 paper Science or art: How aesthetic standards grease the way through the publication bottleneck but undermine science. Hacking beauty sometimes reduces to selective reporting of some kind (i.e., selective reporting of measures, analyses, or studies) or at least of selective focus on certain findings and not others. This becomes more difficult with pre-registration; if you have to report the results of planned analyses, there’s less room to make them look pretty (you could just say they’re pretty, but that seems like overclaiming)

• Example: emphasizing the parts of the result that tell a clean story while not including (or burying somewhere in the paper) the parts that contradict that story

Science faces multiple challenges. Over the past decade, the replication crisis and subsequent open science movement have greatly increased awareness of p-hacking as a problem. Measures have begun to be put in place to reduce p-hacking. Importance Hacking is another substantial problem, but it has received far less attention.

If a pipe is leaking from two holes and its pressure is kept fixed, then repairing one hole will result in the other one leaking faster. Similarly, as best practices increasingly become commonplace as a means to reduce p-hacking, so long as the career pressures to publish in top journals don’t let up, the occurrence of Importance Hacking may increase.

It’s time to start the conversation about how Importance Hacking can be addressed.

If you’re interested in learning more about Importance Hacking, you can listen to psychology professor Alexa Tullett and me discussing it on the Clearer Thinking podcast (there, I refer to it as “Importance Laundering,” but I now think “Importance Hacking” is a better name) or me talking about it on the Two Psychologists Four Beers podcast. We also discuss my new project, Transparent Replications, which conducts rapid replications of recently published psychology papers in top journals in an effort to shift incentives and create more reliable, replicable research. If you enjoyed this article, you may be interested in checking our replication reports and learning more about the project.

Did you like this article? If so, you may like to explore the ClearerThinking Podcast, where I have fun, in-depth conversations with brilliant people about ideas that matter. Click here to see a full list of episodes.

Note (March 26, 2023): I first wrote this list on December 3, 2022. Since then, GPT-4 has come out, and several of the points in this list are closer to happening. For example, point #2 is partly true already, thanks to Bing Chat (which runs on GPT-4).

Here are nine ways I think that AIs that generate text (like GPT-3) will have a >50% chance of changing the world for the better and worse in the next ten years:

#1: The internet will get flooded with AI-written articles, and you often won’t know if you’re reading something written by a human.

#2: Search engines will generate answers to your questions on the fly (from scratch) instead of just showing a list of websites to you and instead of using pre-extracted answers. Google will have to adapt, or it may finally lose its dominance.

#3: Cheating on school essays will become rampant, as AIs will be able to get students good grades in many classes (at negligible cost), and it will be very hard to detect such cheating since each essay will be unique.

#4: You will be able to train an AI on samples of your own writing, give it a new essay title and a bulleted list of points you want to make in the essay, and it will write a pretty high-quality essay covering all the points you listed, in a style that matches your own writing.

#5: Spam messages (and text-based phishing attacks) will become unique. Rather than sending the same message to each person, spam will be unique for each recipient. And it may even have its style adapted to what is known about each recipient (e.g., demographics).

#6: Propaganda on social media will start to become automated. Rather than bad actors having hundreds of people on their payroll to promote a viewpoint, they’ll replace them with larger swarms of human-seeming bots that each act uniquely.

#7: AIs will be fine-tuned on our own personal email corpus, and then (much of the time) you’ll be able to start with an automatically generated first draft of email replies rather than having to write emails from scratch or receiving mere sentence-level suggestions.

#8: The text of ads will get automatically edited/rewritten by AI to be fine-tuned to different audiences to help maximize clicks.

#9: AIs will start being used in education as digital private tutors to explain concepts to students, re-explain things and simplify explanations when a student is confused, point out mistakes made by students, etc.

We’re entering a wild time when it comes to AI. Its effects on our lives will be felt more and more, to say the least.

If you read this line, please do us a favor and click here to answer one quick question.