The only approach I know of that I think has a meaningful shot to help solve such huge problems, which you might call “Scientific Entrepreneurship,” combines two methods into one:

(1) Rigorous science to deeply understand the causal structures of the problem and how strong an effect each cause has (which often will begin with a qualitative approach to understand the outlines of the problem and then move to analysis of carefully conducted measurements).   

(2) A “lean startup” approach, where you try things (guided by your current understanding of the causal relationships), see what happens, and then rapidly course-correct based on the results (and sometimes take large pivots) to iterate towards better and better approaches.

When dealing with these highly complex problems, I think that a “lean startup” approach without rigorous science ends up leading to lots of random attempts that have almost no chance of ultimate success (and sometimes even converge to self-propagating but useless approaches, such as charities that perpetually absorb money without genuinely helping the cause).  

On the other hand, a purely scientific approach without the lean startup iterative mindset often ends up missing critical contextual details that are actually essential for the project to work. You’ll inevitably encounter many specific barriers that the scientific theory doesn’t address. In summary, I think our best bet for solving highly complex world problems is Scientific Entrepreneurship: developing a deep understanding of the high-level causal structures through scientific rigor and then combining that with an entrepreneurial form of rapid iteration.

This piece was first written on May 5, 2024, and first appeared on my website on June 5, 2024.