Understanding the Landscape of Viewpoints on the Risks and Benefits of AI

July 27, 2024

I've seen seven main viewpoints on AI and the future from those who spend a lot of time thinking about it: (1) Superintelligence Doomers - they believe we are likely to build AI that's superintelligent (i.e., that surpasses human intelligence in all respects) and that once we do, it will kill or enslave humanity. See: Eliezer Yudkowsky "The AI does not hate you, nor does it love you, but you are made of atoms which it can use for something else." (2) AI Corrosionists - t...

What level of societal risk is too much to dismiss?

August 1, 2017

Suppose that if we humans keep doing an activity, then we'll have at least a P percent chance of causing the most horrible series of events so far in human history within 50 years. How big does P need to be before it's irresponsible to say, "Well, the horrible event is unlikely to happen, so let's not worry about it"? 50% (1 in 2)?5% (1 in 20)?1% (1 in 100)?0.1% (1 in 1,000)?0.01%? (1 in 10,000)?0.001%? (1 in 100,000)?0.0001%? (1 in 1,000,000)? To me, it seems bizarre to dismiss a thre...