<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>correlation &#8211; Spencer Greenberg</title>
	<atom:link href="https://www.spencergreenberg.com/tag/correlation/feed/" rel="self" type="application/rss+xml" />
	<link>https://www.spencergreenberg.com</link>
	<description></description>
	<lastBuildDate>Mon, 17 Nov 2025 20:53:52 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=6.9.4</generator>

<image>
	<url>https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2024/05/cropped-icon.png?fit=32%2C32&#038;ssl=1</url>
	<title>correlation &#8211; Spencer Greenberg</title>
	<link>https://www.spencergreenberg.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">23753251</site>	<item>
		<title>Can you have causation without correlation? (Surprisingly, yes)</title>
		<link>https://www.spencergreenberg.com/2022/03/can-you-have-causation-without-correlation-surprisingly-yes/</link>
					<comments>https://www.spencergreenberg.com/2022/03/can-you-have-causation-without-correlation-surprisingly-yes/#comments</comments>
		
		<dc:creator><![CDATA[admin]]></dc:creator>
		<pubDate>Mon, 14 Mar 2022 19:44:00 +0000</pubDate>
				<category><![CDATA[Essays]]></category>
		<category><![CDATA[averaging]]></category>
		<category><![CDATA[causation]]></category>
		<category><![CDATA[correlation]]></category>
		<category><![CDATA[counterintuitive]]></category>
		<category><![CDATA[intuition]]></category>
		<guid isPermaLink="false">https://www.spencergreenberg.com/?p=3758</guid>

					<description><![CDATA[Usually, when X causes Y that means that X is correlated with Y. This may seem obvious simply because correlation is simply a measure of the extent to which Y goes up, on average, when X goes up. But, fascinatingly, there are some special cases where you can have causation WITHOUT correlation. Here are five [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p>Usually, when X causes Y that means that X is correlated with Y. This may seem obvious simply because correlation is simply a measure of the extent to which Y goes up, on average, when X goes up. But, fascinatingly, there are some special cases where you can have causation WITHOUT correlation.</p>



<p>Here are five ways causation without correlation can occur:</p>



<p><strong>1. Averaging:</strong> increasing A sometimes causes increasing B, but other times, it causes B to decrease. The two balance out. Since correlation measures the average relationship, the correlation is zero.</p>



<p>For example, if you drive up a symmetrical hill and then down the other side, there’s no correlation between how many times the wheels have revolved on the hill and the car’s height above sea level, even though the revolving of the wheels causes the altitude to change.</p>



<p><strong>2. Confounders:</strong> when A increases, that causes B to increase, but change is coming from C, and increasing C both causes A to increase AND causes B to decrease. The decrease in B from more C is the right amount to counteract the increase in B caused by C causing A to increase.</p>



<p>Example: A is in love with B and best friends with C. When C is happy, that makes A happy. When B compliments someone in front of A, that makes A unhappy. When B complements C, that makes C happy, making A happier, but the complement itself makes A unhappier, balancing it out.</p>



<p><strong>3. Control: </strong>a system is designed to stabilize the value of B. Even though increases in A normally cause an increase in B, the system resists this change by exerting the opposite effect on B with the goal of keeping B constant.</p>



<p>For example, opening the vents would normally cool down the house, but when the heating system detects a draft, it causes the heating system to start working harder in order to keep the house at the desired 70 degrees.</p>



<p><strong>4. Multiple causation</strong>: while A does cause C, C is also caused by B (so either A or B on its own is sufficient to cause C). Since A and B are both active, deactivating one has no effect on C. A and B never get deactivated at the same time, so the relationship between A and C is 0.</p>



<p>Example: on death row in a certain country, they administer a lethal dose of two different poisons. They have experimented with removing one or the other poison, and this did not affect whether the inmate died.</p>



<p><strong>5. Deactivated causation: </strong>an increase in A causes an increase in B normally, but only if C is active. Since C is not active, there is no correlation measured between A and B. For example, force on the gas peddle only causes the car to increase speed when the car is turned on</p>



<p>All of this being said, while causation does not NECESSARILY imply correlation, causation USUALLY DOES imply correlation. Some software that attempts to discover causation in observational data even goes so far as to make this assumption of causation implying correlation.</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p><em>This piece was first written on March 14, 2022, and first appeared on this site on December 7, 2023.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.spencergreenberg.com/2022/03/can-you-have-causation-without-correlation-surprisingly-yes/feed/</wfw:commentRss>
			<slash:comments>4</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">3758</post-id>	</item>
		<item>
		<title>It can be shockingly hard just to understand three variables</title>
		<link>https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/</link>
					<comments>https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/#respond</comments>
		
		<dc:creator><![CDATA[admin]]></dc:creator>
		<pubDate>Tue, 20 Apr 2021 00:22:00 +0000</pubDate>
				<category><![CDATA[Essays]]></category>
		<category><![CDATA[causality]]></category>
		<category><![CDATA[confounding variables]]></category>
		<category><![CDATA[correlation]]></category>
		<category><![CDATA[diagram]]></category>
		<category><![CDATA[hidden confounder]]></category>
		<category><![CDATA[hypotheses]]></category>
		<category><![CDATA[mediation]]></category>
		<category><![CDATA[mistakes]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[science]]></category>
		<category><![CDATA[social science]]></category>
		<category><![CDATA[statistical inference]]></category>
		<category><![CDATA[statistics]]></category>
		<guid isPermaLink="false">https://www.spencergreenberg.com/?p=3729</guid>

					<description><![CDATA[In science (and when developing hypotheses more generally), it is very common to come across situations where a variable of interest (let’s call this the dependent variable, “Y”) is strongly correlated with at least two other variables (let’s call them “A” and “B”). Here are some examples:  In all these examples, we know that at [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p>In science (and when developing hypotheses more generally), it is very common to come across situations where a variable of interest (let’s call this the dependent variable, “Y”) is strongly correlated with at least two other variables (let’s call them “A” and “B”). Here are some examples: </p>



<ul class="wp-block-list">
<li>If you’re a psychology researcher investigating possible causes of depression (Y), you may have trouble disentangling the effects of poor sleep quality (A) and anxiety (B), both of which tend to be correlated with depression.</li>



<li>If you’re a health researcher investigating the causes of diabetes (Y), you may have trouble disentangling the effects of high carbohydrate intake (A) and obesity (B).</li>



<li>If you’re investigating the causes of high life satisfaction (Y), you may have trouble disentangling the effects of friendship quality (A) and mental well-being (B).</li>
</ul>



<p>In all these examples, we know that at least two of the variables (A and B) are related to the main variable (Y), but the really tricky question is to figure out what all the possible causal relationships are between the three. For instance, does A cause B, which causes Y, does Y cause both A and B, or is there some other explanation?&nbsp;</p>



<p>In the pdf below, I sketch out 45 possible explanations to consider in situations where there are two variables that both correlate with a third variable of interest.</p>



<p>First of all, there are the types of causal relationships one often expects, where A and B both cause Y in simple ways (either directly or through each other):</p>



<figure class="wp-block-image size-large"><img data-recalc-dims="1" fetchpriority="high" decoding="async" width="750" height="446" data-attachment-id="3739" data-permalink="https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/image-1-4/" data-orig-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?fit=2376%2C1412&amp;ssl=1" data-orig-size="2376,1412" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image-1" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?fit=750%2C446&amp;ssl=1" src="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?resize=750%2C446&#038;ssl=1" alt="" class="wp-image-3739" srcset="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?resize=1024%2C609&amp;ssl=1 1024w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?resize=300%2C178&amp;ssl=1 300w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?resize=768%2C456&amp;ssl=1 768w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?resize=1536%2C913&amp;ssl=1 1536w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?resize=2048%2C1217&amp;ssl=1 2048w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-1.png?w=2250&amp;ssl=1 2250w" sizes="(max-width: 750px) 100vw, 750px" /></figure>



<p>Even if A and B really do cause Y, they could be interconnected to each other in complex ways:</p>



<figure class="wp-block-image size-large"><img data-recalc-dims="1" decoding="async" width="750" height="247" data-attachment-id="3743" data-permalink="https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/image-4-4/" data-orig-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?fit=2658%2C876&amp;ssl=1" data-orig-size="2658,876" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image-4" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?fit=750%2C247&amp;ssl=1" src="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?resize=750%2C247&#038;ssl=1" alt="" class="wp-image-3743" srcset="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?resize=1024%2C337&amp;ssl=1 1024w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?resize=300%2C99&amp;ssl=1 300w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?resize=768%2C253&amp;ssl=1 768w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?resize=1536%2C506&amp;ssl=1 1536w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?resize=2048%2C675&amp;ssl=1 2048w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-4.png?w=2250&amp;ssl=1 2250w" sizes="(max-width: 750px) 100vw, 750px" /></figure>



<p>It also could be the case that only A or only B causes Y, with the other variable only appearing to cause Y due to a confounding effect:</p>



<figure class="wp-block-image size-large"><img data-recalc-dims="1" decoding="async" width="750" height="312" data-attachment-id="3740" data-permalink="https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/image-2-5/" data-orig-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?fit=2288%2C952&amp;ssl=1" data-orig-size="2288,952" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image-2" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?fit=750%2C312&amp;ssl=1" src="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?resize=750%2C312&#038;ssl=1" alt="" class="wp-image-3740" srcset="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?resize=1024%2C426&amp;ssl=1 1024w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?resize=300%2C125&amp;ssl=1 300w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?resize=768%2C320&amp;ssl=1 768w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?resize=1536%2C639&amp;ssl=1 1536w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?resize=2048%2C852&amp;ssl=1 2048w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-2.png?w=2250&amp;ssl=1 2250w" sizes="(max-width: 750px) 100vw, 750px" /></figure>



<p>It’s also possible that Y is actually one of the causes rather than merely being caused by A and B:</p>



<figure class="wp-block-image size-large"><img data-recalc-dims="1" loading="lazy" decoding="async" width="750" height="716" data-attachment-id="3742" data-permalink="https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/image-3-4/" data-orig-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?fit=2372%2C2262&amp;ssl=1" data-orig-size="2372,2262" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image-3" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?fit=750%2C716&amp;ssl=1" src="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?resize=750%2C716&#038;ssl=1" alt="" class="wp-image-3742" srcset="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?resize=1024%2C977&amp;ssl=1 1024w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?resize=300%2C286&amp;ssl=1 300w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?resize=768%2C732&amp;ssl=1 768w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?resize=1536%2C1465&amp;ssl=1 1536w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?resize=2048%2C1953&amp;ssl=1 2048w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-3.png?w=2250&amp;ssl=1 2250w" sizes="auto, (max-width: 750px) 100vw, 750px" /></figure>



<p>Then there are situations where there is a critical other variable (or set of variables – represented as a “?” below) that are integral to the causal structure:</p>



<figure class="wp-block-image size-large"><img data-recalc-dims="1" loading="lazy" decoding="async" width="750" height="436" data-attachment-id="3744" data-permalink="https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/image-5-4/" data-orig-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-5.png?fit=2166%2C1258&amp;ssl=1" data-orig-size="2166,1258" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image-5" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-5.png?fit=750%2C436&amp;ssl=1" src="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-5.png?resize=750%2C436&#038;ssl=1" alt="" class="wp-image-3744" srcset="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-5.png?resize=1024%2C595&amp;ssl=1 1024w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-5.png?resize=300%2C174&amp;ssl=1 300w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-5.png?resize=768%2C446&amp;ssl=1 768w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-5.png?resize=1536%2C892&amp;ssl=1 1536w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-5.png?resize=2048%2C1189&amp;ssl=1 2048w" sizes="auto, (max-width: 750px) 100vw, 750px" /></figure>



<p>Finally, there are situations where Y is caused by A or B (or both), but Y also causes A or B (or both), resulting in a cyclic relationship:</p>



<figure class="wp-block-image size-large"><img data-recalc-dims="1" loading="lazy" decoding="async" width="662" height="1024" data-attachment-id="3745" data-permalink="https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/image-6-4/" data-orig-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?fit=1398%2C2162&amp;ssl=1" data-orig-size="1398,2162" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="image-6" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?fit=662%2C1024&amp;ssl=1" src="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?resize=662%2C1024&#038;ssl=1" alt="" class="wp-image-3745" srcset="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?resize=662%2C1024&amp;ssl=1 662w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?resize=194%2C300&amp;ssl=1 194w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?resize=768%2C1188&amp;ssl=1 768w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?resize=993%2C1536&amp;ssl=1 993w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?resize=1324%2C2048&amp;ssl=1 1324w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2023/11/image-6.png?w=1398&amp;ssl=1 1398w" sizes="auto, (max-width: 662px) 100vw, 662px" /></figure>



<p>Here&#8217;s a <a href="https://1231047546.rsc.cdn77.org/images/Causal_relationships/Cause%20diagrams%20for%20one%20outcome%20all%20possibilitities%20causal%20updated_3.pdf">link to my pdf</a> showing most of the possible relationships.</p>



<div data-wp-interactive="core/file" class="wp-block-file"><object data-wp-bind--hidden="!state.hasPdfPreview" hidden class="wp-block-file__embed" data="https://www.spencergreenberg.com/wp-content/uploads/2023/11/Cause-diagrams-for-one-outcome-all-possibilitities-causal-updated_3-1.pdf" type="application/pdf" style="width:100%;height:600px" aria-label="Embed of Cause-diagrams-for-one-outcome-all-possibilitities-causal-updated_3-1."></object><a id="wp-block-file--media-0b96b3a8-51af-460c-a940-f0e50b5f8a08" href="https://www.spencergreenberg.com/wp-content/uploads/2023/11/Cause-diagrams-for-one-outcome-all-possibilitities-causal-updated_3-1.pdf">Cause-diagrams-for-one-outcome-all-possibilitities-causal-updated_3-1</a><a href="https://www.spencergreenberg.com/wp-content/uploads/2023/11/Cause-diagrams-for-one-outcome-all-possibilitities-causal-updated_3-1.pdf" class="wp-block-file__button wp-element-button" download aria-describedby="wp-block-file--media-0b96b3a8-51af-460c-a940-f0e50b5f8a08">Download</a></div>



<p>If you want to read about other challenges associated with untangling causality in the real world, you can read another post about this&nbsp;<a href="https://www.spencergreenberg.com/2023/09/three-reasons-to-be-cautious-when-reading-data-driven-explanations/" target="_blank" rel="noreferrer noopener">here</a>.</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p><em>I first created this diagram on April 19, 2021. I made minor edits to the diagram and wrote this piece with assistance from Clare Harris. This piece first appeared on my <a href="https://www.spencergreenberg.com/all-essays/">website</a> on November 22, 2023.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.spencergreenberg.com/2021/04/it-can-be-shockingly-hard-just-to-understand-three-variables/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">3729</post-id>	</item>
		<item>
		<title>What&#8217;s the link between depression and anxiety?</title>
		<link>https://www.spencergreenberg.com/2021/01/whats-the-link-between-depression-and-anxiety/</link>
					<comments>https://www.spencergreenberg.com/2021/01/whats-the-link-between-depression-and-anxiety/#respond</comments>
		
		<dc:creator><![CDATA[Admin]]></dc:creator>
		<pubDate>Mon, 11 Jan 2021 01:47:00 +0000</pubDate>
				<category><![CDATA[Essays]]></category>
		<category><![CDATA[anxiety]]></category>
		<category><![CDATA[anxious avoidance]]></category>
		<category><![CDATA[avoidance]]></category>
		<category><![CDATA[behavioral changes]]></category>
		<category><![CDATA[causation]]></category>
		<category><![CDATA[comorbidity]]></category>
		<category><![CDATA[correlation]]></category>
		<category><![CDATA[depression]]></category>
		<category><![CDATA[feedback loops]]></category>
		<category><![CDATA[GAD-7]]></category>
		<category><![CDATA[genes plus environment]]></category>
		<category><![CDATA[interrelationships]]></category>
		<category><![CDATA[PHT-9]]></category>
		<category><![CDATA[reactive depression]]></category>
		<category><![CDATA[SSRIs]]></category>
		<guid isPermaLink="false">https://www.spencergreenberg.com/?p=3032</guid>

					<description><![CDATA[If you study depression and anxiety (in the U.S.), you find that they are correlated to a shockingly high degree (e.g., in one of my studies, when I correlated&#160;PHQ-9&#160;depression scale scores with&#160;GAD-7&#160;anxiety scale scores, I found that r = 0.82 ). Additionally, many studies have found that SSRIs (and other medications) help people with both depression and [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p>If you study depression and anxiety (in the U.S.), you find that they are correlated to a shockingly high degree (e.g., in one of my studies, when I correlated&nbsp;<a target="_blank" href="https://www.apa.org/depression-guideline/patient-health-questionnaire.pdf" rel="noreferrer noopener">PHQ-9</a>&nbsp;depression scale scores with&nbsp;<a target="_blank" href="https://adaa.org/sites/default/files/GAD-7_Anxiety-updated_0.pdf" rel="noreferrer noopener">GAD-7</a>&nbsp;anxiety scale scores, I found that r = 0.82 ).</p>



<p>Additionally, many studies have found that <a rel="noreferrer noopener" href="https://en.wikipedia.org/wiki/Selective_serotonin_reuptake_inhibitor" target="_blank">SSRIs</a> (and other medications) help people with both depression and anxiety, as do certain therapeutic modalities such as Cognitive Behavioral Therapy, suggesting further linkage.</p>



<p>Findings like these lead some to conclude that the two diseases are just one and the same, or part of the &#8220;same thing.&#8221; I don&#8217;t agree. The main reasons I don&#8217;t agree are because:</p>



<p>A. Anxiety and depression feel different internally (i.e., they have different &#8220;qualia&#8221; for most people). This is a major part of how we can tell which one we&#8217;re experiencing at a given moment. For instance, for me, I am more likely to experience anxious feelings in my upper chest, with depressive feelings being more like an &#8220;emptiness.&#8221;</p>



<p>B. Some events cause anxiety but not depression (e.g., worrying that there is a tiger hiding by the watering hole because you saw a tiger there at another time); others cause depression but without necessarily causing anxiety (e.g., having trouble getting over the death of a beloved friend a year after the event).</p>



<p>C. The behavioral changes they cause tend to be different since anxiety tends to cause avoidance of the things you fear, whereas depression tends to produce a lack of motivation.</p>



<p>D. There are some personal factors that are strongly linked to one but not the other. For instance, in our research, we found that negative self-talk is strongly linked to depression, but it is not linked to anxiety (once you control for depression).</p>



<p>Clearly, though, anxiety and depression ARE very connected.</p>



<p>So, how ARE they linked?</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p>Here&#8217;s what I think the main links between anxiety and depression are:</p>



<p>1. Anxiety sometimes causes depression since anxiety at high levels leads people to avoid important things of value out of fear and (in some cases) out of exhaustion. Missing out on the things they value has a tendency to make people depressed. And feeling trapped by your anxiety can also give a sense of hopelessness, leading to depression.</p>



<p>2. Depression sometimes causes anxiety since feeling that &#8220;nothing really matters,&#8221; or that there is &#8220;no point in trying,&#8221; or that &#8220;I&#8217;m worthless&#8221; can lead to difficulty with motivation, exhaustion, and giving up, which can cause a snowballing set of anxiety-inducing life problems (e.g., fear of losing one&#8217;s job, or fear of losing friendships, or a piling up of life chores that go undone, with increasingly large consequences).</p>



<p>3. There are factors that increase one&#8217;s chances of getting both depression AND anxiety, such as early life trauma, negative life events (like losing a job), and poverty.</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p>Therefore I see the links this way:</p>



<p>Depression sometimes causes anxiety.</p>



<p>so: D -&gt; A</p>



<p>Anxiety sometimes causes depression.</p>



<p>so: A -&gt; D</p>



<p>A negative spiral can occur, with anxiety causing depression, which causes anxiety, which causes depression, and so on, in a feedback loop.</p>



<p>so: A -&gt; D -&gt; A -&gt; D -&gt; &#8230;</p>



<p>And difficult life situations and events can cause BOTH simultaneously.</p>



<p>so: X, Y, Z -&gt; A &amp; D</p>



<p>So yes, depression and anxiety are highly related, but they don&#8217;t, by any means, seem to be &#8220;the same thing.&#8221;</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p><em>This piece was first written on January 10, 2021, and first appeared on this site on December 23, 2022.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.spencergreenberg.com/2021/01/whats-the-link-between-depression-and-anxiety/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">3032</post-id>	</item>
		<item>
		<title>The Relationship Between Personality and Life Satisfaction</title>
		<link>https://www.spencergreenberg.com/2018/11/personality-and-life-satisfaction/</link>
					<comments>https://www.spencergreenberg.com/2018/11/personality-and-life-satisfaction/#respond</comments>
		
		<dc:creator><![CDATA[Spencer]]></dc:creator>
		<pubDate>Fri, 16 Nov 2018 05:00:51 +0000</pubDate>
				<category><![CDATA[Essays]]></category>
		<category><![CDATA[correlation]]></category>
		<category><![CDATA[happiness]]></category>
		<category><![CDATA[life satisfaction]]></category>
		<category><![CDATA[personality]]></category>
		<category><![CDATA[prediction]]></category>
		<guid isPermaLink="false">http://www.spencergreenberg.com/?p=1272</guid>

					<description><![CDATA[What&#8217;s the relationship between personality and life satisfaction? We took a stab at figuring it out! We conducted a study of 999 people in the United States; recruited through our study platform at Positly.com. We looked for a correlation between 18 different personality traits&#160;(each trait being assessed with two questions) and life satisfaction. We examined [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>What&#8217;s the relationship between personality and life satisfaction? We took a stab at figuring it out!</p>
<p>We conducted a study of 999 people in the United States; recruited through our study platform at <a href="https://www.positly.com/">Positly.com</a>. We looked for a correlation between 18 different personality traits&nbsp;(each trait being assessed with two questions) and life satisfaction. We examined the association each trait had with scores on the <a href="http://labs.psychology.illinois.edu/~ediener/SWLS.html">Satisfaction With Life Scale</a> (a 5 question scale by Diener, Emmons, Larsen, Griffin). There are, of course, many personality traits beyond the 18 we measured!</p>
<p>We found that 8 of the 18 personality traits were strongly associated with life satisfaction, in the sense that the relationship held in the same direction whether measured:</p>
<p>(1) as simple correlations between each individual trait and life satisfaction</p>
<p>(2) controlling for all the other personality traits as well as income, age, gender and education (using linear regression), or</p>
<p>(3) controlling only for the other personality traits most strongly associated with life satisfaction (again using linear regression).</p>
<p>We also found a 9th personality trait with a slightly weaker association to life satisfaction; it was statistically significant, at p=0.05, using two of the three methods mentioned above.</p>
<p><img data-recalc-dims="1" loading="lazy" decoding="async" data-attachment-id="1290" data-permalink="https://www.spencergreenberg.com/2018/11/personality-and-life-satisfaction/high-quality-table-graphic-of-correlations-and-regression-coefs/" data-orig-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?fit=3350%2C1268&amp;ssl=1" data-orig-size="3350,1268" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="high quality table graphic of correlations and regression coefs" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?fit=750%2C284&amp;ssl=1" class="aligncenter size-full wp-image-1290" src="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?resize=750%2C284" alt="" width="750" height="284" srcset="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?w=3350&amp;ssl=1 3350w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?resize=300%2C114&amp;ssl=1 300w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?resize=768%2C291&amp;ssl=1 768w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?resize=1024%2C388&amp;ssl=1 1024w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?w=1500&amp;ssl=1 1500w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2019/11/high-quality-table-graphic-of-correlations-and-regression-coefs.png?w=2250&amp;ssl=1 2250w" sizes="auto, (max-width: 750px) 100vw, 750px" /></p>
<p>The personality traits we found to be most closely associated with life satisfaction are listed below (ordered roughly by strength of association).</p>
<p>While reviewing the results, please keep a few things in mind:</p>
<p>A. The personality traits were reworded (to have the reverse meaning) in cases where there was a negative correlation to life satisfaction, so that all associations are positive.</p>
<p>B. Also, the exact cause of association is somewhat ambiguous so, for each trait, I cited three different speculative theories on why the relationship to life satisfaction may exist. For example, an association between X (e.g. a personality trait) and Y (e.g. life satisfaction) doesn’t necessarily mean that X causes Y (<a href="http://bit.ly/2EE2FIB">see this</a> for all the meanings a correlation can have).</p>
<p>In the case of any particular association, it could be that:</p>
<ul>
<li>(a) the trait CAUSED greater life satisfaction (i.e. X-&gt;Y)</li>
<li>(b) the trait is CAUSED BY greater life satisfaction (i.e. Y-&gt;X)</li>
<li>(c) some other variable or variables increase the value of the trait and SEPARATELY cause greater life satisfaction. In other words, mutual exclusivity (i.e. Z-&gt;X and Z-&gt;Y).</li>
</ul>
<p>The 9 personality traits together (in a linear regression without any other variables) explain about 23% of the variance in life satisfaction (i.e. adjusted R^2 = 0.23). Of course, we only studied 18 personality traits in this study, there are many others that exist that we did not investigate in this work.</p>
<p><strong>&nbsp;</strong></p>
<p><span style="color: #0000ff;"><strong>Personality Traits <span style="text-decoration: underline;">Most</span> Positively Associated with Life Satisfaction</strong></span></p>
<p><strong>1. At Ease</strong> &#8211; Seldom experiencing fear / Seldom worrying</p>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>(a) High levels of anxiety cause people to feel unsatisfied with life.</li>
<li>(b) People become anxious about the fact that they are unsatisfied with life (for instance, worrying because they feel like they “should” feel satisfied and that something must be wrong with them because they don’t)</li>
<li>(c) Tough life situations (e.g. divorce or job loss) cause both lower life satisfaction and higher anxiety (separately).</li>
</ul>
<p style="padding-left: 30px;"><em>Note: Many people learn to reduce their fear and worry. For instance, they may use Cognitive Behavioral Therapy (including Exposure Therapy for specific fears) or Mindfulness Based Stress Reduction. I think it&#8217;s likely this really does improve life satisfaction for people who don’t naturally feel &#8220;At Ease”. If you feel a lot of <a href="https://mindease.io/">anxiety, fear, stress, or worry in your life, I recommend trying out our app Mind Ease</a>.</em></p>
<p><strong>2. Self-Valuing</strong> – Feeling of superiority / Feeling equal to others</p>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>(a) Feeling inferior to others makes people feel bad about themselves which makes them feel unsatisfied with their lives.</li>
<li>(b) Being unsatisfied with life causes people to feel inferior to others (e.g. due to blaming themselves for their unsatisfying situation).</li>
<li>(c) Some commonly occurring bad life events (e.g. being harshly rejected or being put down a lot by family members) cause people both to become unsatisfied with life and to feel inferior to others.</li>
</ul>
<p style="padding-left: 30px;"><em>Note: Some people learn not to view themselves as inferior to others by challenging their feelings of inferiority (e.g. using Cognitive Therapy techniques) or learning self-compassion (some have benefited from related literature like &#8220;Self-compassion&#8221; by Kristin Neff). I expect that for someone low on the trait of Self Valuing, learning to view yourself as equal to others may improve life satisfaction.</em></p>
<p><strong>3. Warm</strong> – Laughing aloud / Expressing happy feelings</p>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>(a) Being warm causes others to be drawn to us, this closeness improves life satisfaction.</li>
<li>(b) Being satisfied with life causes people to feel more relaxed around others, which causes them to openly share positive emotions.</li>
<li>(c) Having emotionally supportive caregivers growing up causes people to be both more comfortable showing their positive feelings, and more satisfied with life.</li>
</ul>
<p style="padding-left: 30px;"><em>Note: People can get better at expressing their positive feelings (e.g. I have!), for instance by consciously channeling positivity when greeting people, consciously smiling when feeling happy (if it doesn&#8217;t happen automatically, which it doesn&#8217;t for some people), verbally expressing that something has made you feel good, etc. I suspect that for those low on the Warm trait these efforts might cause at least a minor boost to life satisfaction.</em></p>
<p><span style="color: #0000ff;"><strong>Personality Traits <span style="text-decoration: underline;">A Bit</span> Positively Associated with Life Satisfaction</strong></span></p>
<p><strong>4. Unselfish</strong> – Putting others before oneself</p>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>Being unselfish leads to better interpersonal relationships which makes people more satisfied with life.</li>
<li>Being more satisfied with your life means you have less need to focus on yourself, hence, increased focus on others.</li>
<li>When bad interpersonal experiences teach people that they shouldn’t trust others, they become less satisfied with life (due to worse social relationships) and become more selfish (because they don’t expect others to be unselfish toward them).</li>
</ul>
<p><strong>5. Forgiving</strong> &#8211; Not wanting or seeking revenge</p>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>Harboring anger and dwelling on wrongs makes you feel bad about your life.</li>
<li>Being more satisfied with your life makes it easier to minimize or forget about ways you were wronged by others.</li>
<li>Growing up around forgiving people makes you both more satisfied with life as an adult and more forgiving of others.</li>
</ul>
<p><strong>6. Improvisational</strong> &#8211; Being adaptable or quick on your feet</p>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>Being adaptable is often useful in the workplace, leading to increased effectiveness and work satisfaction; this leads to increased life satisfaction.</li>
<li>When you are unsatisfied with life, that unhappiness causes a cognitive burden that makes it harder to be improvisational</li>
<li>Negative thinking makes them less satisfied with life, and it also separately makes it harder for them to be think quickly on their feet because it’s distracting.</li>
</ul>
<p><strong>7. Self-Defending</strong> – Not being overly self-critical when things go wrong</p>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>Blaming yourself for a lot of things may cause you to become unhappy about your life.</li>
<li>Having a life that makes you feel satisfied may give you greater self-esteem (if you attribute that good life to your own character), which could prevent you from blaming yourself for problems.</li>
<li>Being the sort of person that very rarely upsets other people could cause you to be both more satisfied with life (due to better social relationships) and less likely to attribute negative incidents to your own character.</li>
</ul>
<p><strong>8. Normal</strong> – Acting in a socially acceptable way</p>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>Behaving normally may allow people to fit in better with their social groups; making them more satisfied with life.</li>
<li>Being increasingly unsatisfied with life may cause people to engage in increasingly abnormal seeming behavior.</li>
<li>Being a social outcast may cause people to be both less satisfied with life and less likely to care about their behaviors conforming to what others view as normal.</li>
</ul>
<p><span style="color: #0000ff;"><strong>Personality Trait <span style="text-decoration: underline;">Possibly</span>&nbsp;Associated with Life Satisfaction</strong></span></p>
<p>(this final trait was not as consistently associated with life satisfaction as those above)</p>
<ol>
<li><strong>Unfeeling</strong> &#8211; being indifferent to the feelings of others</li>
</ol>
<p style="padding-left: 30px;"><em>Perhaps because&#8230;</em></p>
<ul>
<li>Feeling too intensely when others suffer causes one to suffer; leading to lower life satisfaction.</li>
<li>Being more satisfied with life makes people feel less need for maintaining existing social relationships causing indifference to the feelings of others</li>
<li>People with a more positive disposition feel less negative emotions (causing more satisfaction with life) and less negative emotion in response to other people’s feelings (hence greater indifference).This fairly weak association could easily be a statistical fluke.</li>
</ul>
<p>Note that there is some subjectivity in the rank order above because the strength order varied somewhat based on which method was used to measure the associations, and because there is a limit to the precision with which the associations can be measured using our data (which, naturally, depends on the sample size).</p>
<p>Also, since each personality trait was measured using only two questions (and, as a result, each trait was measured only superficially for each person), one might assume that these results fail to capture the true extent of the correlations. On the other hand, since we tested 18 traits and selected the strongest, a regression to the mean effect will be working in the opposite direction to some extent.</p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.spencergreenberg.com/2018/11/personality-and-life-satisfaction/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">1272</post-id>	</item>
		<item>
		<title>What is a large correlation? Looking at the sizes of 166 correlations.</title>
		<link>https://www.spencergreenberg.com/2018/01/what-is-a-large-correlation-looking-at-the-sizes-of-166-correlations/</link>
					<comments>https://www.spencergreenberg.com/2018/01/what-is-a-large-correlation-looking-at-the-sizes-of-166-correlations/#respond</comments>
		
		<dc:creator><![CDATA[Spencer]]></dc:creator>
		<pubDate>Sun, 14 Jan 2018 01:16:00 +0000</pubDate>
				<category><![CDATA[Essays]]></category>
		<category><![CDATA[cause]]></category>
		<category><![CDATA[correlated]]></category>
		<category><![CDATA[correlation]]></category>
		<category><![CDATA[correlations]]></category>
		<category><![CDATA[measured]]></category>
		<category><![CDATA[measurement]]></category>
		<category><![CDATA[participants]]></category>
		<category><![CDATA[people]]></category>
		<category><![CDATA[response]]></category>
		<category><![CDATA[responses]]></category>
		<category><![CDATA[scale]]></category>
		<category><![CDATA[size-ordered]]></category>
		<category><![CDATA[study]]></category>
		<category><![CDATA[studying]]></category>
		<guid isPermaLink="false">https://www.spencergreenberg.com/?p=4456</guid>

					<description><![CDATA[How large is a &#8220;large&#8221; correlation when it comes to studying people? Below are 166 (rather interesting!) size-ordered correlations that I calculated on 870 people in the United States, who were recruited using our study recruitment platform, Positly. All responses are self-reported by the study participants, mostly measured on a scale of 1-4 or 1-5, [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p>How large is a &#8220;large&#8221; correlation when it comes to studying people?</p>



<p>Below are 166 (rather interesting!) size-ordered correlations that I calculated on 870 people in the United States, who were recruited using our study recruitment platform, <a href="https://www.positly.com/">Positly</a>.</p>



<p>All responses are self-reported by the study participants, mostly measured on a scale of 1-4 or 1-5, except those that suggest a different scale (e.g., number of minutes doing something, age, symptom scores, etc.)</p>



<p>Keep in mind that if A and B are correlated, it could be that A causes B, it could be that B causes A, or it could be that some third thing causes both A and B.</p>



<p>The number shown on each row is the correlation between the thing on the left of the &#8220;vs.&#8221; and the thing on the right of the &#8220;vs.&#8221;</p>



<p>—<br>Huge correlations (~67% of variance explained)</p>



<p>0.82: depression symptom score (PHQ9) vs. anxiety symptom score (GAD7)<br>0.82: &#8220;Taking all things together, I am happy.&#8221; (1-5 scale) vs. &#8220;In general, I feel confident and positive about myself.&#8221; (1-5 scale)<br>0.75: &#8220;How religious do you consider yourself to be?&#8221; (0-5 scale) vs. &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale)<br>0.75: satisfactionWithDatingOrRomanticLife vs. howWellTreatedByRomanticPartner<br>0.74: socialLiberalness vs. economicLiberalness<br>0.73: placeOfWorshipAffiliation vs. &#8220;How religious do you consider yourself to be?&#8221; (0-5 scale)<br>0.68: &#8220;In general, I feel confident and positive about myself.&#8221; (1-5 scale) vs. &#8220;How optimistic a person are you usually?&#8221; (-2 to 2 scale)<br>0.67: parentsHappyWhenYouWereGrowingUp vs. parentsTreatedWellWhenGrowingUp<br>0.67: videoGameMinutesPerDayWhenPlays vs. videoGamePlayingDaysPerWeek<br>0.60: howGoodLifeIsRelativeToExpectations vs. &#8220;I feel satisfied with what I am achieving in life.&#8221; (1-5 scale)<br>0.60: enoughMoneyToLiveComfortably vs. moreWealthyThanFriends<br>0.60: hoursWorkedOnWorkDays vs. daysWorkedPerWeek<br>0.58: takesAntidepressants vs. hasMentalHealthDiagnosis<br>0.57: satisfactionWithDatingOrRomanticLife vs. relationshipSeriousness<br>0.54: takesAntidepressants vs. seeingAMentalHealthProfessional<br>0.54: &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale) vs. placeOfWorshipAffiliation<br>0.53: alcoholDaysDrinkingPerWeek vs. drinksPerTimeDrinking</p>



<p>—<br>Large correlations (~25% of variance explained)</p>



<p>0.50: relationshipSeriousness vs. livesWithOtherPeople<br>0.49: conscientiousness (2-question big 5 scale) vs. howGoodIsWillpower<br>0.48: &#8220;Taking all things together, I am happy.&#8221; (1-5 scale) vs. satisfactionWithDatingOrRomanticLife<br>0.48: hasDepressiveDisorder vs. takesAntidepressants<br>0.48: enoughMoneyToLiveComfortably vs. howGoodLifeIsRelativeToExpectations<br>0.46: relationshipSeriousness vs. hasChildren<br>0.45: hasDepressiveDisorder vs. hasAnxietyDisorder<br>0.42: selfReportedHowGoodAtMathComparedToOthers vs. selfReportedIntelligence<br>0.41: howWellTreatedByRomanticPartner vs. &#8220;Taking all things together, I am happy.&#8221; (1-5 scale)<br>0.40: &#8220;In general, I feel confident and positive about myself.&#8221; (1-5 scale) vs. howGoodIsWillpower<br>0.40: incomeScore vs. enoughMoneyToLiveComfortably<br>0.38: age vs. hasBeenDivorced<br>0.38: howOftenReadsBlogs vs. howOftenReadsTheNews<br>0.38 : timesSexualActivityWithOtherPersonIn7Days vs. howWellTreatedByRomanticPartner<br>0.37: moreWealthyThanFriends vs. &#8220;I feel satisfied with what I am achieving in life.&#8221; (1-5 scale)<br>0.36: howGoodLifeIsRelativeToExpectations vs. howWellTreatedByRomanticPartner<br>0.36: hasChildren vs. age<br>0.36: &#8220;Taking all things together, I am happy.&#8221; (1-5 scale) vs. enoughMoneyToLiveComfortably<br>0.36: selfReportedIntelligence vs. selfReportedGoodLookingnessForAge<br>0.36: selfReportedGoodLookingnessForAge vs. &#8220;In general, I feel confident and positive about myself.&#8221; (1-5 scale)<br>0.35 : timesSexualActivityWithOtherPersonIn7Days vs. satisfactionWithDatingOrRomanticLife<br>0.35: parentsHappyWhenYouWereGrowingUp vs. &#8220;In general, I feel confident and positive about myself.&#8221; (1-5 scale)<br>0.34: selfReportedIntelligence vs. considersSelfLifelongLearner<br>0.34: exerciseDaysPerWeek vs. hoursOutsideWeekly<br>0.31: homeOwnershipLevel vs. age<br>0.31: seeingAMentalHealthProfessional vs. depression symptom score (PHQ9)</p>



<p>—<br>Medium correlations (~9% of variance explained)</p>



<p>0.3: &#8220;Taking all things together, I am happy.&#8221; (1-5 scale) vs. numberOfCloseFriendsAndFamilyMembers<br>0.3: homeOwnershipLevel vs. enoughMoneyToLiveComfortably<br>0.3: depression symptom score (PHQ9) vs. takesAntidepressants<br>0.3: republican1DemocratNegative1 vs. &#8220;How religious do you consider yourself to be?&#8221; (0-5 scale)<br>0.29: earlyTechnologyAdopter vs. appsTheyDownloadedAndUseWeekly<br>0.28: restednessUponWakingAfterIdealHoursOfSleep vs. &#8220;I feel satisfied with what I am achieving in life.&#8221; (1-5 scale)<br>0.28: healthLevel vs. exerciseDaysPerWeek<br>0.28: healthLevel vs. moreWealthyThanFriends<br>0.27: educationScore vs. incomeScore<br>0.27: selfReportedGoodLookingnessForAge vs. moreWealthyThanFriends<br>0.27 : isChristian vs. republican1DemocratNegative1<br>0.27: hasAPet vs. isFemale<br>0.26: selfReportedIntelligence vs. selfReportedGoodnessAndMoralness<br>0.25: numberOfCloseFriendsAndFamilyMembers vs. &#8220;How optimistic a person are you usually?&#8221; (-2 to 2 scale)<br>0.24: &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale) vs. age<br>0.23: age squared vs. &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale)<br>0.23: smokeCigarettesFrequency vs. addictedToADrugOtherThanCaffeineOrNicotine<br>0.23: hoursWorkedOnWorkDays vs. positivenessOfFeelingsAboutJob<br>0.23: hasAPet vs. isWhite<br>0.22: selfReportedIntelligence vs. educationScore<br>0.22: anxiety symptom score (GAD7) vs. takesAntidepressants<br>0.22: depression symptom score (PHQ9) vs. debtsCannotPayLevel<br>0.22: &#8220;How optimistic a person are you usually?&#8221; (-2 to 2 scale) vs. parentsTreatedWellWhenGrowingUp<br>0.21: hoursPastMidnightGoesToSleep vs. videoGameMinutesPerDayWhenPlays<br>0.21: hoursOutsideWeekly vs. exerciseMinutesPerExerciseDay<br>0.21: satisfactionWithDatingOrRomanticLife vs. parentsHappyWhenYouWereGrowingUp<br>0.21: socialLiberalness vs. homosexuality<br>0.21 : isChristian vs. hasChildren</p>



<p>—<br>Small correlations (~4% of variance explained)</p>



<p>0.2: howOftenReadsTheNews vs. considersSelfLifelongLearner<br>0.2: hoursPastMidnightGoesToSleep vs. depression symptom score (PHQ9)<br>0.2: earlyTechnologyAdopter vs. internetCapableSmartphone<br>0.2: howGoodIsWillpower vs. moreWealthyThanFriends<br>0.2: nightclubAttendance vs. timesSexualActivityWithOtherPersonIn7Days<br>0.2: daysPerWeekUsesTwitter vs. appsTheyDownloadedAndUseWeekly<br>0.2: &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale) vs. republican1DemocratNegative1<br>0.2: enoughMoneyToLiveComfortably vs. positivenessOfFeelingsAboutJob<br>0.2: bookReadingDaysPerWeek vs. considersSelfLifelongLearner<br>0.19: daysPerWeekUsesFacebook vs. isFemale<br>0.19: bodyMassIndex vs. depression symptom score (PHQ9)<br>0.19: differenceBetweenAverageAndNeededSleepHours vs. &#8220;Taking all things together, I am happy.&#8221; (1-5 scale)<br>0.19: selfReportedGoodLookingnessForAge vs. exerciseMinutesPerExerciseDay<br>0.19: selfReportedIntelligence vs. earlyTechnologyAdopter<br>0.18: hasAPet vs. daysPerWeekUsesFacebook<br>0.18: howWellTreatedByRomanticPartner vs. parentsTreatedWellWhenGrowingUp<br>0.18: &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale) vs. &#8220;How optimistic a person are you usually?&#8221; (-2 to 2 scale)<br>0.18: moreWealthyThanFriends vs. timesSexualActivityWithOtherPersonIn7Days<br>0.18: nightclubAttendance vs. drinksPerTimeDrinking<br>0.18: incomeScore vs. selfReportedGoodLookingnessForAge<br>0.17 : firedFromAJobInLast12Months vs. addictedToADrugOtherThanCaffeineOrNicotine<br>0.17: isFemale vs. &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale)<br>0.17: numberOfCloseFriendsAndFamilyMembers vs. &#8220;How religious do you consider yourself to be?&#8221; (0-5 scale)<br>0.17: selfReportedHowGoodAtMathComparedToOthers vs. selfReportedGoodLookingnessForAge<br>0.17: educationScore vs. enoughMoneyToLiveComfortably<br>0.17: selfReportedIntelligence vs. moreWealthyThanFriends<br>0.17 : timesSexualActivityWithOtherPersonIn7Days vs. healthLevel<br>0.17: daysPerWeekSpeaksToFriends vs. numberOfCloseFriendsAndFamilyMembers<br>0.17: &#8220;How religious do you consider yourself to be?&#8221; (0-5 scale) vs. takingAllThingsTogetherIAmHAPPY<br>0.16: minutesOnComputerTypicalDay vs. hoursPastMidnightGoesToSleep<br>0.16: hasBeenDivorced vs. &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale)<br>0.16 : timesSexualActivityWithOtherPersonIn7Days vs. selfReportedGoodLookingnessForAge<br>0.16: hoursOutsideWeekly vs. &#8220;How optimistic a person are you usually?&#8221; (-2 to 2 scale)<br>0.16: &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale) vs. numberOfCloseFriendsAndFamilyMembers<br>0.16: educationScore vs. bookReadingDaysPerWeek<br>0.16: howGoodIsWillpower vs. positivenessOfFeelingsAboutJob<br>0.16: gotDivorcedInLastTwoYears vs. addictedToADrugOtherThanCaffeineOrNicotine<br>0.16: howOftenReadsTheNews vs. educationScore<br>0.16: hasChildren vs. hasAPet<br>0.16: differenceBetweenAverageAndNeededSleepHours vs. exerciseDaysPerWeek<br>0.16: bodyMassIndex vs. chronicMedicalConditionSeriousness</p>



<p>—<br>Tiny correlation (~2% of variance explained)</p>



<p>0.15: anxiety symptom score (GAD7) vs. socialLiberalness<br>0.15: restednessUponWakingAfterIdealHoursOfSleep vs. positivenessOfFeelingsAboutJob<br>0.15: relationshipSeriousness vs. republican1DemocratNegative1<br>0.15: daysPerWeekSpeaksToFriends vs. howOftenReadsTheNews<br>0.15: alcoholDaysDrinkingPerWeek vs. smokeCigarettesFrequency<br>0.15: gotDivorcedInLastTwoYears vs. firedFromAJobInLast12Months<br>0.15: selfReportedGoodLookingnessForAge vs. satisfactionWithDatingOrRomanticLife<br>0.15: videoGameMinutesPerDayWhenPlays vs. bookReadingMinutesPerDayWhenRead<br>0.14: parentsHappyWhenYouWereGrowingUp vs. selfReportedGoodLookingnessForAge<br>0.14: isChristian vs. daysPerWeekUsesFacebook<br>0.14: considersSelfLifelongLearner vs. howOftenReadsBlogs<br>0.14: healthLevel vs. differenceBetweenAverageAndNeededSleepHours<br>0.14 : republican1DemocratNegative1 vs. homeOwnershipLevel<br>0.13: hasAPet vs. mentalIllnessInFamilyLevel<br>0.13: economicLiberalness vs. daysPerWeekUsesTwitter<br>0.13: economicLiberalness vs. hoursPastMidnightGoesToSleep<br>0.13: seeingAMentalHealthProfessional vs. gotDivorcedInLastTwoYears<br>0.13: videoGamePlayingDaysPerWeek vs. bodyMassIndex<br>0.13: &#8220;How spiritual do you consider yourself to be?&#8221; (0-5 scale) vs. physicalDisabilityLevel<br>0.12: bornInUS vs. hasAPet<br>0.12: howGoodIsWillpower vs. numberOfCloseFriendsAndFamilyMembers<br>0.12: howOftenReadsBlogs vs. educationScore<br>0.12: &#8220;How optimistic a person are you usually?&#8221; (-2 to 2 scale) vs. hasBeenDivorced<br>0.12: parentsTreatedWellWhenGrowingUp vs. &#8220;How religious do you consider yourself to be?&#8221; (0-5 scale)<br>0.12: urbannessOfLocation vs. economicLiberalness<br>0.12: isFemale vs. depression symptom score (PHQ9)<br>0.11: nightclubAttendance vs. selfReportedGoodLookingnessForAge<br>0.11: howOftenReadsTheNews vs. daysPerWeekUsesTwitter<br>0.11: worksMoreThanWouldLike vs. depression symptom score (PHQ9)<br>0.11: incomeScore vs. hasAPet<br>0.11: parentsHappyWhenYouWereGrowingUp vs. howGoodIsWillpower<br>0.11: isFemale vs. hasMentalHealthDiagnosis<br>0.11: hasAnxietyDisorder vs. hasAPet<br>0.11: usCitizen vs. isWhite<br>0.11: howOftenReadsBlogs vs. socialLiberalness<br>0.11 : firedFromAJobInLast12Months vs. nightclubAttendance<br>0.11: educationScore vs. appsTheyDownloadedAndUseWeekly</p>



<p>—<br>Negligible correlations (~1% of variance explained)</p>



<p>0.10: videoGameMinutesPerDayWhenPlays vs. hasMentalHealthDiagnosis<br>0.09: Points (gad7) vs. smokeCigarettesFrequency<br>0.09: healthLevel vs. alcoholDaysDrinkingPerWeek<br>0.09: howOftenReadsTheNews vs. incomeScore<br>0.08: selfReportedHowGoodAtMathComparedToOthers vs. howOftenReadsTheNews<br>0.07: physicalDisabilityLevel vs. lookingForWork<br>0.07: isMidwestUSRegion vs. hasChildren<br>0.07: gotDivorcedInLastTwoY</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p><em>This piece was first written on January 13, 2018, and first appeared on my website on July 30, 2025.</em></p>



<p></p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.spencergreenberg.com/2018/01/what-is-a-large-correlation-looking-at-the-sizes-of-166-correlations/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">4456</post-id>	</item>
		<item>
		<title>Correlation Coefficient as a Gateway to Skepticism</title>
		<link>https://www.spencergreenberg.com/2017/06/correlation-coefficient-as-a-gateway-to-skepticism/</link>
					<comments>https://www.spencergreenberg.com/2017/06/correlation-coefficient-as-a-gateway-to-skepticism/#comments</comments>
		
		<dc:creator><![CDATA[Spencer]]></dc:creator>
		<pubDate>Wed, 14 Jun 2017 13:41:00 +0000</pubDate>
				<category><![CDATA[Essays]]></category>
		<category><![CDATA[cause]]></category>
		<category><![CDATA[coefficient]]></category>
		<category><![CDATA[correlation]]></category>
		<category><![CDATA[explanation]]></category>
		<category><![CDATA[happiness]]></category>
		<category><![CDATA[skepticism]]></category>
		<category><![CDATA[variable]]></category>
		<guid isPermaLink="false">https://www.spencergreenberg.com/?p=1546</guid>

					<description><![CDATA[The correlation coefficient as a gateway to radical skepticism:Suppose you calculate that two variables are moderately correlated. For instance, you find that self-reported happiness has a correlation r=0.32 with self-reported willpower, as I found in one of my studies. What are the possible explanations for (or causes of) this? A Causes B &#8211; Increasing A [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p>The correlation coefficient as a gateway to radical skepticism:<br>Suppose you calculate that two variables are moderately correlated. For instance, you find that self-reported happiness has a correlation r=0.32 with self-reported willpower, as I found in one of my studies.</p>



<p> What are the possible explanations for (or causes of) this?</p>



<ul class="wp-block-list"><li> <strong>A Causes B</strong> &#8211; Increasing A is a cause of increasing B but not the reverse. [e.g., more happiness causes more willpower]</li><li> (2) <strong>B Causes A</strong> &#8211; Increasing B is a cause of increasing A but not the reverse. [e.g., more willpower causes more happiness]</li><li> (3) <strong>A Causes B Causes A</strong> &#8211; Increasing A and B are both causes of increases of the other, leading to a positive feedback loop between them. [e.g., more willpower causes more happiness which causes more willpower which causes more happiness, etc.]</li><li> (4) <strong>X Causes A and B</strong> &#8211; There exists at least one other variable X (potentially many more than one) such that increases (or decreases) in X lead simultaneously to increases in both A and B. [e.g., living in a stable environment and having a supportive romantic partner are both situations that increase happiness and are also both situations that increase willpower]</li><li> (5) <strong>Non-linearity</strong> &#8211; A and B actually have a much stronger relationship than it appears (in fact they could be fully deterministically related) because correlation only captures the average extent to which A exceeding its mean coincides with B exceeding its mean, and can understate the strength of relationships that go both up and down or that go up in an inconsistent fashion (that is, it captures linear relationships, but can sometimes mask non-linear ones). [e.g., as willpower goes up happiness tends to go up as people become increasingly good at making good longer-term effective choices, but as willpower gets to extremely high levels, people start experiencing less happiness again because extreme levels of willpower are linked to reduced emotional responses of all kinds]</li><li> (6a) <strong>Noise</strong> &#8211; The correlation is actually much larger or smaller than it seems as a result of sampling error or noise (e.g., the sample size is too low to measure it with reliability, and so it is really more like 0.32 plus or minus 0.3 and could realistically be near zero) [e.g., with a sample size of n=30, a measured correlation of 0.32 has an insanely wide 95th percentile confidence interval of -0.045 to 0.609]</li><li> (6b) <strong>Too Many Tries </strong>&#8211; You found this correlation by looking at a long list of correlations that you calculated (and it stood out to you because it was one of the highest correlations), but there is actually not a significant correlation at all, it just looks that way because you tested so many hypotheses and each one had some chance of looking significant due to random fluctuations (so it&#8217;s unsurprising that one ended up being moderately large, and that&#8217;s the one you honed in on) [e.g., if you look at all pairs of correlations for 15 variables that leads to 105 distinct correlations, and with a sample size of 50 data points used to calculate each correlation, it is quite likely that you&#8217;d get a correlation of 0.32 or higher even if the true correlation between all pairs of variables was 0]</li><li> (7) <strong>Outliers</strong> &#8211; There is an extreme outlier in the data (e.g., a transcription error or data corruption or disgruntled survey respondent), and without it, the calculated correlation would decrease or increase dramatically. [e.g., with n=100 data points, a crazy outlier pair of 30 for A and 1.35 for B when the rest of your values are between 0 and 1 can make the calculated correlation come out to 0.32 when the correlation calculated without that one outlier is actually -0.12]</li><li> (8a) <strong>Selection Bias</strong> &#8211; Your data is a biased sample of the population that you actually care about due to unintentional selection effects in your sampling procedure, and so the 0.32 correlation, which you assumed applies to the broader population from which your data was drawn, is not actually representative of the population you are attempting to draw conclusions about. [e.g., you inadvertently surveyed only younger people, and in younger people, the correlation between willpower and happiness is positive, whereas in older people it is a negligible correlation, yet you&#8217;re trying to draw conclusions about the entire population which includes both young and old]</li><li> (8b) <strong>Correlation From Conditioning</strong> &#8211; The variables A and B are actually uncorrelated if you had looked at them in the full population of interest, but you only sampled them in some subpopulation out of convenience, and A and B are both correlated with how likely you are to end up in that subpopulation, creating an observed correlation in the subpopulation that doesn&#8217;t exist in the full population [e.g., happiness and willpower are actually uncorrelated, but you only collected data on people at camp, and whether or not a person decides to go to camp is strongly positively predicted by happiness and strongly negatively predicted by willpower; therefore campers are likely to have high happiness or low willpower (though not both) creating a correlation between happiness and willpower among campers that doesn&#8217;t exist among non-campers]</li><li>(9) <strong>The World Is Too Complex For Mere Mortals</strong> &#8211; Some mixture of (1), (2), (3), (4), (5) and (6a), (6b), (7), (8a), and (8b) are true.</li><li>(10) <strong>Wrong Problem</strong> &#8211; Of the literally infinite variety of formulas that capture the extent to which A and B vary together, the correlation (i.e., the average of the product of standard deviations from the mean) is not the formula you are truly interested in, what you actually care about is, say, the median of the product of absolute deviations from the median, but you calculated the ordinary correlation because that&#8217;s all that you could think of to do, or that&#8217;s the only relevant function the software you used had available.</li><li> (11) <strong>Undefined</strong> &#8211; A and B were generated from Cauchy distributions, and the true correlation between these two variables is mathematically undefined (much like how the Cauchy distribution has an undefined expected value), so your calculated value of 0.32 is a meaningless estimate of an undefined quantity.</li><li> (12) <strong>Bug</strong> &#8211; there was a bug in the correlation calculation or data loading code, or data cleaning code and your software just happened to output 0.32, but that&#8217;s not actually the correlation value or a value of interest at all.</li><li> (13) <strong>Wrong Calculation</strong> &#8211; You only thought you had run your correlation coefficient code, but you accidentally ran the wrong program (the one you wrote as a teen), and the number 0.32 was the fraction of baseball cards you had at that time that were in mint condition.</li><li> (14) <strong>Memory Mistake</strong> &#8211; Your faulty memory only makes you think the correlation between A and B is 0.32, when in fact, the correlation number you saw on your computer screen (a mere 60 seconds ago) was 0.23 (thanks be to the unreliable three pounds of jello between your ears).</li><li> (15) <strong>Dreaming</strong> &#8211; You are actually asleep right now (with your head slumped down on your keyword, and your knocked-over cup of tea dripping Earl Grey on the carpet), and you only dreamed that you calculated a 0.32 correlation, but when you wake up the correlation will turn out to be, say, -0.134 (or maybe you never collected the data in the first place and will get an F on your assignment).</li><li> (16) <strong>God</strong> &#8211; God, it turns out, predetermined everything, and is, therefore, the one and only cause, so is the true (and only) explanation for this correlation of 0.32.</li><li> (17) <strong>Solipsism</strong> &#8211; Metaphysical Solipsism turns out to be true, and the world has no independent existence outside of your mind, so in effect, you are the only cause, and therefore you are the cause of this experience of observation of 0.32 correlation (but what does it say about you that you would create this experience?)</li><li> (18) <strong>Many Worlds</strong> &#8211; The Many World&#8217;s hypothesis is true, and the laws of physics don&#8217;t forbid any possible values of this particular correlation, hence for any number r within the range -1 to 1, there is a you who witnessed that correlation r, but most you&#8217;s most likely witnessed a correlation close to 0.32 (as evidenced by the fact that you witnessed it and that you are unlikely to have witnessed an unlikely event).</li><li> (19) <strong>Simulation</strong> &#8211; The Simulation Hypothesis is true, you are part of a simulation, and the (simulated) world you live in was designed by conscious beings to have a 0.32 correlation between variables A and B (the true reason for which you will surely never understand, perhaps it has to do with getting published in a 5th dimension outer-reality academic journal on the niche topic of civilizational development in 4d space-time universes).</li><li> (20) <strong>Relativism</strong> &#8211; Truth and meaning are relative and culturally determined, and the definition and usage of correlation, as well as the ritualistic &#8220;scientific&#8221; process of calculating it, and the belief that it should be calculated at all, are merely an artifact of your time and place, which props up the power of the current ruling elite, yet is so deeply rooted in your culture that you fail to see any other possibility.</li><li> (21) <strong>Evil Demon</strong> &#8211; Descartes&#8217; Evil Demon, as &#8220;clever and deceitful as he is powerful,&#8221; has been tricking you for the entirety of what you call your life, and all that you think you know of the external world is merely an illusion designed by this demon, including this godforsaken correlation.</li><li> (22) <strong>Boltzmann Brains</strong> &#8211; The universe is infinite (in space, or time) and hence contains an infinite number of brains produced by the brief chance alignment of particles into structures capable of consciousness, and given that only a finite number of brains could evolve on planets, you have a 100% chance of being one of these randomly coalescing &#8220;Boltzmann brains,&#8221; and you just happen to be one that momentarily believes there is such a thing as correlation and that you measured a 0.32 correlation between A and B (in a moment you will pop back out of existence &#8211; bye!)</li><li> (23) <strong>Contradiction</strong> &#8211; There is an as of yet undiscovered (but as the Incompleteness Theorem shows, impossible to rule out) contradiction in the axioms of mathematics as we know it, and a valid mathematical proof exists to show that A and B have any correlation including -1, Pi or 0.32.</li><li><em>Or perhaps I&#8217;m overthinking this, and just: &#8220;as A goes up, B tends to go up a bit, on average.&#8221;</em></li></ul>
]]></content:encoded>
					
					<wfw:commentRss>https://www.spencergreenberg.com/2017/06/correlation-coefficient-as-a-gateway-to-skepticism/feed/</wfw:commentRss>
			<slash:comments>1</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">1546</post-id>	</item>
		<item>
		<title>How Journalism Distorts Reality</title>
		<link>https://www.spencergreenberg.com/2012/04/how-journalism-distorts-reality/</link>
					<comments>https://www.spencergreenberg.com/2012/04/how-journalism-distorts-reality/#comments</comments>
		
		<dc:creator><![CDATA[Spencer]]></dc:creator>
		<pubDate>Sun, 08 Apr 2012 00:04:44 +0000</pubDate>
				<category><![CDATA[Essays]]></category>
		<category><![CDATA[belief]]></category>
		<category><![CDATA[bias]]></category>
		<category><![CDATA[correlation]]></category>
		<category><![CDATA[distortion]]></category>
		<category><![CDATA[information]]></category>
		<category><![CDATA[journalism]]></category>
		<category><![CDATA[studies]]></category>
		<guid isPermaLink="false">http://www.spencergreenberg.com/?p=564</guid>

					<description><![CDATA[Journalism provides us with important information about what&#8217;s going on in the world. But when you consider the incentives that journalists have, combine that with their usual lack of scientific training, and add in the constraints of the medium in which they work, serious distortions of reality can result. Many journalists produce excellent work. But [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>Journalism provides us with important information about what&#8217;s going on in the world. But when you consider the incentives that journalists have, combine that with their usual lack of scientific training, and add in the constraints of the medium in which they work, serious distortions of reality can result. Many journalists produce excellent work. But others leave you less informed after reading their articles than before you began.</p>
<p>What causes journalistic distortion?</p>
<p><strong>1. Equal time to each side. </strong>There are many issues for which there are two or more reasonable positions that a person can hold. Then there are those issues where one side is supported by nearly everyone who has relevant expertise, and only a few fringe people oppose that view. The trouble is that stories about highly unbalanced issues can lead to a false impression of balance, either because the journalist feels compelled to spend equal time discussing each view-point, or because the journalist is himself unaware of which side is more trustworthy. And a person with highly unrepresentative but highly quotable opinions may be quoted in the article more than is warranted. It may seem less biased to present both sides, but when one side is almost certainly right, an equal presentation may distort more than it informs.</p>
<p><strong>2. Selective reporting. </strong>Since news organizations are in the business of selling the news (or, at least, driving traffic to their websites) they have a monetary incentive to produce news that people will be eager to read. Feel-good stories about a dog saving someone&#8217;s life can beat out information that might be more important or relevant to most people. What&#8217;s problematic from a reality distortion perspective though is that the rate at which events occur and the rate at which they are reported are massively out of sync. For each story about someone coming home from work only to be murdered by their ex-boyfriend, we never hear the millions of tales of people coming home to work only to sit down and eat dinner. This is problematic because the way the human brain tries to estimate how likely something is to occur <a href="http://en.wikipedia.org/wiki/Availability_heuristic">involves an attempt to retrieve instances of that thing in memory</a>. The more easily you can retrieve those instances, the more frequent you will tend to assume that thing is. If you&#8217;ve recently read about a few murder cases, you may have the impression that murder has become more common than it used to be, even if this is merely an artifact of journalists choosing (for whatever reason) to report on more murders. If you can easily think of an example of a shark attack, you may overestimate <a href="http://en.wikipedia.org/wiki/Shark_attack#Statistics">the frequency of sharks killing people</a>.</p>
<p>The vividness of the accounts we hear can also alter our perception. A vivid retelling not only increases the chance that we remember an account, but also tends to increase our emotional response to it. If you&#8217;ve recently read an article that described a gruesome murder in horrid detail, you may subsequently be more afraid when walking alone on an empty street. Through this mechanism, news reading can cause people to have excessive fear of things that aren&#8217;t very likely to harm them, and fail to fear far more dangerous things that are rarely reported on. You&#8217;re much more likely to die in a car crash than be killed by terrorism, yet in a world where terrorism is reported on constantly, you will likely fear terrorism more.</p>
<p><strong>3. Mix-ups of correlation and causation. </strong>Just because X tends to occur together with Y doesn&#8217;t mean that X causes Y. In fact, it could be that Y causes X instead, or that both X and Y are caused by some third thing. Unfortunately, reporters frequently get this wrong (or at least fail to make the distinction clear to the reader), especially when reporting on scientific findings. Articles will insinuate that since the latest study found higher wine/broccoli/nicotine consumption was associated with greater longevity/health/focus, that means that wine/broccoli/nicotine must actually cause those benefits. A related problem that you&#8217;ll sometimes see (especially in articles about finance) is the implication that<a href="http://en.wikipedia.org/wiki/Post_hoc_ergo_propter_hoc"> since Y came after X, that means that Y was caused by X</a>. It may be true that many stock market investors reacted negatively to a new bill that was just signed into law, but that doesn&#8217;t mean that&#8217;s a causal explanation of why the stock market fell 1% today. There surely were many factors influencing the change in the market&#8217;s price, some tending to push it up, others tending to push it down. Even if it were true that the signing of the bill had a strong effect (which it might be difficult to confirm), that event certainly cannot take all the credit for determining the change in the market&#8217;s price.</p>
<p><figure id="attachment_574" aria-describedby="caption-attachment-574" style="width: 600px" class="wp-caption aligncenter"><a href="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2012/04/borgman042797_600x385.jpg"><img data-recalc-dims="1" loading="lazy" decoding="async" data-attachment-id="574" data-permalink="https://www.spencergreenberg.com/2012/04/how-journalism-distorts-reality/borgman042797_600x385/" data-orig-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2012/04/borgman042797_600x385.jpg?fit=600%2C385&amp;ssl=1" data-orig-size="600,385" data-comments-opened="1" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}" data-image-title="borgman042797_600x385" data-image-description="" data-image-caption="&lt;p&gt;by Jim Borgman&lt;/p&gt;
" data-large-file="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2012/04/borgman042797_600x385.jpg?fit=600%2C385&amp;ssl=1" src="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2012/04/borgman042797_600x385.jpg?resize=600%2C385" alt="" title="borgman042797_600x385" width="600" height="385" class="size-full wp-image-574" srcset="https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2012/04/borgman042797_600x385.jpg?w=600&amp;ssl=1 600w, https://i0.wp.com/www.spencergreenberg.com/wp-content/uploads/2012/04/borgman042797_600x385.jpg?resize=300%2C192&amp;ssl=1 300w" sizes="auto, (max-width: 600px) 100vw, 600px" /></a><figcaption id="caption-attachment-574" class="wp-caption-text">by Jim Borgman</figcaption></figure></p>
<p><strong>4. Use of low quality studies. </strong>Just because a study &#8220;proves&#8221; something, doesn&#8217;t make it so. In fact, most studies that are conducted are of poor quality for one reason or another. This could be due to a small number of study participants, lack of a control group, lack of randomization, the wrong choice of statistical test, flawed experimental protocol, poor choice of outcome measures, selective reporting of study results, or a variety of other reasons. Unfortunately, journalists rarely make it clear whether a study was of high quality, being mainly interested in what the study claimed to have found. Even the reporting of high quality studies can be problematic, if the journalist fails to mention other high quality studies that found different results. Given all the things that can go wrong in the design and execution of a study, we should be hesitant to accept the results even of those studies that look to be of high quality, until we have seen replication of the study by a different research team.</p>
<p><strong>5. Lack of understanding. </strong>Many journalists write about a wide range of subjects. It is rare that they are true experts in the subject of a particular article. But as non-experts writing about what are sometimes very complicated subjects, there is the danger that journalists misunderstand the underlying subject matter. This problem occurs especially often in articles about highly technical research. The issue is compounded further by the fact that journalists are often working under tight deadlines, and so may lack the ability to do extensive background research.</p>
<p><strong>6. Selective use of the facts. </strong>Even within a single story, the problem of selective reporting can be substantial. Not all facts in a case are equally entertaining or fit the narrative equally well. There is some incentive to favor those facts that improve the story over drier, though perhaps important material. Of course a political or other agenda on the part of the reporter can also determine which facts he chooses to report on. Since there is a tendency for liberals to read liberal news sources while conservatives read conservative sources, both groups may have their pre-existing views bolstered by selectively reported evidence.</p>
<p><strong>7. Exaggeration of importance. </strong>News sells better if it sounds important, so news organizations have an incentive to make their news fit this criteria. One way to do this is to report on stories that actually matter to a lot of people, but sometimes it is better for the organization to just make whatever they&#8217;re reporting on sound more important than it is. The next big scientific breakthrough reported on turns out to be completely forgotten a few years or months later (but who remembers?) One of the most common forms of exaggeration in journalism is when a trend is constructed from a few data points. If a handful of celebrities are eating a lot of coconut, or museums have recently become a little more popular among people in their twenties, that doesn&#8217;t mean there&#8217;s a new fad that the world should hear about.<br />
<br />
Choose your news sources carefully, because the information you consume determines what you believe about the world. And as incredibly valuable as journalism is, it can distort reality.</p>
]]></content:encoded>
					
					<wfw:commentRss>https://www.spencergreenberg.com/2012/04/how-journalism-distorts-reality/feed/</wfw:commentRss>
			<slash:comments>2</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">564</post-id>	</item>
	</channel>
</rss>
