<?xml version="1.0" encoding="UTF-8" standalone="yes"?><oembed><version><![CDATA[1.0]]></version><provider_name><![CDATA[Random Critical Analysis]]></provider_name><provider_url><![CDATA[https://randomcriticalanalysis.wordpress.com]]></provider_url><author_name><![CDATA[rcafdm]]></author_name><author_url><![CDATA[https://randomcriticalanalysis.wordpress.com/author/rcafdm/]]></author_url><title><![CDATA[On SAT, ACT, IQ, and other psychometric test&nbsp;correlations]]></title><type><![CDATA[link]]></type><html><![CDATA[<p>Although I touched on this topic <a href="https://randomcriticalanalysis.wordpress.com/2015/06/14/nlsy97-assessing-systematic-patterns-in-relationships-between-iq-and-other-test-scores-by-ses-gpa-and-more/" target="_blank">briefly before</a>, I seem to have forgotten some relevant plots and data and don&#8217;t feel like editing the last one, so this post is somewhat redundant&#8230;</p>
<p>Both the SAT and ACT are quite well correlated with IQ tests, so much so that you can make good guesses about someone&#8217;s IQ if you know their SAT/ACT score and vice versa.</p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_composite_by_asvab_iq.png" target="_blank"><img class="aligncenter wp-image-2633 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_composite_by_asvab_iq.png?w=809&#038;h=653" alt="sat_composite_by_asvab_iq" width="809" height="653" /></a></p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/asvab_by_sat.png" target="_blank"><img class="aligncenter wp-image-2638 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/asvab_by_sat.png?w=809&#038;h=653" alt="asvab_by_sat" width="809" height="653" /></a></p>
<p><!--more--></p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/satv_by_asvab.png" target="_blank"><img class="aligncenter wp-image-2631 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/satv_by_asvab.png?w=809&#038;h=653" alt="satv_by_asvab" width="809" height="653" /></a> <a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/satm_by_asvab.png" target="_blank"><img class="aligncenter wp-image-2632 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/satm_by_asvab.png?w=809&#038;h=653" alt="satm_by_asvab" width="809" height="653" /></a></p>
<hr />
<p>The SAT &#8211; ASVAB correlation is quite strong and it is probably weakened by <a href="http://emilkirkegaard.dk/understanding_statistics/?app=restriction_of_range" target="_blank">range restriction effects</a>.  People with lower IQ scores and/or lower HS GPA are <em>much less likely</em> to sit for the SAT.   If the SAT is significantly influenced by the degree to which people actually apply themselves in school (almost surely to some degree) and IQ is only weakly correlated with conscientiousness and related characteristics, both will tend to significantly reduce the apparent strength of the correlation</p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_prob_by_aidx.png"><br />
</a> <a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/act_prob_by_hsgpa.png" target="_blank"><img class="aligncenter wp-image-2627 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/act_prob_by_hsgpa.png?w=809&#038;h=653" alt="act_prob_by_hsgpa" width="809" height="653" /></a> <a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_prob_by_hsgpa.png" target="_blank"><img class="aligncenter wp-image-2628 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_prob_by_hsgpa.png?w=809&#038;h=653" alt="sat_prob_by_hsgpa" width="809" height="653" /></a> <a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/act_prob_by_iq.png" target="_blank"><img class="aligncenter wp-image-2629 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/act_prob_by_iq.png?w=809&#038;h=653" alt="act_prob_by_iq" width="809" height="653" /></a> <a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_prob_by_iq.png" target="_blank"><img class="aligncenter wp-image-2630 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_prob_by_iq.png?w=809&#038;h=653" alt="sat_prob_by_iq" width="809" height="653" /></a></p>
<p><img class="aligncenter wp-image-2626 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_prob_by_aidx.png?w=809&#038;h=653" alt="sat_prob_by_aidx" width="809" height="653" /></p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/act_prob_by_aidx.png" target="_blank"><img class="aligncenter wp-image-2625 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/act_prob_by_aidx.png?w=809&#038;h=653" alt="act_prob_by_aidx" width="809" height="653" /></a></p>
<hr />
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_by_aca_idx.png" target="_blank"><img class="aligncenter wp-image-2634 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_by_aca_idx.png?w=809&#038;h=653" alt="sat_by_aca_idx" width="809" height="653" /></a></p>
<hr />
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/splom_sat_misc.png" target="_blank"><img class="aligncenter wp-image-2639 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/splom_sat_misc.png?w=809&#038;h=653" alt="splom_sat_misc" width="809" height="653" /></a></p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/test_correlations_by_year.png" target="_blank"><img class="aligncenter wp-image-2623 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/test_correlations_by_year.png?w=809&#038;h=653" alt="test_correlations_by_year" width="809" height="653" /></a></p>
<hr />
<p>The ASVAB/AFQT is <em>effectively</em> an IQ test and it is certainly <a href="http://www.rand.org/content/dam/rand/pubs/monographs/MG265/images/webG1471.pdf" target="_blank">well correlated with &#8220;official&#8221; IQ tests</a> like Wechsler Adult Intelligence Scale (WAIS) and Stanford-Binet.</p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/google-chrome15.png" target="_blank"><img class="aligncenter wp-image-2635 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/google-chrome15.png?w=747&#038;h=895" alt="Google Chrome" width="747" height="895" /></a></p>
<p>Given the strength of the correlation between ASVAB and SAT/ACT and similarities in design, the correlations between these &#8220;aptitude&#8221; tests and WAIS or Stanford-Binet are probably <em>very similar, </em>especially<em> </em>without range restriction effects and without these tests being spaced apart by several years in some cases (consider that the ASVAB-SAT r=0.85 whereas PSAT-SAT r=0.90&#8230;. pretty close).  Of course, there is not one true &#8220;IQ test&#8221; and different tests have different strengths and weaknesses.</p>
<p><a href="http://emilkirkegaard.dk/en/wp-content/uploads/Scholastic-Assessment-or-g-The-Relationship-Between-the-Scholastic-Assessment-Test-and-General-Cognitive-Ability.pdf" target="_blank">Other people have studied this question using NLSY79 </a>(the <em>older</em> NLSY study) and compared to other psychometric tests too.</p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/google-chrome16.png" target="_blank"><img class="aligncenter wp-image-2636 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/google-chrome16.png?w=809&#038;h=306" alt="Google Chrome" width="809" height="306" /></a></p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/google-chrome17.png" target="_blank"><img class="aligncenter wp-image-2637 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/google-chrome17.png?w=809&#038;h=594" alt="Google Chrome" width="809" height="594" /></a></p>
<hr />
<p>Of course, just because these tests are well correlated in general does not mean that one cannot make incrementally better predictions with additional information or, at least, adjust the confidence level accordingly.  It seems to me that people that &#8220;slack off&#8221; in school, as determined to lousy GPAs despite high IQ, are significantly less likely to earn SAT scores commensurate with their intelligence (especially at the upper ability levels).</p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_by_q_grouped_by_hsgpa_tercile.png" target="_blank"><img class="aligncenter wp-image-2640 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_by_q_grouped_by_hsgpa_tercile.png?w=809&#038;h=653" alt="sat_by_q_grouped_by_hsgpa_tercile" width="809" height="653" /></a></p>
<p>That&#8217;s not to say that that makes the SAT a worse predictor for admissions purposes though!</p>
<p>Likewise, there are some modest differences by the student&#8217;s father&#8217;s education level:</p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_by_pred_asvab_fed.png" target="_blank"><img class="aligncenter" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_by_pred_asvab_fed.png?w=965&#038;h=998" alt="" width="965" height="998" /></a></p>
<p>Or by parents income level (1997)</p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_by_q_grouped_by_pincome_b4.png" target="_blank"><img class="aligncenter wp-image-2641 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/sat_by_q_grouped_by_pincome_b4.png?w=809&#038;h=653" alt="sat_by_q_grouped_by_pincome_b4" width="809" height="653" /></a></p>
<p style="text-align:center;"><em>(which doesn&#8217;t necessarily means these tests are biased as there are also average differences in GPA controlling for IQ, not to mention regression to the mean, etc)</em></p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/hsgpa_by_iq_grouped_by_income.png" target="_blank"><img class="aligncenter wp-image-2642 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/hsgpa_by_iq_grouped_by_income.png?w=809&#038;h=653" alt="hsgpa_by_iq_grouped_by_income" width="809" height="653" /></a></p>
<p><a href="https://randomcriticalanalysis.files.wordpress.com/2015/06/gpa_by_iq_grouped_fed.png" target="_blank"><img class="aligncenter wp-image-2643 size-full" src="https://randomcriticalanalysis.files.wordpress.com/2015/06/gpa_by_iq_grouped_fed.png?w=809&#038;h=653" alt="gpa_by_iq_grouped_fed" width="809" height="653" /></a></p>
<p style="text-align:center;">(and, in practical terms, the higher SES GPA usually means more due to more higher average grading standards and larger average course loads)</p>
<p>Notes:</p>
<ul>
<li>I used the <a href="http://www.bls.gov/nls/nlsy97.htm" target="_blank">NLSY97 dataset</a>, which provides test scores and a lot of other information at an individual level for a (mostly) nationally representative cohort of people born between 1980 and 1984, for this analysis.   I converted the ASVAB score percentiles to IQ scores whereby 50th percentile = 100 IQ, SD = 15.  NLSY97 oversampled some lower-IQ groups, but the percentiles were set according to <em>national</em> norms (which <em>is</em> somewhat lower than the white or the asian means in this and other data)..</li>
</ul>
]]></html><thumbnail_url><![CDATA[https://i1.wp.com/randomcriticalanalysis.files.wordpress.com/2015/06/gpa_by_iq_grouped_fed.png?fit=440%2C330]]></thumbnail_url><thumbnail_height><![CDATA[330]]></thumbnail_height><thumbnail_width><![CDATA[408]]></thumbnail_width></oembed>