Thursday, April 05, 2007
Agnostic. 2007. New GRE cancelled - the cost of attempted gap-reduction? Gene Expression. April 4, 2007. Available online: http://www.gnxp.com/blog/2007/04/new-gre-cancelled-cost-of-attempted-gap.php.
First, an excerpt from the excellent blog piece. Then a short discussion by me:
The NYT reports that a completely revised GRE has been deep sixed, not merely delayed (read the ETS press release here). The official story is that there is some insurmountable problem with providing access to all test-takers, an issue apparently too complicated for ETS to bother trying to explain it to us. You figure, since this was such a huge project that was suddenly halted, they'd want to clearly spell out why they dumped it -- unless that's the point. Although I'm no mind-reader, the true reason is pretty obvious: the made-over test was designed to narrow the male-female gap at the elite score level, but this diluted its g-loadedness such that it couldn't reliably distinguish between someone with, say, a 125 IQ and a 145+ IQ, which is what graduate departments who rely on super-smart students worry about. Rather than admit that this psychometric magic trick went awry and lopped off a few limbs of g-loadedness, they spun a yarn about access to the te
We now ask why ETS intentionally stripped the SAT of some of its g-loadedness? Certainly not because they discovered IQ had little value in predicting academic performance, or that some items tap g more directly than others -- so why re-invent the wheel? Since scores on various verbal tasks highly correlate, this change cannot have affected much the mean of any group of test-takers. But if getting a perfect score required scoring correctly on, say, 10 easy questions, 5 medium, and 5 difficult (across 3 sections), a greater number of above-average students can come within striking distance of a perfect score if the new requirement were 10 easy, 9 medium, and 1 hard. I don't know exactly how they screwed around with the numbers, but that's what they pay their psychometricians big bucks to do. Now, reducing the difficulty of attaining elite scores, without also raising mean scores (as with the 1994 recentering), can only have had the goal of reducing a gap that exists at the level of variance, not a gap between means. This, then, cannot be a racial gap but the male-female gap, since here the difference in means is probably 0-2 IQ points, although male variance is consistently greater.
In other words..
- Some time ago, the SAT released a new test that kept the pre-existing group means (so that jews still scored higher than scotch-irish, and that asians still scored higher than blacks) but made it easy for pretty-good students to score the same as very-good students
- The GRE seriously considered, openly planned on, announced, and then suddenly rejected a similar plan.
Ultimately, this is a tale of political correctness and money. Especially since fired Harvard President Larry Summers publicly asked if there was a genetic component to sexual differences, but since the birth of feminism in the early 20th century, the "polite" opinion is that males and females are genetically identical and apart from a few organs the sexes are in no way different. Thus intelligence testing, which consistently reveal that the highest-scoring males have higher intelligence than the highest-scoring females, is embarrassing. While the SAT and the GRE are technically aptitude tests, they are also rough measures of intelligence so the same issues that impact IQ testing impact the SAT and GRE.
The easy way to remove this shame is to ignore it, so the SAT lowered the bar for the highest-scoring students. Thus the highest-scoring females would score exactly the same as the highest scoring males - with a perfect 2400R.
For undergraduate schools this is just fine. Anything that increases the student body size while avoiding public embarrassment puts money into the hands of the Universities,. Likewise, compared to graduate schools undergrad institutions tend to be non-competitive (excluding quotized areas sex as race, where it is hard to change race from penalized categories such as oriental or white to preferred categories such as black or indian). Thus, the SAT combined easy leftism with easy commercialism: the change stands!
For graduate schools this is not fine. Graduate students are investments in ways that undergrads just aren't. Grad students take up more of professors' face time, often have the responsibility of assisting in research or teaching undergraduates, and are actually paid. Thus a non-productive grad student can more easily become a cash dog than can a non-productive undergrad. There, within grad schools capitalism defeated easy leftism: the change is rejected!
Update: Darth Quixote at gnxp examines the results of the latest SAT.