Life Ain’t Fair, College Edition
The SAT is a poor measure of college aptitude but it's better than most others.
Last week, MIT announced that it was bringing back the requirement for applicants to submit SAT scores. While this was seen by many as regression, it turns out, contrary to conventional wisdom, the test helped increase the admission of racial minorities and other underprivileged groups. UT-Austin clinical-psychology professor Kathryn Paige Harden explains that “The SAT Isn’t What’s Unfair.”
Critics of standardized tests have had plenty of reasons to celebrate lately. More than three-quarters of colleges are not requiring the SAT or the ACT for admission this fall, an all-time high, and more than 400 Ph.D. programs have dropped the GRE, up from a mere handful a few years ago. MIT’s announcement on Monday that it is reinstating a testing requirement for fall 2023 admissions was a major departure from these recent trends. Just as striking, amid the widespread perception of standardized testing as an engine of inequality, was MIT’s rationale: “Not having SATs/ACT scores to consider,” MIT’s dean of admissions, Stu Schmill, wrote, “tends to raise socioeconomic barriers to demonstrating readiness for our education.” Dropping the SAT, it turns out, actually hurts low-income students, rather than helping them.
MIT’s conclusion is counterintuitive because students from richer families, on average, score higher on the SAT and other standardized tests than students from poorer ones. The correlation between family background and SAT performance is from about .25 to .40—that is, meaningful but far from perfect. Still, it’s strong enough that some researchers dismiss standardized tests as nothing more than a proxy for asking, “Are you rich?” (The ACT measures roughly the same skills as the more widely used SAT, and the arguments for and against both tests are similar.)
But the income-related disparities we see in SAT scores are not evidence of an unfair test. They are evidence of an unfair society. The test measures differences in academic preparedness, including the ability to write a clear sentence, to understand a complex passage, and to solve a mathematical problem. The SAT doesn’t create inequalities in these academic skills. It reveals them. Throwing the measurement away doesn’t remedy underlying injustices in children’s academic opportunities, any more than throwing a thermometer away changes the weather.
Which, by the way, shouldn’t be surprising. The whole reason standardized tests were adopted was to provide a measurement to help cut through the variability of opportunity.
The higher scores of richer students are not due, as is commonly assumed, to richer students’ ability to “game” the SAT with expensive test prep. Despite the marketing claims of test-prep companies, gains from test prep are modest at best. Instead, richer students’ higher scores reflect a problem that is much more durable and pervasive: These students are the beneficiaries of lifelong inequalities in opportunities to learn. As developmental scientists have long documented, poverty and racism can harm children’s learning in countless ways, even to the point of affecting their brain development. In the Developmental Behavior Genetics Lab at the University of Texas, my colleagues and I have found that children as young as 2 years old from low-income families differ from their better-off counterparts in their performance on standardized tests.
No one should be surprised that, at age 18, students who have enjoyed a lifetime of material, social, and cultural advantages perform better on tests of academic skills that those advantages facilitate. And these skills actually matter more for students’ performance in college than how wealthy their families are.
But rich kids do better on standardized tests. How does considering these scores help poor kids? Because they help us see beyond the advantage:
In large-scale studies of college admissions, higher socioeconomic status is not associated with better grades after controlling for SAT scores, but SAT scores remain predictive of better grades after controlling for family background.
And removing the SAT actually just puts the onus on measures where privilege matters even more:
Richer students don’t just get better SAT scores. They also tend to outperform on everything else that an admissions committee would use to select students. Personal essays? Their style and content are more strongly correlated with family income than SAT scores are. Recommendation letters? They are subject to teachers’ classist and racist biases, and even knowing how to request the letters requires significant social capital.
Yeah, but we all know that grades are a better predictor of college success than SAT scores, since they measure work ethic, organizational skills, and other valuable things.
Many critics of standardized tests urge college-admissions officers to focus on applicants’ high-school performance. But low-income students also have worse grades, on average, particularly if their parents do not have a college degree. Moreover, admissions officers commonly consider not only grades but which classes students have taken. Access to advanced coursework is highly stratified: Less than half of American high schools, for instance, offer calculus. And parents know firsthand that their children’s sports teams, volunteer positions, study-abroad trips, and summer internships require substantial investments of time and money. In a society characterized by pervasive inequalities in opportunities to learn, looking for a measure of a student’s “merit” that is somehow unencumbered by unearned advantages is a fool’s errand.
Dropping any admissions requirement is necessarily a decision to weigh other factors more heavily. If other student characteristics, such as essays, recommendations, and coursework, are more strongly correlated with family income than test scores are, then dropping test scores actually tilts the playing field even more in favor of richer students. This was the situation that MIT found itself in after it suspended its SAT requirement in 2020. And other schools that dropped standardized tests during the pandemic will soon find themselves in the same straits.
Yup. No matter how you slice it, rich kids have a head start. There’s just no getting around that unless we’re going to have a pure lottery system for admission to prestigious schools. Which, incidentally, is probably the best solution once the pool is culled down to very high achievers.
But, of course, MIT is unique. It’s not only an extremely competitive private school but it’s also one that unusually prizes mathematical competency. Maybe it doesn’t tell us much about the value of standardized testing for more “normal” schools.
[S]tudies of other types of undergraduate institutions and other educational stages have also found that standardized testing improves the representation of low-income students, because testing replaces more flawed indicators of student readiness. A K-12 school district in Florida that made standardized testing universal among its second-grade students saw a substantial jump in the number of low-income and Black students in its gifted-and-talented program. Before the switch to universal testing, admission to the gifted-and-talented program depended strongly on teacher referrals—subjective assessments that, like recommendation letters for college applicants, may be informed by educators’ biases.
It’s like there’s institutionalized racism at work.
Similarly, when the state of Michigan required every high-school student to take the ACT or the SAT, it saw an increase in the number of low-income students attending four-year colleges. These studies suggest that the best policy might actually be to facilitate more high-school students taking the SAT, not abandon it entirely. Standardized testing, inequitable as it might be, is more equitable than any other criterion.
Which makes sense when you think about it. White and Asian kids are more likely to be in a home environment that values educational achievement, both for cultural reasons and because their parents are more likely to have gone to college. So, in addition to all the other advantages Harden noted, they’re likely putting in more effort to get good grades and otherwise excel in a scholastic environment. Testing helps identify under-utilized talent.
There are real barriers to the fair use of standardized testing that educators and policy makers should address. Currently, just signing up for the SAT or the GRE is prohibitively expensive for many students, as are college-application fees, and many students might not even consider taking the test. Free, accessible, universal testing (and access to test prep) would help dismantle these barriers.
That seems reasonable enough.
Ultimately, though, Americans must recognize that improving admissions policies at elite four-year colleges is woefully insufficient to address the larger problem of social inequality. An exclusive focus on who “deserves” to win the admissions competition neglects important questions about the stakes of the competition: What do we owe, as a society, to those students who fail to win the academic rat race, or indeed have no interest in competing in the first place?
After all, fewer than half of American high schoolers enroll in four-year colleges. In recent years, life has gotten worse, in nearly every possible way, for people without a college degree in the U.S. They make less money, report more pain and worse health, and die younger than they did in previous generations. Participation in higher education has become a bottleneck in American society. Standardized testing can make passage through that bottleneck fairer, but we must also consider how to make the bottleneck wider, and provide people with more pluralistic opportunities to build a good life—regardless of whether they get into MIT.
Now, I maintain my skepticism that universal college makes much sense. Large swaths of people simply don’t have the aptitudes to do well in college and turning it into 13th through 16th grade waters down whatever utility it has. Beyond that, while we’re using a college degree as a stand-in for skillsets that are useful in the workplace, most jobs simply don’t utilize that education. We need to destigmatize the trades and other productive alternatives to college.
Regardless, Harden’s larger point is surely right: we should use the tools available to us to cut through the privileges that children of more affluent families have to identify potential and expand options available to those who didn’t start on first base.
Far?
All standardized tests, regardless of declared purpose, test the same thing: IQ. Which makes sense because IQ is very useful and even better, it’s testable. There’s no point complaining that IQ tests perform as IQ tests.
Now, what can’t be tested? Commitment. Curiosity. Ambition. Motivation. Endurance. Resiliency. Morality. Confidence. Which are all also very useful in pursuing an education.
I got into college with nothing but a GED and a bunch of standardized test scores. Had there been a way to test my commitment or resolve I’d have been rejected because at no time did I actually expect to go for four years. Indeed, a semester and a half of smoking weed and casual sex and I was outta there, having wasted a slot that might have gone to some Black or Brown or for that matter White kid who wanted it, needed it, and would have made it work.
That’s my alma mater! Crunch the numbers and show the data….
The other gaming-the-system that rich(er) kids can do that poor kids can’t is apply to more schools, even if they know full well it’s a Hail Mary pass. I used to interview applicants for MIT and I estimate roughly 1/3 of the applicants who went to the trouble of asking for an interview didn’t have the foggiest idea as to why they wanted to apply or how they would take advantage of the opportunities at MIT. You could tell they were applying simply so Mummy and Daddy could boast about their kid getting into MIT.
I always felt sorry for those kids. What they really needed was several years far, far away from their families before making the decision about college.
It’s an old, old problem, exacerbated by the inundation of the trades by the flood of workers being dumped out of the factories as they closed (and automated) in the 1970s. This made the trades a less attractive option for the 18-yr old in the 1980s. Now those men of the ’70s are in or approaching their 70s and retiring out creating a shortage. A shortage with the headwinds of 40 years of denigration of the trades by unthinking guidance counselors.
The Roman citizen would die in the streets before taking up “slaves” work. Similarly, the knights of the Chivalric period knew fighting and war but left books and the useful arts to the lesser in society. Even just a century ago, there was the ‘Mind and Hand’ movement to get schools to teach the useful arts in conjunction with the devotion of the purely academic. MIT came out of this movement with its motto ‘Mind and Hand’. It is likely were the increasingly defunct “shop” classes of high schools of old originated.
Our society is also really, really segregated along education lines. The fewer-than-half statistic rings false because I don’t associate with the non-college-educated very much, with the exceptions of my idiot brothers (and they have some community college)
My baristas all have 4-year college degrees. Meanwhile, my brothers don’t even have baristas.
Lines are being drawn in society that are becoming increasingly difficult to cross. A mix of the cost of college, the cost of housing in areas with good schools, casual racism, formal racism, etc.
It’s not good for society.
(I’m not sure I would say that I associate with the baristas either, actually…)
This is interesting to me, because I hated, hated, hated public high school. I wasn’t a troublemaker, but I simply never did any work, and my grades reflected that, mostly. I did, however, score in the 700s on my SATs, which I’m sure caused a lot of head scratching in college admissions departments.
I did know a lot of people who got high grades but fared badly (certainly much worse than I) on the SATs.
@JKB: I would say less available rather than less attractive. The ensuing gutting of wages and lunatic predisposition to moving toward right to work philosophy within the society was what made the trades less attractive. On the other hand, you can’t create a plutocracy without the plutes, I guess.
@CSK: My brother was the one who hated high school. I actually enjoyed school so much that I eventually became a teacher. What helped make the difference for me though was that early in junior high school (at the first grading period of 7th grade to be exact), I decided that I was never again going to work for the approval of the teachers and administrators. I was in it for what I could get that I cared about from then on. As a result, my grades almost never reflected what I actually learned in anything. I remember one of our National Merit Scholarship qualifiers (is the NMSQT even a thing anymore?) noting to me that I had done better on the test than a lot of the “smart” kids. How he knew that is beyond me though.
Cracker: an acquired taste since 1952.
@Just nutha ignint cracker:
In my case, I think my do-nothingness in high school was a function of the absolute contempt I had for the vast majority of my teachers (one or two were great). In my book, they were a pack of zombie jerks who made us do stupid things for stupid reasons. And this was considered a very good school district.
I was an excellent student in college, went on to get a Ph.D, and became a…teacher. Granted, that was at the university level, and most of the reason I was attracted to the profession was that it provided a lot of time to write, but even so…
Funnily enough, this is exactly what those of us who opposed dropping standardized tests said would happen. Whenever people said the tests were racist/sexist, I would ask them to point to specific questions that were bigoted and their only answer was to point at the test results, which was lazy thinking. You never want to throw away objective information because then your admissions because more subjective which tends to favor the wealthy and connected. You can always account for disparities in testing; you can’t account for disparities in recommendation letters.
I’m hoping other universities follow MIT’s lead and turn away from this insanity. Like James, I favor a lottery system: set minimum requirements and anyone who meets them gets a ticket. This would eliminate the nonsensical idea that you can distinguish the best from the best at this level. And it would also be a huge stress relief to high school kids who are having to go to insane lengths of extracurriculars and classes to outcompete each other.
Lots of stuff to discuss here. First, admission to an elite college is not good news for people who will not succeed there. And standardized tests are probably an ok predictor of that, though grades and test scores don’t necessarily track. My parents were not college educated. Neither are my siblings. I went to the University of California at Berkeley (engineering BS, 1970) because it was close to where I lived, because I had a B+ average in high school, and because I was just good at standardized tests. And at the time, that was all it took, there was no tuition, and I could live on NDEA loans and grants. I was a B student and did not go to grad school. I went on to a great career in my chosen field, and my lackluster grades did not hold me back. Today, most of this probably would not have happened for me, a smart white working class kid with smart, but uneducated parents. I tell this story to point out that the vast majority of American 18 year olds are entering a terrifying world of tough choices with not enough resources and pretty poor guidance. “Rich” parents are largely in a ridiculous prestige competiton and “poor” parents are hitting a brick wall. In retirement I am a volunteer STEM mentor of smart college bound high school kids. In 13 years of doing this, two of my several hundred students have gone to MIT. Most of the rest have done fine at less elite schools, most at obscenely high cost. My father’s sole guidance to me on college was, “Get that piece of paper, and you can write your own ticket.” Nothing in there about which school that piece of paper came from.
@Ed:
I think that for your parents’ generation, almost any college would do, and the Ivies were seen as the preserve of rich bluebloods.
And–again with your parents’ generation–far fewer people attended college then, so it really was a mark of distinction for those who did.