Remix.run Logo
rayiner 6 days ago

High school grades in the U.S. aren’t standardized and aren’t reliable. A standardized test like the SAT is the strongest predictor of college success: https://www.reddit.com/r/Sat/comments/1alp6vh/the_evidence_i... (collecting evidence)

ghaff 6 days ago | parent | next [-]

I took a grad marketing class once with a business professor who studied this sort of thing. GMATs rather than SATs but same idea. Basically GMATs mattered more than anything else especially metrics such as letters of recommendation that were basically worthless.

I knew the director of admissions somewhat at an elite school and he said that they basically put a couple of quantitative metrics (like SAT) on one axis and read essays and considered other metrics like interviews on the other axis for diversity before that term became popular.

The upper right more or less got in, the lower left didn't, and then they debated the middle ground.

olalonde 6 days ago | parent | prev | next [-]

In Quebec, grades are normalized using a statistical formula that factors in how well students from your high school tend to perform in university[0]. This means an average student at an "elite" school could end up with a similar score to a top student from a weaker school.

[0] https://en.wikipedia.org/wiki/R_score

morkalork 6 days ago | parent | next [-]

Wow, interesting. Do students take that into account when selecting which CEGEP to attend?

I don't know how it is in Ontario now, but when I went through HS there university admissions were your top-K grades for the last couple of years and they didn't factor in which school you attended. There were no shortage of private/alternative high schools in Toronto that catered gaming that system with lax workloads and inflated grades.

jjmarr 6 days ago | parent [-]

Most university have their own "adjustment factors" for competitive programs, to counteract this.

morkalork 6 days ago | parent [-]

I'm not sure if universities knew the origin HS at the time because applications within the province were centralized in a single system, also because there was talk at one point of making the HS known which implies it wasn't?

jjmarr 5 days ago | parent [-]

I don't know how it was when you were applying, but when I applied in 2018 the universities knew your HS and Waterloo was doing adjustments based on your high school.

Over the past 7 years other schools have done so as well. Waterloo's adjustment factor list got FOI'd and made public if you want to find yours.

morkalork 4 days ago | parent [-]

Ok! The one I can find only goes back to 2016 and I was applying a bit before that. The grid has a lot of missing data since Waterloo probably doesn't have enough data for each cohort and HS to make a good estimate, I guess that would make a province-wide system like in Québec superior since they can adjust based on outcomes from all universities.

After seeing the list I'm kind of sad, I had the choice between two schools at 10 and 13, and chose the one with 13. A 3% difference can make or break an application in any competitive program... Well, at least it wasn't one of those schools with 20 point factor, wow.

tptacek 5 days ago | parent | prev [-]

Selective universities in the US all do the same thing with high school grades.

mpyne 6 days ago | parent | prev | next [-]

There's a reason the military kept using the ASVAB even during the worst parts of COVID pandemic. ASVAB is a very solid predictor of success in training, and in Navy experience it's predictive value generally correlates with with how academic/technical the training pipeline is.

derbOac 6 days ago | parent | prev | next [-]

That paper is pretty misleading and flies in the face of most peer-reviewed research (I don't know that journal, for what it's worth).

My guess is because it was focused on those attending elite institutions:

"In their paper on admissions to highly selective colleges... students at each of the schools in this analysis... Students opting to not submit an SAT/ACT score achieve relatively lower college GPAs when they attend an Ivy-Plus college..."

My guess is the meaning of a high or low GPA versus standardized test changes quite a bit when you have groups very highly selected based on a wealth of other information.

The Dartmouth report has always frustrated because they, along with that other paper, selectively present conditional means rather than scatterplots, hiding the variability around points to make things look more predictive than they are. Means by predictor level are almost useless without knowing the conditional variance for each predictor level. They're basically deliberately pretending that there is no error variance in the prediction equation.

Meta-analyses suggest that both standardized test performance and GPA predict later performance. For example:

https://www.tandfonline.com/doi/abs/10.1080/10627197.2015.99...

In some literature, GPA is superior, and others, testing.

There are other studies from decades ago showing that when standardized tests are temporarily removed from admissions (e.g., due to a court ruling), it has almost no influence on outcomes of admitted students later, suggesting admissions committees are able to select comparable students without tests.

I'm not saying tests are horrible and should be omitted, I just think people really overstate their predictive utility and it causes a ton of problems down the road.

ghaff 6 days ago | parent [-]

Basically standardized tests (and GPAs--however corrected) are both good predictors. Depending upon the institution's objectives, other factors may play in as well though they may not correlate that well to GPA in university which may or may not be a good thing depending on your perspective. My personal opinion in that it doesn't really matter past a certain point. (You don't want people to flunk out but the objective isn't really to get good university grades.)

siva7 6 days ago | parent | prev | next [-]

So? In many countries high school grades also aren't standardized and counts 100% for admission. The system still works reliably and not worse than in america.

sokoloff 6 days ago | parent | next [-]

“Not worse” in what sense? Is there a Stanford/MIT/Caltech/Harvard/N-others of equivalent global prestige/regard in those countries?

Mountain_Skies 6 days ago | parent | prev [-]

Can you quantify that claim?

orochimaaru 6 days ago | parent | prev [-]

The SAT isn't strong enough to predict anything. It can generally be answered by someone in their sophomore year at college or even their freshman, depending on what level of courses they are taking.

The problem finding a hard enough test with as little human intervention for assessments. Because human intervention brings with it subjectivity. This subjectivity was manageable when there weren't so many people applying for top schools (e.g. in the early 1900's). But right now its not.

SAT/ACT/GRE are no indicator of success. What this "study" is merely proving is that schools may have regressed in their rigor for grading hard courses.

malfist 6 days ago | parent [-]

Why does it matter if a college student, after three years of education, can do well on the entrance exam? Isn't that a given?

peterfirefly 6 days ago | parent [-]

It should be. I don't think it is, especially not among the favoured parts of the student population (athletics, legacies, "disadvantaged", "minorities").