The first weekend of December brings more than just dwindling daylight and inescapable holiday cheer to high school students; many teens sit for the last SAT administration of the calendar year. What do we know about the SAT students took this weekend?
1. The test seemed easier than practice tests, which has been the disappointing trend in 2018.
2. Certain international test centers administered a previously leaked SAT, which has also been the disappointing trend in 2018.
3. The math section went heavy on statistics.
We also know that any test taker under standard group testing conditions who skipped the optional essay section–which, these days, is most of them–faced a mysterious fifth section of multiple choice questions. Section 5 lasted 20 minutes for everyone, but each test taker could see content from any of the other four test sections.
Section 5 of the SAT is widely believed to be an experimental section, an opportunity for the College Board to pretest questions with a captive audience under test conditions. However, the test maker has been unusually mysterious about what should be a transparent aspect of the exam. Back when this version of the SAT was released, College Board shared (or, rather, buried in very fine print) the following guidance:
The SAT will be given in a standard testing room (to students with no testing accommodations) and consist of four components — five if the optional 50-minute Essay is taken — with each component timed separately. The timed portion of the SAT with Essay (excluding breaks) is three hours and 50 minutes. To allow for pretesting, some students taking the SAT with no Essay will take a fifth, 20-minute section. Any section of the SAT may contain both operational and pretest items.
The College Board rebuffed efforts at the time to gain clarity on this fifth section, so the general consensus accepted Section 5 as a purely experimental section, with no bearing on a student’s test scores. Some have hypothesized ancillary uses for this section, such as testing to make sure a student isn’t cheating, but nobody–including the test maker–has addressed the elephant in the room:
“Any section of the SAT may contain both operational and pretest items.”
In the absence of guidance from the test maker, we can assume that operational items contribute to a score while pretest items serve as experimental material that does not contribute to a score. Interspersing experimental questions throughout the test makes far more sense for statistical validity than informing testers that certain questions have no bearing on test scores. The last iteration of the SAT executed that requirement well: Out of the ten test sections, one extra Math, Reading, or Writing section was mixed in with the rest but would not contribute to the official score. Since students had no real way to identify the experimental section–not for lack of trying–they were forced to act as if all test questions counted.
Contrast the effectiveness of that approach to one where test takers are informed that a certain block of questions has no bearing on the official score. No wonder students routinely, by their own accounts, blow off that last, presumably meaningless test section. Yet, SAT Section 5 may not be as innocuous as widely believed. Some of our students just reported that their proctors at the December 2018 SAT informed their groups that some of the questions on Section 5 do count towards the official score. Specifically, a certain number of questions on that section would count, while some questions from the previous section covering the same content would not.
Either these proctors were ill-informed, which happens far too often, or someone finally shared critical information that College Board has failed to clarify. Both possibilities, unfortunately, lead to the same crisis of confidence in the validity of this test.
Does SAT Section 5 count in any way towards official scores? As recently as last month, College Board refused to answer that question. Until we all receive the official answers that any competent, credible organization would provide about such an influential standardized exam, test takers would be wise to take Section 5 of the SAT as seriously as they do the first four sections. Play to the final whistle to ensure that every question that might contribute to your score receives your best focus, commitment, and effort.