1 00:00:15,356 --> 00:00:15,796 Speaker 1: Pushkin. 2 00:00:27,076 --> 00:00:30,516 Speaker 2: It's eight o'clock in the morning on a Saturday, a 3 00:00:30,556 --> 00:00:37,276 Speaker 2: little chili deep in downtown Manhattan. Streets are empty. I'm 4 00:00:37,316 --> 00:00:41,076 Speaker 2: standing on the sidewalk with my assistant, Camille Baptista. 5 00:00:41,476 --> 00:00:44,756 Speaker 1: First of all, Camille needs no did you did you 6 00:00:44,796 --> 00:00:45,596 Speaker 1: sleep well last night? 7 00:00:45,916 --> 00:00:49,676 Speaker 3: I did sleep well. Yes, I did not, really I could. 8 00:00:49,556 --> 00:00:50,356 Speaker 1: Almost know sleep. 9 00:00:50,356 --> 00:00:53,116 Speaker 2: And I had a nightmare about the l SAT that 10 00:00:53,276 --> 00:00:55,516 Speaker 2: I left before him so over. I had an exam 11 00:00:55,596 --> 00:00:57,716 Speaker 2: nightmare from high school, essentially a high. 12 00:00:57,556 --> 00:00:59,476 Speaker 3: School See you left before it was over. 13 00:01:01,596 --> 00:01:04,436 Speaker 2: I had a nightmare about the l SAT that I 14 00:01:04,516 --> 00:01:08,276 Speaker 2: walked out before the test was over. Oh but my 15 00:01:08,476 --> 00:01:23,156 Speaker 2: nightmare was just beginning. This is Malcolm Gladwell. I'm back 16 00:01:23,396 --> 00:01:27,636 Speaker 2: with season four of Revisionist History, my podcast about things 17 00:01:27,676 --> 00:01:40,476 Speaker 2: overlooked and misunderstood. This episode is about what happened when 18 00:01:40,516 --> 00:01:44,676 Speaker 2: Camille and I took the law school admissions test. We 19 00:01:44,756 --> 00:01:48,356 Speaker 2: had three number two pencils each, a small pack of Kleenex, 20 00:01:48,796 --> 00:01:51,876 Speaker 2: a package of trail Mix, all in clear plastic bags. 21 00:01:52,396 --> 00:01:55,596 Speaker 2: We lined up outside Pacey University with hundreds of other 22 00:01:55,636 --> 00:02:00,996 Speaker 2: nervous people clutching clear plastic bags. Everyone wanted someday to 23 00:02:01,036 --> 00:02:05,596 Speaker 2: become lawyers except us. We were there in the name 24 00:02:05,636 --> 00:02:06,196 Speaker 2: of science. 25 00:02:09,796 --> 00:02:10,316 Speaker 1: We had to go. 26 00:02:10,716 --> 00:02:15,836 Speaker 2: Yeah, it's all been very traumatic and stressful, but I 27 00:02:15,876 --> 00:02:17,356 Speaker 2: wanted to get one last thing. I would like to 28 00:02:17,396 --> 00:02:20,436 Speaker 2: get your handicap on your chances of beating Just tell 29 00:02:20,476 --> 00:02:21,516 Speaker 2: me what you think your chances. 30 00:02:21,356 --> 00:02:25,556 Speaker 3: Of beating me are my chances as a Your mom, 31 00:02:25,596 --> 00:02:27,516 Speaker 3: I would point out, was quite confident you would win. 32 00:02:28,516 --> 00:02:31,476 Speaker 3: My mom is confident in me no matter what, which 33 00:02:31,516 --> 00:02:35,396 Speaker 3: is very nice, but you know, maybe unrealistic. Uh, you know, 34 00:02:35,596 --> 00:02:39,756 Speaker 3: I don't know. Fifty to fifty, Camille, I really am. 35 00:02:40,116 --> 00:02:42,636 Speaker 3: I told you I am twenty four. 36 00:02:43,196 --> 00:02:45,636 Speaker 2: Okay, I can't even I won't even tell you how 37 00:02:45,756 --> 00:02:47,956 Speaker 2: I am. But it's it is a It is a 38 00:02:48,036 --> 00:02:49,796 Speaker 2: large multiple of your age, I know. 39 00:02:49,836 --> 00:02:51,596 Speaker 3: But I don't think it has I don't think it 40 00:02:51,596 --> 00:02:52,956 Speaker 3: has to do with age. I think it has to 41 00:02:52,956 --> 00:02:57,476 Speaker 3: do with reading ability. And you read non stop twenty 42 00:02:57,516 --> 00:02:58,236 Speaker 3: four hours a day. 43 00:02:58,356 --> 00:03:01,516 Speaker 2: I've been an intellectual. I've been in cognitive cline for 44 00:03:01,556 --> 00:03:06,556 Speaker 2: thirty years. It's all going to be exposed. All right, 45 00:03:06,636 --> 00:03:13,036 Speaker 2: we're off, We're going to go. I got the idea 46 00:03:13,076 --> 00:03:16,316 Speaker 2: of taking the l SAT from a man named William Henderson. 47 00:03:17,556 --> 00:03:19,516 Speaker 2: I read a paper that he wrote. It was on 48 00:03:19,596 --> 00:03:23,316 Speaker 2: my favorite website SSRN, which is where academics from around 49 00:03:23,356 --> 00:03:26,356 Speaker 2: the world post their papers and they get ranked. If 50 00:03:26,356 --> 00:03:29,316 Speaker 2: you're a regular listener to this podcast, you'll know how 51 00:03:29,436 --> 00:03:36,076 Speaker 2: genius I think SSRN is. Anyway, this paper was called 52 00:03:36,596 --> 00:03:41,356 Speaker 2: the l SAT Law School Exams and Meritocracy, The Surprising 53 00:03:41,436 --> 00:03:46,836 Speaker 2: and under Theorized role of test taking Speed. Anything with 54 00:03:46,956 --> 00:03:50,276 Speaker 2: the words surprising and under theorized in the title, of course, 55 00:03:50,636 --> 00:03:53,516 Speaker 2: is going to be catnet for me. So I read it, 56 00:03:54,276 --> 00:03:58,836 Speaker 2: then I read it again. Then I had to meet him. 57 00:03:59,076 --> 00:04:02,076 Speaker 4: So just a little bit of a background here. I 58 00:04:02,116 --> 00:04:04,276 Speaker 4: didn't go to law schoolto was thirty five, and so 59 00:04:04,356 --> 00:04:07,996 Speaker 4: I had had a whole career before then. 60 00:04:08,356 --> 00:04:11,476 Speaker 2: Why what were you doing before you became a lawyer. 61 00:04:12,036 --> 00:04:15,036 Speaker 4: I was a firefighter paramedic. I was a union rep 62 00:04:15,196 --> 00:04:18,916 Speaker 4: for a suburban Cleveland fire department. I did that for 63 00:04:19,556 --> 00:04:21,956 Speaker 4: nine years and as a kid, people, and remember, I'm 64 00:04:21,996 --> 00:04:24,356 Speaker 4: kidding as I went to law school because of those 65 00:04:24,396 --> 00:04:25,916 Speaker 4: bastard management attorneys. 66 00:04:26,316 --> 00:04:29,276 Speaker 2: Henderson goes to law school. After that, he gets a 67 00:04:29,276 --> 00:04:32,196 Speaker 2: clerkship with a judge and one day he's in a 68 00:04:32,276 --> 00:04:34,876 Speaker 2: shower and a thought occurs to him. What was the 69 00:04:34,916 --> 00:04:40,276 Speaker 2: aha in a shower? The specific aha was what. 70 00:04:39,076 --> 00:04:43,796 Speaker 4: Was my God? The two most time pressure things I've 71 00:04:43,836 --> 00:04:46,636 Speaker 4: ever done in my life is taking the LSAT and 72 00:04:46,716 --> 00:04:48,396 Speaker 4: these damn law school exams. 73 00:04:48,716 --> 00:04:51,876 Speaker 2: He had been a firefighter paramedic, he had raced to 74 00:04:51,916 --> 00:04:54,276 Speaker 2: the streets of Cleveland to save people on the brink 75 00:04:54,316 --> 00:04:57,556 Speaker 2: of death. And then most time pressure he'd ever felt 76 00:04:57,836 --> 00:04:59,756 Speaker 2: was taking the l set to get into law school 77 00:04:59,836 --> 00:05:01,836 Speaker 2: and then taking the exams once he got there. 78 00:05:01,916 --> 00:05:06,236 Speaker 4: I can remember taking Cass Sunstein's Elements exam my first 79 00:05:06,316 --> 00:05:08,036 Speaker 4: year of law school is a two hour exam. 80 00:05:09,196 --> 00:05:11,916 Speaker 2: Stein used to teach at the University of Chicago, which 81 00:05:11,956 --> 00:05:14,876 Speaker 2: is where Henderson went to law school. He's a genius. 82 00:05:15,316 --> 00:05:17,316 Speaker 2: He asked the kind of questions that you can spend 83 00:05:17,356 --> 00:05:22,436 Speaker 2: months years thinking about. But his exam two hours. That's 84 00:05:22,476 --> 00:05:23,236 Speaker 2: all you got. 85 00:05:23,476 --> 00:05:26,956 Speaker 4: The proctor said time, and everybody dropped their pencils and 86 00:05:26,996 --> 00:05:30,956 Speaker 4: there was this huge ug you know, everybody was like 87 00:05:31,156 --> 00:05:33,876 Speaker 4: groaning that they didn't get more time to keep on 88 00:05:33,956 --> 00:05:36,996 Speaker 4: working on Cass Sunstein's Element exam. It's like, you know, 89 00:05:37,116 --> 00:05:39,676 Speaker 4: ninety people who all dropped their pencil and they're all, 90 00:05:39,956 --> 00:05:43,156 Speaker 4: you know, exclaiming the desire for more time. That was 91 00:05:43,196 --> 00:05:44,356 Speaker 4: a memorable experience. 92 00:05:44,956 --> 00:05:48,196 Speaker 2: Now, I'm sure this is obvious to you, particularly if 93 00:05:48,196 --> 00:05:51,276 Speaker 2: you're an American. You've been tested a thousand times in 94 00:05:51,316 --> 00:05:55,796 Speaker 2: your life, SAT ACT, GRE on and on, and every 95 00:05:55,836 --> 00:05:58,996 Speaker 2: one of those standardized tests doesn't just test whether you 96 00:05:59,036 --> 00:06:02,236 Speaker 2: can answer the question correctly. They test how quickly you 97 00:06:02,236 --> 00:06:05,636 Speaker 2: can answer the question correctly. But I'm a Canadian. I've 98 00:06:05,636 --> 00:06:08,836 Speaker 2: never taken a standardized test in my life, and as 99 00:06:08,836 --> 00:06:11,716 Speaker 2: an hour I have to say the whole system seems 100 00:06:11,756 --> 00:06:16,796 Speaker 2: really weird. Why is quicker better? The L set is 101 00:06:16,876 --> 00:06:20,916 Speaker 2: Exhibit A. It's the single most important thing that determines 102 00:06:21,156 --> 00:06:23,836 Speaker 2: where you go to law school. Nothing else comes close. 103 00:06:24,276 --> 00:06:26,716 Speaker 2: And what is it? It's around one hundred and twenty 104 00:06:26,756 --> 00:06:33,156 Speaker 2: five questions, divided among five sections analytical reasoning, reading, comprehension, 105 00:06:33,596 --> 00:06:37,796 Speaker 2: two sections on dissecting an argument, and one experimental section. 106 00:06:38,356 --> 00:06:41,836 Speaker 2: Everything's multiple choice. You mark your answers with a pencil 107 00:06:42,076 --> 00:06:45,316 Speaker 2: by filling in little bubbles on an answer sheet like 108 00:06:45,356 --> 00:06:49,236 Speaker 2: an IBM punch card. A perfect score is one eighty, 109 00:06:49,636 --> 00:06:52,436 Speaker 2: and if you're a super go getter, you cannot score 110 00:06:52,516 --> 00:06:55,676 Speaker 2: below one seventy five because then you can't get into 111 00:06:55,676 --> 00:06:58,036 Speaker 2: Harvard and if you can't get into Harvard, you're never 112 00:06:58,076 --> 00:06:59,836 Speaker 2: going to get an offer from a big law firm 113 00:07:00,036 --> 00:07:04,516 Speaker 2: or get a Supreme Court clerkship. Your life is over everything. 114 00:07:04,796 --> 00:07:08,996 Speaker 2: The country club, the BMW, the multiple cases of two thousand, 115 00:07:09,236 --> 00:07:14,876 Speaker 2: Chateau Lafitte, Rothschild, it hinges on those five sections, And 116 00:07:14,996 --> 00:07:16,916 Speaker 2: how long do you get to spend on each of 117 00:07:16,916 --> 00:07:21,876 Speaker 2: those five sections? Thirty five minutes, not forty, not fifty, 118 00:07:22,276 --> 00:07:25,556 Speaker 2: not fifty five. And if you finish up one section early, 119 00:07:25,756 --> 00:07:27,636 Speaker 2: you don't get to add that time to the next section. 120 00:07:28,396 --> 00:07:31,436 Speaker 2: When we decide who is smart enough to be a lawyer, 121 00:07:31,956 --> 00:07:38,356 Speaker 2: we use a stopwatch. So that was William Henderson's question. 122 00:07:38,756 --> 00:07:41,556 Speaker 2: What does putting that thirty five minute time limit on 123 00:07:41,596 --> 00:07:46,156 Speaker 2: a cognitive test like the LSAT do? So I said 124 00:07:46,196 --> 00:07:51,436 Speaker 2: to Camille, let's find out, And because we're both super competitive, 125 00:07:51,676 --> 00:07:55,716 Speaker 2: the whole thing got very involved. The first thing I 126 00:07:55,756 --> 00:07:58,876 Speaker 2: would like to do is to understand on a very 127 00:07:58,996 --> 00:08:03,996 Speaker 2: very granular level, what time pressure means for the way 128 00:08:04,036 --> 00:08:07,716 Speaker 2: people take the test, the strategies they use, the kinds 129 00:08:07,756 --> 00:08:12,556 Speaker 2: of mistakes they may specific Everyone told me that there 130 00:08:12,596 --> 00:08:14,236 Speaker 2: was no way I could do well on the l 131 00:08:14,316 --> 00:08:17,676 Speaker 2: set without getting some coaching. So I went to one 132 00:08:17,676 --> 00:08:21,516 Speaker 2: of the top new educational technology startups in America, a 133 00:08:21,556 --> 00:08:25,676 Speaker 2: company in New York called Noodle, started by John Katzman, 134 00:08:25,996 --> 00:08:28,516 Speaker 2: who before this was one of the founders of the 135 00:08:28,516 --> 00:08:32,796 Speaker 2: famous Princeton Review test prep company. I sat down with 136 00:08:32,876 --> 00:08:35,676 Speaker 2: Katsman and two of his top people in a big 137 00:08:35,796 --> 00:08:40,276 Speaker 2: loft building on Union Square in Manhattan. Katzman, Fritz Stewart 138 00:08:40,476 --> 00:08:41,676 Speaker 2: and Dan Edmonds. 139 00:08:42,116 --> 00:08:43,476 Speaker 1: No, but I am very. 140 00:08:45,116 --> 00:08:47,316 Speaker 2: Very anxious not to lose to Camille. 141 00:08:47,436 --> 00:08:50,236 Speaker 5: So I thought he was she born in the US 142 00:08:50,316 --> 00:08:51,196 Speaker 5: or in the UK. 143 00:08:51,356 --> 00:08:53,916 Speaker 2: Oh, she's went to a fancy school, like this serious, 144 00:08:53,956 --> 00:08:59,116 Speaker 2: seriously intelligent woman. But I'm saying US or UK, we US. 145 00:08:58,956 --> 00:08:59,556 Speaker 1: Okay, you have. 146 00:09:02,556 --> 00:09:06,556 Speaker 2: Oh great, I'm too old and I'm from the wrong country. 147 00:09:07,236 --> 00:09:10,956 Speaker 2: It was not an encouraging start. I've done things under 148 00:09:10,996 --> 00:09:15,036 Speaker 2: time pressure before. Of course. I've written newspaper stories on deadline, 149 00:09:15,196 --> 00:09:18,156 Speaker 2: I wrote exams in college. In those cases, though, the 150 00:09:18,236 --> 00:09:21,476 Speaker 2: task required me to be me only with a sense 151 00:09:21,476 --> 00:09:24,276 Speaker 2: of urgency. But the first thing the Noodle guys told 152 00:09:24,356 --> 00:09:27,396 Speaker 2: me was the l set didn't require me to be me. 153 00:09:28,036 --> 00:09:30,036 Speaker 2: It required me to be someone else. 154 00:09:30,756 --> 00:09:33,436 Speaker 6: A lot of it is about helping people understand. They 155 00:09:33,516 --> 00:09:35,476 Speaker 6: don't get to do this at a comfortable speed. 156 00:09:35,836 --> 00:09:37,396 Speaker 2: It's Dan Edmonds right. 157 00:09:37,436 --> 00:09:39,796 Speaker 6: In order to finish these sections, you have to do 158 00:09:39,836 --> 00:09:42,876 Speaker 6: it at a speed that's a little uncomfortable, which means 159 00:09:42,956 --> 00:09:47,436 Speaker 6: you have to hone your instincts by the test rules, 160 00:09:47,836 --> 00:09:48,876 Speaker 6: not by your rules. 161 00:09:49,676 --> 00:09:52,116 Speaker 2: What does it mean to read it at an uncomfortable speed? 162 00:09:54,436 --> 00:09:54,756 Speaker 1: For me? 163 00:09:54,996 --> 00:09:58,556 Speaker 6: It means that if there's something like in a reading 164 00:09:58,556 --> 00:10:01,156 Speaker 6: comprehension passage, if I hit a paragraph that I don't 165 00:10:01,196 --> 00:10:03,236 Speaker 6: fully understand, I don't get to go back and reread it. 166 00:10:03,716 --> 00:10:05,236 Speaker 6: I just kind of have to accept the parts that 167 00:10:05,236 --> 00:10:06,316 Speaker 6: I understand and move on. 168 00:10:06,716 --> 00:10:10,836 Speaker 2: The noodle guys approach the l set like pathologists approach 169 00:10:11,036 --> 00:10:11,636 Speaker 2: a cadaver. 170 00:10:12,196 --> 00:10:14,476 Speaker 7: For me, I'm like, Eh, all right, I didn't get that, 171 00:10:14,636 --> 00:10:16,916 Speaker 7: But if a question asks about it, I will go back. 172 00:10:16,916 --> 00:10:19,156 Speaker 7: But it doesn't bother me as long as I understand 173 00:10:19,156 --> 00:10:21,636 Speaker 7: the topic, sentence of the paragraph, and the overall thrust 174 00:10:21,676 --> 00:10:24,036 Speaker 7: of the author's argument. If I miss a few details 175 00:10:24,036 --> 00:10:27,356 Speaker 7: here and there, or even a chunk of the argument, 176 00:10:27,596 --> 00:10:30,596 Speaker 7: I'm like, all right, fine, who cares, I'll go dig 177 00:10:30,636 --> 00:10:31,876 Speaker 7: it out exactly when I need to. 178 00:10:32,436 --> 00:10:35,756 Speaker 2: Wait. It's okay to miss a chunk of the argument. 179 00:10:36,116 --> 00:10:39,436 Speaker 7: So I don't even aim for a level of what 180 00:10:39,476 --> 00:10:43,036 Speaker 7: we would normally call comprehension, and my first read I 181 00:10:43,076 --> 00:10:46,556 Speaker 7: am out to process the information, not understand it. I 182 00:10:46,556 --> 00:10:48,836 Speaker 7: don't get any points for understanding it. I get points 183 00:10:48,836 --> 00:10:50,036 Speaker 7: for bubbling in the right question. 184 00:10:50,636 --> 00:10:52,156 Speaker 6: I imagine that when you read, there are lots of 185 00:10:52,156 --> 00:10:54,356 Speaker 6: moments where you sort of oh, that's an interesting point, 186 00:10:54,356 --> 00:10:56,036 Speaker 6: and you sort of pause and you think, and you 187 00:10:56,636 --> 00:10:59,116 Speaker 6: let your mind meander a little bit. There's no meander 188 00:10:59,116 --> 00:11:01,916 Speaker 6: time on the alf set, there's no digression time. 189 00:11:02,436 --> 00:11:06,196 Speaker 2: Meander and digression are my whole m. That's what I 190 00:11:06,316 --> 00:11:08,716 Speaker 2: do for a living. What do you think this podcast 191 00:11:08,796 --> 00:11:13,716 Speaker 2: comes from? So then John Katzman gave me a sample question. 192 00:11:14,236 --> 00:11:17,476 Speaker 5: What I would have you do is read this, and 193 00:11:17,516 --> 00:11:21,676 Speaker 5: then for each of these questions, tell me the two 194 00:11:21,796 --> 00:11:27,316 Speaker 5: stupidest answers, too stupidest, okay, the two answer choices that 195 00:11:27,396 --> 00:11:28,316 Speaker 5: you know are wrong. 196 00:11:28,676 --> 00:11:29,796 Speaker 1: WHOA, this is what? 197 00:11:30,436 --> 00:11:31,036 Speaker 5: That's what I'm saying. 198 00:11:31,076 --> 00:11:33,156 Speaker 1: You can't read this on a podcast, No, No, I can't. 199 00:11:33,236 --> 00:11:37,356 Speaker 2: The passage with six hundred words it seemed longer. I've 200 00:11:37,436 --> 00:11:40,196 Speaker 2: just been told that I don't need to understand it. 201 00:11:40,796 --> 00:11:43,476 Speaker 2: I don't need to comprehend it. It's okay if I 202 00:11:43,556 --> 00:11:46,076 Speaker 2: miss chunks of it. In other words, I'm supposed to 203 00:11:46,076 --> 00:11:48,876 Speaker 2: read it without reading it. And as I sit there 204 00:11:49,076 --> 00:11:51,796 Speaker 2: puzzling about this, the three of them debate right in 205 00:11:51,836 --> 00:11:54,636 Speaker 2: front of me. How long this reading without reading should take. 206 00:11:55,156 --> 00:11:59,236 Speaker 2: John said a minute, Fritz said three tops, Dan said 207 00:11:59,356 --> 00:12:02,236 Speaker 2: it depends on the person who's reading. The only thing 208 00:12:02,276 --> 00:12:04,716 Speaker 2: they all agreed on was that I had to hurry. 209 00:12:04,676 --> 00:12:07,596 Speaker 1: Fly and get the bones of the argument. 210 00:12:09,116 --> 00:12:12,436 Speaker 5: Now feel free to spend the time on the question itself. 211 00:12:12,836 --> 00:12:16,236 Speaker 5: And again, all you're trying to do is tell me 212 00:12:16,276 --> 00:12:17,916 Speaker 5: the two worst answers. 213 00:12:17,956 --> 00:12:20,276 Speaker 1: Two worst answers, What do you tell me? I'm on 214 00:12:20,316 --> 00:12:20,876 Speaker 1: your structure. 215 00:12:21,596 --> 00:12:25,676 Speaker 2: Just so, this is on page one two right, already 216 00:12:26,036 --> 00:12:26,236 Speaker 2: got it? 217 00:12:26,316 --> 00:12:26,596 Speaker 1: Okay? 218 00:12:26,796 --> 00:12:29,276 Speaker 2: I read it out loud because I thought maybe that 219 00:12:29,316 --> 00:12:33,796 Speaker 2: would help researcher. People who participate in opinion surveys often 220 00:12:33,836 --> 00:12:37,116 Speaker 2: give answers they believe the opinion surveyor wants to hear, 221 00:12:37,716 --> 00:12:40,356 Speaker 2: and for this reason that some opinion surveys do not 222 00:12:40,396 --> 00:12:43,996 Speaker 2: reflect the actual views of those being surveyed. However, in 223 00:12:44,076 --> 00:12:46,756 Speaker 2: well constructed surveys, the questions are worded so as to 224 00:12:46,756 --> 00:12:50,836 Speaker 2: provide respondence with no indication of which answers the surveyor 225 00:12:50,956 --> 00:12:55,836 Speaker 2: might expect after the passage. There were multiple sets of 226 00:12:55,916 --> 00:12:58,836 Speaker 2: questions to test my understanding of what I had just 227 00:12:58,876 --> 00:13:01,556 Speaker 2: not read. There were pages of them. So if a 228 00:13:01,556 --> 00:13:05,716 Speaker 2: survey is well constructed, survey responders desire to meet surveyor's 229 00:13:05,716 --> 00:13:10,596 Speaker 2: expectations has no effect on the survey's results. The reasoning 230 00:13:10,636 --> 00:13:14,436 Speaker 2: in the researcher's argument is questionable in that the argument 231 00:13:14,516 --> 00:13:19,036 Speaker 2: overlooks the possibility that they must say A and B 232 00:13:19,396 --> 00:13:20,996 Speaker 2: are uh. 233 00:13:23,316 --> 00:13:25,756 Speaker 5: Just across map and move on to the actions. 234 00:13:25,916 --> 00:13:27,836 Speaker 1: Okay, those are the worst. 235 00:13:27,996 --> 00:13:29,836 Speaker 5: Not They're wrong, They're the worst answers. 236 00:13:30,876 --> 00:13:31,876 Speaker 2: The clock is ticking. 237 00:13:32,716 --> 00:13:38,036 Speaker 1: Well, this is such a brutal passage, shine cruel, Jesus bananas. 238 00:13:38,316 --> 00:13:39,476 Speaker 1: What am I aunt? Time wise? 239 00:13:40,956 --> 00:13:43,876 Speaker 2: This is what they meant when they talked about uncomfortable reading. 240 00:13:44,556 --> 00:13:47,796 Speaker 2: I was being forced into a kind of altered, frenzied state. 241 00:13:48,476 --> 00:13:51,596 Speaker 2: The word they used was breathless. You should be a 242 00:13:51,596 --> 00:13:55,436 Speaker 2: little breathless, they said. I was breathless. I kept asking 243 00:13:55,956 --> 00:13:59,076 Speaker 2: how much time has passed? They tell me my heart 244 00:13:59,116 --> 00:14:01,636 Speaker 2: would accelerate. I started to panic. 245 00:14:04,276 --> 00:14:07,116 Speaker 7: Okay, okay, I have no idea what I did great 246 00:14:07,316 --> 00:14:10,956 Speaker 7: timing on that seven minute twenty. 247 00:14:10,996 --> 00:14:13,996 Speaker 5: So this section is how long minutes? 248 00:14:14,116 --> 00:14:15,996 Speaker 1: Thirty five minutes, thirty five, thirty five. 249 00:14:15,796 --> 00:14:18,756 Speaker 5: Minutes And we just did one, two, three, four, five, 250 00:14:20,076 --> 00:14:23,956 Speaker 5: six seven questions you would have had, say, ten minutes. 251 00:14:25,276 --> 00:14:27,516 Speaker 1: Yeah, but I haven't picked any right answers yet. 252 00:14:28,036 --> 00:14:30,716 Speaker 7: But you've done all the harder And that was four 253 00:14:30,756 --> 00:14:33,356 Speaker 7: and a half oh seven and a half seven seven twenty. 254 00:14:33,636 --> 00:14:35,196 Speaker 1: So you're tight. 255 00:14:36,236 --> 00:14:42,276 Speaker 2: Oh man, you're not toast. Oh I'm toast. We did 256 00:14:42,316 --> 00:14:45,236 Speaker 2: another question. I was convinced the answer was B. 257 00:14:46,436 --> 00:14:46,836 Speaker 1: It was C. 258 00:14:47,916 --> 00:14:52,356 Speaker 2: I could feel Harvard slipping away. Great, thank you. Will 259 00:14:52,396 --> 00:14:54,796 Speaker 2: you guys think my aunts are of a beating Camille? 260 00:14:55,116 --> 00:14:59,876 Speaker 6: Do you want the honest answer? I think you're in 261 00:14:59,916 --> 00:15:03,036 Speaker 6: real trouble, buddy. 262 00:15:06,316 --> 00:15:08,436 Speaker 2: On the day of the l SAT, I sat in 263 00:15:08,476 --> 00:15:11,356 Speaker 2: a little class in one of those fixed half desks 264 00:15:11,356 --> 00:15:13,756 Speaker 2: that I last had in grade school. We got our 265 00:15:13,836 --> 00:15:17,596 Speaker 2: test packets. I raced through reading comprehension with time to 266 00:15:17,596 --> 00:15:21,276 Speaker 2: spare sections two and three. I was right up against 267 00:15:21,276 --> 00:15:27,476 Speaker 2: the deadline. Then came analytical reasoning logic games, and I 268 00:15:27,556 --> 00:15:29,916 Speaker 2: looked at the questions and what I had to figure 269 00:15:29,956 --> 00:15:33,076 Speaker 2: out and realized that there was just no way I 270 00:15:33,116 --> 00:15:36,156 Speaker 2: was going to finish in thirty five minutes. I needed 271 00:15:36,196 --> 00:15:39,196 Speaker 2: to slow down, and I wasn't allowed to slow down. 272 00:15:40,316 --> 00:15:43,236 Speaker 2: I glanced behind me and there was Camille with like 273 00:15:43,396 --> 00:15:47,556 Speaker 2: a death stare in her eyes, ruthlessly dispatching question after question. 274 00:15:49,196 --> 00:15:51,476 Speaker 2: Then I looked around some more and saw all these 275 00:15:51,556 --> 00:15:55,556 Speaker 2: kids half my age, beavering away full of purpose, because 276 00:15:55,596 --> 00:15:59,116 Speaker 2: all you Americans, apparently except as Gospel, this idea that 277 00:15:59,156 --> 00:16:01,356 Speaker 2: the smart person is not the person who gets the 278 00:16:01,436 --> 00:16:04,476 Speaker 2: right answer. The smart person is the person who gets 279 00:16:04,476 --> 00:16:15,676 Speaker 2: the right answer the quickest. Mercifully, it ended at one thirty. 280 00:16:16,036 --> 00:16:20,156 Speaker 2: Camille and I stumbled outside into the sunshine, clutching our 281 00:16:20,156 --> 00:16:25,036 Speaker 2: plastic baggies. Our producer, Jacob Smith was waiting. We had 282 00:16:25,476 --> 00:16:27,356 Speaker 2: no idea some people wanted to be lawyers. 283 00:16:27,556 --> 00:16:28,676 Speaker 1: First of all, that was a shock. 284 00:16:30,836 --> 00:16:34,396 Speaker 2: Camille cheated because she she packed my We had to 285 00:16:34,396 --> 00:16:37,436 Speaker 2: have these plastic bags. She packed packed my plastic bag 286 00:16:37,476 --> 00:16:39,396 Speaker 2: for me. But she gave herself like apples and like 287 00:16:39,436 --> 00:16:41,316 Speaker 2: really really lutritious snacks. 288 00:16:41,676 --> 00:16:44,636 Speaker 8: And I got bags, which is the same thing. 289 00:16:45,476 --> 00:16:46,516 Speaker 7: So you had fresh fruit. 290 00:16:46,556 --> 00:16:50,476 Speaker 8: And Malcolm I did Malcolm on Trao Mix from CBS. 291 00:16:50,836 --> 00:16:55,276 Speaker 8: But but but who sharpened all your pencils, Malcolm, and 292 00:16:55,596 --> 00:16:58,676 Speaker 8: packed your little tissues in case your nose runs. 293 00:16:58,676 --> 00:17:01,956 Speaker 9: Right now, after both taking it, who like, what's your 294 00:17:01,956 --> 00:17:02,516 Speaker 9: honest opinion? 295 00:17:02,556 --> 00:17:03,356 Speaker 1: How do you think did better? 296 00:17:04,676 --> 00:17:04,836 Speaker 2: Oh? 297 00:17:04,876 --> 00:17:05,916 Speaker 1: I think it, Camille didn't. 298 00:17:07,076 --> 00:17:10,036 Speaker 2: I was I did so poorly. I was fine, and 299 00:17:10,076 --> 00:17:12,956 Speaker 2: I got really cocky and then I hit the logic 300 00:17:12,996 --> 00:17:15,956 Speaker 2: games and basically I think I got zero right. I 301 00:17:15,956 --> 00:17:18,196 Speaker 2: had no idea what to do. I sat there and 302 00:17:18,276 --> 00:17:20,716 Speaker 2: I was like in a state of complete panic. I 303 00:17:20,836 --> 00:17:23,836 Speaker 2: have I was untested until this moment. Now I have 304 00:17:23,916 --> 00:17:27,716 Speaker 2: been tested. America has taken its measure of me, and 305 00:17:27,796 --> 00:17:33,276 Speaker 2: I'm it's pretty it's pretty humbling experience. Why do Americans 306 00:17:33,356 --> 00:17:37,156 Speaker 2: do this to themselves? Do they play scrabble with a stopwatch? 307 00:17:37,796 --> 00:17:40,916 Speaker 2: In literature class? Do they get extra points for reading 308 00:17:40,996 --> 00:17:44,996 Speaker 2: Tolstoi's War and Piece Overnight? Is there an oscar that 309 00:17:45,076 --> 00:17:46,876 Speaker 2: goes out every year to the movie that got shot 310 00:17:46,916 --> 00:17:56,876 Speaker 2: the quickest? I really don't get it. Okay, time to 311 00:17:56,996 --> 00:17:59,436 Speaker 2: meander and digress. 312 00:17:59,956 --> 00:18:01,996 Speaker 9: I became a grand master at fifteen, so I think 313 00:18:02,036 --> 00:18:04,076 Speaker 9: I became an im right after I turned thirteen. And 314 00:18:04,116 --> 00:18:06,596 Speaker 9: I was a grand master at fifteen, so yeah, yeah, 315 00:18:06,956 --> 00:18:08,796 Speaker 9: that was very very good at the time. 316 00:18:09,236 --> 00:18:13,716 Speaker 2: That's Hikaru Nakamura grew up in Westchester County, outside New 317 00:18:13,756 --> 00:18:16,556 Speaker 2: York City. He's in his early thirties, although he looks 318 00:18:16,636 --> 00:18:19,676 Speaker 2: about half that age. He's one of the best chess 319 00:18:19,676 --> 00:18:22,636 Speaker 2: players in the world. How much chess were you playing 320 00:18:22,676 --> 00:18:23,236 Speaker 2: as a kid? 321 00:18:23,836 --> 00:18:26,516 Speaker 9: Pretty much all the time, so I was playing at 322 00:18:26,516 --> 00:18:29,036 Speaker 9: the Marshall at least I would say two or three 323 00:18:29,076 --> 00:18:31,036 Speaker 9: days every single week, and then I would also be 324 00:18:31,076 --> 00:18:33,956 Speaker 9: playing blitz on the internet chess club. I would say 325 00:18:33,956 --> 00:18:36,636 Speaker 9: at least five to six hours every single day. 326 00:18:37,356 --> 00:18:40,556 Speaker 2: Years ago, I met Magnus Carlson, who is the greatest 327 00:18:40,636 --> 00:18:43,036 Speaker 2: chess player in the world, and I asked him how 328 00:18:43,116 --> 00:18:45,676 Speaker 2: much he used a chess board versus how much he 329 00:18:45,836 --> 00:18:50,156 Speaker 2: just worked through chess positions in his mind, and he said, oh, 330 00:18:50,516 --> 00:18:53,516 Speaker 2: I've practiced mostly in my mind. In fact, I'm working 331 00:18:53,596 --> 00:18:57,756 Speaker 2: on an opening right now. Nakamura is a little like that. 332 00:18:58,396 --> 00:19:02,476 Speaker 2: He's incredibly gracious and humble, but even when he's giving 333 00:19:02,556 --> 00:19:05,436 Speaker 2: you what seems like his full attention, you get the 334 00:19:05,436 --> 00:19:07,996 Speaker 2: feeling that there's a whole separate part of his brain 335 00:19:08,316 --> 00:19:10,436 Speaker 2: breaking down. A bus be Fisher match from the early 336 00:19:10,516 --> 00:19:14,556 Speaker 2: nineteen seventies. The first thing I did after my disaster 337 00:19:14,676 --> 00:19:17,796 Speaker 2: with the l set was call up Hikaru, but I 338 00:19:17,796 --> 00:19:20,676 Speaker 2: didn't want to talk to him about chess. I wanted 339 00:19:20,676 --> 00:19:23,796 Speaker 2: to talk to him about time. So my first question 340 00:19:24,116 --> 00:19:28,316 Speaker 2: about this would be what would happen within reason if 341 00:19:28,356 --> 00:19:30,876 Speaker 2: there was no clock? How does the way that you 342 00:19:30,916 --> 00:19:33,236 Speaker 2: approach a game of chess change if I remove the 343 00:19:33,236 --> 00:19:34,436 Speaker 2: time constrained entirely? 344 00:19:34,756 --> 00:19:37,756 Speaker 9: All right, So if you remove time entirely from the 345 00:19:37,796 --> 00:19:42,196 Speaker 9: game of Chuss, every game of trust would be drawn 346 00:19:42,356 --> 00:19:45,476 Speaker 9: because without time, if you have an nast amount of 347 00:19:45,476 --> 00:19:47,636 Speaker 9: time to think about any given move. If I could 348 00:19:47,676 --> 00:19:50,556 Speaker 9: think for thirty minutes on every single move, I do 349 00:19:50,636 --> 00:19:52,316 Speaker 9: not think I would ever lose a game of trust 350 00:19:52,316 --> 00:19:54,516 Speaker 9: to a human. To a computer, I would still lose, 351 00:19:54,596 --> 00:19:58,036 Speaker 9: but to human even Magnus. Yeah, if I had an 352 00:19:58,036 --> 00:19:59,676 Speaker 9: half hour for every move, I don't think I would 353 00:19:59,676 --> 00:20:00,596 Speaker 9: ever lose to Magnus. 354 00:20:00,836 --> 00:20:04,036 Speaker 2: This is why chess games have a time limit. Otherwise 355 00:20:04,076 --> 00:20:06,676 Speaker 2: it's not a game. Tournaments would go on for months 356 00:20:06,876 --> 00:20:09,436 Speaker 2: and everyone would end up tied for first. It would 357 00:20:09,436 --> 00:20:12,516 Speaker 2: be like Little League. Everyone would get a participation trophy. 358 00:20:13,596 --> 00:20:16,796 Speaker 2: So there's classical chess, which is the kind play of 359 00:20:16,836 --> 00:20:20,876 Speaker 2: the World Championships. Classical allots ninety minutes for the first 360 00:20:20,916 --> 00:20:23,916 Speaker 2: forty moves, then thirty minutes for the rest of the game. 361 00:20:24,276 --> 00:20:28,836 Speaker 2: Winning at classical chess involves calculation, working through many possible 362 00:20:28,836 --> 00:20:33,196 Speaker 2: scenarios before deciding on a move. Then there's blitz chess. 363 00:20:34,236 --> 00:20:36,556 Speaker 2: That's what Hikara was playing for five or six hours 364 00:20:36,596 --> 00:20:39,916 Speaker 2: a day growing up. In blitz, each player gets five 365 00:20:39,956 --> 00:20:41,276 Speaker 2: minutes for the whole game. 366 00:20:41,876 --> 00:20:44,316 Speaker 9: When you play blitz chess, it very much becomes about 367 00:20:44,356 --> 00:20:47,636 Speaker 9: finding moves that look good, that are not blunders, that 368 00:20:47,676 --> 00:20:49,956 Speaker 9: you can play almost instantly, where you use a couple 369 00:20:49,956 --> 00:20:51,516 Speaker 9: of seconds. 370 00:20:51,516 --> 00:20:53,356 Speaker 2: In classical how many moves would you go deep? 371 00:20:53,676 --> 00:20:56,036 Speaker 9: It normally would be about five to six moves in 372 00:20:56,116 --> 00:20:58,396 Speaker 9: about three or four branches. 373 00:20:58,996 --> 00:21:02,516 Speaker 2: It's a fantastically complex mental exercise. 374 00:21:02,676 --> 00:21:04,676 Speaker 9: Yes, very much. I mean it's probably at least I 375 00:21:04,676 --> 00:21:08,116 Speaker 9: would say, close to one hundred different different permutations of 376 00:21:08,276 --> 00:21:10,316 Speaker 9: moves or a sequence. Is that you're looking at for 377 00:21:10,396 --> 00:21:11,196 Speaker 9: every single move? 378 00:21:11,356 --> 00:21:15,556 Speaker 2: Yeah? Yeah. In blitz we've truncated that process. 379 00:21:15,876 --> 00:21:16,116 Speaker 3: Right. 380 00:21:17,036 --> 00:21:21,276 Speaker 2: Everything about Blitz and classical is the same same pieces, 381 00:21:21,476 --> 00:21:26,116 Speaker 2: same board, same players, same choreographed openings, but the time 382 00:21:26,156 --> 00:21:29,196 Speaker 2: limits are different and what happens when you tinker with 383 00:21:29,236 --> 00:21:32,836 Speaker 2: the time limit, you get a completely different set of results. 384 00:21:33,796 --> 00:21:37,716 Speaker 2: A classical chess, Magnus Carlson is number one, he's also 385 00:21:37,836 --> 00:21:41,636 Speaker 2: number one a blitz because he's a genius. Hikaru right 386 00:21:41,676 --> 00:21:45,596 Speaker 2: now is eleventh in the classical rankings. But it blitz, 387 00:21:45,956 --> 00:21:49,516 Speaker 2: he's number two in the world. Why because he's really 388 00:21:49,556 --> 00:21:52,956 Speaker 2: really good at the rapid pattern recognition that's necessary for blitz, 389 00:21:53,156 --> 00:21:56,156 Speaker 2: and he's not quite as good at the complex calculation 390 00:21:56,476 --> 00:22:00,996 Speaker 2: that's necessary for classical. Now, who's an example, a good 391 00:22:01,036 --> 00:22:03,116 Speaker 2: example of the opposite. 392 00:22:02,596 --> 00:22:07,836 Speaker 9: Uh Fabiano Fabiano Karjuana is actually he's probably the best example. 393 00:22:07,876 --> 00:22:10,596 Speaker 9: I can't even think of anyone else who is that 394 00:22:10,716 --> 00:22:13,196 Speaker 9: much better at classical chess than they are at blitz 395 00:22:13,236 --> 00:22:13,556 Speaker 9: and wrap. 396 00:22:13,636 --> 00:22:15,476 Speaker 2: Why do you think he's not good at blitz and rappit? 397 00:22:16,636 --> 00:22:21,316 Speaker 9: I think I think with Fabiano he's it's the other way. 398 00:22:21,356 --> 00:22:24,876 Speaker 9: He's very very good at calculations, so when he gets positions, 399 00:22:24,876 --> 00:22:28,796 Speaker 9: he's very good at calculating and understanding what the possibilities 400 00:22:28,796 --> 00:22:32,756 Speaker 9: are with with more time, whereas when he doesn't have 401 00:22:32,796 --> 00:22:35,676 Speaker 9: time to calculate the long sequences all the way through 402 00:22:36,516 --> 00:22:39,156 Speaker 9: his intuition has to take over, and his intuition and 403 00:22:39,236 --> 00:22:42,796 Speaker 9: natural feel are not as good as as everyone else. 404 00:22:43,396 --> 00:22:47,756 Speaker 2: Fabiano is a tortoise, slow and steady. Hikaru is a 405 00:22:47,756 --> 00:22:51,636 Speaker 2: hair ear's back speedy. You can struct your chest that 406 00:22:51,716 --> 00:22:55,076 Speaker 2: favors the tortoise, or you construct your chess so that 407 00:22:55,156 --> 00:22:58,556 Speaker 2: it favors hairs. I think you can see where I'm 408 00:22:58,596 --> 00:23:01,316 Speaker 2: going with this. If we had a blitz tournament for 409 00:23:01,396 --> 00:23:05,676 Speaker 2: the World championship, you know, in two months, where would 410 00:23:05,676 --> 00:23:06,756 Speaker 2: you put your odds of winning? 411 00:23:07,756 --> 00:23:11,036 Speaker 9: I would put my odds of winning probably around twenty percent. 412 00:23:11,076 --> 00:23:14,476 Speaker 9: I would say I'd put Magnets at about sixty percent. 413 00:23:14,516 --> 00:23:16,156 Speaker 9: I put myself at twenty percent. 414 00:23:16,036 --> 00:23:20,476 Speaker 2: So pretty good odds. Yes, so your your world changes if, 415 00:23:21,156 --> 00:23:24,796 Speaker 2: just arbitrarily, we decided that the standard for international tournament 416 00:23:24,836 --> 00:23:26,476 Speaker 2: chess ought to be blitz. 417 00:23:26,756 --> 00:23:28,076 Speaker 9: Yes, it would change. 418 00:23:28,156 --> 00:23:32,156 Speaker 2: Yeah, you would make a lot more money probably, Yes. Wait, 419 00:23:33,036 --> 00:23:37,396 Speaker 2: there's a third variation, bullet chess. In bullet you get 420 00:23:37,436 --> 00:23:40,756 Speaker 2: one minute for the whole game, and Hikaru is the 421 00:23:40,916 --> 00:23:44,196 Speaker 2: king at bullet. Are you better than Magnus at bullet. 422 00:23:44,636 --> 00:23:46,516 Speaker 9: At bullet yes, a bullet yes. 423 00:23:46,356 --> 00:23:50,396 Speaker 2: Why so what's why wouldn't Magnus. If he's if he's 424 00:23:50,396 --> 00:23:54,276 Speaker 2: so serenely superior at all other kinds of chess, why 425 00:23:54,356 --> 00:23:55,476 Speaker 2: can't he beat you a bullet? 426 00:23:56,156 --> 00:23:58,956 Speaker 9: In terms of the calculation, what he does is like 427 00:23:58,996 --> 00:24:01,236 Speaker 9: the sort of well it's not an algorithm, but sort 428 00:24:01,236 --> 00:24:02,636 Speaker 9: of the way that he find tunes are the way 429 00:24:02,676 --> 00:24:05,476 Speaker 9: he thinks about I think it takes a little bit 430 00:24:05,556 --> 00:24:07,996 Speaker 9: more time to come to the conclusions. 431 00:24:08,276 --> 00:24:12,676 Speaker 2: What strikes me is that the chess hierarchy formal chess 432 00:24:12,716 --> 00:24:16,836 Speaker 2: hierarchy is an arbitrary function of the amount of time 433 00:24:16,876 --> 00:24:20,996 Speaker 2: we have decided to spend on a chess match. Right, Yes, 434 00:24:21,796 --> 00:24:24,716 Speaker 2: Like I said, I think you can see where I'm 435 00:24:24,756 --> 00:24:29,756 Speaker 2: going with this. Hikaru is a hair, not a tortoise. 436 00:24:30,276 --> 00:24:32,876 Speaker 2: And what is the l SAT It is a test 437 00:24:33,076 --> 00:24:36,876 Speaker 2: that rewards hairs over tortoises, which means that if the 438 00:24:36,956 --> 00:24:41,036 Speaker 2: Elsat ran the chess world, they would consider Hikaru the 439 00:24:41,076 --> 00:24:43,596 Speaker 2: greatest chess player in the world. They would crown him 440 00:24:43,676 --> 00:24:48,156 Speaker 2: champion over Magnus. El sat logic is that the best 441 00:24:48,196 --> 00:24:51,916 Speaker 2: player is the one who solves the hardest chess puzzles quickest, 442 00:24:52,476 --> 00:24:56,996 Speaker 2: and that's Hikaru. But that's insane, not even Hikaru thinks 443 00:24:57,036 --> 00:25:00,516 Speaker 2: he's better a chess than Magnus. What Hikara would say 444 00:25:00,796 --> 00:25:03,916 Speaker 2: is that he's a different kind of chess player than Magnus. 445 00:25:04,596 --> 00:25:07,876 Speaker 2: And I haven't even mentioned puzzle Rush. It's an online 446 00:25:07,916 --> 00:25:10,996 Speaker 2: game where you get a series of endgame chess positions 447 00:25:11,276 --> 00:25:13,436 Speaker 2: and you have to get to checkmate as often as 448 00:25:13,436 --> 00:25:17,956 Speaker 2: possible in five minutes. Puzzle Rush is insanely popular. Do 449 00:25:17,996 --> 00:25:19,156 Speaker 2: you play a lot of Puzzle Rush? 450 00:25:19,316 --> 00:25:20,716 Speaker 9: I have the highest score at it. 451 00:25:20,716 --> 00:25:24,396 Speaker 2: So yes, I yeah. So what's your score? 452 00:25:24,556 --> 00:25:25,996 Speaker 9: My highest score is fifty. 453 00:25:25,716 --> 00:25:27,556 Speaker 2: Five, and what's the second highest? 454 00:25:28,076 --> 00:25:30,356 Speaker 9: I think there are two people with fifty four, and 455 00:25:30,396 --> 00:25:32,836 Speaker 9: then there are couple with fifty three, and it falls 456 00:25:32,876 --> 00:25:33,396 Speaker 9: off from there. 457 00:25:33,556 --> 00:25:33,796 Speaker 1: Yeah. 458 00:25:33,916 --> 00:25:38,396 Speaker 2: Yeah. We have most of the top players in the 459 00:25:38,436 --> 00:25:39,796 Speaker 2: world played puzzle Rush. 460 00:25:39,996 --> 00:25:40,596 Speaker 9: Most of them have. 461 00:25:40,716 --> 00:25:42,836 Speaker 1: Yes, as Magnus plays change. 462 00:25:42,596 --> 00:25:45,436 Speaker 9: Not officially, not officially, might be playing and hiding a 463 00:25:45,436 --> 00:25:46,476 Speaker 9: sea he probably has. 464 00:25:46,596 --> 00:25:50,196 Speaker 2: Yeah, yeah, yeah. Do you get any award for being 465 00:25:50,276 --> 00:25:52,076 Speaker 2: the number one on puzzle Rush? 466 00:25:52,196 --> 00:25:52,796 Speaker 1: No? 467 00:25:53,156 --> 00:25:56,276 Speaker 2: They don't like crown u King of Puzzle Rush. There's 468 00:25:56,316 --> 00:26:00,316 Speaker 2: a three hour video of a car crushing puzzle Rush 469 00:26:00,636 --> 00:26:03,796 Speaker 2: on YouTube. It is one hundred and thirty thousand views. 470 00:26:05,956 --> 00:26:09,796 Speaker 2: This actually might be the most hotly contested form of 471 00:26:09,876 --> 00:26:12,396 Speaker 2: chess you've ever played. You've never played something where millions 472 00:26:12,396 --> 00:26:13,916 Speaker 2: of people are in the same tournament. 473 00:26:14,636 --> 00:26:16,996 Speaker 9: Yeah that's yeah, that's true. This is right. 474 00:26:17,676 --> 00:26:19,716 Speaker 2: You could make an argument this is your greatest accomplishment. 475 00:26:21,716 --> 00:26:24,636 Speaker 9: I guess, but I have one thinking it that way. 476 00:26:24,636 --> 00:26:25,356 Speaker 9: But yes, you're right. 477 00:26:25,836 --> 00:26:29,036 Speaker 2: Yes, the only reason we don't consider that your greatest 478 00:26:29,076 --> 00:26:33,516 Speaker 2: accomplishment is we've arbitrarily decided only to honor chess played 479 00:26:33,596 --> 00:26:38,636 Speaker 2: under these archaic rules in a tournament atmosphere. That puzzle 480 00:26:38,716 --> 00:26:40,916 Speaker 2: rush is a I mean, if we decided to say, 481 00:26:40,996 --> 00:26:42,396 Speaker 2: that's what chess. 482 00:26:42,036 --> 00:26:45,156 Speaker 9: Yes, right, yeah, if you arbitrary decide yes, that's that's true. 483 00:26:45,276 --> 00:26:45,676 Speaker 7: Yeah. 484 00:26:45,716 --> 00:26:49,356 Speaker 2: It has many advantages. Chiefly is it allows the entire 485 00:26:49,396 --> 00:26:52,636 Speaker 2: world to compete on an equal right. Right, so you 486 00:26:52,676 --> 00:26:55,036 Speaker 2: went against the entire world and you won. 487 00:26:55,196 --> 00:26:58,236 Speaker 9: I don't know, yeah, yeah, I've never thought about that, 488 00:26:58,276 --> 00:26:59,716 Speaker 9: but yes, that is true. 489 00:26:59,996 --> 00:27:01,796 Speaker 2: If one thing comes out of this, it is I 490 00:27:01,836 --> 00:27:04,676 Speaker 2: hope you you give yourself a pat on the back. 491 00:27:07,676 --> 00:27:11,036 Speaker 2: The order in which people finish in any cognitive task 492 00:27:11,636 --> 00:27:14,196 Speaker 2: is an arbitrary function of how much time is given 493 00:27:14,236 --> 00:27:17,716 Speaker 2: to complete that task. You can make it fast or 494 00:27:17,756 --> 00:27:21,316 Speaker 2: you can make it slow. The chess world has chosen 495 00:27:21,356 --> 00:27:24,436 Speaker 2: to reward the tortoise. The el sat has chosen to 496 00:27:24,516 --> 00:27:28,276 Speaker 2: reward the hair. They've decided to play puzzle rush and 497 00:27:28,356 --> 00:27:31,076 Speaker 2: reward the Kors of the world, and not have us 498 00:27:31,076 --> 00:27:36,836 Speaker 2: play classical and reward Fabiano. What does the legal world 499 00:27:36,876 --> 00:27:45,796 Speaker 2: have against Fabiano? As I mentioned earlier, there's going to 500 00:27:45,796 --> 00:27:48,276 Speaker 2: be a second part to this examination of the l set. 501 00:27:48,516 --> 00:27:51,276 Speaker 2: Of course, there is why would I rush? In the 502 00:27:51,316 --> 00:27:53,676 Speaker 2: next episode, I'm going to visit with the folks who 503 00:27:53,756 --> 00:27:59,196 Speaker 2: administer the l set, the Law School Admissions Council of Newtown, Pennsylvania. 504 00:27:59,636 --> 00:28:03,876 Speaker 2: But that can wait. Let's go back to William Henderson, 505 00:28:04,276 --> 00:28:10,796 Speaker 2: who started me wondering about time and tests. The great 506 00:28:10,916 --> 00:28:14,436 Speaker 2: justification for the l set is your score is supposed 507 00:28:14,476 --> 00:28:17,156 Speaker 2: to be a useful indication of how well you will 508 00:28:17,196 --> 00:28:21,516 Speaker 2: do in your first year of law school. It's a predictor. 509 00:28:22,516 --> 00:28:25,836 Speaker 2: But Henderson's great question was what if the l ST 510 00:28:25,956 --> 00:28:28,916 Speaker 2: only predicts law school grades? Because law schools make the 511 00:28:28,956 --> 00:28:32,396 Speaker 2: same mistake that the lset does. In most law schools, 512 00:28:32,516 --> 00:28:35,156 Speaker 2: grades are based in large part on how well students 513 00:28:35,196 --> 00:28:38,556 Speaker 2: do on exams where they are deliberately not given enough time. 514 00:28:39,476 --> 00:28:43,236 Speaker 2: You take Cass Sunstein's elements exam, where you engage with 515 00:28:43,276 --> 00:28:46,396 Speaker 2: the ideas of a legal genius, and you have two hours. 516 00:28:46,756 --> 00:28:47,196 Speaker 1: That's it. 517 00:28:48,156 --> 00:28:51,916 Speaker 2: Henderson wondered if a law school doesn't rely so heavily 518 00:28:51,996 --> 00:28:55,516 Speaker 2: on its students doing things quickly, if the school relies 519 00:28:55,636 --> 00:29:00,076 Speaker 2: instead on take home exams and essays, what happens to 520 00:29:00,156 --> 00:29:03,796 Speaker 2: the usefulness of the L set as a predictor? And 521 00:29:03,876 --> 00:29:08,756 Speaker 2: he found that its usefulness declines. I'm quoting the data 522 00:29:08,836 --> 00:29:12,716 Speaker 2: show that the l SAT was a relatively robust predictor 523 00:29:12,796 --> 00:29:16,916 Speaker 2: of in class exams and a relatively weak predictor of 524 00:29:17,036 --> 00:29:20,996 Speaker 2: take them exams and papers. In other words, once you 525 00:29:21,156 --> 00:29:24,476 Speaker 2: stop racing against the clock, then the people who do 526 00:29:24,596 --> 00:29:27,356 Speaker 2: well on the l set no longer are the best 527 00:29:27,356 --> 00:29:31,036 Speaker 2: at law school, which is exactly what every chess player 528 00:29:31,116 --> 00:29:35,436 Speaker 2: in the world would have told you. What happened. So 529 00:29:35,516 --> 00:29:38,276 Speaker 2: what did William Henderson do when he became a law 530 00:29:38,316 --> 00:29:42,356 Speaker 2: professor at Indiana University. He changed the way he evaluated 531 00:29:42,356 --> 00:29:46,836 Speaker 2: his students. He started placing more emphasis on take them exams, 532 00:29:47,076 --> 00:29:49,476 Speaker 2: and when he gives an exam in class, he makes 533 00:29:49,516 --> 00:29:51,316 Speaker 2: it four hours, not two. 534 00:29:52,196 --> 00:29:55,516 Speaker 4: That's completely open book and I give out one of 535 00:29:55,516 --> 00:29:58,756 Speaker 4: the questions in advance. I say, here's three questions. I'm 536 00:29:58,756 --> 00:30:00,476 Speaker 4: going to test you on one, so you've seen one 537 00:30:00,516 --> 00:30:03,956 Speaker 4: of the questions already. And then four hours is plenty 538 00:30:03,956 --> 00:30:06,596 Speaker 4: of time to do the issue spot or and I 539 00:30:06,636 --> 00:30:09,396 Speaker 4: give a word limit. And I did that as a 540 00:30:09,436 --> 00:30:12,876 Speaker 4: direct result of that LSAT study that I did, because 541 00:30:12,956 --> 00:30:16,836 Speaker 4: I was acutely aware that you change the ordinal ranking 542 00:30:18,076 --> 00:30:20,476 Speaker 4: when you pick a testament. And I say, you know, 543 00:30:20,676 --> 00:30:22,716 Speaker 4: I don't think anybody will need all four hours, but 544 00:30:22,756 --> 00:30:25,036 Speaker 4: if you if you want to take four hours, you're 545 00:30:25,076 --> 00:30:26,396 Speaker 4: free to take four hours. 546 00:30:26,796 --> 00:30:29,996 Speaker 2: Not long after he started grading that way, a student 547 00:30:30,116 --> 00:30:30,996 Speaker 2: came to see him. 548 00:30:31,236 --> 00:30:34,476 Speaker 4: This kid got an A on the exam, and so 549 00:30:34,516 --> 00:30:37,196 Speaker 4: he comes in. He wants to talk about exams. I said, 550 00:30:38,156 --> 00:30:40,796 Speaker 4: I've been here for three years. I've never done this 551 00:30:40,876 --> 00:30:42,476 Speaker 4: well out of the exam before, and I want to 552 00:30:42,476 --> 00:30:45,276 Speaker 4: know why I did this well. And I pulled out 553 00:30:45,276 --> 00:30:47,796 Speaker 4: his exam and it was an eight hour take home 554 00:30:47,796 --> 00:30:49,916 Speaker 4: and I go, look at your first paragraph. You hit 555 00:30:50,036 --> 00:30:53,996 Speaker 4: every single issue here in the first paragraph. It's just 556 00:30:54,036 --> 00:30:57,356 Speaker 4: a well organized pearl. The light bulb went on for him. 557 00:30:57,396 --> 00:30:59,236 Speaker 4: It's just like if I had had more time. All 558 00:30:59,276 --> 00:31:00,996 Speaker 4: my exams would have been disorganized. 559 00:31:01,956 --> 00:31:05,076 Speaker 2: You have a student who the system declared was of 560 00:31:05,156 --> 00:31:09,276 Speaker 2: average ability. The student believed it, why wouldn't he. But 561 00:31:09,356 --> 00:31:11,836 Speaker 2: then someone came along, someone by the way, with the 562 00:31:11,836 --> 00:31:15,196 Speaker 2: great benefit of being a firefighter from the suburbs of Cleveland, 563 00:31:15,436 --> 00:31:18,076 Speaker 2: who had the freedom to think a little differently, and 564 00:31:18,116 --> 00:31:23,036 Speaker 2: he said, wait, maybe you aren't of average ability. Maybe 565 00:31:23,076 --> 00:31:26,596 Speaker 2: you only think your average because we have chosen an 566 00:31:26,676 --> 00:31:32,156 Speaker 2: arbitrary system to evaluate your ability that makes you look average. 567 00:31:32,196 --> 00:31:35,036 Speaker 2: You are Fabiano and we have been making you play 568 00:31:35,036 --> 00:31:40,956 Speaker 2: puzzle Rush. I know what you're thinking. Yeah, yeah, yeah, 569 00:31:40,996 --> 00:31:43,276 Speaker 2: but who won between you and Camille who got the 570 00:31:43,356 --> 00:31:47,796 Speaker 2: higher score in the l SAT No stop racing ahead, 571 00:31:47,956 --> 00:31:52,076 Speaker 2: you are engaged in uncomfortable listening. You'll have to wait 572 00:31:52,276 --> 00:31:55,396 Speaker 2: until the next episode. What I want you to think 573 00:31:55,436 --> 00:31:59,516 Speaker 2: about is that student of William Henderson's and his miraculous 574 00:31:59,556 --> 00:32:02,516 Speaker 2: revelation that he really was a good student. After all, 575 00:32:04,356 --> 00:32:06,716 Speaker 2: there are a ton of tortoises like him out there, 576 00:32:07,316 --> 00:32:10,436 Speaker 2: not just taking the elsat in city in law school classrooms, 577 00:32:10,756 --> 00:32:13,996 Speaker 2: but competing for places at any number of schools and 578 00:32:14,076 --> 00:32:17,316 Speaker 2: professions that have decided to tell their applicants whether they 579 00:32:17,356 --> 00:32:20,996 Speaker 2: are or are not any good. And what I don't 580 00:32:21,036 --> 00:32:23,836 Speaker 2: understand is how the hairs got to set the rules. 581 00:32:24,196 --> 00:32:25,996 Speaker 2: I thought the whole point of the story of the 582 00:32:26,036 --> 00:32:31,436 Speaker 2: tortoise and the hair was that the tortoise one. Clearly, 583 00:32:31,476 --> 00:32:35,716 Speaker 2: the kind of person who is most disadvantaged by this 584 00:32:35,876 --> 00:32:39,396 Speaker 2: system is the tortoise. I realized, after my experience with 585 00:32:39,476 --> 00:32:42,836 Speaker 2: the noodle guys and my time with Hikaru, that I'm 586 00:32:42,876 --> 00:32:46,076 Speaker 2: on the side of the tortoise. I feel for the tortoise. 587 00:32:46,516 --> 00:32:50,516 Speaker 2: I might be a tortoise. I come from tortoises, and 588 00:32:50,636 --> 00:32:54,356 Speaker 2: we've all met tortoises in our lives. Who will not 589 00:32:54,596 --> 00:32:56,916 Speaker 2: My mother is a little bit of a tortoise. She 590 00:32:56,996 --> 00:33:00,796 Speaker 2: will not be rushed under any circumstances. She will not 591 00:33:01,036 --> 00:33:04,156 Speaker 2: She does not make mistakes. She goes over things five 592 00:33:04,196 --> 00:33:08,236 Speaker 2: times to make sure that they're perfect. She is ideal 593 00:33:08,636 --> 00:33:11,516 Speaker 2: for a certain kind of work. She'd have a problem 594 00:33:11,516 --> 00:33:13,436 Speaker 2: with the eel set. She would say, why are you 595 00:33:13,516 --> 00:33:16,116 Speaker 2: rushing me? And she would you know, and she wouldn't finish, 596 00:33:16,236 --> 00:33:18,876 Speaker 2: And she would never guess. She can't guess. She's incapable 597 00:33:18,916 --> 00:33:22,596 Speaker 2: of guessing. So my mom could never The profession is 598 00:33:22,596 --> 00:33:23,836 Speaker 2: putting up a barrier. 599 00:33:23,516 --> 00:33:24,156 Speaker 1: To my market. 600 00:33:24,956 --> 00:33:29,356 Speaker 2: You put a stopwatch on thinking whatever, you rigged the system. 601 00:33:29,476 --> 00:33:34,596 Speaker 2: So Camille wins fine, but when you go after the Gladwells, 602 00:33:35,156 --> 00:33:51,516 Speaker 2: then it's personal. Revisionist History is produced by Mia Lobel 603 00:33:51,636 --> 00:33:56,596 Speaker 2: and Jacob Smith with Camille Baptista. Our editor is Julia Barton. 604 00:33:56,956 --> 00:34:00,716 Speaker 2: Flon Williams is our engineer. Fact checking by Beth Johnson. 605 00:34:01,036 --> 00:34:05,876 Speaker 2: Original music by Luis Kiera. Special thanks to Carle Migliore, 606 00:34:06,036 --> 00:34:11,716 Speaker 2: Heather Fein, Maggie Taylor, Maya Kanig, and Jacob Iceberg. Revision's 607 00:34:11,796 --> 00:34:15,556 Speaker 2: History is brought to you by Pushkin Industries. I'm Malcolm 608 00:34:15,556 --> 00:34:23,916 Speaker 2: gladwa But Camille, Camille is like a smarty pant. She's 609 00:34:23,956 --> 00:34:28,236 Speaker 2: going to do don't you think she's going to do? Yes? 610 00:34:28,436 --> 00:34:31,996 Speaker 5: Yes, Well, Camille has a natural. 611 00:34:33,116 --> 00:34:33,596 Speaker 9: Uh. 612 00:34:33,676 --> 00:34:39,276 Speaker 5: She she naturally prepares and is naturally persistent and determined. 613 00:34:39,556 --> 00:34:42,996 Speaker 5: So I think those things will really help her a lot. 614 00:34:43,956 --> 00:34:45,396 Speaker 2: Should I should I be worried? 615 00:34:50,956 --> 00:34:53,436 Speaker 5: I think you should be worried. I think you should 616 00:34:53,476 --> 00:34:53,876 Speaker 5: be worried. 617 00:34:54,876 --> 00:34:55,116 Speaker 8: Yep