WEBVTT - How AI Could Actually Make the World Better

0:00:15.356 --> 0:00:31.836
<v Speaker 1>Pushkin. I'm Jacob Goldstein. This is what's your problem? And

0:00:31.876 --> 0:00:35.276
<v Speaker 1>my guest today is Josh Tieringel. He's a staff writer

0:00:35.356 --> 0:00:37.716
<v Speaker 1>at The Atlantic, and he just wrote a new book

0:00:37.756 --> 0:00:41.236
<v Speaker 1>called AI for Good And the subtitle of the book

0:00:41.316 --> 0:00:44.796
<v Speaker 1>explains the problem that Josh is interested in. The subtitle

0:00:44.916 --> 0:00:48.716
<v Speaker 1>is how real people are using artificial intelligence to fix

0:00:48.796 --> 0:00:51.956
<v Speaker 1>things that matter. As you'll hear, I talked with Josh

0:00:51.996 --> 0:00:55.956
<v Speaker 1>about several of these real people. Professor trying to understand

0:00:55.996 --> 0:00:59.436
<v Speaker 1>her nonverbal son, a general who ran the logistics side

0:00:59.436 --> 0:01:03.156
<v Speaker 1>of Operation Warp Speed, a hospital CEO trying to reduce

0:01:03.196 --> 0:01:06.196
<v Speaker 1>the rate of deadly infections. And one thing just to

0:01:06.236 --> 0:01:08.356
<v Speaker 1>note here is you know, and I guess this is

0:01:08.356 --> 0:01:11.076
<v Speaker 1>not surprising in the state of AI. Some of these

0:01:11.116 --> 0:01:13.356
<v Speaker 1>stories are not yet finished. They're kind of stories that

0:01:13.396 --> 0:01:16.516
<v Speaker 1>are still in the middle. But before we got into

0:01:16.516 --> 0:01:20.276
<v Speaker 1>the specific stories, I asked Josh what common threads he

0:01:20.356 --> 0:01:23.036
<v Speaker 1>saw across all these people he wrote about, who are

0:01:23.076 --> 0:01:25.756
<v Speaker 1>you trying to use AI to do good things?

0:01:26.436 --> 0:01:30.876
<v Speaker 2>They're largely stubborn. Uh huh, They're really stubborn. And you know,

0:01:30.916 --> 0:01:33.556
<v Speaker 2>one of the things that I admire. I'm very impatient

0:01:33.596 --> 0:01:36.356
<v Speaker 2>and when I see a problem. Oftentimes I have what

0:01:36.436 --> 0:01:38.916
<v Speaker 2>I think is a fairly normal human impulse, which is like,

0:01:39.276 --> 0:01:42.236
<v Speaker 2>wipe the mismatched puzzle pieces off the table and get

0:01:42.236 --> 0:01:46.036
<v Speaker 2>a different puzzle. Right, It's frustrating to dig into systems

0:01:46.436 --> 0:01:50.916
<v Speaker 2>to learn technology, and these people, they don't get frustrated,

0:01:51.276 --> 0:01:53.796
<v Speaker 2>not to the point of destroying the system. In fact,

0:01:54.716 --> 0:01:57.316
<v Speaker 2>most of them have no experience with AI or technology.

0:01:57.716 --> 0:02:00.636
<v Speaker 2>They care about medicine, they care about teaching, They care

0:02:00.676 --> 0:02:03.476
<v Speaker 2>about solving a really hard problem, and so they just

0:02:03.556 --> 0:02:07.276
<v Speaker 2>keep looking for solutions. And when something seems promising, their

0:02:07.316 --> 0:02:10.476
<v Speaker 2>ability to concentrate and learn, earn the technology of that

0:02:10.636 --> 0:02:14.636
<v Speaker 2>promise and apply it to their problem is through the roof.

0:02:15.196 --> 0:02:18.276
<v Speaker 2>And so I just kept being awed by the fact

0:02:18.276 --> 0:02:22.916
<v Speaker 2>that they were curious, they're patient, They were impatient at

0:02:22.956 --> 0:02:26.356
<v Speaker 2>exactly the right moments in the sense that things weren't moving.

0:02:26.716 --> 0:02:29.876
<v Speaker 2>They knew how to deploy either their political capital or

0:02:29.876 --> 0:02:34.036
<v Speaker 2>their temper in ways to get things moving. And you know,

0:02:34.076 --> 0:02:35.996
<v Speaker 2>I found time and time again that when I would

0:02:36.036 --> 0:02:38.796
<v Speaker 2>talk to other people who were witnessing these phenomenon, whether

0:02:38.836 --> 0:02:41.716
<v Speaker 2>it was in hospitals or in government, we would all

0:02:41.756 --> 0:02:43.996
<v Speaker 2>just kind of be like, Yeah, these are the ones

0:02:44.036 --> 0:02:46.996
<v Speaker 2>making it happen. They're kind of Samurai, right. They care

0:02:47.076 --> 0:02:50.396
<v Speaker 2>about their problem more than other people care about standing

0:02:50.396 --> 0:02:52.916
<v Speaker 2>in the way of the solution, and they get it done.

0:02:53.156 --> 0:02:54.476
<v Speaker 1>Tell me about Christy Johnson.

0:02:55.076 --> 0:03:00.316
<v Speaker 2>Yeah, So, Christy Johnson is certainly one of the most

0:03:00.396 --> 0:03:05.796
<v Speaker 2>inspiring interesting people I've met in my journalism career. So, I,

0:03:05.876 --> 0:03:08.436
<v Speaker 2>like a lot of people, was thinking about AI and

0:03:08.516 --> 0:03:11.796
<v Speaker 2>human connect and reading all the headlines about the sort

0:03:11.796 --> 0:03:16.596
<v Speaker 2>of parasocial crisis in which people were dating, chat GPT,

0:03:16.916 --> 0:03:20.276
<v Speaker 2>falling in love with Claude, realizing that this was mimicking

0:03:20.356 --> 0:03:23.076
<v Speaker 2>a lot of the worst elements of social media, seeing

0:03:23.116 --> 0:03:26.916
<v Speaker 2>the studies and getting very, very depressed about what AI

0:03:27.036 --> 0:03:29.596
<v Speaker 2>would mean for human connection. So I was having that

0:03:29.676 --> 0:03:33.036
<v Speaker 2>conversation with Rosin Picard, who runs the MIT Media Lab,

0:03:33.076 --> 0:03:34.876
<v Speaker 2>and she basically said, look, you got to meet Christy,

0:03:35.676 --> 0:03:39.396
<v Speaker 2>and so she introduced me. Christy Johnson was a physicist

0:03:40.276 --> 0:03:47.076
<v Speaker 2>and a brilliant student. She met another physicist in a program.

0:03:47.516 --> 0:03:49.996
<v Speaker 2>He is an astrophysicist and actually was on the team

0:03:50.636 --> 0:03:53.076
<v Speaker 2>that took the first picture of a black hole. The

0:03:53.116 --> 0:03:55.236
<v Speaker 2>two of them fell in the deepest form of nerd

0:03:55.276 --> 0:03:59.036
<v Speaker 2>love you could possibly imagine. I mean even the two

0:03:59.036 --> 0:04:01.196
<v Speaker 2>of them laugh at just how dorky their love letters

0:04:01.236 --> 0:04:03.996
<v Speaker 2>are to each other, all about physics and math and

0:04:04.516 --> 0:04:07.956
<v Speaker 2>the world. They get married and they have a kid,

0:04:08.036 --> 0:04:12.116
<v Speaker 2>and about a couple of weeks in she's like, there's

0:04:12.116 --> 0:04:14.596
<v Speaker 2>something wrong with my son. And she's kind of gas

0:04:14.716 --> 0:04:17.276
<v Speaker 2>lit by the medical profession for a year just hearing no,

0:04:17.356 --> 0:04:21.636
<v Speaker 2>he's fine, Stop worrying, enjoy your kid. Finally they get

0:04:21.636 --> 0:04:25.476
<v Speaker 2>some testing done and he has a genetic deficiency. And

0:04:26.476 --> 0:04:29.876
<v Speaker 2>the other six children like him in the world are

0:04:29.916 --> 0:04:35.556
<v Speaker 2>all severely autistic, epileptic, and completely nonverbal, and so this

0:04:35.596 --> 0:04:39.876
<v Speaker 2>is the kind of diagnosis that changes everybody's lives. Within

0:04:39.916 --> 0:04:44.636
<v Speaker 2>the family. They begin to grieve a little bit for

0:04:44.676 --> 0:04:47.636
<v Speaker 2>their expectations for their son, but they're also scientists, and

0:04:47.996 --> 0:04:51.396
<v Speaker 2>Christy and Michael both are like, we should understand this,

0:04:51.516 --> 0:04:54.516
<v Speaker 2>we should do something about it. A couple of years

0:04:54.516 --> 0:04:57.676
<v Speaker 2>ago past and Christy is like, no longer all that

0:04:57.716 --> 0:05:01.036
<v Speaker 2>interested in physics. She's very interested in her son. And

0:05:01.076 --> 0:05:03.396
<v Speaker 2>so what she set out to do was solve the

0:05:03.436 --> 0:05:08.236
<v Speaker 2>problem of the more than one million nonverbal Americans who

0:05:08.556 --> 0:05:11.436
<v Speaker 2>are stuck to their parents and their caregivers. That's it

0:05:11.756 --> 0:05:15.556
<v Speaker 2>for everybody in that universe, the universe shrinks.

0:05:16.036 --> 0:05:18.596
<v Speaker 1>Just to be clear, what is her dream? What is

0:05:18.596 --> 0:05:20.156
<v Speaker 1>the outcome she hopes to achieve.

0:05:20.636 --> 0:05:23.156
<v Speaker 2>Her dream is that her son and other people like

0:05:23.236 --> 0:05:25.836
<v Speaker 2>him can interact with people they don't know all that

0:05:25.876 --> 0:05:29.636
<v Speaker 2>well and share what it is they want and need.

0:05:29.796 --> 0:05:35.236
<v Speaker 1>So a machine will turn their nonverbal vocalizations into words. Yeah,

0:05:35.396 --> 0:05:38.316
<v Speaker 1>verbal people can understand that other people can respond to

0:05:38.476 --> 0:05:40.876
<v Speaker 1>and interact with. And so she made a bet. She

0:05:40.956 --> 0:05:42.996
<v Speaker 1>basically thought, look, I see where AI.

0:05:42.836 --> 0:05:45.756
<v Speaker 2>And machine learning are right now. My hunch is that

0:05:45.796 --> 0:05:48.276
<v Speaker 2>they will get better and better. But what I need

0:05:48.476 --> 0:05:52.476
<v Speaker 2>is data. And so she created a scientific protocol to

0:05:52.596 --> 0:05:57.316
<v Speaker 2>get vocalizations from these kids, and she used every tool available.

0:05:57.396 --> 0:05:59.676
<v Speaker 2>So she went on YouTube, she went on social media.

0:05:59.796 --> 0:06:01.956
<v Speaker 2>She said, this is me and my son. This is

0:06:01.956 --> 0:06:04.956
<v Speaker 2>what happens when he's hungry. Listen to that vocalization, and

0:06:04.956 --> 0:06:08.836
<v Speaker 2>now I'm recording it, and she began to generate a

0:06:08.876 --> 0:06:10.956
<v Speaker 2>little bit of momentum. She went to the MIT Media

0:06:10.996 --> 0:06:13.716
<v Speaker 2>Lab and spoke to Rosbaccard one night, kind of cold

0:06:13.796 --> 0:06:18.596
<v Speaker 2>calder and Roz realized, like, this woman has no qualifications

0:06:18.636 --> 0:06:21.476
<v Speaker 2>to be at the media lab, but my god, like,

0:06:21.876 --> 0:06:26.276
<v Speaker 2>what an incredible human she got there, she did her PhD.

0:06:27.076 --> 0:06:29.516
<v Speaker 2>And she proved that if you can gather enough of

0:06:29.556 --> 0:06:33.236
<v Speaker 2>these vocalizations as audio files, you can begin to attack

0:06:33.276 --> 0:06:36.676
<v Speaker 2>the problem. And so what she learned largely through using AIS.

0:06:36.716 --> 0:06:41.716
<v Speaker 2>At first you have to multiply the files, so a

0:06:41.956 --> 0:06:47.116
<v Speaker 2>system like chat, GPT or Claude is trained on potentially

0:06:47.156 --> 0:06:50.156
<v Speaker 2>trillions of data points in order to become as fluent

0:06:50.196 --> 0:06:53.996
<v Speaker 2>as it is. She had a couple thousand audio files.

0:06:54.316 --> 0:06:56.996
<v Speaker 2>So the first thing she did is get her graduate

0:06:57.036 --> 0:07:00.236
<v Speaker 2>students to figure out how to synthesize more data, how

0:07:00.236 --> 0:07:04.516
<v Speaker 2>to take those data files, those original sounds, and grow

0:07:04.556 --> 0:07:05.916
<v Speaker 2>them and multiply them.

0:07:05.996 --> 0:07:08.316
<v Speaker 1>It's like what they're trying to do with self driving cars,

0:07:08.436 --> 0:07:12.196
<v Speaker 1>right exactly, like drive on pretend roads essentially exactly.

0:07:12.316 --> 0:07:15.396
<v Speaker 2>It's called synthetic data. And AI is really good at

0:07:15.396 --> 0:07:16.316
<v Speaker 2>making synthetic data.

0:07:16.316 --> 0:07:18.316
<v Speaker 1>And they're even they're working on that for text, right

0:07:18.356 --> 0:07:20.996
<v Speaker 1>because now the current models basically are trained on the

0:07:20.996 --> 0:07:23.596
<v Speaker 1>whole Internet, so like there's no more real text for

0:07:23.636 --> 0:07:25.636
<v Speaker 1>them to read, so they need synthetic texts.

0:07:25.836 --> 0:07:28.116
<v Speaker 2>They're out of stuff, right, And so if you want

0:07:28.116 --> 0:07:30.196
<v Speaker 2>the training to advance, you have to synthesize a lot

0:07:30.236 --> 0:07:32.756
<v Speaker 2>of this data, and she's continuing to grow the organic

0:07:32.756 --> 0:07:33.556
<v Speaker 2>files as well.

0:07:34.196 --> 0:07:35.596
<v Speaker 1>Tell me about ROSCO.

0:07:36.836 --> 0:07:42.716
<v Speaker 2>Yeah, So ROSCO is a protocol and basically, you can't

0:07:42.996 --> 0:07:46.476
<v Speaker 2>do what Christy is trying to do without science because

0:07:46.996 --> 0:07:49.396
<v Speaker 2>you need some sort of rigorous idea of what you're

0:07:49.436 --> 0:07:53.676
<v Speaker 2>testing for or else. The data that you're recording is meaningless.

0:07:53.676 --> 0:07:54.636
<v Speaker 1>It's not really data.

0:07:55.036 --> 0:07:58.036
<v Speaker 2>It's not really data, it just sounds. And so working

0:07:58.036 --> 0:08:00.436
<v Speaker 2>with a grad student, what she figured out is, Okay,

0:08:00.516 --> 0:08:04.876
<v Speaker 2>we don't need all the data. All the data is unprocessable.

0:08:05.316 --> 0:08:07.596
<v Speaker 2>We need the right kinds of data for this task.

0:08:07.676 --> 0:08:10.596
<v Speaker 2>And so what they did is create this protocol where

0:08:10.596 --> 0:08:13.956
<v Speaker 2>they would run families through a certain kind of test

0:08:14.076 --> 0:08:16.476
<v Speaker 2>and it was split timed so that it was standardized,

0:08:16.516 --> 0:08:20.996
<v Speaker 2>and they would say, for two minutes, give your child

0:08:21.316 --> 0:08:24.076
<v Speaker 2>a YouTube video because we want to hear. And you know,

0:08:24.116 --> 0:08:26.476
<v Speaker 2>in the autism community, YouTube is great. It cues up

0:08:26.516 --> 0:08:29.156
<v Speaker 2>the same video as many times as you want. People

0:08:29.196 --> 0:08:31.756
<v Speaker 2>always have their favorite video, she said, whatever their favorite

0:08:31.796 --> 0:08:34.916
<v Speaker 2>video is queued up. At the one forty five mark,

0:08:34.916 --> 0:08:39.076
<v Speaker 2>they would introduce a beach ball and buffering.

0:08:38.996 --> 0:08:41.636
<v Speaker 1>Beach ball meaning the spinning wheel that says like pause,

0:08:41.676 --> 0:08:42.396
<v Speaker 1>it's loading.

0:08:42.596 --> 0:08:45.316
<v Speaker 2>Yeah, they would pause the video because what they wanted

0:08:45.356 --> 0:08:50.076
<v Speaker 2>to do was get a vocalization of dissatisfaction and frustration,

0:08:50.316 --> 0:08:52.036
<v Speaker 2>and so that was a way to do it. And

0:08:52.116 --> 0:08:55.156
<v Speaker 2>they would say, okay, this is a five minute snack period.

0:08:55.516 --> 0:08:57.156
<v Speaker 2>We want you to make sure that you are giving

0:08:57.196 --> 0:09:00.196
<v Speaker 2>them their favorite sack, and we want to hear what

0:09:00.196 --> 0:09:02.476
<v Speaker 2>that is like. And so they would do these things

0:09:02.516 --> 0:09:05.156
<v Speaker 2>that are really relevant to her ultimate goal, which is

0:09:05.156 --> 0:09:08.076
<v Speaker 2>making sure that these kids could be out there in

0:09:08.116 --> 0:09:10.796
<v Speaker 2>the world talking to other people and having needs met.

0:09:11.596 --> 0:09:14.916
<v Speaker 2>And so it was a very scientific protocol. And then

0:09:14.956 --> 0:09:18.356
<v Speaker 2>she would send it to families along with a phone

0:09:19.316 --> 0:09:22.156
<v Speaker 2>and a camera and basically say, record it from these

0:09:22.236 --> 0:09:24.596
<v Speaker 2>various angles, send it back to us, so that the

0:09:24.716 --> 0:09:28.276
<v Speaker 2>data is standardized. It's not just random vocalizations that they're

0:09:28.276 --> 0:09:32.316
<v Speaker 2>figuring out. And because the population is so specific and

0:09:32.316 --> 0:09:35.196
<v Speaker 2>because the keepers of the knowledge are so specific to

0:09:35.276 --> 0:09:38.396
<v Speaker 2>parents and caregivers, it took her a while to figure out,

0:09:38.476 --> 0:09:40.076
<v Speaker 2>that's how you actually want to get the data.

0:09:40.636 --> 0:09:44.916
<v Speaker 1>Huh. Yeah, it sounds like a lot of work. It

0:09:44.956 --> 0:09:47.476
<v Speaker 1>sounds hard to scale.

0:09:47.636 --> 0:09:50.036
<v Speaker 2>Yeah, And it would be hard to scale if not

0:09:50.076 --> 0:09:52.716
<v Speaker 2>for synthetic data, and if not for all of the

0:09:52.756 --> 0:09:54.556
<v Speaker 2>advances on the other side with translation.

0:09:54.756 --> 0:09:57.476
<v Speaker 1>Yeah, so you don't have to scale that much, is

0:09:57.516 --> 0:09:58.276
<v Speaker 1>what those things.

0:09:58.196 --> 0:10:00.076
<v Speaker 2>Well, you don't have to scale it nearly as much, right,

0:10:00.116 --> 0:10:02.676
<v Speaker 2>And what would have been a project that would probably

0:10:02.756 --> 0:10:07.476
<v Speaker 2>have happened over three scientists lifetimes yea, is now maybe

0:10:07.596 --> 0:10:10.756
<v Speaker 2>only over half of her career. And that's a real

0:10:10.876 --> 0:10:13.756
<v Speaker 2>form of progress. And so even though Christy doesn't have

0:10:13.836 --> 0:10:16.916
<v Speaker 2>the kinds of funding that Google or open Ai have,

0:10:17.516 --> 0:10:19.716
<v Speaker 2>she's able to kind of surf in their wake, and

0:10:20.116 --> 0:10:23.476
<v Speaker 2>they've made these progressions on things like zero shot translation,

0:10:23.596 --> 0:10:26.076
<v Speaker 2>with some people may have heard of. You know, historically

0:10:26.116 --> 0:10:29.476
<v Speaker 2>we would translate things by taking one set of language,

0:10:30.516 --> 0:10:33.836
<v Speaker 2>decoding each word and rewriting it in a different language,

0:10:34.036 --> 0:10:37.276
<v Speaker 2>and up until about ten years ago, that's what machine

0:10:37.276 --> 0:10:41.396
<v Speaker 2>translation was. Zero shot translation is actually a translation at

0:10:41.436 --> 0:10:45.796
<v Speaker 2>such a deep level that you're not translating language to language,

0:10:45.836 --> 0:10:50.796
<v Speaker 2>you're basically translating every language to every language simultaneously. And

0:10:50.836 --> 0:10:52.916
<v Speaker 2>then we got to a certain point recently where we

0:10:52.956 --> 0:10:56.356
<v Speaker 2>can translate based on audio waves. And so if you

0:10:56.356 --> 0:11:01.756
<v Speaker 2>can translate audio waves, it becomes much easier to translate

0:11:01.796 --> 0:11:05.756
<v Speaker 2>vocalizations from people who don't use words at all, and

0:11:05.796 --> 0:11:08.556
<v Speaker 2>so she you know, you mentioned a lot of these

0:11:08.596 --> 0:11:11.476
<v Speaker 2>stories aren't done. This is the least done story, right,

0:11:11.756 --> 0:11:16.716
<v Speaker 2>And you know what's interesting is that technology has already

0:11:16.796 --> 0:11:19.996
<v Speaker 2>changed the lives of lots of autistic people, because you know,

0:11:20.076 --> 0:11:22.956
<v Speaker 2>she showed me her phone.

0:11:23.436 --> 0:11:23.636
<v Speaker 1>Right.

0:11:23.716 --> 0:11:26.996
<v Speaker 2>So we were having dinner on our porch, and her son, Felix,

0:11:27.036 --> 0:11:31.916
<v Speaker 2>who's lovely sweet in many ways, a normal American teenager,

0:11:31.996 --> 0:11:34.236
<v Speaker 2>just picked up the phone and went off to go

0:11:34.276 --> 0:11:36.276
<v Speaker 2>do something. And then he came back and he dropped

0:11:36.276 --> 0:11:38.876
<v Speaker 2>off the phone, and she and her husband showed me

0:11:38.956 --> 0:11:42.636
<v Speaker 2>photos that he had taken of what he's fascinated by.

0:11:43.316 --> 0:11:45.916
<v Speaker 2>And so some of them were hairbrush bristles that were

0:11:45.916 --> 0:11:49.636
<v Speaker 2>actually these these kind of beautiful plastic forests. He'd used

0:11:49.636 --> 0:11:52.996
<v Speaker 2>a filter and he'd taken them and hundreds of these photos.

0:11:53.436 --> 0:11:56.396
<v Speaker 2>And before that, he'd taken photos of windows and was

0:11:56.476 --> 0:11:59.196
<v Speaker 2>really interested in the way windows around their neighborhood worked,

0:11:59.796 --> 0:12:02.836
<v Speaker 2>or castles or sketches of castles. And she said, like,

0:12:02.956 --> 0:12:07.356
<v Speaker 2>before the iPhone, when he's staring at something, I would

0:12:07.396 --> 0:12:10.196
<v Speaker 2>have no idea what he would have been daring. But

0:12:10.276 --> 0:12:13.356
<v Speaker 2>here's this really rudimentary piece of technology, at least now

0:12:13.996 --> 0:12:16.996
<v Speaker 2>and through that I'm able to understand what he's looking at.

0:12:17.156 --> 0:12:21.116
<v Speaker 2>I don't necessarily understand why he's fascinated by it, but

0:12:21.276 --> 0:12:22.916
<v Speaker 2>I know that he's interested. And I can make his

0:12:22.996 --> 0:12:25.836
<v Speaker 2>life richer by exposing him to more of it, and

0:12:26.036 --> 0:12:28.196
<v Speaker 2>I can frustrate him less by making sure there's always

0:12:28.236 --> 0:12:32.196
<v Speaker 2>a hairbrush around. And so those kinds of things I

0:12:32.236 --> 0:12:35.516
<v Speaker 2>have to say, like they make me more optimistic that

0:12:35.596 --> 0:12:38.996
<v Speaker 2>if we can wrestle this technology, like you know, tech

0:12:39.036 --> 0:12:41.676
<v Speaker 2>doesn't always have to be bad, Like we're not faded

0:12:41.756 --> 0:12:44.996
<v Speaker 2>to the world sucking because technology is coming out, but

0:12:45.076 --> 0:12:46.716
<v Speaker 2>we do have to figure out how we want it

0:12:46.756 --> 0:12:50.676
<v Speaker 2>to work. And so I left Christy feeling like she's

0:12:50.716 --> 0:12:53.876
<v Speaker 2>going to get there, and I know that that's not guaranteed,

0:12:54.436 --> 0:12:58.036
<v Speaker 2>but she is so stubborn, she's so motivated by love

0:12:58.356 --> 0:13:01.196
<v Speaker 2>and by problem solving, and the tech is moving so

0:13:01.396 --> 0:13:04.516
<v Speaker 2>fast that she's been at this ten years, right, and

0:13:04.596 --> 0:13:07.236
<v Speaker 2>ten years she's only gotten so far. But the next

0:13:07.236 --> 0:13:09.996
<v Speaker 2>ten years are going to move so much faster, and

0:13:10.036 --> 0:13:11.916
<v Speaker 2>more people are going to come and attack the problem.

0:13:11.956 --> 0:13:15.156
<v Speaker 2>And it wouldn't surprise me if ten years from now

0:13:15.476 --> 0:13:16.956
<v Speaker 2>she's successful.

0:13:18.236 --> 0:13:22.396
<v Speaker 1>So another story you tell in your book is about

0:13:22.436 --> 0:13:26.556
<v Speaker 1>Operation Warp Speed, and in particular it's about the logistics

0:13:26.596 --> 0:13:29.836
<v Speaker 1>of getting vaccines out to the public. And you know,

0:13:29.956 --> 0:13:33.556
<v Speaker 1>I knew a moderate amount about the vaccine development side,

0:13:33.916 --> 0:13:36.076
<v Speaker 1>but I really didn't know anything about the getting the

0:13:36.156 --> 0:13:39.036
<v Speaker 1>vaccine out to the world side. And I certainly didn't

0:13:39.076 --> 0:13:42.516
<v Speaker 1>know that it was an AI story. So tell me

0:13:42.556 --> 0:13:44.956
<v Speaker 1>about Operation Warp Speed, and in particular about this guy

0:13:44.996 --> 0:13:48.356
<v Speaker 1>you write about, this general named Gus Purna.

0:13:49.516 --> 0:13:53.276
<v Speaker 2>Look, I was writing, and I was hungry for understanding

0:13:53.516 --> 0:13:56.316
<v Speaker 2>and trying to figure out how exactly machine learning and

0:13:56.436 --> 0:14:00.116
<v Speaker 2>artificial intelligence integrate into society and ways are helpful, and

0:14:00.156 --> 0:14:03.796
<v Speaker 2>so I kind of tripped across this video of Gus Perna,

0:14:03.956 --> 0:14:07.996
<v Speaker 2>who oversaw Operation Warp Speed, who is not a technologist

0:14:08.076 --> 0:14:11.956
<v Speaker 2>by any means, He's a logistician. He oversees, generally, you know,

0:14:12.516 --> 0:14:15.636
<v Speaker 2>or did before he retired, the delivery of munitions and

0:14:15.716 --> 0:14:18.556
<v Speaker 2>uniforms and food so that we can fight wars. And

0:14:18.596 --> 0:14:21.036
<v Speaker 2>he was placed in charge of Operation Warp Speed and

0:14:21.076 --> 0:14:23.436
<v Speaker 2>the delivery of it so that you know, hopefully Big

0:14:23.476 --> 0:14:27.916
<v Speaker 2>Pharma can can execute on all these vaccines. But then

0:14:27.956 --> 0:14:30.556
<v Speaker 2>what how do they get into plastic vials and how

0:14:30.556 --> 0:14:33.236
<v Speaker 2>do those vials get delivered to everything from a CBS

0:14:33.756 --> 0:14:36.756
<v Speaker 2>to a doctor's office to in rural areas, sometimes a

0:14:36.796 --> 0:14:41.716
<v Speaker 2>general store that has no digital footprint. And so he

0:14:41.756 --> 0:14:46.236
<v Speaker 2>shows up in Washington and discovers that there's no plan,

0:14:46.356 --> 0:14:50.556
<v Speaker 2>like he is the plan. And so in Washington, like

0:14:50.596 --> 0:14:54.596
<v Speaker 2>it or not, everything starts with consultants everything, and so

0:14:54.676 --> 0:14:56.876
<v Speaker 2>people come in and they pitch him on things, and again,

0:14:57.036 --> 0:15:00.156
<v Speaker 2>not a technical guy, but he keeps hearing these crazy

0:15:00.196 --> 0:15:03.036
<v Speaker 2>pitches over the course of an hour. Somebody's like, we're

0:15:03.036 --> 0:15:06.076
<v Speaker 2>going to put a medical blockchain together and in a

0:15:06.076 --> 0:15:09.476
<v Speaker 2>couple of years, and he's like, no. Somebody else pitched

0:15:09.516 --> 0:15:12.036
<v Speaker 2>like hardware, We'll just put a hardware device in every

0:15:12.076 --> 0:15:15.356
<v Speaker 2>doctor's and he knows enough to say no. And finally

0:15:15.356 --> 0:15:18.756
<v Speaker 2>he meets with these two reasonably seeing people who are like, look,

0:15:19.036 --> 0:15:21.556
<v Speaker 2>you have a data problem. This can all be solved

0:15:21.676 --> 0:15:24.676
<v Speaker 2>if we get the right number of data streams flowing

0:15:24.676 --> 0:15:27.596
<v Speaker 2>into the right interface so that you can actually see

0:15:27.956 --> 0:15:33.196
<v Speaker 2>everything from plastic vials, metal needles, refrigerated trucks because remember,

0:15:33.796 --> 0:15:37.636
<v Speaker 2>half of the vaccines needed to be really cold refrigerated

0:15:37.676 --> 0:15:41.396
<v Speaker 2>for delivery. To track which states might want Johnson and

0:15:41.476 --> 0:15:44.556
<v Speaker 2>Johnson versus like you have to build a whole civilization

0:15:44.636 --> 0:15:46.036
<v Speaker 2>to do this stuff. And they said, look, you can

0:15:46.036 --> 0:15:50.956
<v Speaker 2>build a civilization in data, probably won't cost that much,

0:15:51.276 --> 0:15:54.436
<v Speaker 2>but we will need you to solve the human problem,

0:15:54.756 --> 0:15:57.076
<v Speaker 2>which is getting these various agencies to play ball, so

0:15:57.116 --> 0:15:59.356
<v Speaker 2>we can actually get to the data, clean it up,

0:15:59.476 --> 0:16:01.596
<v Speaker 2>and feed it to you. And so that's a machine

0:16:01.636 --> 0:16:04.476
<v Speaker 2>learning story. And when I went down the rabbit hole

0:16:04.516 --> 0:16:07.276
<v Speaker 2>of how it actually happened, it was really instructive because

0:16:07.356 --> 0:16:11.556
<v Speaker 2>obviously the end state was a huge success, underrated.

0:16:11.916 --> 0:16:15.076
<v Speaker 1>Every chance I get, I want to scream about how underrated,

0:16:15.076 --> 0:16:18.916
<v Speaker 1>worse feed is weirdly politically orphaned, right, Like the Republicans

0:16:19.316 --> 0:16:21.876
<v Speaker 1>decided they don't like vaccines even though they did it.

0:16:21.876 --> 0:16:24.076
<v Speaker 1>It was like, as far as I'm concerned, the great

0:16:24.076 --> 0:16:27.116
<v Speaker 1>success of Trump's first administration, and then because it was Trump,

0:16:27.156 --> 0:16:28.956
<v Speaker 1>the Democrats can't say it was great.

0:16:28.756 --> 0:16:31.796
<v Speaker 2>Right exactly, And so it's wandering out there, this great

0:16:31.836 --> 0:16:34.916
<v Speaker 2>American success story that just got buried by the stupidity

0:16:34.916 --> 0:16:38.356
<v Speaker 2>of our politics. But we did it, and we wouldn't

0:16:38.356 --> 0:16:41.236
<v Speaker 2>have been able to do it without really successful machine

0:16:41.316 --> 0:16:41.996
<v Speaker 2>learning and AI.

0:16:42.716 --> 0:16:45.116
<v Speaker 1>So how did it work? Like why was that an

0:16:45.116 --> 0:16:46.556
<v Speaker 1>AI problem? And what did they actually do.

0:16:46.916 --> 0:16:49.396
<v Speaker 2>So it was a data problem, but also an actionable

0:16:49.476 --> 0:16:53.956
<v Speaker 2>data problem. And so there's a company called Pounteer, very

0:16:54.116 --> 0:16:57.156
<v Speaker 2>very provocative company. A lot of people respond poorly to

0:16:57.236 --> 0:17:01.516
<v Speaker 2>its name, and it has this kind of mystical aura

0:17:01.556 --> 0:17:03.916
<v Speaker 2>to it, in part because it was founded by Peter

0:17:03.996 --> 0:17:07.516
<v Speaker 2>Chiel and co funded by the CIA, and in part

0:17:07.516 --> 0:17:11.556
<v Speaker 2>because it's named for the stones in the Tolkien trilogy.

0:17:12.036 --> 0:17:13.956
<v Speaker 2>But really all they do is plumbing.

0:17:14.356 --> 0:17:18.516
<v Speaker 1>I am not reflexively anti tech or anti company. I

0:17:18.556 --> 0:17:21.676
<v Speaker 1>have some amount of wariness toward Palenteer, I guess because

0:17:21.716 --> 0:17:26.156
<v Speaker 1>I associate them with domestic surveillance at some level, like

0:17:26.196 --> 0:17:28.396
<v Speaker 1>that piece of it I mean, but I don't know

0:17:28.436 --> 0:17:30.316
<v Speaker 1>it that well. I've never interviewed somebody from Palenter. I

0:17:30.316 --> 0:17:32.716
<v Speaker 1>haven't read a book about them. So, like, tell me

0:17:32.716 --> 0:17:36.596
<v Speaker 1>about Palenteer as a company. I guess, first of all,

0:17:36.596 --> 0:17:39.916
<v Speaker 1>like the side that makes people weary, and then I'm

0:17:39.916 --> 0:17:42.716
<v Speaker 1>curious more generally how they operate, what differentiates them, what

0:17:42.756 --> 0:17:44.236
<v Speaker 1>they actually do as a tech company.

0:17:44.556 --> 0:17:48.156
<v Speaker 2>Yeah. So as a company, they're created in two thousand

0:17:48.156 --> 0:17:50.796
<v Speaker 2>and three by two friends who have no business being friends.

0:17:50.796 --> 0:17:53.156
<v Speaker 2>One is Peter Thiel, who I think most of your

0:17:53.196 --> 0:17:57.876
<v Speaker 2>listeners really know about. He's a sort of largely libertarian Republican,

0:17:58.156 --> 0:18:02.516
<v Speaker 2>big Trump donor, has very controversial stances on pretty much

0:18:02.556 --> 0:18:03.836
<v Speaker 2>every possible.

0:18:03.436 --> 0:18:07.236
<v Speaker 1>Issue, including the Antichrist, weirdly including the anti Christ.

0:18:07.316 --> 0:18:10.036
<v Speaker 2>He really finds a way. His friend is a guy

0:18:10.116 --> 0:18:12.876
<v Speaker 2>named Alex Karp, who is kind of his polar opposite.

0:18:12.916 --> 0:18:17.956
<v Speaker 2>He's New York born, he's half black, half Jewish, largely

0:18:17.956 --> 0:18:21.716
<v Speaker 2>identifies as a socialist. A big donor to Hillary Clinton

0:18:21.756 --> 0:18:25.876
<v Speaker 2>and Kamala Harris. They met in law school. They argued

0:18:25.876 --> 0:18:28.836
<v Speaker 2>all the time. They agreed about the need for this

0:18:28.996 --> 0:18:31.476
<v Speaker 2>kind of technology, and the only other thing they agree

0:18:31.476 --> 0:18:34.436
<v Speaker 2>on is that in general, the world is better when

0:18:34.476 --> 0:18:38.316
<v Speaker 2>America is a strong actor and American values like freedom

0:18:38.596 --> 0:18:40.876
<v Speaker 2>are or propagated throughout the world. So that's what they

0:18:40.916 --> 0:18:41.316
<v Speaker 2>agree on.

0:18:41.636 --> 0:18:45.436
<v Speaker 1>Do you think that the liberal antagonism toward Palenteer is

0:18:45.476 --> 0:18:47.476
<v Speaker 1>misplaced or do you think it's valid in some ways?

0:18:48.436 --> 0:18:52.316
<v Speaker 2>It's incredibly complicated because it has now grown to include

0:18:52.356 --> 0:18:55.756
<v Speaker 2>not just surveillance, but Alex Karp's position on Israel, which

0:18:55.796 --> 0:18:58.636
<v Speaker 2>is that Israel should be supported by Palanteer products, just

0:18:58.676 --> 0:19:02.036
<v Speaker 2>as Ukraine should be. And so there's lots of different

0:19:02.276 --> 0:19:05.516
<v Speaker 2>valances where people can find something they don't like about Palanteer.

0:19:05.756 --> 0:19:07.716
<v Speaker 2>And by the way, I respect all of them.

0:19:08.036 --> 0:19:12.396
<v Speaker 1>Yeah, and so just as a tech company, what is

0:19:12.436 --> 0:19:15.796
<v Speaker 1>Palanteer's thing, What do they do? And in particular, what

0:19:15.876 --> 0:19:18.796
<v Speaker 1>did they do in Operation Warp Speed to get vaccines

0:19:18.836 --> 0:19:19.556
<v Speaker 1>out to the public.

0:19:20.076 --> 0:19:22.156
<v Speaker 2>I spoke to their chief architect and he's like, look,

0:19:22.236 --> 0:19:25.436
<v Speaker 2>we're the mole people of Silicon Valley. We take these

0:19:25.516 --> 0:19:28.956
<v Speaker 2>data streams, we lay them out, we clean them, We

0:19:29.116 --> 0:19:32.756
<v Speaker 2>integrate the data from various different places, so like, for instance,

0:19:32.756 --> 0:19:35.716
<v Speaker 2>a CVS and a right aid and a mom and

0:19:35.756 --> 0:19:38.916
<v Speaker 2>pop place and a trucking company, and we put them

0:19:38.916 --> 0:19:42.196
<v Speaker 2>together so that on an iPad or a laptop someone

0:19:42.276 --> 0:19:44.396
<v Speaker 2>could play the pandemic like a video game.

0:19:44.596 --> 0:19:47.236
<v Speaker 1>Right, play it like a video game, meaning there's like

0:19:48.076 --> 0:19:50.956
<v Speaker 1>a crazy dashboard, so you can see here's where the

0:19:50.956 --> 0:19:53.596
<v Speaker 1>people are, and here's where the vials are, and here's

0:19:53.596 --> 0:19:55.436
<v Speaker 1>where the vaccine is, and here's where the trucks are,

0:19:55.436 --> 0:19:57.356
<v Speaker 1>and we need to get these trucks to this vaccine

0:19:57.396 --> 0:19:59.476
<v Speaker 1>to these people. That's the exact video game you're playing.

0:19:59.716 --> 0:20:03.716
<v Speaker 2>Yeah, and constantly up to date and constantly accurate, and

0:20:04.076 --> 0:20:06.676
<v Speaker 2>literally an administrator can sit there and just move things

0:20:06.716 --> 0:20:08.916
<v Speaker 2>around and know that they're actually going to the right place.

0:20:09.196 --> 0:20:12.756
<v Speaker 1>Yes, a wildly hard problem. Like it's not sexy, like

0:20:12.956 --> 0:20:16.636
<v Speaker 1>developing a vaccine, and we've heard a lot about mRNA vaccines,

0:20:16.636 --> 0:20:19.796
<v Speaker 1>but like figuring out where the actual vaccine is is

0:20:20.676 --> 0:20:21.956
<v Speaker 1>totally non trivial health.

0:20:22.156 --> 0:20:24.756
<v Speaker 2>Yeah, it's a huge deal. And so there's two problems

0:20:24.796 --> 0:20:27.476
<v Speaker 2>you're solving right. One is the technical problem, and that

0:20:27.556 --> 0:20:31.196
<v Speaker 2>involves a lot of really dull, really unglamorous work, which

0:20:31.236 --> 0:20:34.436
<v Speaker 2>is like trying to figure out why this pipe you

0:20:34.476 --> 0:20:36.956
<v Speaker 2>know it's because it is pipe coming from a distribution

0:20:37.156 --> 0:20:40.156
<v Speaker 2>center is broken, and so AI can attack that.

0:20:40.436 --> 0:20:42.316
<v Speaker 1>When you say pipe, do you mean the pipe through

0:20:42.316 --> 0:20:44.276
<v Speaker 1>which data is flowing? What do you mean pipe in

0:20:44.316 --> 0:20:44.956
<v Speaker 1>this instance?

0:20:45.236 --> 0:20:49.156
<v Speaker 2>So, to build a data pipeline is basically a work

0:20:49.196 --> 0:20:52.356
<v Speaker 2>of code. But everybody's got lots of different code, and

0:20:52.436 --> 0:20:54.476
<v Speaker 2>so when your data pipelines are built in many many

0:20:54.516 --> 0:20:58.876
<v Speaker 2>different codes to many different standards, they have to be standardized.

0:20:59.036 --> 0:21:01.396
<v Speaker 2>You have to be able to see, oh, okay, this

0:21:01.516 --> 0:21:04.476
<v Speaker 2>data coming from CBS matches up to the data coming

0:21:04.516 --> 0:21:08.876
<v Speaker 2>from the trucking company. It's clean, it's modern. Most of

0:21:08.916 --> 0:21:11.596
<v Speaker 2>the that they were dealing with in fact was not

0:21:11.716 --> 0:21:15.156
<v Speaker 2>modern in any way. It was created a decade ago

0:21:16.116 --> 0:21:20.036
<v Speaker 2>using old code and often had bad information, and so

0:21:20.156 --> 0:21:22.476
<v Speaker 2>you need to standardize it, you need to clean it.

0:21:22.796 --> 0:21:25.116
<v Speaker 2>And then where it really gets fun is you can

0:21:25.276 --> 0:21:30.236
<v Speaker 2>use those pieces of information to recommend actions to note

0:21:30.276 --> 0:21:33.556
<v Speaker 2>that like, oh, you know you're overly distributing in one area,

0:21:33.636 --> 0:21:37.316
<v Speaker 2>you could be moving here. In fact, this rural area,

0:21:37.476 --> 0:21:41.316
<v Speaker 2>for instance, might really want the one shot doses, whereas

0:21:42.116 --> 0:21:43.556
<v Speaker 2>an urban area might want too.

0:21:43.876 --> 0:21:47.876
<v Speaker 1>And those suggestions might be coming from the machine learning model,

0:21:47.876 --> 0:21:48.916
<v Speaker 1>from the AI basic.

0:21:48.836 --> 0:21:52.236
<v Speaker 2>Correct, so that while you know, the very overtaxed humans

0:21:52.236 --> 0:21:56.196
<v Speaker 2>dealing with political problems and interagency problems are on the phone,

0:21:56.756 --> 0:21:58.876
<v Speaker 2>the AI is just kind of nudging them toward like

0:21:58.996 --> 0:22:02.116
<v Speaker 2>easier ways to make this whole project happen. So like

0:22:02.156 --> 0:22:05.116
<v Speaker 2>the technical is one problem, and then something that's kind

0:22:05.116 --> 0:22:08.516
<v Speaker 2>of a light motif of your show is the humans

0:22:08.556 --> 0:22:12.276
<v Speaker 2>are another. Because we create our own systems and there

0:22:12.316 --> 0:22:15.876
<v Speaker 2>is nothing more complicated than the federal bureaucracy. And I

0:22:15.916 --> 0:22:19.116
<v Speaker 2>mean that oftentimes with admiration and sometimes not with admiration.

0:22:19.676 --> 0:22:24.116
<v Speaker 2>And so inside of the CDC are many different agencies,

0:22:24.516 --> 0:22:28.156
<v Speaker 2>and a lot of them were even in COVID had

0:22:28.276 --> 0:22:29.196
<v Speaker 2>very sharp elbows.

0:22:29.276 --> 0:22:29.636
<v Speaker 1>Yeah.

0:22:29.716 --> 0:22:32.876
<v Speaker 2>They didn't want the Department of Defense, which was nominally

0:22:32.916 --> 0:22:36.476
<v Speaker 2>overseeing this effort, getting involved. They thought, no, this is

0:22:36.516 --> 0:22:40.516
<v Speaker 2>our territory. What do you possibly know about this? And

0:22:40.596 --> 0:22:44.076
<v Speaker 2>General Perna was so important because he really didn't know

0:22:44.116 --> 0:22:46.956
<v Speaker 2>that much about technology. He really didn't know that much

0:22:46.956 --> 0:22:51.036
<v Speaker 2>about vaccines. What he knew about was getting stuff done.

0:22:51.636 --> 0:22:54.036
<v Speaker 1>Yeah. You tell the story of a moment when he's

0:22:54.276 --> 0:22:58.236
<v Speaker 1>arguing with the governor about whether some amount of vaccine

0:22:58.276 --> 0:23:01.356
<v Speaker 1>has been delivered to the governor state. Tell me, tell

0:23:01.356 --> 0:23:01.796
<v Speaker 1>me about that.

0:23:02.316 --> 0:23:06.116
<v Speaker 2>Yeah. So, once the vaccines started to get delivered, this

0:23:06.156 --> 0:23:08.716
<v Speaker 2>is where the video game element, the dashboard Elmont really

0:23:08.716 --> 0:23:12.156
<v Speaker 2>became an important because they could see trucks pulling up

0:23:12.356 --> 0:23:16.236
<v Speaker 2>to a registered refrigeration point or warehouse point in every state.

0:23:16.916 --> 0:23:19.716
<v Speaker 2>And there were states that were really eager to get

0:23:19.716 --> 0:23:23.076
<v Speaker 2>the vaccines, and the governors felt that their entire political

0:23:23.076 --> 0:23:26.076
<v Speaker 2>futures depended on getting it and distributing it and being

0:23:26.116 --> 0:23:28.996
<v Speaker 2>able to tell their citizens like, hey, Massachusetts, we got it,

0:23:29.316 --> 0:23:31.756
<v Speaker 2>we got it. You can go to these places. Remember,

0:23:31.756 --> 0:23:34.676
<v Speaker 2>there are people, you know, frantically refreshing their browsers to

0:23:34.716 --> 0:23:37.436
<v Speaker 2>try and find weights up to three four weeks, and

0:23:37.476 --> 0:23:41.236
<v Speaker 2>so somebody would say, hey, you promised me this dosage.

0:23:41.316 --> 0:23:43.436
<v Speaker 2>I don't have it. And he said, oh, but you do.

0:23:43.876 --> 0:23:46.236
<v Speaker 2>Here's who signed for it. Go get them. I'm going

0:23:46.316 --> 0:23:49.236
<v Speaker 2>to stay right here. You go get them. And so

0:23:49.356 --> 0:23:51.796
<v Speaker 2>what he, you know, also did and he had plenty

0:23:51.796 --> 0:23:54.276
<v Speaker 2>of people working for him who help with this. These

0:23:54.316 --> 0:23:57.916
<v Speaker 2>systems need accountability. And what I think, what I saw

0:23:57.996 --> 0:24:00.356
<v Speaker 2>time and again in reporting on the book, is that

0:24:00.396 --> 0:24:05.756
<v Speaker 2>the accountability is human based. We respond to human beings saying, actually,

0:24:05.756 --> 0:24:08.196
<v Speaker 2>I'm calling your bluff because I can see the answer here.

0:24:08.356 --> 0:24:08.676
<v Speaker 1>Uh huh.

0:24:09.196 --> 0:24:11.476
<v Speaker 2>Actually, I'm gonna follow up with you because you said

0:24:11.476 --> 0:24:13.196
<v Speaker 2>you would do this pilot with us and you didn't.

0:24:13.636 --> 0:24:15.756
<v Speaker 2>And if you don't have the right human in that chair,

0:24:15.916 --> 0:24:19.636
<v Speaker 2>with the right temperament, the right force, the right seductive charm,

0:24:19.676 --> 0:24:22.516
<v Speaker 2>and that's what's called for, it's going to fail. And

0:24:22.556 --> 0:24:26.316
<v Speaker 2>so I can't say enough. Like my conversations with Perna,

0:24:26.436 --> 0:24:28.276
<v Speaker 2>I just came away thinking we should put him in

0:24:28.356 --> 0:24:29.356
<v Speaker 2>charge of a lot of stuff.

0:24:33.596 --> 0:24:46.036
<v Speaker 1>We'll be back in just a minute. So let's talk

0:24:46.036 --> 0:24:48.596
<v Speaker 1>about the Cleveland clinic. Your book has start of divided

0:24:48.636 --> 0:24:51.596
<v Speaker 1>into sections. There's a warp speed section. There's a healthcare section.

0:24:52.156 --> 0:24:56.076
<v Speaker 1>Healthcare sections basically the Cleveland Clinic. Why did you choose

0:24:56.276 --> 0:24:58.596
<v Speaker 1>for your healthcare section the Cleveland Clinic?

0:25:00.036 --> 0:25:03.196
<v Speaker 2>Mostly because they asked me to come in, and so

0:25:03.676 --> 0:25:04.036
<v Speaker 2>I was.

0:25:04.036 --> 0:25:07.076
<v Speaker 1>Really clicking phrase kings under the street light. Yeah.

0:25:07.076 --> 0:25:09.676
<v Speaker 2>And also, listen, healthcare is a universe, right, So what

0:25:09.756 --> 0:25:11.916
<v Speaker 2>I really wanted to explore is as much of that

0:25:12.036 --> 0:25:14.316
<v Speaker 2>universe as possible. Cleveland Clinic is one of the top

0:25:14.396 --> 0:25:17.756
<v Speaker 2>systems in the world and the United States, and they're

0:25:17.796 --> 0:25:21.276
<v Speaker 2>run by a really interesting guy named doctor Thomas Mihaliovich.

0:25:21.836 --> 0:25:23.596
<v Speaker 2>And so what he told me at the beginning is

0:25:24.076 --> 0:25:27.036
<v Speaker 2>I want you to wander around because what we do

0:25:27.116 --> 0:25:28.556
<v Speaker 2>with AI is going to be different than what a

0:25:28.556 --> 0:25:31.436
<v Speaker 2>lot of other people do. First of all, we actually

0:25:31.636 --> 0:25:34.396
<v Speaker 2>have one major priority, which is the treatment of our patients.

0:25:34.996 --> 0:25:37.236
<v Speaker 2>And so that means that when technology comes to the

0:25:37.236 --> 0:25:40.916
<v Speaker 2>Cleveland Clinic, it's not run by technologists. It's run by doctors.

0:25:41.476 --> 0:25:43.756
<v Speaker 2>And that is going to eliminate certain partners right off

0:25:43.796 --> 0:25:47.556
<v Speaker 2>the bat, because most software folks believe that software is

0:25:47.596 --> 0:25:50.076
<v Speaker 2>the most powerful force in the world, and they don't

0:25:50.076 --> 0:25:53.556
<v Speaker 2>want to explain themselves or work within some sort of

0:25:53.596 --> 0:25:56.996
<v Speaker 2>old fashioned medical system. I spent a fair amount of

0:25:57.036 --> 0:25:59.836
<v Speaker 2>time with the chief technical officer, who had come from

0:25:59.916 --> 0:26:03.076
<v Speaker 2>outside of healthcare and was recruited specifically from outside of it,

0:26:03.636 --> 0:26:07.476
<v Speaker 2>and he obviously knew tons about technology, but knew very

0:26:07.476 --> 0:26:08.476
<v Speaker 2>little about healthcare.

0:26:09.196 --> 0:26:11.516
<v Speaker 1>I'm somewhat frustrated in your book.

0:26:12.316 --> 0:26:15.756
<v Speaker 2>Yeah, he is frustrated because he's used to being in charge,

0:26:16.236 --> 0:26:19.236
<v Speaker 2>and what he learned in his first couple of years

0:26:19.356 --> 0:26:21.956
<v Speaker 2>is like, I'm not in charge.

0:26:21.956 --> 0:26:25.436
<v Speaker 1>And like every doctor is in charge in a weird way, right,

0:26:25.516 --> 0:26:28.876
<v Speaker 1>one of the maybe distinctive things about healthcare. And I

0:26:28.876 --> 0:26:30.836
<v Speaker 1>know doctors don't see it that way, but doctors have

0:26:30.916 --> 0:26:33.076
<v Speaker 1>a lot of autonomy and a lot of them don't

0:26:33.116 --> 0:26:34.756
<v Speaker 1>want AI.

0:26:35.196 --> 0:26:37.076
<v Speaker 2>They have a ton of autonomy, but they also have

0:26:37.156 --> 0:26:40.116
<v Speaker 2>a ton of authority. Doctor. You know, medicine is a

0:26:40.196 --> 0:26:43.076
<v Speaker 2>hierarchical business, and you want it to be that way

0:26:43.156 --> 0:26:45.716
<v Speaker 2>when you're the patient. You want someone who actually says,

0:26:45.876 --> 0:26:47.796
<v Speaker 2>I see all the data, I have all the inputs,

0:26:48.436 --> 0:26:50.636
<v Speaker 2>here's what we're going to go do, and then distributes

0:26:50.676 --> 0:26:54.036
<v Speaker 2>the tasks back. Technology doesn't work all that well that way,

0:26:54.116 --> 0:26:57.956
<v Speaker 2>and so ro heat Chandra came in and he's basically like.

0:26:58.116 --> 0:27:00.516
<v Speaker 1>This is this is the chief technology this is yeah,

0:27:00.516 --> 0:27:02.116
<v Speaker 1>this CTO, and.

0:27:02.076 --> 0:27:04.876
<v Speaker 2>He's like, I'm supposed to help turn this place around

0:27:04.876 --> 0:27:08.356
<v Speaker 2>with technology. The business is terrible. Our margins. You know,

0:27:08.436 --> 0:27:10.916
<v Speaker 2>Clinton Clinic is actually one of the more successful nonprofit

0:27:10.956 --> 0:27:14.596
<v Speaker 2>hospital systems, and it's got it two percent margin, which

0:27:14.756 --> 0:27:18.116
<v Speaker 2>most people would find horrifying. And so he goes at

0:27:18.156 --> 0:27:20.836
<v Speaker 2>it like a technologist, and time and again he runs

0:27:20.836 --> 0:27:24.996
<v Speaker 2>into this wall, which is doctor saying well, I don't

0:27:24.996 --> 0:27:26.876
<v Speaker 2>want to do it that way. Yeah, and sometimes with

0:27:26.956 --> 0:27:30.316
<v Speaker 2>good reason and sometimes not. But again, you can't just

0:27:30.356 --> 0:27:32.796
<v Speaker 2>solve the technical problem. If you want AI to actually

0:27:32.836 --> 0:27:34.836
<v Speaker 2>work for good, you have to solve both the technical

0:27:35.076 --> 0:27:37.476
<v Speaker 2>and the structural problem of what you're trying to fix.

0:27:38.436 --> 0:27:41.516
<v Speaker 1>So actually, at the Cleveland Clinic, you encountered this company

0:27:41.596 --> 0:27:45.196
<v Speaker 1>called Baesian Health, And as it happens, I interviewed the

0:27:45.236 --> 0:27:47.596
<v Speaker 1>founder of that company, Suci Saria, a few years ago

0:27:47.676 --> 0:27:51.396
<v Speaker 1>on this show, and they built this system where they

0:27:51.516 --> 0:27:56.036
<v Speaker 1>use AI to flag when patients are likely developing sepsis.

0:27:56.756 --> 0:27:58.156
<v Speaker 1>And you know, that was a few years ago that

0:27:58.196 --> 0:28:00.516
<v Speaker 1>I talked to her, and so I'm curious, how's it going,

0:28:00.516 --> 0:28:02.996
<v Speaker 1>How is it working in the world. At the Cleveland clinic.

0:28:03.596 --> 0:28:07.356
<v Speaker 2>Yeah, so's she's brilliant. And I talked to her as well,

0:28:07.396 --> 0:28:10.796
<v Speaker 2>and from a technical perspective of her ability to understand

0:28:10.796 --> 0:28:13.476
<v Speaker 2>not just what sepsis is, but again to create a

0:28:13.516 --> 0:28:16.476
<v Speaker 2>bunch of data streams and integrate them and create weights

0:28:16.556 --> 0:28:20.676
<v Speaker 2>between the streams, to create a flag for doctors to say, hey,

0:28:20.916 --> 0:28:24.036
<v Speaker 2>this might be sepsis. And just as a reminder, sepsis

0:28:24.116 --> 0:28:28.116
<v Speaker 2>kills more people every year than breast cancer, prostate cancer,

0:28:28.196 --> 0:28:30.996
<v Speaker 2>and the opioid crisis. Yeah, three hundred and fifty thousand

0:28:30.996 --> 0:28:33.636
<v Speaker 2>Americans a year, and it happens in hospitals. And so

0:28:33.716 --> 0:28:36.876
<v Speaker 2>the clinic, which loses in twenty twenty one, I think

0:28:37.116 --> 0:28:40.356
<v Speaker 2>lost about three thousand patients to sepsis, said well, we can't.

0:28:40.716 --> 0:28:43.356
<v Speaker 2>This is crazy. It may be the industry standard, but

0:28:43.396 --> 0:28:46.356
<v Speaker 2>it's crazy. So they brought in beision. I will tell

0:28:46.396 --> 0:28:48.956
<v Speaker 2>you that the founder, when first approached by the CTO

0:28:48.956 --> 0:28:51.916
<v Speaker 2>of the Cleveland clinic, said yeah, I'm not sure we're interested.

0:28:53.076 --> 0:28:55.356
<v Speaker 2>She said, you guys are a really big system. Your

0:28:55.396 --> 0:28:58.276
<v Speaker 2>doctors are going to be resistant. You're kind of a pain.

0:28:59.116 --> 0:29:01.236
<v Speaker 2>Prove to me that you actually want to implement this

0:29:01.316 --> 0:29:04.196
<v Speaker 2>in your hospital. And the CTO, who has a similar

0:29:04.236 --> 0:29:08.476
<v Speaker 2>attitude about medicine. Was actually like, oh, I see a

0:29:08.516 --> 0:29:11.596
<v Speaker 2>kindred spirit. I'm going to talk up the fact that

0:29:11.636 --> 0:29:13.356
<v Speaker 2>our doctors are committed and we're going to do this.

0:29:13.996 --> 0:29:17.356
<v Speaker 2>And so they went into Cleveland Clinic and they really

0:29:17.436 --> 0:29:19.636
<v Speaker 2>piloted for a year, and it was a hard year.

0:29:19.836 --> 0:29:21.956
<v Speaker 2>They had to figure out how it works, not just

0:29:22.276 --> 0:29:26.356
<v Speaker 2>in community hospitals in an emergency room in other places,

0:29:26.356 --> 0:29:29.756
<v Speaker 2>but like in the ICU and the Cleveland Clinic. ICU

0:29:29.876 --> 0:29:35.156
<v Speaker 2>is different even than most other healthcare ICUs because it's

0:29:35.196 --> 0:29:38.516
<v Speaker 2>a world famous institution. People come in from all over

0:29:38.556 --> 0:29:42.316
<v Speaker 2>the world, and a lot of sepsis looks exactly like

0:29:42.436 --> 0:29:45.876
<v Speaker 2>a cardiac infection, looks exactly like sixteen other things that

0:29:45.916 --> 0:29:48.356
<v Speaker 2>they're all flagging for. And so if you're an ICU

0:29:48.356 --> 0:29:51.596
<v Speaker 2>and doctor or nurse, your job is basically responding to

0:29:51.636 --> 0:29:55.836
<v Speaker 2>beeps coming from machinery near your patient. It can be

0:29:55.876 --> 0:29:58.356
<v Speaker 2>a huge pain in the ass. And so when a

0:29:58.396 --> 0:30:01.996
<v Speaker 2>sepsis flag isn't properly calibrated, when it flags too much

0:30:02.036 --> 0:30:04.716
<v Speaker 2>or flags too little, it's actually not doing its job.

0:30:05.036 --> 0:30:08.196
<v Speaker 2>So even though everyone may agree on the premise, which is, hey,

0:30:08.236 --> 0:30:10.956
<v Speaker 2>we want to reduce more metality, from sepsis because it's

0:30:11.236 --> 0:30:15.076
<v Speaker 2>twenty twenty six or whatever. You know, you think about

0:30:15.116 --> 0:30:17.916
<v Speaker 2>your own job, You think about the own annoyances you

0:30:17.996 --> 0:30:20.676
<v Speaker 2>have in getting your job done, and even though it's

0:30:20.756 --> 0:30:24.316
<v Speaker 2>life or death, those annoyances mount. And so the software

0:30:24.436 --> 0:30:27.156
<v Speaker 2>has to work within the way doctors work, or else

0:30:27.196 --> 0:30:28.516
<v Speaker 2>it's not going to get used well.

0:30:28.556 --> 0:30:31.396
<v Speaker 1>And I mean, just to be clear, it was a

0:30:31.396 --> 0:30:34.116
<v Speaker 1>little bit unclear to me in the book how good

0:30:34.196 --> 0:30:37.036
<v Speaker 1>the software is in that context, like.

0:30:38.516 --> 0:30:39.396
<v Speaker 2>Is it good enough?

0:30:39.516 --> 0:30:42.076
<v Speaker 1>Is part of the problem that there's too many false positives,

0:30:42.116 --> 0:30:43.956
<v Speaker 1>which is a real problem.

0:30:44.076 --> 0:30:47.556
<v Speaker 2>Not outside of the ICU. Okay, the ICU is the

0:30:47.836 --> 0:30:51.556
<v Speaker 2>is the last frontier because everything is so complicated in

0:30:51.596 --> 0:30:52.156
<v Speaker 2>an ICU.

0:30:52.316 --> 0:30:57.276
<v Speaker 1>Yeah, it's the hardest diagnosis essentially exactly. So outside of

0:30:57.316 --> 0:31:01.196
<v Speaker 1>the ICU, is there like empirical benefit, are fewer people

0:31:01.276 --> 0:31:02.276
<v Speaker 1>dying of sepsis?

0:31:02.596 --> 0:31:06.476
<v Speaker 2>Well? The clinic reported a forty one percent drop in

0:31:06.556 --> 0:31:10.316
<v Speaker 2>mortality over the course of a year using the software. Now,

0:31:10.396 --> 0:31:13.396
<v Speaker 2>some of it was because they had drawn everyone's attention

0:31:13.476 --> 0:31:16.556
<v Speaker 2>to the reduction of sepsis. It's the Hawthorne effect when

0:31:16.596 --> 0:31:19.596
<v Speaker 2>you say we're going to do this, and everyone's attention shifts.

0:31:20.236 --> 0:31:23.316
<v Speaker 2>But people are realizing that that sepsis is a very

0:31:23.396 --> 0:31:26.156
<v Speaker 2>perfect for AI kind of problem because it has all

0:31:26.236 --> 0:31:30.676
<v Speaker 2>of these inputs that are sometimes conflicting and so much

0:31:30.716 --> 0:31:34.876
<v Speaker 2>data that it can overwhelm a caregiver. And AI doesn't

0:31:34.876 --> 0:31:37.596
<v Speaker 2>get overwhelmed by too much data. It's really great at

0:31:37.636 --> 0:31:41.756
<v Speaker 2>processing data at scale, very very quickly. What it often

0:31:42.676 --> 0:31:45.796
<v Speaker 2>isn't as great at is figuring out how to tell people.

0:31:45.516 --> 0:31:50.556
<v Speaker 1>About it, especially probabilistically. Right that like correct, the AI

0:31:50.676 --> 0:31:53.956
<v Speaker 1>is very good at pattern matching and making a probabilistic assessment,

0:31:55.676 --> 0:31:59.196
<v Speaker 1>but that last piece seems like the hard to figure

0:31:59.196 --> 0:32:00.276
<v Speaker 1>out for humans piece.

0:32:00.756 --> 0:32:04.036
<v Speaker 2>Yeah, And so what Beijin did, much to their credit,

0:32:04.236 --> 0:32:07.076
<v Speaker 2>is they heard the caregivers and they said, look, it's

0:32:07.076 --> 0:32:09.436
<v Speaker 2>not good enough just to send a flag. I get

0:32:09.476 --> 0:32:13.196
<v Speaker 2>flags all day, Tell me why explain why this flagged

0:32:13.236 --> 0:32:16.676
<v Speaker 2>on this patient. And what Cleveland Clinic did in the ICU,

0:32:16.756 --> 0:32:20.796
<v Speaker 2>particularly because they're very aware that this was the hardest place,

0:32:21.236 --> 0:32:24.956
<v Speaker 2>they basically just set up a workstation. They called it

0:32:24.996 --> 0:32:27.356
<v Speaker 2>a command center. Command center is a little glorious for

0:32:27.396 --> 0:32:27.876
<v Speaker 2>what I saw.

0:32:27.996 --> 0:32:28.596
<v Speaker 1>It was a PC.

0:32:29.276 --> 0:32:32.116
<v Speaker 2>There's a lovely woman named Dana operating it. She would

0:32:32.156 --> 0:32:34.596
<v Speaker 2>look at the patients in the ICU. She would see

0:32:34.596 --> 0:32:36.796
<v Speaker 2>the flag, she would hover over the flag, and the

0:32:36.796 --> 0:32:41.636
<v Speaker 2>flag would say I flagged this because I'm noticing X, Y,

0:32:41.676 --> 0:32:45.156
<v Speaker 2>and Z, and so she would say, Okay, Well, what

0:32:45.236 --> 0:32:48.396
<v Speaker 2>I'm seeing when I go look at the patient is

0:32:48.676 --> 0:32:51.356
<v Speaker 2>they're actually okay, and I can see why the AI

0:32:51.516 --> 0:32:54.196
<v Speaker 2>might be confused about this. I'll keep an eye on it.

0:32:54.676 --> 0:32:57.756
<v Speaker 2>Other times it was very clear that like, yep, you're

0:32:57.796 --> 0:33:00.476
<v Speaker 2>seeing what we're seeing. This is validating what we're seeing.

0:33:00.556 --> 0:33:02.916
<v Speaker 2>And occasionally it would flag something and she would go

0:33:02.916 --> 0:33:05.196
<v Speaker 2>in and say to the caregivers, we have to do

0:33:05.236 --> 0:33:05.996
<v Speaker 2>a check right now.

0:33:07.916 --> 0:33:11.036
<v Speaker 1>When you step back, having learned what you've learned from

0:33:11.076 --> 0:33:14.036
<v Speaker 1>the Cleveland Clinic, when you think about healthcare and AI

0:33:14.676 --> 0:33:17.196
<v Speaker 1>in the next few years, what do you think about I.

0:33:17.116 --> 0:33:19.996
<v Speaker 2>Think that healthcare and AI are going to really beat

0:33:20.076 --> 0:33:23.236
<v Speaker 2>like peanut butter and chocolate. I think it's the best

0:33:23.356 --> 0:33:26.396
<v Speaker 2>place for AI to come into our lives and have

0:33:26.636 --> 0:33:29.636
<v Speaker 2>rational uses that make our health care better and that

0:33:29.676 --> 0:33:33.156
<v Speaker 2>make our costs lower. It is going to take change.

0:33:33.196 --> 0:33:35.796
<v Speaker 2>And so one of the most interesting people I met

0:33:35.796 --> 0:33:38.116
<v Speaker 2>at the clinic is this woman named doctor Rita Pappus,

0:33:38.476 --> 0:33:42.916
<v Speaker 2>who's a hospitalist and hospitalists oversee the administration of the hospital,

0:33:42.956 --> 0:33:45.476
<v Speaker 2>but from a medical point of view. And she started

0:33:45.516 --> 0:33:48.196
<v Speaker 2>as a nurse and in her thirties went back to

0:33:48.236 --> 0:33:51.876
<v Speaker 2>medical school, and so she's seen everything a hospital has

0:33:51.916 --> 0:33:54.596
<v Speaker 2>to offer, including every type of human in a hospital.

0:33:55.236 --> 0:33:57.236
<v Speaker 2>And one of the things she told me is like, look,

0:33:58.676 --> 0:34:02.556
<v Speaker 2>I know that roheat the CTO is finding lots of

0:34:02.596 --> 0:34:06.436
<v Speaker 2>resistance across the hospital, and guess what, I'm not the

0:34:06.516 --> 0:34:09.396
<v Speaker 2>least bit surprised. Doctors are trained a very particular way

0:34:10.036 --> 0:34:13.716
<v Speaker 2>and ultimately, like long term, two decades out, if we

0:34:13.756 --> 0:34:16.676
<v Speaker 2>want AI to take hold in hospitals, we actually going

0:34:16.716 --> 0:34:19.716
<v Speaker 2>to need different kinds of people to go into medicine

0:34:20.356 --> 0:34:24.756
<v Speaker 2>who are less lowercase C conservative, less grounded in their ways,

0:34:25.196 --> 0:34:31.316
<v Speaker 2>more collaborative, and more willing to trust that technology can

0:34:31.316 --> 0:34:33.276
<v Speaker 2>do some of the job. The people that she sees

0:34:33.356 --> 0:34:36.476
<v Speaker 2>going into the profession right now after hundreds of years

0:34:36.476 --> 0:34:40.076
<v Speaker 2>of selection, are very particular type. And so she didn't

0:34:40.116 --> 0:34:43.796
<v Speaker 2>say this in a value judgment. She's very objective about it,

0:34:43.836 --> 0:34:45.676
<v Speaker 2>but she said, look, that's what it's going to take.

0:34:45.756 --> 0:34:48.276
<v Speaker 2>We've already proven that it can work for our bottom line,

0:34:48.316 --> 0:34:50.556
<v Speaker 2>that it can work for patients if we're going to

0:34:50.596 --> 0:34:54.156
<v Speaker 2>scale it, education for doctors is going to have to

0:34:54.236 --> 0:34:54.716
<v Speaker 2>change too.

0:34:55.596 --> 0:34:59.796
<v Speaker 1>So at the end of the book you have this epilogue,

0:34:59.836 --> 0:35:02.876
<v Speaker 1>that's the one part of the book where you're basically like,

0:35:04.036 --> 0:35:07.516
<v Speaker 1>here's what you should do. You being a person who's

0:35:07.516 --> 0:35:09.796
<v Speaker 1>reading the book, who cares about the world it's interested

0:35:09.836 --> 0:35:13.876
<v Speaker 1>in AI, what should I do? What's your advice?

0:35:14.676 --> 0:35:18.396
<v Speaker 2>Well, I think, look, there's two pieces of advice here, right.

0:35:18.836 --> 0:35:22.076
<v Speaker 2>The first is it, if you're the kind of person

0:35:22.156 --> 0:35:25.996
<v Speaker 2>who cares about living in a better world, you're going

0:35:26.076 --> 0:35:28.356
<v Speaker 2>to have to use these tools to understand what they're

0:35:28.396 --> 0:35:33.436
<v Speaker 2>capable of. And that responsibility is really frustrating to people. Right,

0:35:33.516 --> 0:35:36.396
<v Speaker 2>We've now listened to technologists tell us that we have

0:35:36.436 --> 0:35:38.676
<v Speaker 2>to change our lives for whatever their product is for

0:35:38.716 --> 0:35:43.076
<v Speaker 2>the last twenty years, and it's annoying and they get richer,

0:35:43.756 --> 0:35:46.676
<v Speaker 2>and we spend more time adapting, and you haven't seen

0:35:46.676 --> 0:35:49.196
<v Speaker 2>a lot of public good come from it. But I'm

0:35:49.236 --> 0:35:52.836
<v Speaker 2>pretty convinced that in the right situations, these tools can

0:35:52.916 --> 0:35:56.636
<v Speaker 2>help us, can help their republic, can help education, medicine.

0:35:58.196 --> 0:36:01.436
<v Speaker 2>But if we leave that to the technologists, we're going

0:36:01.476 --> 0:36:03.556
<v Speaker 2>to get a bad result. So we need to figure

0:36:03.556 --> 0:36:06.036
<v Speaker 2>out what good they can play in our lives and

0:36:06.076 --> 0:36:09.236
<v Speaker 2>what kind of good we want to advocate for in

0:36:09.236 --> 0:36:12.916
<v Speaker 2>the public space. And if it's not hard, there are

0:36:12.956 --> 0:36:15.156
<v Speaker 2>lots of ways to understand what this stuff does. You

0:36:15.156 --> 0:36:16.676
<v Speaker 2>can do it in a couple minutes, in a day,

0:36:17.196 --> 0:36:22.036
<v Speaker 2>repeat it. It's a really important component to being a

0:36:22.036 --> 0:36:24.396
<v Speaker 2>citizen in the twenty first century. And it's a lot

0:36:24.396 --> 0:36:27.156
<v Speaker 2>of what the Pope wrote in his encyclical, which is

0:36:27.876 --> 0:36:30.236
<v Speaker 2>we cannot wish these away, but we do have to

0:36:30.276 --> 0:36:31.916
<v Speaker 2>make them more human. And the way to make them

0:36:31.916 --> 0:36:34.916
<v Speaker 2>more human is to be insisting that they be more human.

0:36:34.956 --> 0:36:35.916
<v Speaker 2>So you have to use them.

0:36:36.716 --> 0:36:39.916
<v Speaker 1>When you say make them more human, what does that mean.

0:36:40.156 --> 0:36:42.276
<v Speaker 2>Left to their own devices. This is going to be

0:36:42.396 --> 0:36:45.996
<v Speaker 2>enterprise software. It's going to be sold into the Department

0:36:46.036 --> 0:36:49.356
<v Speaker 2>of Defense. It's going to be used to eliminate jobs.

0:36:49.796 --> 0:36:52.436
<v Speaker 2>It's going to be used to make corporations more efficient.

0:36:53.236 --> 0:36:55.956
<v Speaker 2>And I think what we want to advocate for is, no,

0:36:56.276 --> 0:37:00.956
<v Speaker 2>we want these tools to make many, many people's lives better.

0:37:01.476 --> 0:37:04.076
<v Speaker 2>It's not to say that, you know, capitalism can't continue

0:37:04.116 --> 0:37:07.156
<v Speaker 2>churning on, but like you have to advocate for what

0:37:07.196 --> 0:37:09.316
<v Speaker 2>you want, and so in the same way, that mister

0:37:09.436 --> 0:37:13.476
<v Speaker 2>Johnson's use of AI is sitting way downstream of what

0:37:13.556 --> 0:37:16.636
<v Speaker 2>Google and open aiy ultimately want. We want to move

0:37:16.676 --> 0:37:19.276
<v Speaker 2>those things upstream, and so the only way to do

0:37:19.316 --> 0:37:21.516
<v Speaker 2>it is to know what the tools can do and

0:37:21.516 --> 0:37:24.756
<v Speaker 2>then insist that we get that kind of utility because

0:37:26.116 --> 0:37:28.996
<v Speaker 2>it's just not on the radar for these companies. So

0:37:29.036 --> 0:37:32.716
<v Speaker 2>that's one component of it, and the other, frankly, is

0:37:32.716 --> 0:37:36.076
<v Speaker 2>we probably need greater regulation for the negatives to prevent

0:37:36.116 --> 0:37:36.836
<v Speaker 2>them from happening.

0:37:37.476 --> 0:37:38.676
<v Speaker 1>Like what's good regulation?

0:37:39.996 --> 0:37:43.476
<v Speaker 2>The best model I've heard so far is really, you know,

0:37:43.596 --> 0:37:49.316
<v Speaker 2>kind of using nuclear power and nuclear weaponry as a model. Right,

0:37:49.636 --> 0:37:52.196
<v Speaker 2>that was the last thing we created that has this

0:37:52.396 --> 0:37:56.796
<v Speaker 2>kind of scale and power. The International Atomic Energy Commission

0:37:56.836 --> 0:37:59.396
<v Speaker 2>was established to make sure that we knew exactly how

0:37:59.516 --> 0:38:01.756
<v Speaker 2>much nuclear material there was in the world yea, and

0:38:01.756 --> 0:38:03.756
<v Speaker 2>who had control of it and what it was being

0:38:03.876 --> 0:38:04.156
<v Speaker 2>used for.

0:38:04.236 --> 0:38:06.996
<v Speaker 1>I mean, like, how does that map to this? I

0:38:07.036 --> 0:38:09.596
<v Speaker 1>get that it says big deal read flo but what

0:38:09.596 --> 0:38:10.636
<v Speaker 1>does it actually mean.

0:38:10.916 --> 0:38:14.036
<v Speaker 2>It means keeping an inventory of all of these models

0:38:14.036 --> 0:38:17.436
<v Speaker 2>and their capabilities, knowing how much energy they're using, knowing

0:38:17.436 --> 0:38:21.316
<v Speaker 2>how many chips they have, knowing how many floating point operations,

0:38:21.556 --> 0:38:24.676
<v Speaker 2>which is the technical term for what these models are processing.

0:38:25.236 --> 0:38:27.756
<v Speaker 2>Each model is doing. You could set a limit on

0:38:27.756 --> 0:38:31.436
<v Speaker 2>the floating point operations and say beyond this model, you

0:38:31.476 --> 0:38:33.676
<v Speaker 2>can't make it, at least for now.

0:38:33.956 --> 0:38:37.916
<v Speaker 1>So you're talking about like a global speed limit on

0:38:38.036 --> 0:38:39.796
<v Speaker 1>the development of bigger models.

0:38:40.076 --> 0:38:42.956
<v Speaker 2>Say, I think it's probably the simplest way to go

0:38:43.036 --> 0:38:47.876
<v Speaker 2>about regulating how AI works in the world and giving

0:38:48.076 --> 0:38:50.956
<v Speaker 2>governments and societies time to reckon with the consequences of

0:38:51.036 --> 0:38:51.916
<v Speaker 2>each new model.

0:38:52.116 --> 0:38:55.596
<v Speaker 1>And you think it might happen, I think.

0:38:55.516 --> 0:38:58.476
<v Speaker 2>Something akin to it is going to happen because I

0:38:58.716 --> 0:39:03.516
<v Speaker 2>think politically actors are realizing in twenty twenty six, AI

0:39:03.636 --> 0:39:05.036
<v Speaker 2>is likely to be one of the two or three

0:39:05.076 --> 0:39:08.076
<v Speaker 2>biggest issues in the election, and by twenty twenty eight

0:39:08.716 --> 0:39:12.156
<v Speaker 2>it's like to be the biggest. Look, it's America, and

0:39:12.156 --> 0:39:16.436
<v Speaker 2>in the end, America tends to regulate after the crisis.

0:39:16.756 --> 0:39:20.636
<v Speaker 2>That's historically what we do. If I had to beat

0:39:20.676 --> 0:39:22.716
<v Speaker 2>I would say that's probably what will happen this time.

0:39:22.916 --> 0:39:25.396
<v Speaker 2>Is something bad will happen and then we will all

0:39:25.436 --> 0:39:27.916
<v Speaker 2>be looking at the ashes of it and figuring out

0:39:27.916 --> 0:39:30.396
<v Speaker 2>what to do. I hope that's not the case.

0:39:35.356 --> 0:39:42.396
<v Speaker 1>We'll be back in a minute with the lightning round.

0:39:46.716 --> 0:39:47.916
<v Speaker 1>Let's finish with the lightning round.

0:39:48.596 --> 0:39:48.796
<v Speaker 2>Yeah.

0:39:49.956 --> 0:39:51.796
<v Speaker 1>Best Baltimore musician of all time.

0:39:53.796 --> 0:39:56.076
<v Speaker 2>Tupac Shakur did not know.

0:39:57.476 --> 0:39:57.916
<v Speaker 1>Baltimore.

0:39:57.956 --> 0:40:00.636
<v Speaker 2>A student of Baltimore School for the Arts and the

0:40:00.676 --> 0:40:04.116
<v Speaker 2>Baltimore Orioles recently gave out a Tupac Shakur bobblehead and

0:40:04.156 --> 0:40:05.516
<v Speaker 2>the stadium was full.

0:40:05.716 --> 0:40:06.316
<v Speaker 1>Were you there?

0:40:06.756 --> 0:40:08.596
<v Speaker 2>I was not, but I contemplated.

0:40:09.116 --> 0:40:11.596
<v Speaker 1>We were on the ground crew of the Orioles. Yeah.

0:40:11.676 --> 0:40:13.236
<v Speaker 1>In high school, what'd you learn?

0:40:15.196 --> 0:40:17.596
<v Speaker 2>I learned that the most disgusting thing in the world

0:40:18.076 --> 0:40:22.516
<v Speaker 2>is a tobacco ball combined with bazooka, and that most

0:40:22.596 --> 0:40:26.036
<v Speaker 2>relief pitchers would form that in their mouths, get the

0:40:26.116 --> 0:40:29.396
<v Speaker 2>juices out, spit it out into the air, and then

0:40:29.516 --> 0:40:30.956
<v Speaker 2>kick it into the outfield.

0:40:31.756 --> 0:40:35.956
<v Speaker 1>Incredible. What's your walk on song?

0:40:38.596 --> 0:40:40.196
<v Speaker 2>I really love the Rocky theme?

0:40:40.556 --> 0:40:42.876
<v Speaker 1>Amazing a cliche for a reason.

0:40:43.196 --> 0:40:46.036
<v Speaker 2>It absolutely is like, if you are working out and

0:40:46.076 --> 0:40:50.156
<v Speaker 2>you need to go that last quarter mile, just put

0:40:50.196 --> 0:40:50.436
<v Speaker 2>it on.

0:40:50.596 --> 0:40:53.196
<v Speaker 1>I really respect that you went to that instead of

0:40:53.236 --> 0:40:59.756
<v Speaker 1>some obscure hipster pick so right that you oversaw Times

0:40:59.796 --> 0:41:02.876
<v Speaker 1>Person of the Year when you were at time I did.

0:41:02.956 --> 0:41:05.196
<v Speaker 2>Yeah, what's a tip.

0:41:05.236 --> 0:41:06.316
<v Speaker 1>If I want to be Times.

0:41:06.076 --> 0:41:09.596
<v Speaker 2>Person of the Year, you know, it's really year dependent.

0:41:09.836 --> 0:41:14.316
<v Speaker 3>So I, like a fool, thought we would just evaluate

0:41:14.356 --> 0:41:17.356
<v Speaker 3>it based on the most important person of the year,

0:41:17.956 --> 0:41:20.916
<v Speaker 3>and that is in that case, it turns out it's like, oh,

0:41:20.956 --> 0:41:23.236
<v Speaker 3>but last year we did a bad person, so this.

0:41:23.276 --> 0:41:25.276
<v Speaker 2>Year we need to do a good person.

0:41:25.476 --> 0:41:28.556
<v Speaker 1>Well that makes some sense. There's a mix, it does.

0:41:28.436 --> 0:41:31.596
<v Speaker 2>You want to mix, but it is not the pure

0:41:31.716 --> 0:41:32.996
<v Speaker 2>thing that I was raised to believe.

0:41:32.996 --> 0:41:36.716
<v Speaker 1>It is. Were you there? There was a year I

0:41:36.836 --> 0:41:39.036
<v Speaker 1>remember exactly what it was. I don't know exactly when

0:41:39.036 --> 0:41:41.076
<v Speaker 1>you were there when they put like something reflective on

0:41:41.116 --> 0:41:42.676
<v Speaker 1>the cover in the Person of the Are was you?

0:41:43.076 --> 0:41:43.516
<v Speaker 2>Was that you?

0:41:44.116 --> 0:41:44.276
<v Speaker 1>Oh?

0:41:44.356 --> 0:41:49.396
<v Speaker 2>I was there? It was not me. I thought this

0:41:49.596 --> 0:41:52.796
<v Speaker 2>is pretty silly. You know, we could just make the

0:41:52.876 --> 0:41:54.756
<v Speaker 2>YouTube guys, the people of the year.

0:41:54.716 --> 0:41:58.036
<v Speaker 1>Failure is an orphan success as a thousand fathers failures. Yeah,

0:41:58.276 --> 0:41:59.276
<v Speaker 1>that was happening right now.

0:41:59.476 --> 0:42:01.596
<v Speaker 2>So I was no, no, no, I genuinely did not

0:42:01.676 --> 0:42:02.316
<v Speaker 2>oversee that one.

0:42:02.436 --> 0:42:04.676
<v Speaker 1>Is there nobody who would say I thought that was

0:42:04.676 --> 0:42:05.316
<v Speaker 1>a good idea.

0:42:05.476 --> 0:42:08.636
<v Speaker 2>I was asked forty eight hours before it went to

0:42:08.636 --> 0:42:11.476
<v Speaker 2>print to write the back page, and so I wrote

0:42:11.476 --> 0:42:15.196
<v Speaker 2>a backpage that, as I recall, was largely about Andy

0:42:15.196 --> 0:42:18.036
<v Speaker 2>Warhol and the notion of you know, fifteen minutes and

0:42:18.076 --> 0:42:21.836
<v Speaker 2>how that works in a distributed sort of technological I

0:42:21.836 --> 0:42:23.236
<v Speaker 2>don't want to go back and look at it or

0:42:23.276 --> 0:42:25.596
<v Speaker 2>defend it, but I will tell you it was not

0:42:25.756 --> 0:42:28.556
<v Speaker 2>my call to put the reflective view on the cover.

0:42:29.196 --> 0:42:31.796
<v Speaker 1>You know, everybody hated it at the time, and I

0:42:31.836 --> 0:42:34.756
<v Speaker 1>get that. I mean, for anybody to care at all

0:42:34.836 --> 0:42:37.556
<v Speaker 1>now it would be amazing. But it also, like you

0:42:37.596 --> 0:42:39.836
<v Speaker 1>could argue it's sort of the fifteen minutes of famous,

0:42:39.876 --> 0:42:42.316
<v Speaker 1>like the foreshadowing the creator economy or something, if you

0:42:42.356 --> 0:42:42.756
<v Speaker 1>wanted that.

0:42:43.636 --> 0:42:46.116
<v Speaker 2>I think others there have been others that have held

0:42:46.196 --> 0:42:46.636
<v Speaker 2>up worse.

0:42:47.356 --> 0:42:51.516
<v Speaker 1>If you were running a media company right now, what

0:42:51.556 --> 0:42:52.236
<v Speaker 1>would your play be.

0:42:54.036 --> 0:42:59.396
<v Speaker 2>I would really retreat to original reporting and high quality presentation,

0:43:00.116 --> 0:43:02.876
<v Speaker 2>because I think what you're really competing is right now

0:43:02.996 --> 0:43:05.196
<v Speaker 2>is a lot of noise and a lot of slop

0:43:05.356 --> 0:43:07.756
<v Speaker 2>and a lot of volume. And when you see that

0:43:07.796 --> 0:43:12.236
<v Speaker 2>going on, treat to quality and trust your taste because

0:43:12.316 --> 0:43:15.236
<v Speaker 2>the individual the taste of individuals is still pretty interesting,

0:43:16.036 --> 0:43:19.156
<v Speaker 2>I think. But I wouldn't try to compete everywhere. I

0:43:19.196 --> 0:43:21.956
<v Speaker 2>would try to compete on the most interesting stories and

0:43:22.116 --> 0:43:24.876
<v Speaker 2>make them, you know, keep it simple, make them as

0:43:24.876 --> 0:43:26.636
<v Speaker 2>good as you can possibly make them.

0:43:27.076 --> 0:43:28.956
<v Speaker 1>Thanks Mian, congratulations on the book.

0:43:29.036 --> 0:43:29.756
<v Speaker 2>Thank you so much.

0:43:38.236 --> 0:43:41.076
<v Speaker 1>Josh Tarrengel is the author of the book AI for Good,

0:43:41.596 --> 0:43:45.236
<v Speaker 1>How real people are using artificial intelligence to fix things

0:43:45.276 --> 0:43:49.196
<v Speaker 1>that matter. Please let us know what you think of

0:43:49.236 --> 0:43:51.156
<v Speaker 1>the show, which you want to hear more of, which

0:43:51.196 --> 0:43:55.116
<v Speaker 1>you want to hear less of particular guest ideas. You

0:43:55.156 --> 0:43:58.436
<v Speaker 1>can email us at problem at pushkin dot fm. I

0:43:58.476 --> 0:44:00.996
<v Speaker 1>read all the emails. You can also find me on

0:44:01.716 --> 0:44:05.996
<v Speaker 1>x run LinkedIn. Really do appreciate all the messages that

0:44:06.036 --> 0:44:08.716
<v Speaker 1>we get. Today's show was produced by Gabriel Hunter Chang

0:44:08.716 --> 0:44:11.756
<v Speaker 1>and The Menino. It was engineered by Hansdale She and

0:44:11.996 --> 0:44:15.316
<v Speaker 1>edited by Lydia Jane Kott. I'm Jacob Goldstein and we'll

0:44:15.316 --> 0:44:24.516
<v Speaker 1>be back next week with another episode of What's Your Problem.