WEBVTT - What Could Possibly Go Wrong?

0:00:04.600 --> 0:00:07.040
<v Speaker 1>Sleep Workers is a production of I Heart Radio and

0:00:07.200 --> 0:00:16.560
<v Speaker 1>Unusual Productions. I was on a patrol up in the

0:00:16.600 --> 0:00:19.960
<v Speaker 1>mountains of Afghanistan, and I was doing a reconnaissance patrol

0:00:20.079 --> 0:00:23.760
<v Speaker 1>with a very small ranger team, and I saw someone

0:00:23.800 --> 0:00:29.120
<v Speaker 1>approaching us, young man, maybe early twenties. That's Polar, a

0:00:29.160 --> 0:00:32.640
<v Speaker 1>former Army ranger, an elite special operative in the U. S. Military.

0:00:33.360 --> 0:00:35.519
<v Speaker 1>There were sort of a couple of possibilities that came

0:00:35.560 --> 0:00:38.640
<v Speaker 1>into my mind. One was that he was a goat hurter,

0:00:38.920 --> 0:00:41.440
<v Speaker 1>just out, you know, taking his goats out to eat grass.

0:00:41.960 --> 0:00:45.160
<v Speaker 1>Another was that he might be like a woodcutter that's

0:00:45.159 --> 0:00:48.240
<v Speaker 1>protecting his property. And another one might be that he

0:00:48.640 --> 0:00:51.080
<v Speaker 1>was someone who was had seen us. There wasn't a

0:00:51.080 --> 0:00:53.360
<v Speaker 1>lot of vegetation in the area, so we were pretty exposed,

0:00:53.720 --> 0:00:56.240
<v Speaker 1>and he was coming to kill us, And those all

0:00:56.280 --> 0:01:01.160
<v Speaker 1>seemed like very real possibilities. PULL knew of similar situations

0:01:01.200 --> 0:01:05.160
<v Speaker 1>where enemy fighters pretended to be civilians, concealing their weapons

0:01:05.240 --> 0:01:08.920
<v Speaker 1>until the last minute ambush. I fairly id degree of

0:01:08.959 --> 0:01:11.040
<v Speaker 1>confidence that, you know, if we got into a gunfight,

0:01:11.160 --> 0:01:14.120
<v Speaker 1>we could outmatch him or three of us, but if

0:01:14.120 --> 0:01:16.280
<v Speaker 1>you surprised us, he might have usially killed one of

0:01:16.319 --> 0:01:18.440
<v Speaker 1>us in the process first, so I wanted to maneuver

0:01:18.480 --> 0:01:20.760
<v Speaker 1>to a position where I could see him, and I

0:01:20.760 --> 0:01:22.200
<v Speaker 1>found him. He was sitting on the edge of a

0:01:22.240 --> 0:01:25.760
<v Speaker 1>cliff and looking out over this by valley, and he

0:01:25.800 --> 0:01:28.080
<v Speaker 1>had his back to me, and I settled into a

0:01:28.080 --> 0:01:30.840
<v Speaker 1>position where I could watch him very closely through my

0:01:30.880 --> 0:01:34.120
<v Speaker 1>sniper rifle. It was close enough that the wind carried

0:01:34.120 --> 0:01:37.000
<v Speaker 1>his voice towards me and I could hear him talking.

0:01:38.200 --> 0:01:40.440
<v Speaker 1>That alarmed me because I couldn't see who was talking to.

0:01:41.240 --> 0:01:45.240
<v Speaker 1>Paul didn't speak the local Afghan languages Dory or Pashtow,

0:01:45.720 --> 0:01:49.040
<v Speaker 1>so he couldn't understand what the man was saying. I

0:01:49.080 --> 0:01:50.880
<v Speaker 1>thought he might have had a radio and he could

0:01:50.920 --> 0:01:54.560
<v Speaker 1>be reporting back to maybe a group of fighters a nearby.

0:01:54.960 --> 0:01:58.000
<v Speaker 1>I was wearing that possibility versus maybe he's just you know,

0:01:58.080 --> 0:01:59.960
<v Speaker 1>talking to himself or talking to his goats or something

0:02:00.000 --> 0:02:04.480
<v Speaker 1>in And then eventually I heard him start singing, and

0:02:04.520 --> 0:02:06.880
<v Speaker 1>it struck me that if he was singing, you know,

0:02:06.920 --> 0:02:09.440
<v Speaker 1>singing out over the radio to someone in our position,

0:02:09.480 --> 0:02:12.040
<v Speaker 1>it seemed like a very strange thing for a fighter

0:02:12.080 --> 0:02:14.320
<v Speaker 1>to be doing. And the most like the explanation was

0:02:14.360 --> 0:02:17.239
<v Speaker 1>he was just an innocent go to hurd Um had

0:02:17.320 --> 0:02:20.040
<v Speaker 1>no idea that we were there, and he was singing

0:02:20.080 --> 0:02:24.639
<v Speaker 1>to himself just to pass the time, and so Paul

0:02:24.800 --> 0:02:29.079
<v Speaker 1>lowered his sniper rifle and he left, no provocation, no

0:02:29.160 --> 0:02:34.080
<v Speaker 1>harm done to either side. But that incident really stuck

0:02:34.120 --> 0:02:35.720
<v Speaker 1>with me because there was a period of time where

0:02:35.760 --> 0:02:38.720
<v Speaker 1>I didn't know whether he was, you know, an innocent

0:02:38.760 --> 0:02:40.639
<v Speaker 1>person or a fighter who might have been trying to

0:02:40.680 --> 0:02:43.200
<v Speaker 1>kill us Um, And the actions I would take were

0:02:43.320 --> 0:02:46.400
<v Speaker 1>very different in those two worlds. And now I look

0:02:46.440 --> 0:02:49.160
<v Speaker 1>back when I think about autonomous weapons and I think

0:02:49.200 --> 0:02:51.920
<v Speaker 1>what would a machine do? How could a machine understand

0:02:51.960 --> 0:02:55.600
<v Speaker 1>the context that I did, and sort of realize it

0:02:55.639 --> 0:02:57.840
<v Speaker 1>doesn't make sense that a person might be singing in

0:02:57.840 --> 0:03:00.640
<v Speaker 1>a tactical way that's some strange is probably just an

0:03:00.800 --> 0:03:04.360
<v Speaker 1>in person be able to do that. It's a profound question.

0:03:04.440 --> 0:03:07.880
<v Speaker 1>Paul poses what happens when something like a Predator drone

0:03:07.919 --> 0:03:11.000
<v Speaker 1>has as much autonomy as a self driving car and

0:03:11.160 --> 0:03:15.080
<v Speaker 1>can an AI system ever understand context, which can sometimes

0:03:15.120 --> 0:03:19.360
<v Speaker 1>mean the difference between life and death. In this episode

0:03:19.520 --> 0:03:22.440
<v Speaker 1>will examine AI on the battlefield and the future of

0:03:22.480 --> 0:03:40.279
<v Speaker 1>technology driven warfare. I'm as Velosen and this is Sleepwalkers.

0:03:40.280 --> 0:03:42.720
<v Speaker 1>So care last episode we talked about the future of

0:03:42.760 --> 0:03:45.360
<v Speaker 1>work and we focus on one big question, which was

0:03:45.720 --> 0:03:49.200
<v Speaker 1>what can AI not do and what Paul is talking about?

0:03:49.360 --> 0:03:53.320
<v Speaker 1>Identifying whether someone's a shepherd or an insurgent. Identifying targets

0:03:53.320 --> 0:03:56.320
<v Speaker 1>on the battlefield seems to be one of those things, sure,

0:03:56.400 --> 0:03:58.080
<v Speaker 1>But on the other hand, it's important for us to

0:03:58.080 --> 0:04:00.320
<v Speaker 1>ask what is AI good at. You know, good at

0:04:00.320 --> 0:04:03.320
<v Speaker 1>making predictions based on data about what might happen next,

0:04:03.560 --> 0:04:07.280
<v Speaker 1>It's good at seeing patterns. So it makes me think,

0:04:07.320 --> 0:04:10.640
<v Speaker 1>you know that with enough training data about battlefield interactions,

0:04:10.680 --> 0:04:14.600
<v Speaker 1>it could get just as good or better than humans

0:04:14.600 --> 0:04:16.600
<v Speaker 1>at this task. Yeah, and of course we don't have

0:04:16.680 --> 0:04:19.840
<v Speaker 1>the counter effectual to pull story. Sadly, there's probably many

0:04:19.880 --> 0:04:22.359
<v Speaker 1>stories where the army ranger doesn't wait to hear the

0:04:22.360 --> 0:04:25.040
<v Speaker 1>shepherd seeing before deciding what to do and just pulls

0:04:25.040 --> 0:04:28.360
<v Speaker 1>the trigger. And equally, there's probably many sad cases where

0:04:28.440 --> 0:04:30.160
<v Speaker 1>it does turn out to be an insurgent and an

0:04:30.160 --> 0:04:33.000
<v Speaker 1>ambush happens to the soldiers. So just from that story,

0:04:33.040 --> 0:04:35.599
<v Speaker 1>it's not necessarily clear to me that humans are always

0:04:35.680 --> 0:04:38.400
<v Speaker 1>or will always be better than algorithms that identifying targets.

0:04:39.000 --> 0:04:41.159
<v Speaker 1>You know, I do think it raises an important question.

0:04:41.760 --> 0:04:45.240
<v Speaker 1>We are increasingly comfortable outsourcing many parts of our lives

0:04:45.279 --> 0:04:47.159
<v Speaker 1>to technology. You know, who are we going to fall

0:04:47.160 --> 0:04:48.839
<v Speaker 1>in love with? How are we going to get to

0:04:48.880 --> 0:04:51.839
<v Speaker 1>our cousin's house? You know, that's decision making. Though, in

0:04:51.880 --> 0:04:54.680
<v Speaker 1>the world of war, we can also build tools to

0:04:54.720 --> 0:04:57.240
<v Speaker 1>do things that people don't want to do. A lot

0:04:57.240 --> 0:05:00.760
<v Speaker 1>of people have heard about Boston Dynamics. They have this

0:05:01.240 --> 0:05:07.640
<v Speaker 1>extremely terrifying video of this ford legged robodog aptly named Spot,

0:05:07.839 --> 0:05:11.040
<v Speaker 1>you know, that can run across bumpy ground. It can

0:05:11.080 --> 0:05:13.600
<v Speaker 1>go into places that aren't safe for human beings, you know,

0:05:13.680 --> 0:05:16.919
<v Speaker 1>And they've just announced this model with a claw on

0:05:16.960 --> 0:05:19.080
<v Speaker 1>the back of it that can open doors. There are

0:05:19.080 --> 0:05:22.719
<v Speaker 1>so many potential uses for this, from assisting military rates

0:05:23.240 --> 0:05:26.919
<v Speaker 1>to sending Spot into buildings that are unsafe for humans. Yeah, like,

0:05:27.320 --> 0:05:30.159
<v Speaker 1>a whole pack of Spots can actually pull a truck.

0:05:30.200 --> 0:05:32.440
<v Speaker 1>There's a video of it online. Look it up. It's frightening.

0:05:32.680 --> 0:05:36.239
<v Speaker 1>Teamwork is the dream work exactly? But no, like, what's

0:05:36.240 --> 0:05:39.120
<v Speaker 1>going to happen when that comes to the world of

0:05:39.160 --> 0:05:42.600
<v Speaker 1>war and we have packs of robodogs? Well, who knows?

0:05:42.680 --> 0:05:44.880
<v Speaker 1>Right the future is unclear, and that's really the question

0:05:44.920 --> 0:05:49.159
<v Speaker 1>of this episode. How will AI and robotics change the battlefield?

0:05:49.560 --> 0:05:51.479
<v Speaker 1>And how good of an insurance policy is it to

0:05:51.520 --> 0:05:53.960
<v Speaker 1>keep a human in the loop, to have somebody a

0:05:54.040 --> 0:05:57.640
<v Speaker 1>person controlling the pack of spots. We have from Paul

0:05:57.720 --> 0:06:00.000
<v Speaker 1>char at the beginning. He's now the director of Technology,

0:06:00.040 --> 0:06:03.360
<v Speaker 1>g and National Security at a bipartisan think tank called

0:06:03.400 --> 0:06:06.679
<v Speaker 1>the Center for a New American Security. He's recently written

0:06:06.680 --> 0:06:09.359
<v Speaker 1>a book called Army of None, Autonomous Weapons and the

0:06:09.400 --> 0:06:14.440
<v Speaker 1>Future of War. We're moving to a world where machines

0:06:14.480 --> 0:06:16.880
<v Speaker 1>may be making some of the most important decisions on

0:06:16.920 --> 0:06:20.680
<v Speaker 1>the battlefield about who lives and dies. And as Paul's

0:06:20.720 --> 0:06:24.640
<v Speaker 1>experienced in Afghanistan taught him, even elite military training isn't

0:06:24.640 --> 0:06:27.200
<v Speaker 1>always enough to tell who is and isn't likely to

0:06:27.200 --> 0:06:30.640
<v Speaker 1>be a threat. So understandably there's a great worry in

0:06:30.760 --> 0:06:34.680
<v Speaker 1>handing over target identification to a computer, especially as the

0:06:34.680 --> 0:06:37.920
<v Speaker 1>stakes are life and death. And as Paul tells us,

0:06:38.080 --> 0:06:41.800
<v Speaker 1>autonomous weapons are already being produced and sold around the world.

0:06:42.120 --> 0:06:46.120
<v Speaker 1>The best example today of fully autonomous weapon is a

0:06:46.240 --> 0:06:49.360
<v Speaker 1>drone built by Israel called the Harpy Drown and he's

0:06:49.400 --> 0:06:53.320
<v Speaker 1>been sold to a number of countries Turkey, India, China,

0:06:53.480 --> 0:06:57.360
<v Speaker 1>South Korea. It's an anti radar webbon that is lying

0:06:57.360 --> 0:07:00.520
<v Speaker 1>a switch pattern in the sky looking for enemy radars,

0:07:01.040 --> 0:07:03.560
<v Speaker 1>and when it finds one, it can then attack the

0:07:03.640 --> 0:07:07.080
<v Speaker 1>radar within any further human permission. And that processes the

0:07:07.120 --> 0:07:10.880
<v Speaker 1>line to an autonomous weapon that's able to go find

0:07:10.920 --> 0:07:13.640
<v Speaker 1>targets and then attack them all by itself. These are

0:07:13.720 --> 0:07:17.320
<v Speaker 1>not the autonomous killer robots of science fiction, setting their

0:07:17.360 --> 0:07:20.120
<v Speaker 1>own goals and killing it will. We still send them

0:07:20.120 --> 0:07:22.520
<v Speaker 1>into battle and tell them what to look for, but

0:07:22.600 --> 0:07:25.080
<v Speaker 1>we no longer control exactly what they do when they

0:07:25.120 --> 0:07:28.280
<v Speaker 1>get there. So by analogy, you might think about a

0:07:28.280 --> 0:07:31.800
<v Speaker 1>self driving car. Um, there are really degrees of how

0:07:31.920 --> 0:07:34.240
<v Speaker 1>much a car could be self driving. You could have

0:07:34.360 --> 0:07:38.400
<v Speaker 1>some like the Tesla autopilot today, where there's a steering

0:07:38.400 --> 0:07:41.280
<v Speaker 1>wheel and the human could intervene and grab control of

0:07:41.280 --> 0:07:44.320
<v Speaker 1>the vehicle. UM, you might have some like Google self

0:07:44.400 --> 0:07:47.040
<v Speaker 1>driving car that is no steering wheel and a person

0:07:47.200 --> 0:07:50.960
<v Speaker 1>just merely a passenger. But even in a totally self

0:07:51.040 --> 0:07:54.400
<v Speaker 1>driving car, the human is still choosing the destination. You're

0:07:54.400 --> 0:07:56.160
<v Speaker 1>not getting in your car just in car, you know,

0:07:56.200 --> 0:07:58.280
<v Speaker 1>take me where you want to go. So it's some

0:07:58.360 --> 0:08:01.120
<v Speaker 1>level humans are always involved, and it's going to be

0:08:01.120 --> 0:08:03.960
<v Speaker 1>the case in warfare. Um. The question is, you know,

0:08:04.000 --> 0:08:06.880
<v Speaker 1>when do we cross the threshold where the humans have

0:08:06.920 --> 0:08:10.960
<v Speaker 1>transfer control of some important and meaningful decisions two machines,

0:08:11.400 --> 0:08:14.760
<v Speaker 1>and then what are the legal or ethical complications of that.

0:08:15.560 --> 0:08:18.720
<v Speaker 1>It is a hugely important question. In the aftermath of

0:08:18.720 --> 0:08:21.560
<v Speaker 1>the Second World War, a hundred and ninety six countries

0:08:21.600 --> 0:08:25.280
<v Speaker 1>signed up to the Geneva Convention setting standards for behavior

0:08:25.360 --> 0:08:28.640
<v Speaker 1>in battle, But how do we enforce those standards if

0:08:28.680 --> 0:08:32.760
<v Speaker 1>the combatants are machines not people. Beyond having a human

0:08:32.760 --> 0:08:35.160
<v Speaker 1>in the loop, one important piece of the puzzle is

0:08:35.160 --> 0:08:38.560
<v Speaker 1>a healthy testing and review process, a clear understanding of

0:08:38.559 --> 0:08:41.160
<v Speaker 1>how a weapon works and the decisions it will make.

0:08:41.840 --> 0:08:45.840
<v Speaker 1>But according to Richard Danzig, a former secretary of the Navy,

0:08:45.880 --> 0:08:48.840
<v Speaker 1>that's easier said than done. One of the things that

0:08:48.920 --> 0:08:54.280
<v Speaker 1>concerns me is that the technologies are frequently highly classified.

0:08:54.800 --> 0:08:59.040
<v Speaker 1>So we're for self driving cars, we typically require that

0:08:59.160 --> 0:09:03.240
<v Speaker 1>there be millions of miles driven, and we insist that

0:09:03.400 --> 0:09:08.720
<v Speaker 1>external regulators review them for safety. In the military context,

0:09:08.880 --> 0:09:12.560
<v Speaker 1>we don't have millions of miles of experience before combat

0:09:13.320 --> 0:09:17.440
<v Speaker 1>and we don't typically have any kind of third party

0:09:17.520 --> 0:09:20.680
<v Speaker 1>review that says, wait a minute, here, the risks associated

0:09:20.720 --> 0:09:24.199
<v Speaker 1>with this system spinning out of control. We ought to

0:09:24.240 --> 0:09:27.880
<v Speaker 1>be using teams to say, hey, what could go wrong

0:09:27.920 --> 0:09:31.400
<v Speaker 1>if an adversary wants to attack these and subvert them,

0:09:31.640 --> 0:09:34.960
<v Speaker 1>or when they interact with other systems. This kind of

0:09:34.960 --> 0:09:38.360
<v Speaker 1>war gaming is valuable, but the best laid plans and

0:09:38.440 --> 0:09:42.280
<v Speaker 1>standards can crumble in the face of existential threats, real

0:09:42.440 --> 0:09:45.920
<v Speaker 1>or perceived. You only need to think about Hiroshima and

0:09:46.080 --> 0:09:50.480
<v Speaker 1>Nagasaki to understand how quickly restraint can give way to

0:09:50.600 --> 0:09:55.240
<v Speaker 1>the desire for victory his pool Again, as countries feel

0:09:55.240 --> 0:09:57.880
<v Speaker 1>that their national survival might be at stake, they're gonna

0:09:57.880 --> 0:10:00.520
<v Speaker 1>be willing to take more risk put up more experimental weapons.

0:10:00.720 --> 0:10:02.920
<v Speaker 1>The use of poison gas in World War One is

0:10:02.960 --> 0:10:05.600
<v Speaker 1>I think a terrible example of this happening and practice.

0:10:05.679 --> 0:10:07.960
<v Speaker 1>Germany was in a panic to find some kind of

0:10:08.000 --> 0:10:12.040
<v Speaker 1>wonder weapon that might break that stalemate. So a desire

0:10:12.120 --> 0:10:16.080
<v Speaker 1>to get an upper hand will clearly Historically we've seen

0:10:16.200 --> 0:10:19.719
<v Speaker 1>lead militarios to take risks and deploy more experimental technology.

0:10:21.480 --> 0:10:23.439
<v Speaker 1>This is one of the scariest things about war to

0:10:23.559 --> 0:10:27.599
<v Speaker 1>me Kara, particularly war involving new technology, the potential for

0:10:27.679 --> 0:10:32.679
<v Speaker 1>misunderstanding and unintended consequences. Paul mentions the almost accidental use

0:10:32.720 --> 0:10:35.520
<v Speaker 1>of poison gas in World War One, and then there

0:10:35.559 --> 0:10:38.200
<v Speaker 1>was a Cuban missile crisis where we almost stumbled into

0:10:38.200 --> 0:10:40.880
<v Speaker 1>a nuclear war. And all this potential for misunderstanding is

0:10:40.920 --> 0:10:44.000
<v Speaker 1>compounded exponentially in the world of AI because it's not

0:10:44.080 --> 0:10:46.120
<v Speaker 1>just humans who are trying to read each other and

0:10:46.160 --> 0:10:49.600
<v Speaker 1>make decisions. It's algorithms sort of loose in the wild,

0:10:49.960 --> 0:10:53.200
<v Speaker 1>interacting with one another. The Guardian actually had a great

0:10:53.200 --> 0:10:57.000
<v Speaker 1>story about this called Frank and Algorithms, The Deadly Consequences

0:10:57.000 --> 0:10:59.880
<v Speaker 1>of Unpredictable Code, and the article makes the point that

0:11:00.080 --> 0:11:03.560
<v Speaker 1>the stock market flash crash of was actually caused by

0:11:03.600 --> 0:11:07.120
<v Speaker 1>algorithms interacting with one another. You know, it's hard not

0:11:07.200 --> 0:11:09.600
<v Speaker 1>to think that this could happen in the wild, so

0:11:09.679 --> 0:11:11.960
<v Speaker 1>to speak. It's a scary thought, and it's made even

0:11:12.040 --> 0:11:15.600
<v Speaker 1>scarier because there's just so much potential all around for misunderstanding.

0:11:15.840 --> 0:11:19.280
<v Speaker 1>And that's something Richard Danzig is seriously concerned about. When

0:11:19.400 --> 0:11:22.840
<v Speaker 1>we talked about sending a ship on a mission, policy

0:11:22.920 --> 0:11:27.080
<v Speaker 1>makers by and large understand what that means and how

0:11:27.160 --> 0:11:31.280
<v Speaker 1>others will perceive it if the ship comes into their waters.

0:11:31.760 --> 0:11:36.520
<v Speaker 1>Whereas when we start talking about artificial intelligence, policy makers,

0:11:36.559 --> 0:11:38.800
<v Speaker 1>if there are five people in a room, may readily

0:11:38.920 --> 0:11:42.840
<v Speaker 1>envisioned five different things. We need the people making decisions

0:11:42.880 --> 0:11:46.320
<v Speaker 1>to understand both the situations they're dealing with and also

0:11:46.400 --> 0:11:48.920
<v Speaker 1>how the tools they're using actually work. And that's not

0:11:49.000 --> 0:11:51.840
<v Speaker 1>easy when it comes to AI. Part of the issue

0:11:51.960 --> 0:11:55.120
<v Speaker 1>is the so called black box problem. Currently, we understand

0:11:55.160 --> 0:11:58.320
<v Speaker 1>the principles of how a neural network uses probabilities to

0:11:58.360 --> 0:12:01.640
<v Speaker 1>reach a conclusion, but we can't interrogate the millions of

0:12:01.679 --> 0:12:04.720
<v Speaker 1>micro decisions it makes along the way. This is a

0:12:04.840 --> 0:12:09.000
<v Speaker 1>huge barrier to understanding weapons systems powered by AI. I

0:12:09.040 --> 0:12:11.880
<v Speaker 1>wanted to know how the research is developing new military

0:12:11.880 --> 0:12:15.280
<v Speaker 1>technology think about the black box problem. So I spoke

0:12:15.320 --> 0:12:18.560
<v Speaker 1>with Artie Prabaka, the former head of DARPA, the Defense

0:12:18.600 --> 0:12:22.959
<v Speaker 1>Advanced Research Projects Agency, and Arthie shared a story about

0:12:22.960 --> 0:12:26.880
<v Speaker 1>how the black box problem plays out. Many years ago, now,

0:12:26.920 --> 0:12:29.199
<v Speaker 1>there was a wonderful paper from Stanford that showed a

0:12:29.280 --> 0:12:32.400
<v Speaker 1>machine system that could label images. This was a girl

0:12:32.440 --> 0:12:35.440
<v Speaker 1>blowing out the candles on her birthday cake, or a

0:12:35.480 --> 0:12:39.520
<v Speaker 1>construction worker doing something so fairly complex analysis of what

0:12:39.600 --> 0:12:42.000
<v Speaker 1>was going on in this picture, and it would get

0:12:42.200 --> 0:12:43.599
<v Speaker 1>one right, and it would get ten right, and we

0:12:43.720 --> 0:12:45.720
<v Speaker 1>get a hunder right. And then there was a picture

0:12:46.240 --> 0:12:49.200
<v Speaker 1>that every human being would say, that's a baby holding

0:12:49.200 --> 0:12:52.560
<v Speaker 1>an electric truth brush, but the machine said it's a

0:12:52.600 --> 0:12:55.880
<v Speaker 1>small boy holding a baseball bat. And you know, you

0:12:55.920 --> 0:12:58.240
<v Speaker 1>just look at it and you think, what what what?

0:12:58.080 --> 0:13:00.319
<v Speaker 1>What were what were you thinking? And this I think

0:13:00.320 --> 0:13:03.520
<v Speaker 1>it's a great illustration of the black box nature of

0:13:03.559 --> 0:13:07.040
<v Speaker 1>these learning systems because they've been trained on all this

0:13:07.360 --> 0:13:11.280
<v Speaker 1>volume of data, but when you look inside to say, well,

0:13:11.320 --> 0:13:13.480
<v Speaker 1>what went wrong there, you know, you just see a

0:13:13.480 --> 0:13:15.800
<v Speaker 1>bunch of nodes with weights from being trained, and so

0:13:15.960 --> 0:13:20.959
<v Speaker 1>they're really opaque. Offi's example is kind of cute, but

0:13:21.120 --> 0:13:23.960
<v Speaker 1>think about it for a moment. The difference between a

0:13:23.960 --> 0:13:27.560
<v Speaker 1>baby holding an electric toothbrush and a small boy holding

0:13:27.559 --> 0:13:31.840
<v Speaker 1>a baseball bat could also be in Afghanistan, the difference

0:13:31.880 --> 0:13:35.400
<v Speaker 1>between Paul Shepherd and militant, in other words, the difference

0:13:35.400 --> 0:13:38.359
<v Speaker 1>between life and death. Yeah, and it's a bit daunting

0:13:39.160 --> 0:13:42.080
<v Speaker 1>that we are becoming more reliant on something that we

0:13:42.160 --> 0:13:45.959
<v Speaker 1>continue not to understand fully, don't you think absolutely and

0:13:46.120 --> 0:13:47.920
<v Speaker 1>Henry kissing you actually wrote a piece on this for

0:13:47.960 --> 0:13:52.200
<v Speaker 1>the Atlantic called how the Enlightenment Ends Big Stuff for Sure,

0:13:52.200 --> 0:13:56.040
<v Speaker 1>Hetty and what's kissing You? He argued that because we're

0:13:56.120 --> 0:13:59.080
<v Speaker 1>unable to interrogate the output of algorithms, as we rely

0:13:59.120 --> 0:14:01.720
<v Speaker 1>on them more immorti classify the world around us, we

0:14:01.760 --> 0:14:04.400
<v Speaker 1>may actually start to lose the ability to reason for ourselves.

0:14:04.640 --> 0:14:07.680
<v Speaker 1>It's not inevitable though, that AI will always be opaque.

0:14:08.160 --> 0:14:11.439
<v Speaker 1>The EU are actually working on this policy that decisions

0:14:11.440 --> 0:14:14.800
<v Speaker 1>made by AI need to be explainable to people they affect.

0:14:15.320 --> 0:14:17.880
<v Speaker 1>That may be a policy that's easier said than done.

0:14:18.360 --> 0:14:21.720
<v Speaker 1>Although the so called next wave of AI is all

0:14:21.760 --> 0:14:24.880
<v Speaker 1>about explainable AI, and it's actually a major initiative right

0:14:24.880 --> 0:14:29.080
<v Speaker 1>now at DAPPA. Here's off the again. Explainable AI has

0:14:29.120 --> 0:14:32.960
<v Speaker 1>been part of starting an entire new field of inquiry

0:14:33.080 --> 0:14:37.360
<v Speaker 1>and artificial intelligence to couple that kind of statistical power

0:14:37.920 --> 0:14:42.040
<v Speaker 1>that machine learning systems have with systems that explain how

0:14:42.080 --> 0:14:44.480
<v Speaker 1>they got the results that they got. In order for

0:14:44.600 --> 0:14:47.840
<v Speaker 1>us human users to be able to know when to

0:14:47.920 --> 0:14:51.680
<v Speaker 1>trust those machine learning systems and when not to trust them.

0:14:51.760 --> 0:14:55.440
<v Speaker 1>What authe is describing would be a huge breakthrough in AI.

0:14:55.680 --> 0:14:58.960
<v Speaker 1>Understanding how neural networks make their decisions would allow us

0:14:59.000 --> 0:15:02.480
<v Speaker 1>to honess the power the technology much more safely, and

0:15:02.560 --> 0:15:06.000
<v Speaker 1>not just on the battlefield. When we come back, we

0:15:06.000 --> 0:15:07.840
<v Speaker 1>look at how much of the technology we take for

0:15:07.880 --> 0:15:11.520
<v Speaker 1>granted in our everyday lives actually originated in the military.

0:15:17.800 --> 0:15:21.360
<v Speaker 1>So DARPA, the defense agency with an annual budget of

0:15:21.440 --> 0:15:25.840
<v Speaker 1>three point five billion dollars, its motto is to cast

0:15:25.880 --> 0:15:29.720
<v Speaker 1>a javelin into the infinite spaces of the future. What

0:15:29.840 --> 0:15:32.000
<v Speaker 1>you may not know is how much of the technology

0:15:32.040 --> 0:15:35.400
<v Speaker 1>we all use every day came right out of Darper.

0:15:36.560 --> 0:15:39.040
<v Speaker 1>I think about this every time I use my smartphone

0:15:39.080 --> 0:15:43.880
<v Speaker 1>because that's a beautiful, seamless integration of a whole host

0:15:43.960 --> 0:15:48.440
<v Speaker 1>of technologies that were sparked many many years ago by Darper.

0:15:48.560 --> 0:15:51.200
<v Speaker 1>So the chip in your cell phone that talks to

0:15:52.000 --> 0:15:56.520
<v Speaker 1>the cell tower is based on materials and electronics technology

0:15:56.560 --> 0:16:00.240
<v Speaker 1>that was developed for communications, and radar systems that up

0:16:00.240 --> 0:16:03.600
<v Speaker 1>that knows when you've rotated your phone is MEM's technology

0:16:03.640 --> 0:16:07.880
<v Speaker 1>that had huge early support from DARPA. But also Series

0:16:07.960 --> 0:16:12.040
<v Speaker 1>or other intelligent agents are based on the artificial intelligence

0:16:12.080 --> 0:16:15.160
<v Speaker 1>research that was done. But what fueled this wave of

0:16:15.240 --> 0:16:22.240
<v Speaker 1>incredible innovation at DAPPA. Well, actually, war DARPA is a

0:16:22.360 --> 0:16:27.480
<v Speaker 1>very American concept. In nineteen fifty seven, the Soviet Union

0:16:27.640 --> 0:16:30.760
<v Speaker 1>put the first artificial satellite on orbit. That was Sputnik.

0:16:31.200 --> 0:16:33.360
<v Speaker 1>There was a lot of excitement because human beings had

0:16:33.360 --> 0:16:36.400
<v Speaker 1>never done that before, but of course also quite a

0:16:36.480 --> 0:16:38.480
<v Speaker 1>shock for the United States at the height of the

0:16:38.520 --> 0:16:42.120
<v Speaker 1>CULD WARP. Sputnik was a reminder that in addition to

0:16:42.200 --> 0:16:45.040
<v Speaker 1>working on the problems that you knew you had, you

0:16:45.240 --> 0:16:47.840
<v Speaker 1>also needed to have people who came to work every

0:16:47.920 --> 0:16:51.760
<v Speaker 1>day to think about those kinds of technological surprises. And

0:16:51.840 --> 0:16:56.040
<v Speaker 1>so DARPA was started as a reaction to that technological

0:16:56.040 --> 0:16:59.960
<v Speaker 1>surprise of Sputnik. It's mission for sixty years has been

0:17:00.120 --> 0:17:05.080
<v Speaker 1>to create those kinds of technological surprises, and its history

0:17:05.400 --> 0:17:09.080
<v Speaker 1>is one in which it's accomplished that mission. DARPA is

0:17:09.640 --> 0:17:13.119
<v Speaker 1>known as the place that made the early stages of

0:17:13.320 --> 0:17:17.879
<v Speaker 1>each revolution and artificial intelligence, and of course must memorably

0:17:17.960 --> 0:17:21.280
<v Speaker 1>for starting the ARPA net and writing the protocols that

0:17:21.359 --> 0:17:24.880
<v Speaker 1>became the Internet that we have today. Think about that

0:17:25.359 --> 0:17:28.560
<v Speaker 1>the technology that forms the architecture of our daily lives.

0:17:28.560 --> 0:17:32.040
<v Speaker 1>In the twenty one century, the Internet was created by

0:17:32.040 --> 0:17:35.760
<v Speaker 1>a defense agency whose mission was to outthink the Soviet Union,

0:17:36.600 --> 0:17:39.000
<v Speaker 1>and in some sense all of the technologies we've looked

0:17:39.040 --> 0:17:42.600
<v Speaker 1>at so far in Sleepwalkers are the outgrowth of Dapper's work.

0:17:43.520 --> 0:17:46.760
<v Speaker 1>What really enabled this was DARPA's decision to allow their

0:17:46.760 --> 0:17:50.520
<v Speaker 1>technology into the US private sector and to let entrepreneurs

0:17:50.560 --> 0:17:55.679
<v Speaker 1>build on top of it. Absolutely as vital was that

0:17:56.040 --> 0:17:59.480
<v Speaker 1>were the companies and the entrepreneurs and the investors who

0:17:59.520 --> 0:18:03.440
<v Speaker 1>saw that you could turn those those raw research results

0:18:03.560 --> 0:18:07.640
<v Speaker 1>into this seamless, beautiful product that we've now we all

0:18:07.680 --> 0:18:10.959
<v Speaker 1>live with all the time. Characters. Amazing to think just

0:18:11.040 --> 0:18:13.600
<v Speaker 1>how much a Silicon Valley really stands on the shoulders

0:18:13.600 --> 0:18:16.399
<v Speaker 1>of DARPA. But even outside of what we think of

0:18:16.480 --> 0:18:19.240
<v Speaker 1>as the tech world, there's plenty of examples of military

0:18:19.320 --> 0:18:22.879
<v Speaker 1>technology living with us. For example, microwaves, which were an

0:18:22.920 --> 0:18:26.800
<v Speaker 1>accidental byproduct of radar technology, and then as good old Rumba,

0:18:26.880 --> 0:18:30.280
<v Speaker 1>which was originally developed a mind sweeping technology and is

0:18:30.280 --> 0:18:34.760
<v Speaker 1>still a mind sweeping technology in my house. Um. Yeah,

0:18:34.840 --> 0:18:37.520
<v Speaker 1>you know. There's this concept of dual use technology, which

0:18:37.560 --> 0:18:40.639
<v Speaker 1>we've talked about a few times. It's the idea that

0:18:40.720 --> 0:18:44.120
<v Speaker 1>technology developed for the military can have civilian applications and

0:18:44.200 --> 0:18:46.840
<v Speaker 1>vice versa. We talked about this with blink identity and

0:18:46.880 --> 0:18:51.359
<v Speaker 1>facial recognition. Do you remember last year the project may

0:18:51.359 --> 0:18:54.080
<v Speaker 1>even walk out? Yeah, Google, right, So that was a

0:18:54.080 --> 0:18:57.359
<v Speaker 1>project for the Pentagon. Over three thousand employees protested that

0:18:57.400 --> 0:19:00.720
<v Speaker 1>they didn't want to develop that technology. Google pulled the

0:19:00.760 --> 0:19:03.720
<v Speaker 1>plug on the project. The problem is though that you know,

0:19:03.800 --> 0:19:06.880
<v Speaker 1>you can say you're developing you know, AI and target

0:19:06.880 --> 0:19:09.920
<v Speaker 1>recognition for the military. All you can say you're developing

0:19:10.000 --> 0:19:13.199
<v Speaker 1>AI to recognize what's happening in images. But it's the

0:19:13.200 --> 0:19:16.080
<v Speaker 1>same technology and once it gets into the wild, anyone

0:19:16.119 --> 0:19:18.440
<v Speaker 1>who wants can use it. And that's actually something that

0:19:18.520 --> 0:19:22.720
<v Speaker 1>Arthur you spoke about about innovation traveling from DARPA to

0:19:22.760 --> 0:19:25.520
<v Speaker 1>the private sector. Yeah, and now DARPA actually has this

0:19:25.640 --> 0:19:29.679
<v Speaker 1>younger sibling called the Defense Innovation Unit d i u X,

0:19:30.160 --> 0:19:33.280
<v Speaker 1>whose job is actually to invest and incubate technologies from

0:19:33.280 --> 0:19:36.600
<v Speaker 1>the private sector that could be helpful for defense. So

0:19:36.760 --> 0:19:39.720
<v Speaker 1>this is basically the bridge from Silicon Valley to d C,

0:19:40.320 --> 0:19:43.960
<v Speaker 1>which is taking things from the consumer space and applying

0:19:44.040 --> 0:19:46.919
<v Speaker 1>them for military use. And one of these technologies is

0:19:46.920 --> 0:19:50.800
<v Speaker 1>called Halo. They're basically headphones that electrify your brain in

0:19:50.880 --> 0:19:55.240
<v Speaker 1>order to stimulate growth. That's right. So I went to

0:19:55.280 --> 0:19:58.600
<v Speaker 1>Connecticut to test them out with former Navy Seal John Wilson,

0:19:59.760 --> 0:20:02.680
<v Speaker 1>OH a seal for twelve years. I've served in Iraq

0:20:03.080 --> 0:20:08.240
<v Speaker 1>multiple times, Afghanistan, I went to Mogadishue, and then South America.

0:20:08.480 --> 0:20:10.920
<v Speaker 1>As you can imagine, drug warfare is still a really

0:20:10.960 --> 0:20:13.520
<v Speaker 1>big issue, so we have military units down there to

0:20:13.880 --> 0:20:16.600
<v Speaker 1>combat the cartels. We were gone three hundred days out

0:20:16.600 --> 0:20:19.080
<v Speaker 1>of the year training and then we were deployed from

0:20:19.080 --> 0:20:23.080
<v Speaker 1>once on end. So that's what we lived, breathed day

0:20:23.080 --> 0:20:24.800
<v Speaker 1>in and day out. We weren't going home at night.

0:20:25.440 --> 0:20:28.000
<v Speaker 1>These days, John is back with his family and he's

0:20:28.080 --> 0:20:31.480
<v Speaker 1>especially interested in how new technology can help seals past

0:20:31.520 --> 0:20:35.520
<v Speaker 1>and present. One such technology is the Halo headset, which

0:20:35.600 --> 0:20:38.520
<v Speaker 1>d I u X invested in. The headset uses an

0:20:38.520 --> 0:20:42.720
<v Speaker 1>electric current to prime the brain for so called neuroplasticity,

0:20:42.760 --> 0:20:45.960
<v Speaker 1>in other words, the ability to learn and learn quickly.

0:20:46.400 --> 0:20:49.160
<v Speaker 1>For us, I've recognized and when we do a pistol draw,

0:20:49.359 --> 0:20:52.600
<v Speaker 1>that movement is a repetitive movement that we've done thousands

0:20:52.640 --> 0:20:55.280
<v Speaker 1>and thousands and thousands of times over and over again.

0:20:55.520 --> 0:20:58.040
<v Speaker 1>And what this does is it primes the brain to

0:20:58.200 --> 0:21:01.440
<v Speaker 1>learn those repetitive movements faster? And have you genuinely knows

0:21:01.520 --> 0:21:04.680
<v Speaker 1>the difference. When I first came across this, I've got

0:21:04.680 --> 0:21:06.480
<v Speaker 1>a bunch of seals together and went out to the range.

0:21:06.520 --> 0:21:09.080
<v Speaker 1>We neuro primed and we started shooting. So we got

0:21:09.119 --> 0:21:11.639
<v Speaker 1>the baseline. Did this for a month, looked at our

0:21:11.680 --> 0:21:15.000
<v Speaker 1>scores and our scores were light years better. And light

0:21:15.080 --> 0:21:17.840
<v Speaker 1>years I mean milliseconds, right, But milliseconds on the battlefield

0:21:17.840 --> 0:21:20.720
<v Speaker 1>equates the life or death. I may be as far

0:21:20.760 --> 0:21:23.679
<v Speaker 1>away from being a military person as anyone could be,

0:21:24.200 --> 0:21:26.240
<v Speaker 1>but John has kindly agreed to lead me through a

0:21:26.359 --> 0:21:29.200
<v Speaker 1>Navy seal workout. So what we have here it looks

0:21:29.200 --> 0:21:33.160
<v Speaker 1>like a beats headset right with some strange noduals. Yeah,

0:21:33.560 --> 0:21:35.760
<v Speaker 1>so what we have on the top has mentioned were

0:21:35.800 --> 0:21:38.679
<v Speaker 1>these little nods. What those do? Or those are going

0:21:38.760 --> 0:21:42.640
<v Speaker 1>to send a current into the cortex or frontal cortex

0:21:42.680 --> 0:21:46.000
<v Speaker 1>into your brain? Is that safe? That's a great question.

0:21:47.000 --> 0:21:51.000
<v Speaker 1>I'm gonna bypass that question. It's safe. Turns out it

0:21:51.080 --> 0:21:53.680
<v Speaker 1>is safe. It's been tested by Dapper and others. So

0:21:54.080 --> 0:21:56.240
<v Speaker 1>I had to put it on and John agreed to

0:21:56.240 --> 0:21:59.320
<v Speaker 1>help me use the headset to neuro prime before putting

0:21:59.320 --> 0:22:01.879
<v Speaker 1>me through my pace is all right, let's let's crank

0:22:01.880 --> 0:22:04.160
<v Speaker 1>it up so you can. So it's probably a good

0:22:04.400 --> 0:22:05.800
<v Speaker 1>I don't know if you can feel a difference there,

0:22:05.800 --> 0:22:07.879
<v Speaker 1>but we've got twenty minutes of neuro priming. It feels

0:22:07.880 --> 0:22:10.439
<v Speaker 1>like something pinching in my head a bit. Yeah, it's not.

0:22:10.600 --> 0:22:13.960
<v Speaker 1>It's not a comfortable feeling, right, yeah, and you imagine, no,

0:22:14.080 --> 0:22:17.159
<v Speaker 1>you never do. But it's worth it, right, What is

0:22:17.160 --> 0:22:20.720
<v Speaker 1>that uncomfortable sensation? What's happening that? That's electricity? Yea, so

0:22:20.800 --> 0:22:23.320
<v Speaker 1>it's it's going into your brain right now, and it's

0:22:23.320 --> 0:22:26.680
<v Speaker 1>getting your brain into a state of neuroplasicity. Hyper Learning,

0:22:26.800 --> 0:22:28.879
<v Speaker 1>essentially is what that state allows you to do, and

0:22:28.880 --> 0:22:32.119
<v Speaker 1>it just allows you to learn faster and learn more information.

0:22:32.800 --> 0:22:35.199
<v Speaker 1>After a warm up, which was in fact a lot

0:22:35.280 --> 0:22:39.719
<v Speaker 1>more intense than my normal workout, two three, come on up,

0:22:39.880 --> 0:22:44.760
<v Speaker 1>drive up and hold right still the warm up, Yes,

0:22:44.760 --> 0:22:46.760
<v Speaker 1>it's still the warm up, it was time to take

0:22:46.800 --> 0:22:50.119
<v Speaker 1>the headset off and start the real thing. Or so

0:22:50.200 --> 0:22:58.399
<v Speaker 1>I thought, all right, it's already to keep going. You

0:22:58.400 --> 0:23:08.200
<v Speaker 1>can do twenty reps. So oh my god, oh god, ah,

0:23:09.280 --> 0:23:15.080
<v Speaker 1>those people's not do what hell weeks like I thinks

0:23:15.160 --> 0:23:24.639
<v Speaker 1>be worse than this. Yeah, why do you ask? John? Thankfully,

0:23:24.760 --> 0:23:28.200
<v Speaker 1>the workout came to an end and without any injury. Though,

0:23:28.240 --> 0:23:30.640
<v Speaker 1>to be honest, I couldn't tell if the neuropriming had

0:23:30.680 --> 0:23:34.280
<v Speaker 1>worked for me. Because halo enhances the brain's ability to learn,

0:23:34.640 --> 0:23:37.439
<v Speaker 1>Studies show best results when it's used over time. In

0:23:37.480 --> 0:23:40.240
<v Speaker 1>other words, if I wore the headset before every workout,

0:23:40.560 --> 0:23:42.840
<v Speaker 1>I might start to notice the difference in how quickly

0:23:42.880 --> 0:23:46.359
<v Speaker 1>I performed. But somehow I trusted John talking about the

0:23:46.440 --> 0:23:51.040
<v Speaker 1>draw time for his weapons. So the battle feels Afghanistan

0:23:51.840 --> 0:23:58.119
<v Speaker 1>rugs Syria. It's my happy place. Yeah, who can understand that?

0:23:58.760 --> 0:24:01.639
<v Speaker 1>It's my happy place because around people that I know

0:24:01.640 --> 0:24:03.320
<v Speaker 1>would do anything for me that I love me and

0:24:03.320 --> 0:24:07.200
<v Speaker 1>I love them for John. Being on the battlefield wasn't

0:24:07.200 --> 0:24:11.679
<v Speaker 1>the hardest part leaving. It was transition and is not

0:24:11.760 --> 0:24:13.880
<v Speaker 1>an easy thing. It's the hardest thing I've ever done.

0:24:14.320 --> 0:24:17.160
<v Speaker 1>When we transition, we do it by ourselves. We're trying

0:24:17.160 --> 0:24:19.600
<v Speaker 1>to solve a complex problem, which we love to do.

0:24:19.800 --> 0:24:22.560
<v Speaker 1>But normally when that takes place, you have your team

0:24:22.600 --> 0:24:24.920
<v Speaker 1>around you and you're going to figure it out because

0:24:25.000 --> 0:24:26.520
<v Speaker 1>you know you'll never let the person the left and

0:24:26.600 --> 0:24:28.560
<v Speaker 1>right of you down. When you're trying to do this

0:24:28.600 --> 0:24:30.439
<v Speaker 1>by yourself, you have nobody to talk to. When it

0:24:30.480 --> 0:24:32.439
<v Speaker 1>starts getting heart and you go dark is what we

0:24:32.480 --> 0:24:34.639
<v Speaker 1>call us. So we go into our shell. We we

0:24:34.720 --> 0:24:37.840
<v Speaker 1>kind of ostracize ourselves from society and and that's when

0:24:38.080 --> 0:24:42.240
<v Speaker 1>bad stuff starts happening. John recools a recent narrow escape

0:24:42.480 --> 0:24:46.000
<v Speaker 1>for one of his Sealed comrades. He was a Seal

0:24:46.040 --> 0:24:49.720
<v Speaker 1>Team six guy and um ended up going through divorce.

0:24:50.200 --> 0:24:52.280
<v Speaker 1>He had a newborn that he had to stay home

0:24:52.280 --> 0:24:54.240
<v Speaker 1>and take care of, so he went to a really

0:24:54.359 --> 0:24:56.439
<v Speaker 1>dark place. He just called me in unbeknownst to me,

0:24:56.520 --> 0:24:57.760
<v Speaker 1>it just put his son to bed and he was

0:24:57.760 --> 0:24:59.919
<v Speaker 1>sitting in the car with a pistol. I didn't know that.

0:25:00.800 --> 0:25:02.639
<v Speaker 1>I'm just picked up the phone and asked him how

0:25:02.720 --> 0:25:05.720
<v Speaker 1>he was doing, and he said he's doing okay, but

0:25:05.760 --> 0:25:07.880
<v Speaker 1>he needs some help. I said, we got your brother,

0:25:07.920 --> 0:25:10.239
<v Speaker 1>That's all I said. And that was enough for him

0:25:10.280 --> 0:25:12.240
<v Speaker 1>to put that gun away, go back inside and take

0:25:12.280 --> 0:25:14.280
<v Speaker 1>care of that little guy. Just me saying we got you.

0:25:15.800 --> 0:25:20.119
<v Speaker 1>That camaraderie saved John's friends life, but returning veterans need

0:25:20.200 --> 0:25:23.880
<v Speaker 1>something more than community. They need a purpose, a mission,

0:25:24.320 --> 0:25:26.520
<v Speaker 1>and that can be hard to find in civilian life.

0:25:26.880 --> 0:25:28.359
<v Speaker 1>You don't know you're fit, you don't know your rule

0:25:28.400 --> 0:25:30.520
<v Speaker 1>in the family, in your tribe, you don't know your

0:25:30.560 --> 0:25:33.120
<v Speaker 1>rule in society, and you're just trying to get by

0:25:33.160 --> 0:25:34.840
<v Speaker 1>to put food on the table. And there's there's a

0:25:34.880 --> 0:25:38.879
<v Speaker 1>void there now. And according to John, that's where Halo

0:25:39.000 --> 0:25:41.120
<v Speaker 1>comes in. Just because we're steals doesn't mean we all

0:25:41.119 --> 0:25:43.800
<v Speaker 1>want to end up doing security work. There's a lot

0:25:43.800 --> 0:25:45.600
<v Speaker 1>of people that wanted to maybe go in to finance

0:25:45.720 --> 0:25:49.199
<v Speaker 1>or be a lawyer. Halo allows us to succeed and

0:25:49.280 --> 0:25:52.080
<v Speaker 1>accelerate at that process. So if it's people want to

0:25:52.160 --> 0:25:54.960
<v Speaker 1>go back to school putting a Halo headset on before

0:25:54.960 --> 0:25:58.480
<v Speaker 1>you study, people maybe wanting to get a job that

0:25:58.520 --> 0:26:02.080
<v Speaker 1>requires multiple languages, you can throw on the halo and

0:26:02.080 --> 0:26:04.760
<v Speaker 1>pick up those language at an accelerated pace. Do you

0:26:04.800 --> 0:26:08.320
<v Speaker 1>think it's more powerful as something to believe in, like

0:26:08.359 --> 0:26:10.679
<v Speaker 1>if I put this headset on, like achieve my goals?

0:26:11.520 --> 0:26:13.760
<v Speaker 1>Is more powerful? Is a technological solution or is it

0:26:13.800 --> 0:26:16.760
<v Speaker 1>somewhere in between those two things? I think it's probably

0:26:16.760 --> 0:26:19.800
<v Speaker 1>both right. So our Strength and Conditioning coach and the

0:26:19.800 --> 0:26:22.800
<v Speaker 1>steel teams. He had a bottle p E is what

0:26:22.920 --> 0:26:26.359
<v Speaker 1>he wrote on it, which stood for placebo effect. It

0:26:26.480 --> 0:26:28.960
<v Speaker 1>was just water, but guys would come over and saying

0:26:29.000 --> 0:26:30.520
<v Speaker 1>their herd and he would just spare a little bit

0:26:30.560 --> 0:26:33.440
<v Speaker 1>of this water on them and they would every single

0:26:33.480 --> 0:26:35.680
<v Speaker 1>time would walk away like, oh I feel better, thanks, coach.

0:26:35.960 --> 0:26:38.080
<v Speaker 1>My point is is the research their supports that this

0:26:38.119 --> 0:26:40.880
<v Speaker 1>actually works. But who gives a ship even if it didn't,

0:26:40.880 --> 0:26:43.760
<v Speaker 1>because people are going to believe in themselves and that's part.

0:26:43.840 --> 0:26:46.080
<v Speaker 1>That's the bottle of my opinion. If it takes a

0:26:46.160 --> 0:26:48.040
<v Speaker 1>headset to get there, then great, but we know that

0:26:48.080 --> 0:26:50.720
<v Speaker 1>this headset works is going to help accelerate you atue

0:26:50.720 --> 0:26:54.520
<v Speaker 1>in that goal. We've talked about dual use in terms

0:26:54.560 --> 0:26:58.080
<v Speaker 1>of military technology that enters the civilian world and vice versa,

0:26:58.680 --> 0:27:01.560
<v Speaker 1>and Halo is just that a consumer product that is

0:27:01.600 --> 0:27:04.480
<v Speaker 1>also used by the armed forces, but it has a

0:27:04.560 --> 0:27:08.560
<v Speaker 1>much more profound dual use. It can save soldiers lives twice,

0:27:09.160 --> 0:27:12.000
<v Speaker 1>the first time on the battlefield where shaving milliseconds of

0:27:12.119 --> 0:27:15.800
<v Speaker 1>reaction time coming the difference between life and death, and

0:27:15.880 --> 0:27:19.159
<v Speaker 1>the second time when they return home. Haylo can help

0:27:19.200 --> 0:27:22.800
<v Speaker 1>them develop new skills and perhaps even more importantly, give

0:27:22.840 --> 0:27:25.600
<v Speaker 1>them the hope they need to keep going. When we

0:27:25.640 --> 0:27:28.320
<v Speaker 1>come back, we return to Darper and how to ensure

0:27:28.320 --> 0:27:32.000
<v Speaker 1>that we design new military technologies with worst case scenarios

0:27:32.119 --> 0:27:44.120
<v Speaker 1>top of mind. One of the central contentions of Sleepwalkers

0:27:44.200 --> 0:27:47.520
<v Speaker 1>is that our creations reflect us, and knowing this, we

0:27:47.560 --> 0:27:49.720
<v Speaker 1>need to be deliberate about how we tell them to

0:27:49.760 --> 0:27:53.400
<v Speaker 1>behave We're talking episode three of this series, The Watchman

0:27:53.560 --> 0:27:57.240
<v Speaker 1>about automation bias, the very human habit of treating the

0:27:57.240 --> 0:28:01.119
<v Speaker 1>output of computers as infallible even while ignoring the inputs

0:28:01.200 --> 0:28:04.399
<v Speaker 1>that we've given them. And recognizing this, Arthur made it

0:28:04.400 --> 0:28:07.240
<v Speaker 1>a central tenet of her tenure at Dapper to argue

0:28:07.280 --> 0:28:13.840
<v Speaker 1>that technology is not inevitable. There's a tendency to give

0:28:13.920 --> 0:28:16.800
<v Speaker 1>the active role to the technology. It's what the AI

0:28:16.920 --> 0:28:20.480
<v Speaker 1>will do to us. I want to keep bringing us

0:28:20.480 --> 0:28:24.440
<v Speaker 1>back to the fact that these technologies are our creations.

0:28:24.560 --> 0:28:28.440
<v Speaker 1>They're built by human beings. We have this enormous privilege

0:28:28.480 --> 0:28:31.080
<v Speaker 1>that we get to work on the powerful technologies that

0:28:31.119 --> 0:28:35.919
<v Speaker 1>can shape the progress of our societies. That privilege comes

0:28:36.040 --> 0:28:39.840
<v Speaker 1>with a responsibility to ask what could possibly go wrong?

0:28:40.600 --> 0:28:44.239
<v Speaker 1>What could possibly go wrong? It's a legitimate question, but

0:28:44.320 --> 0:28:48.200
<v Speaker 1>there's also a reason it's become a meme. It's notoriously

0:28:48.200 --> 0:28:51.800
<v Speaker 1>hard to answer. This is especially true in times of war,

0:28:52.240 --> 0:28:55.680
<v Speaker 1>when new technologies are often rushed into action without being

0:28:55.680 --> 0:29:00.760
<v Speaker 1>fully understood. Here's poor Shari again. Old War one is

0:29:00.840 --> 0:29:04.840
<v Speaker 1>a a wonderful, a terrible, um example of what can

0:29:04.880 --> 0:29:10.440
<v Speaker 1>happen when we see new technologies change warfare in ways

0:29:10.680 --> 0:29:14.280
<v Speaker 1>that policymakers were not prepared for. You know, the Industrial

0:29:14.280 --> 0:29:18.560
<v Speaker 1>Revolution brought not just you know, locomotives, but also um,

0:29:18.600 --> 0:29:23.080
<v Speaker 1>you know, cars, tanks, airplanes, machine guns that then were

0:29:23.200 --> 0:29:27.000
<v Speaker 1>used to industrialized warfare in a totally new way that

0:29:27.160 --> 0:29:30.920
<v Speaker 1>dramatically change this scale and the speed of killing that

0:29:31.000 --> 0:29:34.520
<v Speaker 1>was possible. The Gatling gun. People still had to crank

0:29:34.640 --> 0:29:37.960
<v Speaker 1>the gun, but then it automated the process of loading

0:29:37.960 --> 0:29:41.120
<v Speaker 1>and firing bullets. We began this episode talking about the

0:29:41.200 --> 0:29:45.560
<v Speaker 1>new dangers posed by automated weapons. Well, the Gatling gun

0:29:45.680 --> 0:29:48.440
<v Speaker 1>was actually one of the world's first, and as Paul

0:29:48.520 --> 0:29:51.400
<v Speaker 1>told us, its invention had a ripple effect that its

0:29:51.440 --> 0:29:55.800
<v Speaker 1>inventor could not have foreseen. The inventor, Richard Gatling, did

0:29:55.880 --> 0:29:59.960
<v Speaker 1>this to save lives. He was looking at um people

0:30:00.000 --> 0:30:03.360
<v Speaker 1>were coming back wounded and killed from the American Civil War.

0:30:03.840 --> 0:30:06.120
<v Speaker 1>He wanted to build a machine that could reduce the

0:30:06.200 --> 0:30:09.479
<v Speaker 1>number of soldiers that were needed on the battlefield as

0:30:09.480 --> 0:30:12.040
<v Speaker 1>a way to save lives. And that sounds like, you know,

0:30:12.080 --> 0:30:16.400
<v Speaker 1>a very well meaning idea and in practice, um as

0:30:16.400 --> 0:30:19.000
<v Speaker 1>the Gatlin gun involved into the machine gun. In World

0:30:19.000 --> 0:30:21.600
<v Speaker 1>War One, we saw a scale of killing that was

0:30:21.640 --> 0:30:25.160
<v Speaker 1>just unprecedented and in a whole a whole generation of

0:30:25.240 --> 0:30:29.560
<v Speaker 1>European man wiped out a battlefield. And so I think

0:30:29.560 --> 0:30:32.240
<v Speaker 1>it's it's an important cautionary tale for our ability to

0:30:32.320 --> 0:30:36.200
<v Speaker 1>predict how this technology will be used. The name of

0:30:36.200 --> 0:30:41.200
<v Speaker 1>this podcast, Sleepwalkers, is borrowed from a book called The Sleepwalkers,

0:30:41.200 --> 0:30:44.239
<v Speaker 1>How Europe Went to War in nineteen fourteen, written by

0:30:44.280 --> 0:30:47.160
<v Speaker 1>the historian Christopher Clark. And one of the big questions

0:30:47.200 --> 0:30:49.880
<v Speaker 1>I've been asking is, are we had a moment like

0:30:50.080 --> 0:30:52.520
<v Speaker 1>we were on the eve of World War One when

0:30:52.560 --> 0:30:56.000
<v Speaker 1>we haven't fully understood the implications of our new technology.

0:30:56.680 --> 0:31:00.440
<v Speaker 1>I asked Richard Danzig, the former Navy secretary, about the anels.

0:31:01.440 --> 0:31:05.520
<v Speaker 1>There is an analogy from World War One. European military

0:31:05.720 --> 0:31:11.040
<v Speaker 1>leaders developed mobilization plans to increase their own capabilities in

0:31:11.120 --> 0:31:16.120
<v Speaker 1>the event of an attack, and they underestimated the degree

0:31:16.160 --> 0:31:20.400
<v Speaker 1>to which that created rigidities and interactions, so that in

0:31:20.440 --> 0:31:25.160
<v Speaker 1>the end, the railroad timetables generated a war that perhaps

0:31:25.240 --> 0:31:28.840
<v Speaker 1>no one intended to be engaged in. People think that

0:31:28.880 --> 0:31:34.640
<v Speaker 1>they're driving the card, and in reality, the horses of

0:31:34.720 --> 0:31:38.720
<v Speaker 1>technology are frequently pulling us in directions that we don't

0:31:38.720 --> 0:31:43.400
<v Speaker 1>anticipate and can't control. So are we better place now

0:31:43.520 --> 0:31:46.680
<v Speaker 1>to understand the implications of AI and new technology for

0:31:46.760 --> 0:31:51.640
<v Speaker 1>global conflict than Europe was in ur I don't believe

0:31:51.640 --> 0:31:55.760
<v Speaker 1>our understanding of AI is greater than their understanding At

0:31:55.800 --> 0:31:59.720
<v Speaker 1>that point, we will make these mistakes too. I cannot

0:31:59.760 --> 0:32:03.080
<v Speaker 1>ask to make their significance or their frequency, but I'm

0:32:03.160 --> 0:32:07.440
<v Speaker 1>rather confident we will lose control, that we will make

0:32:07.520 --> 0:32:12.960
<v Speaker 1>mistakes of that kind and cause unintended consequences. So to me,

0:32:13.120 --> 0:32:18.600
<v Speaker 1>the interesting question is not can I predict their frequency?

0:32:18.840 --> 0:32:22.400
<v Speaker 1>The interesting question is what can I do in advance

0:32:22.560 --> 0:32:25.360
<v Speaker 1>if I recognize that it's one of them. Is well

0:32:25.400 --> 0:32:30.920
<v Speaker 1>represented by the darkast Safe Chaine project that government agency

0:32:31.200 --> 0:32:34.840
<v Speaker 1>is saying if people edit genes, but it turns out

0:32:34.880 --> 0:32:39.200
<v Speaker 1>they escape into the environment and proliferate. How do we

0:32:39.840 --> 0:32:42.560
<v Speaker 1>program them to begin with so that we can shut

0:32:42.600 --> 0:32:46.000
<v Speaker 1>them off? When it's so difficult to predict how new

0:32:46.000 --> 0:32:50.120
<v Speaker 1>technologies will be used and misused, it's hugely important that

0:32:50.160 --> 0:32:53.720
<v Speaker 1>we build precautions while they're still being researched and developed.

0:32:54.200 --> 0:32:56.120
<v Speaker 1>Is difficult, but we have to do our best to

0:32:56.160 --> 0:33:00.400
<v Speaker 1>anticipate the future dangers of a technology long before potential

0:33:00.480 --> 0:33:05.200
<v Speaker 1>deployment on the battlefield. Thankfully, that philosophy governed Arthur Prabaka's

0:33:05.240 --> 0:33:08.640
<v Speaker 1>work at DAPPER. What we developed was a way of

0:33:09.000 --> 0:33:12.920
<v Speaker 1>grappling with the ethical implications of these technologies. It started

0:33:13.280 --> 0:33:16.640
<v Speaker 1>by being open with ourselves, not just about our hopes

0:33:16.680 --> 0:33:20.200
<v Speaker 1>for the technology, but also our fears, and looking at

0:33:20.200 --> 0:33:22.080
<v Speaker 1>each other in the eye and saying, here's what we

0:33:22.160 --> 0:33:25.360
<v Speaker 1>think really is possible, but also here's what could really

0:33:25.400 --> 0:33:28.360
<v Speaker 1>go wrong. Were there any specific programs that you were

0:33:29.320 --> 0:33:32.360
<v Speaker 1>tempted by as a technologist, but in the end you

0:33:32.400 --> 0:33:35.600
<v Speaker 1>had to kill because they didn't meet your ethical standards.

0:33:36.120 --> 0:33:38.640
<v Speaker 1>I don't really have anything to say about that. The

0:33:38.640 --> 0:33:40.680
<v Speaker 1>answer is yes, but I can't give you an example

0:33:40.720 --> 0:33:44.680
<v Speaker 1>because it was classified. Karen, we've talked about the design

0:33:44.800 --> 0:33:47.680
<v Speaker 1>phase and thinking from r and d onwards about making

0:33:47.680 --> 0:33:50.960
<v Speaker 1>new weapons system safe. But it doesn't always work out

0:33:51.000 --> 0:33:53.200
<v Speaker 1>that way. Yeah, the genie does have a habit of

0:33:53.200 --> 0:33:56.280
<v Speaker 1>getting out of the bottle. Um. We've talked about dual

0:33:56.360 --> 0:34:01.320
<v Speaker 1>use before. Even seemingly benign technologies can be hugely destructive.

0:34:02.040 --> 0:34:03.560
<v Speaker 1>The one that blows my mind is the sort of

0:34:03.680 --> 0:34:07.440
<v Speaker 1>Arthur Galston, who was a plant biologist who discovered while

0:34:07.480 --> 0:34:10.560
<v Speaker 1>he was a graduate student, this compound that helps soybeans

0:34:10.560 --> 0:34:13.680
<v Speaker 1>flower faster. He also learned that if this compound were

0:34:13.680 --> 0:34:16.560
<v Speaker 1>applied in excess, that it would cause the plant to

0:34:16.600 --> 0:34:20.960
<v Speaker 1>shed its leaves. And when Galston discovered this defoliant effect,

0:34:21.000 --> 0:34:25.080
<v Speaker 1>that's what was abused by biological warfare scientists who would

0:34:25.120 --> 0:34:28.279
<v Speaker 1>then go on to develop Agent orange. I just got

0:34:28.320 --> 0:34:31.000
<v Speaker 1>back from a trip to Vietnam actually, where the effects

0:34:31.000 --> 0:34:34.000
<v Speaker 1>of Asian orange is still being felt. It's actually a

0:34:34.080 --> 0:34:37.840
<v Speaker 1>gene toxin which causes deformities through the generations. So that

0:34:37.920 --> 0:34:40.759
<v Speaker 1>is a truly horrific one, Kara, And it makes us

0:34:40.800 --> 0:34:43.520
<v Speaker 1>think it wasn't those chemists who were releasing agent orange

0:34:43.520 --> 0:34:46.920
<v Speaker 1>over Vietnam, it was the US military. So the idea

0:34:46.960 --> 0:34:49.240
<v Speaker 1>of the person who creates the technology gets to control

0:34:49.239 --> 0:34:51.759
<v Speaker 1>what happens to it is simply not the case, and

0:34:51.800 --> 0:34:53.480
<v Speaker 1>so we need to move forward with the assumption that

0:34:53.600 --> 0:34:57.120
<v Speaker 1>AI weapons will leave the laboratory and exists in the world.

0:34:57.640 --> 0:35:00.400
<v Speaker 1>And the central question is how helpful it to have

0:35:00.480 --> 0:35:04.120
<v Speaker 1>a human in the loop. Well, according to Richard Danzigg,

0:35:04.239 --> 0:35:10.160
<v Speaker 1>humans are of increasingly limited utility. I think there are

0:35:10.200 --> 0:35:14.680
<v Speaker 1>circumstances where human control is useful, but I don't think

0:35:14.719 --> 0:35:18.440
<v Speaker 1>that's the most useful approach. And the reason for that

0:35:18.640 --> 0:35:22.440
<v Speaker 1>is because the power is in the machine. So many

0:35:22.480 --> 0:35:26.600
<v Speaker 1>decisions that we care about are made at extraordinarily high speed,

0:35:27.120 --> 0:35:30.799
<v Speaker 1>and it just isn't time for the humans to assimilate

0:35:30.840 --> 0:35:35.320
<v Speaker 1>them and make correct judgments. Even the president declaring or

0:35:35.400 --> 0:35:40.200
<v Speaker 1>not nuclear war and responding might have fifteen minutes to

0:35:40.239 --> 0:35:44.360
<v Speaker 1>make a judgment. In other words, the whole idea of

0:35:44.400 --> 0:35:47.279
<v Speaker 1>a human in the loop making the final cool is

0:35:47.360 --> 0:35:50.400
<v Speaker 1>something of an illusion. At the very least, it relies

0:35:50.400 --> 0:35:54.120
<v Speaker 1>on us making wise decisions at lightning speed and under pressure.

0:35:54.640 --> 0:35:57.560
<v Speaker 1>And there's another problem. All of the information people like

0:35:57.680 --> 0:36:01.160
<v Speaker 1>the president used to make decisions has already been filtered

0:36:01.160 --> 0:36:05.520
<v Speaker 1>through several computer systems. So when the president reviews information

0:36:05.560 --> 0:36:08.520
<v Speaker 1>to make a tactical choice. He or she is already

0:36:08.560 --> 0:36:13.240
<v Speaker 1>relying on automation. He's extraordinarily dependent on what the machines

0:36:13.280 --> 0:36:17.440
<v Speaker 1>are telling him, what the sensors are interpreted to him,

0:36:17.440 --> 0:36:21.279
<v Speaker 1>and what the algorithms say the trajectories of missiles that

0:36:21.320 --> 0:36:25.520
<v Speaker 1>have been launched. So realistically, he's on the cart being

0:36:25.560 --> 0:36:30.359
<v Speaker 1>pulled by the horses of these technologies. UM. If that's

0:36:30.360 --> 0:36:32.680
<v Speaker 1>true for the president, think what it's like for the

0:36:32.719 --> 0:36:38.640
<v Speaker 1>person who's a sergeant in the field manning Patriot Missile Battalion. UM.

0:36:39.440 --> 0:36:43.759
<v Speaker 1>And it shows incoming missiles he has seconds or at

0:36:43.840 --> 0:36:47.759
<v Speaker 1>best minutes to respond and has to make decisions. We

0:36:47.920 --> 0:36:51.319
<v Speaker 1>know how fallible we are as decision makers, and we

0:36:51.400 --> 0:36:54.080
<v Speaker 1>know how dependent we already are on computer systems to

0:36:54.080 --> 0:36:57.640
<v Speaker 1>guide our decisions. So what can we do to prevent

0:36:57.680 --> 0:37:01.080
<v Speaker 1>ourselves from stumbling into a conflict that no one wants?

0:37:02.080 --> 0:37:05.440
<v Speaker 1>But I think we need to recognize that science is

0:37:05.480 --> 0:37:09.600
<v Speaker 1>now diffused around the globe, and we need a common

0:37:09.760 --> 0:37:13.520
<v Speaker 1>kind of understanding about how to reduce these risks, And

0:37:13.560 --> 0:37:17.040
<v Speaker 1>then we need some joint planning for the contingency that

0:37:17.080 --> 0:37:20.800
<v Speaker 1>these do escape. What do we do if a newly

0:37:20.920 --> 0:37:26.239
<v Speaker 1>engineered genetic system gets out there into the wild. Well,

0:37:26.320 --> 0:37:28.719
<v Speaker 1>that's not just a problem for the Chinese. If it

0:37:28.760 --> 0:37:33.759
<v Speaker 1>happens to happen in China, technology spreads, it gets modified, copied,

0:37:33.800 --> 0:37:36.200
<v Speaker 1>and hacked, and once something is out of the lab

0:37:36.560 --> 0:37:39.640
<v Speaker 1>is anyone's guess as to what happens. And countries are

0:37:39.719 --> 0:37:43.359
<v Speaker 1>slowly trying to establish standards for AI. But as Paul

0:37:43.400 --> 0:37:47.759
<v Speaker 1>Shari argues, creating a global framework governing AI in warfare

0:37:47.920 --> 0:37:50.920
<v Speaker 1>is a tool order. It's a very hard area to

0:37:50.960 --> 0:37:54.640
<v Speaker 1>think about. How do we mitigate that risk because countries

0:37:54.640 --> 0:37:56.879
<v Speaker 1>are not going to talk about the things that they're

0:37:56.920 --> 0:38:01.760
<v Speaker 1>doing in cyberspace and the fine angel sector. They've installed

0:38:01.760 --> 0:38:04.879
<v Speaker 1>things like circuit breakers that would take stocks offline if

0:38:04.920 --> 0:38:07.880
<v Speaker 1>the price moves too quickly. Well, there's no referee to

0:38:07.920 --> 0:38:10.440
<v Speaker 1>call time out in warfare. So if we're going to

0:38:10.520 --> 0:38:13.400
<v Speaker 1>manage those risks in the military space, does have to

0:38:13.400 --> 0:38:17.160
<v Speaker 1>be circuit breakers, uh if you will that people build

0:38:17.160 --> 0:38:20.600
<v Speaker 1>into our own weapons systems limits on them, ways to

0:38:20.680 --> 0:38:24.319
<v Speaker 1>interject human control to maintain control if things begin to

0:38:24.719 --> 0:38:28.600
<v Speaker 1>move in unexpected ways. And it's worth acknowledging really upfront

0:38:28.640 --> 0:38:32.040
<v Speaker 1>that there's a trade off there that every time that

0:38:32.480 --> 0:38:37.040
<v Speaker 1>a military puts guard rails on a weapon system or

0:38:37.320 --> 0:38:40.279
<v Speaker 1>inserts a human in the loop as a check. That's

0:38:40.320 --> 0:38:44.919
<v Speaker 1>potentially slowing down the effectiveness of their weapon. And there's

0:38:44.960 --> 0:38:47.120
<v Speaker 1>a risk that they are going to be afraid that

0:38:47.160 --> 0:38:49.120
<v Speaker 1>an adversary might not do that and might get an

0:38:49.239 --> 0:38:52.200
<v Speaker 1>edge on them. And that dynamic is really the crux

0:38:52.239 --> 0:38:55.360
<v Speaker 1>of the problem here. It's hard to get to a

0:38:55.360 --> 0:38:59.640
<v Speaker 1>place where countries um trust each other enough to engage

0:38:59.640 --> 0:39:02.920
<v Speaker 1>in mute all frustrain. But we may not have a choice.

0:39:03.520 --> 0:39:06.080
<v Speaker 1>Up until now, our defense policy has been based on

0:39:06.120 --> 0:39:10.279
<v Speaker 1>the assumption of technical superiority, and as our argues, we

0:39:10.280 --> 0:39:13.360
<v Speaker 1>can no longer rely on that. You have a model

0:39:13.400 --> 0:39:16.879
<v Speaker 1>that is based on owning all the technology and knowing

0:39:16.920 --> 0:39:18.920
<v Speaker 1>that no one else can have access to it for

0:39:18.960 --> 0:39:23.160
<v Speaker 1>two or three decades, and today those assumptions simply don't hold.

0:39:23.800 --> 0:39:26.719
<v Speaker 1>We are not the only people who can innovate right now.

0:39:27.880 --> 0:39:31.360
<v Speaker 1>The history of new technology and warfare is frankly disturbing.

0:39:31.840 --> 0:39:34.239
<v Speaker 1>When we create new weapons, we tend to use them.

0:39:34.840 --> 0:39:37.400
<v Speaker 1>We've talked about the atomic bomb in Japan, and about

0:39:37.400 --> 0:39:40.160
<v Speaker 1>poisonous gas in World War One, and even about the

0:39:40.200 --> 0:39:44.000
<v Speaker 1>Gatling gun, one of the world's first automated weapons designed

0:39:44.040 --> 0:39:46.600
<v Speaker 1>to reduce the number of combatants required to wage war.

0:39:47.080 --> 0:39:51.160
<v Speaker 1>It decimated an entire generation in Europe. We haven't yet

0:39:51.200 --> 0:39:54.560
<v Speaker 1>seen what happens when AI weapons systems begin to interact

0:39:54.560 --> 0:39:58.440
<v Speaker 1>with one another, but chances are we will in our lifetime.

0:39:59.239 --> 0:40:01.800
<v Speaker 1>So the pation in all of this can be to

0:40:01.920 --> 0:40:05.040
<v Speaker 1>desperately try to hit pools on new technology, but off,

0:40:05.160 --> 0:40:09.879
<v Speaker 1>y'all ues, that would be the wrong approach. Historically, we

0:40:09.920 --> 0:40:15.920
<v Speaker 1>are drawn forward by the enormous potential that these technologies

0:40:15.960 --> 0:40:18.879
<v Speaker 1>can enhance our lives, and at the same time we're

0:40:18.960 --> 0:40:24.160
<v Speaker 1>we're repelled by the consequences that we understand could be

0:40:24.280 --> 0:40:29.080
<v Speaker 1>fundamentally wrong. So I think that's the tension. But in

0:40:29.200 --> 0:40:33.279
<v Speaker 1>aggregate and over time, I do think that technology has

0:40:33.320 --> 0:40:36.759
<v Speaker 1>lifted us up, has advanced us. You know, when you

0:40:36.800 --> 0:40:39.960
<v Speaker 1>play the parlor game of asking your friends what period

0:40:39.960 --> 0:40:42.719
<v Speaker 1>in history they would rather live in. I might want

0:40:42.760 --> 0:40:45.120
<v Speaker 1>to visit, but there's no other time in history I

0:40:45.160 --> 0:40:47.600
<v Speaker 1>want to live in. And I think the future is

0:40:47.600 --> 0:40:50.200
<v Speaker 1>going to be fraught with problems, and it's still going

0:40:50.239 --> 0:40:52.080
<v Speaker 1>to be a better place than the one that we're in.

0:40:53.960 --> 0:40:56.759
<v Speaker 1>It's true that technology has made so many parts of

0:40:56.760 --> 0:41:00.920
<v Speaker 1>our lives easier, healthier, and safer, and it's also true

0:41:00.960 --> 0:41:03.600
<v Speaker 1>that the technology we create has the potential to be

0:41:03.719 --> 0:41:07.880
<v Speaker 1>ever more destructive. We've talked about dual use in this episode,

0:41:08.200 --> 0:41:11.000
<v Speaker 1>and as a matter of fact, many DARPA programs have

0:41:11.040 --> 0:41:15.440
<v Speaker 1>found their way into revolutionizing medicine. In the next episode,

0:41:15.480 --> 0:41:17.800
<v Speaker 1>we look at some of the incredible applications of AI

0:41:17.960 --> 0:41:21.120
<v Speaker 1>in the world of healthcare, from accurately predicting time of

0:41:21.160 --> 0:41:26.000
<v Speaker 1>death to decoding the human genome. I'm Ozveloshin, See you

0:41:26.040 --> 0:41:41.280
<v Speaker 1>next time. Sleepwalkers is a production of our Heart Radio

0:41:41.400 --> 0:41:45.640
<v Speaker 1>and unusual productions. For the latest AI news, live interviews,

0:41:45.680 --> 0:41:48.600
<v Speaker 1>and behind the scenes footage. Find us on Instagram, at

0:41:48.640 --> 0:41:54.600
<v Speaker 1>Sleepwalker's podcast or at sleepwalkers podcast dot com. Sleepwalkers is

0:41:54.640 --> 0:41:57.200
<v Speaker 1>hosted by me oz Veloshin and car hosted by me

0:41:57.360 --> 0:42:00.279
<v Speaker 1>Kara Price. Were produced by Julian Weller with help from

0:42:00.320 --> 0:42:03.920
<v Speaker 1>Jacopo Penzo and Taylor Chacogne. Mixing by Tristan McNeil and

0:42:04.000 --> 0:42:07.480
<v Speaker 1>Julian Weller. Our story editor is Matthew Riddle. Recording assistance

0:42:07.600 --> 0:42:11.080
<v Speaker 1>this episode from Chris Hambroke and Jackson Bierfeld. Sleepwalkers is

0:42:11.120 --> 0:42:15.319
<v Speaker 1>executive produced by me Osvaloschen and Mangesh Hattikiller. For more

0:42:15.360 --> 0:42:17.959
<v Speaker 1>podcasts from my Heart Radio, visit the I heart Radio app,

0:42:18.040 --> 0:42:20.960
<v Speaker 1>Apple Podcasts, or wherever you listen to your favorite shows.