WEBVTT - Empires of AI With Karen Hao

0:00:02.400 --> 0:00:06.840
<v Speaker 1>Also media, Hello and welcome to Better Offline. I'm your

0:00:06.840 --> 0:00:20.840
<v Speaker 1>host ed zich Tron. As ever, remember you can buy

0:00:20.840 --> 0:00:23.840
<v Speaker 1>Better Offline merchandise linkers in the episode notes. Today, I

0:00:23.840 --> 0:00:26.040
<v Speaker 1>am joined by Karen Howe, the author of the upcoming

0:00:26.079 --> 0:00:28.680
<v Speaker 1>book Empire of Ai, which tells the story of Open

0:00:28.720 --> 0:00:31.440
<v Speaker 1>Ai and the arms rais surrounding large language models. Karen,

0:00:31.480 --> 0:00:32.280
<v Speaker 1>thank you for joining me.

0:00:32.840 --> 0:00:34.120
<v Speaker 2>Thank you so much for having me ed.

0:00:35.000 --> 0:00:39.279
<v Speaker 1>So you describe the progress of these models in these

0:00:39.280 --> 0:00:41.600
<v Speaker 1>companies as a kind of colonialism, Can you get into

0:00:41.640 --> 0:00:42.120
<v Speaker 1>that for me?

0:00:43.520 --> 0:00:46.239
<v Speaker 2>Yeah, So, if you think about the way that empires

0:00:46.240 --> 0:00:49.960
<v Speaker 2>of old operated during the very long history of European colonialism,

0:00:50.280 --> 0:00:53.480
<v Speaker 2>they were essentially taking resources that were not their own,

0:00:54.480 --> 0:00:57.880
<v Speaker 2>exploiting massive amounts of labor as in not paying them

0:00:58.160 --> 0:01:01.680
<v Speaker 2>or paying them extremely small amounts of money, and they

0:01:01.680 --> 0:01:05.320
<v Speaker 2>were doing this all under a civilizing mission, this idea

0:01:05.480 --> 0:01:09.560
<v Speaker 2>that they were bringing modernity and progress to all of humanity,

0:01:09.600 --> 0:01:11.600
<v Speaker 2>when in fact what was actually happening was they were

0:01:11.600 --> 0:01:14.920
<v Speaker 2>just fortifying themselves and the empire, and the people at

0:01:14.959 --> 0:01:17.640
<v Speaker 2>the top of the empire, and everyone else that kind

0:01:17.640 --> 0:01:20.160
<v Speaker 2>of lived in the world had to live in the

0:01:20.160 --> 0:01:22.559
<v Speaker 2>thrash of what the people at the top decided based

0:01:22.600 --> 0:01:25.000
<v Speaker 2>on their whims for what was part of their self

0:01:25.040 --> 0:01:28.680
<v Speaker 2>serving agenda. And that's essentially what we're seeing with Empires

0:01:28.680 --> 0:01:32.000
<v Speaker 2>of AI today, where they are taking data that is

0:01:32.040 --> 0:01:34.480
<v Speaker 2>not their own, their laying claim to it. They're taking land,

0:01:34.640 --> 0:01:38.720
<v Speaker 2>they're taking energy, they're taking water. They are exploiting massive

0:01:38.720 --> 0:01:41.679
<v Speaker 2>amounts of labor, both labor that goes into the inputs

0:01:41.959 --> 0:01:45.080
<v Speaker 2>for developing these am models, but also exploiting labor in

0:01:45.080 --> 0:01:48.440
<v Speaker 2>the sense that they are ultimately creating labor automating technologies

0:01:49.200 --> 0:01:52.200
<v Speaker 2>that is eroding away people's labor rights as we speak,

0:01:53.240 --> 0:01:55.760
<v Speaker 2>and they're doing it under this civilizing mission of they

0:01:55.800 --> 0:01:58.600
<v Speaker 2>are doing it for the benefit of all of humanity.

0:01:59.800 --> 0:02:02.120
<v Speaker 2>And what I say in the book is Empires of

0:02:02.160 --> 0:02:05.040
<v Speaker 2>AI they're not as overtly violent as empires of old.

0:02:05.240 --> 0:02:09.799
<v Speaker 2>And so maybe that can become confusing and people think, oh, well,

0:02:09.800 --> 0:02:12.359
<v Speaker 2>it can't be that bad. But the thing is, we've

0:02:12.360 --> 0:02:15.399
<v Speaker 2>had one hundred and fifty years of social and moral progress,

0:02:15.480 --> 0:02:18.280
<v Speaker 2>and so empires of modern day are going to look

0:02:18.320 --> 0:02:22.280
<v Speaker 2>different in the way that empires of old operated. And

0:02:22.520 --> 0:02:26.480
<v Speaker 2>when you look just at like the actual parallels, there

0:02:26.480 --> 0:02:31.480
<v Speaker 2>are just so many extraordinary parallels between the kind of

0:02:31.600 --> 0:02:35.120
<v Speaker 2>basis of empire building back then and now that I

0:02:35.160 --> 0:02:39.080
<v Speaker 2>think it is fundamentally the only frame that I have

0:02:39.160 --> 0:02:42.120
<v Speaker 2>found to really help understand and grapple with the sheer

0:02:42.160 --> 0:02:46.280
<v Speaker 2>scope and scale and the actual like what is actually

0:02:46.360 --> 0:02:48.280
<v Speaker 2>happening here within the AI industry.

0:02:49.440 --> 0:02:51.799
<v Speaker 1>One theme from the book I also noticed was that

0:02:52.320 --> 0:02:55.160
<v Speaker 1>despite all of the backs and forths between all the people,

0:02:55.760 --> 0:02:58.680
<v Speaker 1>very rarely product came out. Though, Like it was interesting,

0:02:58.720 --> 0:03:01.360
<v Speaker 1>there seemed to be all that these sations about research

0:03:01.440 --> 0:03:04.360
<v Speaker 1>and all of these things they were saying, but it

0:03:04.440 --> 0:03:06.800
<v Speaker 1>usually just ended with like some sort of release and

0:03:06.840 --> 0:03:10.560
<v Speaker 1>then kind of just moved on. Yeah, it almost it

0:03:10.639 --> 0:03:12.960
<v Speaker 1>almost makes me wonder what they're always what they're working

0:03:13.000 --> 0:03:13.840
<v Speaker 1>on half the time.

0:03:15.000 --> 0:03:18.000
<v Speaker 2>Yeah, you know, it's I think it's a product of

0:03:18.080 --> 0:03:21.120
<v Speaker 2>two different things that that you noticed that in the book.

0:03:21.200 --> 0:03:24.160
<v Speaker 2>One is that I finished writing the book before a

0:03:24.200 --> 0:03:28.080
<v Speaker 2>lot of the most recent product releases came out, Right,

0:03:28.440 --> 0:03:31.680
<v Speaker 2>That's just the nature of writing things on the timescale of.

0:03:31.639 --> 0:03:34.160
<v Speaker 1>Books, is it's not fun.

0:03:34.680 --> 0:03:39.920
<v Speaker 2>Yeah. I froze the manuscript in like the early days

0:03:39.920 --> 0:03:43.520
<v Speaker 2>of January, right before Deep Seek, right before Stargate, right

0:03:43.520 --> 0:03:48.760
<v Speaker 2>before you know, a string of other releases. So that's

0:03:48.800 --> 0:03:53.080
<v Speaker 2>one is that through most of open AI's history, it

0:03:53.160 --> 0:03:56.240
<v Speaker 2>is really it was really more focused on research conversations,

0:03:56.280 --> 0:03:58.680
<v Speaker 2>and it's only been in the last year or so

0:03:58.800 --> 0:04:02.520
<v Speaker 2>that it's really dramatically shifted much more to talking about product.

0:04:03.080 --> 0:04:06.480
<v Speaker 2>But the second reason is that I personally like that

0:04:06.600 --> 0:04:11.480
<v Speaker 2>is my expertise. I came up in AI reporting covering

0:04:11.560 --> 0:04:15.160
<v Speaker 2>the research, and so I wanted to focus on that

0:04:15.200 --> 0:04:18.280
<v Speaker 2>in the book and really unpack it, especially because there's

0:04:18.360 --> 0:04:22.320
<v Speaker 2>not as much reporting on the research these days, and

0:04:22.400 --> 0:04:24.640
<v Speaker 2>I wanted to kind of track that history and the

0:04:24.640 --> 0:04:27.880
<v Speaker 2>internal conversations that happened when people say that they're developing

0:04:28.200 --> 0:04:30.360
<v Speaker 2>so called AGI and.

0:04:30.360 --> 0:04:32.560
<v Speaker 1>You talk about in twenty nineteen in the book the

0:04:32.560 --> 0:04:35.480
<v Speaker 1>your rose colored Glasses got knocked off by a story?

0:04:35.760 --> 0:04:39.040
<v Speaker 1>What was it that really made you start being suspicious

0:04:39.080 --> 0:04:40.040
<v Speaker 1>of these companies?

0:04:41.520 --> 0:04:45.360
<v Speaker 2>Yeah, So in twenty nineteen was when I started covering

0:04:45.440 --> 0:04:48.000
<v Speaker 2>Opening Eye, and I embedded within the company for three

0:04:48.080 --> 0:04:52.040
<v Speaker 2>days in August of twenty nineteen to profile what had

0:04:52.080 --> 0:04:57.040
<v Speaker 2>then become a newly minted capped profit nested in a nonprofit.

0:04:58.680 --> 0:05:00.880
<v Speaker 2>And I think the thing that but that really started

0:05:00.880 --> 0:05:05.360
<v Speaker 2>tipping me off was it was actually really small things. Initially,

0:05:05.640 --> 0:05:09.839
<v Speaker 2>the first thing was they publicly professed to be this

0:05:10.000 --> 0:05:12.760
<v Speaker 2>bastion of transparency and they were going to share all

0:05:12.839 --> 0:05:14.880
<v Speaker 2>their research to the world, and they had accumulated a

0:05:14.880 --> 0:05:18.839
<v Speaker 2>significant amount of good will on the basis of this idea,

0:05:19.320 --> 0:05:23.080
<v Speaker 2>and they were raising not literally fundraising, but they had

0:05:23.120 --> 0:05:26.240
<v Speaker 2>amassed a lot of capital on the basis of this idea.

0:05:26.560 --> 0:05:29.960
<v Speaker 2>And when I started embedding within the company, I realized

0:05:29.960 --> 0:05:33.320
<v Speaker 2>that they were incredibly secretive, like they were not. They

0:05:33.320 --> 0:05:37.479
<v Speaker 2>wouldn't allow me to see anything or time to anyone

0:05:37.680 --> 0:05:42.720
<v Speaker 2>beyond very strictly sanctioned conversations. And even in those conversations,

0:05:42.760 --> 0:05:45.719
<v Speaker 2>I would notice that researchers were giving side eye to

0:05:45.760 --> 0:05:49.839
<v Speaker 2>the communications officer every other sentence because they were worried

0:05:49.880 --> 0:05:53.520
<v Speaker 2>about stepping into a lane that was considered proprietary. And

0:05:53.560 --> 0:05:55.800
<v Speaker 2>I was like, wait a minute, why are there things

0:05:55.839 --> 0:05:58.280
<v Speaker 2>that are proprietary, and why are the people being secretive

0:05:58.279 --> 0:06:02.200
<v Speaker 2>if all this is supposed to ultimately be shared with

0:06:02.240 --> 0:06:05.800
<v Speaker 2>the public. But the other thing was when I was

0:06:05.880 --> 0:06:09.680
<v Speaker 2>talking with executives, Like the very first interview that I

0:06:09.760 --> 0:06:12.520
<v Speaker 2>had was with Greg Brockman and Ilia Setskav, the CTO

0:06:12.520 --> 0:06:16.880
<v Speaker 2>and she's scientist, And I just asked them very basic questions,

0:06:16.920 --> 0:06:19.160
<v Speaker 2>like why do you think we should spend this much

0:06:19.200 --> 0:06:22.720
<v Speaker 2>money on Agi and not on something else? And can

0:06:22.760 --> 0:06:25.599
<v Speaker 2>you articulate for me what does AGI look like? What

0:06:25.640 --> 0:06:29.560
<v Speaker 2>would you even want Agi to do? And can you

0:06:29.640 --> 0:06:32.559
<v Speaker 2>articulate for me? You know, part of their origin story

0:06:32.600 --> 0:06:36.080
<v Speaker 2>as a company was they want to build agi good

0:06:36.120 --> 0:06:39.640
<v Speaker 2>agi first before the bad people built bad Agi. So

0:06:39.680 --> 0:06:42.159
<v Speaker 2>I was like, well, what would bad agi look like

0:06:42.200 --> 0:06:45.280
<v Speaker 2>as well? Or like what are the harms that are

0:06:45.279 --> 0:06:48.359
<v Speaker 2>coming out of some of this rapid AI progress? And

0:06:48.920 --> 0:06:53.200
<v Speaker 2>they weren't able to answer any of those questions. And

0:06:53.640 --> 0:06:56.359
<v Speaker 2>that was when I thought, hold on a second, Like

0:06:56.480 --> 0:07:00.000
<v Speaker 2>I thought that this was a nonprofit meant to care

0:07:00.080 --> 0:07:04.320
<v Speaker 2>counter some of the ills of Silicon Valley, one of

0:07:04.360 --> 0:07:08.719
<v Speaker 2>the ills being that the most companies end up being

0:07:08.760 --> 0:07:12.640
<v Speaker 2>thrown boatloads of cash without like clear articulated ideas about

0:07:12.640 --> 0:07:15.520
<v Speaker 2>what they're going to do with that cash. And here

0:07:15.560 --> 0:07:17.920
<v Speaker 2>I am in this meeting room trying to just ask

0:07:18.000 --> 0:07:21.640
<v Speaker 2>the most basic question, like the most boiler plate stuff

0:07:21.680 --> 0:07:25.920
<v Speaker 2>that there should be some kind of answer too, uh,

0:07:25.960 --> 0:07:28.840
<v Speaker 2>And they can't even answer that. So it seems like

0:07:29.040 --> 0:07:33.320
<v Speaker 2>it is actually very much just an animal of Silicon Valley.

0:07:33.680 --> 0:07:36.640
<v Speaker 2>This is not actually something different from what we're seeing

0:07:36.680 --> 0:07:37.880
<v Speaker 2>with the rest of the tech industry.

0:07:38.840 --> 0:07:41.480
<v Speaker 1>It felt as well, that was a comment and forgive

0:07:41.480 --> 0:07:43.640
<v Speaker 1>me for forgetting it exactly where where it was like

0:07:43.720 --> 0:07:45.600
<v Speaker 1>the all secrets could be written on a grain of

0:07:45.680 --> 0:07:50.800
<v Speaker 1>rice or something like that. Yeah, and I have to admit,

0:07:51.000 --> 0:07:53.120
<v Speaker 1>as I read it, I got this weird feeling like

0:07:53.160 --> 0:07:56.720
<v Speaker 1>does anyone actually have any ip because when you actually

0:07:56.720 --> 0:07:59.480
<v Speaker 1>look at the conversations they're having, and you likely privy

0:07:59.520 --> 0:08:02.040
<v Speaker 1>to more hair, it felt like they wouldn't talk about

0:08:02.040 --> 0:08:05.080
<v Speaker 1>what they were doing at all, and not I say,

0:08:05.120 --> 0:08:07.960
<v Speaker 1>this is run apof written a lot about the valley.

0:08:08.520 --> 0:08:11.760
<v Speaker 1>It feels like they'd say more, but no one wanted

0:08:11.800 --> 0:08:14.679
<v Speaker 1>to say anything, not even secret. It's like nobody really knew.

0:08:15.080 --> 0:08:17.800
<v Speaker 1>And you even described some of the managerial stuff in there,

0:08:17.800 --> 0:08:19.760
<v Speaker 1>like no one really knew what was going on anyway.

0:08:19.960 --> 0:08:23.880
<v Speaker 1>It just feels like a remarkably disorganized company considering the scale.

0:08:25.160 --> 0:08:28.000
<v Speaker 2>Yeah, so I think early on at Opening Eye was

0:08:28.040 --> 0:08:31.360
<v Speaker 2>completely disorganized in the sense that they had no idea.

0:08:31.920 --> 0:08:34.680
<v Speaker 2>You know, they decide, Okay, we're going to build this

0:08:34.720 --> 0:08:36.559
<v Speaker 2>ag I think, but then they were like, what does

0:08:36.600 --> 0:08:40.000
<v Speaker 2>that even mean? We have no idea, And there was

0:08:40.240 --> 0:08:42.760
<v Speaker 2>a lot of there weren't real managers at the company either,

0:08:42.800 --> 0:08:46.080
<v Speaker 2>because they had just gathered up a bunch of researchers

0:08:46.120 --> 0:08:49.560
<v Speaker 2>from academia, and they didn't really have much of a

0:08:49.600 --> 0:08:52.360
<v Speaker 2>sense of how to organize themselves other than a traditional

0:08:52.400 --> 0:08:56.440
<v Speaker 2>academic lab where there's a professor and grad students, and

0:08:57.679 --> 0:09:02.199
<v Speaker 2>I mean academia, you know, as it's has its function,

0:09:02.600 --> 0:09:06.040
<v Speaker 2>But that ultimately wasn't the right structure for trying to

0:09:06.559 --> 0:09:10.720
<v Speaker 2>move a group of people towards a similar goal. And

0:09:10.760 --> 0:09:14.199
<v Speaker 2>over time, Opening Eye did start cleaning itself up a

0:09:14.240 --> 0:09:16.800
<v Speaker 2>little bit, It did start restructuring itself. It started focusing

0:09:16.840 --> 0:09:20.199
<v Speaker 2>more on GPT models because they hit on that in

0:09:20.320 --> 0:09:26.080
<v Speaker 2>around twenty eighteen twenty nineteen. But similarly, there's still just

0:09:26.240 --> 0:09:31.160
<v Speaker 2>because there's no clarity about its mission and ultimately what

0:09:31.240 --> 0:09:34.680
<v Speaker 2>it is trying to build, you end up with just

0:09:34.920 --> 0:09:38.800
<v Speaker 2>a lot of riffs within the organization over this very

0:09:38.840 --> 0:09:42.320
<v Speaker 2>fundamental question. People fundamentally disagree about what Opening I is.

0:09:43.000 --> 0:09:46.400
<v Speaker 2>They disagree about what AGI is, They disagree about what

0:09:46.440 --> 0:09:49.520
<v Speaker 2>it means to ensure that something should benefit all of humanity.

0:09:51.240 --> 0:09:56.040
<v Speaker 2>And I think because there was all this confusion or

0:09:56.120 --> 0:09:59.520
<v Speaker 2>there were all these different interpretations ultimately of these like

0:09:59.600 --> 0:10:04.200
<v Speaker 2>basic tenants of the organization. I think people also just

0:10:04.920 --> 0:10:08.120
<v Speaker 2>there was they wouldn't quite clearly articulate to one another

0:10:08.400 --> 0:10:10.679
<v Speaker 2>what they were doing. It wasn't necessarily that they were

0:10:10.720 --> 0:10:13.600
<v Speaker 2>trying to be secretive to one another. It was more

0:10:13.760 --> 0:10:16.880
<v Speaker 2>just that they weren't really on the same page. And

0:10:18.840 --> 0:10:23.080
<v Speaker 2>this eventually became sort of less and less true in

0:10:23.080 --> 0:10:26.480
<v Speaker 2>the sense that as sam Oltman's installed himself as CEO

0:10:26.520 --> 0:10:31.760
<v Speaker 2>and started really exerting a particular type of path for

0:10:31.920 --> 0:10:35.160
<v Speaker 2>AI progress, then they started having, you know, research documents

0:10:35.200 --> 0:10:38.480
<v Speaker 2>that explicitly articulated we are a scaling lab, like we

0:10:38.520 --> 0:10:41.160
<v Speaker 2>are going after scale way.

0:10:41.280 --> 0:10:44.480
<v Speaker 1>How long did it take them to put those documents

0:10:44.480 --> 0:10:46.360
<v Speaker 1>together though? What year about?

0:10:47.520 --> 0:10:50.360
<v Speaker 2>I think their first research roadmap was in twenty seventeen,

0:10:50.400 --> 0:10:52.480
<v Speaker 2>so it was one and a half years to them

0:10:53.000 --> 0:10:57.520
<v Speaker 2>so bad into the non profit Yeah, yeah.

0:10:56.640 --> 0:10:59.600
<v Speaker 1>So I will admit there is another colonial thing that

0:10:59.640 --> 0:11:04.320
<v Speaker 1>stood out well. Two specifically, One, it definitely feels that

0:11:04.320 --> 0:11:07.240
<v Speaker 1>there are a lot of unintelligent cousin types who were

0:11:07.240 --> 0:11:09.840
<v Speaker 1>put in there because their mate was there throughout the company.

0:11:10.240 --> 0:11:13.800
<v Speaker 1>But two it's this kind of religious view around agi,

0:11:14.280 --> 0:11:18.200
<v Speaker 1>this kind of nebulous justification for just about every I

0:11:18.240 --> 0:11:20.240
<v Speaker 1>was disappointed, and I understand what you mentioned it like

0:11:20.640 --> 0:11:23.480
<v Speaker 1>did Yadowski was in there? I think the less wrong people.

0:11:23.640 --> 0:11:26.640
<v Speaker 1>This is a personal belief. Just no need to mention

0:11:26.720 --> 0:11:29.679
<v Speaker 1>them again for anyone. I think that Yadowski, anyone who

0:11:29.679 --> 0:11:31.840
<v Speaker 1>writes a six hundred thousand word Harry Potter book should

0:11:31.880 --> 0:11:35.760
<v Speaker 1>be put in prison, including JK. Rowling. But it feels

0:11:35.840 --> 0:11:38.960
<v Speaker 1>like there really is this belief system that's pushed throughout

0:11:38.960 --> 0:11:43.080
<v Speaker 1>this industry which mirrors colonialism. Mirror is the very judao

0:11:43.200 --> 0:11:46.880
<v Speaker 1>Christian push of the British and many other colonial entities.

0:11:47.760 --> 0:11:50.320
<v Speaker 2>Yeah. Absolutely so. One of the things that I was

0:11:50.480 --> 0:11:54.760
<v Speaker 2>most surprised by when reporting the book is I had

0:11:54.840 --> 0:11:58.320
<v Speaker 2>seen all the divisions around boomers and boomers people saying hey,

0:11:58.400 --> 0:12:00.760
<v Speaker 2>I can bring us to Utopiera, people saying I can

0:12:00.840 --> 0:12:04.080
<v Speaker 2>kill us all. I really did think initially that it

0:12:04.160 --> 0:12:07.200
<v Speaker 2>was just rhetoric and that it was just a tool

0:12:07.360 --> 0:12:11.120
<v Speaker 2>for accruing more power. And the thing that surprised me

0:12:11.280 --> 0:12:16.319
<v Speaker 2>most was how many people I met that genuinely deeply

0:12:16.320 --> 0:12:19.240
<v Speaker 2>believed in both, especially the Dumer ideology like I was

0:12:19.240 --> 0:12:23.200
<v Speaker 2>interviewing people whose voices were quivering because they were talking

0:12:23.240 --> 0:12:27.320
<v Speaker 2>about their anxiety around the potential end of the world,

0:12:27.400 --> 0:12:31.880
<v Speaker 2>and that was a very sincere reaction. And I think

0:12:31.920 --> 0:12:34.000
<v Speaker 2>that is part You're exactly right that it is a

0:12:34.080 --> 0:12:37.720
<v Speaker 2>huge parallel with empire building in the past, is that

0:12:38.280 --> 0:12:43.680
<v Speaker 2>empires need to have an ideology that convinces themselves why

0:12:43.720 --> 0:12:46.800
<v Speaker 2>they are ultimately doing something that is for the benefit

0:12:46.840 --> 0:12:49.680
<v Speaker 2>of the world. So in the past, when they had

0:12:49.679 --> 0:12:52.280
<v Speaker 2>the civilizing mission, we're bringing this to the world. It

0:12:52.360 --> 0:12:57.320
<v Speaker 2>also wasn't rhetoric. It was also a deeply seated religious

0:12:57.840 --> 0:13:02.600
<v Speaker 2>and spiritual and scientific belief that they were doing something

0:13:02.640 --> 0:13:04.440
<v Speaker 2>that was better off for everyone.

0:13:04.920 --> 0:13:07.600
<v Speaker 1>I mean, the origins of the BBC in England were

0:13:07.880 --> 0:13:12.600
<v Speaker 1>religious indoctrination on some level. It kind of it's I

0:13:12.679 --> 0:13:16.800
<v Speaker 1>admit I'm surprised to hear the quivering voices stuff I

0:13:16.840 --> 0:13:21.360
<v Speaker 1>think because I think that again, this personal opinion, Ydowski,

0:13:21.480 --> 0:13:23.000
<v Speaker 1>I think is full. I think a lot of those

0:13:23.040 --> 0:13:24.840
<v Speaker 1>less wrong guys are full of shit. I think they're

0:13:24.880 --> 0:13:27.440
<v Speaker 1>doing it for not for the bit. But it's the

0:13:27.480 --> 0:13:31.800
<v Speaker 1>same kind of horse trading shit that people do around anything.

0:13:31.840 --> 0:13:33.480
<v Speaker 1>It's like, we don't have anything to believe in, so

0:13:33.559 --> 0:13:36.680
<v Speaker 1>let's all agree on this. But it's interesting to hear

0:13:36.720 --> 0:13:40.320
<v Speaker 1>that people are I don't know how to put this,

0:13:40.480 --> 0:13:44.360
<v Speaker 1>actually believing this crap even though it doesn't feel like

0:13:44.520 --> 0:13:46.560
<v Speaker 1>there's any real evidence. You know.

0:13:46.880 --> 0:13:50.280
<v Speaker 2>Yeah, well, I think the analogy that I've started using

0:13:50.400 --> 0:13:54.520
<v Speaker 2>is I really feel like opening Eyes done, where you know,

0:13:54.679 --> 0:13:57.920
<v Speaker 2>in Dune, there is a mythology that is created by

0:13:57.960 --> 0:14:00.960
<v Speaker 2>a certain group of people with four understanding that they're

0:14:00.960 --> 0:14:06.120
<v Speaker 2>creating a mythology, right right, But then as they start

0:14:06.160 --> 0:14:10.640
<v Speaker 2>to embody and act out this mythology, not only do

0:14:11.160 --> 0:14:13.360
<v Speaker 2>many many people who didn't know that it was originally

0:14:13.400 --> 0:14:16.400
<v Speaker 2>created come to believe it, also the people who created

0:14:16.400 --> 0:14:20.000
<v Speaker 2>it come to believe it themselves. And I think this

0:14:20.240 --> 0:14:26.960
<v Speaker 2>is essentially exactly what is happening within AI with the ideologies,

0:14:27.040 --> 0:14:30.520
<v Speaker 2>is that maybe there was at some point someone who

0:14:30.960 --> 0:14:36.520
<v Speaker 2>was more aware that there was some kind of rhetorical

0:14:36.600 --> 0:14:39.880
<v Speaker 2>trick that they were playing around, really propagating this kind

0:14:39.920 --> 0:14:43.040
<v Speaker 2>of belief, but it is not We're not at that

0:14:43.120 --> 0:14:46.160
<v Speaker 2>point anymore. Like, there are lots and lots of people

0:14:46.160 --> 0:14:49.840
<v Speaker 2>who genuinely believe these things, and I think it's self

0:14:49.880 --> 0:14:53.640
<v Speaker 2>perpetuating because when you believe it, you look for signs

0:14:53.680 --> 0:14:58.320
<v Speaker 2>of it, and you research things that would suggest more

0:14:58.400 --> 0:15:01.800
<v Speaker 2>evidence for your belief and so they're kind of continuing

0:15:01.840 --> 0:15:04.960
<v Speaker 2>to reinforce their beliefs. And the more these A models

0:15:04.960 --> 0:15:09.320
<v Speaker 2>have progressed, the stronger these beliefs have become. Because whether

0:15:09.400 --> 0:15:12.840
<v Speaker 2>you believe AI will bring utopia or dystopia, there is

0:15:12.880 --> 0:15:16.320
<v Speaker 2>an abundance of evidence that you can point to now

0:15:16.800 --> 0:15:21.000
<v Speaker 2>to reinforce your own yeah, exactly, to reinforce your own

0:15:21.800 --> 0:15:24.160
<v Speaker 2>starting point. And so it's sort of like a microcosm

0:15:25.120 --> 0:15:29.520
<v Speaker 2>of society today where you know, most the average person

0:15:29.720 --> 0:15:32.880
<v Speaker 2>no longer encounters information that can change their minds. It

0:15:32.960 --> 0:15:36.600
<v Speaker 2>just continues to entrench whatever they already believed before.

0:15:37.120 --> 0:15:40.840
<v Speaker 1>Do you believe Sam Moultman believes this shite? Do you

0:15:40.840 --> 0:15:44.240
<v Speaker 1>think he believes in the AGI? Is he part of it?

0:15:44.240 --> 0:15:49.360
<v Speaker 2>It's really It's really interesting because I think the no

0:15:49.440 --> 0:15:52.560
<v Speaker 2>matter who I interviewed, and no matter how long they

0:15:52.600 --> 0:15:55.880
<v Speaker 2>worked with Sam Aultman or how closely they worked with

0:15:55.960 --> 0:15:58.360
<v Speaker 2>Sam Altman, and not a single person was able to

0:15:58.560 --> 0:16:02.760
<v Speaker 2>fully articulate what his beliefs are. And I think that

0:16:02.840 --> 0:16:03.920
<v Speaker 2>is very much by design.

0:16:04.240 --> 0:16:08.000
<v Speaker 1>Is that it's beautiful that's.

0:16:07.720 --> 0:16:11.360
<v Speaker 2>Yeah, and and and and and it wasn't. And they

0:16:11.360 --> 0:16:14.800
<v Speaker 2>would explicitly say this too. They would they would call out,

0:16:15.000 --> 0:16:19.720
<v Speaker 2>I'm not actually sure what he believes. And this was

0:16:19.800 --> 0:16:34.120
<v Speaker 2>the most consistent thing that people said about him.

0:16:34.400 --> 0:16:37.840
<v Speaker 1>I really noticed as well. If you read your book

0:16:38.120 --> 0:16:40.800
<v Speaker 1>and you really look, you actually can't get much of

0:16:40.800 --> 0:16:43.040
<v Speaker 1>an idea of who Sam Mortman is at all, And

0:16:43.080 --> 0:16:46.200
<v Speaker 1>in fact, you can't work out why he's brilliant at all.

0:16:46.200 --> 0:16:47.880
<v Speaker 1>And I've read a lot of stuff about Sam Moultman.

0:16:48.120 --> 0:16:50.120
<v Speaker 1>The long and short of it I can understand is

0:16:50.200 --> 0:16:54.400
<v Speaker 1>that he's got good psychology and he's really charming. Everyone

0:16:54.440 --> 0:16:57.360
<v Speaker 1>talks about the psychology and the charming, and it's just

0:16:57.520 --> 0:17:01.040
<v Speaker 1>really it. It is so busy. He's so a bizarre

0:17:01.120 --> 0:17:04.160
<v Speaker 1>man like everything about him is so like. The way

0:17:04.200 --> 0:17:07.680
<v Speaker 1>that people talk about him is so strange.

0:17:08.000 --> 0:17:10.560
<v Speaker 2>Yeah, So this is what I sort of concluded about

0:17:10.600 --> 0:17:15.160
<v Speaker 2>why he's able to pull off what he does. He

0:17:15.320 --> 0:17:17.600
<v Speaker 2>is a once in a generation talent when it comes

0:17:17.600 --> 0:17:23.720
<v Speaker 2>to storytelling, and he has a loose relationship with the truth, yes,

0:17:23.800 --> 0:17:27.600
<v Speaker 2>which is a really powerful combination. And so when he's

0:17:27.640 --> 0:17:31.960
<v Speaker 2>talking to someone, he shines most when he's talking to

0:17:32.040 --> 0:17:35.639
<v Speaker 2>small groups of people in one on one meetings, and

0:17:35.720 --> 0:17:40.280
<v Speaker 2>what he says is more tightly correlated with what that

0:17:40.440 --> 0:17:45.080
<v Speaker 2>person needs to hear rather than what he believes, which

0:17:45.119 --> 0:17:47.040
<v Speaker 2>is part of the reason why people say, ultimately like

0:17:47.080 --> 0:17:50.000
<v Speaker 2>they don't really know what he believes because he doesn't

0:17:50.119 --> 0:17:54.439
<v Speaker 2>really indicate it. And so I think that is what

0:17:54.520 --> 0:17:58.600
<v Speaker 2>makes him incredibly persuasive. And he is really good at

0:17:58.640 --> 0:18:01.960
<v Speaker 2>understanding people and what they and what they want, and

0:18:02.080 --> 0:18:04.160
<v Speaker 2>you know, he's well resourced, so he's able to then

0:18:04.200 --> 0:18:07.000
<v Speaker 2>deliver to them what they need and want. And what

0:18:07.080 --> 0:18:13.679
<v Speaker 2>I realized is with that kind of talent, you would

0:18:13.720 --> 0:18:19.280
<v Speaker 2>inherently be incredibly polarizing as a figure, because if the

0:18:19.320 --> 0:18:23.479
<v Speaker 2>person agrees with you, you're the best asset in the

0:18:23.520 --> 0:18:27.200
<v Speaker 2>world for what they want to achieve. You're incredibly persuasive,

0:18:27.440 --> 0:18:31.200
<v Speaker 2>You're able to get the resources you can do exactly

0:18:31.840 --> 0:18:34.680
<v Speaker 2>what that person can do for you, exactly what you

0:18:34.720 --> 0:18:37.879
<v Speaker 2>want them to do. But if you disagree with this person,

0:18:38.119 --> 0:18:42.639
<v Speaker 2>that person becomes the greatest threat ever because they are

0:18:42.680 --> 0:18:46.159
<v Speaker 2>so persuasive. You have fear that they're going to be

0:18:46.200 --> 0:18:48.399
<v Speaker 2>able to carry out exactly what you don't want them

0:18:48.440 --> 0:18:51.400
<v Speaker 2>to carry out. And so that kind of boils down

0:18:51.440 --> 0:18:56.639
<v Speaker 2>to why he's just such an enigmatic and extremely polarizing person.

0:18:57.440 --> 0:18:59.520
<v Speaker 2>Is it really depends on whether or not someone agrees

0:18:59.600 --> 0:19:00.440
<v Speaker 2>or disagree with him.

0:19:00.680 --> 0:19:02.680
<v Speaker 1>He also doesn't seem that smart. I don't know, he

0:19:02.720 --> 0:19:04.800
<v Speaker 1>seems quite good at talking to people, but when I

0:19:04.840 --> 0:19:07.760
<v Speaker 1>hear him talk, he doesn't seem that eloquent. And it

0:19:07.800 --> 0:19:10.800
<v Speaker 1>makes me wonder if perhaps Sam Mortman is a symptom

0:19:10.840 --> 0:19:12.840
<v Speaker 1>of a greater problem that so much of our power,

0:19:12.880 --> 0:19:16.200
<v Speaker 1>structure and money is based on someone making decisions based

0:19:16.240 --> 0:19:19.399
<v Speaker 1>on the last intelligent person or intelligent seeming person they

0:19:19.480 --> 0:19:19.840
<v Speaker 1>talk to.

0:19:21.200 --> 0:19:24.639
<v Speaker 2>Yeah, I mean, I think our society is also just

0:19:24.800 --> 0:19:31.360
<v Speaker 2>we still have such a have we worship people that

0:19:31.480 --> 0:19:36.199
<v Speaker 2>are wealthy. Yeah, like, And so even if he's not

0:19:36.480 --> 0:19:40.199
<v Speaker 2>saying something that is convincing you in real time, he

0:19:40.320 --> 0:19:43.040
<v Speaker 2>has all of the kind of indicators that this person

0:19:43.119 --> 0:19:46.679
<v Speaker 2>has been remarkably successful and you should listen to what

0:19:46.720 --> 0:19:49.200
<v Speaker 2>he says because then that will make you successful too, right,

0:19:50.280 --> 0:19:53.040
<v Speaker 2>And so I think that is part of the part

0:19:53.200 --> 0:19:56.960
<v Speaker 2>of the kind of mythos around him, is that if

0:19:56.960 --> 0:20:00.240
<v Speaker 2>you can join up with him, it will greatly enrich you.

0:20:00.800 --> 0:20:02.439
<v Speaker 2>And you know, like, there's a lot of evidence to

0:20:02.440 --> 0:20:05.520
<v Speaker 2>suggest that too, that like, there have been plenty of

0:20:05.520 --> 0:20:08.560
<v Speaker 2>people that I've allied themselves with Sam Aulman and that

0:20:08.600 --> 0:20:12.879
<v Speaker 2>have become much richer for it. And so whether or

0:20:12.920 --> 0:20:16.879
<v Speaker 2>not people are joining up with him because they necessarily

0:20:16.920 --> 0:20:19.320
<v Speaker 2>one hundred percent agree with like his ideology or his

0:20:19.400 --> 0:20:22.720
<v Speaker 2>actions or anything like that, or if it's if it's

0:20:22.760 --> 0:20:26.280
<v Speaker 2>more because ultimately they get to benefit from that alliance,

0:20:27.200 --> 0:20:29.080
<v Speaker 2>I think is Yeah, what.

0:20:29.000 --> 0:20:31.720
<v Speaker 1>Most feels like, it's people connecting with other people to

0:20:31.760 --> 0:20:34.560
<v Speaker 1>see how far they can get, far more than AI.

0:20:34.800 --> 0:20:37.639
<v Speaker 1>Because one of the other things I really noticed when

0:20:37.680 --> 0:20:41.160
<v Speaker 1>you were telling the story of the firing Sam Wulman

0:20:41.160 --> 0:20:44.080
<v Speaker 1>getting fired in No. Twenty twenty three, As much as

0:20:44.080 --> 0:20:47.440
<v Speaker 1>people wanted to pretend, they kept bringing up the tender

0:20:48.000 --> 0:20:50.080
<v Speaker 1>and to explain for the listeners the tender was the

0:20:50.119 --> 0:20:52.960
<v Speaker 1>open AI hadn't had a plans to let have plans

0:20:52.960 --> 0:20:55.479
<v Speaker 1>to let people sell their stock. It really felt like

0:20:55.560 --> 0:20:59.680
<v Speaker 1>that was more the primary concern than any loyalty to Altman.

0:21:00.800 --> 0:21:02.960
<v Speaker 2>It was. I wouldn't say it was the primary concern,

0:21:03.000 --> 0:21:06.080
<v Speaker 2>but I mean, yeah, it really depended on.

0:21:06.080 --> 0:21:06.639
<v Speaker 1>Who I was.

0:21:07.320 --> 0:21:11.679
<v Speaker 2>It's taught, Yeah, exactly like every employee sort of had

0:21:11.680 --> 0:21:15.639
<v Speaker 2>a different calculus that ultimately led them to revolt against

0:21:15.640 --> 0:21:18.720
<v Speaker 2>the board and want Altman back, And there were different

0:21:18.720 --> 0:21:21.760
<v Speaker 2>calculuses among Microsoft and investors. But one of the key

0:21:21.800 --> 0:21:25.679
<v Speaker 2>things that I think is uh necessary to understand just

0:21:25.800 --> 0:21:29.040
<v Speaker 2>why there is so much seeming loyalty around Altman in general,

0:21:29.200 --> 0:21:33.960
<v Speaker 2>is he is very very good at at establishing relationships

0:21:34.840 --> 0:21:38.159
<v Speaker 2>with money involved, where he is the lynchpin to the

0:21:38.200 --> 0:21:42.160
<v Speaker 2>other person accessing that much yes, and so the tender

0:21:42.200 --> 0:21:44.720
<v Speaker 2>offer is a perfect example of this, and that employees

0:21:45.000 --> 0:21:48.680
<v Speaker 2>ultimately they realized that Altman is just really he's really

0:21:48.680 --> 0:21:52.320
<v Speaker 2>good at fundraising, and whether or not an employee believes

0:21:52.359 --> 0:21:56.000
<v Speaker 2>in the AGI thing, they all agreed that open AA

0:21:56.040 --> 0:21:59.080
<v Speaker 2>ultimately needs an enormous amount of capital, and also many

0:21:59.160 --> 0:22:01.160
<v Speaker 2>of them are doing it in part because they can

0:22:01.200 --> 0:22:05.239
<v Speaker 2>then like guarantee their own financial future. And so with

0:22:05.960 --> 0:22:09.679
<v Speaker 2>Altman gone, it became increasingly clear that open a I

0:22:09.720 --> 0:22:12.760
<v Speaker 2>wouldn't survive, and so that's not something that a lot

0:22:12.760 --> 0:22:16.440
<v Speaker 2>of employees wanted. It became clear that even if Opening

0:22:16.480 --> 0:22:18.960
<v Speaker 2>I did survive, they would be a lot more short

0:22:19.080 --> 0:22:21.240
<v Speaker 2>changed in terms of the amount of capital that they

0:22:21.280 --> 0:22:23.840
<v Speaker 2>would be able to get because he would no longer

0:22:23.880 --> 0:22:27.960
<v Speaker 2>be their champion for that, and also the tender offer

0:22:28.000 --> 0:22:30.480
<v Speaker 2>could potentially go away and they would not be personally

0:22:30.920 --> 0:22:35.000
<v Speaker 2>enriched as well, and you know, many of them. The

0:22:35.040 --> 0:22:39.000
<v Speaker 2>thing to also understand is like it's very expensive to

0:22:39.000 --> 0:22:42.040
<v Speaker 2>live in the Bay Area, and so for the worker,

0:22:42.240 --> 0:22:45.240
<v Speaker 2>for the employees, in the moment, losing the tender offer

0:22:45.359 --> 0:22:48.480
<v Speaker 2>wasn't like oh no, I'm going to lose like my retirement.

0:22:48.640 --> 0:22:51.560
<v Speaker 2>It was also this sense of like, I'm literally going

0:22:51.640 --> 0:22:55.760
<v Speaker 2>to lose my financial security right now, like I already

0:22:56.280 --> 0:22:59.320
<v Speaker 2>tried to, I already bought, you know, a house based

0:22:59.320 --> 0:23:02.600
<v Speaker 2>on the fact. I feel like you mentioned that yeah, yeah.

0:23:02.640 --> 0:23:04.400
<v Speaker 1>That was someone who put money.

0:23:04.680 --> 0:23:07.960
<v Speaker 2>Yeah, who put plenty of money down, and that the

0:23:09.040 --> 0:23:13.440
<v Speaker 2>tender offer dissolving was a real financial stress. It was

0:23:13.760 --> 0:23:16.040
<v Speaker 2>a threat to their financial existence in the life.

0:23:16.080 --> 0:23:19.359
<v Speaker 1>I imagine so, But I'm just the way it was

0:23:19.440 --> 0:23:22.800
<v Speaker 1>framed in public was that this was some big loyalty

0:23:22.880 --> 0:23:25.480
<v Speaker 1>thing where everyone was like, I love open Ai and

0:23:25.560 --> 0:23:29.879
<v Speaker 1>Sam Altman, and that just didn't feel like it was

0:23:29.920 --> 0:23:32.760
<v Speaker 1>what was happening. That people seemed angry at Ilia, but

0:23:32.800 --> 0:23:36.280
<v Speaker 1>they just seemed angry because something changed, rather than.

0:23:36.520 --> 0:23:39.480
<v Speaker 2>Like, yeah, yeah, I mean I think I think there

0:23:39.480 --> 0:23:43.280
<v Speaker 2>were certainly people within the company that did feel loyalty

0:23:43.600 --> 0:23:46.760
<v Speaker 2>to Altman and and and that was one of their

0:23:46.800 --> 0:23:49.639
<v Speaker 2>primary motivating things. But by and Leche, when I was

0:23:49.640 --> 0:23:54.640
<v Speaker 2>interviewing lots of employees for understanding like what ultimately led

0:23:54.640 --> 0:24:00.280
<v Speaker 2>them to rally around Sam, there was actually more more

0:24:01.080 --> 0:24:04.760
<v Speaker 2>practical concerns than just personal loyalty that was driving the thing,

0:24:04.960 --> 0:24:07.600
<v Speaker 2>whether it was financial or whether it was just I

0:24:07.640 --> 0:24:09.919
<v Speaker 2>really believe in Agi and I don't want open Aiye

0:24:09.960 --> 0:24:13.160
<v Speaker 2>to go away because it'll scrap all of the work

0:24:13.200 --> 0:24:17.720
<v Speaker 2>that we've done. And of course, you know, of course

0:24:17.960 --> 0:24:20.840
<v Speaker 2>the narrative would I mean, the open ai themselves have

0:24:20.920 --> 0:24:24.240
<v Speaker 2>been pushing again and again and again this idea that

0:24:25.040 --> 0:24:28.000
<v Speaker 2>all of the employee or whatever, more than ninety percent

0:24:28.080 --> 0:24:31.520
<v Speaker 2>of the employees ended up signing the petition, and they

0:24:31.720 --> 0:24:34.520
<v Speaker 2>show they cite this number as just a show of

0:24:34.520 --> 0:24:37.399
<v Speaker 2>solidarity and loyalty to Altman. But then, of course, if

0:24:37.440 --> 0:24:39.720
<v Speaker 2>you look at the track record after the Boyd crisis

0:24:39.720 --> 0:24:43.760
<v Speaker 2>of how many people have subsequently left the company once

0:24:45.480 --> 0:24:48.800
<v Speaker 2>once things have sort of stabilized and there isn't a

0:24:48.880 --> 0:24:52.840
<v Speaker 2>crisis situation, that is I think much more revealing of

0:24:52.960 --> 0:24:55.119
<v Speaker 2>how much loyalty people have to him.

0:24:55.920 --> 0:24:59.560
<v Speaker 1>So tell me about Jack Clock. So Jack Clock is

0:24:59.640 --> 0:25:01.640
<v Speaker 1>the what is he? And he's one of the co

0:25:01.720 --> 0:25:05.280
<v Speaker 1>founders of Anthropic. Now, yeah, I, without putting you on

0:25:05.320 --> 0:25:07.640
<v Speaker 1>the spot, kind of feels like Jack Clark has got

0:25:07.680 --> 0:25:10.320
<v Speaker 1>off a little easy with everyone not even saying you.

0:25:10.320 --> 0:25:12.159
<v Speaker 1>You're one of the few people. Jack Clark worked at

0:25:12.160 --> 0:25:15.800
<v Speaker 1>The Register, which is an extremely critical IT publication, and

0:25:15.840 --> 0:25:18.840
<v Speaker 1>now he's out in conferences saying that AI agents will

0:25:18.880 --> 0:25:22.280
<v Speaker 1>control everything. He just feels like one of the weirdest

0:25:22.359 --> 0:25:23.920
<v Speaker 1>characters in this whole story.

0:25:26.359 --> 0:25:29.520
<v Speaker 2>Yeah, Yeah, it's interesting. Like when I went to profile

0:25:29.520 --> 0:25:33.240
<v Speaker 2>Opening Eye in twenty nineteen, I actually the first person

0:25:33.280 --> 0:25:36.240
<v Speaker 2>I reached out to was Jack because I had spoken

0:25:36.280 --> 0:25:39.320
<v Speaker 2>to him before and he had until then, until recently

0:25:39.359 --> 0:25:43.280
<v Speaker 2>been playing communications for head for Open Eye, and then

0:25:43.680 --> 0:25:46.080
<v Speaker 2>he had shifted into a policy role. And I remember

0:25:46.119 --> 0:25:50.240
<v Speaker 2>when I when I was at the company, I was like, hey, Jack, like,

0:25:50.280 --> 0:25:53.200
<v Speaker 2>do you think you can actually give me more access

0:25:53.240 --> 0:25:57.280
<v Speaker 2>to seeing the things that I like, stuff that I

0:25:57.400 --> 0:25:58.800
<v Speaker 2>like to say? Yeah, Like I was literally I was

0:25:58.800 --> 0:26:01.040
<v Speaker 2>literally asking so they wouldn't let me go beyond the

0:26:01.040 --> 0:26:04.480
<v Speaker 2>first floor. There were there's there were three floors second.

0:26:04.200 --> 0:26:06.880
<v Speaker 1>And I'm so sorry there's computers there. There's not It's

0:26:06.920 --> 0:26:08.800
<v Speaker 1>not like they have an AI machine. Come on.

0:26:09.280 --> 0:26:11.800
<v Speaker 2>Yeah, And I was like, hey, like, can I just

0:26:12.040 --> 0:26:14.080
<v Speaker 2>literally just go up to the second? Can you like

0:26:14.119 --> 0:26:15.920
<v Speaker 2>take me up and just like let me walk around?

0:26:16.080 --> 0:26:20.119
<v Speaker 2>And he looked at me with this like like deep

0:26:20.200 --> 0:26:24.160
<v Speaker 2>deep side eye of like no, Karen, like you absolutely cannot.

0:26:24.680 --> 0:26:27.960
<v Speaker 2>And I was like, so, Fawny, you're a former journalist.

0:26:28.000 --> 0:26:30.560
<v Speaker 2>You know how this works. Like the.

0:26:32.000 --> 0:26:35.200
<v Speaker 1>Jack Frow in twenty fourteen for The Register was shock

0:26:35.240 --> 0:26:37.840
<v Speaker 1>an a w West the fall of Amazon's deflationary cloud,

0:26:38.040 --> 0:26:39.719
<v Speaker 1>just as Jeff Bezos did the books and see these

0:26:39.720 --> 0:26:42.160
<v Speaker 1>Amazon's rivals are now doing it. He used to write

0:26:42.240 --> 0:26:47.199
<v Speaker 1>these like very grouchy l reg style pig It's just

0:26:47.320 --> 0:26:48.320
<v Speaker 1>so weird.

0:26:49.240 --> 0:26:51.760
<v Speaker 2>Yeah, I mean I think this is like I've.

0:26:52.040 --> 0:26:53.400
<v Speaker 1>But it gets back to the thing you were saying

0:26:53.400 --> 0:26:54.800
<v Speaker 1>about the kind of the doctrine.

0:26:55.359 --> 0:27:00.480
<v Speaker 2>Yeah. So, like, because I started covering this company intoing nineteen,

0:27:01.480 --> 0:27:03.560
<v Speaker 2>I talked with people then that I then talked to

0:27:03.640 --> 0:27:05.520
<v Speaker 2>for the book, and I was able to sort of

0:27:06.359 --> 0:27:10.399
<v Speaker 2>have this unique opportunity to track how people's individual beliefs

0:27:10.400 --> 0:27:15.400
<v Speaker 2>evolve when they are seeped in this world, and there

0:27:15.400 --> 0:27:18.000
<v Speaker 2>were people that I was talking to back then that

0:27:18.080 --> 0:27:20.239
<v Speaker 2>were like, I don't really believe in this AGI thing,

0:27:20.400 --> 0:27:22.280
<v Speaker 2>that by the time I was talking to them for

0:27:22.320 --> 0:27:24.680
<v Speaker 2>the book were like AGI all the way, like that

0:27:24.920 --> 0:27:28.359
<v Speaker 2>this is a genuine, true belief. And I think there's

0:27:28.400 --> 0:27:31.480
<v Speaker 2>a lot of reasons for this transformation, Like one is

0:27:31.480 --> 0:27:35.520
<v Speaker 2>that you are only talking to people who believe this,

0:27:35.680 --> 0:27:39.360
<v Speaker 2>so you're just constantly in this environment where you're not

0:27:39.480 --> 0:27:43.600
<v Speaker 2>talking to people who are challenging or testing that belief

0:27:43.680 --> 0:27:49.000
<v Speaker 2>and instead just like continuously being reinforced in this echo chamber.

0:27:50.119 --> 0:27:53.159
<v Speaker 2>But I think there's another thing that I kind of

0:27:53.200 --> 0:27:55.720
<v Speaker 2>came to realize while reporting on the book is like

0:27:55.760 --> 0:27:59.000
<v Speaker 2>people who really really believe that AGI is possible, that

0:27:59.040 --> 0:28:01.840
<v Speaker 2>we will actually be able to replicate human intelligence. It's

0:28:01.880 --> 0:28:05.360
<v Speaker 2>not a belief about what AI is capable of. It

0:28:05.400 --> 0:28:11.639
<v Speaker 2>is a belief about what human intelligence is. And a

0:28:11.720 --> 0:28:14.120
<v Speaker 2>lot of people in the AI world today have this

0:28:14.320 --> 0:28:17.359
<v Speaker 2>belief that human intelligence or everything in the world is

0:28:17.480 --> 0:28:21.360
<v Speaker 2>inherently computable and all you have to do is just

0:28:21.480 --> 0:28:23.840
<v Speaker 2>a mass more data and more compute and eventually you

0:28:23.920 --> 0:28:26.919
<v Speaker 2>will get to that thing. You will be able to

0:28:26.920 --> 0:28:29.920
<v Speaker 2>replicate that thing. And when you are in this kind

0:28:29.960 --> 0:28:34.560
<v Speaker 2>of environment where you have people constantly arguing to you

0:28:34.920 --> 0:28:37.480
<v Speaker 2>that this is why AGA is possible, because everything is computable,

0:28:37.520 --> 0:28:41.480
<v Speaker 2>and then you see the rapid clip of your models

0:28:41.760 --> 0:28:44.080
<v Speaker 2>being able to do more and more functions that you

0:28:44.120 --> 0:28:48.240
<v Speaker 2>know other people outside in society previously would have suggested

0:28:48.760 --> 0:28:52.520
<v Speaker 2>were not possible. It's sort of the self reinforcing belief machine,

0:28:52.960 --> 0:29:00.120
<v Speaker 2>like it just manufacturers gives you yeah, exactly, And so

0:29:00.200 --> 0:29:04.480
<v Speaker 2>I think. And one of the things that I also

0:29:05.120 --> 0:29:09.200
<v Speaker 2>have just has a general realization not just with opening

0:29:09.200 --> 0:29:12.360
<v Speaker 2>eye but in general. When I'm covering tech companies, I

0:29:12.440 --> 0:29:14.040
<v Speaker 2>kind of have a policy for myself to do a

0:29:14.040 --> 0:29:15.800
<v Speaker 2>little bit of a detox after I spend a lot

0:29:15.800 --> 0:29:18.560
<v Speaker 2>of time talking with them, because it is really like,

0:29:18.600 --> 0:29:20.640
<v Speaker 2>when you're talking with all of these people that exist

0:29:20.640 --> 0:29:24.560
<v Speaker 2>in this world, you do adopt their worldview, and you

0:29:24.600 --> 0:29:27.120
<v Speaker 2>do adopt their talking points, and you do see things

0:29:27.440 --> 0:29:31.880
<v Speaker 2>through their eyes. And usually I then have to like

0:29:32.440 --> 0:29:36.000
<v Speaker 2>let myself just be in the actual world for a

0:29:36.040 --> 0:29:39.320
<v Speaker 2>little bit and remind myself of what the average person

0:29:39.360 --> 0:29:43.480
<v Speaker 2>thinks and what the average person values, and remind myself

0:29:43.480 --> 0:29:46.360
<v Speaker 2>that there are you know, there are problems beyond the

0:29:46.400 --> 0:29:50.840
<v Speaker 2>Silicon Valley's borders that just look fundamentally different from what

0:29:51.040 --> 0:29:54.640
<v Speaker 2>they conceive the world to be. And so I did

0:29:54.720 --> 0:29:57.000
<v Speaker 2>that with the Opening Eye profile. I did that with

0:29:57.760 --> 0:30:00.760
<v Speaker 2>I profiled Facebook years ago, and I that with Facebook.

0:30:00.840 --> 0:30:03.240
<v Speaker 2>I did that with the book, where I would interview

0:30:03.280 --> 0:30:05.800
<v Speaker 2>lots of people in like these big batches and kind

0:30:05.840 --> 0:30:08.400
<v Speaker 2>of really do my best to try and occupy their

0:30:08.440 --> 0:30:12.800
<v Speaker 2>shoes for a couple of weeks a month, and then

0:30:12.960 --> 0:30:17.840
<v Speaker 2>I would spend my time explicitly not interviewing open ani people,

0:30:17.960 --> 0:30:21.080
<v Speaker 2>just interviewing other people that were out in the world

0:30:21.120 --> 0:30:23.800
<v Speaker 2>to just like reset my brain chemistry a little bit,

0:30:24.320 --> 0:30:26.200
<v Speaker 2>because it really does feel that way. It really does

0:30:26.280 --> 0:30:31.280
<v Speaker 2>feel like you kind of get absorbed into this singular

0:30:31.520 --> 0:30:33.440
<v Speaker 2>world view and then you have to kind of remind

0:30:33.440 --> 0:30:36.760
<v Speaker 2>yourself of the greater reality.

0:30:49.880 --> 0:30:51.840
<v Speaker 1>I'm gonna ask this question without getting you in too

0:30:51.920 --> 0:30:54.120
<v Speaker 1>much trouble. You think that's what happened with Kevin Russe,

0:30:56.360 --> 0:31:00.360
<v Speaker 1>because it's really I know, I don't want to put

0:31:00.360 --> 0:31:02.240
<v Speaker 1>you in a situation we have to talk kill of someone,

0:31:02.520 --> 0:31:07.120
<v Speaker 1>but that interview was bizarre and hard fork I So.

0:31:08.720 --> 0:31:13.400
<v Speaker 2>I've been I think really lucky in that I've covered

0:31:13.560 --> 0:31:17.040
<v Speaker 2>the tech industry almost always not living in SF.

0:31:18.120 --> 0:31:19.280
<v Speaker 1>I agree, that's a great thing.

0:31:19.720 --> 0:31:23.600
<v Speaker 2>And and you know, like I've been able to figure

0:31:23.640 --> 0:31:25.320
<v Speaker 2>that out in my career, and that was an explicit

0:31:25.320 --> 0:31:27.560
<v Speaker 2>dis like I did not want to live in SF

0:31:27.640 --> 0:31:30.920
<v Speaker 2>anymore like I had lived in SF. I wanted to

0:31:31.200 --> 0:31:35.520
<v Speaker 2>get out. And I think this is a really it's

0:31:35.320 --> 0:31:40.280
<v Speaker 2>it's a really hard balance for any journalist. Is you

0:31:40.400 --> 0:31:42.360
<v Speaker 2>need to decide whether you're close to your subject and

0:31:42.400 --> 0:31:44.920
<v Speaker 2>immerse in their world and therefore might be co opted

0:31:45.040 --> 0:31:49.719
<v Speaker 2>by their world, or whether you exist outside of that

0:31:49.800 --> 0:31:52.800
<v Speaker 2>world and therefore you don't have as much access. You

0:31:53.080 --> 0:31:55.080
<v Speaker 2>don't get to go to the parties where you hear

0:31:55.160 --> 0:31:58.880
<v Speaker 2>tips all the time. And and that's one just like

0:31:59.040 --> 0:32:01.280
<v Speaker 2>it's been attention in my career as well as like

0:32:01.360 --> 0:32:03.440
<v Speaker 2>I constantly feel like I'm missing things because I'm not

0:32:03.440 --> 0:32:05.120
<v Speaker 2>an SF. But the thing that I think I have

0:32:05.480 --> 0:32:09.120
<v Speaker 2>gained from not being an SF is just a continued

0:32:09.200 --> 0:32:16.040
<v Speaker 2>connection to non SF world, you know, Like I I

0:32:16.240 --> 0:32:19.560
<v Speaker 2>notice when I spend too much time with s F

0:32:19.640 --> 0:32:24.040
<v Speaker 2>people that I start in my vocabulary changes, like how

0:32:24.480 --> 0:32:27.120
<v Speaker 2>I talk about things changes, because because people in SF

0:32:27.160 --> 0:32:31.120
<v Speaker 2>talk about things in a very particular way, you know,

0:32:31.240 --> 0:32:36.560
<v Speaker 2>like they are talking about like optimization hacking, and like

0:32:37.400 --> 0:32:42.840
<v Speaker 2>they have a particular utilitarian maximization mindset around how they

0:32:42.880 --> 0:32:47.480
<v Speaker 2>do things and why, and I have to then kind

0:32:47.480 --> 0:32:52.000
<v Speaker 2>of step away from that and reseet my language, even

0:32:52.560 --> 0:32:55.520
<v Speaker 2>when when then I sit down to write a story

0:32:55.600 --> 0:32:58.920
<v Speaker 2>that's for the greater public. And so yeah, so I

0:32:58.960 --> 0:33:01.440
<v Speaker 2>think this is something that's just challenging in general. Is

0:33:01.520 --> 0:33:05.080
<v Speaker 2>like it's really hard to not get too close to

0:33:05.160 --> 0:33:09.920
<v Speaker 2>your sources and to not start adopting everything that they

0:33:10.200 --> 0:33:15.640
<v Speaker 2>say as as your own, especially if you are literally

0:33:15.680 --> 0:33:16.240
<v Speaker 2>living with them.

0:33:16.800 --> 0:33:21.000
<v Speaker 1>And yes, in some cases right could be anyone. But

0:33:21.360 --> 0:33:23.640
<v Speaker 1>it does feel like there is a kind of almost

0:33:23.680 --> 0:33:27.360
<v Speaker 1>word containent or thought contagion with this stuff with AGI

0:33:27.600 --> 0:33:30.560
<v Speaker 1>that it pickles certain people. They hear about the idea

0:33:30.600 --> 0:33:34.200
<v Speaker 1>of the autonomous computer and it drives them mad and everything.

0:33:34.280 --> 0:33:38.160
<v Speaker 1>To your point, they start chasing it even though there's

0:33:38.240 --> 0:33:40.240
<v Speaker 1>not really any evidence that we can do it.

0:33:41.960 --> 0:33:44.959
<v Speaker 2>Yeah, I mean, I mean, like when I first started

0:33:45.280 --> 0:33:50.080
<v Speaker 2>covering AI, I also was so enthralled by the premise,

0:33:50.760 --> 0:33:53.840
<v Speaker 2>Like when I when I so before I feel AI,

0:33:56.000 --> 0:33:58.400
<v Speaker 2>I didn't really like that when I first started covering

0:33:58.400 --> 0:34:03.200
<v Speaker 2>it at my two technology review. I did not realize

0:34:03.240 --> 0:34:07.800
<v Speaker 2>before then that AI was actually trying to recreate human intelligence.

0:34:07.800 --> 0:34:10.319
<v Speaker 2>I thought it was just you know, I mean, it

0:34:10.360 --> 0:34:12.719
<v Speaker 2>is a marketing it is a marketing term.

0:34:12.760 --> 0:34:14.799
<v Speaker 1>But even then, this sounds like it might be a

0:34:14.840 --> 0:34:16.520
<v Speaker 1>definition that people argue.

0:34:16.280 --> 0:34:19.880
<v Speaker 2>Over right, right right, But I mean, like in the original,

0:34:19.960 --> 0:34:22.920
<v Speaker 2>like when AI was coined as a term in nineteen

0:34:22.960 --> 0:34:27.279
<v Speaker 2>fifty six, like John McCarthy, he did explicitly coin the

0:34:27.400 --> 0:34:30.360
<v Speaker 2>term both to be to attract funders, so as a

0:34:30.400 --> 0:34:34.400
<v Speaker 2>marketing term, and because he was trying to describe what

0:34:34.560 --> 0:34:37.440
<v Speaker 2>he wanted the field to do, which was to recreate

0:34:37.520 --> 0:34:40.959
<v Speaker 2>human intelligence. And that is just it's it's it's such

0:34:41.040 --> 0:34:47.040
<v Speaker 2>an evocative thing, like to think, wait a minute, could

0:34:47.040 --> 0:34:49.560
<v Speaker 2>we actually do that? And what would that mean? And

0:34:49.600 --> 0:34:53.840
<v Speaker 2>there's so much philosophical Uh, it's just a philosophical mindfield.

0:34:53.880 --> 0:34:58.400
<v Speaker 2>Like and if you are someone that loves philosophizing, you

0:34:58.440 --> 0:35:00.440
<v Speaker 2>can just sit there for like days in days and

0:35:00.520 --> 0:35:02.920
<v Speaker 2>days and think, holy crap, like what would that be?

0:35:03.000 --> 0:35:06.640
<v Speaker 1>What would that look like? How can we do times columns?

0:35:07.640 --> 0:35:10.360
<v Speaker 2>And and so I really got I got pulled into

0:35:10.760 --> 0:35:18.600
<v Speaker 2>just the kind of sheer enigma of that and yeah,

0:35:18.719 --> 0:35:21.960
<v Speaker 2>also the power of that of oh wow, if we

0:35:21.960 --> 0:35:24.720
<v Speaker 2>could do this, like if if you know, if I

0:35:24.719 --> 0:35:29.200
<v Speaker 2>imagine being in the shoes of someone who's actually doing

0:35:29.239 --> 0:35:33.239
<v Speaker 2>the AI research and thinking to yourself, I might be

0:35:33.320 --> 0:35:37.279
<v Speaker 2>contributing to the recreation of my own intelligence sort of

0:35:37.280 --> 0:35:40.279
<v Speaker 2>of our collective intelligence. Like that's intoxicating, you.

0:35:40.239 --> 0:35:45.279
<v Speaker 1>Know, feels like philosophy marketing though, because I I just

0:35:45.360 --> 0:35:47.480
<v Speaker 1>look at this stuff and I hear about this stuff,

0:35:47.480 --> 0:35:49.800
<v Speaker 1>and I always think, Okay, but what you're doing today,

0:35:50.640 --> 0:35:52.520
<v Speaker 1>And I look at what they're doing today, and I say,

0:35:52.520 --> 0:35:54.960
<v Speaker 1>that doesn't seem anything like that, And I understand. I

0:35:55.000 --> 0:35:57.880
<v Speaker 1>actually don't think that there's anything harmful in discussing AGI.

0:35:58.120 --> 0:36:00.000
<v Speaker 1>What pisses me off is how many people don't seem

0:36:00.000 --> 0:36:04.400
<v Speaker 1>to be discussing AGI. They discuss the ramifications on the edges.

0:36:04.560 --> 0:36:07.839
<v Speaker 1>Because something that and Casey Kawa, friend of the show,

0:36:07.840 --> 0:36:09.480
<v Speaker 1>has brought up a number of times with me, is like,

0:36:09.560 --> 0:36:12.719
<v Speaker 1>no one seems to be discussing personage, Like if we

0:36:12.800 --> 0:36:15.360
<v Speaker 1>make a conscious computer, do we give it a Social

0:36:15.360 --> 0:36:16.240
<v Speaker 1>Security number?

0:36:16.440 --> 0:36:18.279
<v Speaker 2>That's actually really funny because I think there are too

0:36:18.320 --> 0:36:20.120
<v Speaker 2>many people discussing personage.

0:36:21.160 --> 0:36:23.120
<v Speaker 1>I don't see them in the black. Well, perhaps they're

0:36:23.120 --> 0:36:25.200
<v Speaker 1>not doing it in the media because AGI gets brought

0:36:25.239 --> 0:36:28.040
<v Speaker 1>up as this vague term and then they go, ah,

0:36:28.239 --> 0:36:31.080
<v Speaker 1>what do you think, Yes, could be good, could be bad,

0:36:31.200 --> 0:36:35.280
<v Speaker 1>millions brillion sound fucking And it's just it's so bizarre

0:36:35.400 --> 0:36:39.640
<v Speaker 1>because I look at I've been covering I personally with

0:36:39.680 --> 0:36:42.399
<v Speaker 1>AI really only started looking at it hard in twenty

0:36:42.440 --> 0:36:45.760
<v Speaker 1>twenty three, which is my own fault. And I've looked

0:36:45.760 --> 0:36:48.400
<v Speaker 1>and perhaps that has also colored my belief system because

0:36:49.480 --> 0:36:52.719
<v Speaker 1>I ken looking for the thing, like the stuff, the

0:36:52.800 --> 0:36:54.719
<v Speaker 1>thing that everyone was freaking out about. And you look

0:36:54.719 --> 0:36:58.160
<v Speaker 1>and it's like we've extrapolated from large language models that

0:36:58.960 --> 0:37:01.520
<v Speaker 1>AGI will come out. But actually that kind of leads

0:37:01.560 --> 0:37:05.440
<v Speaker 1>me to another question. You Sam Morton's a confusing person.

0:37:05.480 --> 0:37:09.799
<v Speaker 1>What about Dario Amma Day, Darry Ama Day. What do

0:37:09.840 --> 0:37:12.319
<v Speaker 1>you think does he believe in AGI? You think you

0:37:12.360 --> 0:37:13.560
<v Speaker 1>think he's a true believer.

0:37:14.280 --> 0:37:16.319
<v Speaker 2>I do think Dario is a true believer, yeah, And

0:37:16.360 --> 0:37:18.200
<v Speaker 2>I do think that he's a true duomer as well,

0:37:18.239 --> 0:37:22.920
<v Speaker 2>like he genuinely has a lot of anxiety around the

0:37:23.480 --> 0:37:27.600
<v Speaker 2>AGI creating the end of the world, whether or not,

0:37:28.640 --> 0:37:30.480
<v Speaker 2>and also like what does it mean to be a

0:37:30.480 --> 0:37:31.080
<v Speaker 2>true believer?

0:37:31.200 --> 0:37:34.440
<v Speaker 1>You know, like, does he believe the bollocks he's saying

0:37:34.719 --> 0:37:37.000
<v Speaker 1>because he claims that AGI will be here but twenty

0:37:37.080 --> 0:37:38.360
<v Speaker 1>twenty seven or quicker.

0:37:38.760 --> 0:37:41.719
<v Speaker 2>Yeah, So that then is when he's just wearing his

0:37:41.800 --> 0:37:43.560
<v Speaker 2>CEO hat and he needs to say something.

0:37:43.960 --> 0:37:45.880
<v Speaker 1>When you say wearing the CEO, can you be a

0:37:45.880 --> 0:37:46.719
<v Speaker 1>bit more specific?

0:37:47.800 --> 0:37:52.640
<v Speaker 2>I think Dario is an interesting case in that he

0:37:52.960 --> 0:37:55.759
<v Speaker 2>originally he has a different background than Sam. You know,

0:37:56.040 --> 0:37:59.040
<v Speaker 2>Sam is a VC that or an investor that then

0:37:59.520 --> 0:38:02.239
<v Speaker 2>became the CEO of an AI company, and his skill

0:38:02.280 --> 0:38:06.719
<v Speaker 2>is storytelling, right, That's what all investors do. Dario was,

0:38:07.520 --> 0:38:11.640
<v Speaker 2>he was a scientist. He studied I think computational neuroscience,

0:38:11.840 --> 0:38:14.600
<v Speaker 2>and he had a kind of deep fascination with this

0:38:14.719 --> 0:38:16.920
<v Speaker 2>idea of how do you how do you figure out

0:38:16.920 --> 0:38:18.360
<v Speaker 2>how the brain works and how do you replicate it

0:38:18.400 --> 0:38:20.960
<v Speaker 2>like it was? It was. He didn't initially call himself

0:38:20.960 --> 0:38:23.120
<v Speaker 2>an AI researcher, and I think the early days of

0:38:23.160 --> 0:38:27.440
<v Speaker 2>his academic career, but like he was essentially studying a

0:38:27.480 --> 0:38:31.360
<v Speaker 2>lot of the things that hardcore AI researchers study, the brain,

0:38:32.120 --> 0:38:34.920
<v Speaker 2>computer science, like all all of these things. And so

0:38:35.040 --> 0:38:38.880
<v Speaker 2>I think he has this fascination and I don't know

0:38:38.960 --> 0:38:41.160
<v Speaker 2>this for sure, but I would guess that he is

0:38:41.600 --> 0:38:44.880
<v Speaker 2>of the category of people that I described that believes

0:38:44.880 --> 0:38:47.640
<v Speaker 2>that everything is fundamentally computable in the world, and human

0:38:47.640 --> 0:38:52.319
<v Speaker 2>intelligence is computable, and so he does really believe that

0:38:52.440 --> 0:38:55.640
<v Speaker 2>if he can figure it out like AGI will happen.

0:38:57.080 --> 0:39:00.600
<v Speaker 2>But then he has to run a company, and a

0:39:00.640 --> 0:39:02.600
<v Speaker 2>company can't just do science. And actually, one of the

0:39:02.640 --> 0:39:08.920
<v Speaker 2>things that people mentioned to me about their criticisms of

0:39:09.000 --> 0:39:12.560
<v Speaker 2>Daria when he initially ran Anthropic was that he didn't

0:39:12.600 --> 0:39:15.000
<v Speaker 2>care about the business at all, Like he seemed to

0:39:15.040 --> 0:39:19.120
<v Speaker 2>have no interest in anything other than the science. And

0:39:19.200 --> 0:39:21.640
<v Speaker 2>there were people within the company that were like, this

0:39:21.760 --> 0:39:23.680
<v Speaker 2>is not going to work as a company if you

0:39:23.920 --> 0:39:28.319
<v Speaker 2>cannot literally do business, if you cannot raise money, And

0:39:28.360 --> 0:39:33.759
<v Speaker 2>so I think what happened I didn't actually report this out,

0:39:33.800 --> 0:39:36.080
<v Speaker 2>but my guess is what happened is Dario then had

0:39:36.120 --> 0:39:39.720
<v Speaker 2>to shift to not just being a scientist but also

0:39:39.960 --> 0:39:43.360
<v Speaker 2>being a businessman, and he had to learn how to storytell,

0:39:43.440 --> 0:39:48.400
<v Speaker 2>and is he and I think honestly he tries to.

0:39:49.120 --> 0:39:51.719
<v Speaker 2>You know, Sam Altman is a really successful storyteller and

0:39:52.200 --> 0:39:54.760
<v Speaker 2>able to accreu a out of capital. I think Dario

0:39:55.080 --> 0:39:59.960
<v Speaker 2>tries to match the stories that Altman tells in order

0:40:00.160 --> 0:40:03.040
<v Speaker 2>to try and accrue the same amount of capital and

0:40:03.280 --> 0:40:07.000
<v Speaker 2>try to take capital away. Maybe because ultimately they are

0:40:07.320 --> 0:40:12.120
<v Speaker 2>personal archite nemesis and anthropic and open AI are competiti.

0:40:11.880 --> 0:40:13.719
<v Speaker 1>Hate each other so much? Is it just because Sam

0:40:13.760 --> 0:40:16.399
<v Speaker 1>Wlman doesn't like the Warrio walked off?

0:40:19.239 --> 0:40:24.120
<v Speaker 2>I don't know that Sam. I. I can't figure out

0:40:24.160 --> 0:40:30.200
<v Speaker 2>whether Sam genuinely ever hates anyone, but people certainly hate him,

0:40:30.280 --> 0:40:35.640
<v Speaker 2>and Dario hates him for sure. I think it goes

0:40:35.680 --> 0:40:38.920
<v Speaker 2>back to this idea of do you agree or do

0:40:38.960 --> 0:40:41.759
<v Speaker 2>you disagree with Sam about something fundamental and therefore do

0:40:41.800 --> 0:40:43.880
<v Speaker 2>you perceive him as the greatest asset ever or the

0:40:43.880 --> 0:40:47.840
<v Speaker 2>greatest threat ever? And from in Dario's case, he fundamentally

0:40:47.920 --> 0:40:57.000
<v Speaker 2>disagreed with Sam about certain key decisions around safety AAI safety,

0:40:57.080 --> 0:41:01.000
<v Speaker 2>the Dumer, the Dumer brand of AI safety, where they

0:41:01.280 --> 0:41:06.000
<v Speaker 2>Daria was the one that decided to blow up the

0:41:06.040 --> 0:41:08.000
<v Speaker 2>amount of computer chips that were being used to train

0:41:08.040 --> 0:41:10.719
<v Speaker 2>a single model. So he did that. From GPT two

0:41:10.760 --> 0:41:12.840
<v Speaker 2>to GPT three, they went from a couple dozen chips

0:41:13.280 --> 0:41:16.440
<v Speaker 2>to ten thousand chips all at once to train GPT

0:41:16.560 --> 0:41:20.240
<v Speaker 2>three and Daria wanted to do this because he wanted

0:41:20.360 --> 0:41:24.160
<v Speaker 2>to create an internal lead in order to then have

0:41:24.480 --> 0:41:28.080
<v Speaker 2>some time to do research on this model that would

0:41:28.120 --> 0:41:31.920
<v Speaker 2>emerge from ten thousand chips. And Allmann does this thing

0:41:31.960 --> 0:41:34.920
<v Speaker 2>where he will convince, he will ally with people, so

0:41:35.520 --> 0:41:37.560
<v Speaker 2>he was like, oh, ten thousand chips, that just a

0:41:37.600 --> 0:41:40.919
<v Speaker 2>brilliant idea. We should totally do that. But then once

0:41:40.960 --> 0:41:45.080
<v Speaker 2>it was done, he sort of shifted to, Okay, now

0:41:45.080 --> 0:41:46.759
<v Speaker 2>we should release it, or now we should give it

0:41:46.800 --> 0:41:49.360
<v Speaker 2>to Microsoft because we have this deal with Microsoft. We

0:41:49.400 --> 0:41:51.799
<v Speaker 2>need to make them happy. We need to give them

0:41:51.840 --> 0:41:56.080
<v Speaker 2>some kind of really exciting thing deliverable to justify the

0:41:56.160 --> 0:41:58.080
<v Speaker 2>first one billion dollars they gave us so that they

0:41:58.080 --> 0:42:01.640
<v Speaker 2>can then give us more money. And so it was

0:42:01.680 --> 0:42:04.160
<v Speaker 2>actually it was like the two It was both Altman

0:42:04.360 --> 0:42:09.439
<v Speaker 2>and Amoday together that I would credit as being responsible

0:42:09.520 --> 0:42:14.360
<v Speaker 2>for dramatically accelerating the AI race, because Amoday was the

0:42:14.360 --> 0:42:16.680
<v Speaker 2>one that decided we need to blow it up to

0:42:16.680 --> 0:42:19.160
<v Speaker 2>ten thousand chips, and then Altman was the one that

0:42:19.200 --> 0:42:22.120
<v Speaker 2>persuaded him, yes, you should do it because I agree

0:42:22.120 --> 0:42:24.279
<v Speaker 2>with you, and then kind of flipped to, Okay, now

0:42:24.280 --> 0:42:25.480
<v Speaker 2>we need to get this out in the world as

0:42:25.560 --> 0:42:34.319
<v Speaker 2>quickly as possible, and amoday I think feels like his

0:42:34.600 --> 0:42:39.960
<v Speaker 2>intelligent Like Altman, as a politically savvy person, was able

0:42:40.000 --> 0:42:45.080
<v Speaker 2>to use his intelligence against him to achieve exactly the

0:42:45.120 --> 0:42:50.600
<v Speaker 2>opposite of what he ultimately wanted, which was to slow Yeah,

0:42:50.640 --> 0:42:52.360
<v Speaker 2>to slow things down rather than accelerate it.

0:42:53.000 --> 0:42:56.399
<v Speaker 1>This sounds like colonial This sounds like colonial Britain. It's

0:42:56.480 --> 0:42:59.360
<v Speaker 1>just white guys getting angry at each other over tiny

0:42:59.480 --> 0:43:04.000
<v Speaker 1>grievance is from years ago. Here's a weird question. Well,

0:43:04.000 --> 0:43:06.040
<v Speaker 1>first of all, do any of them seem happy in

0:43:06.080 --> 0:43:08.800
<v Speaker 1>any way? Do any of them seem to enjoy anything?

0:43:08.880 --> 0:43:12.759
<v Speaker 1>I asked this seriously, I genuinely do they seem miserable?

0:43:12.880 --> 0:43:15.880
<v Speaker 1>That is the consistent theme from all of Jack Clark included.

0:43:16.600 --> 0:43:21.440
<v Speaker 1>They all seem pissed off, scared, paranoid. Weird. It's that

0:43:21.520 --> 0:43:23.160
<v Speaker 1>they're being driven mad by this.

0:43:23.280 --> 0:43:28.440
<v Speaker 2>Yeah, yeah, yeah, I think that is an entirely accurate description.

0:43:28.760 --> 0:43:33.879
<v Speaker 2>I think you cannot be not driven mad in this

0:43:34.000 --> 0:43:38.080
<v Speaker 2>world where you have convinced yourself that the stakes are

0:43:38.120 --> 0:43:41.880
<v Speaker 2>the future of humanity. You know, like, how do you

0:43:41.920 --> 0:43:43.280
<v Speaker 2>not buckle under that pressure?

0:43:44.160 --> 0:43:46.960
<v Speaker 1>I mean, skill issue? I think I'd be fine give

0:43:47.000 --> 0:43:50.439
<v Speaker 1>me one billion dollars. But it does make me think

0:43:50.480 --> 0:43:53.319
<v Speaker 1>that right now as and Bloomberg came out with the

0:43:53.320 --> 0:43:56.960
<v Speaker 1>headline just as we're recording this, that Stargate soft Banks,

0:43:56.960 --> 0:44:01.239
<v Speaker 1>Stargate is hitting snags over pariff is they can't seem

0:44:01.280 --> 0:44:04.920
<v Speaker 1>to raise the money. I wonder if we're going to

0:44:04.960 --> 0:44:09.080
<v Speaker 1>see new levels of paranoia anxiety with all of these

0:44:09.080 --> 0:44:12.080
<v Speaker 1>people as the AI trade starts to collapse a bit.

0:44:13.920 --> 0:44:19.120
<v Speaker 2>Yeah, this has been an interesting theme that I've picked

0:44:19.200 --> 0:44:22.080
<v Speaker 2>up on with the way that Alman operates is when

0:44:22.640 --> 0:44:28.920
<v Speaker 2>he starts sounding incredibly optimistic in public about the future

0:44:29.040 --> 0:44:31.200
<v Speaker 2>of open AI, the future of AGI, the future of

0:44:31.200 --> 0:44:34.520
<v Speaker 2>all these things, it means that something is going wrong.

0:44:35.160 --> 0:44:40.759
<v Speaker 2>Like it's become the opposite signal, because he will roll

0:44:40.800 --> 0:44:44.040
<v Speaker 2>out the most grandiose language when he needs to cover

0:44:44.200 --> 0:44:51.160
<v Speaker 2>up something that is really stressing him out. And so

0:44:51.560 --> 0:44:55.000
<v Speaker 2>we're seeing, you know, like this happening again more recently

0:44:55.040 --> 0:44:57.520
<v Speaker 2>where I mean, in the beginning of the year, he

0:44:57.600 --> 0:45:00.239
<v Speaker 2>had this post where he was like, we we are

0:45:00.239 --> 0:45:04.480
<v Speaker 2>no longer just building AGI, we are now on our

0:45:04.520 --> 0:45:06.960
<v Speaker 2>path to building superintelligence. Like he was sort of like

0:45:07.040 --> 0:45:11.640
<v Speaker 2>upping the ante saying okay, could continue to hold on

0:45:12.120 --> 0:45:14.760
<v Speaker 2>could continue to stay with the program because we're about

0:45:14.800 --> 0:45:21.600
<v Speaker 2>to uh supercharge turbocharged this like ten times more. And

0:45:22.000 --> 0:45:24.160
<v Speaker 2>it was like at the time when Opening Eye was

0:45:24.960 --> 0:45:28.360
<v Speaker 2>starting to really feel weak because it had just lost

0:45:28.400 --> 0:45:31.720
<v Speaker 2>a string of executives, including some of its most important

0:45:31.760 --> 0:45:35.839
<v Speaker 2>ones Elias ask Govern and Miramurati, and it was under

0:45:36.000 --> 0:45:38.080
<v Speaker 2>just a massive amount of scrutiny and it wasn't making

0:45:38.120 --> 0:45:40.279
<v Speaker 2>the clip of research progress that it needed to kind

0:45:40.320 --> 0:45:45.080
<v Speaker 2>of solve what it itself defined as the key challenges

0:45:45.160 --> 0:45:49.400
<v Speaker 2>to reaching AGI and so yeah, so I think the

0:45:49.400 --> 0:45:53.440
<v Speaker 2>more that that that it sort of becomes clear that

0:45:53.520 --> 0:45:57.560
<v Speaker 2>people are no longer really buying into this AI future

0:45:57.600 --> 0:46:00.680
<v Speaker 2>that they've painted. The stronger they're going to painted, the

0:46:00.680 --> 0:46:02.800
<v Speaker 2>more they're going to roll out this rhetoric.

0:46:03.840 --> 0:46:06.000
<v Speaker 1>You mentioned this because there was a tweet from April

0:46:06.080 --> 0:46:09.200
<v Speaker 1>fifteenth where he said, the Open Ai team is executing

0:46:09.280 --> 0:46:11.520
<v Speaker 1>just ridiculously well at so many things right now. The

0:46:11.560 --> 0:46:13.400
<v Speaker 1>coming months and years should be amazing. So I'm going

0:46:13.440 --> 0:46:16.080
<v Speaker 1>to guess things were bad. Yeah, Yeah, I mean, like

0:46:16.200 --> 0:46:18.799
<v Speaker 1>cool read Sam's tweets.

0:46:19.120 --> 0:46:22.640
<v Speaker 2>Yeah, this was like a thing that I just consistently,

0:46:22.719 --> 0:46:25.560
<v Speaker 2>consistently every time I was reporting on things that were

0:46:25.560 --> 0:46:29.120
<v Speaker 2>going really bad, sure enough Altman would roll out some

0:46:29.200 --> 0:46:33.960
<v Speaker 2>kind of like really crazy, some really crazy yeah statement

0:46:34.040 --> 0:46:37.359
<v Speaker 2>out in public. So that was actually that tweet's actually

0:46:37.400 --> 0:46:40.960
<v Speaker 2>a perfect example because he says things will be awesome

0:46:40.960 --> 0:46:44.640
<v Speaker 2>in the coming months and years. It's always like hold on,

0:46:44.960 --> 0:46:48.440
<v Speaker 2>stick with me, Yeah, stick with me. Things might look

0:46:48.440 --> 0:46:51.279
<v Speaker 2>a little bit weird now, but oh boy, like just

0:46:51.400 --> 0:46:54.600
<v Speaker 2>you wait for what I'm seeing inside that like you

0:46:54.719 --> 0:46:57.759
<v Speaker 2>need to just have patience for you know. It's it's always.

0:46:57.400 --> 0:47:00.719
<v Speaker 1>That kind of May seventh picture, It's great to see

0:47:00.719 --> 0:47:02.960
<v Speaker 1>progress on the first Star Gay in Abilene with our

0:47:03.000 --> 0:47:04.880
<v Speaker 1>partners at Oracle. Today will be the biggest day I

0:47:05.000 --> 0:47:07.319
<v Speaker 1>training facility in the world. The scale, speed and skill

0:47:07.560 --> 0:47:09.839
<v Speaker 1>of the people building this is awesome. And then this

0:47:09.880 --> 0:47:13.279
<v Speaker 1>story comes out a week later, bloody hell. This does

0:47:13.960 --> 0:47:16.400
<v Speaker 1>so final question, how do you feel? What do you

0:47:16.440 --> 0:47:19.680
<v Speaker 1>think this fijisimo? Forgive me if I messed up the

0:47:19.760 --> 0:47:22.120
<v Speaker 1>name there. What do you think about her becoming CEO

0:47:22.200 --> 0:47:26.640
<v Speaker 1>of Applications and Sam Altman doing something else? Yeah?

0:47:26.680 --> 0:47:29.960
<v Speaker 2>So I haven't actually I haven't actually done reporting on

0:47:29.960 --> 0:47:34.120
<v Speaker 2>this myself, but my sense of what happening, what's happening

0:47:34.280 --> 0:47:37.880
<v Speaker 2>is Altmand's not a good manager. He's not actually like

0:47:37.960 --> 0:47:40.319
<v Speaker 2>he's a he's a fundraising CEO. He's not someone that

0:47:40.360 --> 0:47:44.920
<v Speaker 2>can run the company. And I think probably what happened

0:47:45.560 --> 0:47:49.520
<v Speaker 2>is that after Miramrati left, she was the one that

0:47:49.640 --> 0:47:51.960
<v Speaker 2>was actually doing the actually the day to day operations

0:47:52.000 --> 0:47:54.640
<v Speaker 2>and the running of the show. After she left, he

0:47:54.719 --> 0:47:57.480
<v Speaker 2>then made a big show of I'm going to be

0:47:57.640 --> 0:48:00.480
<v Speaker 2>much more close to the the work. Wow, I'm going

0:48:00.520 --> 0:48:03.840
<v Speaker 2>to do the day to day running. And probably his

0:48:03.960 --> 0:48:08.720
<v Speaker 2>time is up in doing that because what in my book,

0:48:08.719 --> 0:48:12.520
<v Speaker 2>I like talk a lot about how like he's not

0:48:12.640 --> 0:48:15.680
<v Speaker 2>good at that, like he is he will he's not

0:48:15.719 --> 0:48:18.560
<v Speaker 2>good at making decisions. He's very conflict averse. So what

0:48:18.640 --> 0:48:21.120
<v Speaker 2>he does is he'll just say he'll agree with every

0:48:21.120 --> 0:48:23.440
<v Speaker 2>single team even when they're disagreeing with one another. And

0:48:23.520 --> 0:48:27.200
<v Speaker 2>it causes chaos, and it causes riffs where you don't

0:48:27.239 --> 0:48:29.919
<v Speaker 2>the person at the top is not able to make

0:48:29.960 --> 0:48:31.759
<v Speaker 2>a decision and say we are all going to go

0:48:31.840 --> 0:48:33.200
<v Speaker 2>this way now and some of you are going to

0:48:33.200 --> 0:48:35.360
<v Speaker 2>be unhappy. Like he does not do that, and so

0:48:35.960 --> 0:48:38.440
<v Speaker 2>it just leads to a lot of tumult chaos. Part

0:48:38.520 --> 0:48:41.040
<v Speaker 2>of the reason why Opening Eye has had so many

0:48:41.080 --> 0:48:44.560
<v Speaker 2>product releases and features and things like that. I think

0:48:44.640 --> 0:48:47.719
<v Speaker 2>is actually also a product of this in that he

0:48:47.760 --> 0:48:50.560
<v Speaker 2>doesn't want to tell any team, like all of these

0:48:50.719 --> 0:48:53.600
<v Speaker 2>product releases and features are different teams working on these things,

0:48:53.880 --> 0:48:56.359
<v Speaker 2>and he doesn't want to tell any team like we're

0:48:56.360 --> 0:48:58.680
<v Speaker 2>going to have this person release first and have their

0:48:58.719 --> 0:49:00.919
<v Speaker 2>moment in the sun, and then we're gonna like work

0:49:00.960 --> 0:49:02.759
<v Speaker 2>a little bit more and then you get your moment

0:49:02.840 --> 0:49:05.000
<v Speaker 2>in the sun, you know, a year later. He's like

0:49:05.239 --> 0:49:07.560
<v Speaker 2>everyone gets their moment in the sun. Like we're gonna

0:49:07.600 --> 0:49:11.080
<v Speaker 2>do releases. We're gonna do like twelve days of ship Miss.

0:49:11.520 --> 0:49:15.520
<v Speaker 2>We're gonna just release. That was insane case in twelve

0:49:15.640 --> 0:49:17.240
<v Speaker 2>days twelve.

0:49:17.080 --> 0:49:20.160
<v Speaker 1>Days of ship Miss for the listeners that don't remember,

0:49:20.200 --> 0:49:21.839
<v Speaker 1>that was when they claimed they were going to release

0:49:21.880 --> 0:49:24.000
<v Speaker 1>twelve new twelve new products.

0:49:23.640 --> 0:49:25.200
<v Speaker 2>Twelve new products over the twelve.

0:49:25.000 --> 0:49:27.680
<v Speaker 1>And it wasn't twelve new. It was like four new products,

0:49:28.040 --> 0:49:30.040
<v Speaker 1>and like some of them were like an API for

0:49:30.080 --> 0:49:33.319
<v Speaker 1>an API. It's just so strange. It feels like, while

0:49:33.360 --> 0:49:38.439
<v Speaker 1>you're also describing an empire, you're also describing this kind

0:49:38.440 --> 0:49:43.000
<v Speaker 1>of very petty underpa. It really does mirror British colonialisten right,

0:49:43.840 --> 0:49:45.719
<v Speaker 1>You've got a guy who doesn't want to rule, who

0:49:45.800 --> 0:49:48.440
<v Speaker 1>wants the power of a ruler and all the assets,

0:49:48.680 --> 0:49:53.759
<v Speaker 1>but someone else, ideally in another country, should take responsibility. Yeah,

0:49:54.239 --> 0:49:55.120
<v Speaker 1>truly awful.

0:49:55.960 --> 0:49:58.080
<v Speaker 2>I mean this is a paradox of empire. Is like

0:49:58.360 --> 0:50:02.160
<v Speaker 2>it feels inevitable, well because it feels so strong and

0:50:02.360 --> 0:50:04.720
<v Speaker 2>it also feels so weak when you start to look

0:50:05.000 --> 0:50:06.040
<v Speaker 2>at an end of the surface.

0:50:07.440 --> 0:50:10.280
<v Speaker 1>It's it was a really great book, and I really

0:50:10.280 --> 0:50:12.279
<v Speaker 1>appreciate your time. Where can people find you?

0:50:13.440 --> 0:50:16.160
<v Speaker 2>I am on LinkedIn and blue sky these days, and

0:50:16.320 --> 0:50:20.719
<v Speaker 2>also on my website karindhow dot com and Yeah reach out.

0:50:20.880 --> 0:50:22.279
<v Speaker 2>I have a contact for him there and I try

0:50:22.280 --> 0:50:24.120
<v Speaker 2>to respond to as many people as possible.

0:50:24.800 --> 0:50:26.800
<v Speaker 1>Wonderful. Thank you so much for joining us. I'm of

0:50:26.880 --> 0:50:28.840
<v Speaker 1>course aid zechro on. You'll now get a thing I

0:50:28.880 --> 0:50:31.479
<v Speaker 1>recorded over a year ago that people still complain about about.

0:50:31.480 --> 0:50:42.920
<v Speaker 1>Where you can find stuff. Thank you for listening. Thank

0:50:43.000 --> 0:50:45.719
<v Speaker 1>you for listening to Better Offline. The editor and composer

0:50:45.760 --> 0:50:48.560
<v Speaker 1>of the Better Offline theme song is Matasowski. You can

0:50:48.640 --> 0:50:51.000
<v Speaker 1>check out more of his music and audio projects at

0:50:51.000 --> 0:50:54.480
<v Speaker 1>Matasowski dot com. M A T T O s O

0:50:55.160 --> 0:50:58.640
<v Speaker 1>W s KI dot com. You can email me an

0:50:58.640 --> 0:51:01.480
<v Speaker 1>easy at better offline dot com or visit better Offline

0:51:01.520 --> 0:51:03.600
<v Speaker 1>dot com to find more podcast links and of course

0:51:03.640 --> 0:51:06.759
<v Speaker 1>my newsletter. I also really recommend you go to chat

0:51:06.760 --> 0:51:09.440
<v Speaker 1>dot Where's youread dot at to visit the discord, and

0:51:09.440 --> 0:51:12.160
<v Speaker 1>go to our slash Better Offline to check out our reddit.

0:51:12.920 --> 0:51:14.280
<v Speaker 1>Thank you so much for listening.

0:51:15.120 --> 0:51:17.840
<v Speaker 3>Better Offline is a production of cool Zone Media. For

0:51:17.920 --> 0:51:21.080
<v Speaker 3>more from cool Zone Media, visit our website cool Zonemedia

0:51:21.160 --> 0:51:24.000
<v Speaker 3>dot com, or check us out on the iHeartRadio app,

0:51:24.040 --> 0:51:26.760
<v Speaker 3>Apple Podcasts, or wherever you get your podcasts.