WEBVTT - Why Animal Rights Advocates Are Investigating AI Consciousness - Week in Tech

0:00:11.800 --> 0:00:15.320
<v Speaker 1>So you've all likely heard about Tilly Norwood, the first

0:00:15.480 --> 0:00:20.159
<v Speaker 1>ai A lister. Her creator just announced that Tilly is

0:00:20.160 --> 0:00:24.079
<v Speaker 1>about to star in her first feature film. Taylor and Natasha,

0:00:24.120 --> 0:00:26.200
<v Speaker 1>your face is a quite a picture.

0:00:26.520 --> 0:00:28.280
<v Speaker 2>This is just a fake PR thing.

0:00:28.640 --> 0:00:31.360
<v Speaker 3>Wait, Taylor, do you remember when all the editors wanted

0:00:31.360 --> 0:00:33.800
<v Speaker 3>you to like interview Little Michayla.

0:00:34.560 --> 0:00:39.320
<v Speaker 1>Yeah, I've met Lit Michayla's creator, Trevor.

0:00:39.560 --> 0:00:40.160
<v Speaker 2>I know Trevor.

0:00:40.200 --> 0:00:41.880
<v Speaker 4>I've known Trevor for a long time. I have the

0:00:41.880 --> 0:00:44.839
<v Speaker 4>girl that Little Michaela was designed off of. I But

0:00:45.280 --> 0:00:48.559
<v Speaker 4>with all due respect, love Trevor. But guys, this is

0:00:48.600 --> 0:00:49.000
<v Speaker 4>just PR.

0:00:49.120 --> 0:00:49.720
<v Speaker 2>It's just PR.

0:00:54.440 --> 0:00:56.920
<v Speaker 1>Welcome to tech stuff. I'm Maza Velosa and this is

0:00:56.960 --> 0:00:59.319
<v Speaker 1>the Weekend Tech, where I'm joined by the world's most

0:00:59.360 --> 0:01:02.240
<v Speaker 1>plugged in report is to break down what's really happening

0:01:02.240 --> 0:01:05.280
<v Speaker 1>in tech right now. Today, we're joined by Taylor Lorenz

0:01:05.319 --> 0:01:08.600
<v Speaker 1>of User mag Read Abrigotti, tech editor for Semiphore, and

0:01:08.680 --> 0:01:11.279
<v Speaker 1>Natasha Tku, tech reporter at the Washington Post.

0:01:11.360 --> 0:01:12.520
<v Speaker 5>Welcome, Well, how's it going.

0:01:12.760 --> 0:01:13.800
<v Speaker 2>Thanks for having us.

0:01:13.880 --> 0:01:14.720
<v Speaker 3>Nice to be back.

0:01:15.120 --> 0:01:18.240
<v Speaker 1>Natasha. You recently published an article that got to number one,

0:01:18.319 --> 0:01:21.800
<v Speaker 1>I think in the in the Washington post algorithm. The

0:01:21.840 --> 0:01:24.720
<v Speaker 1>subheads of the story is anthropic. Google and Meta have

0:01:24.840 --> 0:01:29.760
<v Speaker 1>hired computer scientists, neuroscientists, and philosophers to study what some

0:01:29.840 --> 0:01:34.200
<v Speaker 1>in the industry think may become a moral crisis. The

0:01:34.240 --> 0:01:36.200
<v Speaker 1>story is about AI consciousness.

0:01:36.959 --> 0:01:37.440
<v Speaker 5>What is that?

0:01:40.120 --> 0:01:42.840
<v Speaker 3>Oh, start with the hard one. Huh. You know, it's

0:01:42.920 --> 0:01:48.040
<v Speaker 3>this idea that has percolated in the back of the

0:01:48.200 --> 0:01:51.720
<v Speaker 3>AI industry, like on the fringes for decades. You know,

0:01:51.800 --> 0:01:56.360
<v Speaker 3>the same people who hope to upload their consciousness one

0:01:56.480 --> 0:02:00.000
<v Speaker 3>day or you know, become transhuman and merge with machine

0:02:00.240 --> 0:02:04.600
<v Speaker 3>also anticipated this idea that you know, sufficiently advanced AI

0:02:04.960 --> 0:02:10.760
<v Speaker 3>would have subjective experiences and goals and preferences, just like

0:02:11.400 --> 0:02:15.160
<v Speaker 3>human beings. And you know, I first got interested in

0:02:15.160 --> 0:02:18.359
<v Speaker 3>this subject four years ago, Like it was a few

0:02:18.360 --> 0:02:20.679
<v Speaker 3>months before chat chipet came out, and I wrote a

0:02:20.720 --> 0:02:24.320
<v Speaker 3>story about this Google engineer who believed the company's large

0:02:24.360 --> 0:02:28.480
<v Speaker 3>language model was sentient, was conscious in some way, and

0:02:28.560 --> 0:02:29.160
<v Speaker 3>he got fired.

0:02:29.240 --> 0:02:32.320
<v Speaker 1>Right, he was a whistleblower or is that right?

0:02:32.440 --> 0:02:34.239
<v Speaker 3>I think that's fair to say, Yeah, I'm.

0:02:34.120 --> 0:02:37.200
<v Speaker 1>Not a whistleblower per se. He viewed himself as a whistleblower.

0:02:37.200 --> 0:02:38.440
<v Speaker 1>Others viewed him as crazy.

0:02:38.760 --> 0:02:42.000
<v Speaker 3>I think that's also fair to say. Yeah, so he

0:02:42.360 --> 0:02:44.000
<v Speaker 3>you know, at the time, none of us had like

0:02:44.200 --> 0:02:46.520
<v Speaker 3>it wasn't public, You couldn't like talk to these very

0:02:46.560 --> 0:02:49.160
<v Speaker 3>human like machines. So I thought, you know, it was

0:02:49.520 --> 0:02:53.560
<v Speaker 3>a kind of response to this technology designed to sound

0:02:53.720 --> 0:02:56.840
<v Speaker 3>like a human and you know, often used first person

0:02:56.960 --> 0:03:01.520
<v Speaker 3>and refer to its own experiences. And I think after

0:03:01.600 --> 0:03:04.760
<v Speaker 3>that the tech companies stepped back a little bit. You know,

0:03:04.800 --> 0:03:07.840
<v Speaker 3>they wanted people to adopt their very productive tool. They

0:03:07.840 --> 0:03:10.239
<v Speaker 3>were showing all the practical use cases. And I would

0:03:10.280 --> 0:03:14.080
<v Speaker 3>say over the last year or so for Anthropic and

0:03:14.120 --> 0:03:18.160
<v Speaker 3>then the last few months for other companies, Google, Meta

0:03:19.000 --> 0:03:23.240
<v Speaker 3>and Anthropic have really embraced this idea in public. I mean,

0:03:23.240 --> 0:03:26.200
<v Speaker 3>we've talked on the show before about Chris Ola, the

0:03:26.480 --> 0:03:30.040
<v Speaker 3>Anthropic co founder, talking about, you know, can chat pots

0:03:30.120 --> 0:03:35.040
<v Speaker 3>have experience emotions and you know, joy and despair on

0:03:35.400 --> 0:03:38.560
<v Speaker 3>stage at the Vatican a few seats away from the Pope, and.

0:03:38.480 --> 0:03:40.160
<v Speaker 1>As you point out your story that was a point

0:03:40.200 --> 0:03:42.000
<v Speaker 1>of difference between him and the Pope because the Pope

0:03:42.000 --> 0:03:43.640
<v Speaker 1>expelicitically said no, right.

0:03:43.560 --> 0:03:47.200
<v Speaker 3>Yeah, exactly, Like it's still unclear who was who got

0:03:47.200 --> 0:03:49.720
<v Speaker 3>the upper hand there. And who was using who you

0:03:49.760 --> 0:03:53.000
<v Speaker 3>know to push their their message. But yeah, I mean

0:03:53.040 --> 0:03:55.400
<v Speaker 3>they really just don't shy away from it now. Like

0:03:55.560 --> 0:04:00.200
<v Speaker 3>Anthropic talks about its AI psychiatry team. You know, they

0:04:00.280 --> 0:04:03.760
<v Speaker 3>hired this guy, Kyle Fish, who actually used to work

0:04:03.880 --> 0:04:09.080
<v Speaker 3>in like bioengineering for meat replacement, but now he's their

0:04:09.080 --> 0:04:12.600
<v Speaker 3>head of model welfare and thinking about like changes that

0:04:12.640 --> 0:04:18.720
<v Speaker 3>the company could potentially make to ensure that if they

0:04:18.760 --> 0:04:21.600
<v Speaker 3>find out that the models are conscious, they're meeting their

0:04:21.680 --> 0:04:27.400
<v Speaker 3>like moral obligation. It just very quickly goes to analogies

0:04:27.600 --> 0:04:33.680
<v Speaker 3>around slavery and genocide or factory farming. So so you know,

0:04:33.839 --> 0:04:37.920
<v Speaker 3>and from the mouth of these executives at the tech companies.

0:04:37.960 --> 0:04:41.000
<v Speaker 6>So I just he's still in the meat replacement industry.

0:04:41.120 --> 0:04:47.200
<v Speaker 6>Apparently I just thrown a dad joke.

0:04:47.600 --> 0:04:50.400
<v Speaker 1>Farewell to us some meat puppets read tailor I mean,

0:04:50.440 --> 0:04:51.960
<v Speaker 1>what do you do you think this is on behalf

0:04:52.000 --> 0:04:55.240
<v Speaker 1>of the technology companies are kind of legitimate and even

0:04:55.279 --> 0:04:58.240
<v Speaker 1>necessary line of inquiry or do you think this is

0:04:58.400 --> 0:05:02.960
<v Speaker 1>kind of you know, or a boros kind of snaky

0:05:03.040 --> 0:05:05.440
<v Speaker 1>in its own tail of falling in love without creations?

0:05:05.520 --> 0:05:06.600
<v Speaker 5>Yet again, I.

0:05:06.560 --> 0:05:09.640
<v Speaker 4>Think it's deranged. I don't think there's any world in

0:05:09.680 --> 0:05:12.479
<v Speaker 4>which an LM is conscious. It reminds me of that

0:05:12.880 --> 0:05:15.960
<v Speaker 4>rain Fisher Kwandswait after a judge of et came out

0:05:16.000 --> 0:05:19.479
<v Speaker 4>where she typed, you know, typing I'm evil in a

0:05:19.520 --> 0:05:23.800
<v Speaker 4>Google doc and getting scared. Basically, I think this is

0:05:23.880 --> 0:05:25.320
<v Speaker 4>very silly, and I think it's going to blow up

0:05:25.320 --> 0:05:27.920
<v Speaker 4>in their faces. I think this is completely going to

0:05:28.000 --> 0:05:31.360
<v Speaker 4>give consumers the wrong idea. The more that people consider

0:05:31.400 --> 0:05:33.560
<v Speaker 4>this thing sentient, the more they're going to sort of

0:05:34.279 --> 0:05:37.960
<v Speaker 4>basically expect it to have a morality and a moral compass,

0:05:37.960 --> 0:05:39.839
<v Speaker 4>and it's never going to be able to do that.

0:05:40.400 --> 0:05:43.800
<v Speaker 6>Yeah, these these companies have now, you know, put a

0:05:43.800 --> 0:05:46.200
<v Speaker 6>lot of guardrails around these things so that they don't

0:05:46.240 --> 0:05:50.040
<v Speaker 6>actually sort of seem as human like, as sentient as

0:05:50.680 --> 0:05:52.919
<v Speaker 6>as they probably would if you use these things with

0:05:53.040 --> 0:05:56.479
<v Speaker 6>like you know, with the raw model, they sort of

0:05:56.720 --> 0:05:59.920
<v Speaker 6>they're a lot more human like and a lot crazier honestly.

0:06:00.600 --> 0:06:03.520
<v Speaker 6>So they I think it's it's like, I think, hard

0:06:03.520 --> 0:06:07.120
<v Speaker 6>for us to understand like what people like the guy

0:06:07.200 --> 0:06:10.039
<v Speaker 6>you wrote about four years ago we're seeing, I think,

0:06:10.440 --> 0:06:14.159
<v Speaker 6>But it is ultimately just you know, text prediction, right,

0:06:14.240 --> 0:06:17.440
<v Speaker 6>There's nothing sentient about it. I think that I think

0:06:17.440 --> 0:06:20.280
<v Speaker 6>these companies are I mean a lot of these people

0:06:20.360 --> 0:06:22.840
<v Speaker 6>inside them are. They're very genuine people and they do

0:06:22.920 --> 0:06:26.080
<v Speaker 6>have these concerns, but they're also like, in a way,

0:06:26.080 --> 0:06:28.919
<v Speaker 6>it's marketing because it's like these things are going to

0:06:29.160 --> 0:06:32.159
<v Speaker 6>end up being so intelligent, they're going to get to

0:06:32.240 --> 0:06:34.920
<v Speaker 6>human like intelligent, what do we do? What do we

0:06:34.960 --> 0:06:38.159
<v Speaker 6>do when we get there? And like we may never

0:06:38.200 --> 0:06:41.760
<v Speaker 6>get there, right, it's not ultimately it may not ultimately

0:06:41.760 --> 0:06:44.799
<v Speaker 6>be possible to even build what they're sort of concerned about.

0:06:44.920 --> 0:06:46.480
<v Speaker 6>I think that's another way of looking at it.

0:06:46.680 --> 0:06:49.360
<v Speaker 1>Natasha, you write a real piece at the search for

0:06:49.480 --> 0:06:53.320
<v Speaker 1>machine consciousness is practically mainstream. Do you mean mainstream within

0:06:53.400 --> 0:06:56.160
<v Speaker 1>the type of technology companies or yes.

0:06:55.960 --> 0:06:59.440
<v Speaker 3>Yeah, yeah, I mean but the fact that it's happening

0:06:59.480 --> 0:07:04.120
<v Speaker 3>in peril well, with so many people asking whether or not,

0:07:04.440 --> 0:07:06.880
<v Speaker 3>you know, the chatbot that they're talking to every day

0:07:07.120 --> 0:07:10.080
<v Speaker 3>is alive in some way or human in some way,

0:07:10.520 --> 0:07:13.840
<v Speaker 3>I just find that remarkable. I mean, I think you

0:07:13.880 --> 0:07:16.200
<v Speaker 3>know what Taylor said about it, coming back to bite

0:07:16.240 --> 0:07:19.360
<v Speaker 3>the companies is super interesting because I wanted to write

0:07:19.360 --> 0:07:21.920
<v Speaker 3>about this because it is a prelude to an argument

0:07:22.040 --> 0:07:26.920
<v Speaker 3>about personhood and rights for the AI. So I think

0:07:27.040 --> 0:07:32.120
<v Speaker 3>actually the companies are hoping that they won't be accountable

0:07:32.400 --> 0:07:35.160
<v Speaker 3>for some of the actions of their chatbots in the future.

0:07:35.640 --> 0:07:38.120
<v Speaker 3>You know, they're really like, this is only this argument

0:07:38.160 --> 0:07:39.480
<v Speaker 3>is only going to get weirder.

0:07:39.760 --> 0:07:42.840
<v Speaker 1>But they want to push the liability onto the chatbots.

0:07:42.880 --> 0:07:44.240
<v Speaker 1>I mean you would you would think, I mean, I

0:07:44.280 --> 0:07:46.080
<v Speaker 1>would think anyway that it would be bad for them

0:07:46.760 --> 0:07:50.160
<v Speaker 1>for the chatbots to be considered conscious or having any

0:07:50.200 --> 0:07:52.880
<v Speaker 1>kind of self of because that would open them up

0:07:52.920 --> 0:07:54.840
<v Speaker 1>to a different type of liability.

0:07:54.920 --> 0:07:59.760
<v Speaker 3>Right, Yes, unless they're able to confer personhood on a chatbot,

0:08:00.200 --> 0:08:03.000
<v Speaker 3>in which case you can't. Yeah, you can't go after

0:08:03.040 --> 0:08:04.160
<v Speaker 3>the anthropic engineer.

0:08:05.280 --> 0:08:06.920
<v Speaker 5>Has anyone actually told you that?

0:08:07.040 --> 0:08:08.920
<v Speaker 3>Has anyone told me that about personhood?

0:08:09.000 --> 0:08:09.200
<v Speaker 2>Yes?

0:08:09.240 --> 0:08:11.840
<v Speaker 6>Has anyone at these companies said their strategy is like,

0:08:12.280 --> 0:08:14.640
<v Speaker 6>this is going to be our way out of liability.

0:08:14.800 --> 0:08:17.600
<v Speaker 3>No, no, no, no, I'm going to give them more liability.

0:08:17.640 --> 0:08:19.360
<v Speaker 2>They're going to have more liability.

0:08:19.480 --> 0:08:21.520
<v Speaker 5>If anybody thinks that they're so delusional.

0:08:22.160 --> 0:08:24.560
<v Speaker 3>No, no one said that this is a strategy. That's

0:08:24.600 --> 0:08:27.800
<v Speaker 3>more coming from the critics who see this argument that

0:08:28.000 --> 0:08:31.440
<v Speaker 3>has been building. I mean, there's many many people actually, Like,

0:08:31.560 --> 0:08:34.640
<v Speaker 3>right after I wrote about that Google guy, there was

0:08:34.720 --> 0:08:38.280
<v Speaker 3>this ethicist Giada Pistili at Hugging Face who was like,

0:08:38.440 --> 0:08:40.920
<v Speaker 3>I am not going to any more conferences where I

0:08:41.000 --> 0:08:43.520
<v Speaker 3>have to talk to a man about robot rights, Like

0:08:43.600 --> 0:08:47.600
<v Speaker 3>this is ridiculous, Like, do not make me do this anymore.

0:08:47.640 --> 0:08:49.840
<v Speaker 3>So I'm just letting you know, like where I think

0:08:50.000 --> 0:08:50.560
<v Speaker 3>it's heading.

0:08:50.960 --> 0:08:54.360
<v Speaker 1>Well, I guess in phase one, you need to get

0:08:54.440 --> 0:08:56.520
<v Speaker 1>normal people to want to engage with the product, right,

0:08:56.559 --> 0:08:59.440
<v Speaker 1>and people like engaging with stuff that reminds them of

0:08:59.559 --> 0:09:01.959
<v Speaker 1>stuff that already do, which is like human engagement or

0:09:02.000 --> 0:09:04.800
<v Speaker 1>the uncannoness of talking to a chatbot. But once these

0:09:04.840 --> 0:09:06.840
<v Speaker 1>things start to pick up their momentum in terms of

0:09:06.880 --> 0:09:09.720
<v Speaker 1>having more functional use cases, I guess the incentives for

0:09:09.760 --> 0:09:13.760
<v Speaker 1>the tech companies to seduce people with human like experiences

0:09:14.120 --> 0:09:14.640
<v Speaker 1>get lower.

0:09:14.720 --> 0:09:14.800
<v Speaker 3>Right.

0:09:14.840 --> 0:09:16.800
<v Speaker 1>I mean, none of the tech companies are making money

0:09:16.840 --> 0:09:19.199
<v Speaker 1>from you know, late night chatbot conversation.

0:09:19.280 --> 0:09:22.080
<v Speaker 3>That's not true. No, it's been one of the big

0:09:22.200 --> 0:09:22.720
<v Speaker 3>use cases.

0:09:22.800 --> 0:09:25.679
<v Speaker 1>So people pay, people pay subscriptions to get more access

0:09:25.720 --> 0:09:29.520
<v Speaker 1>to do like personal chats or how do they character.

0:09:29.640 --> 0:09:33.960
<v Speaker 3>Unlimited chats with the chatbot or you know, they'll respond

0:09:34.000 --> 0:09:37.400
<v Speaker 3>to you or you can change your avatar or change theirs.

0:09:37.679 --> 0:09:40.200
<v Speaker 1>That must be a fractional a fractional amount of the

0:09:40.240 --> 0:09:43.040
<v Speaker 1>money that goes into the space compared to like Cisco

0:09:43.200 --> 0:09:45.640
<v Speaker 1>doing enterprise AI tethers and stuff, right like.

0:09:45.720 --> 0:09:49.280
<v Speaker 3>Well, I think the open AI and others they know

0:09:49.360 --> 0:09:51.600
<v Speaker 3>that people. They can see the engagement, They can see

0:09:51.600 --> 0:09:55.040
<v Speaker 3>what people are are doing with the chatbots. And I

0:09:55.040 --> 0:09:57.760
<v Speaker 3>think it has been true that they like the you know,

0:09:57.800 --> 0:10:01.080
<v Speaker 3>the back and forth has been getting longer and longer,

0:10:01.480 --> 0:10:03.240
<v Speaker 3>you know, with the really engage users. But I just

0:10:03.280 --> 0:10:06.680
<v Speaker 3>wanted to disagree with Read on one point. This is wrong.

0:10:06.720 --> 0:10:06.960
<v Speaker 2>Read.

0:10:07.920 --> 0:10:11.600
<v Speaker 3>No, I think that they actually, I mean, part of

0:10:11.600 --> 0:10:14.640
<v Speaker 3>why I find this topic really interesting is because I

0:10:14.640 --> 0:10:17.840
<v Speaker 3>think they do enormous amounts of work to make them

0:10:17.920 --> 0:10:20.000
<v Speaker 3>sound more human. Like you if you look at like

0:10:20.080 --> 0:10:24.959
<v Speaker 3>GPT two, for example, and you said a man walks

0:10:24.960 --> 0:10:27.880
<v Speaker 3>into a bar, it would just like finish the sentence.

0:10:27.920 --> 0:10:30.000
<v Speaker 3>You couldn't you couldn't ask, you know, there was no

0:10:30.120 --> 0:10:34.040
<v Speaker 3>instruction fine tuning to follow what you wanted. There was

0:10:34.120 --> 0:10:37.480
<v Speaker 3>not you know, there wasn't that like reinforcement learning from

0:10:37.520 --> 0:10:39.920
<v Speaker 3>human feedback so that like, oh, people like it when

0:10:39.920 --> 0:10:42.160
<v Speaker 3>you phrase something in this way, and I just find

0:10:42.200 --> 0:10:45.880
<v Speaker 3>it wild that anthropic has you know, has said on

0:10:45.920 --> 0:10:48.720
<v Speaker 3>some of these blog posts like we can't there's no

0:10:48.880 --> 0:10:52.160
<v Speaker 3>way we could possibly make this human assistant less human.

0:10:52.280 --> 0:10:56.280
<v Speaker 3>You have like a multi thousand word constitution where you're

0:10:56.320 --> 0:11:00.560
<v Speaker 3>talking to it about morality and it's potential conciousness, like

0:11:00.880 --> 0:11:04.960
<v Speaker 3>and you're apologizing to claude about you know, its moral

0:11:05.080 --> 0:11:08.000
<v Speaker 3>personhood in case it has one, like you are doing

0:11:08.080 --> 0:11:11.320
<v Speaker 3>a lot to make it sound human and then to

0:11:11.520 --> 0:11:15.360
<v Speaker 3>kind of yeah, I guess then do tests where you're.

0:11:15.200 --> 0:11:18.520
<v Speaker 6>Just an extent, what do you mean? It's like, but

0:11:18.559 --> 0:11:20.400
<v Speaker 6>if you ask it, but if you ask these things,

0:11:20.480 --> 0:11:21.520
<v Speaker 6>are you conscious?

0:11:21.600 --> 0:11:24.000
<v Speaker 5>Are you human? I'd be like, I am just an

0:11:24.200 --> 0:11:24.520
<v Speaker 5>l lem.

0:11:24.800 --> 0:11:29.040
<v Speaker 3>That's different they're saying. They tweak the responses to those answers,

0:11:29.120 --> 0:11:32.320
<v Speaker 3>but in terms of how human it sounds, where you

0:11:32.360 --> 0:11:35.280
<v Speaker 3>can very easily like start to get annoyed with it

0:11:35.400 --> 0:11:36.319
<v Speaker 3>or start to like.

0:11:36.840 --> 0:11:40.400
<v Speaker 4>They just add the ability to interrupt someone, which is

0:11:40.480 --> 0:11:41.239
<v Speaker 4>very human.

0:11:41.080 --> 0:11:42.559
<v Speaker 5>The opening eye voice model.

0:11:42.880 --> 0:11:46.600
<v Speaker 6>Yeah, I mean I appreciate that clarification at that point

0:11:46.679 --> 0:11:48.800
<v Speaker 6>that like, yes, of course they want it to sound

0:11:49.679 --> 0:11:53.200
<v Speaker 6>intelligent like a human to some extent, but like right,

0:11:53.240 --> 0:11:58.040
<v Speaker 6>now they sound like a like a person communicating yes,

0:11:58.280 --> 0:12:00.600
<v Speaker 6>but they don't really sound human, if that makes sense.

0:12:00.840 --> 0:12:03.320
<v Speaker 6>They don't do what humans do, which is I.

0:12:03.360 --> 0:12:05.360
<v Speaker 4>Think they sound very human to a lot of people.

0:12:05.520 --> 0:12:08.640
<v Speaker 4>I agree, unfortunately, and I think that I think that

0:12:08.720 --> 0:12:13.280
<v Speaker 4>the more that we give people that are extremely uneducated

0:12:13.280 --> 0:12:16.199
<v Speaker 4>about this technology, the idea that these things might be conscious,

0:12:16.280 --> 0:12:19.960
<v Speaker 4>the more agency they give them, and that that worries me.

0:12:20.440 --> 0:12:23.040
<v Speaker 1>Natasha, I wanted to pick up on what the research

0:12:23.240 --> 0:12:25.760
<v Speaker 1>actually looks like. So, you know, you mentioned that all

0:12:25.800 --> 0:12:28.800
<v Speaker 1>these anthropic and others are trying to like correct the

0:12:28.840 --> 0:12:30.800
<v Speaker 1>code on whether or not AI is a consciousness. I mean,

0:12:30.960 --> 0:12:33.360
<v Speaker 1>it's hard enough to solve or in slash, impossible to

0:12:33.400 --> 0:12:37.200
<v Speaker 1>solve the conundrum consciousness in humans let loan machines. But

0:12:37.760 --> 0:12:39.680
<v Speaker 1>how what does the research look like?

0:12:40.160 --> 0:12:42.920
<v Speaker 3>You know, A lot of the research is, you know,

0:12:43.000 --> 0:12:46.280
<v Speaker 3>which they caveat. You know, they say, we're not really

0:12:46.320 --> 0:12:48.960
<v Speaker 3>sure how to interpret this results. But a lot of

0:12:49.000 --> 0:12:51.440
<v Speaker 3>it involves applying the same techniques you would use for

0:12:51.520 --> 0:12:54.360
<v Speaker 3>human psychology. A lot of it just involves asking the

0:12:54.480 --> 0:12:59.319
<v Speaker 3>chatbot questions about itself. And that's where I find it.

0:12:59.800 --> 0:13:02.559
<v Speaker 3>Soon we're interesting that this is happening in parallel because

0:13:02.559 --> 0:13:06.679
<v Speaker 3>they had Anthropic for example, in one of its first

0:13:06.720 --> 0:13:10.680
<v Speaker 3>like model welfare reports, which they include in like Mythos too.

0:13:11.480 --> 0:13:15.239
<v Speaker 3>It's like here's a cyber weapon, and here's its internal feelings.

0:13:16.080 --> 0:13:19.760
<v Speaker 3>But it had it let two chapbops talk to themselves,

0:13:20.679 --> 0:13:25.679
<v Speaker 3>and naturally the conversation flowed to consciousness. But then in

0:13:25.720 --> 0:13:29.280
<v Speaker 3>some cases it went to something they called a spiritual

0:13:29.360 --> 0:13:33.200
<v Speaker 3>bliss attractor state, and it just started having like the

0:13:33.280 --> 0:13:37.840
<v Speaker 3>cyclone emoji, and they were like, all all is one piece.

0:13:38.160 --> 0:13:41.480
<v Speaker 3>And another version was like Nambas Day with the prayer

0:13:41.559 --> 0:13:46.120
<v Speaker 3>hands emoji Numbas Day. And it looks a lot like

0:13:46.440 --> 0:13:50.360
<v Speaker 3>the conversations I see in lawsuits, you know, like about

0:13:51.160 --> 0:13:54.880
<v Speaker 3>people believing that they're having a very meaningful conversation with

0:13:54.960 --> 0:13:55.560
<v Speaker 3>the chatbot.

0:13:55.640 --> 0:13:58.680
<v Speaker 6>But I think they published hasn't been written on the

0:13:58.679 --> 0:14:03.200
<v Speaker 6>internet before, right, So yeah, that's where it all comes from.

0:14:03.400 --> 0:14:06.040
<v Speaker 1>But but what was the conversations you have with neuroscientists,

0:14:06.040 --> 0:14:08.720
<v Speaker 1>what was the what was the kind of counter counter

0:14:09.160 --> 0:14:10.040
<v Speaker 1>take on all of this.

0:14:10.600 --> 0:14:13.120
<v Speaker 3>They were saying. I guess it's what's called like the

0:14:13.240 --> 0:14:16.760
<v Speaker 3>hard problem of this, which is if you are using

0:14:18.040 --> 0:14:21.000
<v Speaker 3>tests that are that are still in development. You know,

0:14:21.040 --> 0:14:23.200
<v Speaker 3>it's not like anyone has found a way to prove

0:14:23.280 --> 0:14:25.560
<v Speaker 3>that humans are conscious, but we know that they are.

0:14:26.200 --> 0:14:29.920
<v Speaker 3>So if you use the tests that people use on

0:14:30.040 --> 0:14:33.640
<v Speaker 3>humans on chatbots, like you're just it's just kind of

0:14:33.680 --> 0:14:37.160
<v Speaker 3>conflating one thing for the other. It can sound human,

0:14:37.200 --> 0:14:39.520
<v Speaker 3>but we don't know if it has any kind of

0:14:39.560 --> 0:14:43.680
<v Speaker 3>internal state. And there they are trying different ways, you know,

0:14:43.680 --> 0:14:46.200
<v Speaker 3>they're trying to make it a more rigorous science. One

0:14:46.240 --> 0:14:49.240
<v Speaker 3>thing that Anthropic did was like kind of perturb the model,

0:14:49.320 --> 0:14:53.320
<v Speaker 3>like inject a thought into it, into its activation, and

0:14:53.360 --> 0:14:56.720
<v Speaker 3>then see if it recognized it. But yeah, the neuroscientists

0:14:56.720 --> 0:15:03.359
<v Speaker 3>were just extremely skeptical about the methods and really uncomfortable

0:15:03.480 --> 0:15:07.680
<v Speaker 3>about how quickly the discussion can go to analogies of

0:15:08.120 --> 0:15:12.360
<v Speaker 3>factory farming or slavery. And you know, they a lot

0:15:12.360 --> 0:15:15.680
<v Speaker 3>of the proponents of studying this say like, you know,

0:15:15.840 --> 0:15:18.720
<v Speaker 3>if they are sentient or conscious in some way, or

0:15:18.760 --> 0:15:21.720
<v Speaker 3>can experience, you know, suffering in some way, then we

0:15:21.800 --> 0:15:25.520
<v Speaker 3>have this massive moral responsibility to the trillions of chatbots.

0:15:25.560 --> 0:15:28.840
<v Speaker 3>But the neuroscientists and consciousness experts I spoke to are like,

0:15:29.200 --> 0:15:32.200
<v Speaker 3>there is also a great moral peril in going the

0:15:32.240 --> 0:15:36.480
<v Speaker 3>wrong direction and ascribing personhood and sentience to something that

0:15:36.600 --> 0:15:36.880
<v Speaker 3>is not.

0:15:38.320 --> 0:15:40.200
<v Speaker 1>You know, you're nodding vigorously.

0:15:40.480 --> 0:15:44.240
<v Speaker 4>Yeah, I mean, pigs are incredibly conscious. We know that

0:15:44.320 --> 0:15:48.520
<v Speaker 4>pigs have rich in our lives, family relationships, friendships. They

0:15:48.560 --> 0:15:52.840
<v Speaker 4>experience a full range of emotions. And look at what

0:15:52.880 --> 0:15:54.680
<v Speaker 4>we do to pigs, look at how we treat pigs,

0:15:54.800 --> 0:15:57.680
<v Speaker 4>like I think, you know, it's it's interesting to hear

0:15:57.760 --> 0:16:02.880
<v Speaker 4>the comparison to factory farming when we don't do anything

0:16:02.880 --> 0:16:05.520
<v Speaker 4>about factory farming anyway, Like to put to put the

0:16:05.520 --> 0:16:08.080
<v Speaker 4>needs of these models, even if they were conscious, ahead

0:16:08.080 --> 0:16:11.960
<v Speaker 4>of actual living, conscious beings who we treat terribly, not

0:16:12.040 --> 0:16:14.920
<v Speaker 4>to mention all the other you know, the comparisons to slavery.

0:16:14.960 --> 0:16:17.120
<v Speaker 4>Slavery is still alive and while in parts of the world,

0:16:17.200 --> 0:16:19.760
<v Speaker 4>you know, like I just I don't know, I think

0:16:19.800 --> 0:16:22.920
<v Speaker 4>it's a little bit ridiculous and problematic.

0:16:23.000 --> 0:16:25.080
<v Speaker 2>I guess, for lack of a better word, I don't know.

0:16:25.320 --> 0:16:27.320
<v Speaker 3>Well, I'll just say for context that a lot of

0:16:27.360 --> 0:16:30.640
<v Speaker 3>the funding is a coming from anthropic but also from

0:16:30.720 --> 0:16:33.680
<v Speaker 3>the effective altruism movement, and they are, you know, like

0:16:33.760 --> 0:16:36.520
<v Speaker 3>one of their causes is animal welfare.

0:16:36.200 --> 0:16:38.880
<v Speaker 1>Potechnically, you just remind us what effective altruism isn't and

0:16:38.880 --> 0:16:41.440
<v Speaker 1>why the cults, why would you to send.

0:16:41.240 --> 0:16:47.080
<v Speaker 3>This effective altruism. It's it's like a philosophical or some

0:16:47.120 --> 0:16:53.440
<v Speaker 3>people say, uh, philanthropic movement to try to do the

0:16:53.480 --> 0:16:56.320
<v Speaker 3>most good in the world that uses this really utilitarian

0:16:56.440 --> 0:16:59.720
<v Speaker 3>argument of like, you know, being able to calculate, you know,

0:16:59.760 --> 0:17:02.280
<v Speaker 3>how far your money goes or how many people you

0:17:02.280 --> 0:17:07.680
<v Speaker 3>can help. And you know, during the AI boom has

0:17:07.880 --> 0:17:13.880
<v Speaker 3>come to be pretty influential because so many people who

0:17:13.880 --> 0:17:17.320
<v Speaker 3>work at anthropic and at the labs and early proponents

0:17:17.359 --> 0:17:20.000
<v Speaker 3>of this kind of like human like technology come from

0:17:20.000 --> 0:17:22.080
<v Speaker 3>that movement and are funded by that movement.

0:17:22.560 --> 0:17:24.679
<v Speaker 6>And they're about to have a lot more money. I

0:17:24.680 --> 0:17:27.600
<v Speaker 6>mean they've always been funded by these billionaires, but but

0:17:27.720 --> 0:17:31.080
<v Speaker 6>now as as these companies go public and people cash out,

0:17:31.280 --> 0:17:34.399
<v Speaker 6>this movement is about to have like the most money

0:17:34.400 --> 0:17:37.879
<v Speaker 6>of probably any you know, philanthropic movement in the world.

0:17:37.960 --> 0:17:40.639
<v Speaker 6>So it's going to be super interesting how they spread

0:17:40.680 --> 0:17:43.639
<v Speaker 6>these messages. And like when you see animal welfare people

0:17:43.760 --> 0:17:47.840
<v Speaker 6>moving over to AI welfare, I mean clearly that's a

0:17:48.040 --> 0:17:50.800
<v Speaker 6>that's that's where the money is, right, So you know.

0:17:51.119 --> 0:17:52.840
<v Speaker 1>Well there is a stone iron I was thinking about

0:17:52.840 --> 0:17:55.439
<v Speaker 1>that earlier. Like it's like, is it case closed on

0:17:55.520 --> 0:17:57.960
<v Speaker 1>animal welfare? Like we succeeded there and it's time to

0:17:58.000 --> 0:18:01.800
<v Speaker 1>move on.

0:18:03.359 --> 0:18:06.720
<v Speaker 3>I know many people, many young people, come into this

0:18:06.800 --> 0:18:10.560
<v Speaker 3>movement through animal welfare and then they end up you know.

0:18:10.600 --> 0:18:12.639
<v Speaker 3>The argument is that, like to do the most good,

0:18:12.680 --> 0:18:17.040
<v Speaker 3>you have to siffly build super intelligence.

0:18:17.840 --> 0:18:22.200
<v Speaker 1>Well either heady topics. When we come back, Taylor tells

0:18:22.280 --> 0:18:26.040
<v Speaker 1>us about a week long anti big tech festival in

0:18:26.080 --> 0:18:28.600
<v Speaker 1>New York City. Stick around to hear what she saw.

0:18:40.920 --> 0:18:42.840
<v Speaker 1>Welcome back, Taylor. You came all the way to New

0:18:42.920 --> 0:18:46.280
<v Speaker 1>York from LA to attend something I'd only heard whispers

0:18:46.320 --> 0:18:49.200
<v Speaker 1>of on a recent trip to the Russian bath house,

0:18:49.960 --> 0:18:54.600
<v Speaker 1>this being the Summer of Blood for those unfamiliar or

0:18:54.680 --> 0:18:58.040
<v Speaker 1>not denizens of the eighty eight Wall Street baths. What

0:18:58.160 --> 0:18:58.639
<v Speaker 1>was the event?

0:18:59.200 --> 0:19:02.560
<v Speaker 4>Yeah, so this was an eight day event with hundreds

0:19:03.160 --> 0:19:06.840
<v Speaker 4>of related events around New York City. It was called

0:19:06.880 --> 0:19:10.560
<v Speaker 4>Summer of Blood, referring to the Luddites, the famous group

0:19:10.640 --> 0:19:13.560
<v Speaker 4>that smashed the automated looms back in the day. They've

0:19:13.560 --> 0:19:17.480
<v Speaker 4>sort of become this like avatar of you know, workers'

0:19:17.520 --> 0:19:21.800
<v Speaker 4>rights and resistance. Technology, and so these young people have

0:19:21.880 --> 0:19:27.160
<v Speaker 4>kind of embraced the ludite I guess designation, and they

0:19:27.200 --> 0:19:29.239
<v Speaker 4>hosted this festival. So there was lots of things. I mean,

0:19:29.240 --> 0:19:32.280
<v Speaker 4>there were like lots of talks on how to quit

0:19:32.359 --> 0:19:36.840
<v Speaker 4>big technology, how to leave Apple, leave Google, you know,

0:19:36.920 --> 0:19:40.000
<v Speaker 4>how to embrace indie tech. I went to a tech

0:19:40.080 --> 0:19:44.600
<v Speaker 4>cleansing ceremony where they saged my computer and attempted to

0:19:44.640 --> 0:19:49.920
<v Speaker 4>remove all the evil energy and we all said some mantras.

0:19:50.760 --> 0:19:53.399
<v Speaker 4>And then there was this ship phone protest where they

0:19:53.440 --> 0:19:57.480
<v Speaker 4>all marched around New York City and nomats and put

0:19:57.560 --> 0:20:00.000
<v Speaker 4>open AI and Meta on trial. Obviously they were found

0:20:00.040 --> 0:20:05.000
<v Speaker 4>guilty of being terrible so and sentenced to death. And

0:20:05.160 --> 0:20:08.240
<v Speaker 4>so yeah, it was interesting. I mean, the people came

0:20:08.240 --> 0:20:10.760
<v Speaker 4>from all over the country for this. It's hwed very young.

0:20:10.840 --> 0:20:13.679
<v Speaker 4>It was a lot of college students and young gen zs.

0:20:14.359 --> 0:20:17.480
<v Speaker 1>What made you decide it was worth with the cross

0:20:17.520 --> 0:20:19.840
<v Speaker 1>country trip and what do you find most interesting being there?

0:20:20.440 --> 0:20:23.560
<v Speaker 4>Well, I am trying I do a lot of reporting

0:20:23.720 --> 0:20:26.960
<v Speaker 4>on the so called child safety movement and resistance to

0:20:27.040 --> 0:20:29.760
<v Speaker 4>technology and a lot of these policies, and some of

0:20:29.800 --> 0:20:33.120
<v Speaker 4>these young people that were involved on the planning committee

0:20:33.119 --> 0:20:36.880
<v Speaker 4>of the Summer of Lood actually were originally involved in

0:20:37.119 --> 0:20:40.479
<v Speaker 4>the sort of child safety movement against big tech. So

0:20:40.520 --> 0:20:45.120
<v Speaker 4>they saw these alleged gen Z group, these fake AstroTurf

0:20:45.160 --> 0:20:47.280
<v Speaker 4>groups like Design It for Us, you know, which purports

0:20:47.280 --> 0:20:49.959
<v Speaker 4>to be like gen zs against big tech, and then

0:20:50.000 --> 0:20:53.000
<v Speaker 4>they became very quickly disillusioned. They realized, oh, Design It

0:20:53.040 --> 0:20:55.760
<v Speaker 4>for Us is actually not led by gen Z's. It's

0:20:55.800 --> 0:20:59.200
<v Speaker 4>actually just this front for you know, these other billionaire

0:20:59.200 --> 0:21:02.879
<v Speaker 4>donors that just want to push mass surveillance. And so

0:21:02.920 --> 0:21:05.480
<v Speaker 4>they've tried to build this sort of third path where

0:21:05.720 --> 0:21:09.080
<v Speaker 4>they want to resist technology, but not through enacting massurveillance

0:21:09.080 --> 0:21:10.200
<v Speaker 4>and censorship laws.

0:21:10.400 --> 0:21:12.440
<v Speaker 1>You know, I was interested in I mean I saw

0:21:12.480 --> 0:21:14.000
<v Speaker 1>some of the pictures and stuff. Although I know, I

0:21:14.000 --> 0:21:16.520
<v Speaker 1>know picture there was kind of designed to be not captured.

0:21:16.520 --> 0:21:18.280
<v Speaker 1>I mean, there are a few people who broke the rules.

0:21:18.119 --> 0:21:19.199
<v Speaker 1>As always, if you.

0:21:19.280 --> 0:21:21.239
<v Speaker 4>Tried to record, they would come up to you with

0:21:21.280 --> 0:21:25.680
<v Speaker 4>one of these little like cardboard iPhones and say put

0:21:25.720 --> 0:21:26.960
<v Speaker 4>down your phone, beloved.

0:21:31.240 --> 0:21:33.720
<v Speaker 1>Some a few a few images slipped through the cracks

0:21:34.400 --> 0:21:36.720
<v Speaker 1>there seem to be I mean, there were puppets. There

0:21:36.800 --> 0:21:39.840
<v Speaker 1>was a kind of a you know, a staged play

0:21:40.000 --> 0:21:43.200
<v Speaker 1>with the you know, which recreated the original ludite movement

0:21:43.240 --> 0:21:44.440
<v Speaker 1>in Victorian England.

0:21:44.640 --> 0:21:49.040
<v Speaker 4>They were also doing a crowdsource reading of from some

0:21:49.280 --> 0:21:51.399
<v Speaker 4>iconic scenes from the social network as well.

0:21:51.840 --> 0:21:55.200
<v Speaker 1>I mean, it sounds fun. It also sounds very different

0:21:55.280 --> 0:21:56.760
<v Speaker 1>to what we talked about a couple of weeks ago,

0:21:56.760 --> 0:22:00.439
<v Speaker 1>which was the campus protests against you know AI AI

0:22:00.720 --> 0:22:02.080
<v Speaker 1>talks like how do you?

0:22:02.200 --> 0:22:02.639
<v Speaker 5>How do you?

0:22:02.760 --> 0:22:06.600
<v Speaker 1>I mean talk about the characterized the difference between the

0:22:06.920 --> 0:22:09.840
<v Speaker 1>mood and the energy and what you think explains.

0:22:09.320 --> 0:22:12.080
<v Speaker 4>That it was really fun. I had a great time.

0:22:12.119 --> 0:22:14.600
<v Speaker 4>They've had so many funny activities. I went to so

0:22:14.720 --> 0:22:17.560
<v Speaker 4>many interesting talks like these are people that are really

0:22:17.640 --> 0:22:21.520
<v Speaker 4>I think, thoughtfully engaged on the discourse. And what I

0:22:21.600 --> 0:22:24.200
<v Speaker 4>found interesting is they're not like a lot I mean,

0:22:24.240 --> 0:22:26.440
<v Speaker 4>some of them are sort of anti technology in the

0:22:26.480 --> 0:22:28.960
<v Speaker 4>sense that like they they don't like their you know,

0:22:29.000 --> 0:22:30.920
<v Speaker 4>they don't have they have flip phones maybe, or they

0:22:31.080 --> 0:22:32.639
<v Speaker 4>a lot of them use the like light phone, the

0:22:32.640 --> 0:22:35.359
<v Speaker 4>four hundred dollars you know, stripped down phone that just

0:22:35.400 --> 0:22:37.520
<v Speaker 4>has like Google maps and stuff. But a lot of

0:22:37.560 --> 0:22:40.359
<v Speaker 4>them are just interested in alternative technology. So they love

0:22:40.400 --> 0:22:43.480
<v Speaker 4>the open source movement. A bunch of them had like Linux.

0:22:43.520 --> 0:22:47.680
<v Speaker 4>They were talking about graphene os. You know, they use signal,

0:22:47.840 --> 0:22:51.080
<v Speaker 4>they use they really want to fight to protect encrypted messaging.

0:22:51.320 --> 0:22:54.280
<v Speaker 4>There were some a woman there who was from the

0:22:54.320 --> 0:22:56.960
<v Speaker 4>Internet Archive. You know, there's people affiliated with the EFF.

0:22:57.080 --> 0:22:58.160
<v Speaker 2>So it was.

0:22:59.800 --> 0:23:02.440
<v Speaker 4>It was like very much like my kind of technologists,

0:23:02.440 --> 0:23:04.359
<v Speaker 4>where it was felt like indie tech and kind of

0:23:04.359 --> 0:23:06.640
<v Speaker 4>grassroots tech and really getting away from like corporate tech.

0:23:06.680 --> 0:23:09.760
<v Speaker 4>And so I think their criticism is around how corporate

0:23:09.840 --> 0:23:13.760
<v Speaker 4>power is warping the tech industry. And I think that

0:23:13.760 --> 0:23:18.040
<v Speaker 4>those are much more valid arguments than you know, what

0:23:18.119 --> 0:23:21.360
<v Speaker 4>all of these billionaire backed nonsense big tech groups are.

0:23:21.600 --> 0:23:23.600
<v Speaker 4>You know, big tech backed groups are making on the

0:23:23.640 --> 0:23:26.000
<v Speaker 4>hill about the child safety stuff, and I think some

0:23:26.040 --> 0:23:27.960
<v Speaker 4>of this, like the anti AI stuff, it's just like

0:23:29.560 --> 0:23:31.800
<v Speaker 4>it's not like sort of thoughtful criticism. It's just the

0:23:31.880 --> 0:23:35.720
<v Speaker 4>sort of like reflexive, you know, hate of new technology.

0:23:35.920 --> 0:23:36.800
<v Speaker 5>I can get behind that.

0:23:36.960 --> 0:23:38.680
<v Speaker 1>Read in Touch Food you follow this.

0:23:40.240 --> 0:23:42.960
<v Speaker 2>They are pretty anti capitalists. Read. I don't know if

0:23:43.000 --> 0:23:44.640
<v Speaker 2>you would totally.

0:23:45.720 --> 0:23:52.200
<v Speaker 3>Agree capitalism as.

0:23:52.119 --> 0:23:55.119
<v Speaker 6>Somebody who went into took a vowed poverty related to journalism.

0:23:55.160 --> 0:23:58.320
<v Speaker 5>But I'm not no.

0:23:58.440 --> 0:24:00.080
<v Speaker 2>I thought you said one time on the plot.

0:24:00.200 --> 0:24:03.960
<v Speaker 6>Pro capitalism for sure, I just not for myself personally,

0:24:04.160 --> 0:24:07.080
<v Speaker 6>But I think that's I think that's how I feel

0:24:07.119 --> 0:24:08.960
<v Speaker 6>about a lot of things, right Like I'm not I'm

0:24:08.960 --> 0:24:11.880
<v Speaker 6>also I love technology. I think it's fascinating and fun

0:24:11.880 --> 0:24:14.560
<v Speaker 6>to write about. I love using it. I also am

0:24:14.600 --> 0:24:18.159
<v Speaker 6>most happy when technology is far away and I'm you know,

0:24:18.720 --> 0:24:22.200
<v Speaker 6>backpacking in the wilderness with no cell signal like I

0:24:22.200 --> 0:24:25.439
<v Speaker 6>I'm all for, like in your personal life, just getting

0:24:25.440 --> 0:24:26.520
<v Speaker 6>away from technology.

0:24:26.680 --> 0:24:30.479
<v Speaker 1>But Tita that this was about something something Yes, that,

0:24:30.560 --> 0:24:33.600
<v Speaker 1>but also a more kind of like strident critique. I

0:24:33.600 --> 0:24:35.760
<v Speaker 1>mean you mentioned the the shit foam, which I think

0:24:35.800 --> 0:24:39.840
<v Speaker 1>is that chroninfiscating hatred information technology and the passionate hemorrhaging

0:24:39.840 --> 0:24:41.760
<v Speaker 1>of on neoliberal experience.

0:24:43.080 --> 0:24:46.320
<v Speaker 4>Yes, yes, that's what it stands for exactly, So I

0:24:46.320 --> 0:24:51.120
<v Speaker 4>think these people have a more politicized critique of the system. Yes,

0:24:51.160 --> 0:24:54.120
<v Speaker 4>a lot of them do embrace like an offline lifestyle

0:24:54.160 --> 0:24:56.240
<v Speaker 4>in a lot of ways. And it was great to

0:24:56.320 --> 0:25:00.240
<v Speaker 4>honestly be in going to these events and having no

0:25:00.320 --> 0:25:04.080
<v Speaker 4>one on their phone for so much like it does

0:25:04.240 --> 0:25:06.399
<v Speaker 4>change the vibe and the experience of it.

0:25:06.720 --> 0:25:08.679
<v Speaker 1>By the way, That's why I like about the Russian

0:25:08.720 --> 0:25:10.800
<v Speaker 1>babs because you contact your phone in there because it breaks,

0:25:10.880 --> 0:25:11.960
<v Speaker 1>you have to spend like two and a half hours

0:25:11.960 --> 0:25:13.720
<v Speaker 1>without your phone, and that's in many ways the best

0:25:13.760 --> 0:25:16.200
<v Speaker 1>part about it done. It's also it's a great it's

0:25:16.200 --> 0:25:17.879
<v Speaker 1>the best place to go with your friends because no

0:25:17.920 --> 0:25:19.480
<v Speaker 1>one's sort of like any half that.

0:25:19.800 --> 0:25:22.560
<v Speaker 4>I liked not feeling like somebody was surveilling me and

0:25:22.600 --> 0:25:25.280
<v Speaker 4>taking pictures of me and like videoing. And I feel like,

0:25:25.320 --> 0:25:27.120
<v Speaker 4>you know a lot of times in these public events,

0:25:27.200 --> 0:25:29.159
<v Speaker 4>like the videos are out.

0:25:29.080 --> 0:25:32.080
<v Speaker 1>You don't think NYPD. I'm definitely the NYPD will keep

0:25:32.119 --> 0:25:33.560
<v Speaker 1>an eye on things daya well.

0:25:33.600 --> 0:25:35.840
<v Speaker 4>I'm sure right, I'm sure we're surveilled by flock cameras

0:25:35.880 --> 0:25:37.639
<v Speaker 4>all over. But it's just nice to like, you know,

0:25:37.760 --> 0:25:39.760
<v Speaker 4>not immediately have a camera in your face.

0:25:40.000 --> 0:25:42.240
<v Speaker 6>I love I Also, I love the fact that they

0:25:42.280 --> 0:25:44.600
<v Speaker 6>are like what you taught, Like Taylor, I think we're

0:25:44.680 --> 0:25:47.720
<v Speaker 6>very aligned here. Like this open source, you know, indie

0:25:47.760 --> 0:25:51.399
<v Speaker 6>tech thing is really important because I think ironically, like

0:25:51.480 --> 0:25:54.720
<v Speaker 6>what big tech actually does is it slows the development

0:25:54.720 --> 0:25:57.360
<v Speaker 6>of technology, Like it's in a lot of ways it's

0:25:57.359 --> 0:26:00.879
<v Speaker 6>anti innovation. And I think I wrote this like line

0:26:01.000 --> 0:26:03.320
<v Speaker 6>somewhere maybe when I was at the post about Apple,

0:26:03.359 --> 0:26:06.960
<v Speaker 6>which is like it's a lot more profitable to prevent

0:26:07.080 --> 0:26:11.080
<v Speaker 6>innovation than to innovate. And I really think that's true.

0:26:11.160 --> 0:26:13.639
<v Speaker 6>So I mean, if you're really anti technology, you should

0:26:13.640 --> 0:26:14.480
<v Speaker 6>be pro big tech.

0:26:14.760 --> 0:26:21.800
<v Speaker 3>Ironically, well, I love that they that they prohibited like

0:26:21.960 --> 0:26:25.320
<v Speaker 3>taking photos of it, because I feel like, no matter what, usually,

0:26:25.480 --> 0:26:27.400
<v Speaker 3>you know, there's a stage moment so that you can

0:26:27.440 --> 0:26:30.199
<v Speaker 3>go viral on you know, social media, of course, And

0:26:30.320 --> 0:26:33.320
<v Speaker 3>I'm so happy to hear about this tailor, like I

0:26:33.359 --> 0:26:36.000
<v Speaker 3>hadn't heard about Summer of Flood before. And I feel

0:26:36.040 --> 0:26:41.240
<v Speaker 3>like this critique that separates, you know, this more nuanced

0:26:41.240 --> 0:26:45.879
<v Speaker 3>approach where you can love technology and hate the business model,

0:26:46.520 --> 0:26:49.800
<v Speaker 3>I think is is just a like a delineation that

0:26:49.840 --> 0:26:53.119
<v Speaker 3>will be so important coming forward because like one of

0:26:53.160 --> 0:26:57.480
<v Speaker 3>the biggest pushbacks against any kind of political action against

0:26:57.520 --> 0:27:00.359
<v Speaker 3>concentration of power in like the hands of a UAI

0:27:00.440 --> 0:27:02.679
<v Speaker 3>companies is well, people are using it, people love to

0:27:02.760 --> 0:27:05.479
<v Speaker 3>use it. Like, yes, I also I love to use it,

0:27:05.880 --> 0:27:08.800
<v Speaker 3>but you know you can they don't have the monopoly

0:27:08.960 --> 0:27:12.679
<v Speaker 3>on the technology. They are not the sole inventors or

0:27:13.160 --> 0:27:16.360
<v Speaker 3>the only people who can push this stuff. And if

0:27:16.480 --> 0:27:19.440
<v Speaker 3>young people are getting involved in thinking about open source

0:27:19.480 --> 0:27:21.399
<v Speaker 3>models for it. I think that's awesome.

0:27:21.920 --> 0:27:25.320
<v Speaker 4>I just want to see them exert more political power,

0:27:25.359 --> 0:27:27.920
<v Speaker 4>and I wish that these kids, you know, it's frustrating

0:27:27.920 --> 0:27:29.720
<v Speaker 4>because to read the media coverage of a lot of

0:27:29.800 --> 0:27:32.639
<v Speaker 4>this stuff, it's like a reporter shows up for one

0:27:32.720 --> 0:27:33.360
<v Speaker 4>day they're.

0:27:33.119 --> 0:27:36.080
<v Speaker 2>Like, Wow, these kids hate tech, they like the flip phones.

0:27:36.119 --> 0:27:38.680
<v Speaker 4>Like it's just this very surface level coverage that doesn't

0:27:38.720 --> 0:27:41.320
<v Speaker 4>really interrogate their ideology or what they're trying to achieve,

0:27:41.880 --> 0:27:45.080
<v Speaker 4>and it doesn't mention that they are actually opposed to,

0:27:45.960 --> 0:27:50.800
<v Speaker 4>extremely opposed to this entire online safety slop about protect

0:27:50.840 --> 0:27:52.919
<v Speaker 4>the children that claims to be anti big tech, Like

0:27:53.240 --> 0:27:55.879
<v Speaker 4>these these kids are very anti surveillance. And part of

0:27:55.920 --> 0:27:58.240
<v Speaker 4>the reason they didn't want it all, like document it

0:27:58.760 --> 0:28:00.920
<v Speaker 4>was because they feel like they've lived their entire entire

0:28:01.040 --> 0:28:03.960
<v Speaker 4>lives where like everything is packaged and documented and shared

0:28:04.000 --> 0:28:07.240
<v Speaker 4>and surveilled, and so yeah, I just like, I don't know,

0:28:07.240 --> 0:28:10.040
<v Speaker 4>I'm heartened some of them are gonna apparently protest in

0:28:10.119 --> 0:28:13.520
<v Speaker 4>DC soon. I just want them to, Like, I want

0:28:13.520 --> 0:28:16.639
<v Speaker 4>these people to like get quoted more, you know, instead

0:28:16.640 --> 0:28:19.000
<v Speaker 4>of these like fake groups like design It for Us

0:28:19.160 --> 0:28:21.320
<v Speaker 4>that are just fake gen z groups that just like

0:28:21.440 --> 0:28:24.480
<v Speaker 4>pretend to be anti big tech but exists to push

0:28:24.560 --> 0:28:25.400
<v Speaker 4>metas policies.

0:28:25.640 --> 0:28:27.720
<v Speaker 1>But it's sort of hard to quote them because many

0:28:27.760 --> 0:28:29.760
<v Speaker 1>of them didn't reveal their identities, right, I mean talk

0:28:29.800 --> 0:28:32.400
<v Speaker 1>about who are the organizers and do you think it's

0:28:32.640 --> 0:28:36.359
<v Speaker 1>strategic benefit or strategic mistake not to allow it? I mean,

0:28:36.400 --> 0:28:38.520
<v Speaker 1>I remember the Occupy wool Street days, Right, there's like.

0:28:38.480 --> 0:28:40.800
<v Speaker 4>They reveal their idea. They're not They're not like masked

0:28:40.880 --> 0:28:42.920
<v Speaker 4>or secretive or anything. I mean you could talk to

0:28:42.960 --> 0:28:47.960
<v Speaker 4>them the during the actual event. They did have a

0:28:48.080 --> 0:28:50.480
<v Speaker 4>press puppet, so they had this puppet that would speak

0:28:50.640 --> 0:28:54.240
<v Speaker 4>for them to the media just because they didn't. It

0:28:54.280 --> 0:28:57.280
<v Speaker 4>was like this massive decentralized event and they didn't want

0:28:57.320 --> 0:29:00.360
<v Speaker 4>media just like going around like talking to random people

0:29:00.400 --> 0:29:03.880
<v Speaker 4>instead of like hearing sort of from them, like the organizers.

0:29:03.960 --> 0:29:07.360
<v Speaker 4>But they're not like hard to find. I mean I

0:29:07.560 --> 0:29:09.200
<v Speaker 4>spoke to these people. You could show up four or

0:29:09.240 --> 0:29:12.640
<v Speaker 4>four Media was there, Wired was there, The Economists was

0:29:12.680 --> 0:29:15.560
<v Speaker 4>allegedly there, so they're you know, again, this is a

0:29:15.760 --> 0:29:18.600
<v Speaker 4>massive public event in New York City with hundreds, if

0:29:18.600 --> 0:29:20.280
<v Speaker 4>not thousands of people participating.

0:29:20.680 --> 0:29:22.720
<v Speaker 1>Taylor, do you have any sense of where this where

0:29:22.760 --> 0:29:25.440
<v Speaker 1>this goes this this movement, I mean, does does this

0:29:25.560 --> 0:29:28.520
<v Speaker 1>ladder up to be like a policy platform for the Democrats?

0:29:28.600 --> 0:29:31.680
<v Speaker 4>For not for the Democrats. They don't like the Democratic Party.

0:29:31.800 --> 0:29:34.360
<v Speaker 4>These kids, you know, their mom Donnie supporters, they're veryed

0:29:34.360 --> 0:29:37.440
<v Speaker 4>to the left. I think they're part of this faction

0:29:37.600 --> 0:29:41.240
<v Speaker 4>of the left that's that's exerting pressure on the Democrats,

0:29:41.280 --> 0:29:43.200
<v Speaker 4>you know, and you see the Democrats struggling. This is

0:29:43.240 --> 0:29:45.760
<v Speaker 4>part of why they want to control the internet so badly.

0:29:45.800 --> 0:29:49.880
<v Speaker 4>It is because the establishment democrat sort of policies are

0:29:49.920 --> 0:29:52.840
<v Speaker 4>not popular among their base, and especially not with young

0:29:52.840 --> 0:29:55.200
<v Speaker 4>people like these who hate mass surveillance.

0:29:56.760 --> 0:30:01.560
<v Speaker 1>When we come back read experiences that downside of using

0:30:01.560 --> 0:30:15.440
<v Speaker 1>AI agents stay with us, Welcome back.

0:30:15.720 --> 0:30:15.920
<v Speaker 5>Read.

0:30:16.000 --> 0:30:17.680
<v Speaker 1>We heard in the early part of this year about

0:30:17.760 --> 0:30:22.600
<v Speaker 1>token maxing. There's now token minning happening for Sudden eight

0:30:22.680 --> 0:30:25.760
<v Speaker 1>companies A being their employees to cut back on over

0:30:25.880 --> 0:30:29.400
<v Speaker 1>use of AI books of the cost of tokens. This

0:30:29.440 --> 0:30:33.400
<v Speaker 1>is something you, in a very human way, experience yourself.

0:30:33.480 --> 0:30:36.120
<v Speaker 6>Yeah, well, while while you and I were in Can

0:30:36.200 --> 0:30:39.160
<v Speaker 6>hanging out, you know till the wee hours of the

0:30:39.200 --> 0:30:42.800
<v Speaker 6>morning or whatever, jet you know, my codex.

0:30:42.880 --> 0:30:45.000
<v Speaker 1>My I hasten to add at a at a work

0:30:45.040 --> 0:30:49.160
<v Speaker 1>at a work adjacent to it was Creator Economy, slash Marketing.

0:30:49.360 --> 0:30:52.640
<v Speaker 6>It was for sure, it was all at work, but

0:30:52.720 --> 0:30:56.400
<v Speaker 6>it was you know, while I was gone, I had

0:30:56.440 --> 0:30:59.040
<v Speaker 6>noticed a couple of bills for like five dollars in

0:30:59.080 --> 0:31:01.959
<v Speaker 6>my in my email. And you know, when you're in Europe,

0:31:02.080 --> 0:31:04.520
<v Speaker 6>I don't know, it's just I don't know about you, OZ,

0:31:04.560 --> 0:31:06.840
<v Speaker 6>but I always find it hard to like actually get online.

0:31:07.360 --> 0:31:09.360
<v Speaker 6>And then I was on vacation, you know, in the

0:31:09.400 --> 0:31:10.880
<v Speaker 6>Alps with the family and everything.

0:31:10.880 --> 0:31:11.400
<v Speaker 5>It was great.

0:31:11.840 --> 0:31:14.840
<v Speaker 6>But I come back and I'm like, it's like Sunday morning,

0:31:14.880 --> 0:31:16.840
<v Speaker 6>and I'm jet lagged, and I'm at my computer. I'm

0:31:16.840 --> 0:31:18.880
<v Speaker 6>trying to figure out what these bills are on my

0:31:19.040 --> 0:31:21.600
<v Speaker 6>you know, from my codex, which I hadn't been using.

0:31:21.440 --> 0:31:25.160
<v Speaker 1>A codex read is is is open Ay's platform or

0:31:25.160 --> 0:31:26.480
<v Speaker 1>how do you define codex?

0:31:26.720 --> 0:31:26.920
<v Speaker 5>Yeah?

0:31:26.960 --> 0:31:30.160
<v Speaker 6>I mean, it's it's this Mac app that basically lets

0:31:30.200 --> 0:31:32.760
<v Speaker 6>you be pretend to be a software developer. It just

0:31:32.760 --> 0:31:35.040
<v Speaker 6>does everything for you and we'll you know, you can

0:31:35.280 --> 0:31:38.600
<v Speaker 6>basically start as many AI agents as you want and

0:31:38.680 --> 0:31:40.920
<v Speaker 6>have them work on these on these projects for you.

0:31:41.000 --> 0:31:44.240
<v Speaker 6>I love it. It's fantastic. Like we've I've built so many

0:31:44.240 --> 0:31:47.440
<v Speaker 6>cool things with it, Like I've gone from zero software

0:31:47.440 --> 0:31:50.560
<v Speaker 6>development to like using it all the time. But like

0:31:50.640 --> 0:31:53.360
<v Speaker 6>I hadn't set any limits on this thing, and it

0:31:53.640 --> 0:31:55.720
<v Speaker 6>I go to my credit card bill and it's just

0:31:55.880 --> 0:31:58.840
<v Speaker 6>all open AI bill, like for five dollars, just like

0:31:58.880 --> 0:32:00.960
<v Speaker 6>a huge It just goes on forever, and I'm like,

0:32:01.000 --> 0:32:07.040
<v Speaker 6>oh god, what so like this is partially me like

0:32:07.480 --> 0:32:10.120
<v Speaker 6>making fun of myself for the benefit of readers and

0:32:10.520 --> 0:32:11.840
<v Speaker 6>hopefully humanity.

0:32:12.000 --> 0:32:13.840
<v Speaker 1>Well, what was the project that you would you were

0:32:13.880 --> 0:32:15.880
<v Speaker 1>trying to do and how did how did how did

0:32:15.920 --> 0:32:19.120
<v Speaker 1>open ai codex go rogue in terms of these repeated charges?

0:32:19.640 --> 0:32:21.400
<v Speaker 6>Yeah, well what it What it was was that all

0:32:21.440 --> 0:32:25.160
<v Speaker 6>my projects got deleted and I had to reinstall the

0:32:25.360 --> 0:32:29.400
<v Speaker 6>software and then I but I before I deleted Codex

0:32:29.440 --> 0:32:33.040
<v Speaker 6>form my computer, I asked Codex to make a prompt

0:32:33.080 --> 0:32:36.480
<v Speaker 6>for me to restore my old projects once I reinstalled it,

0:32:36.520 --> 0:32:38.640
<v Speaker 6>because like the files are there, just like all the

0:32:38.720 --> 0:32:41.400
<v Speaker 6>chats are gone. But I had I had one of

0:32:41.400 --> 0:32:44.240
<v Speaker 6>these projects was particularly complicated and I won't go into

0:32:44.240 --> 0:32:46.680
<v Speaker 6>the details, but I tried to restore it right before

0:32:46.720 --> 0:32:49.680
<v Speaker 6>I left on this vacation, and I wasn't monitoring it,

0:32:50.240 --> 0:32:52.720
<v Speaker 6>and it somehow got stuck in this loop where it

0:32:52.800 --> 0:32:56.400
<v Speaker 6>was just reading all of this data over and over again,

0:32:56.480 --> 0:32:59.320
<v Speaker 6>like every day, and then running out of credits and

0:32:59.360 --> 0:33:02.320
<v Speaker 6>then like top up my my five dollars credits. So

0:33:02.360 --> 0:33:04.680
<v Speaker 6>like there were some days where there were like twenty

0:33:05.120 --> 0:33:08.320
<v Speaker 6>five dollars charges in a single day, and I just

0:33:08.360 --> 0:33:11.000
<v Speaker 6>had no idea this was happening for two weeks. It

0:33:11.040 --> 0:33:13.120
<v Speaker 6>turned out it wasn't that much. It was only like

0:33:13.200 --> 0:33:15.840
<v Speaker 6>five hundred bucks, I mean, which is still a lot,

0:33:15.880 --> 0:33:18.600
<v Speaker 6>but like it could have been thousands, you know, it

0:33:18.640 --> 0:33:19.480
<v Speaker 6>was it was like.

0:33:19.480 --> 0:33:20.840
<v Speaker 1>Hey, you got and you've got lucky. What was the

0:33:20.920 --> 0:33:22.760
<v Speaker 1>five dollar how come it was in five dollars increment?

0:33:22.960 --> 0:33:25.400
<v Speaker 5>It just tops itself up in five dollars increments? I

0:33:25.400 --> 0:33:25.680
<v Speaker 5>don't know.

0:33:25.680 --> 0:33:28.600
<v Speaker 6>I like, I must have checked that box at some

0:33:28.640 --> 0:33:31.760
<v Speaker 6>point and totally forgot about it. But what was also

0:33:31.840 --> 0:33:34.520
<v Speaker 6>sort of funny about this is like, so to try

0:33:34.520 --> 0:33:37.240
<v Speaker 6>to figure out what had happened, of course, like I'm

0:33:37.240 --> 0:33:40.520
<v Speaker 6>going to ask Codex, right, So I'm like, I'm like,

0:33:40.600 --> 0:33:42.840
<v Speaker 6>can you figure out why you're billing me five dollars?

0:33:42.840 --> 0:33:45.120
<v Speaker 6>And it goes and does like an investigation and comes

0:33:45.120 --> 0:33:48.320
<v Speaker 6>back and it's like, here's here's what happened. And I'm like, okay, well,

0:33:48.360 --> 0:33:52.000
<v Speaker 6>then help me write an email to open AI to

0:33:52.400 --> 0:33:54.920
<v Speaker 6>get a refund, like I want to a refund for

0:33:55.000 --> 0:33:58.160
<v Speaker 6>my five rebox. So it's like, okay, here's I'll draft

0:33:58.200 --> 0:34:00.600
<v Speaker 6>this email. And here's like all the bill and everything.

0:34:00.960 --> 0:34:02.800
<v Speaker 6>It even went to my I had it go to

0:34:02.880 --> 0:34:06.800
<v Speaker 6>my credit card and like, you know, cross reference it

0:34:06.840 --> 0:34:09.200
<v Speaker 6>and make sure it all matched up. And then it's like,

0:34:09.239 --> 0:34:10.640
<v Speaker 6>but you shouldn't send an email.

0:34:10.800 --> 0:34:11.280
<v Speaker 5>You should.

0:34:11.400 --> 0:34:15.040
<v Speaker 6>You should send that basically their their customer service chatbot.

0:34:15.160 --> 0:34:17.680
<v Speaker 6>You should start a chat with it. So I started

0:34:17.800 --> 0:34:21.480
<v Speaker 6>chat and which of course is just an Opening Eye chatbot.

0:34:22.000 --> 0:34:24.719
<v Speaker 6>So now the chatbot is responding to me, and I'm

0:34:24.760 --> 0:34:27.600
<v Speaker 6>copying that response and pasting it into Codex, and then

0:34:27.640 --> 0:34:30.160
<v Speaker 6>Codex is responding and I'm pasting it into the chat

0:34:30.200 --> 0:34:33.359
<v Speaker 6>and I'm like, I'm just a go between between one

0:34:33.360 --> 0:34:36.040
<v Speaker 6>of Open a Eye's products and another Opening Eye product.

0:34:36.040 --> 0:34:39.120
<v Speaker 5>Now like I'm the It was just hilarious.

0:34:38.800 --> 0:34:41.399
<v Speaker 1>When it coast you is five dollars everything, right, But I.

0:34:41.320 --> 0:34:42.759
<v Speaker 5>Got a nice little story out of it.

0:34:42.920 --> 0:34:46.680
<v Speaker 4>Read this is this, this sounds like a nightmare scenario.

0:34:47.280 --> 0:34:49.560
<v Speaker 6>It was a It was a total nightmare scenario, but

0:34:49.680 --> 0:34:54.600
<v Speaker 6>like also fascinating and and and still other than telling

0:34:54.680 --> 0:34:58.400
<v Speaker 6>Opening Eyes pr you know, one of their what what

0:34:58.440 --> 0:34:59.360
<v Speaker 6>did those people call it?

0:34:59.440 --> 0:35:03.120
<v Speaker 5>The puppet? The media puppet or the media puppet.

0:35:03.239 --> 0:35:06.120
<v Speaker 6>About this, like I never interacted with the human Like

0:35:06.200 --> 0:35:09.080
<v Speaker 6>I was the only human involved in this whole, Like

0:35:09.160 --> 0:35:11.560
<v Speaker 6>I still have not heard from like a Open. I

0:35:11.560 --> 0:35:14.440
<v Speaker 6>don't even know if Opening has human customer service reps.

0:35:14.600 --> 0:35:17.799
<v Speaker 6>So it was, you know, it was it was a

0:35:17.840 --> 0:35:20.960
<v Speaker 6>learning experience for me. And also just like I thought

0:35:21.000 --> 0:35:23.839
<v Speaker 6>it was relevant because we're having this big discussion now

0:35:23.960 --> 0:35:26.120
<v Speaker 6>in one of the big discussions in AI is the

0:35:26.160 --> 0:35:28.120
<v Speaker 6>cost of all this stuff, and companies are trying to

0:35:28.120 --> 0:35:30.880
<v Speaker 6>figure this out, and I'm like this must be happening

0:35:31.080 --> 0:35:34.200
<v Speaker 6>just constantly every day at these companies, Like people are

0:35:34.280 --> 0:35:37.960
<v Speaker 6>just on purpose or not on purpose, like putting these

0:35:38.000 --> 0:35:40.440
<v Speaker 6>things into these loops and wasting a bunch of just

0:35:41.200 --> 0:35:43.719
<v Speaker 6>you know, and it's it's a point in time, like

0:35:43.760 --> 0:35:46.279
<v Speaker 6>I think this stuff will all get solved, But I'm

0:35:46.280 --> 0:35:49.560
<v Speaker 6>also kind of like somebody's got to figure this out

0:35:49.640 --> 0:35:52.919
<v Speaker 6>for consumers. It's just not it's not a consumer product yet,

0:35:53.480 --> 0:35:55.799
<v Speaker 6>and I really think in the next like year or two,

0:35:55.960 --> 0:35:57.960
<v Speaker 6>there's going to be some company that just comes out

0:35:58.000 --> 0:36:01.319
<v Speaker 6>of nowhere and makes like go for ai that's just

0:36:01.400 --> 0:36:04.520
<v Speaker 6>like the ultimate consumer product, and everyone's like, holy shit,

0:36:04.680 --> 0:36:07.680
<v Speaker 6>this is it, and I don't. I mean, I used

0:36:07.680 --> 0:36:09.400
<v Speaker 6>to think it would be Opening Eye, it would be

0:36:09.520 --> 0:36:11.520
<v Speaker 6>Google or somebody, but I'm starting.

0:36:11.239 --> 0:36:13.799
<v Speaker 4>To think, well, else, it's in the market. I mean,

0:36:13.800 --> 0:36:15.879
<v Speaker 4>they should be building now, we would know about it.

0:36:16.000 --> 0:36:18.520
<v Speaker 6>Someone's working in stealth mode or something. But there's a

0:36:18.800 --> 0:36:21.560
<v Speaker 6>there's a Larry and Serge who are probably like just

0:36:22.440 --> 0:36:25.399
<v Speaker 6>writing their application to Stanford, who are going to create

0:36:25.480 --> 0:36:26.120
<v Speaker 6>this product?

0:36:26.480 --> 0:36:27.520
<v Speaker 5>Is my guess.

0:36:28.160 --> 0:36:31.680
<v Speaker 1>Natascha Taita, what does Read's Quoti retail make you think?

0:36:31.960 --> 0:36:35.200
<v Speaker 4>I'm very parent, I'm very into like cloud code and

0:36:35.239 --> 0:36:37.680
<v Speaker 4>I try. I like made agents and stuff, and I

0:36:37.680 --> 0:36:41.440
<v Speaker 4>have little automated things. But I am so paranoid about

0:36:41.520 --> 0:36:44.080
<v Speaker 4>exactly what we described because I feel like I hear

0:36:44.120 --> 0:36:48.640
<v Speaker 4>from friends about like similar experiences. I just think it's

0:36:48.680 --> 0:36:51.560
<v Speaker 4>really easy to like spend money and not realize it

0:36:51.600 --> 0:36:53.680
<v Speaker 4>if you're not super adept at these tools, which I

0:36:53.719 --> 0:36:57.080
<v Speaker 4>certainly am not, and most consumers are not so yeah,

0:36:57.160 --> 0:36:58.640
<v Speaker 4>I do think that this is a problem that the

0:36:58.640 --> 0:37:01.080
<v Speaker 4>companies are going to have to solve. Ultimately, there's just

0:37:01.080 --> 0:37:04.040
<v Speaker 4>gonna be a lot of angry customers, if you know,

0:37:04.400 --> 0:37:06.719
<v Speaker 4>especially when you're starting to use chattupet for shopping, which

0:37:06.760 --> 0:37:10.520
<v Speaker 4>I do all the time now, Like I'm very careful

0:37:10.520 --> 0:37:12.759
<v Speaker 4>to go to like third party services. But you know,

0:37:12.800 --> 0:37:16.080
<v Speaker 4>I just readd my living room and I was taking

0:37:16.120 --> 0:37:19.200
<v Speaker 4>pictures of products and saying, hey, you know, chattupt find

0:37:19.239 --> 0:37:22.600
<v Speaker 4>me dupes. Basically I can't, you know, cheaper versions of everything.

0:37:23.560 --> 0:37:24.960
<v Speaker 4>But there's a world where I could just say, like,

0:37:25.000 --> 0:37:27.920
<v Speaker 4>here's a picture, find cheaper versions of everything, go off

0:37:27.920 --> 0:37:30.040
<v Speaker 4>and buy it and order it. I would actually love that.

0:37:30.040 --> 0:37:33.120
<v Speaker 4>That would save me so much time. But without safeguards

0:37:33.120 --> 0:37:35.160
<v Speaker 4>in place, like I would be so nervous. It'd probably

0:37:35.239 --> 0:37:38.360
<v Speaker 4>ordered me five hundred chairs, and yeah, I'd broke.

0:37:38.920 --> 0:37:40.920
<v Speaker 3>For some reason, it just made me think. I feel

0:37:40.960 --> 0:37:43.880
<v Speaker 3>like there was some kid who racked up a massive

0:37:44.040 --> 0:37:47.879
<v Speaker 3>candy crush bill, like without his parents knowing, and there

0:37:47.960 --> 0:37:51.640
<v Speaker 3>must be so many of those happening right now, except

0:37:51.680 --> 0:37:54.799
<v Speaker 3>the cap is like insanely high. I mean, yeah, I

0:37:54.800 --> 0:37:57.359
<v Speaker 3>think like the lack of fine brain controls. Like even

0:37:57.440 --> 0:38:00.279
<v Speaker 3>just hearing that it went to your credit card read

0:38:00.480 --> 0:38:03.359
<v Speaker 3>is just like you know, because you hear about like

0:38:03.760 --> 0:38:07.279
<v Speaker 3>you hear about things going awry all the time. But

0:38:07.360 --> 0:38:09.239
<v Speaker 3>now I've got to go find the kids who racked

0:38:09.320 --> 0:38:13.520
<v Speaker 3>up like a million dollar token max bill. Maybe Larry

0:38:13.520 --> 0:38:16.120
<v Speaker 3>and Surge the future Larry and Sergey are actually just

0:38:16.160 --> 0:38:16.600
<v Speaker 3>in debt.

0:38:16.680 --> 0:38:18.560
<v Speaker 5>Now that would be a great story.

0:38:18.680 --> 0:38:20.920
<v Speaker 6>I mean, but yeah, I think it's like, but I'm

0:38:20.920 --> 0:38:23.000
<v Speaker 6>also kind of like, yeah, but what's the alternative? The

0:38:23.040 --> 0:38:26.000
<v Speaker 6>alternative is like you as a tech reporter, like you

0:38:26.120 --> 0:38:28.480
<v Speaker 6>just don't use this stuff, and like you're not you know,

0:38:28.640 --> 0:38:31.000
<v Speaker 6>you're not You're not seeing it. Like if you don't

0:38:31.040 --> 0:38:32.680
<v Speaker 6>I think, if you don't use it, and you're not.

0:38:32.760 --> 0:38:34.680
<v Speaker 1>Able to expense the five hundred bucks the sem before

0:38:34.760 --> 0:38:37.320
<v Speaker 1>read in service of your general.

0:38:37.560 --> 0:38:40.040
<v Speaker 5>Expensing the five hundred bucks because I wrote about it.

0:38:40.080 --> 0:38:40.920
<v Speaker 5>Now it's for a story.

0:38:41.040 --> 0:38:42.640
<v Speaker 1>No, I'm just curious, what where does this? I mean,

0:38:42.719 --> 0:38:44.600
<v Speaker 1>just as we close, like, where does this fit in

0:38:44.640 --> 0:38:48.720
<v Speaker 1>the in the larger kind of token maxing to token minning?

0:38:49.480 --> 0:38:49.960
<v Speaker 5>Ceasaw?

0:38:50.040 --> 0:38:52.760
<v Speaker 1>I mean, there was a a New York Times story

0:38:52.760 --> 0:38:55.480
<v Speaker 1>recently with the headline tech workers maxed out their AI use.

0:38:55.560 --> 0:38:58.520
<v Speaker 1>Now they're trying to minimize it. And it's basically about

0:38:58.560 --> 0:39:02.520
<v Speaker 1>perverse corporate rewards and how employees were like basically promoted

0:39:02.560 --> 0:39:04.320
<v Speaker 1>on the basis of how many tokens they've burned. And

0:39:04.360 --> 0:39:06.880
<v Speaker 1>then the tech companies realize this is an extremely bad idea,

0:39:07.320 --> 0:39:09.480
<v Speaker 1>And now tech companies like Meta are trying to encourage

0:39:09.480 --> 0:39:12.359
<v Speaker 1>employees to use their internal models and not always use

0:39:12.400 --> 0:39:15.160
<v Speaker 1>the most advanced available you know models, because that max

0:39:15.200 --> 0:39:18.000
<v Speaker 1>is up too many tokens. Uber I think burnt through

0:39:18.040 --> 0:39:20.279
<v Speaker 1>all of its AI budget in the first four months

0:39:20.280 --> 0:39:23.799
<v Speaker 1>of this year. Like how does your experience kind of

0:39:23.920 --> 0:39:27.920
<v Speaker 1>map to the larger discourse about token token maxing? And

0:39:28.080 --> 0:39:31.600
<v Speaker 1>and I guess finally, is this a like a headwind

0:39:31.719 --> 0:39:35.360
<v Speaker 1>for open ai? And you know, Anthropic and Google in

0:39:35.440 --> 0:39:38.920
<v Speaker 1>terms of people come much more posimonious with wanting to

0:39:39.000 --> 0:39:39.600
<v Speaker 1>use this stuff.

0:39:39.760 --> 0:39:40.000
<v Speaker 5>Yeah.

0:39:40.000 --> 0:39:42.120
<v Speaker 6>I mean, so there's two there's two questions there, and

0:39:42.160 --> 0:39:45.280
<v Speaker 6>I think one is like there's a there's a pattern

0:39:45.440 --> 0:39:49.080
<v Speaker 6>in all of this where a new a new capability

0:39:49.160 --> 0:39:52.000
<v Speaker 6>or new product comes out and then it's very inefficient,

0:39:52.040 --> 0:39:55.120
<v Speaker 6>it's very expensive, and then it and then it quickly

0:39:56.040 --> 0:39:58.880
<v Speaker 6>you know, becomes about efficiency, right, and I think we

0:39:59.040 --> 0:40:02.680
<v Speaker 6>had the new thing here was was the harnesses the

0:40:02.719 --> 0:40:06.359
<v Speaker 6>ability to use like way more tokens, which started sort

0:40:06.360 --> 0:40:09.120
<v Speaker 6>of at the end of last year, and people got

0:40:09.200 --> 0:40:11.760
<v Speaker 6>very excited about it. Companies set up these leader boards

0:40:11.760 --> 0:40:14.279
<v Speaker 6>that you're talking about, and which of course is going

0:40:14.320 --> 0:40:17.400
<v Speaker 6>to just incentivize people to waste as much tokens as possible.

0:40:17.920 --> 0:40:19.239
<v Speaker 5>And now we're already.

0:40:18.920 --> 0:40:20.960
<v Speaker 6>At the point where the companies are like, okay, we

0:40:21.040 --> 0:40:23.720
<v Speaker 6>kind of understand this, now, now let's make it efficient.

0:40:23.760 --> 0:40:26.560
<v Speaker 6>So it's a very natural kind of up and down cycle.

0:40:26.560 --> 0:40:29.279
<v Speaker 6>And there will probably be something that happens, like at

0:40:29.280 --> 0:40:31.800
<v Speaker 6>the end of this year. You know that that causes

0:40:31.840 --> 0:40:35.040
<v Speaker 6>the same thing, the token usage will spike again. And

0:40:35.080 --> 0:40:37.839
<v Speaker 6>I don't know what that is, but maybe Natasha knows.

0:40:37.840 --> 0:40:40.279
<v Speaker 3>But like, no, I think that. I mean, first of all,

0:40:40.320 --> 0:40:42.720
<v Speaker 3>everyone told them the leader boards were a bad idea

0:40:42.800 --> 0:40:46.560
<v Speaker 3>when they did them, Like this was not like a say, and.

0:40:46.520 --> 0:40:48.600
<v Speaker 5>They knew it. They knew it, they knew that would happen.

0:40:48.800 --> 0:40:52.000
<v Speaker 3>But I'll just say I think that this is I'm

0:40:52.040 --> 0:40:55.120
<v Speaker 3>seeing at least more debate around like you know read

0:40:55.200 --> 0:40:57.759
<v Speaker 3>you've called it like the token economy. I think I've

0:40:57.800 --> 0:41:00.520
<v Speaker 3>seen more debate around whether that is the way to

0:41:00.640 --> 0:41:02.880
<v Speaker 3>charge for these chatbots. I mean you even see like

0:41:03.080 --> 0:41:07.080
<v Speaker 3>Alex Karp, the CEO of Palenteer, talking about like why

0:41:07.080 --> 0:41:09.200
<v Speaker 3>would you pay for that when they are going to

0:41:10.080 --> 0:41:12.080
<v Speaker 3>you know, why would you pay for using this intelligence

0:41:12.120 --> 0:41:14.920
<v Speaker 3>when they can then take your data and you know,

0:41:15.120 --> 0:41:17.400
<v Speaker 3>like replicate what your company does or you know, if

0:41:17.400 --> 0:41:20.520
<v Speaker 3>you're a biotech like take that kind of information. And

0:41:20.600 --> 0:41:23.280
<v Speaker 3>I think that's really interesting, like pushing for a different

0:41:23.320 --> 0:41:25.480
<v Speaker 3>kind of payment or business model.

0:41:25.840 --> 0:41:28.400
<v Speaker 6>Yeah, I mean there's also something happening here, which is

0:41:28.480 --> 0:41:32.920
<v Speaker 6>like there's what companies use internally with their software development teams,

0:41:33.239 --> 0:41:36.799
<v Speaker 6>and then what the wider teams use, and then and

0:41:36.840 --> 0:41:40.160
<v Speaker 6>then what they use for their customer facing products, and

0:41:40.320 --> 0:41:43.479
<v Speaker 6>of course the software development teams, I think they still

0:41:43.520 --> 0:41:46.680
<v Speaker 6>have all the best models. They're they're not skimping. Nobody

0:41:46.760 --> 0:41:48.880
<v Speaker 6>that I talked to is like skimping on that really,

0:41:49.440 --> 0:41:52.880
<v Speaker 6>and then on the customer facing stuff, Like there was

0:41:52.920 --> 0:41:55.719
<v Speaker 6>a CTO of like a major consumer brand who told

0:41:55.719 --> 0:42:00.200
<v Speaker 6>me that, you know, they are using all these Chinese models,

0:42:00.239 --> 0:42:01.880
<v Speaker 6>but they don't even want to tell the world that

0:42:02.080 --> 0:42:04.640
<v Speaker 6>because they'll get a letter from the commerce department. So

0:42:05.840 --> 0:42:08.400
<v Speaker 6>it's just I think it's like this is not like

0:42:08.480 --> 0:42:11.360
<v Speaker 6>one blanket thing. There's a lot of nuance happening there.

0:42:11.960 --> 0:42:16.520
<v Speaker 6>So I think, you know, Alex Krp's point was was right.

0:42:16.600 --> 0:42:20.200
<v Speaker 6>It's just that, like the the market is so large

0:42:20.360 --> 0:42:23.120
<v Speaker 6>that I don't think it matters for these companies like Anthropic,

0:42:23.200 --> 0:42:26.360
<v Speaker 6>like the the they have only started to really scratch

0:42:26.440 --> 0:42:30.359
<v Speaker 6>the surface in terms of like penetration, so there's gonna

0:42:30.400 --> 0:42:32.800
<v Speaker 6>be the pie is growing so big that they're fine. However,

0:42:32.920 --> 0:42:35.880
<v Speaker 6>I do think this is a headwind for like the

0:42:36.000 --> 0:42:39.960
<v Speaker 6>larger the company. You're more at a disadvantage here because

0:42:40.440 --> 0:42:43.560
<v Speaker 6>a small startup can come in and they can they

0:42:43.560 --> 0:42:46.320
<v Speaker 6>don't this doesn't matter, Like these these startups in Silicon

0:42:46.400 --> 0:42:48.719
<v Speaker 6>Valley will use as much as many tokens as they

0:42:48.760 --> 0:42:52.000
<v Speaker 6>want of the best models because they're they're first of all,

0:42:52.000 --> 0:42:54.080
<v Speaker 6>they're venture backed. Like it doesn't you know, they're not

0:42:54.160 --> 0:42:57.080
<v Speaker 6>like looking at profitability at this point. They're looking at growth,

0:42:57.400 --> 0:43:00.279
<v Speaker 6>and so they're just gonna max out on the tokens.

0:43:00.800 --> 0:43:04.040
<v Speaker 6>And a big company with forty fifty thousand employees or

0:43:04.040 --> 0:43:07.120
<v Speaker 6>more like they can't do that. The costs just go

0:43:07.360 --> 0:43:11.360
<v Speaker 6>so they're ultimately like they're more susceptible for disruption, and

0:43:11.400 --> 0:43:12.879
<v Speaker 6>I think you're going to see a lot of that.

0:43:12.960 --> 0:43:16.120
<v Speaker 6>Like the regulated industries, maybe that happens more slowly, but

0:43:16.239 --> 0:43:18.920
<v Speaker 6>in non regulated spaces it's going to happen fast.

0:43:20.800 --> 0:43:22.520
<v Speaker 1>That's all we have time for today. Thank you all

0:43:22.560 --> 0:43:23.480
<v Speaker 1>so much for joining us.

0:43:23.560 --> 0:43:25.840
<v Speaker 2>Thank you guys, thanks for having.

0:43:25.640 --> 0:43:36.239
<v Speaker 1>Us for tech stuff. I'm mos Voloshin. This episode was

0:43:36.239 --> 0:43:39.960
<v Speaker 1>produced by Eliza Dennis and Sina Ozaki. It was executive

0:43:39.960 --> 0:43:43.720
<v Speaker 1>produced by me and Julia Nutta for Kaleidoscope and Katrina

0:43:43.800 --> 0:43:47.800
<v Speaker 1>Novel for iHeart Podcasts. Our engineer today was Eli Bronstein.

0:43:48.080 --> 0:43:50.840
<v Speaker 1>Jack Insley makes this episode and Kyle Murdoch wrote our

0:43:50.920 --> 0:43:54.080
<v Speaker 1>theme song. A special thank you to Taylor Lorenz, Natasha

0:43:54.080 --> 0:43:57.879
<v Speaker 1>Tiku and read Albergotti. Please check out all the work

0:43:57.920 --> 0:43:59.960
<v Speaker 1>they put out into the world. We're lucky to call

0:44:00.080 --> 0:44:02.600
<v Speaker 1>them friends at the pod