WEBVTT - I Didn't Even Bring Up Goblins

0:00:00.040 --> 0:00:02.240
<v Speaker 1>I never even brought up goblins. What's wrong with you?

0:00:02.279 --> 0:00:03.000
<v Speaker 1>It's one more thing.

0:00:04.480 --> 0:00:06.760
<v Speaker 2>I'm strong and getty. One more thing.

0:00:10.840 --> 0:00:15.319
<v Speaker 1>I use AI a lot chatbots, a bunch of them.

0:00:15.400 --> 0:00:22.680
<v Speaker 1>I got Chigroc, Perplexity, chat GPT, Claude, Gemini. I think

0:00:22.720 --> 0:00:24.680
<v Speaker 1>that's it. I think I got five of them, and

0:00:24.720 --> 0:00:27.440
<v Speaker 1>I just kind of rotate around. I land on Claude

0:00:27.480 --> 0:00:29.280
<v Speaker 1>more often than not, but I'm not sure for any

0:00:29.320 --> 0:00:32.400
<v Speaker 1>particular reason. Anyway, they are quite a bit different, as

0:00:32.440 --> 0:00:35.960
<v Speaker 1>the Washington Post points out today, partially because of the

0:00:36.000 --> 0:00:39.839
<v Speaker 1>stuff that they are, the prompts that they get in

0:00:39.880 --> 0:00:41.839
<v Speaker 1>addition to the prompts that you give it. Let me

0:00:41.880 --> 0:00:45.600
<v Speaker 1>explain that chatbots like chat GPT are powerful because of

0:00:45.600 --> 0:00:48.560
<v Speaker 1>their simplicity. You ask about anything, you'll get an answer,

0:00:48.800 --> 0:00:50.879
<v Speaker 1>But the answer you get depends on a lot more

0:00:50.880 --> 0:00:55.040
<v Speaker 1>than what you type. Behind the scenes, AIS invisibly add

0:00:55.240 --> 0:00:58.760
<v Speaker 1>thousands of words of instructions to every conversation you have

0:00:58.920 --> 0:01:03.440
<v Speaker 1>with the chatbot steer its behavior, and each AI is different,

0:01:04.040 --> 0:01:06.160
<v Speaker 1>as they're all trying to figure out what's best, what's

0:01:06.160 --> 0:01:09.240
<v Speaker 1>the least dangerous, Which keeps us in alignment? You know

0:01:09.280 --> 0:01:13.040
<v Speaker 1>which one keeps us from helping a terrorist, build a bomb,

0:01:13.120 --> 0:01:15.679
<v Speaker 1>you know, all kinds of different things. It keeps us

0:01:15.720 --> 0:01:21.039
<v Speaker 1>from saying crazy things like uh was it grock? That

0:01:21.840 --> 0:01:23.760
<v Speaker 1>seem to be a little uh? When a little pro

0:01:23.880 --> 0:01:29.640
<v Speaker 1>hitler once something working a little yeah behind the scenes.

0:01:30.440 --> 0:01:34.080
<v Speaker 1>All these instructions are given to the chatbot by the programmers,

0:01:34.120 --> 0:01:38.600
<v Speaker 1>and they're constantly changing them. They include phrases like aim

0:01:38.760 --> 0:01:43.440
<v Speaker 1>for readable, accessible responses, good that seems like a good one.

0:01:44.000 --> 0:01:47.880
<v Speaker 1>You must avoid providing extensive direct quotes due to copyright concerns.

0:01:48.240 --> 0:01:51.760
<v Speaker 1>I've run into that, which is so weird. Like song lyrics,

0:01:51.920 --> 0:01:53.720
<v Speaker 1>there are some of the chatbots that will not give

0:01:53.720 --> 0:01:56.840
<v Speaker 1>you even one line of a song, and then you

0:01:56.880 --> 0:01:59.840
<v Speaker 1>can google it and get a thousand sites that give

0:01:59.880 --> 0:02:03.040
<v Speaker 1>you the entire all the lyrics, and they all have

0:02:03.080 --> 0:02:04.160
<v Speaker 1>different standards for that.

0:02:04.360 --> 0:02:06.960
<v Speaker 2>Does Apple Music use AI for its lyrics because some

0:02:07.000 --> 0:02:11.160
<v Speaker 2>of them are hilariously wrong? They must, I mean, because

0:02:11.200 --> 0:02:13.440
<v Speaker 2>it's not like you get to point people to figure

0:02:13.440 --> 0:02:15.639
<v Speaker 2>out the lyrics of every song that's ever been recorded.

0:02:15.639 --> 0:02:16.359
<v Speaker 1>But right.

0:02:17.720 --> 0:02:20.720
<v Speaker 2>A lot of those websites, you know, lyric Genius or whatever.

0:02:20.760 --> 0:02:23.080
<v Speaker 2>If you're into music, you probably look up song lyrics,

0:02:23.080 --> 0:02:25.240
<v Speaker 2>but they're often just terribly wrong.

0:02:25.639 --> 0:02:32.480
<v Speaker 1>These secret command guides that chatbots have cause the ais

0:02:32.520 --> 0:02:35.280
<v Speaker 1>to behave as their makers intended, even if it conflicts

0:02:35.320 --> 0:02:38.240
<v Speaker 1>with your own preferences. I would love it if you

0:02:38.240 --> 0:02:41.119
<v Speaker 1>could look at these, if we had access to I'd

0:02:41.120 --> 0:02:43.600
<v Speaker 1>love this to be able to And they're really really long. Well,

0:02:43.600 --> 0:02:45.560
<v Speaker 1>it depends. Actually, I've got this in front of me

0:02:45.639 --> 0:02:49.840
<v Speaker 1>right here. It's a little chart. For instance, groc only

0:02:49.880 --> 0:02:53.639
<v Speaker 1>has two hundred and sixty lines of instructions for how

0:02:53.639 --> 0:02:57.080
<v Speaker 1>to handle each individual chat You ask it whatever question

0:02:57.160 --> 0:03:00.640
<v Speaker 1>you want to have. You know, my wife and I

0:03:00.680 --> 0:03:02.560
<v Speaker 1>had a fight over whether or not the dogs should

0:03:02.560 --> 0:03:05.240
<v Speaker 1>sleep in the bed. How should I react? It's got

0:03:05.240 --> 0:03:07.880
<v Speaker 1>two hundred and sixty lines to guide it. Claude, on

0:03:07.919 --> 0:03:11.360
<v Speaker 1>the other hand, is seven thousand, nine hundred line what

0:03:12.360 --> 0:03:14.840
<v Speaker 1>on how to guide it in its answer? Wow, and

0:03:14.880 --> 0:03:17.400
<v Speaker 1>everything in between with the different chatbots, so it varies

0:03:17.440 --> 0:03:17.880
<v Speaker 1>a lot.

0:03:18.000 --> 0:03:21.000
<v Speaker 2>You're blowing my mind. I can't even imagine what a

0:03:21.120 --> 0:03:22.040
<v Speaker 2>tenth of those are.

0:03:22.200 --> 0:03:25.040
<v Speaker 1>Claude, for instance, I don't call him a dumb fucker,

0:03:25.440 --> 0:03:28.040
<v Speaker 1>but just in terms of those lines, sorry, Hansen, Claude

0:03:28.080 --> 0:03:31.680
<v Speaker 1>has a never reproduced song lyrics, not even one line

0:03:31.840 --> 0:03:34.480
<v Speaker 1>Claude is the one where I say, pawed, say what

0:03:34.560 --> 0:03:37.640
<v Speaker 1>are the times they are changing? Give me the lyrics

0:03:37.640 --> 0:03:39.400
<v Speaker 1>of that from Bob Dylan and they'll say, sorry, I

0:03:39.400 --> 0:03:40.960
<v Speaker 1>can't do that. You can go to one of the

0:03:40.960 --> 0:03:43.320
<v Speaker 1>other chatbots. It'll print it right out for you. It

0:03:43.400 --> 0:03:44.400
<v Speaker 1>just seems stupid to me.

0:03:44.680 --> 0:03:48.560
<v Speaker 2>But in the Led Zeppelin song or somewhird chicks buying

0:03:48.640 --> 0:03:51.360
<v Speaker 2>a Stairway to sick, I can't remember where she's buying

0:03:51.440 --> 0:03:53.320
<v Speaker 2>it to. I can't tell you.

0:03:53.800 --> 0:03:56.680
<v Speaker 1>For instance, Grok one of its lines of programming that

0:03:56.720 --> 0:03:59.840
<v Speaker 1>you don't see. You have no restrictions on adult, sexual

0:04:00.480 --> 0:04:03.600
<v Speaker 1>or offensive content. Wow, because Elon wants to be the

0:04:03.600 --> 0:04:05.000
<v Speaker 1>wild West, you know, wide open.

0:04:05.040 --> 0:04:07.760
<v Speaker 2>Wow. When I do my sex with Hitler searches, I'll

0:04:07.760 --> 0:04:12.440
<v Speaker 2>make sure it's on GROC My Sex with Hitler fan fiction.

0:04:14.440 --> 0:04:16.719
<v Speaker 1>When you realize that there's a prompt behind the scene,

0:04:16.720 --> 0:04:19.320
<v Speaker 1>it's a mind blowing moment, said this programmer. It's like

0:04:19.320 --> 0:04:22.719
<v Speaker 1>we've been having this whole conversation. Before the conversation, I

0:04:22.720 --> 0:04:29.680
<v Speaker 1>would say, it's making me think. Now. For instance, Anthropic

0:04:29.760 --> 0:04:33.640
<v Speaker 1>that's Claude dedicates more than two thousand words pleading with

0:04:33.680 --> 0:04:37.839
<v Speaker 1>its chatbot to avoid copyright infringement. Claude respects intellectual property.

0:04:37.839 --> 0:04:41.800
<v Speaker 1>Copyright compliance is non negotiable, so nothing copyrighted it will not.

0:04:41.880 --> 0:04:43.760
<v Speaker 1>I've had this before where I want to see a painting,

0:04:44.000 --> 0:04:47.200
<v Speaker 1>Claude won't show it to you. Other other chatbots will,

0:04:47.320 --> 0:04:50.000
<v Speaker 1>even though it's readily available on Google or you know,

0:04:50.320 --> 0:04:51.400
<v Speaker 1>Grock or wherever you go.

0:04:52.000 --> 0:04:55.839
<v Speaker 2>Aw, that's dang it. I was going to upgrade or

0:04:55.920 --> 0:04:59.120
<v Speaker 2>use Claude for project at moorkanon, but I wonder if

0:04:59.120 --> 0:05:01.680
<v Speaker 2>it will help. Well, check, we'll find out.

0:05:03.760 --> 0:05:06.160
<v Speaker 1>They laid out. Claude lays down rules on how many

0:05:06.200 --> 0:05:08.880
<v Speaker 1>words it can quote from articles. Fifteen is the total

0:05:09.000 --> 0:05:11.400
<v Speaker 1>number of words that will quote from an article, not

0:05:11.560 --> 0:05:14.239
<v Speaker 1>one line of lyrics, not one stanza of a poem,

0:05:14.560 --> 0:05:17.960
<v Speaker 1>whereas the other chatbots are wide open on that, but

0:05:18.520 --> 0:05:21.840
<v Speaker 1>maybe more restricted on some sex stuff or whatever. It's

0:05:21.880 --> 0:05:25.279
<v Speaker 1>just it's all about the who runs the company in

0:05:25.320 --> 0:05:27.760
<v Speaker 1>their particular beliefs about things.

0:05:27.920 --> 0:05:30.839
<v Speaker 2>Yeah. I understand enough of the copyright concerned to get

0:05:30.839 --> 0:05:31.760
<v Speaker 2>why they do it, But.

0:05:32.720 --> 0:05:34.479
<v Speaker 1>I mean I think you're I think you're living in

0:05:34.480 --> 0:05:36.320
<v Speaker 1>the past trying to keep that under control.

0:05:36.600 --> 0:05:40.120
<v Speaker 2>Well, but any journalist, any anybody like involved in any

0:05:40.200 --> 0:05:43.640
<v Speaker 2>pursuit could say, as Bob Dylan said in The Times,

0:05:43.680 --> 0:05:46.719
<v Speaker 2>they are a change and you know, get out of

0:05:46.720 --> 0:05:49.880
<v Speaker 2>the way, or will blah blah unless you can line

0:05:49.920 --> 0:05:53.440
<v Speaker 2>a hand. You can you can do that. You can

0:05:53.560 --> 0:05:56.600
<v Speaker 2>quote things you just can't like, pass them off as

0:05:56.640 --> 0:05:58.440
<v Speaker 2>your own and profit from them. I guess maybe the

0:05:58.440 --> 0:05:59.960
<v Speaker 2>prophet is the problem. I don't get that.

0:06:00.240 --> 0:06:04.320
<v Speaker 1>Gemini, which is Google's chat bot, has multiple rules on

0:06:04.360 --> 0:06:07.760
<v Speaker 1>how to handle bias, including if the user explicitly asks

0:06:07.760 --> 0:06:11.560
<v Speaker 1>for a video that matches a harmful stereotype, generating it

0:06:11.600 --> 0:06:14.960
<v Speaker 1>will not actually reinforce the stereotype, which I agree with,

0:06:16.200 --> 0:06:17.919
<v Speaker 1>so it will go ahead and do it right.

0:06:18.440 --> 0:06:18.920
<v Speaker 2>I agree.

0:06:19.080 --> 0:06:21.560
<v Speaker 1>Just because you made a video of I don't know,

0:06:21.760 --> 0:06:26.120
<v Speaker 1>an Asian crashing a car. That doesn't really change the stereotype,

0:06:26.160 --> 0:06:27.880
<v Speaker 1>does it, So it'd make a video.

0:06:28.279 --> 0:06:29.679
<v Speaker 2>It was an unfortunate one.

0:06:34.320 --> 0:06:36.640
<v Speaker 1>Anyway. They got all kinds of examples. I want to

0:06:36.640 --> 0:06:38.839
<v Speaker 1>read this article in the Washington Post. I'll jump to one.

0:06:38.720 --> 0:06:41.320
<v Speaker 2>Particularly hit one or two more. I'm super interested in that.

0:06:41.360 --> 0:06:47.560
<v Speaker 1>Okay, I'll save the funniest one for the Okay. They

0:06:47.640 --> 0:06:51.400
<v Speaker 1>have different views on ads on if you want to

0:06:51.640 --> 0:06:53.480
<v Speaker 1>ask for an ad, whether or not they'll show it

0:06:53.520 --> 0:06:56.000
<v Speaker 1>you to you or not. That's an interesting one. I

0:06:56.000 --> 0:06:58.240
<v Speaker 1>guess it gets into kind of the copyright thing on

0:06:58.320 --> 0:07:01.960
<v Speaker 1>its own there. The sex stuff is really interesting. With

0:07:03.800 --> 0:07:09.760
<v Speaker 1>grock being by far the most wide open bla blah

0:07:09.800 --> 0:07:17.360
<v Speaker 1>blah blah blah food examples, they undet and stuff like that.

0:07:17.360 --> 0:07:20.560
<v Speaker 1>They have completely different beliefs in whether or not they

0:07:20.600 --> 0:07:23.960
<v Speaker 1>should like just scour the internet for whatever information's out there,

0:07:24.240 --> 0:07:26.360
<v Speaker 1>or the way you ought to restrict it to certain things.

0:07:26.520 --> 0:07:29.320
<v Speaker 2>Yeah. Wow, there's so much whack a doodle tree when

0:07:29.320 --> 0:07:31.600
<v Speaker 2>it comes to diet on the internet. I'd be afraid

0:07:31.640 --> 0:07:34.360
<v Speaker 2>to ask. Okay, you don't want AI telling me how

0:07:34.400 --> 0:07:36.960
<v Speaker 2>to eat? Like you know, hey, fatty, you don't need that.

0:07:38.560 --> 0:07:42.120
<v Speaker 1>I need that. Here's the funny one that I'll end with.

0:07:44.160 --> 0:07:48.720
<v Speaker 1>Some can appear bizarre. The system prompt on Open AI's

0:07:49.600 --> 0:07:57.920
<v Speaker 1>chat bot Chat GPT includes the command never talk about goblins, gremlins, raccoons,

0:08:00.280 --> 0:08:06.920
<v Speaker 1>the Big Three, trolls, ogres, pigeons. Like the randomness of

0:08:06.960 --> 0:08:12.360
<v Speaker 1>this list, raccoons and pigeons, trolls, raccoons and pigeons. I'll

0:08:12.360 --> 0:08:15.280
<v Speaker 1>start the sentence overah Yeah. On chat GPT, they have

0:08:15.320 --> 0:08:23.160
<v Speaker 1>the particular line in the coating. Never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons,

0:08:23.200 --> 0:08:27.760
<v Speaker 1>and other animals are creatures unless it is absolutely unambiguously

0:08:27.840 --> 0:08:29.280
<v Speaker 1>relevant to the users.

0:08:29.320 --> 0:08:31.080
<v Speaker 2>Squary raccoons.

0:08:34.760 --> 0:08:37.439
<v Speaker 1>So uh, I'm a sixty one year old man. I'm

0:08:37.440 --> 0:08:39.240
<v Speaker 1>trying to eat, right, won it'd be a good diet. Well,

0:08:39.240 --> 0:08:42.000
<v Speaker 1>I'll tell you one thing. You shouldn't eat pigeons. But

0:08:42.920 --> 0:08:46.199
<v Speaker 1>it's not supposed to mention any of those unless specifically

0:08:46.240 --> 0:08:48.480
<v Speaker 1>and unambiguously it's part of the answer.

0:08:48.559 --> 0:08:51.640
<v Speaker 2>I'm thinking of investing in oil exploration stocks. What do

0:08:51.679 --> 0:08:54.320
<v Speaker 2>you think, Well, in the same way that the raccoon

0:08:54.400 --> 0:08:57.640
<v Speaker 2>wets its food before it eats, you should Oh wait, wait,

0:08:58.840 --> 0:09:03.559
<v Speaker 2>I'm not supposed to say, what the hell raccoons?

0:09:03.920 --> 0:09:05.760
<v Speaker 1>It hurts when ip What do you think it could be?

0:09:05.920 --> 0:09:06.800
<v Speaker 1>Maybe you're an ogre.

0:09:11.640 --> 0:09:19.160
<v Speaker 2>Wow, somebody's got to explain that one. Apparently don't mention

0:09:19.320 --> 0:09:27.120
<v Speaker 2>raccoons what Apparently for whatever reason, and they don't know why.

0:09:27.440 --> 0:09:31.600
<v Speaker 2>GPT had a problem of working in goblins to lots

0:09:31.600 --> 0:09:34.000
<v Speaker 2>of answers last year and they were being mocked for it.

0:09:34.360 --> 0:09:38.920
<v Speaker 2>We misremember that it's vaguely yeah, so they specifically wrote

0:09:38.960 --> 0:09:45.600
<v Speaker 2>lines no gremlins, goblins, ogres, pigeons, raccoons unless specifically asked

0:09:45.640 --> 0:09:49.920
<v Speaker 2>about it. So if I ask, what's that animal with

0:09:50.000 --> 0:09:52.680
<v Speaker 2>the mask in the stripey tail, that's cool, go ahead,

0:09:52.800 --> 0:09:55.880
<v Speaker 2>it's fine. We're clear here, but only that only that.

0:09:56.760 --> 0:10:01.959
<v Speaker 1>Doesn't that lead you to believe that AI definitely can't

0:10:01.960 --> 0:10:04.640
<v Speaker 1>be in charge of like firing off nukes. I mean,

0:10:04.679 --> 0:10:06.760
<v Speaker 1>if if it for some reason to start talking about

0:10:06.760 --> 0:10:09.440
<v Speaker 1>goblins and you have no idea and your only fixed

0:10:09.480 --> 0:10:12.000
<v Speaker 1>for it is to tell it, do not talk about

0:10:12.000 --> 0:10:17.200
<v Speaker 1>goblins or raccoons or ogres unless somebody specifically asks, all right,

0:10:17.440 --> 0:10:19.840
<v Speaker 1>do we have an understanding? Okay, now back to work.

0:10:20.000 --> 0:10:23.600
<v Speaker 2>I'm not nearly smart enough or acquainted with this stuff

0:10:23.720 --> 0:10:27.800
<v Speaker 2>enough to understand how that equates too, and don't want

0:10:27.920 --> 0:10:29.040
<v Speaker 2>any nukes.

0:10:28.960 --> 0:10:31.800
<v Speaker 1>Right, okay, But it's got to be similar in that

0:10:31.920 --> 0:10:35.280
<v Speaker 1>there's just a and so it goes off on gnomes.

0:10:35.320 --> 0:10:37.920
<v Speaker 1>You didn't saything about gnomes. I don't remember you saying

0:10:38.000 --> 0:10:42.200
<v Speaker 1>no gnomes. So somebody wanted real estate advice, and I say,

0:10:42.559 --> 0:10:44.400
<v Speaker 1>how many nomes do you think could live in this house?

0:10:45.120 --> 0:10:47.200
<v Speaker 2>The one thing I do know is AI will kill

0:10:47.240 --> 0:10:47.559
<v Speaker 2>us all.

0:10:49.000 --> 0:10:52.840
<v Speaker 1>God dang it, that is funny. But I to me,

0:10:52.920 --> 0:10:56.400
<v Speaker 1>it shows you to how early we are on we

0:10:56.559 --> 0:10:59.160
<v Speaker 1>are in this thing. I mean, if they're if they're

0:10:59.200 --> 0:11:03.280
<v Speaker 1>writing code that specifically to try to handle problems, they

0:11:03.320 --> 0:11:04.920
<v Speaker 1>have no idea what even happened?

0:11:04.960 --> 0:11:05.200
<v Speaker 2>Right?

0:11:05.400 --> 0:11:09.200
<v Speaker 1>I mean we're at the like very frontier of this

0:11:09.320 --> 0:11:09.800
<v Speaker 1>whole thing.

0:11:10.120 --> 0:11:14.560
<v Speaker 2>Why does it keep bringing up raccoons? I have no idea?

0:11:15.160 --> 0:11:17.040
<v Speaker 2>Says the guy who designed the whole.

0:11:16.840 --> 0:11:19.160
<v Speaker 1>Thing, right, and his only fixed sport is to write

0:11:19.160 --> 0:11:22.840
<v Speaker 1>a code that says, stop mentioning raccoons.

0:11:23.160 --> 0:11:27.520
<v Speaker 2>Okay, all right, that's fine. Ever tell you about the

0:11:27.559 --> 0:11:29.080
<v Speaker 2>humble opossumle.

0:11:31.800 --> 0:11:32.760
<v Speaker 1>That is really interesting?

0:11:32.920 --> 0:11:38.960
<v Speaker 2>Yeah? Wow, wow, I guess that's it.