Speaker 1: I never even brought up goblins. What's wrong with you?
Speaker 1: It's one more thing.
Speaker 2: I'm strong and getty. One more thing.
Speaker 1: I use AI a lot chatbots, a bunch of them.
Speaker 1: I got Chigroc, Perplexity, chat GPT, Claude, Gemini. I think
Speaker 1: that's it. I think I got five of them, and
Speaker 1: I just kind of rotate around. I land on Claude
Speaker 1: more often than not, but I'm not sure for any
Speaker 1: particular reason. Anyway, they are quite a bit different, as
Speaker 1: the Washington Post points out today, partially because of the
Speaker 1: stuff that they are, the prompts that they get in
Speaker 1: addition to the prompts that you give it. Let me
Speaker 1: explain that chatbots like chat GPT are powerful because of
Speaker 1: their simplicity. You ask about anything, you'll get an answer,
Speaker 1: But the answer you get depends on a lot more
Speaker 1: than what you type. Behind the scenes, AIS invisibly add
Speaker 1: thousands of words of instructions to every conversation you have
Speaker 1: with the chatbot steer its behavior, and each AI is different,
Speaker 1: as they're all trying to figure out what's best, what's
Speaker 1: the least dangerous, Which keeps us in alignment? You know
Speaker 1: which one keeps us from helping a terrorist, build a bomb,
Speaker 1: you know, all kinds of different things. It keeps us
Speaker 1: from saying crazy things like uh was it grock? That
Speaker 1: seem to be a little uh? When a little pro
Speaker 1: hitler once something working a little yeah behind the scenes.
Speaker 1: All these instructions are given to the chatbot by the programmers,
Speaker 1: and they're constantly changing them. They include phrases like aim
Speaker 1: for readable, accessible responses, good that seems like a good one.
Speaker 1: You must avoid providing extensive direct quotes due to copyright concerns.
Speaker 1: I've run into that, which is so weird. Like song lyrics,
Speaker 1: there are some of the chatbots that will not give
Speaker 1: you even one line of a song, and then you
Speaker 1: can google it and get a thousand sites that give
Speaker 1: you the entire all the lyrics, and they all have
Speaker 1: different standards for that.
Speaker 2: Does Apple Music use AI for its lyrics because some
Speaker 2: of them are hilariously wrong? They must, I mean, because
Speaker 2: it's not like you get to point people to figure
Speaker 2: out the lyrics of every song that's ever been recorded.
Speaker 1: But right.
Speaker 2: A lot of those websites, you know, lyric Genius or whatever.
Speaker 2: If you're into music, you probably look up song lyrics,
Speaker 2: but they're often just terribly wrong.
Speaker 1: These secret command guides that chatbots have cause the ais
Speaker 1: to behave as their makers intended, even if it conflicts
Speaker 1: with your own preferences. I would love it if you
Speaker 1: could look at these, if we had access to I'd
Speaker 1: love this to be able to And they're really really long. Well,
Speaker 1: it depends. Actually, I've got this in front of me
Speaker 1: right here. It's a little chart. For instance, groc only
Speaker 1: has two hundred and sixty lines of instructions for how
Speaker 1: to handle each individual chat You ask it whatever question
Speaker 1: you want to have. You know, my wife and I
Speaker 1: had a fight over whether or not the dogs should
Speaker 1: sleep in the bed. How should I react? It's got
Speaker 1: two hundred and sixty lines to guide it. Claude, on
Speaker 1: the other hand, is seven thousand, nine hundred line what
Speaker 1: on how to guide it in its answer? Wow, and
Speaker 1: everything in between with the different chatbots, so it varies
Speaker 1: a lot.
Speaker 2: You're blowing my mind. I can't even imagine what a
Speaker 2: tenth of those are.
Speaker 1: Claude, for instance, I don't call him a dumb fucker,
Speaker 1: but just in terms of those lines, sorry, Hansen, Claude
Speaker 1: has a never reproduced song lyrics, not even one line
Speaker 1: Claude is the one where I say, pawed, say what
Speaker 1: are the times they are changing? Give me the lyrics
Speaker 1: of that from Bob Dylan and they'll say, sorry, I
Speaker 1: can't do that. You can go to one of the
Speaker 1: other chatbots. It'll print it right out for you. It
Speaker 1: just seems stupid to me.
Speaker 2: But in the Led Zeppelin song or somewhird chicks buying
Speaker 2: a Stairway to sick, I can't remember where she's buying
Speaker 2: it to. I can't tell you.
Speaker 1: For instance, Grok one of its lines of programming that
Speaker 1: you don't see. You have no restrictions on adult, sexual
Speaker 1: or offensive content. Wow, because Elon wants to be the
Speaker 1: wild West, you know, wide open.
Speaker 2: Wow. When I do my sex with Hitler searches, I'll
Speaker 2: make sure it's on GROC My Sex with Hitler fan fiction.
Speaker 1: When you realize that there's a prompt behind the scene,
Speaker 1: it's a mind blowing moment, said this programmer. It's like
Speaker 1: we've been having this whole conversation. Before the conversation, I
Speaker 1: would say, it's making me think. Now. For instance, Anthropic
Speaker 1: that's Claude dedicates more than two thousand words pleading with
Speaker 1: its chatbot to avoid copyright infringement. Claude respects intellectual property.
Speaker 1: Copyright compliance is non negotiable, so nothing copyrighted it will not.
Speaker 1: I've had this before where I want to see a painting,
Speaker 1: Claude won't show it to you. Other other chatbots will,
Speaker 1: even though it's readily available on Google or you know,
Speaker 1: Grock or wherever you go.
Speaker 2: Aw, that's dang it. I was going to upgrade or
Speaker 2: use Claude for project at moorkanon, but I wonder if
Speaker 2: it will help. Well, check, we'll find out.
Speaker 1: They laid out. Claude lays down rules on how many
Speaker 1: words it can quote from articles. Fifteen is the total
Speaker 1: number of words that will quote from an article, not
Speaker 1: one line of lyrics, not one stanza of a poem,
Speaker 1: whereas the other chatbots are wide open on that, but
Speaker 1: maybe more restricted on some sex stuff or whatever. It's
Speaker 1: just it's all about the who runs the company in
Speaker 1: their particular beliefs about things.
Speaker 2: Yeah. I understand enough of the copyright concerned to get
Speaker 2: why they do it, But.
Speaker 1: I mean I think you're I think you're living in
Speaker 1: the past trying to keep that under control.
Speaker 2: Well, but any journalist, any anybody like involved in any
Speaker 2: pursuit could say, as Bob Dylan said in The Times,
Speaker 2: they are a change and you know, get out of
Speaker 2: the way, or will blah blah unless you can line
Speaker 2: a hand. You can you can do that. You can
Speaker 2: quote things you just can't like, pass them off as
Speaker 2: your own and profit from them. I guess maybe the
Speaker 2: prophet is the problem. I don't get that.
Speaker 1: Gemini, which is Google's chat bot, has multiple rules on
Speaker 1: how to handle bias, including if the user explicitly asks
Speaker 1: for a video that matches a harmful stereotype, generating it
Speaker 1: will not actually reinforce the stereotype, which I agree with,
Speaker 1: so it will go ahead and do it right.
Speaker 2: I agree.
Speaker 1: Just because you made a video of I don't know,
Speaker 1: an Asian crashing a car. That doesn't really change the stereotype,
Speaker 1: does it, So it'd make a video.
Speaker 2: It was an unfortunate one.
Speaker 1: Anyway. They got all kinds of examples. I want to
Speaker 1: read this article in the Washington Post. I'll jump to one.
Speaker 2: Particularly hit one or two more. I'm super interested in that.
Speaker 1: Okay, I'll save the funniest one for the Okay. They
Speaker 1: have different views on ads on if you want to
Speaker 1: ask for an ad, whether or not they'll show it
Speaker 1: you to you or not. That's an interesting one. I
Speaker 1: guess it gets into kind of the copyright thing on
Speaker 1: its own there. The sex stuff is really interesting. With
Speaker 1: grock being by far the most wide open bla blah
Speaker 1: blah blah blah food examples, they undet and stuff like that.
Speaker 1: They have completely different beliefs in whether or not they
Speaker 1: should like just scour the internet for whatever information's out there,
Speaker 1: or the way you ought to restrict it to certain things.
Speaker 2: Yeah. Wow, there's so much whack a doodle tree when
Speaker 2: it comes to diet on the internet. I'd be afraid
Speaker 2: to ask. Okay, you don't want AI telling me how
Speaker 2: to eat? Like you know, hey, fatty, you don't need that.
Speaker 1: I need that. Here's the funny one that I'll end with.
Speaker 1: Some can appear bizarre. The system prompt on Open AI's
Speaker 1: chat bot Chat GPT includes the command never talk about goblins, gremlins, raccoons,
Speaker 1: the Big Three, trolls, ogres, pigeons. Like the randomness of
Speaker 1: this list, raccoons and pigeons, trolls, raccoons and pigeons. I'll
Speaker 1: start the sentence overah Yeah. On chat GPT, they have
Speaker 1: the particular line in the coating. Never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons,
Speaker 1: and other animals are creatures unless it is absolutely unambiguously
Speaker 1: relevant to the users.
Speaker 2: Squary raccoons.
Speaker 1: So uh, I'm a sixty one year old man. I'm
Speaker 1: trying to eat, right, won it'd be a good diet. Well,
Speaker 1: I'll tell you one thing. You shouldn't eat pigeons. But
Speaker 1: it's not supposed to mention any of those unless specifically
Speaker 1: and unambiguously it's part of the answer.
Speaker 2: I'm thinking of investing in oil exploration stocks. What do
Speaker 2: you think, Well, in the same way that the raccoon
Speaker 2: wets its food before it eats, you should Oh wait, wait,
Speaker 2: I'm not supposed to say, what the hell raccoons?
Speaker 1: It hurts when ip What do you think it could be?
Speaker 1: Maybe you're an ogre.
Speaker 2: Wow, somebody's got to explain that one. Apparently don't mention
Speaker 2: raccoons what Apparently for whatever reason, and they don't know why.
Speaker 2: GPT had a problem of working in goblins to lots
Speaker 2: of answers last year and they were being mocked for it.
Speaker 2: We misremember that it's vaguely yeah, so they specifically wrote
Speaker 2: lines no gremlins, goblins, ogres, pigeons, raccoons unless specifically asked
Speaker 2: about it. So if I ask, what's that animal with
Speaker 2: the mask in the stripey tail, that's cool, go ahead,
Speaker 2: it's fine. We're clear here, but only that only that.
Speaker 1: Doesn't that lead you to believe that AI definitely can't
Speaker 1: be in charge of like firing off nukes. I mean,
Speaker 1: if if it for some reason to start talking about
Speaker 1: goblins and you have no idea and your only fixed
Speaker 1: for it is to tell it, do not talk about
Speaker 1: goblins or raccoons or ogres unless somebody specifically asks, all right,
Speaker 1: do we have an understanding? Okay, now back to work.
Speaker 2: I'm not nearly smart enough or acquainted with this stuff
Speaker 2: enough to understand how that equates too, and don't want
Speaker 2: any nukes.
Speaker 1: Right, okay, But it's got to be similar in that
Speaker 1: there's just a and so it goes off on gnomes.
Speaker 1: You didn't saything about gnomes. I don't remember you saying
Speaker 1: no gnomes. So somebody wanted real estate advice, and I say,
Speaker 1: how many nomes do you think could live in this house?
Speaker 2: The one thing I do know is AI will kill
Speaker 2: us all.
Speaker 1: God dang it, that is funny. But I to me,
Speaker 1: it shows you to how early we are on we
Speaker 1: are in this thing. I mean, if they're if they're
Speaker 1: writing code that specifically to try to handle problems, they
Speaker 1: have no idea what even happened?
Speaker 2: Right?
Speaker 1: I mean we're at the like very frontier of this
Speaker 1: whole thing.
Speaker 2: Why does it keep bringing up raccoons? I have no idea?
Speaker 2: Says the guy who designed the whole.
Speaker 1: Thing, right, and his only fixed sport is to write
Speaker 1: a code that says, stop mentioning raccoons.
Speaker 2: Okay, all right, that's fine. Ever tell you about the
Speaker 2: humble opossumle.
Speaker 1: That is really interesting?
Speaker 2: Yeah? Wow, wow, I guess that's it.