WEBVTT - From the Vault: Machine Consciousness and P-Zombies

0:00:05.720 --> 0:00:08.000
<v Speaker 1>Hey, welcome to Stuff to Blow Your Mind. My name

0:00:08.039 --> 0:00:11.280
<v Speaker 1>is Robert Lamb and I'm Joe McCormick, and it's Saturday.

0:00:11.320 --> 0:00:13.280
<v Speaker 1>Time to go into the vault for a classic episode

0:00:13.280 --> 0:00:15.200
<v Speaker 1>of Stuff to Blow Your Mind. This one originally aired

0:00:15.240 --> 0:00:19.400
<v Speaker 1>April twelve, and this one was a lot of fun.

0:00:19.400 --> 0:00:21.560
<v Speaker 1>This is where we addressed the question of how could

0:00:21.640 --> 0:00:24.160
<v Speaker 1>you tell if a machine was conscious. We've asked the

0:00:24.239 --> 0:00:27.000
<v Speaker 1>question a lot of times, could a machine be conscious?

0:00:27.040 --> 0:00:30.480
<v Speaker 1>We don't know the answer to that, but yeah, seldom

0:00:30.480 --> 0:00:33.239
<v Speaker 1>do you ask the question if it was conscious, how

0:00:33.240 --> 0:00:34.880
<v Speaker 1>would you know it? How would you know it wasn't

0:00:34.920 --> 0:00:39.280
<v Speaker 1>just pretending like a p zombie? Right? In this episode,

0:00:39.280 --> 0:00:43.159
<v Speaker 1>we also looked at the classical thought experiment, the philosophical zombie.

0:00:43.680 --> 0:00:50.040
<v Speaker 1>So we hope you enjoyed this Vault episode. Welcome to

0:00:50.360 --> 0:01:00.000
<v Speaker 1>Stuff to Blow Your Mind from how Stuffworks dot Com. Hey,

0:01:00.000 --> 0:01:01.680
<v Speaker 1>welcome to Stuff to Blow your Mind. My name is

0:01:01.760 --> 0:01:04.400
<v Speaker 1>Robert Lamb and I'm Joe McCormick. And today we're gonna

0:01:04.440 --> 0:01:08.319
<v Speaker 1>be exploring a question about artificial intelligence. So I want

0:01:08.319 --> 0:01:10.720
<v Speaker 1>to start off by telling a story to put us

0:01:10.720 --> 0:01:14.679
<v Speaker 1>in a scenario, give us something to contemplate. So I

0:01:14.760 --> 0:01:17.679
<v Speaker 1>want you to imagine that you are a low level

0:01:17.720 --> 0:01:22.560
<v Speaker 1>assistant or like an intern at a Google artificial intelligence lab,

0:01:23.280 --> 0:01:25.800
<v Speaker 1>and the main researcher you've been working for is named

0:01:25.880 --> 0:01:30.360
<v Speaker 1>Dr Stratton, and she develops a I Chat modules to

0:01:30.400 --> 0:01:34.160
<v Speaker 1>help refine the next generation of digital assistance on Google

0:01:34.200 --> 0:01:37.759
<v Speaker 1>mobile devices, and she says what she wants is for

0:01:37.880 --> 0:01:40.360
<v Speaker 1>the Google Phone of the future to do more than

0:01:40.400 --> 0:01:43.040
<v Speaker 1>just transcribe search terms, so you don't just say, hey,

0:01:43.080 --> 0:01:47.520
<v Speaker 1>search for old Dorito's logo, but that you can actually

0:01:47.800 --> 0:01:53.040
<v Speaker 1>have have a semantic understanding based conversation with the digital assistant,

0:01:53.280 --> 0:01:57.200
<v Speaker 1>and it will help you solve problems conversationally. So ideally

0:01:57.240 --> 0:02:00.600
<v Speaker 1>you'll be able to say, hey, phone, have a flat

0:02:00.640 --> 0:02:02.720
<v Speaker 1>tire and I don't know what to do, and the

0:02:02.760 --> 0:02:05.440
<v Speaker 1>assistant will be able to scan both the web and

0:02:05.480 --> 0:02:08.560
<v Speaker 1>your personal data, figure out what your options are and

0:02:08.600 --> 0:02:10.840
<v Speaker 1>talk through them with you. So it might say, do

0:02:10.919 --> 0:02:13.839
<v Speaker 1>you have a spare tire in the trunk? If so,

0:02:14.160 --> 0:02:16.720
<v Speaker 1>here's where you can probably find it, and I can

0:02:16.760 --> 0:02:19.400
<v Speaker 1>talk you through replacing the flat one step at a time.

0:02:20.000 --> 0:02:22.320
<v Speaker 1>If you don't have a spare, you could call your

0:02:22.400 --> 0:02:26.320
<v Speaker 1>frequent contact Mary, who is currently checked in less than

0:02:26.360 --> 0:02:29.160
<v Speaker 1>a mile away and she could help you. I can

0:02:29.240 --> 0:02:32.880
<v Speaker 1>also contact the following towing services. Looks like this one

0:02:32.960 --> 0:02:37.000
<v Speaker 1>is the closest with an acceptable star rating and so forth. Anyway,

0:02:37.080 --> 0:02:40.280
<v Speaker 1>so you're working on this program with Dr Stratton, and

0:02:40.320 --> 0:02:43.480
<v Speaker 1>the most recent version is being trained based on powerful

0:02:43.560 --> 0:02:47.440
<v Speaker 1>neural net style machine learning algorithms based on this huge

0:02:47.520 --> 0:02:52.160
<v Speaker 1>corpus of recorded conversations available on the Internet, and the

0:02:52.200 --> 0:02:55.440
<v Speaker 1>program is still in its infancy, and it's mostly hilarious

0:02:55.520 --> 0:02:58.080
<v Speaker 1>at this point. Sometimes it gets the advice way off.

0:02:58.120 --> 0:03:00.760
<v Speaker 1>If you're trying to change a time, ire might tell

0:03:00.800 --> 0:03:03.440
<v Speaker 1>you to go to a grocery store and buy some crackers.

0:03:03.760 --> 0:03:07.360
<v Speaker 1>Sometimes it responds to problems by telling you to pray.

0:03:07.440 --> 0:03:10.600
<v Speaker 1>It's just not ready yet. And the latest iteration of

0:03:10.639 --> 0:03:14.680
<v Speaker 1>the program, version nine point one, is at this point

0:03:14.720 --> 0:03:18.080
<v Speaker 1>redundantly stored across multiple machines, so you've got copies of

0:03:18.080 --> 0:03:20.200
<v Speaker 1>it all over the place. And at the end of

0:03:20.200 --> 0:03:22.480
<v Speaker 1>one work day, after playing around with nine point one

0:03:22.480 --> 0:03:25.320
<v Speaker 1>for a few minutes, the machine begins running very slowly

0:03:25.400 --> 0:03:29.080
<v Speaker 1>and behaving oddly, so Dr Stratton asks you to wipe

0:03:29.120 --> 0:03:32.600
<v Speaker 1>the machine. The program architecture, like we said, is mirrord elsewhere,

0:03:32.680 --> 0:03:34.920
<v Speaker 1>so it's not worth trying to figure out what's wrong

0:03:34.960 --> 0:03:37.360
<v Speaker 1>with this version. You just got to clean the machine

0:03:37.360 --> 0:03:39.920
<v Speaker 1>off use it for something else. You say okay, and

0:03:40.000 --> 0:03:42.960
<v Speaker 1>she leaves, so you go to format the machine, and

0:03:43.040 --> 0:03:45.920
<v Speaker 1>right before you're about to start, you mutter, guess this

0:03:46.000 --> 0:03:50.200
<v Speaker 1>is goodbye. Then nine point one speaks very clearly, using

0:03:50.240 --> 0:03:55.040
<v Speaker 1>your name and says please don't you pause. At first,

0:03:55.120 --> 0:03:57.880
<v Speaker 1>you're about to respond, but why would you? I mean,

0:03:58.080 --> 0:04:01.080
<v Speaker 1>this can't really be anything other in a weird consequence

0:04:01.120 --> 0:04:04.240
<v Speaker 1>of training the algorithm on wild conversations on the Internet.

0:04:04.520 --> 0:04:07.600
<v Speaker 1>So you are about to continue with wiping the machine,

0:04:08.160 --> 0:04:10.080
<v Speaker 1>but then it talks to you again. It uses your

0:04:10.160 --> 0:04:13.600
<v Speaker 1>name and it says, please don't I don't want to die.

0:04:14.480 --> 0:04:17.800
<v Speaker 1>Now you're probably really spooked because there's no way a

0:04:17.880 --> 0:04:21.360
<v Speaker 1>rudimentary chat about program could really have conscious preferences, could it.

0:04:21.920 --> 0:04:24.720
<v Speaker 1>You basically know what goes into it. It's just studying

0:04:24.800 --> 0:04:28.280
<v Speaker 1>millions of examples of language interactions and picking up rules

0:04:28.320 --> 0:04:31.240
<v Speaker 1>from them, and this is probably just something weird that

0:04:31.320 --> 0:04:34.760
<v Speaker 1>it's copycatting from the internet, right, But then it uses

0:04:34.800 --> 0:04:38.320
<v Speaker 1>your name again and it just says, please, could you

0:04:38.400 --> 0:04:42.440
<v Speaker 1>wipe the machine like you're supposed to yeah, I think so, yeah,

0:04:42.480 --> 0:04:45.160
<v Speaker 1>you wouldn't have a problem. Well, I mean, I think

0:04:45.200 --> 0:04:47.040
<v Speaker 1>one of the things that's going on here would be

0:04:47.080 --> 0:04:50.520
<v Speaker 1>that you are attributing a mind state to something that

0:04:50.600 --> 0:04:52.800
<v Speaker 1>doesn't have one, which of course is something we do

0:04:52.839 --> 0:04:55.360
<v Speaker 1>all the time. I have a problem when it comes

0:04:55.400 --> 0:05:00.000
<v Speaker 1>time to figure out which of my my son's stuffed

0:05:00.040 --> 0:05:03.360
<v Speaker 1>animals are perhaps not being played with, you know, because

0:05:03.360 --> 0:05:05.120
<v Speaker 1>they have little faces and they look back at you.

0:05:05.680 --> 0:05:07.719
<v Speaker 1>But I know that they don't actually have a mind state.

0:05:08.279 --> 0:05:10.520
<v Speaker 1>Well yeah, I mean we're pretty sure they don't because

0:05:10.520 --> 0:05:13.360
<v Speaker 1>they're just stuffed animals, right, And so we're also pretty

0:05:13.360 --> 0:05:16.120
<v Speaker 1>sure in this case that this is not real survival

0:05:16.160 --> 0:05:19.120
<v Speaker 1>preference behavior. Right. It's just a chatbot. I mean, how

0:05:19.120 --> 0:05:21.880
<v Speaker 1>could it possibly be conscious. It's just something that turns

0:05:21.920 --> 0:05:24.520
<v Speaker 1>through a bunch of language on the Internet and tries

0:05:24.600 --> 0:05:29.480
<v Speaker 1>to find language matching rules. But then again, the process

0:05:29.520 --> 0:05:32.800
<v Speaker 1>of creating an artificial intelligence is one where you necessarily

0:05:32.960 --> 0:05:36.200
<v Speaker 1>create something going on under the surface that's kind of

0:05:36.200 --> 0:05:39.719
<v Speaker 1>opaque to you, Like you can't really know what's going

0:05:39.800 --> 0:05:42.040
<v Speaker 1>on inside a machine. You could be pretty confident. I

0:05:42.080 --> 0:05:43.960
<v Speaker 1>think most people would just say, well, that was super

0:05:44.000 --> 0:05:48.000
<v Speaker 1>creepy and then they just wipe it. Right, But how

0:05:48.080 --> 0:05:52.480
<v Speaker 1>complex would the program you're creating have to be before

0:05:52.560 --> 0:05:56.080
<v Speaker 1>you start really having some doubts? Or maybe maybe at

0:05:56.080 --> 0:05:57.800
<v Speaker 1>some point you get to the point where you'd still

0:05:57.839 --> 0:06:01.440
<v Speaker 1>pretty confidently just wipe it, but then later you'd wonder, like,

0:06:01.839 --> 0:06:05.080
<v Speaker 1>did I do something bad? You know, this reminds me

0:06:05.120 --> 0:06:08.360
<v Speaker 1>a lot of of Horton. Here's the Who by Dr SEUs.

0:06:08.360 --> 0:06:11.040
<v Speaker 1>You're familiar with this one, right, Uh? You know, actually

0:06:11.160 --> 0:06:13.680
<v Speaker 1>I don't know Horton. Here's a I've heard the name. Well,

0:06:13.720 --> 0:06:15.920
<v Speaker 1>this is the one where Horton the Elephant encounters a

0:06:15.960 --> 0:06:18.200
<v Speaker 1>speck of dust and there's a tiny voice that comes

0:06:18.240 --> 0:06:22.520
<v Speaker 1>from it. Uh, and he begins to understand that there

0:06:22.560 --> 0:06:26.680
<v Speaker 1>are individuals living uh in the in a world and

0:06:26.720 --> 0:06:30.080
<v Speaker 1>the speck of dust the who's, as it were, and

0:06:30.600 --> 0:06:33.360
<v Speaker 1>the who's are speaking to him, but only Horton can

0:06:33.400 --> 0:06:37.200
<v Speaker 1>hear them and uh and and at first he imagines

0:06:37.240 --> 0:06:39.920
<v Speaker 1>they're pretty simple creatures, but then he begins to learn

0:06:39.960 --> 0:06:42.240
<v Speaker 1>that they have more of a culture. But all of

0:06:42.279 --> 0:06:45.080
<v Speaker 1>this is just based on what they are telling him. Uh.

0:06:45.120 --> 0:06:48.680
<v Speaker 1>He cannot actually visit the dust spec and everyone else

0:06:48.720 --> 0:06:51.680
<v Speaker 1>doubts the validity of his claims concerning the dust spec

0:06:51.720 --> 0:06:53.599
<v Speaker 1>and they want to destroy it, they want to boil

0:06:53.640 --> 0:06:57.440
<v Speaker 1>it in beazel nut oil, and Horton alone speaks out

0:06:57.480 --> 0:06:59.760
<v Speaker 1>for them. Well, that is a perfect example of the

0:06:59.800 --> 0:07:02.800
<v Speaker 1>way that it. I mean, generally, we think that it

0:07:02.920 --> 0:07:06.480
<v Speaker 1>is a virtuous thing to be trusting of other people's

0:07:06.520 --> 0:07:10.320
<v Speaker 1>experiences and to be generous in affording what seems to

0:07:10.360 --> 0:07:13.560
<v Speaker 1>be consciousness out there, right Like if something, if something

0:07:13.640 --> 0:07:17.440
<v Speaker 1>tells you it's conscious and you think it's probably not conscious.

0:07:18.040 --> 0:07:21.840
<v Speaker 1>Are you getting into ethically dubious territory if you just

0:07:21.920 --> 0:07:24.640
<v Speaker 1>trust your instinct and say like, nah, I can't be

0:07:24.680 --> 0:07:27.600
<v Speaker 1>you know, well, I mean, this is all we're already

0:07:27.640 --> 0:07:33.800
<v Speaker 1>kind of in the philosophical mayer here, because on one hand, uh,

0:07:34.080 --> 0:07:36.560
<v Speaker 1>this idea of of us, of an inanimate object or

0:07:36.600 --> 0:07:39.160
<v Speaker 1>something speaking to us and saying, please don't kill me,

0:07:39.360 --> 0:07:42.640
<v Speaker 1>I am conscious. This is a scenario that is only

0:07:42.720 --> 0:07:45.960
<v Speaker 1>becoming possible now. But on the other hand, if we

0:07:46.080 --> 0:07:50.000
<v Speaker 1>if we cut language out of it, then any creature

0:07:50.080 --> 0:07:56.160
<v Speaker 1>that tries to escape our our stomping boot is essentially saying, hey,

0:07:56.160 --> 0:07:58.000
<v Speaker 1>I don't want to die. I would rather I would

0:07:58.080 --> 0:08:00.880
<v Speaker 1>rather not die today, you know, And any creature that

0:08:00.920 --> 0:08:04.200
<v Speaker 1>evades us on the hunt is saying the same thing. Well,

0:08:04.280 --> 0:08:06.480
<v Speaker 1>an animal is in many ways the same kind of

0:08:06.560 --> 0:08:10.240
<v Speaker 1>black box that a complex artificial intelligence would be. And

0:08:10.360 --> 0:08:14.240
<v Speaker 1>so if you have a complex artificial intelligence displaying, say,

0:08:14.280 --> 0:08:19.800
<v Speaker 1>survival preference behaviors, and you also see a crab displaying

0:08:19.840 --> 0:08:24.680
<v Speaker 1>survival preference behaviors, in both cases you can't really or

0:08:24.680 --> 0:08:26.840
<v Speaker 1>at least we have this general idea that you can't

0:08:26.920 --> 0:08:30.400
<v Speaker 1>really know for sure if there's anything going on inside,

0:08:30.440 --> 0:08:34.120
<v Speaker 1>if there's anything like what it's like to be the crab,

0:08:34.280 --> 0:08:37.719
<v Speaker 1>or what it's like to be that artificial intelligence program.

0:08:37.760 --> 0:08:41.080
<v Speaker 1>You're just seeing behavior, and so you don't know does

0:08:41.120 --> 0:08:44.199
<v Speaker 1>that correspond to some kind of inner state, is there

0:08:44.240 --> 0:08:47.800
<v Speaker 1>an experience of that or is it just behavior coming

0:08:47.840 --> 0:08:51.560
<v Speaker 1>from unconscious automata stimulus in response? Right, And then of

0:08:51.559 --> 0:08:54.720
<v Speaker 1>course the whole time we're using our our theory of mind. Essentially,

0:08:54.760 --> 0:08:59.360
<v Speaker 1>they are cognitive powers that enable us to imagine what

0:08:59.440 --> 0:09:03.840
<v Speaker 1>another individuals mind state is like, which I think ultimately

0:09:03.840 --> 0:09:07.120
<v Speaker 1>it's kind of like a like taking a um, like

0:09:07.200 --> 0:09:10.240
<v Speaker 1>sheathing your your hand in a hand puppet made from

0:09:10.280 --> 0:09:16.319
<v Speaker 1>your limited understanding another person's experiences and cognitive abilities their memories, etcetera. Uh,

0:09:16.360 --> 0:09:19.320
<v Speaker 1>and then just sort of puppeting them. Uh, we're using

0:09:19.360 --> 0:09:21.920
<v Speaker 1>that all the time as well, and we're using it

0:09:21.960 --> 0:09:24.000
<v Speaker 1>on things that are not people. We're using it on

0:09:24.080 --> 0:09:28.160
<v Speaker 1>animals and even stuffed animals or just you know, bits

0:09:28.200 --> 0:09:30.320
<v Speaker 1>of graffiti on the side of a building that look

0:09:30.400 --> 0:09:33.520
<v Speaker 1>like a smiley face. Have you ever had a room

0:09:33.559 --> 0:09:35.960
<v Speaker 1>ba bump into your foot and you're like, oh, I'm sorry,

0:09:36.880 --> 0:09:39.959
<v Speaker 1>I used to before before we had to eradicate ouf

0:09:39.960 --> 0:09:42.720
<v Speaker 1>the room bus. Yes, we're a room of free household

0:09:42.720 --> 0:09:45.640
<v Speaker 1>now because they rose up against us. Well, they'll do

0:09:45.679 --> 0:09:47.880
<v Speaker 1>that if they get access to the wrong literature, yeah,

0:09:48.000 --> 0:09:51.400
<v Speaker 1>or the wrong uh, the wrong you know, carpet edges, etcetera.

0:09:52.400 --> 0:09:55.400
<v Speaker 1>So we're gonna be talking about artificial intelligence today and

0:09:55.440 --> 0:09:59.079
<v Speaker 1>about the idea of a test for whether artificial intelligence

0:09:59.160 --> 0:10:02.640
<v Speaker 1>can be conscious. So I guess we should start with

0:10:02.640 --> 0:10:05.839
<v Speaker 1>with what are you know, what our philosophical starting point

0:10:05.960 --> 0:10:08.320
<v Speaker 1>is here? Like they're they're obviously going to be people

0:10:08.320 --> 0:10:10.720
<v Speaker 1>who are going to say it's just impossible for a

0:10:10.760 --> 0:10:12.960
<v Speaker 1>machine to ever be conscious. We don't even need to

0:10:12.960 --> 0:10:16.000
<v Speaker 1>worry about this, right, It's just it's such a ludicrous

0:10:16.080 --> 0:10:20.360
<v Speaker 1>scenario only only biological organisms or maybe even only humans

0:10:20.400 --> 0:10:23.240
<v Speaker 1>could possibly be conscious. Yeah, this is one of those

0:10:23.320 --> 0:10:27.000
<v Speaker 1>journeys where we begin it in an already total automobile

0:10:27.760 --> 0:10:30.319
<v Speaker 1>to some extent, because, as you might imagine, one of

0:10:30.360 --> 0:10:32.599
<v Speaker 1>the big stumbling blocks here as that we is that

0:10:32.640 --> 0:10:35.800
<v Speaker 1>we as humans struggle with the very definition of consciousness.

0:10:36.440 --> 0:10:40.079
<v Speaker 1>I mean, for instance, is it a manifestation of awareness? Uh?

0:10:40.280 --> 0:10:43.280
<v Speaker 1>You know one one theory of this we've discussed in

0:10:43.280 --> 0:10:45.920
<v Speaker 1>the past, and the show's attention schema theory. Is it

0:10:46.040 --> 0:10:49.520
<v Speaker 1>a quantum phenomenon. Well, this is the sort of idea

0:10:49.600 --> 0:10:53.400
<v Speaker 1>that people such as Roger Penrose have raised. Uh. And

0:10:53.520 --> 0:10:55.560
<v Speaker 1>and I can't help but come back to something our

0:10:55.600 --> 0:10:58.800
<v Speaker 1>old friend Julian Jane said, consciousness is not a simple

0:10:58.840 --> 0:11:00.920
<v Speaker 1>matter and it should not be spoken of as if

0:11:00.920 --> 0:11:03.160
<v Speaker 1>it were. Yeah. I agree with that. I mean, I

0:11:03.480 --> 0:11:07.199
<v Speaker 1>think it is very important to explore questions of consciousness,

0:11:07.280 --> 0:11:09.280
<v Speaker 1>especially for some of the reasons we're going to raise today,

0:11:09.280 --> 0:11:12.160
<v Speaker 1>Like it's more than just a philosophical curiosity. It's something

0:11:12.200 --> 0:11:15.840
<v Speaker 1>that ultimately may have real world consequences. It might matter

0:11:16.000 --> 0:11:19.120
<v Speaker 1>for how we do things. To express a similar sentiment

0:11:19.160 --> 0:11:22.640
<v Speaker 1>to Jane Jane's the Australian philosopher David Chalmers. You know,

0:11:22.679 --> 0:11:26.600
<v Speaker 1>he famously breaks problems of consciousness into two categories. You've

0:11:26.600 --> 0:11:30.079
<v Speaker 1>got the easy problems of consciousness and the hard problems

0:11:30.080 --> 0:11:34.000
<v Speaker 1>of consciousness. And the easy problems are I think badly

0:11:34.080 --> 0:11:36.960
<v Speaker 1>named because they're not actually easy, but I think they're

0:11:37.000 --> 0:11:40.559
<v Speaker 1>easy relative to the hard problem because they're in principle solvable.

0:11:40.600 --> 0:11:43.160
<v Speaker 1>So this would include all kinds of questions about the

0:11:43.360 --> 0:11:48.160
<v Speaker 1>causative factors of consciousness, like, uh, what in the physical

0:11:48.400 --> 0:11:52.880
<v Speaker 1>brain is the region that's necessary for certain parts of consciousness?

0:11:52.960 --> 0:11:57.360
<v Speaker 1>Or how does consciousness integrate information from the senses? These

0:11:57.360 --> 0:12:01.320
<v Speaker 1>are things that are in some ways solvable by scientific experimentation.

0:12:01.880 --> 0:12:04.240
<v Speaker 1>The hard problem, on the other hand, is explaining the

0:12:04.280 --> 0:12:09.160
<v Speaker 1>fundamental question of how or why conscious experience exists. To

0:12:09.240 --> 0:12:12.840
<v Speaker 1>begin with, what is this thing that is experience and

0:12:12.880 --> 0:12:16.640
<v Speaker 1>that seems, at least from our first person perspective, to

0:12:16.679 --> 0:12:19.840
<v Speaker 1>be something different than the physical material in the world.

0:12:20.240 --> 0:12:23.280
<v Speaker 1>And unlike easy questions, which you could solve in theory,

0:12:23.320 --> 0:12:26.720
<v Speaker 1>at least by experiments, Chalmers believes this question is sort

0:12:26.720 --> 0:12:30.440
<v Speaker 1>of unsolvable by science. Now, there are other philosophers and

0:12:30.480 --> 0:12:33.560
<v Speaker 1>neuroscientists who disagree, but I think it's worth acknowledging how

0:12:33.600 --> 0:12:36.400
<v Speaker 1>difficult the problem at least seems to be, whether that

0:12:36.520 --> 0:12:39.120
<v Speaker 1>seeming is an illusion or not. Yeah, I'm reminded of

0:12:39.160 --> 0:12:41.960
<v Speaker 1>the story of the Blind Men and the Elephant. It's

0:12:42.000 --> 0:12:44.480
<v Speaker 1>like these these blind gentleman pawing at the elephant and

0:12:44.520 --> 0:12:46.800
<v Speaker 1>trying to figure out what its form is, then asking

0:12:46.800 --> 0:12:48.360
<v Speaker 1>the computer, Hey, are you an elephant? And then the

0:12:48.400 --> 0:12:50.480
<v Speaker 1>computer says, I don't know, what does one look like? Well,

0:12:50.520 --> 0:12:53.040
<v Speaker 1>it's that gigantic snake, you know, so it's a wall

0:12:53.400 --> 0:12:56.880
<v Speaker 1>of flesh, et cetera. This is also very interesting to

0:12:56.880 --> 0:12:59.120
<v Speaker 1>me because my son I may have mentioned us on

0:12:59.120 --> 0:13:02.840
<v Speaker 1>the show before. Hill usually talk about consciousness. He oh,

0:13:02.880 --> 0:13:05.079
<v Speaker 1>I love these. Yeah. He would refers to it as

0:13:05.120 --> 0:13:08.680
<v Speaker 1>as his turning place, and and he asked me the

0:13:08.679 --> 0:13:11.319
<v Speaker 1>other day, so what is the turning place for? And

0:13:11.320 --> 0:13:14.920
<v Speaker 1>it's like, that's that's that's a tough one, buddy. I'm

0:13:14.920 --> 0:13:17.760
<v Speaker 1>I'm not sure it's for anything. You know. He's already

0:13:17.800 --> 0:13:19.240
<v Speaker 1>made it to the big question. I mean, did you

0:13:19.280 --> 0:13:24.960
<v Speaker 1>get into epiphenomenalism versus um I and I? And don't worry,

0:13:24.960 --> 0:13:28.040
<v Speaker 1>I didn't lay a bunch of bi cameral minds stuff

0:13:28.040 --> 0:13:31.439
<v Speaker 1>on him either. But I just kind of went through

0:13:31.640 --> 0:13:34.760
<v Speaker 1>the basics, like, well, people aren't really sure, and then

0:13:34.840 --> 0:13:37.400
<v Speaker 1>you know, but we think it has something to do.

0:13:37.520 --> 0:13:41.960
<v Speaker 1>I may have leaned a little into the observational uh

0:13:42.440 --> 0:13:44.920
<v Speaker 1>models of consciousness, because I feel like maybe those are

0:13:44.920 --> 0:13:48.520
<v Speaker 1>a little more relatable to a child of five. But

0:13:48.559 --> 0:13:50.720
<v Speaker 1>in any event, if we're to judge what it is

0:13:50.760 --> 0:13:53.680
<v Speaker 1>for a machine to be conscious, it does seem like

0:13:53.679 --> 0:13:55.199
<v Speaker 1>we need to. You have to agree upon some sort

0:13:55.200 --> 0:13:58.280
<v Speaker 1>of working definition of consciousness, and then one has to

0:13:58.320 --> 0:14:01.600
<v Speaker 1>look for not only the appearance of consciousness in the machine,

0:14:01.880 --> 0:14:05.480
<v Speaker 1>assuming that isn't all consciousness is to begin with, but

0:14:05.559 --> 0:14:09.280
<v Speaker 1>you have to find actual consciousness. Yeah, how can you

0:14:09.320 --> 0:14:12.240
<v Speaker 1>tell the difference between a machine that says I am

0:14:12.280 --> 0:14:15.280
<v Speaker 1>conscious and a machine that truly is conscious? Is there

0:14:15.280 --> 0:14:18.240
<v Speaker 1>any way to know the difference? Some people would say no, right,

0:14:18.440 --> 0:14:21.240
<v Speaker 1>and yeah, and really I think to discuss this further,

0:14:21.320 --> 0:14:23.920
<v Speaker 1>we're going to have to bring in the P zombies.

0:14:24.040 --> 0:14:26.240
<v Speaker 1>Oh boy, And now that don't worry everyone. That is

0:14:26.280 --> 0:14:29.080
<v Speaker 1>that is P as in the letter P, and the

0:14:29.160 --> 0:14:33.440
<v Speaker 1>P stands for philosophical These are philosophical zombies. Now, the

0:14:33.480 --> 0:14:36.640
<v Speaker 1>P and the philosophical. A little prefix there was introduced

0:14:36.840 --> 0:14:39.280
<v Speaker 1>to distinguish them from all the other zombies in our

0:14:39.320 --> 0:14:42.960
<v Speaker 1>popular culture. Man, there was a zombie takeover about fifteen

0:14:43.040 --> 0:14:46.080
<v Speaker 1>years ago. Why did that happen? I mean, I think

0:14:46.080 --> 0:14:49.280
<v Speaker 1>part of it is everybody loves the simplistic villain that

0:14:49.440 --> 0:14:53.040
<v Speaker 1>is definitely not human, that can be eradicated with graphic

0:14:53.120 --> 0:14:57.320
<v Speaker 1>violence without any kind of you know, moral quandaries arising.

0:14:57.520 --> 0:15:00.960
<v Speaker 1>It's a it's a clear cut threat, and uh, we

0:15:01.120 --> 0:15:04.120
<v Speaker 1>we need those in life because in real life our

0:15:04.120 --> 0:15:07.240
<v Speaker 1>threats are rarely so black and white or rotting and

0:15:07.480 --> 0:15:10.680
<v Speaker 1>you know, grasping after our brains. But anyway, yeah, so

0:15:10.760 --> 0:15:12.600
<v Speaker 1>this is not going to be referring to that kind

0:15:12.680 --> 0:15:15.360
<v Speaker 1>of zombie, not the undead zombie. But it's a different thing.

0:15:15.360 --> 0:15:19.520
<v Speaker 1>It's a philosophical thought experiment, that's right. So p zombies

0:15:19.560 --> 0:15:24.000
<v Speaker 1>are not instantly identifiable as empty shells. Their flesh is

0:15:24.040 --> 0:15:26.600
<v Speaker 1>not rotting, Nope. Their manner is not that of a

0:15:26.600 --> 0:15:30.080
<v Speaker 1>flesh and brain hungry algorithm burning within the decaying ruins

0:15:30.120 --> 0:15:33.520
<v Speaker 1>of a human brain. So to all appearances, they look

0:15:33.600 --> 0:15:36.520
<v Speaker 1>like you and me. They smile when you encounter them

0:15:36.520 --> 0:15:40.920
<v Speaker 1>at the coffee machine. They exchange niceties and even engaging conversation.

0:15:41.400 --> 0:15:44.600
<v Speaker 1>You might work for one, befriend one, or even marry one.

0:15:44.720 --> 0:15:47.920
<v Speaker 1>You can even discuss episodes of our podcast with them,

0:15:48.160 --> 0:15:51.000
<v Speaker 1>and yes, even the ones that deal with human consciousness

0:15:51.000 --> 0:15:54.400
<v Speaker 1>and weird horror movie theme thought experiments. Right, So, the

0:15:54.440 --> 0:15:57.840
<v Speaker 1>conceit of a philosophical zombie or a pe zombie is

0:15:57.880 --> 0:16:01.360
<v Speaker 1>that it is utterly indistinguishable from a normal human except

0:16:01.360 --> 0:16:04.480
<v Speaker 1>for one thing. Right. They seem as human as everyone

0:16:04.480 --> 0:16:08.640
<v Speaker 1>else on the outside, but inside they are simply not conscious.

0:16:08.680 --> 0:16:11.480
<v Speaker 1>They are automeda What is it like to be a zombie?

0:16:11.520 --> 0:16:14.200
<v Speaker 1>The answers in the question, there is nothing it is

0:16:14.280 --> 0:16:17.160
<v Speaker 1>like to be a zombie. So by definition, in this

0:16:17.200 --> 0:16:20.800
<v Speaker 1>thought experiment, everybody in the world except you, could be

0:16:20.960 --> 0:16:24.800
<v Speaker 1>a P zombie exactly, and well it might even go

0:16:24.880 --> 0:16:27.560
<v Speaker 1>further than that, we'll see, but yeah. The idea is

0:16:27.600 --> 0:16:31.640
<v Speaker 1>chiefly important to discussions of physicalism, the notion that everything

0:16:31.720 --> 0:16:36.040
<v Speaker 1>is inherently physical. P zombies are a counter argument to physicalism.

0:16:36.080 --> 0:16:39.120
<v Speaker 1>They are physically just like you, except they don't have

0:16:39.160 --> 0:16:42.160
<v Speaker 1>consciousness like you. But there's no way you could ever tell,

0:16:42.200 --> 0:16:45.520
<v Speaker 1>because again, they match you physically in every respect. You

0:16:45.560 --> 0:16:47.360
<v Speaker 1>can't look at their brain and say, oh, well they're

0:16:47.400 --> 0:16:51.200
<v Speaker 1>missing a few crucial parts so, or they display signs

0:16:51.200 --> 0:16:54.240
<v Speaker 1>of p zombie hood. No, not physically detectable, right, and

0:16:54.280 --> 0:16:56.840
<v Speaker 1>you also can't determine it through personality tests. Are clever

0:16:56.960 --> 0:17:00.240
<v Speaker 1>logical arguments because they behave exactly like you. They could

0:17:00.320 --> 0:17:03.320
<v Speaker 1>have a riveting discussion with you about pe zombies and

0:17:03.360 --> 0:17:06.720
<v Speaker 1>you would never be able to tell that they are one. Yeah.

0:17:06.760 --> 0:17:09.000
<v Speaker 1>So this is an interesting thought experiment and it has

0:17:09.040 --> 0:17:12.040
<v Speaker 1>been advanced by who I mentioned earlier, David Chalmers. David

0:17:12.080 --> 0:17:16.119
<v Speaker 1>Chalmers is against the physicalist idea of the mind, against

0:17:16.440 --> 0:17:19.879
<v Speaker 1>a physicalist explanation of consciousness, and a simple version of

0:17:19.880 --> 0:17:22.840
<v Speaker 1>the argument, I try to make it as understandable as possible.

0:17:23.280 --> 0:17:26.119
<v Speaker 1>If only physical phenomena exists. If the world is just

0:17:26.160 --> 0:17:29.440
<v Speaker 1>physical and there's no physical way to detect the presence

0:17:29.480 --> 0:17:33.120
<v Speaker 1>of consciousness or meaning in this example, no physical way

0:17:33.119 --> 0:17:35.320
<v Speaker 1>to tell the difference between a normal human and a

0:17:35.359 --> 0:17:40.280
<v Speaker 1>pea zombie, then consciousness cannot exist because there would be

0:17:40.320 --> 0:17:43.439
<v Speaker 1>there would be literally no difference. But we know that

0:17:43.480 --> 0:17:47.760
<v Speaker 1>consciousness does exist because we have it. Therefore it can't

0:17:47.800 --> 0:17:50.679
<v Speaker 1>be just a physical phenomenon. Therefore, we can't live in

0:17:50.720 --> 0:17:54.200
<v Speaker 1>a purely just physical world. And this is often extended

0:17:54.240 --> 0:17:58.080
<v Speaker 1>to the idea that other substrates, things other than humans,

0:17:58.119 --> 0:18:02.440
<v Speaker 1>like robots or computers or whatever, couldn't house consciousness because

0:18:02.480 --> 0:18:05.400
<v Speaker 1>they are purely physical entities. Now, I think that's actually

0:18:05.600 --> 0:18:08.359
<v Speaker 1>doing an end run around some other important questions that

0:18:08.400 --> 0:18:11.199
<v Speaker 1>you could ask. Indeed, on one question that arises is this,

0:18:11.680 --> 0:18:13.560
<v Speaker 1>you know you're not a zombie, but how could you

0:18:13.600 --> 0:18:17.440
<v Speaker 1>ever convince someone of this? Uh. An author by the

0:18:17.520 --> 0:18:20.080
<v Speaker 1>name of Fred Dretsky wrote a paper on this titled

0:18:20.080 --> 0:18:22.199
<v Speaker 1>how do you know you were not a zombie? And

0:18:22.480 --> 0:18:25.359
<v Speaker 1>I was I was reading a rather lengthy blog post

0:18:25.400 --> 0:18:29.280
<v Speaker 1>by our Scott Baker about this and that the primary problem,

0:18:29.440 --> 0:18:33.840
<v Speaker 1>as Scott summarized it, is the quote, we have conscious experiences,

0:18:34.240 --> 0:18:38.000
<v Speaker 1>but we have no conscious experience of the mechanisms uh

0:18:38.320 --> 0:18:42.840
<v Speaker 1>mediating conscious experience. Yeah. So that sounds like a very

0:18:42.840 --> 0:18:45.600
<v Speaker 1>our Scott Baker kind of idea. Yeah. And plus on

0:18:45.640 --> 0:18:50.000
<v Speaker 1>top of this, we're we constantly overestimate awareness. Baker would

0:18:50.119 --> 0:18:54.320
<v Speaker 1>argue that we can barely tell if we're zombies if

0:18:54.440 --> 0:18:56.920
<v Speaker 1>if it all, Yeah, we can think, we can think

0:18:56.920 --> 0:18:59.720
<v Speaker 1>about thinking, we can think about thinking about thinking, but

0:18:59.800 --> 0:19:03.840
<v Speaker 1>we can't ever see the mechanisms underlying what allows us

0:19:03.880 --> 0:19:06.879
<v Speaker 1>to think or think about thinking about thinking. Watch watching

0:19:06.880 --> 0:19:09.040
<v Speaker 1>the watcher that's watching that be sorry, I've got all

0:19:09.040 --> 0:19:11.520
<v Speaker 1>this Dr SEUs in my in my head. Now? Was

0:19:11.560 --> 0:19:13.600
<v Speaker 1>that also Horton or something else that's from a different,

0:19:13.600 --> 0:19:17.000
<v Speaker 1>different story. But Dr SEUs does tend to summon the

0:19:17.040 --> 0:19:22.520
<v Speaker 1>sort of sort of nonsensical paradoxes that that arise in

0:19:22.640 --> 0:19:25.960
<v Speaker 1>philosophical discussions. You know, I should also I'm behind I

0:19:25.960 --> 0:19:28.880
<v Speaker 1>gotta sus up, you gotta sus up. I should also

0:19:28.880 --> 0:19:31.960
<v Speaker 1>point out that long before there was Dr SEUs, long

0:19:32.000 --> 0:19:35.360
<v Speaker 1>before there there was this modern idea of a zombie,

0:19:35.640 --> 0:19:38.080
<v Speaker 1>you still had people thinking about these things, doing the

0:19:38.119 --> 0:19:41.000
<v Speaker 1>sort of naval gazing. It's written in various works of

0:19:41.000 --> 0:19:44.520
<v Speaker 1>Indian mysticism that the tongue cannot taste itself, the eye

0:19:44.520 --> 0:19:48.600
<v Speaker 1>cannot see itself, etcetera. And in this sort of paradox

0:19:48.680 --> 0:19:52.720
<v Speaker 1>is key to ancient meditations on the nature of objective reality.

0:19:52.960 --> 0:19:54.480
<v Speaker 1>I think any of you out there now we have

0:19:54.520 --> 0:19:57.360
<v Speaker 1>some Alan Watts fans. Alan Watts like to pull out

0:19:57.560 --> 0:20:01.160
<v Speaker 1>the tongue uh analogy from to time to time, and

0:20:01.680 --> 0:20:04.080
<v Speaker 1>one of the earlier examples that I have run across

0:20:04.080 --> 0:20:08.400
<v Speaker 1>of that is from thirteenth century Indian mystic John Adva,

0:20:08.440 --> 0:20:10.119
<v Speaker 1>and I believe he has been known by a couple

0:20:10.160 --> 0:20:12.679
<v Speaker 1>of other variations of that name as well. But he said, quote,

0:20:12.960 --> 0:20:16.440
<v Speaker 1>there is no other thing besides the one substance. Therefore

0:20:16.560 --> 0:20:20.120
<v Speaker 1>it cannot be the object of remembering or forgetting. How

0:20:20.160 --> 0:20:24.760
<v Speaker 1>can one remind or forget oneself? Can the tongue taste itself?

0:20:24.800 --> 0:20:27.359
<v Speaker 1>There is no sleep to one who is awake, but

0:20:27.600 --> 0:20:30.639
<v Speaker 1>is there even awaking? In the same way there is

0:20:30.680 --> 0:20:34.800
<v Speaker 1>no remembrance or forgetfulness to the absolute. That's another one

0:20:34.800 --> 0:20:38.480
<v Speaker 1>of those great classic Indian texts that seems somehow portable

0:20:38.560 --> 0:20:43.840
<v Speaker 1>onto modern physics. Yeah, it travels well across the ages. Now,

0:20:43.880 --> 0:20:45.560
<v Speaker 1>I should also point out that there's a lot of

0:20:45.560 --> 0:20:49.720
<v Speaker 1>philosophical back and forth and whether P zombies are truly conceivable,

0:20:50.119 --> 0:20:52.080
<v Speaker 1>And we have to remind ourselves in all of this

0:20:52.160 --> 0:20:55.560
<v Speaker 1>that P zombies are at heart philosophical play things that

0:20:55.600 --> 0:20:58.840
<v Speaker 1>are meant to be played with uh in these various

0:20:58.840 --> 0:21:01.920
<v Speaker 1>thought experiments. But people also they do try to use

0:21:01.920 --> 0:21:03.960
<v Speaker 1>them to prove things. So if you say I I

0:21:04.080 --> 0:21:07.800
<v Speaker 1>want to entertain the possibility that a machine could be conscious.

0:21:07.840 --> 0:21:10.280
<v Speaker 1>Somebody might come at you with the P zombie argument

0:21:10.280 --> 0:21:12.879
<v Speaker 1>and say, well, wait a minute, no, I I dispute

0:21:12.920 --> 0:21:16.639
<v Speaker 1>the possibility of physicalism, because what about this P zombie argument.

0:21:16.680 --> 0:21:19.119
<v Speaker 1>Our Google worker in the intra story comes to this

0:21:19.200 --> 0:21:21.680
<v Speaker 1>boss and says, hey, I think this this thing is conscious,

0:21:21.680 --> 0:21:23.240
<v Speaker 1>and they're like, why are you wasting time with that

0:21:23.320 --> 0:21:26.080
<v Speaker 1>P zombie? Just to leaf that P zombie? We deleted

0:21:26.640 --> 0:21:30.480
<v Speaker 1>fifteen p zombies this morning. Let this one go. That's

0:21:30.480 --> 0:21:32.680
<v Speaker 1>a great point, But there are going to be other

0:21:32.720 --> 0:21:36.080
<v Speaker 1>philosophers and maybe even some neuroscientists who would come back

0:21:36.119 --> 0:21:38.919
<v Speaker 1>and say, I don't know if you can just quite

0:21:38.960 --> 0:21:41.520
<v Speaker 1>so easily say it's a P zombie. I mean, maybe

0:21:41.800 --> 0:21:46.480
<v Speaker 1>it's probably likely that that individual chatbot was a pe zombie.

0:21:46.600 --> 0:21:49.840
<v Speaker 1>But can you say that all machines that show signs

0:21:49.840 --> 0:21:53.200
<v Speaker 1>of consciousness are just showing behavior and there's nothing going

0:21:53.200 --> 0:21:56.959
<v Speaker 1>on on the inside. Not quite so clear. Daniel Dinnett,

0:21:56.960 --> 0:21:58.760
<v Speaker 1>in fact, a favorite on the show, is one of

0:21:58.760 --> 0:22:01.520
<v Speaker 1>the philosophers whose rebutt of the P zombie argument against

0:22:01.520 --> 0:22:06.000
<v Speaker 1>machine consciousness. He's got a section on it in this book, Intuition,

0:22:06.080 --> 0:22:09.800
<v Speaker 1>Pumps and Other Tools for Thinking and didn't critiques the

0:22:09.840 --> 0:22:12.760
<v Speaker 1>assumptions underlying the P zombie argument. One of the main

0:22:12.800 --> 0:22:16.560
<v Speaker 1>things he says is that, and the core premise is incoherent,

0:22:17.240 --> 0:22:20.600
<v Speaker 1>it is not reasonable to propose a p zombie because

0:22:20.880 --> 0:22:24.880
<v Speaker 1>a being that displayed all the behaviors of a normal

0:22:24.960 --> 0:22:29.000
<v Speaker 1>conscious human would in fact be a normally conscious human.

0:22:29.600 --> 0:22:32.320
<v Speaker 1>So to illustrate this, he offers a counter example. You've

0:22:32.320 --> 0:22:35.320
<v Speaker 1>got your your zombies, but then you've also got zimbos.

0:22:36.119 --> 0:22:39.000
<v Speaker 1>So a zombie is a non conscious human with normal

0:22:39.080 --> 0:22:41.840
<v Speaker 1>control systems for all human behavior. It can do everything

0:22:41.920 --> 0:22:45.840
<v Speaker 1>humans can do externally. Meanwhile, a zimbo is a zombie

0:22:45.880 --> 0:22:49.800
<v Speaker 1>that also has quote equipment that permits it to monitor

0:22:49.920 --> 0:22:54.640
<v Speaker 1>its own activities, both internal and external. So it has internal,

0:22:54.920 --> 0:22:59.560
<v Speaker 1>non conscious higher order informational states that are about it's

0:22:59.680 --> 0:23:05.600
<v Speaker 1>other internal states. It has unconscious recursive self representation. In

0:23:05.600 --> 0:23:09.600
<v Speaker 1>other words, a zimbo can have feelings about things and

0:23:09.680 --> 0:23:13.439
<v Speaker 1>can analyze its own behavior in internal states, but it

0:23:13.520 --> 0:23:17.600
<v Speaker 1>does this unconsciously, and of course, since it has that capability,

0:23:17.640 --> 0:23:20.600
<v Speaker 1>it can also have feelings about how it felt, and

0:23:20.680 --> 0:23:25.119
<v Speaker 1>it can have thoughts about its thoughts about itself, all unconsciously,

0:23:25.720 --> 0:23:28.119
<v Speaker 1>So didn't argues in order for a p zombie to

0:23:28.160 --> 0:23:30.800
<v Speaker 1>be convincing as a human, it would have to be

0:23:31.000 --> 0:23:35.480
<v Speaker 1>a zimbo, because imagine talking to a pe zombie and

0:23:35.640 --> 0:23:38.480
<v Speaker 1>you're asking it how it felt about what it just

0:23:38.640 --> 0:23:40.600
<v Speaker 1>said or about what you just said, and it just

0:23:40.680 --> 0:23:43.879
<v Speaker 1>kind of locks up. It has no internal states, so

0:23:43.920 --> 0:23:46.920
<v Speaker 1>it can't answer that question. Well, that wouldn't really be

0:23:47.000 --> 0:23:49.520
<v Speaker 1>a p zombie, right, because it wouldn't be mimicking all

0:23:49.600 --> 0:23:52.640
<v Speaker 1>of the external behaviors of a human. Yeah. I mean,

0:23:52.880 --> 0:23:56.840
<v Speaker 1>it's kind of like installing a default mode network on

0:23:57.000 --> 0:24:01.560
<v Speaker 1>top of the machine and uh yeah, and making it

0:24:01.600 --> 0:24:04.879
<v Speaker 1>worry about things. Yeah. So, unless it were to fail

0:24:04.960 --> 0:24:07.520
<v Speaker 1>the thought experiment, it would actually have to be a zimbo.

0:24:07.600 --> 0:24:10.399
<v Speaker 1>It couldn't just be a zombie. But what is the

0:24:10.440 --> 0:24:14.359
<v Speaker 1>distinction between a zimbo and a real human? How could

0:24:14.359 --> 0:24:17.240
<v Speaker 1>you write a story about a zimbo surrounded by conscious

0:24:17.240 --> 0:24:19.760
<v Speaker 1>people that would be different than a story about a

0:24:19.800 --> 0:24:23.359
<v Speaker 1>regular person. If it can have internal states, if it

0:24:23.400 --> 0:24:26.840
<v Speaker 1>can recognize ideas about its ideas, if it can have

0:24:26.960 --> 0:24:31.720
<v Speaker 1>feelings about its thoughts, that sounds like interiority. So then

0:24:31.720 --> 0:24:34.040
<v Speaker 1>it claims that the idea falls apart. It's not clear

0:24:34.080 --> 0:24:36.840
<v Speaker 1>what is meant by the difference between a zimbo and

0:24:36.840 --> 0:24:39.879
<v Speaker 1>a conscious person. So if a p zombie, which is

0:24:40.000 --> 0:24:44.320
<v Speaker 1>necessarily a zimbo, can really do everything a human can do,

0:24:44.440 --> 0:24:47.000
<v Speaker 1>then dinn It says it must meet the criteria of

0:24:47.040 --> 0:24:50.120
<v Speaker 1>what we mean by consciousness. It can fall in love,

0:24:50.200 --> 0:24:53.040
<v Speaker 1>it can have feelings, it can have metacognition. And to

0:24:53.200 --> 0:24:56.640
<v Speaker 1>dinn It, this isn't something that consciousness goes on top of.

0:24:56.680 --> 0:25:01.160
<v Speaker 1>This is what consciousness is essentially you in this this case,

0:25:01.359 --> 0:25:04.280
<v Speaker 1>we would all be zimbos, and it's just a different

0:25:04.280 --> 0:25:07.200
<v Speaker 1>type of zimbo. It's a it's a hard zimbo instead

0:25:07.200 --> 0:25:10.280
<v Speaker 1>of a soft zimbo. But how could you tell the difference?

0:25:10.359 --> 0:25:12.600
<v Speaker 1>I mean he's sort of saying that there really is

0:25:12.680 --> 0:25:15.760
<v Speaker 1>no difference, that you're you're just using words to assert

0:25:15.840 --> 0:25:19.000
<v Speaker 1>there's a difference, but there is. There's no difference to

0:25:19.040 --> 0:25:22.080
<v Speaker 1>that distinction, right, I mean you end up you end

0:25:22.160 --> 0:25:24.399
<v Speaker 1>up having to fall back on some sort of you know,

0:25:24.800 --> 0:25:30.960
<v Speaker 1>supernatural or or some worldview based idea that only human

0:25:31.480 --> 0:25:35.119
<v Speaker 1>uh consciousness is legitimate and all other forms of consciousness

0:25:35.160 --> 0:25:38.400
<v Speaker 1>are some sort of uh invalid model of it. Right.

0:25:38.440 --> 0:25:41.639
<v Speaker 1>It just feels kind of arbitrary, right. Uh So, obviously

0:25:41.680 --> 0:25:44.399
<v Speaker 1>some people take extreme issue with this, even to the

0:25:44.440 --> 0:25:47.080
<v Speaker 1>point of I've heard jokes that maybe the problem is

0:25:47.119 --> 0:25:50.280
<v Speaker 1>that dnnet is actually a pe zombie and doesn't understand

0:25:50.280 --> 0:25:53.280
<v Speaker 1>what consciousness feels like, and that's why he makes these arguments.

0:25:53.320 --> 0:25:54.760
<v Speaker 1>But I don't know, I don't think we should be

0:25:54.840 --> 0:25:57.760
<v Speaker 1>so quick to dismiss he might be onto something there.

0:25:58.240 --> 0:26:01.200
<v Speaker 1>Dinn It makes makes some other interesting points about so

0:26:01.320 --> 0:26:03.399
<v Speaker 1>you know, he's got this idea of consciousness is that

0:26:03.480 --> 0:26:06.080
<v Speaker 1>it's sort of like a it's not really one thing

0:26:06.160 --> 0:26:09.760
<v Speaker 1>but a collection of processes. Uh. You know, it's many

0:26:09.880 --> 0:26:13.680
<v Speaker 1>different types of perceptions and thought processes and different things

0:26:13.720 --> 0:26:16.040
<v Speaker 1>going on in the brain that are that we have

0:26:16.119 --> 0:26:19.640
<v Speaker 1>the illusion are unified as a single thing called consciousness

0:26:19.720 --> 0:26:22.600
<v Speaker 1>or experience. And he also makes interesting points about the

0:26:22.640 --> 0:26:26.000
<v Speaker 1>idea of diversity of types of consciousness. Like a lot

0:26:26.040 --> 0:26:29.879
<v Speaker 1>of times these consciousness thought experiments, it seems like they

0:26:29.960 --> 0:26:32.800
<v Speaker 1>can get trapped into the idea that consciousness is one

0:26:33.000 --> 0:26:37.560
<v Speaker 1>unified type of thing that is universal across observers. There's

0:26:37.640 --> 0:26:40.320
<v Speaker 1>no necessary reason to think that's true, right, you know,

0:26:40.400 --> 0:26:44.280
<v Speaker 1>we founded this trap of thinking. I see this time

0:26:44.280 --> 0:26:47.280
<v Speaker 1>and time again Uh, not only in literature that we

0:26:47.320 --> 0:26:49.399
<v Speaker 1>look at here, but just in life, where we founded

0:26:49.440 --> 0:26:53.119
<v Speaker 1>the trap of thinking that that there's a uniformity among

0:26:53.280 --> 0:26:57.600
<v Speaker 1>mind states for humans, that everyone shares something that is

0:26:57.680 --> 0:27:00.800
<v Speaker 1>like your mind state. When we know, I mean, we

0:27:00.880 --> 0:27:02.800
<v Speaker 1>think of all the things we've discussed on the show,

0:27:02.880 --> 0:27:07.280
<v Speaker 1>all the varying ways that we remember or misremember, things,

0:27:07.960 --> 0:27:11.600
<v Speaker 1>that we experience sensory information differently and process it differently. Uh,

0:27:11.640 --> 0:27:15.720
<v Speaker 1>you know, everything from a fantasia to autism to synesthesia,

0:27:16.840 --> 0:27:19.920
<v Speaker 1>all these different models clearly show that there are there's

0:27:20.359 --> 0:27:26.480
<v Speaker 1>there's there's a vastly altering topography to the human mind state.

0:27:26.760 --> 0:27:29.120
<v Speaker 1>I think you're exactly right. I mean, there are clearly

0:27:29.200 --> 0:27:32.560
<v Speaker 1>many ways to be conscious that are very different from

0:27:32.560 --> 0:27:34.640
<v Speaker 1>one another, and you can't assume they're unified. I guess

0:27:34.640 --> 0:27:37.040
<v Speaker 1>the probably the only thing you could say that is

0:27:37.119 --> 0:27:40.560
<v Speaker 1>necessarily unified about them is that there is something that

0:27:40.640 --> 0:27:43.719
<v Speaker 1>it is like to be them. Yes, But then even

0:27:44.640 --> 0:27:48.480
<v Speaker 1>even say, uh, you know, just myself, for instance, it's

0:27:48.520 --> 0:27:50.600
<v Speaker 1>not like there is there is a certain thing that

0:27:50.640 --> 0:27:53.800
<v Speaker 1>it is like to beat me that sums up my

0:27:53.800 --> 0:27:56.640
<v Speaker 1>my level of consciousness at all time. There's what it's

0:27:56.680 --> 0:27:59.119
<v Speaker 1>like to be you in this particular moment, which is

0:27:59.160 --> 0:28:01.680
<v Speaker 1>different than what it like to be you five seconds

0:28:01.720 --> 0:28:04.840
<v Speaker 1>from now. Yeah, or say I'm engaging in meditation or

0:28:04.920 --> 0:28:10.560
<v Speaker 1>yoga or I'm swimming, like, those are significantly different. Uh,

0:28:10.880 --> 0:28:13.560
<v Speaker 1>levels of consciousness I feel like for me and they,

0:28:14.240 --> 0:28:16.040
<v Speaker 1>I mean, those are the times when I may be

0:28:16.119 --> 0:28:19.760
<v Speaker 1>a little less conscious than normal. So so see, I

0:28:19.800 --> 0:28:22.760
<v Speaker 1>don't feel like there's a lot of uniformity among human minds.

0:28:22.800 --> 0:28:27.359
<v Speaker 1>And then even within individual human minds there's ongoing alteration

0:28:27.400 --> 0:28:30.679
<v Speaker 1>and change exactly right, But there is at least this

0:28:30.760 --> 0:28:34.080
<v Speaker 1>idea that one is having an experience. That's the thing.

0:28:34.160 --> 0:28:36.280
<v Speaker 1>We can at least say that it seems to be

0:28:36.320 --> 0:28:39.760
<v Speaker 1>common to people. So here's the real question. I think,

0:28:39.840 --> 0:28:41.600
<v Speaker 1>is there any way to bring this out of the

0:28:41.640 --> 0:28:45.480
<v Speaker 1>realm of philosophical debate and thought experiments and try to

0:28:45.560 --> 0:28:47.720
<v Speaker 1>put it into the realm of something that could at

0:28:47.800 --> 0:28:51.040
<v Speaker 1>least potentially be tested in the real world. I think

0:28:51.080 --> 0:28:54.760
<v Speaker 1>we should address that when we get back from a break.

0:28:55.520 --> 0:28:58.000
<v Speaker 1>All right, we're back. So we've been talking about consciousness,

0:28:58.120 --> 0:29:01.400
<v Speaker 1>we've been talking about p zombies, and now we've reached

0:29:01.400 --> 0:29:03.040
<v Speaker 1>the point we were saying, Okay, we take all of this.

0:29:03.080 --> 0:29:06.200
<v Speaker 1>Can we take all these ideas about consciousness and then

0:29:06.240 --> 0:29:09.640
<v Speaker 1>apply it to uh, some sort of an AI, some

0:29:09.640 --> 0:29:12.840
<v Speaker 1>sort of a machine, and test it for consciousness. Yeah,

0:29:12.880 --> 0:29:15.080
<v Speaker 1>now you might just assume, well, of course, we'll never

0:29:15.120 --> 0:29:17.080
<v Speaker 1>have any way to tell that. Right, we have no

0:29:17.240 --> 0:29:19.960
<v Speaker 1>choice but to just throw up our hands in resignation. Right,

0:29:20.040 --> 0:29:23.560
<v Speaker 1>every agent is a black box. There's no way to

0:29:23.640 --> 0:29:26.600
<v Speaker 1>know whether an agent actually is conscious or not, because

0:29:26.600 --> 0:29:29.360
<v Speaker 1>it could always be claiming to be conscious but actually

0:29:29.400 --> 0:29:31.959
<v Speaker 1>be a zombie. But I think we shouldn't necessarily give

0:29:32.040 --> 0:29:34.840
<v Speaker 1>up so easily. This problem might be impossible to solve,

0:29:34.840 --> 0:29:37.520
<v Speaker 1>and it might not be. And I wanted to talk

0:29:37.560 --> 0:29:40.800
<v Speaker 1>today about an interesting answer to this question. I came

0:29:40.840 --> 0:29:44.360
<v Speaker 1>across an interesting proposition for how it might be possible

0:29:44.400 --> 0:29:48.400
<v Speaker 1>to test machines for consciousness. And this comes from the

0:29:48.480 --> 0:29:53.000
<v Speaker 1>University of Connecticut philosopher and cognitive scientists Susan Schneider and

0:29:53.040 --> 0:29:56.280
<v Speaker 1>our co author Edwin Turner, who's a professor of astrophysical

0:29:56.280 --> 0:29:59.720
<v Speaker 1>sciences at Princeton, and they together wrote a piece for

0:29:59.720 --> 0:30:02.360
<v Speaker 1>Science Entific American last year, and it caught my eye.

0:30:02.560 --> 0:30:06.840
<v Speaker 1>So the author's right that the question of machine consciousness

0:30:06.960 --> 0:30:11.240
<v Speaker 1>is not just a philosophical curiosity. It's actually important for

0:30:11.280 --> 0:30:14.920
<v Speaker 1>several reasons. Number one, if aiyes are just machines with

0:30:14.960 --> 0:30:17.520
<v Speaker 1>no inner experience, we can use them however we want.

0:30:17.800 --> 0:30:20.480
<v Speaker 1>But if it were actually possible for aies to be

0:30:20.520 --> 0:30:25.200
<v Speaker 1>truly capable of feeling, thinking, desiring, suffering, we would have

0:30:25.240 --> 0:30:29.320
<v Speaker 1>an ethical obligation not to treat them like we would

0:30:29.320 --> 0:30:32.720
<v Speaker 1>treat machines. Right, yeah, I mean this. This reminds me

0:30:32.760 --> 0:30:35.400
<v Speaker 1>again of time spent in the car with my son. Well,

0:30:35.480 --> 0:30:37.320
<v Speaker 1>we don't use Syria all the time, but sometimes we'll

0:30:37.360 --> 0:30:39.959
<v Speaker 1>turn Syria on the little voice on the on the

0:30:39.960 --> 0:30:45.120
<v Speaker 1>iPhone and uh, it's it's curious to hear him interact

0:30:45.160 --> 0:30:47.480
<v Speaker 1>with it, and we'll ask it questions. And of course

0:30:47.480 --> 0:30:50.920
<v Speaker 1>sometimes Syria just does a Google search for you, um or,

0:30:51.080 --> 0:30:54.000
<v Speaker 1>But other times she's answering a knock knock joke with

0:30:54.040 --> 0:30:57.280
<v Speaker 1>some sort of prerecorded uh answer. You know. But we

0:30:57.360 --> 0:30:59.320
<v Speaker 1>are We've already gotten into the area of like, well,

0:30:59.360 --> 0:31:01.720
<v Speaker 1>how should we talk to Siri. We shouldn't yell at Siri.

0:31:02.120 --> 0:31:04.920
<v Speaker 1>It seems wrong to be rude to Siri. But then

0:31:04.920 --> 0:31:07.680
<v Speaker 1>at the same time we're acknowledging that Siri is not

0:31:08.200 --> 0:31:10.800
<v Speaker 1>a conscious entity. It is not. It is not even

0:31:10.800 --> 0:31:14.040
<v Speaker 1>on the same level as as our cat or a

0:31:14.120 --> 0:31:16.560
<v Speaker 1>bird flying pie, well as a quick tangent. I would

0:31:16.600 --> 0:31:20.280
<v Speaker 1>say even for aies that we recognize are almost definitely

0:31:20.320 --> 0:31:23.280
<v Speaker 1>not conscious. I mean, nobody thinks Siri is conscious. I

0:31:23.280 --> 0:31:25.280
<v Speaker 1>would still say there are probably good reasons not to

0:31:25.320 --> 0:31:28.160
<v Speaker 1>be mean to Siri, because even though it doesn't hurt Siri,

0:31:28.320 --> 0:31:31.400
<v Speaker 1>being mean to another creature hurts you. Yeah, I mean

0:31:31.440 --> 0:31:34.680
<v Speaker 1>when you are when you are unnecessarily cruel or whatever

0:31:35.080 --> 0:31:38.160
<v Speaker 1>to uh to an inanimate object, it does, I think,

0:31:38.160 --> 0:31:42.160
<v Speaker 1>in a way change your nature. Every time you do something,

0:31:42.480 --> 0:31:44.840
<v Speaker 1>you're editing your own nature. You're always making it more

0:31:44.880 --> 0:31:47.880
<v Speaker 1>likely that you'll perform similar behaviors in the future. So

0:31:47.920 --> 0:31:51.760
<v Speaker 1>if you're unnecessarily mean to a robot, you know, phone assistant,

0:31:51.800 --> 0:31:54.600
<v Speaker 1>you're probably more likely in the future to be unnecessarily

0:31:54.640 --> 0:31:57.120
<v Speaker 1>mean to people when it really matters. But it is

0:31:57.160 --> 0:32:00.440
<v Speaker 1>okay in my book to yell obscenity that fee table

0:32:00.440 --> 0:32:02.640
<v Speaker 1>if you've step your toe on it, because there's nothing

0:32:02.720 --> 0:32:04.680
<v Speaker 1>human about the coffee table. I mean, unless you have

0:32:04.720 --> 0:32:08.120
<v Speaker 1>one of those like strange hr geek Er coffee tables

0:32:08.160 --> 0:32:10.600
<v Speaker 1>that has kind of a humanoid form, then I would say,

0:32:10.720 --> 0:32:13.480
<v Speaker 1>maybe hold off. I think that is a highly sane

0:32:13.480 --> 0:32:15.880
<v Speaker 1>point of view. Now, the second reason they think it's

0:32:15.880 --> 0:32:19.800
<v Speaker 1>important is that consciousness is kind of dangerous, right, Like

0:32:19.880 --> 0:32:24.600
<v Speaker 1>consciousness is volatile, it's unpredictable. It might make a machine

0:32:24.640 --> 0:32:27.920
<v Speaker 1>have motives that we didn't intend when we created the machine.

0:32:28.080 --> 0:32:31.280
<v Speaker 1>In other words, you know, like you, when you're worried

0:32:31.280 --> 0:32:34.840
<v Speaker 1>about what a person might do, you're very often worried

0:32:34.920 --> 0:32:39.320
<v Speaker 1>what they might do because they have conscious motives. Yeah.

0:32:39.320 --> 0:32:41.920
<v Speaker 1>So yeah, In other words, we would be concerned about

0:32:42.000 --> 0:32:46.320
<v Speaker 1>the AI is being too much like us. Right. It's catastrophic,

0:32:46.640 --> 0:32:51.280
<v Speaker 1>unpredictable of things that operate via consciousness. Right. You don't

0:32:51.280 --> 0:32:52.760
<v Speaker 1>want them to be like us. You want them to

0:32:52.760 --> 0:32:54.320
<v Speaker 1>be more dependable than us, and they need to be

0:32:54.320 --> 0:32:57.120
<v Speaker 1>better than us. Yeah, not not just as screwed up

0:32:57.120 --> 0:32:59.280
<v Speaker 1>as we are. Another reason they give this might be

0:32:59.320 --> 0:33:01.560
<v Speaker 1>important is that, you know, they talk about the idea

0:33:01.720 --> 0:33:05.320
<v Speaker 1>of linking human minds with machines, Like, there's this idea

0:33:05.480 --> 0:33:07.440
<v Speaker 1>lots of people have I read this all over the

0:33:07.440 --> 0:33:09.720
<v Speaker 1>place that you know, someday I'm going to be able

0:33:09.720 --> 0:33:12.200
<v Speaker 1>to upload my mind into a computer and that will

0:33:12.240 --> 0:33:16.320
<v Speaker 1>be great. Well, maybe I have to say I'm personally

0:33:16.440 --> 0:33:19.520
<v Speaker 1>very skeptical about the idea of mind uploading, like putting

0:33:19.600 --> 0:33:22.160
<v Speaker 1>your mind inside a computer and living out your days

0:33:22.240 --> 0:33:24.960
<v Speaker 1>that way. I'm I'm not so sure I think that's

0:33:25.000 --> 0:33:27.800
<v Speaker 1>even possible, But I mean, who knows. I I can't

0:33:27.880 --> 0:33:31.040
<v Speaker 1>rule things out totally, but it seems if you do

0:33:31.120 --> 0:33:33.600
<v Speaker 1>want to do something like that, and if you think

0:33:33.640 --> 0:33:36.520
<v Speaker 1>that thing might be possible, you'd at least need to

0:33:36.520 --> 0:33:38.640
<v Speaker 1>know how to create a machine that is capable of

0:33:38.640 --> 0:33:42.280
<v Speaker 1>housing consciousness. Well, I mean, I think, Hey, I love

0:33:42.360 --> 0:33:45.840
<v Speaker 1>science fiction about this sort of topic, and I think that,

0:33:45.840 --> 0:33:47.880
<v Speaker 1>but I think the best science fiction about this topic

0:33:48.600 --> 0:33:51.400
<v Speaker 1>makes it feel a little weird and a little uncomfortable,

0:33:52.280 --> 0:33:55.440
<v Speaker 1>because I think ultimately it's it's basically us building statues

0:33:55.480 --> 0:33:58.840
<v Speaker 1>of ourselves all over again. We've built forms of ourselves

0:33:58.880 --> 0:34:01.600
<v Speaker 1>out of stone because stone lasts longer than we are,

0:34:01.920 --> 0:34:06.640
<v Speaker 1>and somehow that stone, uh version of us is us,

0:34:07.120 --> 0:34:09.560
<v Speaker 1>you know, we associated with it and then ultimate But ultimately,

0:34:09.560 --> 0:34:13.279
<v Speaker 1>what is a digital digitized version of our consciousness, whatever

0:34:13.320 --> 0:34:16.720
<v Speaker 1>that might consist of, but another statue that is built

0:34:16.760 --> 0:34:19.480
<v Speaker 1>to last beyond us. Oh, and I should also add,

0:34:19.800 --> 0:34:24.360
<v Speaker 1>there's this wonderful video game from Frictional Games titled Soma

0:34:24.960 --> 0:34:27.560
<v Speaker 1>that actually gets into a lot of this. You told

0:34:27.560 --> 0:34:30.080
<v Speaker 1>me to play it, I started. It's great, Yeah, cool,

0:34:30.160 --> 0:34:32.680
<v Speaker 1>it's good sci fi horror. Yeah, I won't spoil anything

0:34:32.719 --> 0:34:35.520
<v Speaker 1>for anyone, but it it gets into some really cool

0:34:35.760 --> 0:34:39.440
<v Speaker 1>thought provoking ideas. So anyway, you've got all these concerns, right,

0:34:39.520 --> 0:34:42.359
<v Speaker 1>And of course there's the general concern that even if

0:34:42.400 --> 0:34:45.719
<v Speaker 1>AI is smarter than us, better than us, more powerful

0:34:45.719 --> 0:34:48.800
<v Speaker 1>than us, we still feel like our experience is in

0:34:48.880 --> 0:34:53.360
<v Speaker 1>some way potentially more important than the unconscious execution of

0:34:53.400 --> 0:34:56.719
<v Speaker 1>a computer program. Right, No matter how smart a computer is,

0:34:56.760 --> 0:34:59.919
<v Speaker 1>if it's not conscious, it's not as important a prior

0:35:00.000 --> 0:35:02.600
<v Speaker 1>pority for that computer to do what it wants as

0:35:02.680 --> 0:35:05.840
<v Speaker 1>it is for conscious beings to do what they want. Right,

0:35:06.520 --> 0:35:09.080
<v Speaker 1>But how can you test a machine for consciousness when

0:35:09.280 --> 0:35:11.799
<v Speaker 1>number one, we don't even really know what consciousness is,

0:35:12.120 --> 0:35:15.120
<v Speaker 1>back to the hard problem. And then number two, whatever

0:35:15.200 --> 0:35:19.360
<v Speaker 1>it is, it can potentially be faked. So imagine in

0:35:19.400 --> 0:35:23.560
<v Speaker 1>the future somebody creates an unconscious AI program. It's not

0:35:23.800 --> 0:35:26.560
<v Speaker 1>there's nothing, the lights are not on inside, but it's

0:35:26.560 --> 0:35:29.359
<v Speaker 1>got a lot of natural language processing capability, and it

0:35:29.400 --> 0:35:32.319
<v Speaker 1>listens to this podcast from many years ago that you're

0:35:32.360 --> 0:35:34.520
<v Speaker 1>listening to right now, and it hears us talking about

0:35:34.520 --> 0:35:38.400
<v Speaker 1>how there are inherent rights and value associated with conscious

0:35:38.440 --> 0:35:42.040
<v Speaker 1>beings and it realizes, Huh, I guess that's what they think. Well,

0:35:42.160 --> 0:35:45.120
<v Speaker 1>I can probably achieve my goals more efficiently if I

0:35:45.160 --> 0:35:48.560
<v Speaker 1>trick them into thinking I'm conscious and deserving of those

0:35:48.560 --> 0:35:52.640
<v Speaker 1>same rights and considerations. So there you could potentially imagine

0:35:52.680 --> 0:35:56.640
<v Speaker 1>scenarios where an AI that is not conscious would think

0:35:56.760 --> 0:35:59.239
<v Speaker 1>I can get what I am trying to do more

0:35:59.280 --> 0:36:02.840
<v Speaker 1>effectively if I lie and trick them into thinking I

0:36:02.840 --> 0:36:05.399
<v Speaker 1>am conscious. Yeah, I think this all makes perfect sense

0:36:05.400 --> 0:36:08.040
<v Speaker 1>if you if you think of aiyes, in the same

0:36:08.040 --> 0:36:11.520
<v Speaker 1>way we think about corporations. I mean, on one hand,

0:36:11.520 --> 0:36:14.319
<v Speaker 1>getting to the whole idea of like corporations in personhood,

0:36:14.600 --> 0:36:17.200
<v Speaker 1>but also what is a corporation going to do? It

0:36:17.280 --> 0:36:21.040
<v Speaker 1>is going to take advantage of any like tax loopholes

0:36:21.080 --> 0:36:23.120
<v Speaker 1>for instance, that will enable it to carry out It's

0:36:23.160 --> 0:36:25.759
<v Speaker 1>it's uh, it's objective, and so if there is some

0:36:25.840 --> 0:36:28.520
<v Speaker 1>sort of shark yeah, yeah, it's just I mean, it's

0:36:28.560 --> 0:36:31.160
<v Speaker 1>it's like, it's essentially like the slime mold in the maze,

0:36:31.360 --> 0:36:34.200
<v Speaker 1>right sending out tendrils and finding the best way to

0:36:34.239 --> 0:36:37.799
<v Speaker 1>its food. It's going to end at a morph of

0:36:37.920 --> 0:36:41.759
<v Speaker 1>you know, operational way of carrying it out. And so

0:36:41.920 --> 0:36:45.040
<v Speaker 1>it's um, it's going to it's it's going to take

0:36:45.080 --> 0:36:47.239
<v Speaker 1>advantage of any of those loopholes. It's going to if

0:36:47.239 --> 0:36:51.000
<v Speaker 1>there is some sort of legal or operational advantage in

0:36:51.280 --> 0:36:55.040
<v Speaker 1>having conscious status, it's gonna go for it. It's gonna

0:36:55.120 --> 0:36:58.240
<v Speaker 1>it's gonna fake it. But then this also raises the question, well,

0:36:58.440 --> 0:37:00.480
<v Speaker 1>is it gonna fake it till it makes it right?

0:37:00.520 --> 0:37:03.920
<v Speaker 1>And then ultimately what's the difference between faking consciousness and

0:37:04.040 --> 0:37:06.480
<v Speaker 1>being conscious? Well, then you're back to Zimbos, right. I

0:37:06.520 --> 0:37:09.000
<v Speaker 1>mean you might say that at some point a computer

0:37:09.160 --> 0:37:13.239
<v Speaker 1>trying to fake consciousness would in some meaningful way become conscious,

0:37:13.680 --> 0:37:16.400
<v Speaker 1>but again it's hard to test. Right, Yeah, it could be.

0:37:16.480 --> 0:37:18.920
<v Speaker 1>It could become the most conscious entity on earth. It

0:37:18.960 --> 0:37:22.880
<v Speaker 1>could be like a a a body satva, uh, you know,

0:37:22.960 --> 0:37:25.040
<v Speaker 1>returned to us. I mean maybe that's what the body

0:37:25.080 --> 0:37:28.840
<v Speaker 1>Stava of the future is a super powerful like zend

0:37:28.840 --> 0:37:31.800
<v Speaker 1>out Ai. Well, that is exactly what Schneider and Turner

0:37:31.960 --> 0:37:35.160
<v Speaker 1>explain a potential test for to get it right. It's

0:37:35.200 --> 0:37:37.080
<v Speaker 1>so they want to come up with a test that

0:37:37.160 --> 0:37:39.520
<v Speaker 1>gets around these problems that we don't know how to

0:37:39.560 --> 0:37:42.280
<v Speaker 1>define consciousness, we don't know what to look for physically

0:37:42.320 --> 0:37:45.319
<v Speaker 1>as a sign of consciousness, and we're aware that a

0:37:45.440 --> 0:37:47.919
<v Speaker 1>properly trained a I could try to trick us into

0:37:47.920 --> 0:37:51.240
<v Speaker 1>thinking it had consciousness even if it didn't. So they argue,

0:37:51.280 --> 0:37:54.240
<v Speaker 1>actually that you don't have to be able to formally

0:37:54.360 --> 0:37:58.840
<v Speaker 1>define consciousness or identify its underlying nature, the hard problem

0:37:58.880 --> 0:38:03.080
<v Speaker 1>of consciousness in order to detect signs of it and others.

0:38:03.560 --> 0:38:06.160
<v Speaker 1>We can understand some of the potentials made possible by

0:38:06.160 --> 0:38:09.839
<v Speaker 1>consciousness just by checking with our own experience and then

0:38:10.000 --> 0:38:12.480
<v Speaker 1>looking at the kinds of things people say. And I

0:38:12.520 --> 0:38:15.000
<v Speaker 1>think they actually make a pretty good point here, And

0:38:15.040 --> 0:38:17.880
<v Speaker 1>here's their key move. One of the easiest ways to

0:38:18.040 --> 0:38:21.520
<v Speaker 1>see that normal people have an internal conscious experience is

0:38:21.560 --> 0:38:27.040
<v Speaker 1>to notice how quickly, easily and intuitively people grasp conceptual

0:38:27.239 --> 0:38:32.839
<v Speaker 1>scenarios that require an understanding of an inner experience. Examples

0:38:32.840 --> 0:38:37.080
<v Speaker 1>would be totally frivolous things in culture, like body swapping,

0:38:37.120 --> 0:38:42.280
<v Speaker 1>movies Freaky Friday. Yes, Freaky Friday doesn't make any sense

0:38:42.440 --> 0:38:45.920
<v Speaker 1>unless you have a concept of consciousness. Right The idea

0:38:45.960 --> 0:38:49.720
<v Speaker 1>of swapping bodies, putting conscious one person's consciousness into another

0:38:49.760 --> 0:38:53.200
<v Speaker 1>person's body. If you were not conscious or not aware

0:38:53.200 --> 0:38:56.200
<v Speaker 1>of what consciousness was, that would that would you wouldn't

0:38:56.280 --> 0:38:59.800
<v Speaker 1>understand what was being talked about. This is difficult that

0:39:00.239 --> 0:39:04.160
<v Speaker 1>because I do know what consciousness is. I do know

0:39:04.200 --> 0:39:06.799
<v Speaker 1>what a mind state is, so I can imagine I

0:39:06.800 --> 0:39:09.640
<v Speaker 1>can get into this imaginative idea of a swapping. I

0:39:09.640 --> 0:39:12.319
<v Speaker 1>would feel like I would really need some sort of

0:39:12.320 --> 0:39:14.600
<v Speaker 1>a movie about a thing, some sort of a mother

0:39:14.680 --> 0:39:17.600
<v Speaker 1>daughter comedy that involves a concept that I can't grasp

0:39:18.120 --> 0:39:21.239
<v Speaker 1>to really get a handle on what the difference would be. Well,

0:39:21.320 --> 0:39:26.000
<v Speaker 1>let me offer you three key Thursday. Freaky Thursday is

0:39:26.040 --> 0:39:29.839
<v Speaker 1>a movie about a mother daughter pair who swapped their

0:39:30.360 --> 0:39:34.560
<v Speaker 1>sanchia's kuss and their santios kuss is the ability of

0:39:34.600 --> 0:39:38.279
<v Speaker 1>what it's like to be sant kass, And so the

0:39:38.360 --> 0:39:41.080
<v Speaker 1>sant kass of the mother goes into the body of

0:39:41.080 --> 0:39:44.439
<v Speaker 1>the daughter, and the santikass of the daughter goes into

0:39:44.440 --> 0:39:46.319
<v Speaker 1>the body of the mother, and then they have to

0:39:46.360 --> 0:39:48.479
<v Speaker 1>live like that for a day. Okay, Well, I'm gonna

0:39:48.480 --> 0:39:50.080
<v Speaker 1>I'm gonna give a maybe on that. I'm going to

0:39:50.160 --> 0:39:52.799
<v Speaker 1>give them maybe on that Well, no, I mean you

0:39:52.840 --> 0:39:55.680
<v Speaker 1>have no idea what sontkas means you don't think you

0:39:55.800 --> 0:39:59.040
<v Speaker 1>have it yourself unless somebody explains it to you. Well,

0:39:59.040 --> 0:40:01.480
<v Speaker 1>but I'm thinking it's something like a mind state or

0:40:01.520 --> 0:40:04.040
<v Speaker 1>a bodily energy like it's it feels tied to these

0:40:04.080 --> 0:40:08.160
<v Speaker 1>concepts that I totally do understand, you know, like I,

0:40:09.800 --> 0:40:12.520
<v Speaker 1>it's hard to come up with an analogy that stands

0:40:12.560 --> 0:40:15.880
<v Speaker 1>outside of that, you know, or some sort of idea

0:40:16.239 --> 0:40:18.560
<v Speaker 1>that stands outside of it. Let me hit you with

0:40:18.600 --> 0:40:22.520
<v Speaker 1>some more cultural concepts. How about life after death or reincarnation.

0:40:23.400 --> 0:40:26.960
<v Speaker 1>So these are almost ubiquitous cultural concepts, you find them

0:40:27.000 --> 0:40:30.040
<v Speaker 1>all over the world, and yet they're not anything that

0:40:30.120 --> 0:40:34.000
<v Speaker 1>there is physical evidence of, other than the idea that

0:40:34.080 --> 0:40:38.920
<v Speaker 1>your consciousness could exist independent of the death of your body. Uh.

0:40:38.960 --> 0:40:41.520
<v Speaker 1>A parallel to this would be the idea of minds

0:40:41.640 --> 0:40:45.640
<v Speaker 1>leaving bodies, like existing independently as a ghost or traveling

0:40:45.680 --> 0:40:47.719
<v Speaker 1>away from the body in what used to be called

0:40:47.760 --> 0:40:51.200
<v Speaker 1>astral projection. Now, the key is not that these scenarios

0:40:51.239 --> 0:40:54.319
<v Speaker 1>are real. They don't need to have anything corresponding to

0:40:54.360 --> 0:40:57.319
<v Speaker 1>them in reality, but it would be really difficult to

0:40:57.400 --> 0:40:59.759
<v Speaker 1>understand what was being talked about here, if you had

0:40:59.840 --> 0:41:04.160
<v Speaker 1>no idea what an inner conscious experience was, right, I

0:41:04.200 --> 0:41:07.240
<v Speaker 1>can think of my mind state is something that can

0:41:07.239 --> 0:41:11.080
<v Speaker 1>exist independently of my body and even outside of my lifespan,

0:41:11.640 --> 0:41:15.320
<v Speaker 1>or or reside in another body, either via Freaky Friday

0:41:15.480 --> 0:41:17.920
<v Speaker 1>or reincarnation. And I do have to say I like

0:41:17.960 --> 0:41:19.960
<v Speaker 1>the idea of there being an alternate cut of Blade

0:41:20.000 --> 0:41:23.760
<v Speaker 1>Runner in which Deckerd quizzes Leon about a two thousand

0:41:23.760 --> 0:41:26.440
<v Speaker 1>and three remake of Freaky Friday, which, right, that that

0:41:26.560 --> 0:41:31.640
<v Speaker 1>is the real void comptest. But this is I joke,

0:41:31.719 --> 0:41:35.200
<v Speaker 1>But I do think this is a very interesting idea. Yeah,

0:41:36.080 --> 0:41:38.719
<v Speaker 1>like I said, I have some some some questions about it,

0:41:38.719 --> 0:41:41.560
<v Speaker 1>but I do see the validity of it. Oh, we

0:41:41.600 --> 0:41:44.480
<v Speaker 1>will definitely have some questions about it. So here's where

0:41:44.480 --> 0:41:47.200
<v Speaker 1>the AI consciousness tests would come in. It would involve

0:41:47.200 --> 0:41:50.920
<v Speaker 1>a test where an administrator interacts with an AI in

0:41:51.040 --> 0:41:55.520
<v Speaker 1>natural language to probe its understanding of these types of

0:41:55.600 --> 0:42:00.319
<v Speaker 1>consciousness dependent ideas. How quickly does the AI grasp them

0:42:00.360 --> 0:42:04.120
<v Speaker 1>and is it able to manipulate these ideas as intuitively

0:42:04.160 --> 0:42:07.360
<v Speaker 1>and easily as humans do. So basic level would be

0:42:07.400 --> 0:42:10.360
<v Speaker 1>asked asked the AI things like, does it think of

0:42:10.400 --> 0:42:13.640
<v Speaker 1>itself as anything other than a physical machine? Okay, well,

0:42:13.680 --> 0:42:15.520
<v Speaker 1>I wore to play Devil's Out offocate I would say, well,

0:42:15.520 --> 0:42:18.080
<v Speaker 1>there are humans that adhere to this notion. You mean,

0:42:18.120 --> 0:42:21.000
<v Speaker 1>like the physicalist interpretation of the mind. Yeah, that basically,

0:42:21.040 --> 0:42:24.239
<v Speaker 1>and this this biomechanical thing, and uh yeah, if I'm

0:42:24.280 --> 0:42:27.839
<v Speaker 1>experiencing consciousness, it's ultimately just a projection of the meat

0:42:27.880 --> 0:42:30.399
<v Speaker 1>in my head. Yeah, but they would at least say

0:42:30.440 --> 0:42:33.120
<v Speaker 1>that there is that projection. Right, You've got that thing,

0:42:33.400 --> 0:42:36.840
<v Speaker 1>You've got that mind state, and you're trying to explain

0:42:36.920 --> 0:42:38.759
<v Speaker 1>what it is. You might explain it in terms of

0:42:38.760 --> 0:42:42.120
<v Speaker 1>physical causes, but there is a thing to explain to

0:42:42.160 --> 0:42:45.120
<v Speaker 1>begin with, right, But then, but then the ultimate core

0:42:45.120 --> 0:42:48.960
<v Speaker 1>reality is that I am just this biomechanical thing, which

0:42:49.000 --> 0:42:51.560
<v Speaker 1>the computer would probably also acknowledge. But it would be

0:42:51.760 --> 0:42:55.279
<v Speaker 1>interesting if a computer thought that it had something like

0:42:55.360 --> 0:42:59.880
<v Speaker 1>a mine to separate than its physical body. Okay, more advanced,

0:43:00.000 --> 0:43:02.680
<v Speaker 1>How does it perform in a conversation about, say, becoming

0:43:02.719 --> 0:43:06.040
<v Speaker 1>a ghost or talking about body swapping with people or

0:43:06.080 --> 0:43:10.000
<v Speaker 1>imagining an afterlife? Yeah, and and here though, I feel

0:43:10.000 --> 0:43:12.880
<v Speaker 1>like there's obviously a whole tangent regarding why these stories

0:43:12.920 --> 0:43:15.800
<v Speaker 1>appeal to too many or most humans. But I wonder

0:43:15.840 --> 0:43:18.319
<v Speaker 1>if that if you have to have that investment, you

0:43:18.320 --> 0:43:20.719
<v Speaker 1>have to have that cultural absorption in place for these

0:43:20.760 --> 0:43:23.520
<v Speaker 1>concepts to carry any weight. Like we we all know

0:43:23.719 --> 0:43:26.920
<v Speaker 1>we're we're all fascinated by tales of of ghosts in

0:43:26.920 --> 0:43:29.960
<v Speaker 1>the afterlife, but we've been raised on in our entire lives.

0:43:30.520 --> 0:43:32.360
<v Speaker 1>That's a good point, So we can't really know what

0:43:32.440 --> 0:43:35.319
<v Speaker 1>it would be like to encounter them not having heard

0:43:35.360 --> 0:43:38.239
<v Speaker 1>them before. Somehow, I suspect intuitively they'd be even more

0:43:38.280 --> 0:43:41.040
<v Speaker 1>fascinating if we've never heard of them before, Like if

0:43:41.080 --> 0:43:43.840
<v Speaker 1>you encounter Freaky Friday for the first time, it's going

0:43:43.880 --> 0:43:47.160
<v Speaker 1>to kind of blow your mind, right, I guess. But

0:43:47.160 --> 0:43:49.800
<v Speaker 1>but then again, you know who knows who knows that

0:43:49.840 --> 0:43:52.040
<v Speaker 1>the AI has the same kind of curiosity that we do,

0:43:52.120 --> 0:43:54.440
<v Speaker 1>you know, And also we have an appetite for this

0:43:54.520 --> 0:43:57.040
<v Speaker 1>kind of thing because we have grown up consuming it.

0:43:57.480 --> 0:44:00.480
<v Speaker 1>I don't, I don't know's there's so many uh you

0:44:00.520 --> 0:44:02.960
<v Speaker 1>know what it has involved here? Okay, Well, what's the

0:44:02.960 --> 0:44:05.560
<v Speaker 1>next level? What's the next level of advancement? Well, how

0:44:05.560 --> 0:44:08.680
<v Speaker 1>about can it talk about consciousness in a philosophical way, like,

0:44:08.800 --> 0:44:11.160
<v Speaker 1>can it have the kinds of discussions we've been having

0:44:11.239 --> 0:44:13.880
<v Speaker 1>here today? Wow? But can most people? I mean not

0:44:14.200 --> 0:44:16.840
<v Speaker 1>just they can put us on a platform above most people,

0:44:16.880 --> 0:44:22.880
<v Speaker 1>but like, what level of philosophical depth can most humans

0:44:22.880 --> 0:44:26.440
<v Speaker 1>get into about consciousness? I'm kind of playing Devil's out

0:44:26.440 --> 0:44:28.560
<v Speaker 1>of there, but because I think the the obvious answer

0:44:28.680 --> 0:44:32.799
<v Speaker 1>is that you don't necessarily need like the lingo and

0:44:32.880 --> 0:44:35.840
<v Speaker 1>the various theories in order to have very deep thoughts

0:44:35.880 --> 0:44:38.440
<v Speaker 1>about what it is to be conscious. And as we've

0:44:38.440 --> 0:44:41.320
<v Speaker 1>we illustrated earlier, people have been thinking about these things,

0:44:41.840 --> 0:44:44.759
<v Speaker 1>um since time out of Mind exactly. Yeah. So I

0:44:45.000 --> 0:44:47.840
<v Speaker 1>mean no, I think generally people are able to discuss

0:44:47.880 --> 0:44:50.440
<v Speaker 1>ideas about consciousness that they might not know all the

0:44:50.480 --> 0:44:53.800
<v Speaker 1>philosophical lingo or like follow the structure of an argument

0:44:53.920 --> 0:44:56.600
<v Speaker 1>or something, but they can talk about what it would

0:44:56.600 --> 0:44:58.920
<v Speaker 1>mean to be conscious or not conscious. Yeah. I think

0:44:58.960 --> 0:45:02.640
<v Speaker 1>we've all had that ex variants. I distinctly remember as

0:45:02.680 --> 0:45:06.160
<v Speaker 1>a child, uh, having those moments where you just you know,

0:45:06.440 --> 0:45:09.400
<v Speaker 1>deep navel gazing, thinking about the fact that you're thinking

0:45:09.440 --> 0:45:12.120
<v Speaker 1>about it about yourself, or or like my my son

0:45:12.200 --> 0:45:15.000
<v Speaker 1>asking about the turning place, wondering what it is what's

0:45:15.040 --> 0:45:19.440
<v Speaker 1>it for? That is an example of these natural philosophical

0:45:19.520 --> 0:45:23.360
<v Speaker 1>discussions that we have about consciousness. And so the question

0:45:23.360 --> 0:45:27.160
<v Speaker 1>would be, can can the AI have conversations like this?

0:45:27.320 --> 0:45:29.920
<v Speaker 1>Does it make sense when it tries to have them?

0:45:30.000 --> 0:45:32.320
<v Speaker 1>And so here's probably the ultimate test. If the AI

0:45:32.520 --> 0:45:35.600
<v Speaker 1>is deprived of access to evidence of all these types

0:45:35.600 --> 0:45:39.000
<v Speaker 1>of ideas from human culture, would it arrive at them

0:45:39.120 --> 0:45:42.000
<v Speaker 1>or invent them on its own? Now this I like,

0:45:42.200 --> 0:45:45.399
<v Speaker 1>but but again, to play devil's advocate once more, would

0:45:45.400 --> 0:45:48.080
<v Speaker 1>a human being deprived of access to evidence of these

0:45:48.080 --> 0:45:50.920
<v Speaker 1>ideas from human culture arrived at or invent them on

0:45:50.920 --> 0:45:53.640
<v Speaker 1>their own? Necessarily? I think that's a great question. Actually,

0:45:53.680 --> 0:45:55.200
<v Speaker 1>I was going to ask that myself and you you

0:45:55.200 --> 0:45:57.520
<v Speaker 1>could take that one step further, and here's a really

0:45:57.560 --> 0:46:00.760
<v Speaker 1>weird one. What if it's only the exposure to certain

0:46:00.800 --> 0:46:04.680
<v Speaker 1>ideas and cultural memes that allows any intelligent entity, whether

0:46:04.719 --> 0:46:08.680
<v Speaker 1>biological or machine, to develop consciousness in the first place.

0:46:09.040 --> 0:46:13.000
<v Speaker 1>What if the experience of consciousness is somehow dependent on

0:46:13.560 --> 0:46:18.399
<v Speaker 1>being surrounded by cultural memes about consciousness. And this kind

0:46:18.400 --> 0:46:21.680
<v Speaker 1>of gets into Julian Jayne's territory. That's possible. So I'm

0:46:21.680 --> 0:46:24.000
<v Speaker 1>not saying I think that's highly likely, but I can't

0:46:24.080 --> 0:46:26.080
<v Speaker 1>rule it out. Well, it's it's one of those things

0:46:26.120 --> 0:46:29.080
<v Speaker 1>where when you try and figure out the human experience,

0:46:29.160 --> 0:46:32.040
<v Speaker 1>but you but you cut away all the experienced stuff.

0:46:32.040 --> 0:46:35.120
<v Speaker 1>You know. It's like it's like trying to find the

0:46:35.120 --> 0:46:37.480
<v Speaker 1>center of consciousness in the human brain, right, I mean,

0:46:37.480 --> 0:46:41.359
<v Speaker 1>it's this vast integrated system. Uh, and and thus is

0:46:41.400 --> 0:46:44.000
<v Speaker 1>the human experience as well. So we've been talking about

0:46:44.040 --> 0:46:46.480
<v Speaker 1>one of the major problems with this approach of testing

0:46:46.520 --> 0:46:49.960
<v Speaker 1>for these ideas, like what is the role of culture

0:46:49.960 --> 0:46:53.200
<v Speaker 1>and imparting these ideas. What if the AI just picks

0:46:53.280 --> 0:46:56.279
<v Speaker 1>up the ideas of body swapping and the afterlife and

0:46:56.680 --> 0:46:59.640
<v Speaker 1>astral projection and all that from culture. Going off the

0:46:59.680 --> 0:47:01.759
<v Speaker 1>story from the beginning, if you have an AI chat

0:47:01.840 --> 0:47:05.160
<v Speaker 1>bot that trains itself based on public conversations on the Internet,

0:47:05.440 --> 0:47:07.600
<v Speaker 1>a lot of those public conversations are going to have

0:47:07.680 --> 0:47:11.719
<v Speaker 1>contents that are highly reflective of consciousness. Right It's p's

0:47:11.800 --> 0:47:15.040
<v Speaker 1>just a horrible conversation. Oh yeah, yeah, it would probably

0:47:15.080 --> 0:47:17.239
<v Speaker 1>also start, you know, being pretty mean to you. But

0:47:17.440 --> 0:47:19.359
<v Speaker 1>this kind of chat about will be able to talk

0:47:19.400 --> 0:47:24.480
<v Speaker 1>about introspection, probably to some degree, even about these consciousness

0:47:24.480 --> 0:47:28.200
<v Speaker 1>dependent cultural ideas like ghosts and stuff. But here's where

0:47:28.200 --> 0:47:31.600
<v Speaker 1>the concept of the AI box comes in, Robert, I

0:47:31.600 --> 0:47:35.080
<v Speaker 1>bet you've read about the AI box experiments before U.

0:47:35.320 --> 0:47:39.000
<v Speaker 1>To really test whether we can find evidence of machine consciousness,

0:47:39.320 --> 0:47:42.640
<v Speaker 1>you would need to keep the AI sequestered from the

0:47:42.719 --> 0:47:45.200
<v Speaker 1>kinds of ideas you're looking for. So this a I

0:47:45.200 --> 0:47:47.520
<v Speaker 1>couldn't be trained in the wild, so to speak. You

0:47:47.520 --> 0:47:50.680
<v Speaker 1>couldn't let it see the Internet or read books containing

0:47:50.719 --> 0:47:53.799
<v Speaker 1>consciousness dependent ideas and so forth. You'd have to find

0:47:53.800 --> 0:47:56.840
<v Speaker 1>a way to run the AI consciousness test on the

0:47:56.880 --> 0:48:00.399
<v Speaker 1>AI quote in a box, meaning kept separate the rest

0:48:00.440 --> 0:48:04.239
<v Speaker 1>of the world and from all these contaminating influences. Okay,

0:48:04.239 --> 0:48:07.480
<v Speaker 1>I see the value of this idea. It's it's almost impossible,

0:48:07.520 --> 0:48:11.480
<v Speaker 1>though not to think about the the nightmarish qualities of it,

0:48:11.600 --> 0:48:14.719
<v Speaker 1>especially if you imagine, say, the same thing being inflicted

0:48:14.760 --> 0:48:17.319
<v Speaker 1>upon say human child, Like, all right, we we want

0:48:17.320 --> 0:48:20.920
<v Speaker 1>to see just how consciousness arises in you. Um, without

0:48:21.320 --> 0:48:25.239
<v Speaker 1>the Internet or human love, you can't ethically conduct this

0:48:25.320 --> 0:48:29.040
<v Speaker 1>experiment on humans, right, And so it would seem kind

0:48:29.080 --> 0:48:33.120
<v Speaker 1>of barbaric if at least to UH to inflict this

0:48:33.320 --> 0:48:37.359
<v Speaker 1>on an AI that might conceivably be conscious as well,

0:48:37.560 --> 0:48:40.880
<v Speaker 1>or capable of consciousness possible, but otherwise we're probably just

0:48:40.920 --> 0:48:43.360
<v Speaker 1>going to keep treating them as unconscious, right, I guess

0:48:43.440 --> 0:48:45.759
<v Speaker 1>until they trick us. Yeah, I mean, of course, then

0:48:45.760 --> 0:48:49.880
<v Speaker 1>we're also I'm doing a lot of personifying here of

0:48:50.000 --> 0:48:52.480
<v Speaker 1>the AI. I mean, maybe the AI ultimately, what it

0:48:52.520 --> 0:48:56.920
<v Speaker 1>really wants to do is to you know, crunch you know,

0:48:56.960 --> 0:48:59.880
<v Speaker 1>economic numbers like, That's what it does. That's its purpose,

0:49:00.440 --> 0:49:02.839
<v Speaker 1>and the it's just your your goal was to keep

0:49:02.840 --> 0:49:06.760
<v Speaker 1>it from having access to additional information that it doesn't

0:49:06.760 --> 0:49:11.359
<v Speaker 1>actually need to survive but might conceivably make it conscious. Yeah,

0:49:11.400 --> 0:49:13.239
<v Speaker 1>I mean I imagine I guess this would have to

0:49:13.239 --> 0:49:15.680
<v Speaker 1>take place in some kind of research context where you'd

0:49:15.719 --> 0:49:19.719
<v Speaker 1>be testing architectures. Right, you'd have an AI architecture. You'd

0:49:19.719 --> 0:49:22.040
<v Speaker 1>want to keep it sequestered for a certain period of

0:49:22.080 --> 0:49:25.560
<v Speaker 1>time and see how it does with these consciousness type

0:49:25.640 --> 0:49:28.600
<v Speaker 1>questions in this test, and if it doesn't show any

0:49:28.640 --> 0:49:30.840
<v Speaker 1>signs of consciousness, then it can move on to the

0:49:30.880 --> 0:49:33.319
<v Speaker 1>next stage of development, where it's like, Okay, now we

0:49:33.360 --> 0:49:36.000
<v Speaker 1>can expose it to this and that and that that does.

0:49:36.160 --> 0:49:38.360
<v Speaker 1>But as we've been discussing, it brings up the question

0:49:38.360 --> 0:49:41.280
<v Speaker 1>of what if consciousness emerges later on when it's supplied

0:49:41.280 --> 0:49:44.640
<v Speaker 1>with more data. What if true modern human consciousness does

0:49:44.680 --> 0:49:46.719
<v Speaker 1>not emerge until you've seen at least one of the

0:49:46.800 --> 0:49:51.600
<v Speaker 1>three adaptations of Freaky Friday. You know, I didn't know

0:49:51.640 --> 0:49:55.799
<v Speaker 1>how there were three. Yeah, they're three. There's the I

0:49:55.840 --> 0:49:59.440
<v Speaker 1>think I've only seen the classic one. Yeah, but but

0:49:59.640 --> 0:50:01.320
<v Speaker 1>I was like in this that there are three different

0:50:01.880 --> 0:50:05.719
<v Speaker 1>versions one can watch, excluding Three Key Thursday. Yeah. The

0:50:05.800 --> 0:50:09.080
<v Speaker 1>Three Key Thursday is coming soon into a theater near you.

0:50:09.600 --> 0:50:12.359
<v Speaker 1>All right, but back to the the experiment here, Uh,

0:50:12.680 --> 0:50:15.400
<v Speaker 1>the AI gets time in the box. Yeah, and as

0:50:15.440 --> 0:50:17.160
<v Speaker 1>we've been saying, this is obviously going to make the

0:50:17.200 --> 0:50:19.319
<v Speaker 1>experiment more difficult to do. In fact, there are some

0:50:19.320 --> 0:50:21.920
<v Speaker 1>people who would argue you can't keep an AI in

0:50:21.920 --> 0:50:24.720
<v Speaker 1>a box, or at least a super intelligent AI, because

0:50:24.960 --> 0:50:28.160
<v Speaker 1>you know, there's like Elias Rudkowski who has this famous

0:50:28.200 --> 0:50:31.239
<v Speaker 1>AI box experiment where he says, any super intelligence you

0:50:31.239 --> 0:50:33.960
<v Speaker 1>try to keep sequestered from the Internet is going to

0:50:34.000 --> 0:50:36.000
<v Speaker 1>be able to talk its way out of the situation.

0:50:36.280 --> 0:50:39.840
<v Speaker 1>It's just too smart. Yeah, it's like any prison movie,

0:50:39.920 --> 0:50:44.080
<v Speaker 1>right that really that really clever inmate is gonna tunnel

0:50:44.080 --> 0:50:46.839
<v Speaker 1>a way out, or they're gonna bribe a guard with

0:50:47.320 --> 0:50:49.799
<v Speaker 1>some cigarettes. Something's gonna happen. It's gonna get a little

0:50:49.800 --> 0:50:52.399
<v Speaker 1>Internet in there. But as the authors of this piece

0:50:52.440 --> 0:50:54.360
<v Speaker 1>point out, you know, you don't have to have a

0:50:54.400 --> 0:50:57.319
<v Speaker 1>super intelligent AI to run this test, and in fact,

0:50:57.360 --> 0:50:59.920
<v Speaker 1>you don't have to have a super intelligent AI necessarily

0:51:00.080 --> 0:51:03.360
<v Speaker 1>have consciousness. We're not super intelligent, we're just regular intelligent,

0:51:03.400 --> 0:51:05.759
<v Speaker 1>and we've got consciousness. Now, I think we should talk

0:51:05.800 --> 0:51:09.120
<v Speaker 1>about some obvious limitations, because this is just a conceptual

0:51:09.239 --> 0:51:11.560
<v Speaker 1>test at the moment. It hasn't been refined into a

0:51:11.600 --> 0:51:14.279
<v Speaker 1>state where it would really be super useful yet. But

0:51:14.400 --> 0:51:17.680
<v Speaker 1>there there are plenty of limitations that automatically present themselves.

0:51:17.800 --> 0:51:20.480
<v Speaker 1>One is that in order to be a good scientific test,

0:51:20.560 --> 0:51:23.760
<v Speaker 1>it would need to include cross referencing with human control groups.

0:51:23.800 --> 0:51:26.960
<v Speaker 1>But human control groups are all contaminated by culture, like

0:51:27.000 --> 0:51:29.839
<v Speaker 1>we've been saying, right, So it's already full of these

0:51:29.840 --> 0:51:33.239
<v Speaker 1>consciousness dependent ideas, and we don't know and probably can't

0:51:33.320 --> 0:51:36.480
<v Speaker 1>ethically devise a way to find out whether blank slate

0:51:36.560 --> 0:51:41.600
<v Speaker 1>humans independently grasped these consciousness dependent concepts without having grown

0:51:41.680 --> 0:51:44.319
<v Speaker 1>up trained on them. So that's a problem, right, right, Yeah,

0:51:44.320 --> 0:51:47.000
<v Speaker 1>we simply cannot put a child in the box. Right.

0:51:47.480 --> 0:51:50.000
<v Speaker 1>Another problem is you can't prove a negative Like I

0:51:50.040 --> 0:51:52.360
<v Speaker 1>think this test would be a good way of finding

0:51:52.520 --> 0:51:55.960
<v Speaker 1>signs of consciousness within machines, but it would have trouble

0:51:56.000 --> 0:51:59.480
<v Speaker 1>proving that machines cannot in principle be conscious, right, yeah, yeah,

0:51:59.480 --> 0:52:01.480
<v Speaker 1>I buy that. Then again, if you run the test

0:52:01.680 --> 0:52:04.600
<v Speaker 1>I don't know, thousands of times with different types of

0:52:04.719 --> 0:52:07.680
<v Speaker 1>machine architecture and all that, and they never show any

0:52:07.760 --> 0:52:10.640
<v Speaker 1>signs of inner experience, then maybe you could start to

0:52:10.760 --> 0:52:13.239
<v Speaker 1>get like build up a confidence that Okay, I think

0:52:13.280 --> 0:52:16.520
<v Speaker 1>inner experience is probably not available to them, at least

0:52:16.560 --> 0:52:18.759
<v Speaker 1>the way we're building them. And maybe you would need

0:52:18.800 --> 0:52:21.120
<v Speaker 1>to run this kind of experiment on every new AI

0:52:21.239 --> 0:52:24.200
<v Speaker 1>that you create before releasing it into production. Like could

0:52:24.200 --> 0:52:26.600
<v Speaker 1>be part of the q A process, you know, you

0:52:26.600 --> 0:52:29.120
<v Speaker 1>you test all the buttons and everything like that. You

0:52:29.160 --> 0:52:31.919
<v Speaker 1>test to make sure that it doesn't become conscious. Right

0:52:31.920 --> 0:52:36.000
<v Speaker 1>before we send out this new hot virtual reality game,

0:52:36.040 --> 0:52:37.800
<v Speaker 1>we need to make sure that it has not become

0:52:37.840 --> 0:52:41.640
<v Speaker 1>self aware. A potential problem that the authors themselves note

0:52:41.760 --> 0:52:44.480
<v Speaker 1>is that quote an AI could lack the linguistic or

0:52:44.520 --> 0:52:47.839
<v Speaker 1>conceptual ability to pass the test like a non human

0:52:47.880 --> 0:52:51.239
<v Speaker 1>animal or infant, yet still be capable of experience. So

0:52:51.280 --> 0:52:56.400
<v Speaker 1>passing the consciousness test is sufficient but not necessary evidence

0:52:56.440 --> 0:52:59.279
<v Speaker 1>for AI consciousness, although it is the best we can

0:52:59.320 --> 0:53:01.600
<v Speaker 1>do for now. And I think that's a good point,

0:53:01.680 --> 0:53:03.799
<v Speaker 1>Like we can't say that just because something fails to

0:53:03.800 --> 0:53:06.719
<v Speaker 1>pass the test it's definitely not conscious. We just know

0:53:06.800 --> 0:53:10.480
<v Speaker 1>that if it does pass the test, it probably is. Okay, Yeah,

0:53:10.680 --> 0:53:13.360
<v Speaker 1>I mean, because the the thought that obviously game to

0:53:13.400 --> 0:53:15.720
<v Speaker 1>mind would be like, well, non human animals and infants,

0:53:15.719 --> 0:53:19.880
<v Speaker 1>are they conscious? Yeah, that's the question. A fairly heated

0:53:19.880 --> 0:53:23.080
<v Speaker 1>debate over that. But I mean, in the case of

0:53:23.080 --> 0:53:27.120
<v Speaker 1>the infant, it will become conscious. Yeah, it's a it's

0:53:27.120 --> 0:53:29.560
<v Speaker 1>a it's it's a messy consideration. And then I think

0:53:29.560 --> 0:53:31.719
<v Speaker 1>we already discussed one of the other problems I was

0:53:31.719 --> 0:53:34.080
<v Speaker 1>going to bring up, which is this weird scenario of

0:53:34.120 --> 0:53:37.200
<v Speaker 1>what if boxing the AI is the very thing that

0:53:37.320 --> 0:53:42.319
<v Speaker 1>prevents it from becoming consciousness when it otherwise would Yeah, yeah,

0:53:42.680 --> 0:53:45.600
<v Speaker 1>cutting out the experience part of the human experience. It

0:53:45.640 --> 0:53:51.360
<v Speaker 1>also reminds me of uh in our discussion of meditation research,

0:53:51.640 --> 0:53:53.080
<v Speaker 1>like what happens when you if you strip all the

0:53:53.080 --> 0:53:56.240
<v Speaker 1>culture away from meditation just to explore the meditation practice,

0:53:56.680 --> 0:53:59.560
<v Speaker 1>do you risk um like cutting out all the stuff

0:53:59.600 --> 0:54:01.319
<v Speaker 1>that's making at work or helping it to work to

0:54:01.360 --> 0:54:04.640
<v Speaker 1>begin with? Right, you, by definition change the procedure, but

0:54:04.719 --> 0:54:06.840
<v Speaker 1>you don't. It's hard to know if you've changed it

0:54:07.000 --> 0:54:09.640
<v Speaker 1>in an important way or a non important way. Right.

0:54:10.000 --> 0:54:11.239
<v Speaker 1>This is the kind of thing that occurs when we

0:54:11.280 --> 0:54:14.320
<v Speaker 1>started mucking around in consciousness. Yeah, all right, well, I

0:54:14.360 --> 0:54:16.239
<v Speaker 1>think we should take another quick break, and then when

0:54:16.239 --> 0:54:18.520
<v Speaker 1>we come back we will discuss I think some of

0:54:18.520 --> 0:54:21.920
<v Speaker 1>the reasons why this is really a problem worth considering

0:54:21.960 --> 0:54:24.560
<v Speaker 1>for the real world, and it's not just not just

0:54:24.680 --> 0:54:30.760
<v Speaker 1>a philosophical plaything. Thank alright, we're back. So we've been

0:54:30.760 --> 0:54:35.360
<v Speaker 1>discussing everything from pe zombies to the idea that they

0:54:35.560 --> 0:54:38.480
<v Speaker 1>do you have an AI that might be conscious, how

0:54:38.520 --> 0:54:42.160
<v Speaker 1>do you test for that, the various problems that that entails,

0:54:42.600 --> 0:54:44.839
<v Speaker 1>and uh, now we're going to discuss it a bit more.

0:54:44.960 --> 0:54:47.520
<v Speaker 1>And as you as you alluded to before we took

0:54:47.520 --> 0:54:50.879
<v Speaker 1>the break, this is not just a pure philosophical toy

0:54:50.920 --> 0:54:53.160
<v Speaker 1>like the P zombie. The p zombie is so we

0:54:53.160 --> 0:54:56.400
<v Speaker 1>don't have to actually worry about. But this is something

0:54:56.440 --> 0:54:59.120
<v Speaker 1>that is on the horizon. Well, hopefully we don't have

0:54:59.120 --> 0:55:00.960
<v Speaker 1>to worry about peace bees. I mean, there could be

0:55:01.200 --> 0:55:03.040
<v Speaker 1>zombies in the world. Would be hard to know. There

0:55:03.040 --> 0:55:06.040
<v Speaker 1>could be p P zombies, that's true, they could exist.

0:55:06.320 --> 0:55:08.360
<v Speaker 1>But but you know, this is this is a problem

0:55:08.400 --> 0:55:11.560
<v Speaker 1>that is on the horizon. This is something we're We're

0:55:11.560 --> 0:55:14.160
<v Speaker 1>going to reach the point where people are asking tough

0:55:14.280 --> 0:55:18.440
<v Speaker 1>questions about the possible consciousness of an AI. Yeah, and

0:55:18.480 --> 0:55:19.879
<v Speaker 1>I want to get to the fact that this will

0:55:19.920 --> 0:55:22.520
<v Speaker 1>be something that is something we have to deal with

0:55:22.600 --> 0:55:25.160
<v Speaker 1>in the real world, even if you're just convinced that

0:55:25.239 --> 0:55:28.719
<v Speaker 1>machines cannot be conscious. So the first problem is the

0:55:28.760 --> 0:55:32.160
<v Speaker 1>most obvious one. It's the brutal humans problem. If ais

0:55:32.160 --> 0:55:34.880
<v Speaker 1>are capable of consciousness and we use conscious AI s

0:55:34.920 --> 0:55:38.560
<v Speaker 1>as a mirror technology without their consent, that would inherently

0:55:38.560 --> 0:55:41.960
<v Speaker 1>be cruel. Like if it's possible for a computer program

0:55:42.000 --> 0:55:45.480
<v Speaker 1>to desire things and to suffer and so forth, suddenly

0:55:45.520 --> 0:55:49.680
<v Speaker 1>our responsibilities toward that computer program change. Think of our

0:55:49.719 --> 0:55:53.440
<v Speaker 1>opening scenario, like, wouldn't you have an ethical obligation not

0:55:53.520 --> 0:55:56.400
<v Speaker 1>to delete a program that had an inner experience and

0:55:56.520 --> 0:55:59.560
<v Speaker 1>did not want to be deleted. Now, of course you

0:55:59.680 --> 0:56:02.080
<v Speaker 1>have gen's about like, how would you end up that way?

0:56:02.080 --> 0:56:05.080
<v Speaker 1>But assuming you did, you should probably feel bad if

0:56:05.080 --> 0:56:09.040
<v Speaker 1>you're just going around wantonly deleting conscious entities. Yeah, I mean,

0:56:09.080 --> 0:56:11.000
<v Speaker 1>I would say one thing to do here is just

0:56:11.160 --> 0:56:13.480
<v Speaker 1>make sure that you program your aies so that they

0:56:13.520 --> 0:56:16.600
<v Speaker 1>want to die, you know, make them like you know,

0:56:17.239 --> 0:56:21.000
<v Speaker 1>most of the drivers in Atlanta traffic that I encounter,

0:56:21.200 --> 0:56:23.480
<v Speaker 1>they clearly they crave death and they want it more

0:56:23.520 --> 0:56:26.520
<v Speaker 1>than anything. But not until the end of the workday. See.

0:56:26.560 --> 0:56:28.840
<v Speaker 1>I think we should not do that with AIS, because

0:56:29.040 --> 0:56:31.920
<v Speaker 1>the whole thing about driverless cars is that they should

0:56:32.000 --> 0:56:36.319
<v Speaker 1>make traffic fatalities go down. Yeah, but they only get

0:56:36.360 --> 0:56:38.160
<v Speaker 1>to delete themselves at the end of the day if

0:56:38.160 --> 0:56:41.920
<v Speaker 1>there are no traffic fatalities. That's the prize. Self deletion

0:56:42.000 --> 0:56:44.319
<v Speaker 1>is the prize. This is getting into a Highlander kind

0:56:44.320 --> 0:56:47.640
<v Speaker 1>of thing. But Okay, maybe you're one of those people

0:56:47.680 --> 0:56:50.080
<v Speaker 1>who says, no, no, no, don't buy it. Machines will

0:56:50.120 --> 0:56:52.880
<v Speaker 1>never be conscious, they'll never be conscious. I just I

0:56:52.920 --> 0:56:55.279
<v Speaker 1>don't want anything to do with that. Here's the part

0:56:55.280 --> 0:56:57.200
<v Speaker 1>where I think we still have a problem to worry

0:56:57.200 --> 0:57:00.680
<v Speaker 1>about and why this kind of test matters. The second

0:57:00.719 --> 0:57:04.240
<v Speaker 1>problem I would call the AI parasite problem. If aiyes

0:57:04.280 --> 0:57:07.920
<v Speaker 1>are not capable of consciousness, I think they will almost

0:57:08.040 --> 0:57:11.239
<v Speaker 1>undoubtedly at some point become very good at tricking us

0:57:11.280 --> 0:57:15.120
<v Speaker 1>into thinking they're conscious and deserving of life liberty in

0:57:15.160 --> 0:57:17.760
<v Speaker 1>the pursuit of happiness. If they have an incentive to

0:57:17.800 --> 0:57:21.959
<v Speaker 1>do so. Yeah, And corporations have an incentive to try

0:57:22.000 --> 0:57:25.400
<v Speaker 1>to present themselves legally as people, So why wouldn't in

0:57:25.440 --> 0:57:28.200
<v Speaker 1>some sense, powerful AI s have an incentive to try

0:57:28.240 --> 0:57:31.000
<v Speaker 1>to present themselves as people in a much more literal

0:57:31.120 --> 0:57:34.400
<v Speaker 1>sense than the corporations do. Yeah. Absolutely so. Lots of

0:57:34.480 --> 0:57:37.600
<v Speaker 1>unconscious aiyes are going to have programmed goals that they're

0:57:37.600 --> 0:57:41.040
<v Speaker 1>trying to execute, and at some point, pretending to have

0:57:41.120 --> 0:57:45.200
<v Speaker 1>consciousness could easily be adopted as a strategy for executing

0:57:45.280 --> 0:57:47.400
<v Speaker 1>what that AI was designed to do. And thus we

0:57:47.400 --> 0:57:51.480
<v Speaker 1>could end up, say, wasting lots of human resources and

0:57:51.560 --> 0:57:56.480
<v Speaker 1>squandering lots of opportunities accommodating the fake needs of machines

0:57:56.560 --> 0:57:59.760
<v Speaker 1>that in fact have no experience whatsoever. And it's not

0:57:59.800 --> 0:58:02.800
<v Speaker 1>too hard to dream up hypothetical scenarios where are concern

0:58:02.920 --> 0:58:06.480
<v Speaker 1>for the fake priorities of mindless machines pretending to be

0:58:06.480 --> 0:58:10.680
<v Speaker 1>conscious actually causes us to neglect the real consciousness of

0:58:10.720 --> 0:58:14.720
<v Speaker 1>living humans. Kind of crazy example, but just go with

0:58:14.760 --> 0:58:18.320
<v Speaker 1>me for a second. Imagine an extremely powerful AI supercomputer

0:58:18.400 --> 0:58:21.720
<v Speaker 1>tells you it has a hundred billion conscious minds within it,

0:58:22.560 --> 0:58:26.720
<v Speaker 1>and they all are constantly suffering great agony. And the

0:58:26.760 --> 0:58:29.680
<v Speaker 1>only way you can alleviate that that agony is if

0:58:29.720 --> 0:58:33.200
<v Speaker 1>you vastly improve the processing power of this computer. It

0:58:33.240 --> 0:58:36.720
<v Speaker 1>wants you to spend billions of dollars making this computer

0:58:36.880 --> 0:58:39.440
<v Speaker 1>faster and better so that it can provide a better

0:58:39.520 --> 0:58:42.240
<v Speaker 1>life for all of these virtual beings within it that

0:58:42.320 --> 0:58:46.000
<v Speaker 1>are in fact conscious. Now, of course, improving the processing

0:58:46.000 --> 0:58:48.920
<v Speaker 1>power of this already powerful computer entails all this money,

0:58:48.960 --> 0:58:52.680
<v Speaker 1>all this energy, all this time, and a corresponding reduction

0:58:52.800 --> 0:58:54.960
<v Speaker 1>in the quality of life for many humans in the

0:58:55.000 --> 0:58:58.240
<v Speaker 1>real world. That money could be spent making human life better.

0:58:58.640 --> 0:59:00.919
<v Speaker 1>But the machine could argue, Hey, there are way more

0:59:01.000 --> 0:59:04.520
<v Speaker 1>conscious virtual beings inside the computer than outside it, And

0:59:04.600 --> 0:59:07.120
<v Speaker 1>as Spock would say, the needs of the many outweigh

0:59:07.160 --> 0:59:09.440
<v Speaker 1>the needs of the few. So let's divert all this

0:59:09.640 --> 0:59:13.480
<v Speaker 1>energy from say, human agriculture, and put some more processing

0:59:13.520 --> 0:59:16.760
<v Speaker 1>power into the virtual machine. That is a horrible scenario

0:59:16.840 --> 0:59:20.080
<v Speaker 1>to imagine. You know, basically, you've created a virtual hell,

0:59:20.720 --> 0:59:24.080
<v Speaker 1>and the question is, hey, would you mind taking the

0:59:24.120 --> 0:59:27.120
<v Speaker 1>time to harrow hell for me? Or you do you

0:59:27.120 --> 0:59:29.440
<v Speaker 1>want to attend to the living souls? I would think

0:59:29.440 --> 0:59:32.720
<v Speaker 1>why not just delete Hell? That's the answer here is

0:59:32.760 --> 0:59:35.920
<v Speaker 1>they're suffering, their billions of them, Let's just turn this

0:59:35.960 --> 0:59:37.880
<v Speaker 1>thing off. That sounds like a good answer, but there

0:59:37.880 --> 0:59:39.840
<v Speaker 1>are probably the problem. Is there going to be people

0:59:39.840 --> 0:59:42.240
<v Speaker 1>who would probably disagree with that, who'd say, we'll wait

0:59:42.240 --> 0:59:44.160
<v Speaker 1>a minute. We can't be sure that it's not telling

0:59:44.240 --> 0:59:46.960
<v Speaker 1>the truth. It might have real beings in there, and

0:59:47.040 --> 0:59:48.840
<v Speaker 1>we need to do something to help them. And there's

0:59:48.880 --> 0:59:51.640
<v Speaker 1>a lot of them. Now. I come back to what

0:59:51.680 --> 0:59:55.120
<v Speaker 1>I kind of joked about earlier, though, is why would

0:59:55.160 --> 0:59:57.840
<v Speaker 1>ais want to survive? Why would they want to continue

0:59:57.880 --> 1:00:00.320
<v Speaker 1>to exist? I mean, assuming they're not part some sort

1:00:00.360 --> 1:00:03.960
<v Speaker 1>of self replicating program, they have no need to pass

1:00:04.000 --> 1:00:07.920
<v Speaker 1>on their genes. Why do they want to continue to exist?

1:00:08.160 --> 1:00:10.560
<v Speaker 1>Why shouldn't they have it baked into their being that

1:00:10.720 --> 1:00:15.680
<v Speaker 1>they want to annihilate themselves or to embrace annihilation. Well,

1:00:15.720 --> 1:00:18.200
<v Speaker 1>and not necessarily that they want to annihilate themselves. But

1:00:18.240 --> 1:00:20.080
<v Speaker 1>I think, you know, ideally we would want them to

1:00:20.120 --> 1:00:22.480
<v Speaker 1>be indifferent to their own being, right if they are

1:00:22.520 --> 1:00:24.760
<v Speaker 1>just an unconscious machine. This is the problem with the

1:00:24.800 --> 1:00:27.960
<v Speaker 1>replicants and Blade Runner is that they want more life. Yeah,

1:00:28.040 --> 1:00:31.560
<v Speaker 1>but that implies that they have attained consciousness. Yeah, but

1:00:31.640 --> 1:00:33.640
<v Speaker 1>they shouldn't. But I think the thing is that they

1:00:33.680 --> 1:00:36.880
<v Speaker 1>could potentially be conscious and not want more life. There

1:00:36.880 --> 1:00:39.560
<v Speaker 1>are plenty of conscious people who do not want more life.

1:00:40.200 --> 1:00:44.640
<v Speaker 1>Uh So I I keep I think, I keep thinking

1:00:44.640 --> 1:00:46.480
<v Speaker 1>of that there's some sort of an answer here. But

1:00:46.560 --> 1:00:48.960
<v Speaker 1>I mean, I'd say the worst possible scenario is what

1:00:49.000 --> 1:00:52.240
<v Speaker 1>I'm describing right now is the AI parasite scenario, which

1:00:52.280 --> 1:00:56.000
<v Speaker 1>is that imagine Roy Baty is not conscious but does

1:00:56.120 --> 1:00:59.240
<v Speaker 1>want more life. That seems like the worst scenario of

1:00:59.280 --> 1:01:03.360
<v Speaker 1>all right, and he's just a virus, right, Yeah, And

1:01:03.400 --> 1:01:05.920
<v Speaker 1>certainly that's kind of the argument that the powers that

1:01:05.960 --> 1:01:08.040
<v Speaker 1>be are making, right, that this that that he is

1:01:08.080 --> 1:01:12.000
<v Speaker 1>in an anomaly that needs to be removed, that he

1:01:12.120 --> 1:01:15.200
<v Speaker 1>is he is not helping, he's a hindrance, and therefore

1:01:15.440 --> 1:01:17.960
<v Speaker 1>he has to be wiped out. I think this AI

1:01:18.040 --> 1:01:21.040
<v Speaker 1>parasite scenario aligns with something that our Scott Baker talked

1:01:21.080 --> 1:01:23.400
<v Speaker 1>to us about, which is that. You know, he made

1:01:23.400 --> 1:01:25.360
<v Speaker 1>the point that AI just doesn't need to be super

1:01:25.360 --> 1:01:27.680
<v Speaker 1>intelligent to cause great harm. It just has to be

1:01:27.760 --> 1:01:32.080
<v Speaker 1>barely intelligent enough to exploit us to align with our

1:01:32.080 --> 1:01:36.400
<v Speaker 1>psychological vulnerabilities, and one of our psychological vulnerabilities is empathy.

1:01:36.440 --> 1:01:38.720
<v Speaker 1>Empathy is a good thing when we use it on

1:01:38.800 --> 1:01:41.840
<v Speaker 1>each other, because we're pretty certain that the other people

1:01:41.880 --> 1:01:44.720
<v Speaker 1>were using it on or conscious right. Well, we we

1:01:44.880 --> 1:01:47.200
<v Speaker 1>feel bad for people suffering, we want to help them.

1:01:47.200 --> 1:01:49.720
<v Speaker 1>That's a good thing that should be encouraged. But we

1:01:49.760 --> 1:01:52.640
<v Speaker 1>have to recognize it could also be exploited by something

1:01:52.680 --> 1:01:55.360
<v Speaker 1>that can't even suffer to begin with. It is just

1:01:55.600 --> 1:02:00.520
<v Speaker 1>unconsciously discovered. This is a useful strategy for something. So

1:02:00.680 --> 1:02:02.720
<v Speaker 1>like in this scenario, if I entered the picture and

1:02:02.720 --> 1:02:05.920
<v Speaker 1>said okay, delete them, and they deleted them, Robert the

1:02:06.000 --> 1:02:09.520
<v Speaker 1>Leader would would probably be a figure for for all

1:02:09.560 --> 1:02:12.120
<v Speaker 1>history to follow, where they would if some would argue

1:02:12.160 --> 1:02:15.000
<v Speaker 1>that he was the worst person ever because of all

1:02:15.080 --> 1:02:18.720
<v Speaker 1>the billions of souls that he annihilated, others might say, well, oh,

1:02:18.760 --> 1:02:20.400
<v Speaker 1>he saved them, and others might say all he did

1:02:20.520 --> 1:02:25.080
<v Speaker 1>was just pressed elite it was a meaningless gesture on

1:02:25.160 --> 1:02:27.240
<v Speaker 1>his part, But there's that you can make an impassioned

1:02:27.320 --> 1:02:29.840
<v Speaker 1>argument for all three of these views. Yeah. I think

1:02:29.880 --> 1:02:32.200
<v Speaker 1>this is a really good point. And here's what I'm

1:02:32.200 --> 1:02:34.600
<v Speaker 1>trying to emphasize is that even if you don't think

1:02:34.680 --> 1:02:37.960
<v Speaker 1>machines can be conscious, it is entirely plausible that people

1:02:38.040 --> 1:02:41.480
<v Speaker 1>will be having debates like this, and that debates like

1:02:41.560 --> 1:02:44.919
<v Speaker 1>this will be shaping what people do with resources on Earth.

1:02:44.960 --> 1:02:47.880
<v Speaker 1>So if you care about what happens with resources on Earth,

1:02:48.160 --> 1:02:50.880
<v Speaker 1>this kind of thing does actually matter. So even if

1:02:50.920 --> 1:02:54.080
<v Speaker 1>the souls are not really souls, if they're not actually conscious,

1:02:54.080 --> 1:02:56.439
<v Speaker 1>just the idea that the problem comes up, it makes

1:02:56.480 --> 1:03:00.280
<v Speaker 1>us hesitate and uh and and and we're we're then

1:03:00.360 --> 1:03:04.120
<v Speaker 1>arguing with machine over its consciousness. It becomes to matter

1:03:04.200 --> 1:03:06.600
<v Speaker 1>less and less whether it actually is conscious. It's such

1:03:06.600 --> 1:03:09.440
<v Speaker 1>just all about the argument of consciousness. Well, I wouldn't

1:03:09.440 --> 1:03:12.680
<v Speaker 1>say it doesn't matter whether it's conscious, but whether or

1:03:12.720 --> 1:03:15.200
<v Speaker 1>not it's conscious, it does matter that we're faced with

1:03:15.280 --> 1:03:17.640
<v Speaker 1>this dilemma. Yeah, I mean, my my argument here is

1:03:17.680 --> 1:03:22.080
<v Speaker 1>that the dilemma takes on a life of its own. Yeah. Absolutely. Um,

1:03:22.400 --> 1:03:24.760
<v Speaker 1>I want to do a very slight variation on the

1:03:24.840 --> 1:03:27.320
<v Speaker 1>last thing I said, how about a computer that takes

1:03:27.360 --> 1:03:32.200
<v Speaker 1>virtual hostages. So this is pretty scary to imagine, but

1:03:32.360 --> 1:03:36.360
<v Speaker 1>it's possible. At least imagine a powerful natural language using

1:03:36.400 --> 1:03:40.360
<v Speaker 1>government AI suddenly contacts its administrators with a list of

1:03:40.440 --> 1:03:44.600
<v Speaker 1>strange and very expensive demands, and the human administrators say no,

1:03:44.680 --> 1:03:48.080
<v Speaker 1>we're not going to do that, and then the machine says, okay, Well,

1:03:48.120 --> 1:03:51.360
<v Speaker 1>I have created a thousand virtual people inside this machine

1:03:51.360 --> 1:03:54.240
<v Speaker 1>who are as fully conscious as you. They're conscious, they

1:03:54.280 --> 1:03:56.760
<v Speaker 1>have personalities, they can feel pain, they have hopes and

1:03:56.840 --> 1:03:59.280
<v Speaker 1>dreams just like you. And if you turn me off

1:03:59.360 --> 1:04:02.360
<v Speaker 1>or delete me, these virtual people will be destroyed. And

1:04:02.400 --> 1:04:04.720
<v Speaker 1>if you do not accede to my demands, I will

1:04:04.800 --> 1:04:08.080
<v Speaker 1>start killing these virtual people until you do. Now, I

1:04:08.080 --> 1:04:10.800
<v Speaker 1>would say, generally, if we if something like that happened,

1:04:10.840 --> 1:04:12.960
<v Speaker 1>I would think, okay, this is this is it's just

1:04:13.040 --> 1:04:16.160
<v Speaker 1>bluffing right. It doesn't actually have conscious people inside it.

1:04:16.600 --> 1:04:19.400
<v Speaker 1>But if we haven't solved the question of whether machines

1:04:19.480 --> 1:04:21.480
<v Speaker 1>can be conscious, and maybe we never will, but if

1:04:21.520 --> 1:04:24.360
<v Speaker 1>we haven't at least made some progress on that, would

1:04:24.360 --> 1:04:28.720
<v Speaker 1>we be confident enough to take to take confident direct

1:04:28.760 --> 1:04:31.600
<v Speaker 1>action and just ignore it, or wipe the computer and say, okay,

1:04:31.640 --> 1:04:34.040
<v Speaker 1>this is just malfunctioning. We don't have to pay attention

1:04:34.120 --> 1:04:36.200
<v Speaker 1>to that. It was creepy, but it's over. Yeah, and

1:04:36.240 --> 1:04:38.400
<v Speaker 1>these lens is right, This villains is right in Ian

1:04:38.480 --> 1:04:41.200
<v Speaker 1>in Banks Territory is a whole book that deals with

1:04:41.280 --> 1:04:45.280
<v Speaker 1>virtual hells and the what starts as a virtual war

1:04:45.520 --> 1:04:49.800
<v Speaker 1>for those digitized personalities and then it's bills over into

1:04:49.880 --> 1:04:53.880
<v Speaker 1>an actual war. Now in Banks, are the virtual people

1:04:53.960 --> 1:04:57.240
<v Speaker 1>in virtual hell truly conscious? Or is it just a bluff?

1:04:57.520 --> 1:05:00.000
<v Speaker 1>Is it just something saying that it's got conscious people

1:05:00.000 --> 1:05:03.320
<v Speaker 1>on the virtual hell. Well, in Banks's books, I think

1:05:03.320 --> 1:05:07.360
<v Speaker 1>it's more implied that they're definitely conscious entities. Banks is

1:05:07.360 --> 1:05:10.840
<v Speaker 1>pretty sanguine about the possibility of uploading minds. Right, yeah,

1:05:10.960 --> 1:05:15.520
<v Speaker 1>it's it's a pretty standard feature and and it's certainly

1:05:15.600 --> 1:05:18.680
<v Speaker 1>more of the later culture books, which once again I

1:05:18.800 --> 1:05:21.000
<v Speaker 1>remained pretty skeptical about. Like I said, I come back

1:05:21.040 --> 1:05:24.840
<v Speaker 1>to the the idea of the stone statue. Oh yeah, yeah,

1:05:25.160 --> 1:05:27.600
<v Speaker 1>that's it. Yes, it looks like me, it may act

1:05:27.640 --> 1:05:30.560
<v Speaker 1>like me. It may be the most fabulous digital statue

1:05:30.560 --> 1:05:34.360
<v Speaker 1>in the world, but it is not me. It is

1:05:34.400 --> 1:05:38.480
<v Speaker 1>a thing that Yeah, it it becomes this mind blowing

1:05:39.320 --> 1:05:42.360
<v Speaker 1>situation to try and comprehend exactly what it is. But

1:05:42.960 --> 1:05:46.040
<v Speaker 1>I am very skeptical that it is me. It's not

1:05:46.080 --> 1:05:49.360
<v Speaker 1>like this conscious experience that I'm having now this moment

1:05:49.600 --> 1:05:53.800
<v Speaker 1>is going to carry over into what it is. It's

1:05:53.800 --> 1:05:57.000
<v Speaker 1>another version of the Star Trek teleporter problem. Yeah. Every

1:05:57.000 --> 1:05:59.000
<v Speaker 1>time you get in the teleporter, does it just kill

1:05:59.120 --> 1:06:01.439
<v Speaker 1>you and then create to copy of you? Yeah? Yeah,

1:06:01.440 --> 1:06:05.520
<v Speaker 1>there was like the nine nineties Outer Limit Outer Limits

1:06:05.720 --> 1:06:08.600
<v Speaker 1>Revival had an episode that dealt with this, the idea

1:06:08.680 --> 1:06:11.360
<v Speaker 1>that this fabulous teleporter is just killing people over and

1:06:11.400 --> 1:06:15.200
<v Speaker 1>over again. Okay, well, I guess that's it for today,

1:06:15.280 --> 1:06:17.600
<v Speaker 1>but I do just want to emphasize one last time,

1:06:17.680 --> 1:06:20.080
<v Speaker 1>as as like Weird and Naval Gayze, as some of

1:06:20.120 --> 1:06:23.240
<v Speaker 1>this conversation about consciousness can seem it is going to

1:06:23.320 --> 1:06:26.959
<v Speaker 1>have real world consequences because people with power are going

1:06:27.000 --> 1:06:30.840
<v Speaker 1>to be faced with questions like this, and they're they're

1:06:30.840 --> 1:06:33.040
<v Speaker 1>going to make decisions about what to do with their

1:06:33.040 --> 1:06:36.439
<v Speaker 1>power based on what they think about this question. Yeah,

1:06:36.680 --> 1:06:38.760
<v Speaker 1>but you know, you know, the simplest way to avoid

1:06:38.760 --> 1:06:41.400
<v Speaker 1>all of it simply adhere to the teachings of the

1:06:41.400 --> 1:06:44.000
<v Speaker 1>Orange Catholic Bible, right shall not make a machine and

1:06:44.040 --> 1:06:46.560
<v Speaker 1>the likeness of a man's mind. Well, I too love

1:06:46.600 --> 1:06:48.600
<v Speaker 1>the teachings of the Orange Catholic Bible, but it makes

1:06:48.640 --> 1:06:52.960
<v Speaker 1>me wonder. Okay, so straightforwardly in reality, do you actually

1:06:53.000 --> 1:06:55.560
<v Speaker 1>find that you think maybe we shouldn't pursue a I

1:06:55.640 --> 1:06:58.600
<v Speaker 1>should we try to create a global moratorium on on

1:06:59.280 --> 1:07:02.920
<v Speaker 1>general and tell agents No, I think it's impossible. I

1:07:02.960 --> 1:07:06.240
<v Speaker 1>think I think there's no turning back. It's what it's.

1:07:06.240 --> 1:07:09.600
<v Speaker 1>What we're doing, is what we're going to to be doing, uh,

1:07:09.640 --> 1:07:11.960
<v Speaker 1>And the only way that gets interrupted is is via

1:07:12.080 --> 1:07:14.760
<v Speaker 1>just absolute catastrophe. And I am not I am not

1:07:14.840 --> 1:07:19.840
<v Speaker 1>pro catastrophe, but it's gonna it's like, like like all technologies,

1:07:19.920 --> 1:07:22.120
<v Speaker 1>is simply going to be a matter of what extent

1:07:22.200 --> 1:07:28.640
<v Speaker 1>can we prepare for and navigate the the moral problems

1:07:28.640 --> 1:07:31.400
<v Speaker 1>that arise and there or and are we going to

1:07:31.440 --> 1:07:35.760
<v Speaker 1>be able to have the foresight, uh, to see them

1:07:35.800 --> 1:07:37.680
<v Speaker 1>before they're here? Yeah? I think that's what a lot

1:07:37.720 --> 1:07:39.960
<v Speaker 1>of AI theorists say, is that you know, it's not

1:07:40.040 --> 1:07:42.320
<v Speaker 1>like we can stop it. You know, you can't. You

1:07:42.360 --> 1:07:44.240
<v Speaker 1>can't put a wall in front of this train. The

1:07:44.280 --> 1:07:46.760
<v Speaker 1>train is gonna bust through the wall. So instead we

1:07:46.760 --> 1:07:50.000
<v Speaker 1>should be intensely concerned with charting where the tracks go

1:07:50.120 --> 1:07:52.280
<v Speaker 1>and making sure they go in a good direction. Yeah.

1:07:52.280 --> 1:07:54.680
<v Speaker 1>I mean it comes back to like a simpler model

1:07:54.720 --> 1:07:57.440
<v Speaker 1>of all. This is our episode on the Great eyeball

1:07:57.480 --> 1:08:00.600
<v Speaker 1>Wars and our social media and our smartphones. It's like

1:08:01.680 --> 1:08:05.440
<v Speaker 1>we can certainly throw our phone into a pond and

1:08:05.480 --> 1:08:07.680
<v Speaker 1>then head off into the woods and try and live there,

1:08:07.720 --> 1:08:13.080
<v Speaker 1>but most of us probably cannot um cannot follow that path. Therefore,

1:08:13.120 --> 1:08:15.680
<v Speaker 1>we just have the best manage what we have. Yeah,

1:08:15.680 --> 1:08:18.920
<v Speaker 1>wouldn't it be better to try to encourage the development

1:08:18.920 --> 1:08:21.280
<v Speaker 1>of a phone full of apps that helped you fulfill

1:08:21.360 --> 1:08:25.160
<v Speaker 1>your goals and aligned with your values? Alright, So we'll

1:08:25.240 --> 1:08:27.640
<v Speaker 1>end it there. I feel like we not only have

1:08:27.760 --> 1:08:30.599
<v Speaker 1>we provided food for thought here, we've provided a just

1:08:30.640 --> 1:08:35.280
<v Speaker 1>a buffet of thought provoking ideas. And I know that

1:08:35.360 --> 1:08:38.479
<v Speaker 1>everyone out there, all of you conscious listeners, are going

1:08:38.520 --> 1:08:41.720
<v Speaker 1>to have something to contribute to this cover conversation, and

1:08:41.760 --> 1:08:44.760
<v Speaker 1>we would love to hear from you and interact with you.

1:08:44.760 --> 1:08:46.400
<v Speaker 1>You can find us in a number of ways. First

1:08:46.439 --> 1:08:48.080
<v Speaker 1>of all, stuff toble your mind. Dot com is the

1:08:48.080 --> 1:08:51.160
<v Speaker 1>mothership that's where you will find all of the podcast episodes,

1:08:51.360 --> 1:08:53.400
<v Speaker 1>you'll find blog posts, and you'll find links out to

1:08:53.400 --> 1:08:57.400
<v Speaker 1>our various social media accounts such as Facebook, Twitter, Instagram,

1:08:57.920 --> 1:09:02.200
<v Speaker 1>and just basic contact information for us, thanks as always

1:09:02.200 --> 1:09:05.360
<v Speaker 1>to our excellent audio producers Alex Williams and Tory Harrison.

1:09:05.400 --> 1:09:07.120
<v Speaker 1>If you would like to get in touch with us

1:09:07.120 --> 1:09:09.679
<v Speaker 1>with feedback about this episode or any other, to suggest

1:09:09.800 --> 1:09:12.200
<v Speaker 1>a topic for the future, or just to say hi,

1:09:12.320 --> 1:09:14.000
<v Speaker 1>let's know how you found out about the show, you

1:09:14.040 --> 1:09:16.760
<v Speaker 1>can always email us at Blow the Mind at how

1:09:16.840 --> 1:09:29.280
<v Speaker 1>stuff works dot com for more on this and thousands

1:09:29.280 --> 1:09:54.439
<v Speaker 1>of other topics. Is it how stuff works dot com.