1
00:00:04,240 --> 00:00:07,240
Speaker 1: Welcome to tech Stuff, a production of I Heart Radios

2
00:00:07,320 --> 00:00:14,120
Speaker 1: How Stuff Works. Hey there, and welcome to tech Stuff.

3
00:00:14,200 --> 00:00:16,880
Speaker 1: I'm your host, Jonathan Strickland. I'm an executive producer with

4
00:00:16,960 --> 00:00:19,800
Speaker 1: iHeart Radio and I love all things tech, and we're

5
00:00:19,800 --> 00:00:23,239
Speaker 1: going to enjoy another classic episode of tech stuff in

6
00:00:23,239 --> 00:00:26,920
Speaker 1: this episode. And uh, I promised new ones are right

7
00:00:26,920 --> 00:00:29,360
Speaker 1: around the corner. I've got a cool one coming up

8
00:00:29,400 --> 00:00:32,159
Speaker 1: in just a little while that you definitely want to

9
00:00:32,240 --> 00:00:37,160
Speaker 1: check out. Very important, all about the dangers of browsing

10
00:00:37,159 --> 00:00:40,519
Speaker 1: the Internet in an insecure way. But before we get

11
00:00:40,520 --> 00:00:43,640
Speaker 1: to that, I thought maybe we could revisit this classic

12
00:00:43,680 --> 00:00:48,160
Speaker 1: episode in which I talk about augmented reality. So this

13
00:00:48,240 --> 00:00:52,080
Speaker 1: episode is titled Augmenting Your Reality, and it originally aired

14
00:00:52,120 --> 00:00:54,400
Speaker 1: just a couple of years ago, and I thought it'd

15
00:00:54,440 --> 00:00:56,800
Speaker 1: be fun to revisit it. So let's sit back and

16
00:00:56,920 --> 00:01:01,480
Speaker 1: enjoy this classic episode. So I thought I would do

17
00:01:01,800 --> 00:01:06,920
Speaker 1: a deeper dive, a bigger explanation about what augmented reality is,

18
00:01:06,959 --> 00:01:09,720
Speaker 1: what it's all about, how it works, and sort of

19
00:01:09,760 --> 00:01:15,560
Speaker 1: the applications we might put a r toward things that

20
00:01:15,720 --> 00:01:18,440
Speaker 1: you know, was it good for tons of stuff? As

21
00:01:18,440 --> 00:01:22,000
Speaker 1: it turns out, So the first thing we should do

22
00:01:22,600 --> 00:01:26,520
Speaker 1: is probably defined some terms, because if you haven't really

23
00:01:26,520 --> 00:01:30,080
Speaker 1: looked into augmented reality and you aren't familiar with a R,

24
00:01:30,520 --> 00:01:33,680
Speaker 1: you might just be lost. I'm gonna define it all

25
00:01:33,720 --> 00:01:36,320
Speaker 1: for you right now, because that's the kind of stand

26
00:01:36,400 --> 00:01:41,000
Speaker 1: up guy I am. Technically speaking, augmented reality is using

27
00:01:41,040 --> 00:01:45,840
Speaker 1: digital information to enhance or augment and experience in our

28
00:01:45,880 --> 00:01:51,000
Speaker 1: physical real world. So the way we usually see this

29
00:01:51,160 --> 00:01:56,120
Speaker 1: implemented involves some sort of display that has an image

30
00:01:56,120 --> 00:01:58,800
Speaker 1: of the real world on it and it overlays digital

31
00:01:58,840 --> 00:02:01,360
Speaker 1: information on top of that itch. So think of like

32
00:02:01,880 --> 00:02:06,160
Speaker 1: a camera's viewfinder, like an LCD screen on a camera,

33
00:02:06,280 --> 00:02:09,480
Speaker 1: and it actually labels the buildings that are in view.

34
00:02:09,520 --> 00:02:11,400
Speaker 1: When you're out on the street and you hold the

35
00:02:11,440 --> 00:02:15,760
Speaker 1: camera up or a smartphone or even a wearable device

36
00:02:15,840 --> 00:02:18,840
Speaker 1: like a head mounted display that you can look through

37
00:02:19,040 --> 00:02:21,120
Speaker 1: so you can see the real world, you're not just

38
00:02:21,160 --> 00:02:23,840
Speaker 1: staring at a screen, or if you are staring at

39
00:02:23,880 --> 00:02:26,720
Speaker 1: a screen, you're staring at a video feed that is

40
00:02:26,760 --> 00:02:29,560
Speaker 1: provided by an external camera amounted just on the other

41
00:02:29,600 --> 00:02:31,800
Speaker 1: side of the screen. So it's like you're looking through

42
00:02:32,120 --> 00:02:34,840
Speaker 1: a display in the first place, but then on top

43
00:02:34,960 --> 00:02:38,760
Speaker 1: of that view you have this digital information. That's the

44
00:02:38,800 --> 00:02:41,600
Speaker 1: most common implementation we talked about, but it's not the

45
00:02:41,639 --> 00:02:44,560
Speaker 1: only one. Augmented reality does not have to only be

46
00:02:44,880 --> 00:02:49,600
Speaker 1: or even involve visual information at all. You could have

47
00:02:49,720 --> 00:02:54,000
Speaker 1: audio only augmented reality, for example. But the whole idea

48
00:02:54,160 --> 00:02:58,519
Speaker 1: is that it's something that's created digitally to enhance your

49
00:02:58,720 --> 00:03:01,799
Speaker 1: experience in the real world. Now we can contrast this

50
00:03:02,320 --> 00:03:07,079
Speaker 1: with the concept of virtual reality. Virtual reality, of course,

51
00:03:07,680 --> 00:03:11,480
Speaker 1: is a term where you create an experience completely through

52
00:03:11,800 --> 00:03:16,240
Speaker 1: computer generated means computer is making all the things you

53
00:03:16,280 --> 00:03:20,280
Speaker 1: see and here, and maybe even beyond that if you

54
00:03:20,360 --> 00:03:23,960
Speaker 1: have really sophisticated UH setups, so you might have some

55
00:03:24,040 --> 00:03:27,400
Speaker 1: haptic feedback. Haptic refers to your sense of touch, So

56
00:03:27,440 --> 00:03:30,480
Speaker 1: if you have haptic feedback, that means you're getting information

57
00:03:30,520 --> 00:03:34,000
Speaker 1: feedback through your sense of touch. Common example of this

58
00:03:34,520 --> 00:03:38,280
Speaker 1: is a rumble pack inside a game controller, where you

59
00:03:38,320 --> 00:03:40,440
Speaker 1: know you fire a gun and a first person shooter

60
00:03:40,880 --> 00:03:44,800
Speaker 1: and your controller rumbles as a result, letting you know

61
00:03:44,920 --> 00:03:50,640
Speaker 1: that you are in fact, unleashing virtual destruction upon all

62
00:03:50,720 --> 00:03:54,240
Speaker 1: you survey. Well, the same thing can be true with

63
00:03:54,800 --> 00:03:58,680
Speaker 1: virtual reality set up. So virtual reality is all about

64
00:03:58,720 --> 00:04:04,480
Speaker 1: constructing an artificial reality a simulated reality. Augmented reality is

65
00:04:04,520 --> 00:04:07,680
Speaker 1: all about enhancing the one that we are actually in.

66
00:04:08,200 --> 00:04:13,160
Speaker 1: And then there's also mixed reality. Mixed reality is kind

67
00:04:13,160 --> 00:04:16,040
Speaker 1: of sort of in between the two. You might have

68
00:04:16,160 --> 00:04:21,240
Speaker 1: some physical objects within a room that are also mapped

69
00:04:21,279 --> 00:04:25,279
Speaker 1: to a virtual environment, and then you use something like

70
00:04:25,320 --> 00:04:28,880
Speaker 1: a head molded display to enter the virtual environment. That's

71
00:04:28,880 --> 00:04:32,159
Speaker 1: what looks like you're inside, but you have physical objects

72
00:04:32,160 --> 00:04:34,520
Speaker 1: in the room around you that are also mapped to

73
00:04:34,560 --> 00:04:37,040
Speaker 1: the virtual world, Meaning you could pick up this physical

74
00:04:37,080 --> 00:04:40,560
Speaker 1: object and you would see that reflected within the virtual world,

75
00:04:40,600 --> 00:04:43,480
Speaker 1: where you might pick up a sword and shield or

76
00:04:43,800 --> 00:04:48,320
Speaker 1: move a chair or something along those lines. So augmented reality,

77
00:04:48,400 --> 00:04:52,360
Speaker 1: virtual reality, and mixed reality are all kind of inter related,

78
00:04:52,680 --> 00:04:56,360
Speaker 1: so much so that their histories also are very much

79
00:04:56,440 --> 00:05:00,360
Speaker 1: inter related. And there's some people who try to elect

80
00:05:00,480 --> 00:05:05,080
Speaker 1: these different technologies, these different approaches and put them under

81
00:05:05,120 --> 00:05:08,120
Speaker 1: a common umbrella, and they tend to use the phrase

82
00:05:08,520 --> 00:05:12,880
Speaker 1: alternate reality, which is unfortunate because that's also a r

83
00:05:13,000 --> 00:05:15,960
Speaker 1: but alternate reality is kind of the umbrella for virtual,

84
00:05:16,240 --> 00:05:20,360
Speaker 1: augmented and mixed reality. Uh that that that kind of

85
00:05:20,400 --> 00:05:23,760
Speaker 1: gives you the definition of those basic terms, and it

86
00:05:23,839 --> 00:05:26,719
Speaker 1: is important to understand them because they're becoming more and

87
00:05:26,760 --> 00:05:30,839
Speaker 1: more important today. You are already probably aware of a

88
00:05:30,880 --> 00:05:33,760
Speaker 1: lot of VR headsets that are out there on the

89
00:05:33,800 --> 00:05:38,320
Speaker 1: market as well as VR uh Well, they're they're kind

90
00:05:38,320 --> 00:05:41,520
Speaker 1: of like cases that you slide your smartphone into, so

91
00:05:41,560 --> 00:05:46,599
Speaker 1: your smartphone becomes the actual display on a VR headset.

92
00:05:46,600 --> 00:05:50,000
Speaker 1: The headset itself is more or less just a head

93
00:05:50,080 --> 00:05:53,599
Speaker 1: mounted case for your phone. We've seen a lot of

94
00:05:53,600 --> 00:05:56,200
Speaker 1: those come out over the last few years. We've also

95
00:05:56,240 --> 00:05:59,359
Speaker 1: seen a lot of a R applications come out, typically

96
00:05:59,480 --> 00:06:03,039
Speaker 1: for things iPads and smartphones, but we've also seen some

97
00:06:03,080 --> 00:06:08,240
Speaker 1: hardware come out that for wearable devices that falls into

98
00:06:08,279 --> 00:06:11,040
Speaker 1: the augmented reality category, stuff like Google Glass, which i'll

99
00:06:11,040 --> 00:06:13,560
Speaker 1: talk about more a little bit later in this episode.

100
00:06:14,920 --> 00:06:19,640
Speaker 1: For augmented reality to work, to get this enhanced experience

101
00:06:19,760 --> 00:06:23,440
Speaker 1: of reality around you, there are a lot of technological

102
00:06:23,480 --> 00:06:27,880
Speaker 1: components that have to come together so that you actually

103
00:06:27,920 --> 00:06:31,960
Speaker 1: do get an experience that is meaningful. You know, you

104
00:06:31,960 --> 00:06:35,279
Speaker 1: you have to have technology that quote unquote knows where

105
00:06:35,320 --> 00:06:37,840
Speaker 1: you are and what you are looking at or what

106
00:06:37,920 --> 00:06:41,400
Speaker 1: you are close to in order to get that augmented experience.

107
00:06:41,760 --> 00:06:44,120
Speaker 1: It wouldn't do me any good. If I put on

108
00:06:44,440 --> 00:06:49,120
Speaker 1: an augmented reality headset, for example, and stared at let's

109
00:06:49,160 --> 00:06:53,680
Speaker 1: say a famous painting, and instead of getting information about

110
00:06:53,680 --> 00:06:56,600
Speaker 1: the famous painting, I see an exploded view of an

111
00:06:56,760 --> 00:07:00,080
Speaker 1: car engine, that would make no sense. So you have

112
00:07:00,120 --> 00:07:03,360
Speaker 1: to build in technologies in order for the a R

113
00:07:03,480 --> 00:07:07,120
Speaker 1: to understand what it is you're trying to do and

114
00:07:07,240 --> 00:07:10,560
Speaker 1: to augment that experience, which meant that we had to

115
00:07:10,600 --> 00:07:15,480
Speaker 1: wait a pretty good long time for the various technologies

116
00:07:16,080 --> 00:07:21,000
Speaker 1: that we used to to create this relationship to mature

117
00:07:21,200 --> 00:07:24,640
Speaker 1: to a point where it was possible. Sometimes we had

118
00:07:24,680 --> 00:07:26,760
Speaker 1: technologies that would allow us to do it, but it

119
00:07:26,920 --> 00:07:32,240
Speaker 1: required uh tethering headsets to very large computers, which meant

120
00:07:32,240 --> 00:07:35,600
Speaker 1: that you didn't have really any mobility, and uh it

121
00:07:35,720 --> 00:07:41,840
Speaker 1: really limited the usefulness of the actual application. In other cases,

122
00:07:42,600 --> 00:07:45,680
Speaker 1: you could say things like your head tracking technology was

123
00:07:45,720 --> 00:07:49,040
Speaker 1: absolutely necessary for a R to develop the way it did.

124
00:07:49,880 --> 00:07:54,000
Speaker 1: GPS technology as well. Remember it wasn't that long ago

125
00:07:54,520 --> 00:07:59,760
Speaker 1: that we ordinary mere mortals didn't have access to really

126
00:08:00,000 --> 00:08:04,880
Speaker 1: accurate GPS information. For a very long time, that was

127
00:08:04,960 --> 00:08:10,000
Speaker 1: purposefully made less accurate. It was a matter of national defense.

128
00:08:10,680 --> 00:08:13,400
Speaker 1: It wasn't until the nineties that you started to see

129
00:08:13,400 --> 00:08:19,600
Speaker 1: GPS become more accurate for the basic consumer. Wait, back

130
00:08:19,640 --> 00:08:22,840
Speaker 1: in the day, you might get accuracy of up to

131
00:08:22,920 --> 00:08:25,440
Speaker 1: around a hundred meters, which is not great if you're

132
00:08:25,480 --> 00:08:28,120
Speaker 1: looking for the next place to make your turn. If

133
00:08:28,200 --> 00:08:31,800
Speaker 1: it's a hundred meters away, that's that's pretty far. But

134
00:08:31,920 --> 00:08:34,160
Speaker 1: now it's within a few feet, so it's much better.

135
00:08:34,679 --> 00:08:36,880
Speaker 1: That sort of stuff all had to come together in

136
00:08:37,000 --> 00:08:42,640
Speaker 1: order for augmented reality to become a viable I almost

137
00:08:42,640 --> 00:08:45,800
Speaker 1: said a reality, but that just starts to sound redundant

138
00:08:46,720 --> 00:08:49,960
Speaker 1: at any rate. Let's talk about some of these technologies

139
00:08:50,240 --> 00:08:55,080
Speaker 1: we are We really need things like gyroscopes, accelerometers. These

140
00:08:55,120 --> 00:09:00,680
Speaker 1: help devices understand their orientation where they are in respect

141
00:09:00,760 --> 00:09:04,079
Speaker 1: to something else, like are they for a smartphone it

142
00:09:04,160 --> 00:09:06,280
Speaker 1: might be is it in landscape mode or portrait mode?

143
00:09:06,720 --> 00:09:10,679
Speaker 1: But for a head mounted display, it would help give

144
00:09:10,840 --> 00:09:13,680
Speaker 1: the the unit the information that needs to know which

145
00:09:13,679 --> 00:09:15,920
Speaker 1: way you're looking, like are you looking to the east

146
00:09:16,000 --> 00:09:19,520
Speaker 1: or to the west. That kind of thing. UH also

147
00:09:19,640 --> 00:09:24,760
Speaker 1: compasses obviously very important GPS sensors, image recognition software, but

148
00:09:24,800 --> 00:09:27,720
Speaker 1: has become really important so that when you are looking

149
00:09:27,880 --> 00:09:32,400
Speaker 1: at something UH, the system can actually identify what that is.

150
00:09:32,640 --> 00:09:35,319
Speaker 1: In some cases you can get around this. You can

151
00:09:35,360 --> 00:09:38,280
Speaker 1: design an a R system where let's say you make

152
00:09:38,320 --> 00:09:43,680
Speaker 1: a movie poster and the a R application has the

153
00:09:43,679 --> 00:09:46,840
Speaker 1: movie poster or animate in some way if you hold

154
00:09:46,960 --> 00:09:50,960
Speaker 1: up a smartphone that's running the appropriate app. So I'm

155
00:09:51,000 --> 00:09:54,360
Speaker 1: just gonna take a movie from my past that does

156
00:09:54,400 --> 00:09:57,360
Speaker 1: not have an a R movie poster or associated with it,

157
00:09:57,960 --> 00:09:59,880
Speaker 1: but one that I can talk about as if it.

158
00:10:00,000 --> 00:10:02,400
Speaker 1: We're a good example, and that has to be Big

159
00:10:02,440 --> 00:10:06,600
Speaker 1: Trouble in Little China, universally declared the best movie that

160
00:10:06,640 --> 00:10:09,240
Speaker 1: has ever been made. So you've got your Big Trouble

161
00:10:09,320 --> 00:10:12,000
Speaker 1: and Little China poster up on the wall, and you

162
00:10:12,040 --> 00:10:15,320
Speaker 1: hold up your smartphone and you activate your Big Trouble

163
00:10:15,360 --> 00:10:20,040
Speaker 1: and Little China movie marketing app, and the camera on

164
00:10:20,080 --> 00:10:22,760
Speaker 1: your phone detects the poster it you know the posters

165
00:10:22,800 --> 00:10:26,679
Speaker 1: there well. The app and the poster together are able

166
00:10:26,720 --> 00:10:30,600
Speaker 1: to construct the augmented experience because there have been elements

167
00:10:30,600 --> 00:10:33,360
Speaker 1: put into the poster that the app is looking for.

168
00:10:34,200 --> 00:10:37,600
Speaker 1: And once the app identifies that, like, it sees maybe

169
00:10:37,840 --> 00:10:40,560
Speaker 1: eight different points on the poster, and because of the

170
00:10:40,600 --> 00:10:44,200
Speaker 1: orientation of those points, it knows what angle it's at

171
00:10:44,280 --> 00:10:47,319
Speaker 1: what height it's at in relation to the phone, and

172
00:10:47,360 --> 00:10:52,199
Speaker 1: can give you on your display the augmented reality experience.

173
00:10:52,240 --> 00:10:55,480
Speaker 1: In this case, it's obviously Jack Burton and the pork

174
00:10:55,559 --> 00:10:59,640
Speaker 1: Chop Express eating a sandwich, because, as we know, the

175
00:10:59,679 --> 00:11:04,000
Speaker 1: most riveting scene in the movie unfolds in this way.

176
00:11:04,080 --> 00:11:07,440
Speaker 1: So that would be kind of an augmented reality experience

177
00:11:07,440 --> 00:11:11,240
Speaker 1: where you didn't have to worry about every possible application

178
00:11:11,280 --> 00:11:13,560
Speaker 1: down in the real world. You made it for something

179
00:11:13,679 --> 00:11:16,760
Speaker 1: very specific, which means in your software you can have

180
00:11:16,840 --> 00:11:22,320
Speaker 1: the camera look quote unquote for these particular points of

181
00:11:22,360 --> 00:11:26,680
Speaker 1: reference and thus create the augmented experience in that way.

182
00:11:26,880 --> 00:11:28,800
Speaker 1: If you want to take that and move it to

183
00:11:28,880 --> 00:11:32,760
Speaker 1: the real world where you can see augmented information about

184
00:11:32,920 --> 00:11:35,960
Speaker 1: just the world around you, it becomes way more complicated.

185
00:11:36,320 --> 00:11:39,800
Speaker 1: You have to have very sophisticated image recognition software so

186
00:11:39,840 --> 00:11:44,199
Speaker 1: that the camera picks up the images, the software processes

187
00:11:44,240 --> 00:11:47,360
Speaker 1: the information, identifies what those images are, and gives you

188
00:11:47,360 --> 00:11:52,240
Speaker 1: the relevant information. So working with all the sensors, augmented

189
00:11:52,240 --> 00:11:55,319
Speaker 1: reality can make this a possibility. So another example, let's

190
00:11:55,320 --> 00:11:58,559
Speaker 1: say you're out on the street in Atlanta. You're here

191
00:11:58,600 --> 00:12:01,680
Speaker 1: in my hometown at and a Georgia and you're looking

192
00:12:01,720 --> 00:12:03,400
Speaker 1: at a building and you wonder what it is, and

193
00:12:03,440 --> 00:12:05,440
Speaker 1: you hold up your phone and you've got your little

194
00:12:05,800 --> 00:12:08,840
Speaker 1: map app that allows you to look at a real

195
00:12:08,920 --> 00:12:12,240
Speaker 1: world setting and tells you information about it, and it

196
00:12:12,280 --> 00:12:14,760
Speaker 1: tells you it's the Georgia Aquarium. Well, first of all,

197
00:12:14,760 --> 00:12:16,720
Speaker 1: you would probably know that already because the signage there

198
00:12:16,800 --> 00:12:20,400
Speaker 1: is actually pretty good. But the point being that this

199
00:12:20,440 --> 00:12:24,040
Speaker 1: would be something that would tap into the GPS cordints

200
00:12:24,080 --> 00:12:26,280
Speaker 1: on your phone, so it would know where your location

201
00:12:26,440 --> 00:12:29,040
Speaker 1: was and help narrow that down. The compass would tell

202
00:12:29,040 --> 00:12:33,840
Speaker 1: it what direction you are facing the the camera angle.

203
00:12:33,880 --> 00:12:37,640
Speaker 1: Also we have some image recognition going on there. The

204
00:12:37,640 --> 00:12:41,520
Speaker 1: accelerometer tells the orientation of the phone itself. All of

205
00:12:41,520 --> 00:12:44,920
Speaker 1: this data together would give the software the information needed

206
00:12:45,280 --> 00:12:50,640
Speaker 1: for it to display the label Georgia Aquarium on your phone.

207
00:12:50,640 --> 00:12:55,120
Speaker 1: And it all happens in an instant that's pretty amazing. Typically,

208
00:12:55,160 --> 00:12:59,200
Speaker 1: you also have to have some other method to communicate

209
00:12:59,320 --> 00:13:03,280
Speaker 1: with a larger infrastructure, because we don't have the capability

210
00:13:03,400 --> 00:13:07,560
Speaker 1: of building an enormously powerful computer that has all this

211
00:13:07,720 --> 00:13:11,040
Speaker 1: real world information programmed into it and make it a

212
00:13:11,200 --> 00:13:15,440
Speaker 1: handheld or wearable device. So usually you have to pair

213
00:13:15,640 --> 00:13:19,400
Speaker 1: these devices with some other larger infrastructure. Sometimes it's a

214
00:13:19,440 --> 00:13:23,360
Speaker 1: double handshake. For example, with Google Glass, you would use

215
00:13:23,360 --> 00:13:26,800
Speaker 1: Bluetooth to connect Google Glass to a smartphone. Then the

216
00:13:26,840 --> 00:13:30,680
Speaker 1: smartphone would have the connection to the larger internet through

217
00:13:30,760 --> 00:13:38,760
Speaker 1: your smartphones UH cell service provider. So while you're experiencing

218
00:13:39,600 --> 00:13:43,080
Speaker 1: the augmented reality through the Google Glass, it's actually communicating

219
00:13:43,080 --> 00:13:45,559
Speaker 1: through your phone to the infrastructure to get the data

220
00:13:45,600 --> 00:13:48,040
Speaker 1: it needs to show you the information. It's showing you

221
00:13:49,000 --> 00:13:51,720
Speaker 1: very important elements. And all of these components, like I said,

222
00:13:51,840 --> 00:13:55,600
Speaker 1: came together more or less around the same time. Most

223
00:13:55,640 --> 00:13:59,040
Speaker 1: of them were being developed independently of each other, and

224
00:13:59,080 --> 00:14:01,960
Speaker 1: it's just that now we're seeing them all converge. That's

225
00:14:01,960 --> 00:14:05,840
Speaker 1: an old favorite word here at tech stuff converge together

226
00:14:05,880 --> 00:14:08,840
Speaker 1: to create the augmented reality experience and make it possible.

227
00:14:09,640 --> 00:14:11,800
Speaker 1: So how did we get here? How did these different

228
00:14:11,800 --> 00:14:16,000
Speaker 1: elements develop? Well, there are a whole bunch of technology

229
00:14:16,000 --> 00:14:19,440
Speaker 1: pioneers who really create the foundation for augmented reality as

230
00:14:19,440 --> 00:14:22,440
Speaker 1: well as virtual reality and mixed reality. But one that

231
00:14:22,520 --> 00:14:25,040
Speaker 1: I think we really need to concentrate on at first

232
00:14:25,120 --> 00:14:29,960
Speaker 1: is Ivan Sutherland. Now. Sutherland was born in Hastings, Nebraska

233
00:14:30,040 --> 00:14:33,080
Speaker 1: in nineteen thirty eight, and as a kid, he was

234
00:14:33,160 --> 00:14:39,400
Speaker 1: fascinated with mathematics, particularly geometry, and also with engineering. He

235
00:14:39,440 --> 00:14:42,800
Speaker 1: began to study and experiment with computers while he was

236
00:14:42,840 --> 00:14:45,440
Speaker 1: in school, and this was at a time where personal

237
00:14:45,440 --> 00:14:48,160
Speaker 1: computers weren't a thing. There were no personal computers at

238
00:14:48,160 --> 00:14:50,720
Speaker 1: this point. Computers were actually pretty rare, and they were huge,

239
00:14:51,280 --> 00:14:55,320
Speaker 1: and in fact, they often would rely upon physical media

240
00:14:55,400 --> 00:14:59,320
Speaker 1: formats like punch punch cards or paper tape to read

241
00:14:59,400 --> 00:15:03,320
Speaker 1: a program him. So you didn't even have a disc

242
00:15:03,480 --> 00:15:07,160
Speaker 1: or like certainly nothing like a USB thumb drive or

243
00:15:07,200 --> 00:15:09,920
Speaker 1: anything like that. You you actually had to put physical

244
00:15:10,000 --> 00:15:13,240
Speaker 1: media into the machine for it to read and then

245
00:15:13,360 --> 00:15:18,040
Speaker 1: execute whatever program you had designed for that device. He

246
00:15:18,280 --> 00:15:21,720
Speaker 1: went to college at what is now Carnegie Mellon University

247
00:15:21,760 --> 00:15:24,440
Speaker 1: on a full scholarship. He graduated with a Bachelor of

248
00:15:24,480 --> 00:15:26,440
Speaker 1: Science degree. He would then go on to earn a

249
00:15:26,480 --> 00:15:29,800
Speaker 1: master's degree at cal Tech and a PhD in electrical

250
00:15:29,880 --> 00:15:34,000
Speaker 1: engineering from m I T And actually his doctoral thesis

251
00:15:34,000 --> 00:15:38,560
Speaker 1: supervisor was Claude Shannon. And we talked about Claude Shannon

252
00:15:38,600 --> 00:15:40,720
Speaker 1: back in the two thousand and fourteen episode Who Is

253
00:15:40,760 --> 00:15:44,960
Speaker 1: Claude Shannon. Um. We recorded that not too long after

254
00:15:45,120 --> 00:15:48,280
Speaker 1: Shannon's passing, So if you want to hear a really

255
00:15:48,320 --> 00:15:52,280
Speaker 1: interesting story about a pioneer in computer science, you should

256
00:15:52,280 --> 00:15:55,360
Speaker 1: go check out that two thousand and fourteen episode. Back

257
00:15:55,400 --> 00:15:59,720
Speaker 1: to Sutherland. For his thesis, he created something called sketch

258
00:15:59,760 --> 00:16:02,720
Speaker 1: pack AD and that was really, by most accounts, the

259
00:16:02,800 --> 00:16:07,520
Speaker 1: first computer graphical user interface, or gooey. A graphical user

260
00:16:07,560 --> 00:16:13,520
Speaker 1: interface means that you interact with the computer through graphics

261
00:16:13,600 --> 00:16:17,560
Speaker 1: representing various commands on the computer. Windows and the Mac

262
00:16:17,560 --> 00:16:21,720
Speaker 1: operating system are both examples of graphical user interfaces, as

263
00:16:21,760 --> 00:16:23,880
Speaker 1: is the interface on your smartphone. If you have a

264
00:16:23,920 --> 00:16:28,760
Speaker 1: smartphone where you choose applications on a screen, that's a

265
00:16:28,800 --> 00:16:32,520
Speaker 1: graphical user interface. Well, Sutherland created what is largely considered

266
00:16:32,560 --> 00:16:35,320
Speaker 1: to be the first one of those. After college, he

267
00:16:35,400 --> 00:16:38,720
Speaker 1: entered military service and he was assigned to the National

268
00:16:38,760 --> 00:16:43,880
Speaker 1: Security Agency. We have great friends there. I assume I'm

269
00:16:43,880 --> 00:16:48,080
Speaker 1: sure they're listening, because they're listening to everything at any rate.

270
00:16:48,160 --> 00:16:50,680
Speaker 1: He entered the n s A as an electrical engineer,

271
00:16:50,800 --> 00:16:53,880
Speaker 1: and in nineteen sixty four he replaced J. C. R.

272
00:16:54,000 --> 00:16:58,040
Speaker 1: Lick Lighter as the head of DARPA's Information Processing Techniques

273
00:16:58,160 --> 00:17:03,240
Speaker 1: Office or ip TO. And also by back then DARPA

274
00:17:03,360 --> 00:17:07,600
Speaker 1: wasn't DARPA, it was just ARPA. Uh so this is

275
00:17:07,640 --> 00:17:09,439
Speaker 1: the same group, by the way, that would end up

276
00:17:09,480 --> 00:17:12,720
Speaker 1: doing a lot of work that would form the ARPANETTE

277
00:17:12,880 --> 00:17:15,800
Speaker 1: a few years later, and the Arpanette was the predecessor

278
00:17:15,920 --> 00:17:19,560
Speaker 1: to the Internet in some ways. At least, the ARPANET

279
00:17:19,720 --> 00:17:23,760
Speaker 1: was what ended up being the building blocks for the

280
00:17:23,800 --> 00:17:27,439
Speaker 1: infrastructure that would become the Internet. Now, all of that

281
00:17:27,480 --> 00:17:32,159
Speaker 1: work happened after Sutherland had already departed the organization. His

282
00:17:32,200 --> 00:17:37,280
Speaker 1: work became a fundamental component of both virtual and augmented reality.

283
00:17:37,320 --> 00:17:40,919
Speaker 1: As I mentioned earlier in n he wrote a piece

284
00:17:41,000 --> 00:17:43,280
Speaker 1: and essay. It's very short, it's very easy read, and

285
00:17:43,320 --> 00:17:45,680
Speaker 1: you can find it online. The title of the essay

286
00:17:45,800 --> 00:17:48,960
Speaker 1: is the Ultimate Display. And if you ever do any

287
00:17:49,040 --> 00:17:53,320
Speaker 1: research and virtual reality or augmented reality, this essay is

288
00:17:53,359 --> 00:17:56,280
Speaker 1: going to pop up in your research, so go ahead

289
00:17:56,280 --> 00:17:58,199
Speaker 1: and read it. It's like two pages long, so it

290
00:17:58,240 --> 00:18:03,040
Speaker 1: goes very quickly. In that essay he talked about several ideas,

291
00:18:03,119 --> 00:18:10,000
Speaker 1: including the idealized display, the ultimate display, something that would

292
00:18:10,040 --> 00:18:15,200
Speaker 1: be the furthest you could go with display technology. Now,

293
00:18:15,280 --> 00:18:18,440
Speaker 1: keep in mind in his time, by his time, he's

294
00:18:18,440 --> 00:18:20,439
Speaker 1: still alive, by the way, but this time in the

295
00:18:20,480 --> 00:18:25,440
Speaker 1: nineties sixties, he uh, you know, things were just restricted

296
00:18:25,480 --> 00:18:30,159
Speaker 1: to monitors. You might have a light pen, but usually

297
00:18:30,200 --> 00:18:33,760
Speaker 1: you would just use a keyboard. Like it was pretty

298
00:18:33,760 --> 00:18:36,880
Speaker 1: bare bones. But he said, let's push this as far

299
00:18:36,920 --> 00:18:40,760
Speaker 1: as we can imagine it. And in his example, he

300
00:18:40,840 --> 00:18:44,840
Speaker 1: thought of a room that would be completely controlled by computers.

301
00:18:44,880 --> 00:18:48,680
Speaker 1: Everything you would experience within that room would be generated

302
00:18:48,720 --> 00:18:53,800
Speaker 1: by a computer. Everything you see here, smell, taste, and touch,

303
00:18:54,680 --> 00:18:57,240
Speaker 1: all of it generated by computers. The computer would even

304
00:18:57,280 --> 00:19:01,520
Speaker 1: be able to form physical objects out of ror matter itself. Now,

305
00:19:01,560 --> 00:19:05,200
Speaker 1: he wasn't suggesting that this would ever be a device

306
00:19:05,280 --> 00:19:07,280
Speaker 1: that we would actually be able to build. He was

307
00:19:07,320 --> 00:19:13,000
Speaker 1: just saying, what is the ultimate incarnation of display technology?

308
00:19:13,280 --> 00:19:16,080
Speaker 1: And if you read it, you realize, oh, this is

309
00:19:16,080 --> 00:19:18,760
Speaker 1: where the Star Trek Next Generation writers got their idea

310
00:19:18,800 --> 00:19:22,359
Speaker 1: for the Holidack. But unlike Star Trek the Next Generation,

311
00:19:22,520 --> 00:19:25,760
Speaker 1: the Ultimate Display would not go on the fritz every

312
00:19:25,760 --> 00:19:28,760
Speaker 1: other episode and try to kill the crew. It was

313
00:19:28,800 --> 00:19:34,480
Speaker 1: better than that. The Ultimate Display was sort of a

314
00:19:33,960 --> 00:19:39,480
Speaker 1: a foundational like Philosophically, it was foundational for virtual reality

315
00:19:39,520 --> 00:19:43,320
Speaker 1: and augmented reality. This idea of a very immersive experience

316
00:19:43,400 --> 00:19:48,280
Speaker 1: where you, as a user are surrounded somehow by this

317
00:19:49,280 --> 00:19:53,600
Speaker 1: computer generated experience. And that's true both with augmented reality

318
00:19:53,640 --> 00:19:58,119
Speaker 1: and virtual reality and augmented reality. The real world is

319
00:19:58,160 --> 00:20:01,840
Speaker 1: still there, but you get this enhanced experience that is

320
00:20:01,880 --> 00:20:09,000
Speaker 1: completely computer generated. So in nineteen sixty eight, Sutherland and

321
00:20:09,240 --> 00:20:13,359
Speaker 1: a student named Danny Cohen would create a VR, a

322
00:20:13,720 --> 00:20:18,680
Speaker 1: R head mounted display or h MD, and they nicknamed

323
00:20:18,720 --> 00:20:23,000
Speaker 1: it the Sword of Damocles. Why because you had to

324
00:20:23,040 --> 00:20:25,280
Speaker 1: suspend it from the ceiling. It was too heavy to

325
00:20:25,359 --> 00:20:28,240
Speaker 1: wear on your head. You needed it to be nice

326
00:20:28,280 --> 00:20:33,000
Speaker 1: and sturdy. Uh. It included transparent lenses, which meant you

327
00:20:33,040 --> 00:20:36,920
Speaker 1: could overlay computer information on the lenses themselves, and thus

328
00:20:36,960 --> 00:20:39,520
Speaker 1: you could look through the lenses at the real world

329
00:20:39,880 --> 00:20:43,880
Speaker 1: and have these wire framed graphics on top of what

330
00:20:43,920 --> 00:20:46,639
Speaker 1: you were looking at. And it also had a magnetic

331
00:20:46,680 --> 00:20:50,479
Speaker 1: tracking system, meaning that it had sensors that could detect

332
00:20:50,520 --> 00:20:53,520
Speaker 1: magnetic fields, and as you turned your head or you

333
00:20:54,040 --> 00:20:57,399
Speaker 1: change the inclination of your head, it would change the

334
00:20:57,440 --> 00:21:01,040
Speaker 1: magnetic field and this would be relayed as a command

335
00:21:01,280 --> 00:21:05,880
Speaker 1: to the visual center. The actual lenses themselves, so that

336
00:21:06,000 --> 00:21:09,400
Speaker 1: it would the change would be reflected in what you saw.

337
00:21:10,240 --> 00:21:12,480
Speaker 1: So if you have a virtual environment and you turn

338
00:21:12,520 --> 00:21:14,920
Speaker 1: your head to the left, you want the view within

339
00:21:14,960 --> 00:21:17,480
Speaker 1: the virtual environment to go to the left too, But

340
00:21:17,560 --> 00:21:20,480
Speaker 1: without head tracking technology that's impossible. So this was a

341
00:21:20,600 --> 00:21:23,399
Speaker 1: very early example of head tracking technology. And again it

342
00:21:23,520 --> 00:21:27,560
Speaker 1: used magnets magnetic fields in order to do that. Uh.

343
00:21:28,160 --> 00:21:32,480
Speaker 1: Obviously it's also really important for augmented reality. Again, if

344
00:21:32,520 --> 00:21:35,600
Speaker 1: the A R system doesn't detect that you are looking around,

345
00:21:36,160 --> 00:21:39,840
Speaker 1: then you're not getting relevant information, not for the specific

346
00:21:39,880 --> 00:21:43,840
Speaker 1: thing you are looking at. Anyway, as I said, the

347
00:21:43,840 --> 00:21:46,520
Speaker 1: graphics were pretty primitive. There were wire frame drawings, but

348
00:21:46,600 --> 00:21:52,399
Speaker 1: they still showed that this was a viable approach to

349
00:21:52,480 --> 00:21:57,200
Speaker 1: technology using HMD for augmented or virtual reality use. Oh

350
00:21:57,240 --> 00:21:59,560
Speaker 1: and one other note I should make so a lot

351
00:21:59,600 --> 00:22:01,960
Speaker 1: of people say the sort of Damocles was the first

352
00:22:02,000 --> 00:22:04,800
Speaker 1: head mounted display, and they say, you know, this is

353
00:22:04,840 --> 00:22:09,000
Speaker 1: the first HMD was made in nineteen I take issue

354
00:22:09,080 --> 00:22:12,920
Speaker 1: with that. I don't think of the sort of Damocles

355
00:22:13,080 --> 00:22:16,359
Speaker 1: as the first head mounted display. That to me should

356
00:22:16,359 --> 00:22:20,760
Speaker 1: go to a different invention called the head site h

357
00:22:20,800 --> 00:22:23,679
Speaker 1: E A D s I g h T. Now that

358
00:22:23,800 --> 00:22:27,720
Speaker 1: was developed by Phil Coo, and unlike the sort of Damocles,

359
00:22:28,280 --> 00:22:32,679
Speaker 1: it didn't create a virtual world. Instead, the head site

360
00:22:32,920 --> 00:22:37,400
Speaker 1: was sort of a remote viewfinder for a video camera.

361
00:22:38,440 --> 00:22:43,120
Speaker 1: So imagine that you've got a camera mounted on a mechanical,

362
00:22:43,800 --> 00:22:48,000
Speaker 1: uh swiveling mount, so you can move it left right,

363
00:22:48,040 --> 00:22:51,679
Speaker 1: you can change the orientation the inclination as well, and

364
00:22:51,720 --> 00:22:54,520
Speaker 1: then you have that mapped to a head mounted display,

365
00:22:54,640 --> 00:22:56,879
Speaker 1: so that if I put the display on and I

366
00:22:56,920 --> 00:22:59,440
Speaker 1: looked to the left, the camera pans to the left.

367
00:22:59,600 --> 00:23:01,360
Speaker 1: If I to the right, it pans to the right.

368
00:23:01,440 --> 00:23:04,879
Speaker 1: That sort of thing. It was meant to be a

369
00:23:04,920 --> 00:23:08,359
Speaker 1: way for for people to operate a camera in a

370
00:23:08,400 --> 00:23:12,280
Speaker 1: remote location that might not be very friendly to a

371
00:23:12,400 --> 00:23:16,520
Speaker 1: human being standing there. For example, the exterior of an aircraft.

372
00:23:16,880 --> 00:23:18,960
Speaker 1: You could have a camera mounted on the outside of

373
00:23:18,960 --> 00:23:22,520
Speaker 1: your aircraft that would allow an engineer on the inside

374
00:23:22,960 --> 00:23:27,439
Speaker 1: to look around and maybe help a pilot land or

375
00:23:27,680 --> 00:23:31,280
Speaker 1: navigate in a dangerous situation, or just get an idea

376
00:23:31,440 --> 00:23:35,880
Speaker 1: of the status of the aircraft itself. This was very

377
00:23:35,960 --> 00:23:40,440
Speaker 1: much a technology that was being pushed by the military,

378
00:23:41,440 --> 00:23:45,320
Speaker 1: an idea to create more military uses using this technology.

379
00:23:45,359 --> 00:23:50,040
Speaker 1: To make the military more competent, more adept at very

380
00:23:50,119 --> 00:23:55,959
Speaker 1: rapid changing situations on the technology front. So headsite proceeded

381
00:23:56,400 --> 00:23:59,240
Speaker 1: the sort of Damocles by about seven years. That came

382
00:23:59,240 --> 00:24:01,879
Speaker 1: out around night sixty one. But again it wasn't a

383
00:24:01,960 --> 00:24:05,520
Speaker 1: virtual reality headset or an augmented reality headset. It was

384
00:24:05,600 --> 00:24:08,480
Speaker 1: kind of a like I said, a remote viewfinder. But

385
00:24:08,600 --> 00:24:12,240
Speaker 1: still I consider that to be the earliest head mounted display,

386
00:24:12,400 --> 00:24:16,119
Speaker 1: not the sort of Damocles. However, Sutherland would end up

387
00:24:16,119 --> 00:24:19,240
Speaker 1: going on to make lots of other contributions in computer

388
00:24:19,280 --> 00:24:23,639
Speaker 1: graphics as well as the overall concepts that would guide

389
00:24:23,640 --> 00:24:27,560
Speaker 1: both virtual reality and augmented reality development over the next

390
00:24:27,600 --> 00:24:31,639
Speaker 1: several decades. But now it'll be time for me to

391
00:24:31,720 --> 00:24:34,560
Speaker 1: kind of move away from Sutherland to talk about some

392
00:24:34,640 --> 00:24:37,919
Speaker 1: other developments that were important in a R. And before

393
00:24:37,920 --> 00:24:41,280
Speaker 1: I get to that, let's take a quick break to

394
00:24:41,400 --> 00:24:52,280
Speaker 1: thank our sponsor. All Right, we just left off with

395
00:24:52,359 --> 00:24:57,520
Speaker 1: Ivan Sutherland. Now let's talk about a different father of

396
00:24:57,800 --> 00:25:03,719
Speaker 1: augmented reality, Myra Krueger or Doctor Myron Krueger. In nineteen

397
00:25:03,840 --> 00:25:07,520
Speaker 1: seventy four, Dr Krueger created an augmented reality lab called

398
00:25:07,760 --> 00:25:12,640
Speaker 1: video Place. Uh, he was really into this idea of

399
00:25:12,680 --> 00:25:17,719
Speaker 1: seeing the interaction of technology and people in artistic ways.

400
00:25:18,240 --> 00:25:23,480
Speaker 1: He really wanted to explore artistic expressions using technology and

401
00:25:23,600 --> 00:25:27,880
Speaker 1: people working together. So he wanted to create an artificial

402
00:25:27,960 --> 00:25:32,040
Speaker 1: reality environment that didn't require the user to wear special equipment.

403
00:25:32,080 --> 00:25:34,280
Speaker 1: You wouldn't have to put on a head mold display,

404
00:25:34,560 --> 00:25:39,760
Speaker 1: or wear special gloves, or use any kind of device

405
00:25:39,920 --> 00:25:44,000
Speaker 1: to control your actions, because that's a barrier between you

406
00:25:44,080 --> 00:25:50,000
Speaker 1: and the experience. Instead, his version consisted of a laboratory

407
00:25:50,040 --> 00:25:54,879
Speaker 1: that had several rooms all network together, and each room

408
00:25:55,040 --> 00:25:58,240
Speaker 1: had a video camera in it and a projector and

409
00:25:58,320 --> 00:26:01,119
Speaker 1: a screen. Now, the video camera would pick up the

410
00:26:01,200 --> 00:26:04,720
Speaker 1: motions of the person inside the room, it would send

411
00:26:05,000 --> 00:26:08,760
Speaker 1: information to the projector, which would then project the person's

412
00:26:08,960 --> 00:26:12,520
Speaker 1: silhouette on the screen. And the silhouette was typically a

413
00:26:12,560 --> 00:26:15,800
Speaker 1: really bright color, and you could move around and your

414
00:26:15,840 --> 00:26:18,159
Speaker 1: silhouette would move around, so you almost became like a

415
00:26:18,160 --> 00:26:22,119
Speaker 1: puppet master controlling your own silhouette. But then he started

416
00:26:22,119 --> 00:26:26,280
Speaker 1: to incorporate other things, like other elements that were virtually

417
00:26:26,359 --> 00:26:29,480
Speaker 1: on the screen. The projector was projecting things that were

418
00:26:29,520 --> 00:26:32,600
Speaker 1: on the screen but not in the actual real room itself.

419
00:26:32,840 --> 00:26:35,359
Speaker 1: So imagine a ball and a ball is being projected

420
00:26:35,480 --> 00:26:37,879
Speaker 1: on the screen. Well, you could move around so that

421
00:26:37,880 --> 00:26:39,960
Speaker 1: your silhouette would interact with the ball and the ball

422
00:26:40,000 --> 00:26:43,720
Speaker 1: would bounce away. That sort of thing. So you would

423
00:26:43,720 --> 00:26:46,840
Speaker 1: be able to interact with virtual environments by moving around

424
00:26:46,840 --> 00:26:52,439
Speaker 1: in a real physical space. And while those objects weren't

425
00:26:52,520 --> 00:26:55,480
Speaker 1: really there in front of you, you could see the

426
00:26:55,520 --> 00:26:58,520
Speaker 1: representation of them on the screen. And this was really

427
00:26:58,520 --> 00:27:00,919
Speaker 1: powerful stuff. And remember I said these rooms were all

428
00:27:00,960 --> 00:27:04,200
Speaker 1: network together, so you could actually have a system where

429
00:27:04,359 --> 00:27:06,640
Speaker 1: a person in one room and a person in another

430
00:27:06,720 --> 00:27:11,560
Speaker 1: room both have their silhouettes projected together in their respective

431
00:27:11,720 --> 00:27:16,760
Speaker 1: rooms on the screen, and your silhouette would be one color,

432
00:27:16,840 --> 00:27:19,840
Speaker 1: the other person's silhouette would be a different color, and

433
00:27:19,920 --> 00:27:24,720
Speaker 1: you could interact with one another. And according to reports

434
00:27:25,119 --> 00:27:30,119
Speaker 1: from this art experiment, they noticed that whenever people would

435
00:27:30,160 --> 00:27:33,879
Speaker 1: have their silhouettes cross one another, they would actually recoil

436
00:27:34,760 --> 00:27:37,480
Speaker 1: in their physical rooms. Keep in mind, they're in different rooms,

437
00:27:37,600 --> 00:27:40,240
Speaker 1: they're not in the same one together, they would recoil

438
00:27:40,359 --> 00:27:44,040
Speaker 1: as if they had made physical contact or bumped into someone.

439
00:27:44,720 --> 00:27:47,480
Speaker 1: So it showed that there was a very powerful psychological

440
00:27:47,600 --> 00:27:52,159
Speaker 1: element to this virtual presence. And again that psychological element

441
00:27:52,200 --> 00:27:55,600
Speaker 1: plays a huge important role in VR and a R

442
00:27:55,720 --> 00:27:58,800
Speaker 1: research and development, not just for creating products, but just

443
00:27:58,880 --> 00:28:03,520
Speaker 1: to understand how we process information and incorporated into our

444
00:28:03,520 --> 00:28:08,359
Speaker 1: sense of reality. Not to get too deep for you guys,

445
00:28:08,400 --> 00:28:12,159
Speaker 1: So experimentation in the field continued over the years. In

446
00:28:12,200 --> 00:28:15,280
Speaker 1: the early nine eighties, Dr Krueger would write a book

447
00:28:15,560 --> 00:28:19,520
Speaker 1: and publish it about artificial realities. But while the principles

448
00:28:19,560 --> 00:28:24,520
Speaker 1: for augmented reality were established, the technologies were still rather unwieldy.

449
00:28:24,560 --> 00:28:28,360
Speaker 1: They were large, they weren't reliable, and it would require

450
00:28:28,520 --> 00:28:32,439
Speaker 1: several years of work to improve those technologies, to create

451
00:28:32,760 --> 00:28:36,240
Speaker 1: miniaturization strategies to get the elements down to a size

452
00:28:36,280 --> 00:28:39,920
Speaker 1: that was more practical for that sort of use and

453
00:28:40,000 --> 00:28:43,000
Speaker 1: wouldn't require you to have a head mound display mounted

454
00:28:43,040 --> 00:28:46,440
Speaker 1: to the ceiling. And all of that took time, but

455
00:28:46,600 --> 00:28:50,440
Speaker 1: you could tell that the ideas underlying augmented and virtual

456
00:28:50,480 --> 00:28:56,920
Speaker 1: reality were already in place. There was a Boeing researcher

457
00:28:57,080 --> 00:29:02,680
Speaker 1: named Tom Coudell who coined the term augmented reality, and

458
00:29:02,800 --> 00:29:05,760
Speaker 1: he was specifically using it to talk about this approach

459
00:29:05,800 --> 00:29:08,640
Speaker 1: to overlaying digital information on top of our physical world

460
00:29:08,720 --> 00:29:12,800
Speaker 1: to enhance it in some way. Now Dr Cardell earned

461
00:29:12,840 --> 00:29:17,320
Speaker 1: a PhD in physics and astronomy from the University of Arizona,

462
00:29:17,440 --> 00:29:21,280
Speaker 1: and before contributing the term augmented reality to the public lexicon,

463
00:29:21,480 --> 00:29:25,200
Speaker 1: he did extensive work and artificial intelligence research and development.

464
00:29:25,520 --> 00:29:28,000
Speaker 1: He also became a professor in the fields of electrical

465
00:29:28,000 --> 00:29:32,200
Speaker 1: and computer engineering at the University of New Mexico. So

466
00:29:32,240 --> 00:29:34,920
Speaker 1: when he was working with Boeing, he used this phrase

467
00:29:34,960 --> 00:29:37,640
Speaker 1: to talk about specific system he was working on, an

468
00:29:37,680 --> 00:29:40,680
Speaker 1: augmented reality system, and the whole purpose of this was

469
00:29:40,760 --> 00:29:47,120
Speaker 1: to help people who were helping construct airplanes lay cables properly.

470
00:29:47,800 --> 00:29:52,120
Speaker 1: The whole idea was to use this system so that uh,

471
00:29:52,240 --> 00:29:55,200
Speaker 1: an electrician can see exactly where the cable needed to

472
00:29:55,280 --> 00:30:00,240
Speaker 1: go inside the partly constructed cabin of an aircraft aft,

473
00:30:01,080 --> 00:30:03,640
Speaker 1: and that way you could follow the directions that you

474
00:30:03,680 --> 00:30:07,920
Speaker 1: see through your display, lay the actual cable down where

475
00:30:07,960 --> 00:30:11,760
Speaker 1: the guide tells you to go, and then you would

476
00:30:11,800 --> 00:30:17,120
Speaker 1: have a properly wired airplane. Uh. And I'm sure, as

477
00:30:17,120 --> 00:30:22,680
Speaker 1: we're all aware, properly wired airplanes are good airplanes. Improperly

478
00:30:22,760 --> 00:30:25,640
Speaker 1: wired airplanes are not so good. So it was a

479
00:30:25,720 --> 00:30:30,120
Speaker 1: very important system to make this much more smooth and

480
00:30:30,280 --> 00:30:33,040
Speaker 1: fast and it meant that you didn't have to have

481
00:30:33,280 --> 00:30:38,640
Speaker 1: as as many experts to guide the process. You could

482
00:30:38,680 --> 00:30:41,840
Speaker 1: actually have someone come in who had never done this

483
00:30:41,920 --> 00:30:46,320
Speaker 1: before and just follow the directions through this augmented reality

484
00:30:46,680 --> 00:30:52,720
Speaker 1: set system and they could wire the airplane properly. So

485
00:30:53,000 --> 00:30:57,320
Speaker 1: really clever means of using augmented reality. Also, we would

486
00:30:57,360 --> 00:31:00,640
Speaker 1: end up seeing that same sort of philosophy used again

487
00:31:00,680 --> 00:31:04,680
Speaker 1: and again in the future in more sophisticated UH types

488
00:31:04,720 --> 00:31:07,440
Speaker 1: of technology, but it was the exact same approach, exact

489
00:31:07,480 --> 00:31:14,040
Speaker 1: same idea underlying it. In Lewis Rosenberg proposed a system

490
00:31:14,120 --> 00:31:16,520
Speaker 1: that the Air Force could use to allow someone to

491
00:31:16,560 --> 00:31:20,760
Speaker 1: control devices from a remote location, and that consisted of

492
00:31:20,800 --> 00:31:23,960
Speaker 1: a video camera which would provide the visual data to

493
00:31:23,960 --> 00:31:27,080
Speaker 1: the user through a head mounted display. They would wear

494
00:31:27,120 --> 00:31:29,479
Speaker 1: the display on their heads or they would look at

495
00:31:29,520 --> 00:31:33,000
Speaker 1: a screen, but typically they'd wear a display, and then

496
00:31:33,200 --> 00:31:36,880
Speaker 1: they would also wear an exoskeleton on their upper body

497
00:31:37,000 --> 00:31:42,200
Speaker 1: that would allow them to control some sort of robotic device,

498
00:31:42,280 --> 00:31:45,840
Speaker 1: typically robotic arms. And usually the way this would work

499
00:31:45,920 --> 00:31:48,080
Speaker 1: is that the display was designed in such a way

500
00:31:49,040 --> 00:31:52,120
Speaker 1: with the video camera so that the view that the

501
00:31:52,160 --> 00:31:55,160
Speaker 1: person had it made it look like the robot arms

502
00:31:55,640 --> 00:31:59,200
Speaker 1: were their actual arms, which required a little bit of

503
00:31:59,200 --> 00:32:02,920
Speaker 1: trickery on the part of Rosenberg. They had to fudge

504
00:32:03,240 --> 00:32:06,240
Speaker 1: the distances between the video camera and the robotic arms

505
00:32:06,480 --> 00:32:09,760
Speaker 1: to give this this sort of feeling that the robot

506
00:32:09,880 --> 00:32:13,320
Speaker 1: arms represented your actual arms. So you move your arms

507
00:32:13,320 --> 00:32:17,080
Speaker 1: inside the exoskeleton and the robot arms would move as

508
00:32:17,120 --> 00:32:19,680
Speaker 1: well at their remote location, so you it's kind of

509
00:32:19,720 --> 00:32:25,480
Speaker 1: like a really fancy remote control. Now imagine that the

510
00:32:25,560 --> 00:32:29,680
Speaker 1: robot arms are holding various tools. Uh. The suit would

511
00:32:29,680 --> 00:32:33,720
Speaker 1: also provide haptic feedback, that touch based feedback to let

512
00:32:33,720 --> 00:32:36,120
Speaker 1: a user know more about what is going on when

513
00:32:36,160 --> 00:32:40,040
Speaker 1: they're operating the arms. So if you were to have

514
00:32:40,360 --> 00:32:43,200
Speaker 1: do something that would make a robot arm encounter resistance,

515
00:32:44,080 --> 00:32:47,120
Speaker 1: then you would feel haptic feedback in the suit that

516
00:32:47,120 --> 00:32:50,280
Speaker 1: would indicate, oh, you're you're going beyond the parameters of

517
00:32:50,280 --> 00:32:53,280
Speaker 1: where this robot arm is capable of going. So you

518
00:32:53,400 --> 00:32:56,480
Speaker 1: learned very quickly where where you can operate within that

519
00:32:56,560 --> 00:33:00,600
Speaker 1: suit and make sure that you are not pushing it

520
00:33:00,680 --> 00:33:05,720
Speaker 1: beyond its limits. You could also uh end up using

521
00:33:05,760 --> 00:33:09,480
Speaker 1: these tools to do various things in this remote environment. Now,

522
00:33:09,600 --> 00:33:13,480
Speaker 1: Rosenberg called his system virtual fixtures, which meant that the

523
00:33:13,560 --> 00:33:15,959
Speaker 1: user would see these virtual overlays on top of a

524
00:33:15,960 --> 00:33:19,200
Speaker 1: real environment that they were looking at. So I'm going

525
00:33:19,240 --> 00:33:23,320
Speaker 1: to give a very basic example that to illustrate this,

526
00:33:23,360 --> 00:33:25,200
Speaker 1: because it's hard to imagine, it's hard to get it

527
00:33:25,280 --> 00:33:27,840
Speaker 1: across in words. But let's say you're looking through a

528
00:33:27,880 --> 00:33:31,520
Speaker 1: headmund display and in front of you is a board,

529
00:33:32,560 --> 00:33:37,160
Speaker 1: wooden board, and it's just a regular wooden board. There's

530
00:33:37,200 --> 00:33:39,800
Speaker 1: nothing painted on it or anything in the real world,

531
00:33:39,920 --> 00:33:43,080
Speaker 1: and it's in a room that's across the building from you.

532
00:33:43,080 --> 00:33:45,680
Speaker 1: You cannot see this with your own eyes. You can

533
00:33:45,680 --> 00:33:49,400
Speaker 1: only see it through the video camera. The virtual fixture

534
00:33:49,480 --> 00:33:53,640
Speaker 1: overlay might be a series of circles, and the circles

535
00:33:53,720 --> 00:33:55,960
Speaker 1: are things that you were meant to cut out of

536
00:33:56,000 --> 00:33:58,960
Speaker 1: the board using the robot arms and a tool that's

537
00:33:59,040 --> 00:34:02,200
Speaker 1: right there in side the physical environment, across the building

538
00:34:02,240 --> 00:34:05,680
Speaker 1: from you. So you follow the patterns that you see

539
00:34:05,720 --> 00:34:09,640
Speaker 1: in this virtual overlay and you complete the task. That's

540
00:34:09,680 --> 00:34:13,239
Speaker 1: a very simple example, and uh, this system was meant

541
00:34:13,320 --> 00:34:15,800
Speaker 1: to allow for that. That's what he would call the

542
00:34:15,880 --> 00:34:20,359
Speaker 1: virtual fixtures, these overlays that you would see that would

543
00:34:20,400 --> 00:34:23,600
Speaker 1: appear to be real, but actually we're not present in

544
00:34:23,640 --> 00:34:30,160
Speaker 1: the physical environment itself. Now, also in a group of

545
00:34:30,160 --> 00:34:33,480
Speaker 1: researchers at Columbia University, we're proposing a system that they

546
00:34:33,520 --> 00:34:38,600
Speaker 1: called the knowledge based Augmented Reality for Maintenance Assistance a

547
00:34:38,760 --> 00:34:44,080
Speaker 1: k a. Karma Cute. Their approach was pretty novel. They

548
00:34:44,120 --> 00:34:47,640
Speaker 1: pointed out that while augmented reality had tremendous potential, it

549
00:34:47,680 --> 00:34:50,800
Speaker 1: also had a really big barrier and that it takes

550
00:34:50,960 --> 00:34:55,160
Speaker 1: an enormous amount of time to design or animate and

551
00:34:55,280 --> 00:35:00,239
Speaker 1: implement these graphic overlays for a R applications. So say

552
00:35:00,280 --> 00:35:02,520
Speaker 1: you're in a room and you're looking at different objects,

553
00:35:02,600 --> 00:35:05,960
Speaker 1: and little labels are popping up for each object. If

554
00:35:05,960 --> 00:35:07,839
Speaker 1: you're having to do all that by hand, it takes

555
00:35:07,840 --> 00:35:10,920
Speaker 1: a huge amount of time. What they wanted to do

556
00:35:11,440 --> 00:35:16,440
Speaker 1: was create artificial intelligence systems, or at least techniques to

557
00:35:16,640 --> 00:35:22,560
Speaker 1: generate graphics automatically on the fly. So this would be

558
00:35:22,760 --> 00:35:26,239
Speaker 1: similar to using image recognition software, so that if you

559
00:35:26,320 --> 00:35:31,000
Speaker 1: look at a specific box, let's say, the image recognition

560
00:35:31,000 --> 00:35:33,000
Speaker 1: software might be able to map that box to a

561
00:35:33,000 --> 00:35:36,480
Speaker 1: specific product and thus give you an overlay of information

562
00:35:36,520 --> 00:35:39,200
Speaker 1: about the product that would be inside that box, and

563
00:35:39,200 --> 00:35:40,960
Speaker 1: it would be able to do all this automatically. It

564
00:35:40,960 --> 00:35:45,200
Speaker 1: would not require a human programmer to go through and

565
00:35:45,200 --> 00:35:48,279
Speaker 1: and look at every single product in every single type

566
00:35:48,280 --> 00:35:52,120
Speaker 1: of box and program all that out. That would be ridiculous,

567
00:35:52,120 --> 00:35:54,960
Speaker 1: It would take forever. So it was the work of

568
00:35:54,960 --> 00:35:58,120
Speaker 1: this group with Karma that really started the ball rolling

569
00:35:58,120 --> 00:36:01,920
Speaker 1: with this AI approach to automatically fill in that information

570
00:36:02,200 --> 00:36:08,160
Speaker 1: and make a are a more practical experience. Around the

571
00:36:08,280 --> 00:36:12,680
Speaker 1: same time, between ninety two and nine, the Laurel Western

572
00:36:12,760 --> 00:36:16,560
Speaker 1: Development Labs, which was a defense contractor, began to work

573
00:36:16,600 --> 00:36:18,880
Speaker 1: with the U. S Military to create a R systems

574
00:36:18,920 --> 00:36:22,400
Speaker 1: for military vehicles. And you can understand very quickly how

575
00:36:22,880 --> 00:36:27,319
Speaker 1: a R would have enormous potential for military applications. And

576
00:36:27,360 --> 00:36:30,040
Speaker 1: in fact, a R is very commonly used in lots

577
00:36:30,040 --> 00:36:33,760
Speaker 1: of different things like pilot helmets where it helps pilots

578
00:36:33,840 --> 00:36:38,840
Speaker 1: keep track of targets UH and identify a potential threats

579
00:36:38,880 --> 00:36:42,520
Speaker 1: that kind of thing. But in this case they were

580
00:36:42,560 --> 00:36:47,279
Speaker 1: really looking at creating a augmented reality system that would

581
00:36:47,280 --> 00:36:52,920
Speaker 1: create virtual opponents for people working in simulated wartime conditions.

582
00:36:53,400 --> 00:36:57,000
Speaker 1: So really a training program. Imagine that you're operating an

583
00:36:57,040 --> 00:37:01,200
Speaker 1: actual military vehicle like a tank, and you have a

584
00:37:01,400 --> 00:37:05,880
Speaker 1: view outside that is really an augmented reality system, so

585
00:37:05,920 --> 00:37:08,080
Speaker 1: you're actually looking at the real world around you. You

586
00:37:08,120 --> 00:37:10,680
Speaker 1: aren't just sitting in a simulator inside of building. You

587
00:37:10,719 --> 00:37:14,000
Speaker 1: are out there in the field controlling a real vehicle

588
00:37:14,120 --> 00:37:17,760
Speaker 1: moving around in real terrain. But you also see virtual

589
00:37:18,400 --> 00:37:22,879
Speaker 1: representations of enemies in that real terrain, and you can

590
00:37:22,960 --> 00:37:26,680
Speaker 1: practice maneuvers and firing on enemies that sort of thing,

591
00:37:26,960 --> 00:37:30,799
Speaker 1: probably not using live ammunition at that point, but having

592
00:37:30,800 --> 00:37:33,680
Speaker 1: a more realistic simulation in a real environment, so that

593
00:37:33,719 --> 00:37:40,440
Speaker 1: you're not just trying to create a totally virtual scenario. Anyway,

594
00:37:40,480 --> 00:37:44,600
Speaker 1: that work was done in the world, wouldn't really learn

595
00:37:44,680 --> 00:37:48,040
Speaker 1: about it at large until about nine because that's the

596
00:37:48,040 --> 00:37:50,520
Speaker 1: way the military works. They're not so eager to talk

597
00:37:50,560 --> 00:37:54,600
Speaker 1: about their stuff while are still doing it. Meanwhile, at

598
00:37:54,600 --> 00:37:57,839
Speaker 1: the same time, artists were continuing to explore the relationships

599
00:37:57,840 --> 00:38:00,600
Speaker 1: between physical performers and virtual LM. And so you remember

600
00:38:00,640 --> 00:38:04,280
Speaker 1: I talked about Dr Krueger earlier. While in nine different

601
00:38:04,360 --> 00:38:08,680
Speaker 1: artist Julie Martin would create a piece called Dancing in Cyberspace,

602
00:38:09,680 --> 00:38:13,200
Speaker 1: and in that piece, dancers on a physical space or

603
00:38:13,239 --> 00:38:16,799
Speaker 1: a physical stage. We're able to manipulate virtual objects, so

604
00:38:16,880 --> 00:38:19,720
Speaker 1: an audience would be able to see both the physical

605
00:38:19,719 --> 00:38:25,200
Speaker 1: performance by the dancers and the virtual reactions the things

606
00:38:25,200 --> 00:38:27,640
Speaker 1: that happened within the virtual environment as a result of

607
00:38:27,680 --> 00:38:34,160
Speaker 1: the dancers moving around their physical space. Pretty neat. Two researchers,

608
00:38:34,320 --> 00:38:39,839
Speaker 1: Recky Motto and Nagao created there the first real handheld

609
00:38:39,920 --> 00:38:42,520
Speaker 1: a R display, but it was a tethered display. It

610
00:38:42,600 --> 00:38:45,600
Speaker 1: wasn't free form. You couldn't just take it anywhere. It

611
00:38:45,680 --> 00:38:48,560
Speaker 1: was called Navy Cam, and you had to have a

612
00:38:48,719 --> 00:38:52,200
Speaker 1: tether like cable essentially connect the Navy Cam to a workstation.

613
00:38:52,960 --> 00:38:56,239
Speaker 1: But it had a forward facing camera and you can

614
00:38:56,360 --> 00:39:00,359
Speaker 1: use a video feed to go through this and held

615
00:39:00,360 --> 00:39:05,000
Speaker 1: device through the cable to the workstation, and it could

616
00:39:05,000 --> 00:39:08,680
Speaker 1: detect color coded markers in the camera image and display

617
00:39:08,680 --> 00:39:11,200
Speaker 1: information on a video see through view. So you can

618
00:39:11,239 --> 00:39:15,080
Speaker 1: get that augmented reality experience. Obviously very limited, you know,

619
00:39:15,160 --> 00:39:17,520
Speaker 1: you could not just carry this around with you everywhere

620
00:39:17,520 --> 00:39:22,160
Speaker 1: you go, but it showed the ideas behind augmented reality

621
00:39:22,200 --> 00:39:25,560
Speaker 1: could in fact be realized in a handheld format. Now

622
00:39:25,600 --> 00:39:29,399
Speaker 1: it's just a matter of getting those different components small

623
00:39:29,520 --> 00:39:35,360
Speaker 1: enough to all fit in a self contained mobile form factor. Now,

624
00:39:35,400 --> 00:39:38,480
Speaker 1: in the late nineties, we started seeing televised sporting events

625
00:39:38,640 --> 00:39:42,600
Speaker 1: featuring augmented reality elements, or at least you did. I

626
00:39:42,640 --> 00:39:46,400
Speaker 1: don't watch sports ball, that's not entirely true, but I

627
00:39:46,400 --> 00:39:49,680
Speaker 1: don't watch football or hockey, American football or hockey, and

628
00:39:49,840 --> 00:39:53,480
Speaker 1: both of those were the sports that really got them.

629
00:39:53,520 --> 00:39:57,800
Speaker 1: First off, I'm gonna backtrack. I used to watch hockey,

630
00:39:57,840 --> 00:40:04,640
Speaker 1: but then Winnipeg stole the Atlanta Thrash years from me. Winnipeg, Okay,

631
00:40:04,640 --> 00:40:07,560
Speaker 1: getting back to hockey. So hockey had the Fox track system,

632
00:40:07,680 --> 00:40:10,960
Speaker 1: which Fox put into hockey games so that you could

633
00:40:11,000 --> 00:40:13,560
Speaker 1: easily follow the puck. Instead of trying to watch this

634
00:40:13,719 --> 00:40:16,839
Speaker 1: little bitty black disc spinning around, You've got to watch

635
00:40:16,840 --> 00:40:23,440
Speaker 1: this very bright, highlighted neon colored disc that everyone hated.

636
00:40:24,320 --> 00:40:27,600
Speaker 1: And after about two seasons, Fox stop doing it, and

637
00:40:27,680 --> 00:40:31,880
Speaker 1: people were happy. Adila Thrashers moved away, and then it

638
00:40:31,920 --> 00:40:36,640
Speaker 1: was just miserable. American football would follow suit in the

639
00:40:36,719 --> 00:40:40,279
Speaker 1: late nineties and have the first down line introduced, where

640
00:40:40,280 --> 00:40:44,760
Speaker 1: they could on live video overlay the first down line.

641
00:40:45,280 --> 00:40:48,799
Speaker 1: Usually it's a bright yellow line that indicates how far

642
00:40:48,880 --> 00:40:51,400
Speaker 1: the offensive team needs to go. And by offensive, I

643
00:40:51,400 --> 00:40:53,560
Speaker 1: mean they're on the offensive. I don't mean they offend

644
00:40:53,640 --> 00:40:57,920
Speaker 1: my sensibilities. I'm not that against American football, but it

645
00:40:57,960 --> 00:40:59,480
Speaker 1: showed how far they would need to go in order

646
00:40:59,520 --> 00:41:02,640
Speaker 1: to estab a first down, which I am told is

647
00:41:02,680 --> 00:41:06,600
Speaker 1: something you want to do. Uh. That would start to

648
00:41:06,640 --> 00:41:10,839
Speaker 1: get employed in and over time we would see that

649
00:41:11,400 --> 00:41:15,680
Speaker 1: increase where eventually Skycam was able to even use this system.

650
00:41:15,719 --> 00:41:18,319
Speaker 1: At first it wasn't. You could get a Skycamp view,

651
00:41:18,400 --> 00:41:20,560
Speaker 1: but you couldn't do the overlay of the first intent

652
00:41:20,680 --> 00:41:25,080
Speaker 1: line until later. Well, I've got a lot more to

653
00:41:25,160 --> 00:41:29,520
Speaker 1: say about augmented reality, but before I do, let's take

654
00:41:29,520 --> 00:41:40,400
Speaker 1: another quick break to thank our sponsor. Okay, we're back.

655
00:41:40,640 --> 00:41:45,000
Speaker 1: Let's skip ahead to I guess it's not really skipping

656
00:41:45,040 --> 00:41:50,359
Speaker 1: I just talked about. Let's plot ahead to That's when

657
00:41:50,440 --> 00:41:56,439
Speaker 1: NASA's X spacecraft was using an a R system as

658
00:41:56,560 --> 00:42:00,440
Speaker 1: part of its navigational tools, so people back on Earth

659
00:42:00,600 --> 00:42:04,240
Speaker 1: could look at a view from the spacecraft a camera

660
00:42:04,440 --> 00:42:08,479
Speaker 1: mounted on the spacecraft, and on top of that view

661
00:42:08,680 --> 00:42:12,440
Speaker 1: they could overlay map data to help with navigation. And

662
00:42:12,480 --> 00:42:14,960
Speaker 1: all of that, of course was controlled back here on Earth.

663
00:42:15,680 --> 00:42:18,040
Speaker 1: But it was sort of an experiment to see how

664
00:42:18,080 --> 00:42:22,319
Speaker 1: augmented reality could be incorporated into space exploration missions. In

665
00:42:22,360 --> 00:42:27,520
Speaker 1: the future and make them more effective. Also, in the

666
00:42:27,640 --> 00:42:32,840
Speaker 1: Navy began work on the Battlefield Augmented Reality System or BARS,

667
00:42:33,239 --> 00:42:35,719
Speaker 1: which is a wearable a R system for soldiers. You've

668
00:42:35,719 --> 00:42:39,719
Speaker 1: probably seen various implementations of this over the years. Is

669
00:42:39,760 --> 00:42:44,239
Speaker 1: obviously evolved since nine It's one of those pieces of

670
00:42:44,280 --> 00:42:48,239
Speaker 1: technology that some soldiers took to, but a lot just

671
00:42:48,360 --> 00:42:53,960
Speaker 1: felt that it created unnecessary distractions. Technology and warfare is

672
00:42:54,160 --> 00:42:59,080
Speaker 1: very very difficult because there are sometimes where we think, oh,

673
00:42:59,280 --> 00:43:02,400
Speaker 1: more information and is always better, but in some cases

674
00:43:02,440 --> 00:43:06,480
Speaker 1: that doesn't seem to hold true. And for some people

675
00:43:06,520 --> 00:43:10,120
Speaker 1: with these head mounted displays or or really it's heads

676
00:43:10,200 --> 00:43:13,439
Speaker 1: up displays HUDs uh, that can sometimes be the case,

677
00:43:13,520 --> 00:43:19,400
Speaker 1: depends on the implementation. In two thousand, hiro Katsu Kato

678
00:43:19,560 --> 00:43:24,440
Speaker 1: created a software library called a R Toolkit. Very important

679
00:43:24,440 --> 00:43:28,360
Speaker 1: software library was also open source, so anyone could contribute

680
00:43:28,360 --> 00:43:32,360
Speaker 1: to it, modify it. Brent put out a new version

681
00:43:32,640 --> 00:43:35,680
Speaker 1: that sort of stuff, and it uses video tracking to

682
00:43:35,719 --> 00:43:39,719
Speaker 1: overlay computer graphics on a video camera feed and it's

683
00:43:39,719 --> 00:43:43,120
Speaker 1: still a component for a lot of a our experiences today.

684
00:43:43,200 --> 00:43:46,680
Speaker 1: Later on in the two thousand's this would be adapted

685
00:43:47,000 --> 00:43:50,480
Speaker 1: so that it could also be used in Web experiences,

686
00:43:50,560 --> 00:43:56,320
Speaker 1: not just native experiences to specific devices, and we continue

687
00:43:56,360 --> 00:44:00,719
Speaker 1: to see are built into new experiences, including smartphone and tablets.

688
00:44:00,719 --> 00:44:04,360
Speaker 1: By two thousand four, some researchers in Germany were creating

689
00:44:04,440 --> 00:44:07,400
Speaker 1: a r apps that could take advantage of a smartphones camera.

690
00:44:08,040 --> 00:44:11,760
Speaker 1: But two thousand four's pretty early for smartphones. It really

691
00:44:11,800 --> 00:44:15,320
Speaker 1: would would be a few years before this would truly

692
00:44:15,360 --> 00:44:18,520
Speaker 1: take off, because that's when Apple came out with the

693
00:44:18,560 --> 00:44:22,480
Speaker 1: iPhone in two thousand seven. That was the real revolution

694
00:44:22,800 --> 00:44:26,840
Speaker 1: in smartphone technology. There have been smartphones before the iPhone,

695
00:44:26,960 --> 00:44:29,480
Speaker 1: don't get me wrong, and many of them were really good,

696
00:44:30,120 --> 00:44:34,200
Speaker 1: but the iPhone was something that caught the public's attention

697
00:44:34,360 --> 00:44:38,279
Speaker 1: and made smartphones sexy. And because of that, there was

698
00:44:38,320 --> 00:44:41,879
Speaker 1: a ton of money poured into the smartphone industry as

699
00:44:41,920 --> 00:44:45,040
Speaker 1: well as not just Apple, but also to other companies,

700
00:44:45,080 --> 00:44:49,200
Speaker 1: like the companies that were offering Android smartphones. But I

701
00:44:49,239 --> 00:44:51,879
Speaker 1: think we can really thank Apple for all of that

702
00:44:52,360 --> 00:44:55,520
Speaker 1: happening in the first place, especially things like seeing that

703
00:44:55,560 --> 00:44:58,560
Speaker 1: accelerometer where you could switch from portrait to landscape mode.

704
00:44:58,560 --> 00:45:02,080
Speaker 1: I remember everyone freaking out about that when Steve Jobs

705
00:45:02,200 --> 00:45:05,200
Speaker 1: showed it off in two thousand seven at Macworld and

706
00:45:05,560 --> 00:45:07,839
Speaker 1: everyone thought, Wow, this is the this is amazing. Well,

707
00:45:07,880 --> 00:45:09,400
Speaker 1: we take it for granted now, but it was a

708
00:45:09,440 --> 00:45:14,359
Speaker 1: big deal then. So once that smartphone revolution happened, it

709
00:45:14,440 --> 00:45:19,640
Speaker 1: was a landslide victory for both augmented reality and virtual

710
00:45:19,680 --> 00:45:22,960
Speaker 1: reality research and development because it meant that so much

711
00:45:23,000 --> 00:45:28,800
Speaker 1: money was being poured into creating newer, thinner, more capable

712
00:45:28,840 --> 00:45:33,880
Speaker 1: smartphones that we saw an explosion in technological development that

713
00:45:33,960 --> 00:45:39,319
Speaker 1: could also be used for virtual and augmented reality experiences. So,

714
00:45:39,400 --> 00:45:43,200
Speaker 1: for example, I think of those sensors I talked about earlier,

715
00:45:43,239 --> 00:45:48,120
Speaker 1: accelerometers and gyroscopes, that sort of thing. Well, we saw

716
00:45:48,160 --> 00:45:50,319
Speaker 1: a lot of development in those spaces in order to

717
00:45:50,360 --> 00:45:53,279
Speaker 1: make smartphones better, and people who are working in a

718
00:45:53,480 --> 00:45:56,359
Speaker 1: R and VR experiences can take advantage of those same

719
00:45:56,400 --> 00:46:01,600
Speaker 1: sensors either creating apps specifically four smartphones. Thus you don't

720
00:46:01,600 --> 00:46:05,200
Speaker 1: have to build any other hardware, you just use existing hardware,

721
00:46:05,280 --> 00:46:08,359
Speaker 1: but that limits how you can use it, right because

722
00:46:08,360 --> 00:46:10,799
Speaker 1: you don't typically wear your smartphone directly in front of

723
00:46:10,800 --> 00:46:14,600
Speaker 1: your face. Or they could end up taking advantage of

724
00:46:14,640 --> 00:46:18,880
Speaker 1: those new, smaller sensors and incorporate them directly into brand

725
00:46:18,880 --> 00:46:22,400
Speaker 1: new hardware, like various types of wearables like Google Glass,

726
00:46:22,400 --> 00:46:24,200
Speaker 1: for example, but that would be a few more years.

727
00:46:25,800 --> 00:46:30,080
Speaker 1: In two thousand eleven, Nintendo launched the Nintendo three D S,

728
00:46:30,800 --> 00:46:33,120
Speaker 1: which included a camera. It was, you know, the three

729
00:46:33,200 --> 00:46:38,680
Speaker 1: D capable handheld device, and included actually a pair of

730
00:46:39,320 --> 00:46:42,880
Speaker 1: forward facing cameras, so you could take three D photos

731
00:46:42,920 --> 00:46:46,800
Speaker 1: if you wanted to, and it also had some a

732
00:46:47,040 --> 00:46:50,400
Speaker 1: R software included with it. You would get these special

733
00:46:50,560 --> 00:46:55,480
Speaker 1: Nintendo cards kind of like playing cards, and if you

734
00:46:55,520 --> 00:46:58,040
Speaker 1: were to point the camera of the three D S

735
00:46:58,520 --> 00:47:02,000
Speaker 1: at the card and look at the screen, you would

736
00:47:02,000 --> 00:47:05,520
Speaker 1: see a little virtual three dimensional character pop up on

737
00:47:05,600 --> 00:47:09,200
Speaker 1: the card. So Mario would be an obvious example. You

738
00:47:09,239 --> 00:47:11,919
Speaker 1: put the Mario card down on the table, you hold

739
00:47:12,000 --> 00:47:13,760
Speaker 1: up the three D S, and you aim the camera

740
00:47:13,800 --> 00:47:15,640
Speaker 1: at the card, and you look at the screen and

741
00:47:15,640 --> 00:47:18,799
Speaker 1: there's Mario, and Mario appears to be jumping around on

742
00:47:18,960 --> 00:47:23,319
Speaker 1: your physical table. Now, obviously, if you look off of

743
00:47:23,400 --> 00:47:27,279
Speaker 1: the display, there's no Mario jumping around, but on the

744
00:47:27,360 --> 00:47:30,440
Speaker 1: display there he is, and it was pretty cute. I

745
00:47:30,440 --> 00:47:34,480
Speaker 1: remember being really impressed with this very simple implementation of

746
00:47:34,520 --> 00:47:37,680
Speaker 1: a R when we got our three DS, and then

747
00:47:37,680 --> 00:47:41,000
Speaker 1: I took our three DS apart and then I took

748
00:47:41,000 --> 00:47:44,880
Speaker 1: pictures of it, and then I posted on Twitter and

749
00:47:44,960 --> 00:47:49,640
Speaker 1: people got sad, it's a great day. In two thousand thirteen,

750
00:47:49,680 --> 00:47:53,719
Speaker 1: Google introduced Google Glass. That was the wearable that included

751
00:47:53,760 --> 00:47:57,160
Speaker 1: a small display position just above the right eye. Uh

752
00:47:57,320 --> 00:48:00,719
Speaker 1: so when you look straightforward, you could tell that there

753
00:48:00,760 --> 00:48:05,400
Speaker 1: was something kind of above your natural eyeline. But it

754
00:48:05,440 --> 00:48:08,560
Speaker 1: didn't get in the way too much. You too to

755
00:48:08,600 --> 00:48:10,640
Speaker 1: look at the screen. You actually had a glimpse, you know,

756
00:48:10,760 --> 00:48:13,400
Speaker 1: the glance upward, and then you could see what was

757
00:48:13,400 --> 00:48:19,040
Speaker 1: on the display. Google Glass had augmented reality features like crazy.

758
00:48:19,160 --> 00:48:24,200
Speaker 1: You could see video calls. You could actually use the

759
00:48:25,000 --> 00:48:28,200
Speaker 1: glasses to not just to take a video call, but

760
00:48:28,280 --> 00:48:31,520
Speaker 1: show the other person what you are looking at so

761
00:48:31,719 --> 00:48:34,520
Speaker 1: they could see from your point of view. You could

762
00:48:34,560 --> 00:48:37,759
Speaker 1: also overlay directions, so if you're walking down street, you

763
00:48:37,760 --> 00:48:39,960
Speaker 1: could glance up at the screen and it would tell

764
00:48:39,960 --> 00:48:42,000
Speaker 1: you if you need to keep going straight or turn laughter,

765
00:48:42,080 --> 00:48:44,440
Speaker 1: turn right, that kind of thing. It was really useful.

766
00:48:44,840 --> 00:48:47,560
Speaker 1: Um I had a pair of these Google Glass and

767
00:48:47,760 --> 00:48:51,200
Speaker 1: I really liked the direction they were going in. I

768
00:48:51,239 --> 00:48:54,480
Speaker 1: felt that it wasn't a fully realized product at the time,

769
00:48:54,520 --> 00:48:57,719
Speaker 1: and eventually Google agreed and after a couple of years,

770
00:48:57,719 --> 00:49:00,520
Speaker 1: they took Google Glass off the market and early and

771
00:49:00,560 --> 00:49:04,000
Speaker 1: now you can't get them anymore. Uh. They were clever,

772
00:49:04,320 --> 00:49:09,080
Speaker 1: but they were expensive, and they had some limitations. And

773
00:49:09,520 --> 00:49:11,640
Speaker 1: like I was saying earlier, you know, it's hard to

774
00:49:11,640 --> 00:49:14,719
Speaker 1: build all the components you need into one headset. So

775
00:49:14,800 --> 00:49:18,960
Speaker 1: Google Glass would communicate via Bluetooth to your smartphone, and

776
00:49:19,000 --> 00:49:21,640
Speaker 1: your smartphone would act as the actual nexus point to

777
00:49:21,680 --> 00:49:25,680
Speaker 1: the Internet. But it was a neat idea, uh, and

778
00:49:25,880 --> 00:49:28,560
Speaker 1: I enjoyed getting to use them while I did, so

779
00:49:29,120 --> 00:49:32,799
Speaker 1: I keep hoping to see a return of that kind

780
00:49:32,800 --> 00:49:36,680
Speaker 1: of technology, but perhaps in a more mature and less

781
00:49:36,680 --> 00:49:42,799
Speaker 1: expensive format. Now we've also seen applications similar to the

782
00:49:42,840 --> 00:49:45,319
Speaker 1: ones we mentioned earlier, the ones that are meant to

783
00:49:45,360 --> 00:49:49,759
Speaker 1: guide people into laying out or repairing a system. We've

784
00:49:49,800 --> 00:49:52,600
Speaker 1: seen that in the car world. Not too long ago,

785
00:49:53,040 --> 00:49:57,120
Speaker 1: there was the MARTA system introduced by Volkswagen. MARTA makes

786
00:49:57,120 --> 00:50:00,000
Speaker 1: me chuckle because that's also the name of Atlanta's public

787
00:50:00,040 --> 00:50:03,160
Speaker 1: transportation system, but in this case, it stands for Mobile

788
00:50:03,160 --> 00:50:08,400
Speaker 1: Augmented Reality Technical Assistance and it's specifically designed for mechanics

789
00:50:08,440 --> 00:50:12,080
Speaker 1: who are working on the XL one vehicle. So if

790
00:50:12,120 --> 00:50:15,160
Speaker 1: you hold up an iPad that has this app on it,

791
00:50:15,719 --> 00:50:18,359
Speaker 1: and the camera has pointed at an XCEL one and

792
00:50:18,400 --> 00:50:21,480
Speaker 1: you look at the display, you'll see information overlaid on

793
00:50:21,560 --> 00:50:25,759
Speaker 1: top of the car, including labels for all the different parts.

794
00:50:25,840 --> 00:50:28,080
Speaker 1: So let's say you're a mechanic and you have to

795
00:50:28,120 --> 00:50:32,239
Speaker 1: do a specific repair on this vehicle. You hold up

796
00:50:32,280 --> 00:50:35,279
Speaker 1: the iPad, you look through the display, and you see

797
00:50:35,280 --> 00:50:37,040
Speaker 1: exactly what you need to do. It gives you a

798
00:50:37,080 --> 00:50:39,960
Speaker 1: set of instructions that shows you how you need to do.

799
00:50:40,000 --> 00:50:42,319
Speaker 1: It tells you where you need to stand based upon

800
00:50:42,440 --> 00:50:45,160
Speaker 1: the angle of the view. So if you hold it

801
00:50:45,239 --> 00:50:46,760
Speaker 1: up and it says no, you need to move about

802
00:50:46,800 --> 00:50:48,600
Speaker 1: a foot to the right, you can do that. Then

803
00:50:48,640 --> 00:50:50,520
Speaker 1: hold up the iPad again. I'll say, all right, you're

804
00:50:50,560 --> 00:50:53,719
Speaker 1: in the right spot. Make sure you loosen this particular

805
00:50:53,760 --> 00:50:56,759
Speaker 1: bolt first. That kind of thing, and it's meant to

806
00:50:56,880 --> 00:51:01,360
Speaker 1: be an interactive maintenance guy in a way, maintenance and

807
00:51:01,400 --> 00:51:05,760
Speaker 1: repair guide. This is one of those applications of augmented reality.

808
00:51:05,800 --> 00:51:09,600
Speaker 1: I think is a no brainer to me. It's a

809
00:51:09,680 --> 00:51:15,400
Speaker 1: killer app The idea of having an ability to work

810
00:51:15,480 --> 00:51:20,240
Speaker 1: with something you are not familiar with, but you're able

811
00:51:20,280 --> 00:51:23,400
Speaker 1: to leverage the expertise of people who either designed it

812
00:51:23,520 --> 00:51:26,239
Speaker 1: or built it, or just fully understand it, and get

813
00:51:26,320 --> 00:51:31,279
Speaker 1: guidance based on their expertise in real time, so you're

814
00:51:31,320 --> 00:51:36,000
Speaker 1: not having to go and consult a an article about

815
00:51:36,000 --> 00:51:39,600
Speaker 1: it or watch a YouTube video. You get step by

816
00:51:39,600 --> 00:51:44,680
Speaker 1: step instructions overlaid on top of your view of that thing.

817
00:51:45,800 --> 00:51:49,160
Speaker 1: To me, that's the most compelling use of augmented reality

818
00:51:49,400 --> 00:51:51,279
Speaker 1: from a practical standpoint. There are a lot of other

819
00:51:51,360 --> 00:51:53,520
Speaker 1: uses that I'll talk about towards the end that I

820
00:51:53,520 --> 00:51:56,080
Speaker 1: think are also really super cool. So don't get me wrong,

821
00:51:56,120 --> 00:51:59,920
Speaker 1: It's not the only one. But let's move on to

822
00:52:00,040 --> 00:52:04,080
Speaker 1: thousand fifteen. That was when Microsoft would unveil the hollow lens,

823
00:52:04,080 --> 00:52:06,319
Speaker 1: something I still want to try out. I have not

824
00:52:06,440 --> 00:52:09,120
Speaker 1: had a chance to try a hollow lens yet. That

825
00:52:09,239 --> 00:52:12,520
Speaker 1: is a headset cable of advanced a R applications everything

826
00:52:12,600 --> 00:52:15,160
Speaker 1: from what I was just talking about, giving you guidance,

827
00:52:15,200 --> 00:52:18,120
Speaker 1: step by step instructions on how to do like a

828
00:52:18,160 --> 00:52:21,279
Speaker 1: repair job on say an electrical outlet. You can even

829
00:52:21,440 --> 00:52:26,520
Speaker 1: use a Skype system to call an expert who can

830
00:52:26,560 --> 00:52:31,400
Speaker 1: then view your point of view and interact with that

831
00:52:31,480 --> 00:52:34,280
Speaker 1: point of view. So Let's say I'm looking at the outlet.

832
00:52:35,080 --> 00:52:38,880
Speaker 1: The expert electrician i'm talking to can see what I see,

833
00:52:39,480 --> 00:52:44,000
Speaker 1: and he or she can also make notes on the

834
00:52:44,120 --> 00:52:47,719
Speaker 1: display which shows up in my field of view. So

835
00:52:48,000 --> 00:52:50,959
Speaker 1: he or she might circle a specific wire and say

836
00:52:50,960 --> 00:52:52,960
Speaker 1: you need to you need to remove that one first,

837
00:52:53,360 --> 00:52:55,400
Speaker 1: and I know I need to do that one first

838
00:52:55,440 --> 00:52:57,600
Speaker 1: because I can see which one they are talking about.

839
00:52:57,680 --> 00:53:00,600
Speaker 1: Or they might circle another wire and say, no matter

840
00:53:00,719 --> 00:53:05,200
Speaker 1: why you do, don't cut this wire where the toilet

841
00:53:05,280 --> 00:53:11,080
Speaker 1: upstairs will explode like lethal weapon too, and I won't

842
00:53:11,080 --> 00:53:14,399
Speaker 1: do that because you know that guys like three days

843
00:53:14,440 --> 00:53:18,920
Speaker 1: from retirement. So I have a heart. But no, this

844
00:53:18,960 --> 00:53:21,839
Speaker 1: is this is a really neat idea, having this interactive

845
00:53:21,880 --> 00:53:27,000
Speaker 1: ability to overlay the information from the world, the digital world,

846
00:53:27,000 --> 00:53:30,080
Speaker 1: onto your physical world and beyond that. The hollowlens has

847
00:53:30,120 --> 00:53:33,640
Speaker 1: lots of other functions. It's not just something to do,

848
00:53:33,840 --> 00:53:36,919
Speaker 1: you know, home repairs around the house. You can also

849
00:53:37,040 --> 00:53:40,480
Speaker 1: use it for entertainment purposes, like you could create a

850
00:53:40,760 --> 00:53:45,279
Speaker 1: screen that can show you video from various sources and

851
00:53:45,320 --> 00:53:49,080
Speaker 1: you can assign it a place on a wall in

852
00:53:49,160 --> 00:53:52,880
Speaker 1: your environment. Let's say that you're in your living room

853
00:53:53,000 --> 00:53:56,280
Speaker 1: and you just create a screen so you can watch Netflix,

854
00:53:56,320 --> 00:53:59,040
Speaker 1: and you slap it on a wall and it will

855
00:53:59,120 --> 00:54:02,719
Speaker 1: stay in that same position relative to your point of view.

856
00:54:03,080 --> 00:54:04,840
Speaker 1: So if you look to the left or right, the

857
00:54:04,920 --> 00:54:08,080
Speaker 1: screen stays where you put it as if it were

858
00:54:08,120 --> 00:54:10,719
Speaker 1: physically there on your wall. But keep in mind it's

859
00:54:10,760 --> 00:54:13,759
Speaker 1: just a virtual screen, and when you look back to

860
00:54:13,880 --> 00:54:16,400
Speaker 1: that part of your wall, you'll see the virtual screen

861
00:54:16,440 --> 00:54:18,760
Speaker 1: there playing whatever it was that you wanted to watch.

862
00:54:20,080 --> 00:54:22,319
Speaker 1: I think that's a super cool idea. And they've also

863
00:54:22,360 --> 00:54:26,359
Speaker 1: shown off games like a game of Minecraft that uses

864
00:54:26,400 --> 00:54:29,360
Speaker 1: hollow lens so you can actually view a Minecraft world

865
00:54:30,120 --> 00:54:33,239
Speaker 1: sitting appearing to sit at any rate on top of

866
00:54:33,239 --> 00:54:36,520
Speaker 1: a table, so you can walk around the table and

867
00:54:36,640 --> 00:54:40,200
Speaker 1: view the Minecraft world from various angles and play that way.

868
00:54:41,000 --> 00:54:44,080
Speaker 1: I think that's super neat. Don't know how compelling it is,

869
00:54:44,120 --> 00:54:47,040
Speaker 1: because again I haven't tried it myself, but I really

870
00:54:47,080 --> 00:54:52,080
Speaker 1: like the idea. This year two thousand sixteen, are got

871
00:54:52,120 --> 00:54:55,160
Speaker 1: another big boost from a little game called Pokemon Go.

872
00:54:56,280 --> 00:54:59,480
Speaker 1: Although I have to admit this was a really primitive,

873
00:54:59,640 --> 00:55:03,200
Speaker 1: base sick implementation of augmented reality. Really, it was not

874
00:55:03,440 --> 00:55:06,000
Speaker 1: much more than just a In fact, it was nothing

875
00:55:06,080 --> 00:55:09,600
Speaker 1: more than just an animated overlay that would exist on

876
00:55:09,719 --> 00:55:13,240
Speaker 1: top of the camera view of your of your device.

877
00:55:14,120 --> 00:55:17,000
Speaker 1: So I'd say, I'm holding up my smartphone and I'm

878
00:55:17,080 --> 00:55:20,000
Speaker 1: trying to catch a Jiggli Puff, and the Jiggli Puff

879
00:55:20,080 --> 00:55:22,920
Speaker 1: is currently bouncing up and down on the sidewalk in

880
00:55:23,000 --> 00:55:25,520
Speaker 1: front of me. That's about as far as the augmented

881
00:55:25,600 --> 00:55:29,880
Speaker 1: reality actual experience would go. So very primitive. But because

882
00:55:29,960 --> 00:55:35,360
Speaker 1: Pokemon Go became so popular so quickly, it really pushed

883
00:55:35,520 --> 00:55:38,320
Speaker 1: the concept of a R to the front of the

884
00:55:38,440 --> 00:55:42,759
Speaker 1: minds of people everywhere, including business owners who immediately said,

885
00:55:42,840 --> 00:55:46,880
Speaker 1: we need an augmented reality app. Whether they actually needed

886
00:55:46,920 --> 00:55:49,480
Speaker 1: one or not is beside the point. A lot of

887
00:55:49,520 --> 00:55:52,920
Speaker 1: people got into a R because of Pokemon Go. Uh,

888
00:55:53,239 --> 00:55:55,759
Speaker 1: for both good and bad. I always think that you

889
00:55:55,880 --> 00:55:58,000
Speaker 1: have to come up with the experience first. You have

890
00:55:58,160 --> 00:56:03,160
Speaker 1: to understand why you need to use a specific strategy

891
00:56:03,719 --> 00:56:08,719
Speaker 1: to create a specific experience and then build it. Not Hey,

892
00:56:09,200 --> 00:56:13,759
Speaker 1: we need augmented reality makes something that's a R. To me,

893
00:56:13,880 --> 00:56:16,880
Speaker 1: that's the backwards way of going about it. But what

894
00:56:16,960 --> 00:56:19,960
Speaker 1: do I know. I'm not not a programmer, so I'm

895
00:56:19,960 --> 00:56:22,840
Speaker 1: sure the programmers feel in a similar way to me.

896
00:56:23,280 --> 00:56:26,800
Speaker 1: But that's just a guess. Now. The future of a

897
00:56:26,960 --> 00:56:30,120
Speaker 1: R depends heavily upon the applications we see, in which

898
00:56:30,200 --> 00:56:33,680
Speaker 1: ones end up being successful, in which ones aren't. Right now,

899
00:56:33,880 --> 00:56:36,239
Speaker 1: I would say that the best bet is to see

900
00:56:36,320 --> 00:56:41,040
Speaker 1: more a R features built into smartphones and tablets. Uh not,

901
00:56:41,160 --> 00:56:44,920
Speaker 1: maybe not necessarily built into them, but have apps available

902
00:56:45,000 --> 00:56:48,960
Speaker 1: that create a OUR experiences for very specific contexts, Like

903
00:56:49,120 --> 00:56:52,239
Speaker 1: let's say it's a museum app. You might download a

904
00:56:52,320 --> 00:56:54,360
Speaker 1: museum app on your phone, and when you go to

905
00:56:54,440 --> 00:56:57,120
Speaker 1: the museum and you use your phone, you can get

906
00:56:57,160 --> 00:57:00,839
Speaker 1: more information about the paintings and sculptures and or installations

907
00:57:00,920 --> 00:57:03,279
Speaker 1: that you see in the museum. That's an easy one

908
00:57:03,360 --> 00:57:06,080
Speaker 1: to understand. But that same app isn't going to be

909
00:57:06,200 --> 00:57:08,680
Speaker 1: useful once you leave the museum, you no longer have

910
00:57:09,000 --> 00:57:12,680
Speaker 1: the context that it is tied to. I think that

911
00:57:12,840 --> 00:57:16,040
Speaker 1: smartphones are probably going to be where the greatest development

912
00:57:16,160 --> 00:57:18,960
Speaker 1: is going to be in the near term, because wearables

913
00:57:19,040 --> 00:57:22,360
Speaker 1: is still really hard to do. We still don't have

914
00:57:22,680 --> 00:57:25,520
Speaker 1: a consumer version of the hollow lens out available for

915
00:57:25,560 --> 00:57:28,920
Speaker 1: anyone to purchase, and it may never come out as

916
00:57:28,960 --> 00:57:31,720
Speaker 1: a consumer product. Microsoft hasn't shown a whole lot of

917
00:57:31,800 --> 00:57:35,160
Speaker 1: interest in making it a consumer product. Maybe that will change,

918
00:57:35,680 --> 00:57:38,160
Speaker 1: but at the moment, I wouldn't hold my breath, so

919
00:57:39,040 --> 00:57:42,240
Speaker 1: I would argue smartphones and tablets are pretty much where

920
00:57:42,240 --> 00:57:47,200
Speaker 1: it's at. Maybe some implementation with some existing VR headsets

921
00:57:47,240 --> 00:57:49,880
Speaker 1: which have external cameras mounted on them as well, like

922
00:57:50,000 --> 00:57:53,480
Speaker 1: forward facing cameras, you could build a our experiences there.

923
00:57:53,680 --> 00:57:55,880
Speaker 1: Then it gets a little weird because you're you're also

924
00:57:56,040 --> 00:57:58,520
Speaker 1: you know, you're looking at a monitor, so you're looking

925
00:57:58,560 --> 00:58:01,080
Speaker 1: at a video feed of your roundings, and on top

926
00:58:01,120 --> 00:58:03,240
Speaker 1: of the video feed you get the overlay. Same thing

927
00:58:03,360 --> 00:58:05,320
Speaker 1: is true for your smartphones and tablets, by the way,

928
00:58:06,040 --> 00:58:09,360
Speaker 1: but different that from the Google Glass implementation, where you're

929
00:58:09,440 --> 00:58:12,520
Speaker 1: looking at the actual physical world, not a video representation

930
00:58:12,600 --> 00:58:15,640
Speaker 1: of it, but the real world. And then because the

931
00:58:15,760 --> 00:58:19,200
Speaker 1: display itself that you are looking through is transparent, you're

932
00:58:19,240 --> 00:58:23,000
Speaker 1: looking at a transparent overlay of digital information that gives

933
00:58:23,080 --> 00:58:27,840
Speaker 1: you more info about the world you are in. I

934
00:58:27,960 --> 00:58:30,439
Speaker 1: think a R is super cool. I think it's really

935
00:58:30,520 --> 00:58:33,880
Speaker 1: got a lot of potential to change the world around

936
00:58:34,000 --> 00:58:35,800
Speaker 1: us and to change the way we interact with the

937
00:58:35,800 --> 00:58:41,160
Speaker 1: world around us. You could imagine a dystopian future implementation

938
00:58:41,240 --> 00:58:44,040
Speaker 1: of a r where we all have to wear glasses

939
00:58:44,120 --> 00:58:48,320
Speaker 1: and we're constantly getting personalized commercials beamed at us whenever

940
00:58:48,400 --> 00:58:51,480
Speaker 1: we look at anything. Like imagine walking past a store

941
00:58:52,080 --> 00:58:54,320
Speaker 1: casually looking in the window and then getting a whole

942
00:58:54,360 --> 00:58:56,200
Speaker 1: bunch of ads for all the stuff that's in the

943
00:58:56,280 --> 00:58:59,160
Speaker 1: store window. That would be obnoxious, and it's easy to

944
00:58:59,280 --> 00:59:03,280
Speaker 1: understand how people would not want that, yet also easy

945
00:59:03,360 --> 00:59:06,240
Speaker 1: to understand how that could possibly become a future or

946
00:59:06,840 --> 00:59:10,080
Speaker 1: think of the future where your privacy is no longer

947
00:59:10,360 --> 00:59:13,640
Speaker 1: even relevant, and you walk down the street and you

948
00:59:13,720 --> 00:59:17,120
Speaker 1: look at all the people's faces who are also walking

949
00:59:17,160 --> 00:59:20,520
Speaker 1: down the street, and you're getting names of everybody and

950
00:59:20,680 --> 00:59:22,760
Speaker 1: what they like and what they dislike. You know, what

951
00:59:22,960 --> 00:59:25,560
Speaker 1: music they tend to listen to, maybe what they're listening

952
00:59:25,600 --> 00:59:28,760
Speaker 1: to right now, And it's all because we've got facial

953
00:59:28,840 --> 00:59:33,840
Speaker 1: recognition technology. Almost everyone has some sort of social media presence,

954
00:59:34,400 --> 00:59:38,040
Speaker 1: so you can map that face to any public profiles,

955
00:59:38,120 --> 00:59:40,200
Speaker 1: try and find a match. If you found a match,

956
00:59:40,280 --> 00:59:43,120
Speaker 1: you could bring back information to the person wearing the glasses,

957
00:59:43,640 --> 00:59:46,560
Speaker 1: so I can look at somebody and say, oh, this, uh,

958
00:59:46,960 --> 00:59:50,600
Speaker 1: this cute kid over here, she's got she likes punk

959
00:59:50,720 --> 00:59:54,040
Speaker 1: rock music. I'm gonna I'm gonna impress her with my

960
00:59:54,880 --> 01:00:00,800
Speaker 1: knowledge of the cramps. That probably wouldn't work. But the

961
01:00:00,880 --> 01:00:03,360
Speaker 1: point being, this is pretty creepy and invasive, and so

962
01:00:03,520 --> 01:00:06,040
Speaker 1: there are some negative implementations of a ARE that we

963
01:00:06,120 --> 01:00:08,800
Speaker 1: have to watch out for. Unless we get to a

964
01:00:08,840 --> 01:00:11,280
Speaker 1: point where we just don't care about privacy at all anymore.

965
01:00:11,760 --> 01:00:14,240
Speaker 1: Some would argue we're already there, and in that case,

966
01:00:14,520 --> 01:00:16,840
Speaker 1: this implementation of a R may not sound creepy at all.

967
01:00:16,880 --> 01:00:18,680
Speaker 1: It might just sound kind of cool, kind of the

968
01:00:18,720 --> 01:00:21,320
Speaker 1: equivalent of walking into a store, seeing a person with

969
01:00:21,440 --> 01:00:24,080
Speaker 1: a name tag and addressing them by name. If they

970
01:00:24,080 --> 01:00:26,040
Speaker 1: don't remember they have a name tag on, they have

971
01:00:26,160 --> 01:00:28,600
Speaker 1: this moment where they think, do I know you? But

972
01:00:28,640 --> 01:00:30,840
Speaker 1: if we're in a world where everyone can see everyone's

973
01:00:30,920 --> 01:00:33,240
Speaker 1: name all the time, then well, for one thing, I

974
01:00:33,280 --> 01:00:35,520
Speaker 1: won't ever have to worry about coming at a loss

975
01:00:35,520 --> 01:00:37,440
Speaker 1: when I have to introduce my wife to someone. So

976
01:00:37,680 --> 01:00:40,320
Speaker 1: that's a that's a plus side. And I hope you

977
01:00:40,400 --> 01:00:44,080
Speaker 1: guys enjoyed that classic episode of text stuff. If you

978
01:00:44,160 --> 01:00:47,120
Speaker 1: have any comments or questions, reach out on social media.

979
01:00:47,280 --> 01:00:49,960
Speaker 1: We are available at text Stuff h s W both

980
01:00:50,080 --> 01:00:52,680
Speaker 1: on Twitter and on Facebook. You can also go to

981
01:00:52,760 --> 01:00:56,560
Speaker 1: our podcast page that's tech Stuff podcast dot com. You

982
01:00:56,640 --> 01:00:59,480
Speaker 1: can find a link to every episode we've ever recorded. There.

983
01:00:59,720 --> 01:01:02,439
Speaker 1: You'll also find a link to our online store, where

984
01:01:02,440 --> 01:01:05,400
Speaker 1: there's lots of tech Stuff merchandise, so you can go

985
01:01:05,480 --> 01:01:09,280
Speaker 1: ahead and spend all that hard earned cash on really

986
01:01:09,320 --> 01:01:12,000
Speaker 1: cool tech stuff products. I mean, seriously, we do have

987
01:01:12,080 --> 01:01:13,560
Speaker 1: some really neat ones. If you haven't checked it out,

988
01:01:13,640 --> 01:01:15,080
Speaker 1: go at least take a look at the designs. I

989
01:01:15,120 --> 01:01:17,800
Speaker 1: think you'll find them amusing, and who knows, maybe you'll

990
01:01:17,800 --> 01:01:21,360
Speaker 1: find a new favorite tote bag or t shirt. Then remember,

991
01:01:21,400 --> 01:01:23,000
Speaker 1: every purchase you make goes to help the show, and

992
01:01:23,040 --> 01:01:25,160
Speaker 1: we greatly appreciate it, and I will talk to you

993
01:01:25,280 --> 01:01:33,040
Speaker 1: again really soon. Tex Stuff is a production of I

994
01:01:33,160 --> 01:01:36,120
Speaker 1: Heart Radio's How Stuff Works. For more podcasts from my

995
01:01:36,240 --> 01:01:39,800
Speaker 1: heart Radio, visit the i heart Radio app, Apple Podcasts,

996
01:01:39,960 --> 01:01:41,920
Speaker 1: or wherever you listen to your favorite shows.