1
00:00:04,160 --> 00:00:07,160
Speaker 1: Get in text with technology with tex Stuff from how

2
00:00:07,240 --> 00:00:14,160
Speaker 1: stuff works dot com. Hey there, and welcome to tex Stuff.

3
00:00:14,200 --> 00:00:17,680
Speaker 1: I am your host, Jonathan Strickland, and today I'm going

4
00:00:17,760 --> 00:00:22,000
Speaker 1: to augment your reality, or at least tell you what

5
00:00:22,320 --> 00:00:24,720
Speaker 1: augmented reality and a R is all about. And if

6
00:00:24,800 --> 00:00:28,040
Speaker 1: this seems like it's deja vu, that means you are

7
00:00:28,240 --> 00:00:33,600
Speaker 1: a long time listener of tech stuff, because we did

8
00:00:33,840 --> 00:00:38,120
Speaker 1: our episode about a are way back in two thousand nine.

9
00:00:38,159 --> 00:00:40,839
Speaker 1: That's when Chris Palette was my co host and together

10
00:00:40,880 --> 00:00:43,879
Speaker 1: we recorded an episode that we called What in the

11
00:00:43,920 --> 00:00:47,640
Speaker 1: World Is Augmented Reality? And that was a pretty short

12
00:00:47,680 --> 00:00:50,720
Speaker 1: overview of the concept, like twenty minutes long, and that

13
00:00:50,800 --> 00:00:55,840
Speaker 1: included two different listener males. So I thought I would

14
00:00:55,840 --> 00:00:59,960
Speaker 1: do a deeper dive, a bigger explanation about what augment

15
00:01:00,040 --> 00:01:03,200
Speaker 1: the reality is, what it's all about, how it works,

16
00:01:03,560 --> 00:01:08,400
Speaker 1: and sort of the applications we might put a R

17
00:01:08,560 --> 00:01:12,520
Speaker 1: toward things that, you know, was it good for tons

18
00:01:12,520 --> 00:01:16,000
Speaker 1: of stuff? As it turns out, So the first thing

19
00:01:16,040 --> 00:01:19,520
Speaker 1: we should do, it's probably defined some terms, because if

20
00:01:19,560 --> 00:01:23,280
Speaker 1: you haven't really looked into augmented reality and you aren't

21
00:01:23,319 --> 00:01:27,039
Speaker 1: familiar with a R, you might just be lost. I'm

22
00:01:27,040 --> 00:01:30,240
Speaker 1: gonna define it all for you right now, because that's

23
00:01:30,240 --> 00:01:33,360
Speaker 1: the kind of stand up guy I am. Technically speaking,

24
00:01:33,400 --> 00:01:38,520
Speaker 1: augmented reality is using digital information to enhance or augment

25
00:01:39,200 --> 00:01:44,319
Speaker 1: and experience in our physical real world. So the way

26
00:01:44,360 --> 00:01:49,080
Speaker 1: we usually see this implemented involves some sort of display

27
00:01:49,200 --> 00:01:51,720
Speaker 1: that has an image of the real world on it,

28
00:01:51,800 --> 00:01:54,800
Speaker 1: and it overlays digital information on top of that image.

29
00:01:54,880 --> 00:01:58,840
Speaker 1: So think of like a camera's viewfinder, like an LCD

30
00:01:59,280 --> 00:02:02,840
Speaker 1: screen on a camera, and it actually labels the buildings

31
00:02:02,880 --> 00:02:05,240
Speaker 1: that are in view. When you're out on the street

32
00:02:05,320 --> 00:02:08,560
Speaker 1: and you hold the camera up, or a smartphone or

33
00:02:08,600 --> 00:02:12,200
Speaker 1: even a wearable device like a head mounted display that

34
00:02:12,280 --> 00:02:15,160
Speaker 1: you can look through so you can see the real world.

35
00:02:15,200 --> 00:02:17,760
Speaker 1: You're not just staring at a screen, or if you

36
00:02:17,800 --> 00:02:20,320
Speaker 1: are staring at a screen, you're staring at a video

37
00:02:20,440 --> 00:02:23,640
Speaker 1: feed that is provided by an external camera amounted just

38
00:02:23,720 --> 00:02:25,320
Speaker 1: on the other side of the screen. So it's like

39
00:02:25,400 --> 00:02:28,680
Speaker 1: you're looking through a display in the first place, but

40
00:02:28,760 --> 00:02:32,440
Speaker 1: then on top of that view you have this digital information.

41
00:02:33,000 --> 00:02:35,880
Speaker 1: That's the most common implementation we talk about, but it's

42
00:02:35,880 --> 00:02:38,520
Speaker 1: not the only one. Augmented reality does not have to

43
00:02:38,639 --> 00:02:43,760
Speaker 1: only be or even involve visual information at all. You

44
00:02:43,760 --> 00:02:47,880
Speaker 1: could have audio only augmented reality, for example, But the

45
00:02:47,919 --> 00:02:51,360
Speaker 1: whole idea is that it's something that has created digitally

46
00:02:51,720 --> 00:02:55,280
Speaker 1: to enhance your experience in the real world. Now we

47
00:02:55,320 --> 00:03:01,160
Speaker 1: can contrast this with the concept of virtual reality. Virtual reality,

48
00:03:01,200 --> 00:03:04,760
Speaker 1: of course, is a term where you create an experience

49
00:03:04,880 --> 00:03:10,200
Speaker 1: completely through computer generated means a computer is making all

50
00:03:10,240 --> 00:03:14,240
Speaker 1: the things you see and here, and maybe even beyond

51
00:03:14,280 --> 00:03:18,079
Speaker 1: that if you have really sophisticated UH setups, so you

52
00:03:18,160 --> 00:03:21,040
Speaker 1: might have some haptic feedback. Haptic refers to your sense

53
00:03:21,080 --> 00:03:23,520
Speaker 1: of touch, so if you have haptic feedback, that means

54
00:03:23,560 --> 00:03:27,840
Speaker 1: you're getting information feedback through your sense of touch. Common

55
00:03:27,880 --> 00:03:32,400
Speaker 1: example of this is a rumble pack inside a game controller,

56
00:03:32,440 --> 00:03:34,320
Speaker 1: where you know you fire a gun and a first

57
00:03:34,360 --> 00:03:39,080
Speaker 1: person shooter and your controller rumbles as a result, letting

58
00:03:39,080 --> 00:03:44,440
Speaker 1: you know that you are in fact, unleashing virtual destruction

59
00:03:44,600 --> 00:03:48,320
Speaker 1: upon all you survey. Well, the same thing can be

60
00:03:48,360 --> 00:03:52,880
Speaker 1: true with virtual reality set up. So virtual reality is

61
00:03:52,920 --> 00:03:58,400
Speaker 1: all about constructing an artificial reality a simulated reality. Augmented

62
00:03:58,440 --> 00:04:01,000
Speaker 1: reality is all about enhance and seeing the one that

63
00:04:01,080 --> 00:04:05,840
Speaker 1: we are actually in. And then there's also mixed reality.

64
00:04:06,240 --> 00:04:09,800
Speaker 1: Mixed reality is kind of sort of in between the two.

65
00:04:09,880 --> 00:04:14,560
Speaker 1: You might have some physical objects within a room that

66
00:04:14,760 --> 00:04:18,640
Speaker 1: are also mapped to a virtual environment, and then you

67
00:04:18,800 --> 00:04:22,200
Speaker 1: use something like a head molded display to enter the

68
00:04:22,279 --> 00:04:25,760
Speaker 1: virtual environment. That's what looks like you're inside. But you

69
00:04:25,800 --> 00:04:28,160
Speaker 1: have physical objects in the room around you that are

70
00:04:28,200 --> 00:04:30,680
Speaker 1: also mapped to the virtual world, Meaning you could pick

71
00:04:30,800 --> 00:04:33,720
Speaker 1: up this physical object and you would see that reflected

72
00:04:34,000 --> 00:04:36,719
Speaker 1: within the virtual world, where you might pick up a

73
00:04:36,760 --> 00:04:40,000
Speaker 1: sword and shield or move a chair or something along

74
00:04:40,040 --> 00:04:44,920
Speaker 1: those lines. So augmented reality, virtual reality, and mixed reality

75
00:04:45,000 --> 00:04:48,120
Speaker 1: are all kind of inter related, so much so that

76
00:04:48,160 --> 00:04:53,279
Speaker 1: their histories also are very much inter related. And there's

77
00:04:53,279 --> 00:04:56,920
Speaker 1: some people who try to collect these different technologies, these

78
00:04:56,960 --> 00:05:00,880
Speaker 1: different approaches and put them under a co an umbrella,

79
00:05:00,920 --> 00:05:05,520
Speaker 1: and they tend to use the phrase alternate reality, which

80
00:05:05,520 --> 00:05:09,039
Speaker 1: is unfortunate because that's also a r but alternate reality

81
00:05:09,080 --> 00:05:12,440
Speaker 1: is kind of the umbrella for virtual, augmented and mixed reality.

82
00:05:13,680 --> 00:05:16,680
Speaker 1: Uh that that that kind of gives you the definition

83
00:05:16,720 --> 00:05:19,640
Speaker 1: of those basic terms, and it is important to understand

84
00:05:19,680 --> 00:05:23,120
Speaker 1: them because they're becoming more and more important today. You

85
00:05:23,279 --> 00:05:27,280
Speaker 1: are already probably aware of a lot of VR headsets

86
00:05:27,320 --> 00:05:29,760
Speaker 1: that are out there on the market as well as VR.

87
00:05:30,640 --> 00:05:34,279
Speaker 1: Uh Well, they're they're kind of like cases that you

88
00:05:34,320 --> 00:05:38,920
Speaker 1: slide your smartphone into, so your smartphone becomes the actual

89
00:05:39,320 --> 00:05:42,160
Speaker 1: display on a VR headset. The headset itself is more

90
00:05:42,240 --> 00:05:46,200
Speaker 1: or less just a head mounted case for your phone.

91
00:05:47,400 --> 00:05:48,800
Speaker 1: We've seen a lot of those come out over the

92
00:05:48,880 --> 00:05:51,479
Speaker 1: last few years. We've also seen a lot of a

93
00:05:51,760 --> 00:05:56,000
Speaker 1: R applications come out, typically for things like iPads and smartphones,

94
00:05:56,080 --> 00:06:00,040
Speaker 1: but we've also seen some hardware come out that for

95
00:06:00,160 --> 00:06:04,479
Speaker 1: wearable devices that falls into the augmented reality category, stuff

96
00:06:04,480 --> 00:06:06,920
Speaker 1: like Google Glass, which I'll talk about more a little

97
00:06:06,920 --> 00:06:11,039
Speaker 1: bit later in this episode. For augmented reality to work

98
00:06:11,279 --> 00:06:16,240
Speaker 1: to get this enhanced experience of reality around you, there

99
00:06:16,240 --> 00:06:19,440
Speaker 1: are a lot of technological components that have to come

100
00:06:19,480 --> 00:06:24,839
Speaker 1: together so that you actually do get experience that is meaningful.

101
00:06:25,800 --> 00:06:28,719
Speaker 1: You know, you have to have technology that quote unquote

102
00:06:28,800 --> 00:06:32,000
Speaker 1: knows where you are and what you are looking at

103
00:06:32,120 --> 00:06:34,560
Speaker 1: or what you are close to in order to get

104
00:06:34,560 --> 00:06:38,080
Speaker 1: that augmented experience. It wouldn't do me any good if

105
00:06:38,120 --> 00:06:42,200
Speaker 1: I put on an augmented reality headset, for example, and

106
00:06:42,360 --> 00:06:47,000
Speaker 1: stared at let's say, a famous painting, and instead of

107
00:06:47,040 --> 00:06:50,280
Speaker 1: getting information about the famous painting I see an exploded

108
00:06:50,400 --> 00:06:53,720
Speaker 1: view of an car engine That would make no sense.

109
00:06:54,120 --> 00:06:57,240
Speaker 1: So you have to build in technologies in order for

110
00:06:57,360 --> 00:07:00,599
Speaker 1: the a R to understand what it is you're trying

111
00:07:00,600 --> 00:07:04,760
Speaker 1: to do and to augment that experience, which meant that

112
00:07:04,800 --> 00:07:08,240
Speaker 1: we had to wait a pretty good long time for

113
00:07:08,560 --> 00:07:13,640
Speaker 1: the various technologies that we used to to create this

114
00:07:13,800 --> 00:07:17,920
Speaker 1: relationship to mature to a point where it was possible.

115
00:07:18,320 --> 00:07:20,920
Speaker 1: Sometimes we had technologies that would allow us to do it,

116
00:07:20,960 --> 00:07:26,400
Speaker 1: but it required uh tethering headsets to very large computers,

117
00:07:26,400 --> 00:07:29,520
Speaker 1: which meant that you didn't have really any mobility, and

118
00:07:29,800 --> 00:07:34,760
Speaker 1: uh it really limited the usefulness of the actual application.

119
00:07:35,520 --> 00:07:38,960
Speaker 1: In other cases, you could say things like your head

120
00:07:38,960 --> 00:07:42,920
Speaker 1: tracking technology was absolutely necessary for a R to develop

121
00:07:42,960 --> 00:07:47,480
Speaker 1: the way it did. GPS technology as well. Remember it

122
00:07:47,520 --> 00:07:52,559
Speaker 1: wasn't that long ago that we ordinary mere mortals didn't

123
00:07:52,640 --> 00:07:57,320
Speaker 1: have access to really accurate GPS information. For a very

124
00:07:57,360 --> 00:08:02,720
Speaker 1: long time that was purposely made less accurate. It was

125
00:08:02,760 --> 00:08:07,000
Speaker 1: a matter of national defense. It wasn't until the nineties

126
00:08:07,040 --> 00:08:10,840
Speaker 1: that you started to ce GPS become more accurate for

127
00:08:10,960 --> 00:08:15,080
Speaker 1: the basic consumer. Wait, back in the day, you might

128
00:08:15,160 --> 00:08:18,800
Speaker 1: get accuracy of up to around a hundred meters, which

129
00:08:18,840 --> 00:08:21,080
Speaker 1: is not great if you're looking for the next place

130
00:08:21,120 --> 00:08:24,000
Speaker 1: to make your turn. If it's a hundred meters away,

131
00:08:24,040 --> 00:08:27,760
Speaker 1: that's that's pretty far. But now it's within a few feet,

132
00:08:27,880 --> 00:08:30,600
Speaker 1: so it's much better. That sort of stuff all had

133
00:08:30,640 --> 00:08:33,959
Speaker 1: to come together in order for augmented reality to become

134
00:08:34,600 --> 00:08:38,600
Speaker 1: a viable I almost said a reality, but that just

135
00:08:38,640 --> 00:08:43,040
Speaker 1: starts to sound redundant at any rate. Let's talk about

136
00:08:43,080 --> 00:08:46,960
Speaker 1: some of these technologies we were. We really need things

137
00:08:46,960 --> 00:08:53,959
Speaker 1: like gyroscopes, accelerometers. These help devices understand their orientation where

138
00:08:54,000 --> 00:08:57,480
Speaker 1: they are in respect to something else, like are they

139
00:08:57,840 --> 00:08:59,760
Speaker 1: For a smartphone, it might be is it in landscape

140
00:08:59,760 --> 00:09:03,439
Speaker 1: mode or portrait mode? But for a head mounted display,

141
00:09:03,520 --> 00:09:07,440
Speaker 1: it would help give the the unit the information it

142
00:09:07,440 --> 00:09:09,480
Speaker 1: needs to know which way you're looking, like are you

143
00:09:09,600 --> 00:09:11,760
Speaker 1: looking to the east or to the west. That kind

144
00:09:11,760 --> 00:09:17,520
Speaker 1: of thing. UH also compasses obviously very important GPS sensors,

145
00:09:17,640 --> 00:09:20,920
Speaker 1: image recognition software, but has become really important so that

146
00:09:21,280 --> 00:09:25,320
Speaker 1: when you are looking at something UH, the system can

147
00:09:25,360 --> 00:09:28,480
Speaker 1: actually identify what that is. In some cases you can

148
00:09:28,480 --> 00:09:31,840
Speaker 1: get around this. You can design an a R system

149
00:09:31,880 --> 00:09:34,880
Speaker 1: where let's say you make a movie poster and the

150
00:09:34,960 --> 00:09:40,000
Speaker 1: a R application has the movie poster animate in some

151
00:09:40,080 --> 00:09:43,480
Speaker 1: way if you hold up a smartphone that's running the

152
00:09:43,520 --> 00:09:47,880
Speaker 1: appropriate app. So I'm just gonna take a movie from

153
00:09:47,880 --> 00:09:50,600
Speaker 1: my past that does not have an a R movie

154
00:09:50,640 --> 00:09:53,600
Speaker 1: poster associated with it, but one that I can talk

155
00:09:53,679 --> 00:09:56,160
Speaker 1: about as if it were a good example, and that

156
00:09:56,280 --> 00:10:00,360
Speaker 1: has to be Big Trouble in Little China, universally cleared

157
00:10:00,400 --> 00:10:02,800
Speaker 1: the best movie that has ever been made. So you've

158
00:10:02,840 --> 00:10:05,360
Speaker 1: got your Big Trouble and Little China poster up on

159
00:10:05,400 --> 00:10:08,679
Speaker 1: the wall, and you hold up your smartphone and you

160
00:10:08,720 --> 00:10:12,520
Speaker 1: activate your Big Trouble and Little China movie marketing app,

161
00:10:13,320 --> 00:10:16,440
Speaker 1: and the camera on your phone detect the poster. It's

162
00:10:16,640 --> 00:10:19,120
Speaker 1: you know, the posters there. Well. The app and the

163
00:10:19,160 --> 00:10:23,600
Speaker 1: poster together are able to construct the augmented experience because

164
00:10:24,120 --> 00:10:26,840
Speaker 1: there have been elements put into the poster that the

165
00:10:26,880 --> 00:10:30,840
Speaker 1: app is looking for. And once the app identifies that, like,

166
00:10:30,920 --> 00:10:34,440
Speaker 1: it sees maybe eight different points on the poster, and

167
00:10:34,520 --> 00:10:37,720
Speaker 1: because of the orientation of those points, it knows what

168
00:10:37,920 --> 00:10:40,760
Speaker 1: angle it's at, what height it's at in relation to

169
00:10:40,800 --> 00:10:44,960
Speaker 1: the phone, and can give you on your display the

170
00:10:45,040 --> 00:10:49,560
Speaker 1: augmented reality experience. In this case, it's obviously Jack Burton

171
00:10:49,600 --> 00:10:53,040
Speaker 1: and the Pork Chop Express eating a sandwich, because, as

172
00:10:53,040 --> 00:10:57,559
Speaker 1: we know, the most riveting scene in the movie unfolds

173
00:10:57,559 --> 00:11:00,720
Speaker 1: in this way. So that would be kind of an

174
00:11:00,760 --> 00:11:04,000
Speaker 1: augmented reality experience where you didn't have to worry about

175
00:11:04,280 --> 00:11:07,440
Speaker 1: every possible application out in the real world. You made

176
00:11:07,480 --> 00:11:10,840
Speaker 1: it for something very specific, which means in your software

177
00:11:10,880 --> 00:11:15,280
Speaker 1: you can have the camera look quote unquote for these

178
00:11:15,559 --> 00:11:20,560
Speaker 1: particular points of reference and thus create the augmented experience

179
00:11:20,559 --> 00:11:22,960
Speaker 1: in that way. If you want to take that and

180
00:11:23,000 --> 00:11:25,439
Speaker 1: move it to the real world where you can see

181
00:11:25,480 --> 00:11:29,120
Speaker 1: augmented information about just the world around you, it becomes

182
00:11:29,200 --> 00:11:32,680
Speaker 1: way more complicated. You have to have very sophisticated image

183
00:11:32,679 --> 00:11:37,280
Speaker 1: recognition software so that the camera picks up the images,

184
00:11:37,520 --> 00:11:41,040
Speaker 1: the software processes the information, identifies what those images are,

185
00:11:41,400 --> 00:11:45,280
Speaker 1: and gives you the relevant information. So working with all

186
00:11:45,320 --> 00:11:48,880
Speaker 1: the sensors, augmented reality can make this a possibility. So

187
00:11:48,920 --> 00:11:52,400
Speaker 1: another example, let's say you're out on the street in Atlanta.

188
00:11:52,720 --> 00:11:56,240
Speaker 1: You're here in my hometown, Atlanta, Georgia, and you're looking

189
00:11:56,240 --> 00:11:57,960
Speaker 1: at a building and you wonder what it is, and

190
00:11:57,960 --> 00:11:59,920
Speaker 1: you hold up your phone and you've got your little

191
00:12:00,360 --> 00:12:03,400
Speaker 1: map app that allows you to look at a real

192
00:12:03,440 --> 00:12:06,800
Speaker 1: world setting and tells you information about it, and it

193
00:12:06,840 --> 00:12:09,280
Speaker 1: tells you it's the Georgia Aquarium. Well, first of all,

194
00:12:09,320 --> 00:12:11,280
Speaker 1: you would probably know that already because the signage there

195
00:12:11,320 --> 00:12:14,920
Speaker 1: is actually pretty good. But the point being that this

196
00:12:14,960 --> 00:12:18,040
Speaker 1: would be uh something that would tap into the GPS

197
00:12:18,080 --> 00:12:20,319
Speaker 1: coordinates on your phone, so it would know where your

198
00:12:20,360 --> 00:12:23,440
Speaker 1: location was and help narrow that down. The compass would

199
00:12:23,440 --> 00:12:28,680
Speaker 1: tell it what direction you are facing the camera angle. Also,

200
00:12:28,760 --> 00:12:32,160
Speaker 1: when you have some image recognition going on there, the

201
00:12:32,200 --> 00:12:36,040
Speaker 1: accelerometer tells the orientation of the phone itself. All of

202
00:12:36,080 --> 00:12:39,440
Speaker 1: this data together would give the software the information needed

203
00:12:39,840 --> 00:12:45,160
Speaker 1: for it to display the label Georgia Aquarium on your phone.

204
00:12:45,200 --> 00:12:48,040
Speaker 1: And it all happens in an instant that's pretty amazing.

205
00:12:49,280 --> 00:12:52,480
Speaker 1: Typically you also have to have some other method to

206
00:12:53,000 --> 00:12:57,160
Speaker 1: communicate with a larger infrastructure, because we don't have the

207
00:12:57,200 --> 00:13:01,640
Speaker 1: capability of building an enormous, sleep powerful computer that has

208
00:13:01,760 --> 00:13:05,240
Speaker 1: all this real world information programmed into it and make

209
00:13:05,280 --> 00:13:09,480
Speaker 1: it a handheld or wearable device. So usually you have

210
00:13:09,600 --> 00:13:13,680
Speaker 1: to pair these devices with some other larger infrastructure. Sometimes

211
00:13:13,679 --> 00:13:17,439
Speaker 1: it's a double handshake. For example, with Google Glass, you

212
00:13:17,480 --> 00:13:20,720
Speaker 1: would use Bluetooth to connect Google Glass to a smartphone.

213
00:13:21,080 --> 00:13:24,200
Speaker 1: Then the smartphone would have the connection to the larger

214
00:13:24,240 --> 00:13:30,920
Speaker 1: internet through your smartphones UH cell service provider. So while

215
00:13:30,960 --> 00:13:36,280
Speaker 1: you're experiencing the augmented reality through the Google Glass, it's

216
00:13:36,280 --> 00:13:39,640
Speaker 1: actually communicating through your phone to the infrastructure to get

217
00:13:39,679 --> 00:13:42,120
Speaker 1: the data it needs to show you the information. It's

218
00:13:42,120 --> 00:13:45,680
Speaker 1: showing you very important elements. And all of these components,

219
00:13:45,760 --> 00:13:48,400
Speaker 1: like I said, came together more or less around the

220
00:13:48,480 --> 00:13:52,640
Speaker 1: same time. Most of them were being developed independently of

221
00:13:52,679 --> 00:13:54,920
Speaker 1: each other, and it's just that now we're seeing them

222
00:13:54,920 --> 00:13:58,520
Speaker 1: all converge. That's an old favorite word here at tech

223
00:13:58,559 --> 00:14:02,599
Speaker 1: stuff converge together to create the augmented reality experience and

224
00:14:02,640 --> 00:14:05,480
Speaker 1: make it possible. So how did we get here? How

225
00:14:05,559 --> 00:14:09,560
Speaker 1: did these different elements develop? Well, there are a whole

226
00:14:09,559 --> 00:14:12,720
Speaker 1: bunch of technology pioneers who really created the foundation for

227
00:14:12,760 --> 00:14:15,960
Speaker 1: augmented reality as well as virtual reality and mixed reality.

228
00:14:16,400 --> 00:14:18,800
Speaker 1: But one that I think we really need to concentrate

229
00:14:18,840 --> 00:14:23,080
Speaker 1: on at first is Ivan Sutherland. Now. Sutherland was born

230
00:14:23,160 --> 00:14:26,880
Speaker 1: in Hastings, Nebraska in nineteen thirty eight, and as a

231
00:14:26,960 --> 00:14:32,240
Speaker 1: kid he was fascinated with mathematics, particularly geometry, and also

232
00:14:32,280 --> 00:14:36,520
Speaker 1: with engineering. He began to study and experiment with computers

233
00:14:36,680 --> 00:14:39,240
Speaker 1: while he was in school, and this was at a

234
00:14:39,240 --> 00:14:41,640
Speaker 1: time where personal computers weren't a thing. There were no

235
00:14:41,720 --> 00:14:44,440
Speaker 1: personal computers at this point. Computers were actually pretty rare

236
00:14:44,480 --> 00:14:47,960
Speaker 1: and they were huge, and in fact, they often would

237
00:14:48,000 --> 00:14:52,200
Speaker 1: rely upon physical media formats like punch punch cards or

238
00:14:52,280 --> 00:14:57,280
Speaker 1: paper tape to read a program. So you didn't even

239
00:14:57,280 --> 00:15:00,200
Speaker 1: have a disk or like certainly nothing like a US

240
00:15:00,200 --> 00:15:03,240
Speaker 1: Beat thumb drive or anything like that. You you actually

241
00:15:03,240 --> 00:15:06,080
Speaker 1: had to put physical media into the machine for it

242
00:15:06,120 --> 00:15:10,200
Speaker 1: to read and then execute whatever program you had designed

243
00:15:10,200 --> 00:15:14,320
Speaker 1: for that device. He went to college at what is

244
00:15:14,360 --> 00:15:18,320
Speaker 1: now Carnegie Mellon University on a full scholarship. He graduated

245
00:15:18,320 --> 00:15:20,280
Speaker 1: with a Bachelor of Science degree. He would then go

246
00:15:20,320 --> 00:15:22,680
Speaker 1: on to earn a master's degree at cal Tech and

247
00:15:22,800 --> 00:15:26,880
Speaker 1: a PhD in electrical engineering from m I T. And

248
00:15:27,000 --> 00:15:31,840
Speaker 1: actually his doctoral thesis supervisor was Claude Shannon, And we

249
00:15:31,920 --> 00:15:34,040
Speaker 1: talked about Claude Shannon back in the two thousand and

250
00:15:34,080 --> 00:15:38,040
Speaker 1: fourteen episode who is Claude Shannon? Um. We recorded that

251
00:15:38,120 --> 00:15:41,680
Speaker 1: not too long after Shannon's passing. So if you want

252
00:15:41,680 --> 00:15:45,280
Speaker 1: to hear a really interesting story about a pioneer in

253
00:15:45,280 --> 00:15:47,920
Speaker 1: computer science, you should go check out that two thousand

254
00:15:47,920 --> 00:15:52,240
Speaker 1: and fourteen episode. Back to Sutherland. For his thesis, he

255
00:15:52,360 --> 00:15:56,400
Speaker 1: created something called sketch Pad and that was really, by

256
00:15:56,440 --> 00:16:00,920
Speaker 1: most accounts, the first computer graphical user interface or gooey.

257
00:16:00,960 --> 00:16:05,160
Speaker 1: A graphic goal user interface means that you interact with

258
00:16:05,280 --> 00:16:10,640
Speaker 1: the computer through graphics representing various commands on the computer.

259
00:16:10,760 --> 00:16:13,960
Speaker 1: Windows and the Mac operating system are both examples of

260
00:16:13,960 --> 00:16:17,800
Speaker 1: graphical user interfaces, as is the interface on your smartphone.

261
00:16:17,880 --> 00:16:21,800
Speaker 1: If you have a smartphone where you choose applications on

262
00:16:21,840 --> 00:16:25,960
Speaker 1: a screen, that's a graphical user interface. Well, Sutherland created

263
00:16:26,000 --> 00:16:28,520
Speaker 1: what is largely considered to be the first one of those.

264
00:16:29,080 --> 00:16:32,520
Speaker 1: After college, he entered military service and he was assigned

265
00:16:32,560 --> 00:16:36,480
Speaker 1: to the National Security Agency. We have great friends there.

266
00:16:37,320 --> 00:16:40,600
Speaker 1: I assume I'm sure they're listening, because they're listening to

267
00:16:40,680 --> 00:16:43,800
Speaker 1: everything at any rate. He entered the n s A

268
00:16:43,880 --> 00:16:47,000
Speaker 1: as an electrical engineer, and in nineteen sixty four he

269
00:16:47,080 --> 00:16:50,040
Speaker 1: replaced J. C. R. Lick Lighter as the head of

270
00:16:50,120 --> 00:16:56,440
Speaker 1: DARPA's Information Processing Techniques Office, or TIPTOE. And also, by

271
00:16:56,560 --> 00:17:01,520
Speaker 1: back then, DARPA wasn't DARPA, it was just ARPA. Uh uh,

272
00:17:01,640 --> 00:17:03,400
Speaker 1: So this is the same group, by the way, that

273
00:17:03,400 --> 00:17:05,879
Speaker 1: would end up doing a lot of work that would

274
00:17:05,920 --> 00:17:09,400
Speaker 1: form the Arpanette a few years later, and the Arpanette

275
00:17:09,440 --> 00:17:13,560
Speaker 1: was the predecessor to the Internet in some ways. At least,

276
00:17:13,600 --> 00:17:16,840
Speaker 1: the Arpanet was what ended up being the the building

277
00:17:16,920 --> 00:17:21,560
Speaker 1: blocks for the infrastructure that would become the Internet. Now,

278
00:17:21,600 --> 00:17:24,200
Speaker 1: all of that work happened after Sutherland had already departed

279
00:17:24,200 --> 00:17:30,160
Speaker 1: the organization. His work became a fundamental component of both

280
00:17:30,240 --> 00:17:33,280
Speaker 1: virtual and augmented reality. As I mentioned earlier, in nine

281
00:17:34,600 --> 00:17:36,959
Speaker 1: he wrote a piece and essay. It's very short, it's

282
00:17:37,080 --> 00:17:39,280
Speaker 1: very easy read, and you can find it online. The

283
00:17:39,320 --> 00:17:42,640
Speaker 1: title of the essay is the Ultimate Display. And if

284
00:17:42,680 --> 00:17:46,720
Speaker 1: you ever do any research in virtual reality or augmented reality,

285
00:17:46,960 --> 00:17:49,880
Speaker 1: this essay is going to pop up in your research,

286
00:17:50,240 --> 00:17:52,480
Speaker 1: so go ahead and read it. It's like two pages long,

287
00:17:52,560 --> 00:17:56,240
Speaker 1: so it goes very quickly. In that essay he talked

288
00:17:56,280 --> 00:18:02,520
Speaker 1: about several ideas, including the idealized display, the ultimate display,

289
00:18:02,720 --> 00:18:06,760
Speaker 1: something that would be the the furthest you could go

290
00:18:08,240 --> 00:18:11,040
Speaker 1: with display technology. Now, keep in mind, in his time,

291
00:18:12,280 --> 00:18:13,879
Speaker 1: by his time he's still alive, by the way, but

292
00:18:14,320 --> 00:18:17,240
Speaker 1: this time in the nineties sixties, he uh, you know,

293
00:18:17,400 --> 00:18:22,879
Speaker 1: things were just restricted to monitors. You might have a

294
00:18:22,960 --> 00:18:26,879
Speaker 1: light pen, but usually you just use a keyboard. Like

295
00:18:27,119 --> 00:18:30,919
Speaker 1: it was pretty bare bones. They said, let's push this

296
00:18:31,040 --> 00:18:35,119
Speaker 1: as far as we can imagine it. And in his example,

297
00:18:35,240 --> 00:18:38,200
Speaker 1: he thought of a room that would be completely controlled

298
00:18:38,240 --> 00:18:42,520
Speaker 1: by computers. Everything you would experience within that room would

299
00:18:42,520 --> 00:18:47,600
Speaker 1: be generated by a computer. Everything you see here, smell, taste,

300
00:18:47,720 --> 00:18:51,320
Speaker 1: and touch, all of it generated by computers. The computer

301
00:18:51,359 --> 00:18:54,359
Speaker 1: would even be able to form physical objects out of

302
00:18:54,400 --> 00:18:58,280
Speaker 1: pure matter itself. Now, he wasn't suggesting that this would

303
00:18:58,320 --> 00:19:01,160
Speaker 1: ever be a device that we would actually be able

304
00:19:01,200 --> 00:19:03,960
Speaker 1: to build. He was just saying, what is the ultimate

305
00:19:04,600 --> 00:19:10,280
Speaker 1: incarnation of display technology? And if you read it, you realize, oh,

306
00:19:10,320 --> 00:19:12,840
Speaker 1: this is where the Star Trek Next Generation writers got

307
00:19:12,840 --> 00:19:16,119
Speaker 1: their idea for the Holidack. But unlike Star Trek the

308
00:19:16,160 --> 00:19:19,439
Speaker 1: Next Generation, the Ultimate Display would not go on the

309
00:19:19,480 --> 00:19:22,000
Speaker 1: Fritz every other episode and try to kill the crew.

310
00:19:23,040 --> 00:19:27,920
Speaker 1: It was better than that. The Ultimate Display was sort

311
00:19:27,920 --> 00:19:32,600
Speaker 1: of a a foundational like Philosophically, it was foundational for

312
00:19:33,320 --> 00:19:36,240
Speaker 1: virtual reality and augmented reality. This idea of a very

313
00:19:36,280 --> 00:19:42,000
Speaker 1: immersive experience where you, as a user, are surrounded somehow

314
00:19:42,320 --> 00:19:47,240
Speaker 1: by this computer generated experience. And that's true both with

315
00:19:47,280 --> 00:19:52,200
Speaker 1: augmented reality and virtual reality. And augmented reality, the real

316
00:19:52,240 --> 00:19:56,000
Speaker 1: world is still there, but you get this enhanced experience

317
00:19:56,040 --> 00:20:02,040
Speaker 1: that is completely computer generated. So in nineteen sixty eight,

318
00:20:02,680 --> 00:20:07,399
Speaker 1: Sutherland and a student named Danny Cohen would create a VR,

319
00:20:07,840 --> 00:20:12,640
Speaker 1: a r head mounted display or h MD, and they

320
00:20:12,760 --> 00:20:17,440
Speaker 1: nicknamed it the Sword of Damocles. Why because you had

321
00:20:17,480 --> 00:20:19,680
Speaker 1: to suspend it from the ceiling. It was too heavy

322
00:20:19,720 --> 00:20:22,439
Speaker 1: to wear on your head. You needed it to be

323
00:20:22,560 --> 00:20:27,440
Speaker 1: nice and sturdy. Uh. It included transparent lenses, which meant

324
00:20:27,480 --> 00:20:31,199
Speaker 1: you could overlay computer information on the lenses themselves, and

325
00:20:31,240 --> 00:20:33,680
Speaker 1: thus you could look through the lenses at the real

326
00:20:33,720 --> 00:20:38,239
Speaker 1: world and have these wire framed graphics on top of

327
00:20:38,240 --> 00:20:40,639
Speaker 1: what you were looking at. And it also had a

328
00:20:40,680 --> 00:20:44,640
Speaker 1: magnetic tracking system, meaning that it had sensors that could

329
00:20:44,640 --> 00:20:47,760
Speaker 1: detect magnetic fields, and as you turned your head or

330
00:20:47,920 --> 00:20:51,840
Speaker 1: you change the inclination of your head, it would change

331
00:20:51,880 --> 00:20:55,000
Speaker 1: the magnetic field and this would be relayed as a

332
00:20:55,119 --> 00:21:00,119
Speaker 1: command to the visual center the actual lenses themselves, so

333
00:21:00,240 --> 00:21:03,439
Speaker 1: that it would the change would be reflected in what

334
00:21:03,520 --> 00:21:06,679
Speaker 1: you saw. So if you have a virtual environment and

335
00:21:06,720 --> 00:21:08,760
Speaker 1: you turn your head to the left, you want the

336
00:21:08,880 --> 00:21:11,639
Speaker 1: view within the virtual environment to go to the left too,

337
00:21:11,920 --> 00:21:14,919
Speaker 1: but without head tracking technology that's impossible. So this was

338
00:21:14,960 --> 00:21:17,880
Speaker 1: a very early example of head tracking technology. And again

339
00:21:17,880 --> 00:21:22,080
Speaker 1: it used magnets magnetic fields in order to do that. Uh.

340
00:21:22,680 --> 00:21:26,760
Speaker 1: Obviously it's also really important for augmented reality. Again, if

341
00:21:27,080 --> 00:21:30,160
Speaker 1: the a R system doesn't detect that you are looking around,

342
00:21:30,680 --> 00:21:34,400
Speaker 1: then you're not getting relevant information, not for the specific

343
00:21:34,400 --> 00:21:38,399
Speaker 1: thing you are looking at. Anyway, as I said, the

344
00:21:38,400 --> 00:21:41,080
Speaker 1: graphics were pretty primitive. There were wire frame drawings, but

345
00:21:41,119 --> 00:21:46,960
Speaker 1: they still showed that this was a viable approach to

346
00:21:47,040 --> 00:21:51,760
Speaker 1: technology using HMD for augmented or virtual reality use. Oh

347
00:21:51,800 --> 00:21:54,120
Speaker 1: and one other note I should make so a lot

348
00:21:54,160 --> 00:21:56,520
Speaker 1: of people say the sort of Damocles was the first

349
00:21:56,520 --> 00:21:59,320
Speaker 1: head mounted display, and they say, you know, this is

350
00:21:59,359 --> 00:22:03,080
Speaker 1: the first m D was made in nineteen I take

351
00:22:03,200 --> 00:22:06,760
Speaker 1: issue with that. I don't think of the sort of

352
00:22:06,840 --> 00:22:10,359
Speaker 1: Damocles as the first head mounted display. That to me

353
00:22:10,560 --> 00:22:14,119
Speaker 1: should go to a different invention called the head site

354
00:22:15,240 --> 00:22:18,120
Speaker 1: h G A D S I G h T now

355
00:22:18,160 --> 00:22:22,280
Speaker 1: that was developed by Philco and unlike the sort of Damocles,

356
00:22:22,800 --> 00:22:27,200
Speaker 1: it didn't create a virtual world. Instead, the head site

357
00:22:27,480 --> 00:22:31,919
Speaker 1: was sort of a remote viewfinder for a video camera.

358
00:22:32,960 --> 00:22:36,920
Speaker 1: So imagine that you've got a camera mounted on a

359
00:22:36,960 --> 00:22:42,520
Speaker 1: mechanical uh swiveling mount, so you can move it left right,

360
00:22:42,560 --> 00:22:46,239
Speaker 1: you can change the orientation the inclination as well, and

361
00:22:46,280 --> 00:22:49,120
Speaker 1: then you have that mapped to a head mounted display,

362
00:22:49,200 --> 00:22:51,440
Speaker 1: so that if I put the display on and I

363
00:22:51,480 --> 00:22:53,960
Speaker 1: looked to the left, the camera pans to the left.

364
00:22:54,160 --> 00:22:55,880
Speaker 1: If I look to the right, it pans to the right.

365
00:22:56,000 --> 00:22:59,720
Speaker 1: That sort of thing it was meant to be away

366
00:22:59,800 --> 00:23:03,360
Speaker 1: for for people to operate a camera in a remote

367
00:23:03,400 --> 00:23:07,240
Speaker 1: location that might not be very friendly to a human

368
00:23:07,280 --> 00:23:11,040
Speaker 1: being standing there. For example, the exterior of an aircraft.

369
00:23:11,440 --> 00:23:13,520
Speaker 1: You could have a camera mounted on the outside of

370
00:23:13,520 --> 00:23:17,080
Speaker 1: your aircraft that would allow an engineer on the inside

371
00:23:17,520 --> 00:23:22,000
Speaker 1: to look around and maybe help a pilot land or

372
00:23:22,200 --> 00:23:25,840
Speaker 1: navigate in a dangerous situation, or just get an idea

373
00:23:26,000 --> 00:23:30,440
Speaker 1: of the status of the aircraft itself. This was very

374
00:23:30,520 --> 00:23:35,120
Speaker 1: much a technology that was being pushed by the military,

375
00:23:36,000 --> 00:23:39,879
Speaker 1: an idea to create more military uses using this technology

376
00:23:39,920 --> 00:23:44,560
Speaker 1: to make the military more competent, more adept at very

377
00:23:44,680 --> 00:23:50,520
Speaker 1: rapid changing situations on the technology front, So headsite preceded

378
00:23:50,960 --> 00:23:53,760
Speaker 1: the sort of damocles by about seven years. That came

379
00:23:53,760 --> 00:23:56,439
Speaker 1: out around nineteen sixty one, but again it wasn't a

380
00:23:56,480 --> 00:24:00,320
Speaker 1: virtual reality headset or an augmented reality headset. Was kind

381
00:24:00,320 --> 00:24:03,479
Speaker 1: of a like I said, a remote viewfinder. But still

382
00:24:03,800 --> 00:24:06,760
Speaker 1: I consider that to be the earliest head mounted display,

383
00:24:06,920 --> 00:24:10,639
Speaker 1: not the sort of damocles. However, Sutherland would end up

384
00:24:10,640 --> 00:24:13,760
Speaker 1: going on to make lots of other contributions in computer

385
00:24:13,800 --> 00:24:18,200
Speaker 1: graphics as well as the overall concepts that would guide

386
00:24:18,200 --> 00:24:22,119
Speaker 1: both virtual reality and augmented reality development over the next

387
00:24:22,119 --> 00:24:26,199
Speaker 1: several decades. But now it'll be time for me to

388
00:24:26,280 --> 00:24:29,080
Speaker 1: kind of move away from Sutherland to talk about some

389
00:24:29,160 --> 00:24:32,440
Speaker 1: other developments that were important in a R. And before

390
00:24:32,440 --> 00:24:35,800
Speaker 1: I get to that, let's take a quick break to

391
00:24:35,960 --> 00:24:46,800
Speaker 1: thank our sponsor. All Right, we just left off with

392
00:24:46,920 --> 00:24:52,040
Speaker 1: Ivan Sutherland. Now let's talk about a different father of

393
00:24:52,359 --> 00:24:58,879
Speaker 1: augmented reality, Myron Krueger or Dr Myron Krueger. In nineteen four,

394
00:24:59,000 --> 00:25:04,440
Speaker 1: Dr Krueger create an augmented reality lab called Video Place. Uh.

395
00:25:04,480 --> 00:25:09,000
Speaker 1: He was really into this idea of seeing the interaction

396
00:25:09,119 --> 00:25:13,560
Speaker 1: of technology and people in artistic ways. He really wanted

397
00:25:13,600 --> 00:25:19,640
Speaker 1: to explore artistic expressions using technology and people working together.

398
00:25:20,960 --> 00:25:23,600
Speaker 1: So he wanted to create an artificial reality environment that

399
00:25:23,680 --> 00:25:27,080
Speaker 1: didn't require the user to wear special equipment. You wouldn't

400
00:25:27,080 --> 00:25:29,600
Speaker 1: have to put on a head mold display, or wear

401
00:25:29,960 --> 00:25:35,080
Speaker 1: special gloves, or use any kind of device to control

402
00:25:35,280 --> 00:25:41,160
Speaker 1: your actions, because that's a barrier between you and the experience. Instead,

403
00:25:42,080 --> 00:25:45,800
Speaker 1: his version consisted of a laboratory that had several rooms

404
00:25:46,160 --> 00:25:51,080
Speaker 1: all network together, and each room had a video camera

405
00:25:51,160 --> 00:25:54,000
Speaker 1: in it and a projector and a screen. Now, the

406
00:25:54,080 --> 00:25:57,040
Speaker 1: video camera would pick up the motions of the person

407
00:25:57,080 --> 00:26:00,960
Speaker 1: inside the room. It would send information to the projector,

408
00:26:01,119 --> 00:26:05,159
Speaker 1: which would then project the person's silhouette on the screen.

409
00:26:05,480 --> 00:26:08,800
Speaker 1: And the silhouette was typically a really bright color, and

410
00:26:08,840 --> 00:26:11,560
Speaker 1: you could move around and your silhouette would move around,

411
00:26:11,640 --> 00:26:14,240
Speaker 1: So you almost became like a puppet master controlling your

412
00:26:14,280 --> 00:26:17,919
Speaker 1: own silhouette. But then he started to incorporate other things,

413
00:26:17,960 --> 00:26:21,919
Speaker 1: like other elements that were virtually on the screen. The

414
00:26:21,920 --> 00:26:24,760
Speaker 1: projector was projecting things that were on the screen but

415
00:26:24,840 --> 00:26:28,040
Speaker 1: not in the actual real room itself. So imagine a

416
00:26:28,080 --> 00:26:31,400
Speaker 1: ball and a ball is being projected on the screen. Well,

417
00:26:31,440 --> 00:26:33,719
Speaker 1: you could move around so that your silhouette would interact

418
00:26:33,720 --> 00:26:36,600
Speaker 1: with the ball and the ball would bounce away. That

419
00:26:36,760 --> 00:26:38,959
Speaker 1: sort of thing, so you would be able to interact

420
00:26:39,000 --> 00:26:43,000
Speaker 1: with virtual environments by moving around in a real physical space.

421
00:26:43,560 --> 00:26:49,400
Speaker 1: And while those objects weren't really there in front of you,

422
00:26:49,400 --> 00:26:51,919
Speaker 1: you could see the representation of them on the screen.

423
00:26:52,280 --> 00:26:54,680
Speaker 1: And this was really powerful stuff. And remember I said

424
00:26:54,720 --> 00:26:57,160
Speaker 1: these rooms were all network together, so you could actually

425
00:26:57,359 --> 00:27:00,200
Speaker 1: have a system where a person in one room and

426
00:27:00,240 --> 00:27:03,919
Speaker 1: a person in another room both have their silhouettes projected

427
00:27:04,119 --> 00:27:09,440
Speaker 1: together in their respective rooms on the screen, and your

428
00:27:09,880 --> 00:27:12,720
Speaker 1: silhouette would be one color, the other person's silhouette would

429
00:27:12,720 --> 00:27:15,840
Speaker 1: be a different color, and you could interact with one another.

430
00:27:16,560 --> 00:27:23,160
Speaker 1: And according to reports from this art experiment, they noticed

431
00:27:23,200 --> 00:27:26,800
Speaker 1: that whenever people would have their silhouettes cross one another,

432
00:27:27,240 --> 00:27:30,760
Speaker 1: they would actually recoil in their physical rooms. Keep in

433
00:27:30,800 --> 00:27:33,040
Speaker 1: mind they're in different rooms, they're not in the same

434
00:27:33,040 --> 00:27:35,840
Speaker 1: one together, they would recoil as if they had made

435
00:27:35,920 --> 00:27:39,960
Speaker 1: physical contact or bumped into someone. So it showed that

436
00:27:39,960 --> 00:27:44,600
Speaker 1: there was a very powerful psychological element to this virtual presence.

437
00:27:44,960 --> 00:27:48,440
Speaker 1: And again that psychological element plays a huge important role

438
00:27:48,640 --> 00:27:52,000
Speaker 1: in VR and a R research and development, not just

439
00:27:52,080 --> 00:27:55,840
Speaker 1: for creating products, but just to understand how we process

440
00:27:55,880 --> 00:28:00,520
Speaker 1: information and incorporated into our sense of reality. Not to

441
00:28:00,520 --> 00:28:04,480
Speaker 1: get too deep, for you guys. So experimentation in the

442
00:28:04,520 --> 00:28:07,840
Speaker 1: field continued over the years. In the early nineteen eighties,

443
00:28:07,920 --> 00:28:11,199
Speaker 1: Dr Krueger would write a book and publish it about

444
00:28:11,320 --> 00:28:15,800
Speaker 1: artificial realities. But while the principles for augmented reality were established,

445
00:28:15,920 --> 00:28:20,600
Speaker 1: the technologies were still rather unwieldy. They were large, they

446
00:28:20,600 --> 00:28:24,560
Speaker 1: weren't reliable, and it would require several years of work

447
00:28:24,760 --> 00:28:29,320
Speaker 1: to improve those technologies, to create miniaturization strategies to get

448
00:28:29,320 --> 00:28:32,280
Speaker 1: the elements down to a size that was more practical

449
00:28:32,520 --> 00:28:35,560
Speaker 1: for that sort of use and wouldn't require you to

450
00:28:35,600 --> 00:28:39,560
Speaker 1: have a head mound display mounted to the ceiling. And

451
00:28:39,600 --> 00:28:41,800
Speaker 1: all of that took time, but you could tell that

452
00:28:41,880 --> 00:28:46,800
Speaker 1: the ideas underlying augmented and virtual reality were already in place.

453
00:28:47,840 --> 00:28:52,720
Speaker 1: In n there was a Boeing researcher named Tom Coddell

454
00:28:52,960 --> 00:28:58,240
Speaker 1: who coined the term augmented reality, and he was specifically

455
00:28:58,320 --> 00:29:01,360
Speaker 1: using it to talk about this approach to overlaying digital

456
00:29:01,400 --> 00:29:03,959
Speaker 1: information on top of our physical world to enhance it

457
00:29:04,080 --> 00:29:08,120
Speaker 1: in some way. Now. Dr Cordell earned a PhD in

458
00:29:08,160 --> 00:29:12,480
Speaker 1: physics and astronomy from the University of Arizona, and before

459
00:29:12,480 --> 00:29:16,120
Speaker 1: contributing the term augmented reality to the public lexicon. He

460
00:29:16,200 --> 00:29:20,160
Speaker 1: did extensive work and artificial intelligence research and development. He

461
00:29:20,240 --> 00:29:22,640
Speaker 1: also became a professor in the fields of electrical and

462
00:29:22,640 --> 00:29:26,960
Speaker 1: computer engineering at the University of New Mexico. So when

463
00:29:26,960 --> 00:29:29,600
Speaker 1: he was working with Boeing, he used this phrase to

464
00:29:29,640 --> 00:29:32,760
Speaker 1: talk about specific system he was working on, an augmented

465
00:29:32,800 --> 00:29:35,360
Speaker 1: reality system, and the whole purpose of this was to

466
00:29:35,560 --> 00:29:41,680
Speaker 1: help people who were helping construct airplanes lay cables properly.

467
00:29:42,320 --> 00:29:46,680
Speaker 1: The whole idea was to use this system so that uh,

468
00:29:46,800 --> 00:29:49,760
Speaker 1: an electrician can see exactly where the cable needed to

469
00:29:49,840 --> 00:29:55,720
Speaker 1: go inside the partly constructed cabin of an aircraft, and

470
00:29:55,760 --> 00:29:58,520
Speaker 1: that way you could follow the directions that you see

471
00:29:58,560 --> 00:30:02,600
Speaker 1: through your display, lay the actual cable down where the

472
00:30:02,680 --> 00:30:06,440
Speaker 1: guide tells you to go, and then you would have

473
00:30:06,520 --> 00:30:11,840
Speaker 1: a properly wired airplane. Uh. And I'm sure, as we're

474
00:30:11,840 --> 00:30:17,560
Speaker 1: all aware, properly wired airplanes are good airplanes. Improperly wired

475
00:30:17,600 --> 00:30:20,440
Speaker 1: airplanes are not so good. So it was a very

476
00:30:20,480 --> 00:30:25,200
Speaker 1: important system to make this much more smooth and fast,

477
00:30:25,320 --> 00:30:28,080
Speaker 1: and it meant that you didn't have to have as

478
00:30:28,920 --> 00:30:33,560
Speaker 1: as many experts to guide the process. You could actually

479
00:30:33,560 --> 00:30:36,840
Speaker 1: have someone come in who had never done this before

480
00:30:37,320 --> 00:30:41,480
Speaker 1: and just follow the directions through this augmented reality set

481
00:30:41,560 --> 00:30:47,840
Speaker 1: system and they could wire the airplane properly, so really

482
00:30:48,000 --> 00:30:52,040
Speaker 1: clever means of using augmented reality. Also, we would end

483
00:30:52,080 --> 00:30:55,320
Speaker 1: up seeing that same sort of philosophy used again and

484
00:30:55,360 --> 00:30:59,920
Speaker 1: again in the future in more sophisticated UH types of technology.

485
00:31:00,040 --> 00:31:03,479
Speaker 1: It was the exact same approach, exact same idea underlying it.

486
00:31:04,720 --> 00:31:09,440
Speaker 1: In Lewis Rosenberg proposed a system that the Air Force

487
00:31:09,560 --> 00:31:12,400
Speaker 1: could use to allow someone to control devices from a

488
00:31:12,480 --> 00:31:17,000
Speaker 1: remote location, and that consisted of a video camera which

489
00:31:17,040 --> 00:31:20,040
Speaker 1: would provide the visual data to the user through a

490
00:31:20,040 --> 00:31:22,440
Speaker 1: head mounted display. They would wear the display on their

491
00:31:22,480 --> 00:31:25,120
Speaker 1: heads or they would look at a screen, but typically

492
00:31:25,160 --> 00:31:28,640
Speaker 1: they'd wear a display, and then they would also wear

493
00:31:28,720 --> 00:31:32,680
Speaker 1: an exoskeleton on their upper body that would allow them

494
00:31:32,720 --> 00:31:38,280
Speaker 1: to control some sort of robotic device, typically robotic arms.

495
00:31:38,960 --> 00:31:40,880
Speaker 1: And usually the way this would work is that the

496
00:31:40,960 --> 00:31:44,160
Speaker 1: display was designed in such a way with a video

497
00:31:44,240 --> 00:31:47,920
Speaker 1: camera so that the view that the person had it

498
00:31:47,960 --> 00:31:51,760
Speaker 1: made it look like the robot arms were their actual arms,

499
00:31:52,480 --> 00:31:55,000
Speaker 1: which required a little bit of trickery on the part

500
00:31:55,080 --> 00:31:59,000
Speaker 1: of Rosenberg. They had to fudge the distances between the

501
00:31:59,080 --> 00:32:02,240
Speaker 1: video camera and the robotic arms to give this this

502
00:32:02,320 --> 00:32:06,720
Speaker 1: sort of feeling that the robot arms represented your actual arms.

503
00:32:06,760 --> 00:32:09,360
Speaker 1: So you move your arms inside the exoskeleton, and the

504
00:32:09,440 --> 00:32:13,360
Speaker 1: robot arms would move as well at the remote location,

505
00:32:13,520 --> 00:32:16,280
Speaker 1: so you it's kind of like a really fancy remote control.

506
00:32:17,920 --> 00:32:23,280
Speaker 1: Now imagine that the robot arms are holding various tools. Uh.

507
00:32:23,320 --> 00:32:27,320
Speaker 1: The suit would also provide haptic feedback, that touch based

508
00:32:27,440 --> 00:32:29,920
Speaker 1: feedback to let a user know more about what is

509
00:32:29,960 --> 00:32:32,840
Speaker 1: going on when they're operating the arms. So if you

510
00:32:32,880 --> 00:32:36,280
Speaker 1: were to have do something that would make a robot

511
00:32:36,360 --> 00:32:41,080
Speaker 1: arm encounter resistance, then you would feel haptic feedback in

512
00:32:41,120 --> 00:32:43,920
Speaker 1: the suit that would indicate, oh, you're you're going beyond

513
00:32:44,000 --> 00:32:46,800
Speaker 1: the parameters of where this robot arm is capable of going.

514
00:32:47,600 --> 00:32:50,480
Speaker 1: So you learned very quickly where where you can operate

515
00:32:50,520 --> 00:32:54,560
Speaker 1: within that suit and make sure that you are not

516
00:32:54,640 --> 00:32:59,640
Speaker 1: pushing it beyond its limits. You could also uh end

517
00:32:59,720 --> 00:33:02,840
Speaker 1: up using these tools to do various things in this

518
00:33:02,920 --> 00:33:07,640
Speaker 1: remote environment. Now, Rosenberg called his system virtual fixtures, which

519
00:33:07,680 --> 00:33:09,960
Speaker 1: meant that the user would see these virtual overlays on

520
00:33:10,040 --> 00:33:12,320
Speaker 1: top of a real environment that they were looking at.

521
00:33:12,880 --> 00:33:16,280
Speaker 1: So I'm going to give a very basic example that

522
00:33:16,920 --> 00:33:19,400
Speaker 1: to illustrate this. Because it's hard to imagine, it's hard

523
00:33:19,440 --> 00:33:21,840
Speaker 1: to get it across in words. But let's say you're

524
00:33:21,840 --> 00:33:24,640
Speaker 1: looking through a headmund display and in front of you

525
00:33:24,960 --> 00:33:30,800
Speaker 1: is a board, wooden board, and it's just a regular

526
00:33:30,840 --> 00:33:33,640
Speaker 1: wooden board. There's nothing painted on it or anything in

527
00:33:33,640 --> 00:33:36,640
Speaker 1: the real world, and it's in a room that's across

528
00:33:36,720 --> 00:33:39,240
Speaker 1: the building from you. You cannot see this with your

529
00:33:39,240 --> 00:33:41,600
Speaker 1: own eyes. You can only see it through the video camera.

530
00:33:42,880 --> 00:33:47,080
Speaker 1: The virtual fixture overlay might be a series of circles,

531
00:33:47,360 --> 00:33:49,760
Speaker 1: and the circles are things that you were meant to

532
00:33:49,800 --> 00:33:52,360
Speaker 1: cut out of the board using the robot arms and

533
00:33:52,400 --> 00:33:56,320
Speaker 1: a tool that's right there inside the physical environment across

534
00:33:56,360 --> 00:33:59,640
Speaker 1: the building from you. So you follow the patterns that

535
00:33:59,720 --> 00:34:03,520
Speaker 1: you in this virtual overlay and you complete the task.

536
00:34:04,040 --> 00:34:07,520
Speaker 1: That's a very simple example. And uh, this system was

537
00:34:07,560 --> 00:34:10,239
Speaker 1: meant to allow for that. That's what he would call

538
00:34:10,280 --> 00:34:14,520
Speaker 1: the virtual fixtures, these overlays that you would see that

539
00:34:14,680 --> 00:34:17,960
Speaker 1: would appear to be real, but actually we're not present

540
00:34:18,040 --> 00:34:24,520
Speaker 1: in the physical environment itself. Now. Also in a group

541
00:34:24,600 --> 00:34:27,759
Speaker 1: of researchers at Columbia University were proposing a system that

542
00:34:27,840 --> 00:34:32,040
Speaker 1: they called the knowledge based Augmented Reality for maintenance assistance

543
00:34:33,080 --> 00:34:38,439
Speaker 1: a k a. Karma cute. Their approach was pretty novel.

544
00:34:38,480 --> 00:34:42,040
Speaker 1: They pointed out that while augmented reality had tremendous potential,

545
00:34:42,120 --> 00:34:44,920
Speaker 1: it also had a really big barrier, and that it

546
00:34:45,000 --> 00:34:49,560
Speaker 1: takes an enormous amount of time to design or animate

547
00:34:49,640 --> 00:34:53,359
Speaker 1: and implement these graphic overlays for a our applications. So

548
00:34:54,360 --> 00:34:56,200
Speaker 1: let's say you're in a room and you're looking at

549
00:34:56,200 --> 00:34:59,640
Speaker 1: different objects, and little labels are popping up for each object.

550
00:35:00,320 --> 00:35:02,120
Speaker 1: If you're having to do all that by hand, it

551
00:35:02,120 --> 00:35:05,239
Speaker 1: takes a huge amount of time. What they wanted to

552
00:35:05,280 --> 00:35:10,440
Speaker 1: do was create artificial intelligence systems, or at least techniques

553
00:35:10,960 --> 00:35:16,839
Speaker 1: to generate graphics automatically on the fly. So this would

554
00:35:16,880 --> 00:35:20,680
Speaker 1: be similar to using image recognition software, so that if

555
00:35:20,680 --> 00:35:25,040
Speaker 1: you look at a specific box, let's say, the image

556
00:35:25,040 --> 00:35:27,360
Speaker 1: recognition software might be able to map that box to

557
00:35:27,440 --> 00:35:30,319
Speaker 1: a specific product and thus give you an overlay of

558
00:35:30,520 --> 00:35:33,080
Speaker 1: information about the product that would be inside that box.

559
00:35:33,680 --> 00:35:35,359
Speaker 1: And it would be able to do all this automatically.

560
00:35:35,440 --> 00:35:38,759
Speaker 1: It would not require a human programmer to go through

561
00:35:39,280 --> 00:35:42,520
Speaker 1: and and look at every single product in every single

562
00:35:42,560 --> 00:35:45,320
Speaker 1: type of box and program all that out. That would

563
00:35:45,320 --> 00:35:49,120
Speaker 1: be ridiculous. It would take forever so it was the

564
00:35:49,160 --> 00:35:51,920
Speaker 1: work of this group with Karma that really started the

565
00:35:51,960 --> 00:35:55,640
Speaker 1: ball rolling with this AI approach to automatically fill in

566
00:35:55,640 --> 00:36:00,759
Speaker 1: that information and make a are a more practical experience.

567
00:36:02,280 --> 00:36:06,239
Speaker 1: Around this same time, between ninety two and nine, the

568
00:36:06,360 --> 00:36:10,840
Speaker 1: Laurel Western Development Labs, which was defense contractor, began to

569
00:36:10,880 --> 00:36:12,960
Speaker 1: work with the U. S Military to create a R

570
00:36:13,040 --> 00:36:16,480
Speaker 1: systems for military vehicles. And you can understand very quickly

571
00:36:16,640 --> 00:36:21,360
Speaker 1: how a R would have enormous potential for military applications.

572
00:36:21,760 --> 00:36:24,239
Speaker 1: And in fact, a R is very commonly used in

573
00:36:24,320 --> 00:36:27,760
Speaker 1: lots of different things, like pilot helmets, where it helps

574
00:36:27,840 --> 00:36:33,360
Speaker 1: pilots keep track of targets uh and identify potential threats,

575
00:36:33,440 --> 00:36:37,080
Speaker 1: that kind of thing. But in this case, they were

576
00:36:37,080 --> 00:36:41,799
Speaker 1: really looking at creating a augmented reality system that would

577
00:36:41,840 --> 00:36:47,480
Speaker 1: create virtual opponents for people working in simulated wartime conditions,

578
00:36:47,960 --> 00:36:51,520
Speaker 1: so really a training program. Imagine that you're operating an

579
00:36:51,560 --> 00:36:55,759
Speaker 1: actual military vehicle like a tank, and you have a

580
00:36:55,960 --> 00:37:00,400
Speaker 1: view outside that is really an augmented reality system, so

581
00:37:00,480 --> 00:37:02,600
Speaker 1: you're actually looking at the real world around you. You

582
00:37:02,640 --> 00:37:05,200
Speaker 1: aren't just sitting in a simulator inside of building. You

583
00:37:05,239 --> 00:37:08,520
Speaker 1: are out there in the field controlling a real vehicle

584
00:37:08,640 --> 00:37:12,320
Speaker 1: moving around in real terrain, but you also see virtual

585
00:37:12,960 --> 00:37:17,399
Speaker 1: representations of enemies in that real terrain, and you can

586
00:37:17,480 --> 00:37:21,200
Speaker 1: practice maneuvers and firing on enemies that sort of thing,

587
00:37:21,520 --> 00:37:25,319
Speaker 1: probably not using live ammunition at that point, but having

588
00:37:25,360 --> 00:37:28,239
Speaker 1: a more realistic simulation in a real environment, so that

589
00:37:28,280 --> 00:37:35,000
Speaker 1: you're not just trying to create a totally virtual scenario. Anyway,

590
00:37:35,040 --> 00:37:39,200
Speaker 1: that work was done in the world wouldn't really learn

591
00:37:39,200 --> 00:37:42,520
Speaker 1: about it at large until about ninety nine, because that's

592
00:37:42,520 --> 00:37:44,880
Speaker 1: the way the military works. They're not so eager to

593
00:37:44,880 --> 00:37:48,840
Speaker 1: talk about their stuff while are still doing it. Meanwhile,

594
00:37:49,000 --> 00:37:51,719
Speaker 1: at the same time, artists were continuing to explore the

595
00:37:51,760 --> 00:37:55,239
Speaker 1: relationships between physical performers and virtual elements. You remember I

596
00:37:55,239 --> 00:37:59,560
Speaker 1: talked about Dr Krueger earlier. While in different artist Julie

597
00:37:59,600 --> 00:38:04,399
Speaker 1: Martin would create a piece called Dancing in Cyberspace, and

598
00:38:04,520 --> 00:38:07,840
Speaker 1: in that piece, dancers on a physical space or a

599
00:38:07,840 --> 00:38:11,520
Speaker 1: physical stage. We're able to manipulate virtual objects, so an

600
00:38:11,560 --> 00:38:14,800
Speaker 1: audience would be able to see both the physical performance

601
00:38:14,840 --> 00:38:19,759
Speaker 1: by the dancers and the virtual reactions the things that

602
00:38:19,880 --> 00:38:22,279
Speaker 1: happened within the virtual environment as a result of the

603
00:38:22,360 --> 00:38:28,680
Speaker 1: dancers moving around their physical space. Pretty neat two researchers

604
00:38:28,840 --> 00:38:34,360
Speaker 1: Reki Moto and Nagao created there the first real handheld

605
00:38:34,440 --> 00:38:37,080
Speaker 1: a R display, but it was a tethered display. It

606
00:38:37,160 --> 00:38:40,120
Speaker 1: wasn't free form. You couldn't just take it anywhere. It

607
00:38:40,200 --> 00:38:43,080
Speaker 1: was called Navy Cam, and you had to have a

608
00:38:43,280 --> 00:38:46,759
Speaker 1: tether like cable essentially connect the Navy Cam to a workstation.

609
00:38:47,480 --> 00:38:50,759
Speaker 1: But it had a forward facing camera and you can

610
00:38:50,920 --> 00:38:55,280
Speaker 1: use a video feed to go through this handheld device

611
00:38:55,800 --> 00:38:59,920
Speaker 1: through the cable to the workstation, and it could detect

612
00:39:00,040 --> 00:39:03,719
Speaker 1: color coded markers in the camera image and display information

613
00:39:03,760 --> 00:39:05,960
Speaker 1: on a video see through view. So you can get

614
00:39:05,960 --> 00:39:09,759
Speaker 1: that augmented reality experience. Obviously very limited, you know, you

615
00:39:09,800 --> 00:39:12,359
Speaker 1: could not just carry this around with you everywhere you go,

616
00:39:12,520 --> 00:39:17,040
Speaker 1: but it showed the ideas behind augmented reality could in

617
00:39:17,080 --> 00:39:20,320
Speaker 1: fact be realized in a handheld format. Now. It was

618
00:39:20,360 --> 00:39:24,200
Speaker 1: just a matter of getting those different components small enough

619
00:39:24,239 --> 00:39:28,320
Speaker 1: to all fit in a self contained mobile form factor.

620
00:39:29,960 --> 00:39:33,000
Speaker 1: In the late nineties, we started seeing televised sporting events

621
00:39:33,160 --> 00:39:37,080
Speaker 1: featuring augmented reality elements, or at least you did. I

622
00:39:37,200 --> 00:39:40,920
Speaker 1: don't watch sports ball, that's not entirely true, but I

623
00:39:40,960 --> 00:39:44,239
Speaker 1: don't watch football or hockey. American football or hockey, and

624
00:39:44,360 --> 00:39:48,040
Speaker 1: both of those were the sports that really got them.

625
00:39:48,040 --> 00:39:52,360
Speaker 1: First off, I'm gonna backtrack. I used to watch hockey,

626
00:39:52,400 --> 00:39:59,160
Speaker 1: but then Winnipeg stole the Atlanta Thrashers from me. Winnipeg, Okay,

627
00:39:59,160 --> 00:40:02,120
Speaker 1: getting back to hockey. So hockey had the Fox track system,

628
00:40:02,239 --> 00:40:05,520
Speaker 1: which Fox put into hockey games so that you could

629
00:40:05,520 --> 00:40:08,120
Speaker 1: easily follow the puck. Instead of trying to watch this

630
00:40:08,239 --> 00:40:11,359
Speaker 1: little bitty black disc spinning around, you got to watch

631
00:40:11,400 --> 00:40:18,000
Speaker 1: this very bright, highlighted neon colored disc that everyone hated.

632
00:40:18,840 --> 00:40:22,120
Speaker 1: And after about two seasons, Fox stop doing it, and

633
00:40:22,239 --> 00:40:26,360
Speaker 1: people were happy. Untila Thrashers moved away, and then it

634
00:40:26,440 --> 00:40:31,160
Speaker 1: was just miserable. American football would follow suit in the

635
00:40:31,239 --> 00:40:34,799
Speaker 1: late nineties and have the first down line introduced, where

636
00:40:34,800 --> 00:40:39,320
Speaker 1: they could on live video overlay the first down line.

637
00:40:39,800 --> 00:40:43,359
Speaker 1: Usually it's a bright yellow line that indicates how far

638
00:40:43,440 --> 00:40:45,920
Speaker 1: the offensive team needs to go. And by offensive, I

639
00:40:45,960 --> 00:40:48,120
Speaker 1: mean they're on the offensive. I don't mean they offend

640
00:40:48,200 --> 00:40:52,480
Speaker 1: my sensibilities. I'm not that against American football, but it

641
00:40:52,480 --> 00:40:54,040
Speaker 1: showed how far they would need to go in order

642
00:40:54,080 --> 00:40:57,200
Speaker 1: to establish a first down, which I am told is

643
00:40:57,239 --> 00:41:01,160
Speaker 1: something you want to do. Uh. That would start to

644
00:41:01,200 --> 00:41:05,400
Speaker 1: get employed in and over time we would see that

645
00:41:05,960 --> 00:41:10,240
Speaker 1: increase where eventually Skycam was able to even use this system.

646
00:41:10,280 --> 00:41:12,800
Speaker 1: At first, it wasn't you could get a Skycamp you

647
00:41:12,920 --> 00:41:15,120
Speaker 1: but you couldn't do the overlay of the first intent

648
00:41:15,239 --> 00:41:19,600
Speaker 1: line until later. Well, I've got a lot more to

649
00:41:19,719 --> 00:41:24,040
Speaker 1: say about augmented reality, but before I do, let's take

650
00:41:24,080 --> 00:41:34,960
Speaker 1: another quick break to thank our sponsor. Okay, we're back.

651
00:41:35,200 --> 00:41:39,520
Speaker 1: Let's skip ahead to I guess it's not really skipping

652
00:41:39,560 --> 00:41:44,879
Speaker 1: I just talked about. Let's plot ahead to That's when

653
00:41:45,000 --> 00:41:51,000
Speaker 1: NASA's X spacecraft was using an a R system as

654
00:41:51,080 --> 00:41:54,960
Speaker 1: part of its navigational tools, so people back on Earth

655
00:41:55,160 --> 00:41:58,760
Speaker 1: could look at a view from the spacecraft a camera

656
00:41:59,000 --> 00:42:02,560
Speaker 1: mounted on the space ace craft, and on top of

657
00:42:02,600 --> 00:42:06,719
Speaker 1: that view they could overlay map data to help with navigation.

658
00:42:06,920 --> 00:42:08,839
Speaker 1: And all of that, of course was controlled back here

659
00:42:08,960 --> 00:42:12,000
Speaker 1: on Earth, but it was sort of an experiment to

660
00:42:12,040 --> 00:42:16,319
Speaker 1: see how augmented reality could be incorporated into space exploration

661
00:42:16,400 --> 00:42:20,520
Speaker 1: missions in the future and make them more effective. Also,

662
00:42:20,560 --> 00:42:25,920
Speaker 1: in the Navy began work on the Battlefield Augmented Reality

663
00:42:26,040 --> 00:42:29,400
Speaker 1: System or BARS, which is a wearable a R system

664
00:42:29,400 --> 00:42:33,560
Speaker 1: for soldiers. You've probably seen various implementations of this over

665
00:42:33,600 --> 00:42:38,120
Speaker 1: the years is obviously evolved since nine It's one of

666
00:42:38,120 --> 00:42:42,000
Speaker 1: those pieces of technology that some soldiers took to but

667
00:42:42,080 --> 00:42:47,080
Speaker 1: a lot just felt that it created unnecessary distractions. Technology

668
00:42:47,120 --> 00:42:52,560
Speaker 1: and warfare is very, very difficult because there's sometimes where

669
00:42:52,600 --> 00:42:56,239
Speaker 1: we think, oh, more information is always better, but in

670
00:42:56,320 --> 00:43:00,120
Speaker 1: some cases that doesn't seem to hold true. Uh, And

671
00:43:00,280 --> 00:43:03,520
Speaker 1: for some people with these head mounted displays or or

672
00:43:03,600 --> 00:43:07,480
Speaker 1: really it's heads up displays HUDs uh, that can sometimes

673
00:43:07,480 --> 00:43:11,640
Speaker 1: be the case, depends on the implementation. In two thousand,

674
00:43:12,000 --> 00:43:17,080
Speaker 1: hiro Katsu Kato created a software library called a R Toolkit.

675
00:43:18,040 --> 00:43:21,760
Speaker 1: Very important software library was also open source, so anyone

676
00:43:21,880 --> 00:43:26,160
Speaker 1: could contribute to it, modify it. Brent put out a

677
00:43:26,200 --> 00:43:29,760
Speaker 1: new version that sort of stuff, and it uses video

678
00:43:29,800 --> 00:43:33,040
Speaker 1: tracking to overlay computer graphics on a video camera feed,

679
00:43:33,880 --> 00:43:36,200
Speaker 1: and it's still a component for a lot of a

680
00:43:36,320 --> 00:43:39,920
Speaker 1: our experiences today. Later on in the two thousand's this

681
00:43:39,960 --> 00:43:43,120
Speaker 1: would be adapted so that it could also be used

682
00:43:43,200 --> 00:43:48,680
Speaker 1: in web experiences, not just native experiences to specific devices,

683
00:43:50,200 --> 00:43:53,440
Speaker 1: and we continue to see are built into new experiences

684
00:43:53,480 --> 00:43:57,560
Speaker 1: including smartphones and tablets. By two thousand four, some researchers

685
00:43:57,560 --> 00:44:00,200
Speaker 1: in Germany, we're creating a r apps that can take

686
00:44:00,239 --> 00:44:04,280
Speaker 1: advantage of a smartphones camera. But two thousand fours pretty

687
00:44:04,280 --> 00:44:08,200
Speaker 1: early for smartphones. It really would would be a few

688
00:44:08,320 --> 00:44:11,919
Speaker 1: years before this would truly take off, because that's when

689
00:44:12,000 --> 00:44:14,760
Speaker 1: Apple came out with the iPhone in two thousand seven.

690
00:44:15,560 --> 00:44:19,480
Speaker 1: That was the real revolution in smartphone technology. There had

691
00:44:19,520 --> 00:44:22,680
Speaker 1: been smartphones before the iPhone, don't get me wrong, and

692
00:44:22,719 --> 00:44:26,480
Speaker 1: many of them were really good, but the iPhone was

693
00:44:26,560 --> 00:44:30,880
Speaker 1: something that caught the public's attention and made smartphone sexy.

694
00:44:31,160 --> 00:44:33,800
Speaker 1: And because of that, there was a ton of money

695
00:44:34,239 --> 00:44:38,160
Speaker 1: poured into the smartphone industry as well as not just Apple,

696
00:44:38,200 --> 00:44:40,640
Speaker 1: but also to other companies, like the companies that were

697
00:44:40,680 --> 00:44:44,839
Speaker 1: offering Android smartphones. But I think we can really thank

698
00:44:44,880 --> 00:44:48,280
Speaker 1: Apple for all of that happening in the first place,

699
00:44:48,920 --> 00:44:51,640
Speaker 1: especially things like seeing that accelerometer where you could switch

700
00:44:51,680 --> 00:44:54,520
Speaker 1: from portrait to landscape mode. I remember everyone freaking out

701
00:44:54,600 --> 00:44:57,680
Speaker 1: about that when Steve Jobs showed it off in two

702
00:44:57,719 --> 00:45:01,200
Speaker 1: thousand seven at Macworld, and everyone thought, will this is

703
00:45:01,239 --> 00:45:03,520
Speaker 1: the this is amazing. Well, we take it for granted now,

704
00:45:03,560 --> 00:45:06,520
Speaker 1: but it was a big deal then. So once that

705
00:45:06,600 --> 00:45:12,479
Speaker 1: smartphone revolution happened, it was a landslide victory for both

706
00:45:12,560 --> 00:45:16,160
Speaker 1: augmented reality and virtual reality research and development, because it

707
00:45:16,200 --> 00:45:22,000
Speaker 1: meant that so much money was being poured into creating newer, thinner,

708
00:45:22,560 --> 00:45:27,839
Speaker 1: more capable smartphones that we saw an explosion in technological

709
00:45:27,880 --> 00:45:31,440
Speaker 1: development that could also be used for virtual and augmented

710
00:45:31,480 --> 00:45:36,760
Speaker 1: reality experiences. So, for example, I think of those sensors

711
00:45:36,800 --> 00:45:42,240
Speaker 1: I talked about earlier, accelerometers and gyroscopes, that sort of thing. Well,

712
00:45:42,360 --> 00:45:44,480
Speaker 1: we saw a lot of development in those spaces in

713
00:45:44,560 --> 00:45:47,560
Speaker 1: order to make smartphones better, and people who are working

714
00:45:47,560 --> 00:45:50,359
Speaker 1: in a R and VR experiences can take advantage of

715
00:45:50,400 --> 00:45:55,759
Speaker 1: those same sensors either creating apps specifically for smartphones. Thus,

716
00:45:55,840 --> 00:45:58,279
Speaker 1: you don't have to build any other hardware, you just

717
00:45:58,520 --> 00:46:02,120
Speaker 1: use existing hardware. But that limits how you can use it,

718
00:46:02,480 --> 00:46:05,040
Speaker 1: right because you don't typically wear your smartphone directly in

719
00:46:05,040 --> 00:46:08,359
Speaker 1: front of your face. Or they could end up taking

720
00:46:08,360 --> 00:46:12,760
Speaker 1: advantage of those new, smaller sensors and incorporate them directly

721
00:46:12,800 --> 00:46:16,160
Speaker 1: into brand new hardware like various types of wearables like

722
00:46:16,239 --> 00:46:18,200
Speaker 1: Google Glass for example, but that would be a few

723
00:46:18,200 --> 00:46:23,160
Speaker 1: more years. In two thousand and eleven, Nintendo launched the

724
00:46:23,280 --> 00:46:27,040
Speaker 1: Nintendo three D S, which included a camera. It was

725
00:46:27,080 --> 00:46:32,080
Speaker 1: you know, the three D capable handheld device and included

726
00:46:32,400 --> 00:46:36,000
Speaker 1: actually a pair of forward facing cameras so you could

727
00:46:36,280 --> 00:46:40,040
Speaker 1: take three D photos if you wanted to, and it

728
00:46:40,120 --> 00:46:43,480
Speaker 1: also had some a R software included with it. You

729
00:46:43,480 --> 00:46:48,400
Speaker 1: would get these special Nintendo cards kind of like playing cards,

730
00:46:49,239 --> 00:46:51,920
Speaker 1: and if you were to point the camera of the

731
00:46:51,960 --> 00:46:55,680
Speaker 1: three D S at the card and look at the screen,

732
00:46:56,280 --> 00:46:59,680
Speaker 1: you would see a little virtual three dimensional character pop

733
00:46:59,800 --> 00:47:03,320
Speaker 1: up on the card. So Mario would be an obvious example.

734
00:47:03,640 --> 00:47:06,200
Speaker 1: You put the Mario card down on the table, you

735
00:47:06,239 --> 00:47:07,920
Speaker 1: hold up the three D S, and you aim the

736
00:47:07,960 --> 00:47:10,000
Speaker 1: camera at the card, and you look at the screen

737
00:47:10,080 --> 00:47:13,120
Speaker 1: and there's Mario, and Mario appears to be jumping around

738
00:47:13,239 --> 00:47:17,600
Speaker 1: on your physical table. Now, obviously, if you look off

739
00:47:17,760 --> 00:47:21,680
Speaker 1: of the display, there's no Mario jumping around, but on

740
00:47:21,719 --> 00:47:24,600
Speaker 1: the display there he is, and it was pretty cute.

741
00:47:24,880 --> 00:47:28,920
Speaker 1: I remember being really impressed with this very simple implementation

742
00:47:28,960 --> 00:47:32,040
Speaker 1: of a R when we got our three DS, and

743
00:47:32,080 --> 00:47:35,319
Speaker 1: then I took our three DS apart, and then I

744
00:47:35,320 --> 00:47:38,520
Speaker 1: took pictures of it, and then I posted on Twitter

745
00:47:39,280 --> 00:47:43,359
Speaker 1: and people got sad, it's a great day. In two

746
00:47:43,400 --> 00:47:47,520
Speaker 1: thousand thirteen, Google introduced Google Glass that was the wearable

747
00:47:47,600 --> 00:47:51,719
Speaker 1: that included a small display position just above the right eye. Uh,

748
00:47:51,840 --> 00:47:55,239
Speaker 1: So when you look straightforward, you could tell that there

749
00:47:55,320 --> 00:47:59,840
Speaker 1: was something kind of above your natural eyeline. But it

750
00:48:00,800 --> 00:48:03,319
Speaker 1: get in the way too much. You too to look

751
00:48:03,320 --> 00:48:05,319
Speaker 1: at the screen. You actually had a glimpse, You had

752
00:48:05,320 --> 00:48:07,920
Speaker 1: a glance upward, and then you could see what was

753
00:48:07,960 --> 00:48:13,600
Speaker 1: on the display. Google Glass had augmented reality features like crazy.

754
00:48:13,680 --> 00:48:18,719
Speaker 1: You could see video calls. You could actually use the

755
00:48:19,520 --> 00:48:22,719
Speaker 1: glasses to not just to take a video call, but

756
00:48:22,800 --> 00:48:26,080
Speaker 1: show the other person what you are looking at so

757
00:48:26,239 --> 00:48:29,080
Speaker 1: they could see from your point of view. You could

758
00:48:29,080 --> 00:48:32,279
Speaker 1: also overlay directions, so if you're walking down street, you

759
00:48:32,320 --> 00:48:34,480
Speaker 1: could glance up at the screen and it would tell

760
00:48:34,520 --> 00:48:36,520
Speaker 1: you if you need to keep going straight or turn laughter,

761
00:48:36,600 --> 00:48:39,640
Speaker 1: turn right, that kind of thing. It was really useful. Um.

762
00:48:39,680 --> 00:48:42,400
Speaker 1: I had a pair of these Google Glass and I

763
00:48:42,480 --> 00:48:46,040
Speaker 1: really liked the direction they were going in. I felt

764
00:48:46,040 --> 00:48:49,040
Speaker 1: that it wasn't a fully realized product at the time,

765
00:48:49,080 --> 00:48:52,200
Speaker 1: and eventually Google agreed and after a couple of years

766
00:48:52,239 --> 00:48:55,239
Speaker 1: they took Google Glass off the market entirely, and now

767
00:48:55,280 --> 00:48:58,920
Speaker 1: you can't get them anymore. Uh. They were clever, but

768
00:48:59,280 --> 00:49:04,319
Speaker 1: they were expensive and they had some limitations, and like

769
00:49:04,440 --> 00:49:06,480
Speaker 1: I was saying earlier, you know, it's hard to build

770
00:49:06,520 --> 00:49:09,680
Speaker 1: all the components you need into one headset. So Google

771
00:49:09,719 --> 00:49:13,680
Speaker 1: Glass would communicate via Bluetooth to your smartphone, and your

772
00:49:13,719 --> 00:49:16,800
Speaker 1: smartphone would act as the actual nexus point to the Internet.

773
00:49:17,800 --> 00:49:21,080
Speaker 1: But it was a neat idea, uh, and I enjoyed

774
00:49:21,400 --> 00:49:24,040
Speaker 1: getting to use them while I did, so I keep

775
00:49:24,080 --> 00:49:28,440
Speaker 1: hoping to see a return of that kind of technology,

776
00:49:28,480 --> 00:49:32,360
Speaker 1: but perhaps in a more mature and less expensive format.

777
00:49:33,880 --> 00:49:37,680
Speaker 1: Now we've also seen applications similar to the ones we

778
00:49:37,719 --> 00:49:40,760
Speaker 1: mentioned earlier, the ones that are meant to guide people

779
00:49:40,920 --> 00:49:44,680
Speaker 1: into laying out or repairing a system. We've seen that

780
00:49:44,760 --> 00:49:47,960
Speaker 1: in the car world. Not too long ago, there was

781
00:49:48,040 --> 00:49:52,120
Speaker 1: the MARTA system introduced by Volkswagen. MARTA makes me chuckle

782
00:49:52,320 --> 00:49:55,640
Speaker 1: because that's also the name of Atlanta's public transportation system,

783
00:49:55,719 --> 00:49:58,840
Speaker 1: But in this case, it stands for Mobile Augmented Reality

784
00:49:58,880 --> 00:50:03,279
Speaker 1: Technical Assistance, and it's specifically designed for mechanics who are

785
00:50:03,320 --> 00:50:06,960
Speaker 1: working on the XL one vehicle. So if you hold

786
00:50:07,000 --> 00:50:10,480
Speaker 1: up an iPad that has this app on it, and

787
00:50:10,520 --> 00:50:13,040
Speaker 1: the camera has pointed at an XL one and you

788
00:50:13,080 --> 00:50:16,319
Speaker 1: look at the display, you'll see information overlaid on top

789
00:50:16,400 --> 00:50:20,360
Speaker 1: of the car, including labels for all the different parts.

790
00:50:20,360 --> 00:50:22,600
Speaker 1: So let's say you're a mechanic and you have to

791
00:50:22,640 --> 00:50:26,799
Speaker 1: do a specific repair on this vehicle. You hold up

792
00:50:26,840 --> 00:50:29,799
Speaker 1: the iPad, you look through the display, and you see

793
00:50:29,840 --> 00:50:31,600
Speaker 1: exactly what you need to do. It gives you a

794
00:50:31,600 --> 00:50:34,480
Speaker 1: set of instructions that shows you how you need to do.

795
00:50:34,560 --> 00:50:36,839
Speaker 1: It tells you where you need to stand based upon

796
00:50:36,960 --> 00:50:39,680
Speaker 1: the angle of the view. So if you hold it

797
00:50:39,760 --> 00:50:41,280
Speaker 1: up and it says no, you need to move about

798
00:50:41,320 --> 00:50:43,160
Speaker 1: a foot to the right, you can do that. Then

799
00:50:43,160 --> 00:50:45,080
Speaker 1: hold up the iPad again. I'll say, all right, you're

800
00:50:45,080 --> 00:50:48,280
Speaker 1: in the right spot. Make sure you loosen this particular

801
00:50:48,320 --> 00:50:51,319
Speaker 1: bolt first, that kind of thing. And it's meant to

802
00:50:51,400 --> 00:50:55,880
Speaker 1: be an interactive maintenance guide in a way maintenance and

803
00:50:55,920 --> 00:50:59,920
Speaker 1: repair guide. This is one of those applications of augmentary

804
00:51:00,080 --> 00:51:04,120
Speaker 1: lity I think is a no brainer to me. It's

805
00:51:04,120 --> 00:51:07,759
Speaker 1: a killer hap the idea of having an ability to

806
00:51:09,640 --> 00:51:14,399
Speaker 1: work with something you are not familiar with, but you're

807
00:51:14,440 --> 00:51:17,880
Speaker 1: able to leverage the expertise of people who either designed

808
00:51:17,880 --> 00:51:20,440
Speaker 1: it or built it, or just fully understand it and

809
00:51:20,520 --> 00:51:25,600
Speaker 1: get guidance based on their expertise in real time, so

810
00:51:25,640 --> 00:51:30,160
Speaker 1: you're not having to go and consult a an article

811
00:51:30,239 --> 00:51:34,000
Speaker 1: about it, or watch a YouTube video. You get step

812
00:51:34,000 --> 00:51:38,640
Speaker 1: by step instructions overlaid on top of your view of

813
00:51:38,680 --> 00:51:42,480
Speaker 1: that thing. To me, that's the most compelling use of

814
00:51:42,560 --> 00:51:45,520
Speaker 1: augmented reality from a practical standpoint. There are a lot

815
00:51:45,560 --> 00:51:47,640
Speaker 1: of other uses that they'll talk about towards the end

816
00:51:47,840 --> 00:51:50,160
Speaker 1: that I think are also really super cool. So don't

817
00:51:50,160 --> 00:51:53,959
Speaker 1: get me wrong, it's not the only one. But let's

818
00:51:54,000 --> 00:51:56,520
Speaker 1: move on to two thousand fifteen. That was when Microsoft

819
00:51:56,600 --> 00:51:59,920
Speaker 1: would unveil the hollow lens, something I still want to

820
00:52:00,000 --> 00:52:01,799
Speaker 1: try out. I have not had a chance to try

821
00:52:01,800 --> 00:52:04,880
Speaker 1: a hollow lens yet. That is a headset capable of

822
00:52:04,920 --> 00:52:07,880
Speaker 1: advanced a R applications everything from what I was just

823
00:52:07,960 --> 00:52:11,279
Speaker 1: talking about, giving you guidance, step by step instructions on

824
00:52:11,320 --> 00:52:14,000
Speaker 1: how to do like a repair job on say an

825
00:52:14,000 --> 00:52:18,600
Speaker 1: electrical outlet. You can even use a Skype system to

826
00:52:18,760 --> 00:52:22,520
Speaker 1: call an expert who can then view your point of

827
00:52:22,600 --> 00:52:27,080
Speaker 1: view and interact with that point of view. So let's

828
00:52:27,120 --> 00:52:31,480
Speaker 1: say I'm looking at the outlet. The expert electrician I'm

829
00:52:31,480 --> 00:52:35,319
Speaker 1: talking to can see what I see, and he or

830
00:52:35,360 --> 00:52:39,960
Speaker 1: she can also make notes on the display which shows

831
00:52:40,040 --> 00:52:42,880
Speaker 1: up in my field of view. So he or she

832
00:52:43,000 --> 00:52:45,920
Speaker 1: might circle a specific wire and say you need to

833
00:52:46,080 --> 00:52:48,399
Speaker 1: you need to remove that one first, and I know

834
00:52:48,719 --> 00:52:50,520
Speaker 1: I need to do that one first because I can

835
00:52:50,520 --> 00:52:52,640
Speaker 1: see which one they are talking about. Or they might

836
00:52:52,640 --> 00:52:56,680
Speaker 1: circle another wire and say, no, matter what you do,

837
00:52:56,680 --> 00:53:00,480
Speaker 1: don't cut this wire. Well, the toilet ups stairs will

838
00:53:00,480 --> 00:53:05,920
Speaker 1: explode like lethal weapon too, and I won't do that

839
00:53:06,040 --> 00:53:09,719
Speaker 1: because you know that guys like three days from retirement.

840
00:53:10,080 --> 00:53:13,680
Speaker 1: So I have a heart. But no, this is this

841
00:53:13,760 --> 00:53:17,480
Speaker 1: is a really neat idea, having this interactive ability to

842
00:53:18,320 --> 00:53:21,800
Speaker 1: overlay the information from the world, the digital world, onto

843
00:53:21,960 --> 00:53:24,839
Speaker 1: your physical world. And beyond that, the hollowns has lots

844
00:53:24,880 --> 00:53:28,600
Speaker 1: of other functions. It's not just something to do, you know,

845
00:53:29,000 --> 00:53:31,840
Speaker 1: home repairs around the house. You can also use it

846
00:53:31,840 --> 00:53:36,080
Speaker 1: for entertainment purposes, like you could create a screen that

847
00:53:36,160 --> 00:53:40,280
Speaker 1: can show you video from various sources and you can

848
00:53:40,320 --> 00:53:44,440
Speaker 1: assign it a place on a wall in your environment.

849
00:53:44,520 --> 00:53:48,120
Speaker 1: Let's say that you're in your living room and you

850
00:53:48,239 --> 00:53:50,920
Speaker 1: just create a screen so you can watch Netflix, and

851
00:53:50,960 --> 00:53:54,040
Speaker 1: you slap it on a wall and it will stay

852
00:53:54,400 --> 00:53:57,279
Speaker 1: in that same position relative to your point of view.

853
00:53:57,640 --> 00:53:59,400
Speaker 1: So if you look to the left or right, the

854
00:53:59,440 --> 00:54:02,600
Speaker 1: screens days where you put it as if it were

855
00:54:02,680 --> 00:54:05,239
Speaker 1: physically they're on your wall, but keep in mind it's

856
00:54:05,320 --> 00:54:08,319
Speaker 1: just a virtual screen, and when you look back to

857
00:54:08,400 --> 00:54:10,960
Speaker 1: that part of your wall, you'll see the virtual screen

858
00:54:11,000 --> 00:54:13,280
Speaker 1: there playing whatever it was that you wanted to watch.

859
00:54:14,600 --> 00:54:16,879
Speaker 1: I think that's a super cool idea. And they've also

860
00:54:16,880 --> 00:54:20,920
Speaker 1: shown off games like a game of Minecraft that uses

861
00:54:20,920 --> 00:54:23,920
Speaker 1: hollow lens so you can actually view a Minecraft world

862
00:54:24,680 --> 00:54:27,799
Speaker 1: sitting appearing to sit at any rate on top of

863
00:54:27,800 --> 00:54:31,080
Speaker 1: a table, so you can walk around the table and

864
00:54:31,200 --> 00:54:34,759
Speaker 1: view the Minecraft world from various angles and play that way.

865
00:54:35,520 --> 00:54:38,640
Speaker 1: I think that's super neat. Don't know how compelling it is,

866
00:54:38,640 --> 00:54:41,600
Speaker 1: because again I haven't tried it myself, but I really

867
00:54:41,640 --> 00:54:46,400
Speaker 1: like the idea. This year, two thousand and sixteen, are

868
00:54:46,480 --> 00:54:49,759
Speaker 1: got another big boost from a little game called Pokemon Go.

869
00:54:50,840 --> 00:54:54,040
Speaker 1: Although I have to admit this was a really primitive,

870
00:54:54,239 --> 00:54:58,200
Speaker 1: basic implementation of augmented reality. Really, it was not much

871
00:54:58,719 --> 00:55:00,839
Speaker 1: more than just a In fact, it was nothing more

872
00:55:01,280 --> 00:55:04,479
Speaker 1: than just an animated overlay that would exist on top

873
00:55:04,520 --> 00:55:08,759
Speaker 1: of the camera view of your of your device. So

874
00:55:08,800 --> 00:55:11,839
Speaker 1: I'd say I'm holding up my smartphone and I'm trying

875
00:55:11,840 --> 00:55:14,680
Speaker 1: to catch a Jiggli Puff, and the Jiggli Puff is

876
00:55:14,680 --> 00:55:17,799
Speaker 1: currently bouncing up and down on the sidewalk in front

877
00:55:17,840 --> 00:55:20,799
Speaker 1: of me. That's about as far as the augmented reality

878
00:55:21,040 --> 00:55:25,040
Speaker 1: actual experience would go. So very primitive. But because Pokemon

879
00:55:25,160 --> 00:55:30,239
Speaker 1: Go became so popular so quickly, it really pushed the

880
00:55:30,280 --> 00:55:33,600
Speaker 1: concept of a R to the front of the minds

881
00:55:33,640 --> 00:55:37,440
Speaker 1: of people everywhere, including business owners who immediately said, we

882
00:55:37,520 --> 00:55:41,600
Speaker 1: need an augmented reality app Whether they actually needed one

883
00:55:41,680 --> 00:55:44,360
Speaker 1: or not is beside the point. A lot of people

884
00:55:44,440 --> 00:55:47,840
Speaker 1: got into a are because of Pokemon Go, uh, for

885
00:55:47,960 --> 00:55:50,520
Speaker 1: both good and bad. I always think that you have

886
00:55:50,600 --> 00:55:52,719
Speaker 1: to come up with the experience first. You have to

887
00:55:53,400 --> 00:55:58,320
Speaker 1: understand why you need to use a specific strategy to

888
00:55:58,800 --> 00:56:03,640
Speaker 1: create a specific experience, and then build it. Not hey,

889
00:56:03,760 --> 00:56:08,319
Speaker 1: we need augmented reality makes something that's a R. To me,

890
00:56:08,440 --> 00:56:11,440
Speaker 1: that's the backwards way of going about it. But what

891
00:56:11,520 --> 00:56:14,520
Speaker 1: do I know. I'm not not a programmer, so I'm

892
00:56:14,520 --> 00:56:17,440
Speaker 1: sure the programmers feel in a similar way to me.

893
00:56:17,800 --> 00:56:21,360
Speaker 1: But that's just a guess. Now. The future of a

894
00:56:21,480 --> 00:56:24,719
Speaker 1: R depends heavily upon the applications we see in which

895
00:56:24,719 --> 00:56:28,360
Speaker 1: ones end up being successful and which ones aren't. Right now,

896
00:56:28,400 --> 00:56:30,799
Speaker 1: I would say that the best bet is to see

897
00:56:30,840 --> 00:56:35,600
Speaker 1: more a R features built into smartphones and tablets. Uh not,

898
00:56:35,680 --> 00:56:39,480
Speaker 1: maybe not necessarily built into them, but have apps available

899
00:56:39,560 --> 00:56:43,560
Speaker 1: that create a R experiences for very specific contexts. Like

900
00:56:43,640 --> 00:56:46,800
Speaker 1: let's say it's a museum app. You might download a

901
00:56:46,880 --> 00:56:48,960
Speaker 1: museum app on your phone, and when you go to

902
00:56:49,000 --> 00:56:51,680
Speaker 1: the museum and you use your phone, you can get

903
00:56:51,719 --> 00:56:55,440
Speaker 1: more information about the paintings and sculptures and other installations

904
00:56:55,440 --> 00:56:57,879
Speaker 1: that you see in the museum. That's an easy one

905
00:56:57,920 --> 00:57:00,680
Speaker 1: to understand. But that same app isn't going to be

906
00:57:00,760 --> 00:57:03,279
Speaker 1: useful once you leave the museum, you no longer have

907
00:57:03,520 --> 00:57:07,239
Speaker 1: the context that it is tied to. I think that

908
00:57:07,400 --> 00:57:10,680
Speaker 1: smartphones are probably going to be where the greatest development

909
00:57:10,719 --> 00:57:13,520
Speaker 1: is going to be in the near term, because wearables

910
00:57:13,560 --> 00:57:17,000
Speaker 1: is still really hard to do. We still don't have

911
00:57:17,240 --> 00:57:20,080
Speaker 1: a consumer version of the hollow lens out available for

912
00:57:20,120 --> 00:57:23,480
Speaker 1: anyone to purchase, and it may never come out as

913
00:57:23,480 --> 00:57:26,320
Speaker 1: a consumer product. Microsoft hasn't shown a whole lot of

914
00:57:26,360 --> 00:57:29,760
Speaker 1: interest in making it a consumer product. Maybe that will change,

915
00:57:30,240 --> 00:57:32,880
Speaker 1: but at the moment, I wouldn't hold my breath, so

916
00:57:33,600 --> 00:57:36,760
Speaker 1: I would argue smartphones and tablets are pretty much where

917
00:57:36,800 --> 00:57:41,760
Speaker 1: it's at maybe some implementation with some existing VR headsets

918
00:57:41,760 --> 00:57:44,480
Speaker 1: which have external cameras mounted on them as well, like

919
00:57:44,560 --> 00:57:48,040
Speaker 1: forward facing cameras. You could build a our experiences there.

920
00:57:48,240 --> 00:57:50,480
Speaker 1: Then it gets a little weird because you're you're also

921
00:57:50,600 --> 00:57:53,120
Speaker 1: you know, you're looking at a monitor, so you're looking

922
00:57:53,120 --> 00:57:55,640
Speaker 1: at a video feed of your surroundings, and on top

923
00:57:55,680 --> 00:57:57,760
Speaker 1: of the video feed, you get the overlay. Same thing

924
00:57:57,920 --> 00:57:59,919
Speaker 1: is true for your smartphones and tablets, by the way,

925
00:58:00,560 --> 00:58:03,960
Speaker 1: but different that from the Google glass implementation, where you're

926
00:58:03,960 --> 00:58:07,080
Speaker 1: looking at the actual physical world, not a video representation

927
00:58:07,120 --> 00:58:10,240
Speaker 1: of it, but the real world. And then because the

928
00:58:10,320 --> 00:58:13,760
Speaker 1: display itself that you are looking through is transparent, you're

929
00:58:13,800 --> 00:58:17,600
Speaker 1: looking at a transparent overlay of digital information that gives

930
00:58:17,600 --> 00:58:22,440
Speaker 1: you more info about the world you are in. I

931
00:58:22,480 --> 00:58:25,000
Speaker 1: think a R is super cool. I think it's really

932
00:58:25,040 --> 00:58:28,480
Speaker 1: got a lot of potential to change the world around

933
00:58:28,560 --> 00:58:30,320
Speaker 1: us and to change the way we interact with the

934
00:58:30,360 --> 00:58:35,720
Speaker 1: world around us. You could imagine a dystopian future implementation

935
00:58:35,760 --> 00:58:38,600
Speaker 1: of a R where we all have to wear glasses

936
00:58:38,640 --> 00:58:42,880
Speaker 1: and we're constantly getting personalized commercials beamed at us whenever

937
00:58:42,920 --> 00:58:46,600
Speaker 1: we look at anything, like imagine walking past a store

938
00:58:46,640 --> 00:58:48,880
Speaker 1: casually looking in the window and then getting a whole

939
00:58:48,880 --> 00:58:50,800
Speaker 1: bunch of ads for all the stuff that's in the

940
00:58:50,800 --> 00:58:53,760
Speaker 1: store window. That would be obnoxious, and it's easy to

941
00:58:53,840 --> 00:58:57,840
Speaker 1: understand how people would not want that, yet also easy

942
00:58:57,920 --> 00:59:00,200
Speaker 1: to understand how that could possibly become a few her

943
00:59:00,760 --> 00:59:04,280
Speaker 1: or think of the future where your privacy is no

944
00:59:04,320 --> 00:59:08,080
Speaker 1: longer even relevant, and you walk down the street and

945
00:59:08,120 --> 00:59:11,320
Speaker 1: you look at all the people's faces who are also

946
00:59:11,400 --> 00:59:15,000
Speaker 1: walking down the street, and you're getting names of everybody

947
00:59:15,040 --> 00:59:17,200
Speaker 1: and what they like and what they dislike. You know,

948
00:59:17,280 --> 00:59:19,840
Speaker 1: what music they tend to listen to, maybe what they're

949
00:59:19,880 --> 00:59:22,960
Speaker 1: listening to right now, And it's all because we've got

950
00:59:23,000 --> 00:59:27,520
Speaker 1: facial recognition technology. Almost everyone has some sort of social

951
00:59:27,560 --> 00:59:31,439
Speaker 1: media presence, so you can map that face to any

952
00:59:31,480 --> 00:59:34,480
Speaker 1: public profiles, try and find a match. If you found

953
00:59:34,480 --> 00:59:36,640
Speaker 1: a match, you can bring back information to the person

954
00:59:36,720 --> 00:59:41,400
Speaker 1: wearing the glasses. So I can look at somebody and say, oh, this, uh,

955
00:59:41,520 --> 00:59:45,200
Speaker 1: this cute kid over here, she's got she likes punk

956
00:59:45,280 --> 00:59:48,640
Speaker 1: rock music. I'm gonna I'm gonna impress her with my

957
00:59:49,400 --> 00:59:55,360
Speaker 1: knowledge of the cramps. That probably wouldn't work, but the

958
00:59:55,400 --> 00:59:58,240
Speaker 1: point being that's pretty creepy and invasive, and so there

959
00:59:58,280 --> 01:00:00,760
Speaker 1: are some negative implementations of a are that we have

960
01:00:00,800 --> 01:00:03,560
Speaker 1: to watch out for unless we get to a point

961
01:00:03,600 --> 01:00:05,840
Speaker 1: where we just don't care about privacy at all anymore.

962
01:00:06,320 --> 01:00:08,840
Speaker 1: Some would argue we're already there, and in that case,

963
01:00:09,040 --> 01:00:11,400
Speaker 1: this implementation of a R may not sound creepy at all.

964
01:00:11,400 --> 01:00:13,240
Speaker 1: It might just sound kind of cool, kind of the

965
01:00:13,280 --> 01:00:15,920
Speaker 1: equivalent of walking into a store seeing a person with

966
01:00:15,960 --> 01:00:18,640
Speaker 1: a name tag and addressing them by name. If they

967
01:00:18,640 --> 01:00:20,600
Speaker 1: don't remember they have a name tag on, they have

968
01:00:20,680 --> 01:00:23,160
Speaker 1: this moment where they think, do I know you? That.

969
01:00:23,200 --> 01:00:25,400
Speaker 1: If we're in a world where everyone can see everyone's

970
01:00:25,480 --> 01:00:27,800
Speaker 1: name all the time, then well, for one thing, I

971
01:00:27,840 --> 01:00:30,080
Speaker 1: won't ever have to worry about coming at a loss

972
01:00:30,080 --> 01:00:32,080
Speaker 1: when I have to introduce my wife to someone. So

973
01:00:32,200 --> 01:00:34,880
Speaker 1: that's a that's a plus side. Okay, I'm in favor

974
01:00:34,880 --> 01:00:37,280
Speaker 1: of it now, all right. Well that kind of wraps

975
01:00:37,400 --> 01:00:41,880
Speaker 1: up this deep dive on augmented reality. There's so many

976
01:00:41,920 --> 01:00:44,480
Speaker 1: different other things I could have mentioned. There's so much

977
01:00:44,480 --> 01:00:46,880
Speaker 1: more to the history and development of it and all

978
01:00:46,880 --> 01:00:50,000
Speaker 1: the pieces of technology, But this is one of those

979
01:00:50,600 --> 01:00:55,880
Speaker 1: strategies that arose because so many other elements had matured

980
01:00:56,000 --> 01:00:58,360
Speaker 1: over a great deal of time. If you guys have

981
01:00:58,400 --> 01:01:01,160
Speaker 1: any suggestions for future episodes tech Stuff, whether it's a

982
01:01:01,200 --> 01:01:06,120
Speaker 1: specific kind of technology, or how technology has affected us,

983
01:01:06,240 --> 01:01:09,560
Speaker 1: or how we affect tech. Maybe it's a specific company

984
01:01:09,680 --> 01:01:12,680
Speaker 1: or person in technology, or you just have a suggestion

985
01:01:12,760 --> 01:01:15,080
Speaker 1: for somebody I should have on the show, either as

986
01:01:15,160 --> 01:01:18,680
Speaker 1: a guest co host or someone I should interview. Let

987
01:01:18,680 --> 01:01:22,040
Speaker 1: me know, send me a message. The email to send

988
01:01:22,040 --> 01:01:25,640
Speaker 1: it to is tech Stuff at how stuff works dot com,

989
01:01:25,720 --> 01:01:27,720
Speaker 1: or drop me a line on social media. You can

990
01:01:27,760 --> 01:01:30,840
Speaker 1: find me on Twitter or on Facebook with the handle

991
01:01:31,000 --> 01:01:34,040
Speaker 1: tech stuff h s W and I'll talk to you

992
01:01:34,040 --> 01:01:42,880
Speaker 1: guys again really soon. For more on this and thousands

993
01:01:42,920 --> 01:01:55,040
Speaker 1: of other topics, is it how stuff works dot com.