Speaker 1: You're listening to Part Time Genius, the production of Kaleidoscope
Speaker 1: and iHeartRadio. Hey there are podcast listeners. Welcome to Part
Speaker 1: Time Genius. I am Monga's particular. My good pal Will
Speaker 1: is off at the beach this week on a well
Speaker 1: deserved break. But don't you worry. I am not alone
Speaker 1: in the studio. We have our wonderful engineer Dylan Fagan
Speaker 1: back there keeping me company. And I do think he's
Speaker 1: a little crestfallen without Will here because he's just holding
Speaker 1: a big sign that says seven more days till Will
Speaker 1: comes back. It is okay, Dylan, He'll be back soon, buddy,
Speaker 1: I promise. Also, this is kind of a special episode
Speaker 1: because we are here with journalist and podcast host Evan
Speaker 1: Ratliffe and he's telling me all about his new show,
Speaker 1: shell Game, which is so good. In it, Evan creates
Speaker 1: a voice clone of himself. He hooks it up to
Speaker 1: an AI chatbot and sends it out into the world
Speaker 1: on all sorts of weird experiments, from meeting his family
Speaker 1: to talking to scammers, which the AI does with enthusiasm,
Speaker 1: to even having it meet a therapist, all to understand
Speaker 1: better what AI voice can do, what it can't do yet,
Speaker 1: and what to expect from a future when more and
Speaker 1: more people we encounter aren't real It is fascinating. I
Speaker 1: think you're gonna love it. And if you stick around
Speaker 1: after the interview, we are airing the first episode right
Speaker 1: here on Part Time Genius.
Speaker 2: So enjoy.
Speaker 1: Evan. So we are old friends. I have admired your
Speaker 1: work for a very long time. One of the things
Speaker 1: I'm amazed by is your ability to be involved in
Speaker 1: things that are so beloved, especially by journalists, you know,
Speaker 1: like pop Up magazine, Atavist long form podcast which you
Speaker 1: just ended and the outpouring was remarkable and wonderful, And
Speaker 1: I'm really excited to talk about shell Game, your new project.
Speaker 3: Thanks.
Speaker 4: Thanks, I'm also very excited about It's the most fun
Speaker 4: I've had doing anything in a long time.
Speaker 1: I think that's what I was going to say, is that,
Speaker 1: like it feels so fun, Like you're enjoying yourself on
Speaker 1: tape in a way that is undeniable. You can hear
Speaker 1: that mischief and that fun and that playfulness coming through
Speaker 1: the tape. But take me back and stuff and tell
Speaker 1: me how you got into this sort of space of
Speaker 1: reporting in terms of like technology and scams and things
Speaker 1: like that.
Speaker 4: Well, I sort of started out getting interested in scams
Speaker 4: by accident, because when I first became a journalist, I
Speaker 4: worked at Wired Magazine, and one of the first assignments
Speaker 4: that I ever got was to go cover this company
Speaker 4: that had been written up in the Wall Street Journal.
Speaker 4: I won't go too far into it, but their idea
Speaker 4: was to like send the internet over power lines. And
Speaker 4: I went to Texas. It was like one of the
Speaker 4: first reporting I ever got to take. I was so
Speaker 4: excited and I talked to them and it really baffled me,
Speaker 4: like they couldn't explain what they were doing very well.
Speaker 4: And I came back and I went to see my editor,
Speaker 4: who at the time was this guy Alex Heard, his
Speaker 4: legendary editor. He's the editor of Outside magazine now. And
Speaker 4: I sort of laid it all off for him, like
Speaker 4: every time I tried to get to explain something like
Speaker 4: it kept like slipping through my grasp. And he was like,
Speaker 4: have you thought about that it might all be a scam?
Speaker 4: And I was like what, He's like, it could all
Speaker 4: be a scam. I was like, it was in the
Speaker 4: Wall Street Journal and he was like hmm. And I
Speaker 4: realized it was a scam and like the whole thing
Speaker 4: was just like smoke and mirrors, and they had raised
Speaker 4: tens of millions of dollars for it, but they actually
Speaker 4: couldn't do any of the technology.
Speaker 3: So I went back to.
Speaker 4: Texas, reported it again as a scam and did a story.
Speaker 4: Was one of my first stories, and like that really
Speaker 4: changed something in my brain, maybe made me too skeptical sometimes,
Speaker 4: but the idea that like something that you were going
Speaker 4: to just straight up tell as like ge whiz, I
Speaker 4: can't believe they're doing this amazing thing actually was all
Speaker 4: just a fraud. Like it really changed the way I
Speaker 4: looked at the world and it got me interested in
Speaker 4: sort of like what else out there is like this?
Speaker 4: And so I've always kind of covered scam since then,
Speaker 4: had con artists and just like deception and identity and
Speaker 4: technology rolled up together, that's my favorite thing to focus on.
Speaker 1: Yeah, I mean, were you a skeptic before you came
Speaker 1: into this project I've wired?
Speaker 4: I mean I was a little bit of a tech
Speaker 4: skeptic because it was the height of the dot kom boom,
Speaker 4: So I mean, yeah, that's how that's.
Speaker 3: How old we are.
Speaker 4: That's when I started my career, and so I was
Speaker 4: skeptical of the hype around all of the dot COM's
Speaker 4: at the time, because I was sort of entering this
Speaker 4: world in which like everything's going.
Speaker 3: To change forever, and I was a little skeptical of that.
Speaker 4: But I was actually like, I love technology, and I
Speaker 4: loved trying new things, and I had worked a little
Speaker 4: bit in technology before I became a journalist, so I
Speaker 4: was very appreciative of technology. I was an optimist about technology.
Speaker 4: I had a little skepticism about the business aspect of it.
Speaker 4: But truly my interest in scams came from that story.
Speaker 1: That's incredible. You know, growing up, you think just because
Speaker 1: it's in print, it has to be real, right, And
Speaker 1: that learning that even the Wall Street Journal, even like
Speaker 1: these incredible institutions, can get things wrong or don't have
Speaker 1: those layers of fact checking or whatever, and that a
Speaker 1: really great scam artist can get past that is pretty stunning.
Speaker 4: Yeah, and also a thing that you don't know until
Speaker 4: you get into journalism, or you don't you might not know.
Speaker 4: It is just sort of how many types of journalism
Speaker 4: there are, how many types of story even on the
Speaker 4: same topic there can be. So someone who is sent
Speaker 4: just to profile a guy or a woman who invented something.
Speaker 4: That's just a different type of story than someone who
Speaker 4: is sent to sort of like investigate whether that thing
Speaker 4: is real.
Speaker 3: And it might be a different type of reporter.
Speaker 4: It might even be the same reporter can do I
Speaker 4: know reporters who've done both. I've probably done both. But
Speaker 4: how you're approaching something it can make a huge difference.
Speaker 4: And you actually see this in how AI is covered now.
Speaker 4: There's like sort of the like they may new announcement
Speaker 4: type of coverage, and then there are people who are
Speaker 4: trying to dig in and figure out, well, what's going
Speaker 4: on with AI right now and what is really happening
Speaker 4: and how far can it go and et cetera, et cetera,
Speaker 4: And people tend to consume them all the same. Sometimes, Yeah,
Speaker 4: they're not like they're They're a totally different animal.
Speaker 1: That's really fascinating. So tell me about Vanished, which is
Speaker 1: obviously this piece that you did that's really well known
Speaker 1: in the magazine community and also feels like the start
Speaker 1: of what you're doing with shell Game.
Speaker 3: Yeah.
Speaker 4: So Vanish was now fifteen years ago, almost to the day,
Speaker 4: a couple of weeks from now, it is Craifteen years
Speaker 4: ago was when I actually left on it. So Vanish
Speaker 4: was this project where I wanted to investigate what it
Speaker 4: was like to fake your own death. That's sort of
Speaker 4: where it came from. But again it was this. It
Speaker 4: was this sort of like ven diagram of technology and
Speaker 4: identity and privacy and surveillance, all of these things sort
Speaker 4: of wrapped up into one story. And the idea was, well,
Speaker 4: I could write about someone who faked their death, which
Speaker 4: I did. I did a story about someone who had
Speaker 4: attempted to fake their death and got caught. But the
Speaker 4: problem is people who fake their death they either get
Speaker 4: caught or they get away with it.
Speaker 1: I have to get caught both. They're problematic for yeah,
Speaker 1: they will get very far.
Speaker 4: Or they're god and you can never figure out that
Speaker 4: they actually fake their death because everyone thinks they're dead.
Speaker 2: Yeah.
Speaker 4: So basically I just thought, well, what if I try
Speaker 4: to do it myself, you know, for a limited period
Speaker 4: of time. So I tried to essentially disappear from my
Speaker 4: identity into a new identity, not go entirely off the grid,
Speaker 4: but actually live under this new identity. And then the
Speaker 4: twist was, well, if you're going to live under new identity.
Speaker 4: It's actually pretty easy if no one's trying to find
Speaker 4: you under your own identity. So we sort of generated
Speaker 4: a way for people to be looking for me, which
Speaker 4: is that they could win a prize of five thousand
Speaker 4: dollars if they found me, three thousand dollars which would
Speaker 4: come from me, which increases.
Speaker 1: That's incredible.
Speaker 3: That was that helped incentivize me.
Speaker 4: And so off I went, and I was trying to
Speaker 4: stay vanished for a month, and I did all these
Speaker 4: different things, like I went across the country. I hitchhiked
Speaker 4: and I took Greyhound busses. I sold my car, I
Speaker 4: changed my appearance. I was living under a different name,
Speaker 4: I had different social media accounts, and I almost made it.
Speaker 4: I was living in an apartment in New Orleans and
Speaker 4: I had rented under this fake name, but then they
Speaker 4: caught me. So and then I'm still a little bit
Speaker 4: disappointed about that. I did lose the money. But the story,
Speaker 4: I think, really did delve into all of these issues
Speaker 4: about privacy and what happens to your data. And this
Speaker 4: was you have to remember, this is fifteen years ago,
Speaker 4: so it was not as well known how much information is.
Speaker 3: Out there about you. What do these databases have? What
Speaker 3: can people find?
Speaker 4: People found out everything about me, for my social Security number,
Speaker 4: do every address I'd ever lived at, to friends and family,
Speaker 4: all the things you can find out in databases and
Speaker 4: on social media. So they tell me a lot about that.
Speaker 4: But also, like I loved the process of immersing myself
Speaker 4: into a story and kind of creating a story to
Speaker 4: try to illustrate something. So it's always been on my
Speaker 4: mind since.
Speaker 1: Well even there there's this sense of playfulness, right, Like
Speaker 1: you changed your appearance in some ways.
Speaker 2: Can you talk about that?
Speaker 4: Yeah, I mean I did a lot of things that
Speaker 4: probably weren't even necessary, but but partly I mean there
Speaker 4: were a lot of people looking for me. I mean
Speaker 4: you could never quite quantify how many, with tens of
Speaker 4: thousands were following it, and then like at least hundreds
Speaker 4: were like actively looking for me, Like people drove from
Speaker 4: Las Vegas to La to.
Speaker 3: Look for me.
Speaker 4: People in New Orleans were looking for me. I went
Speaker 4: to a US soccer game in Utah. There were people
Speaker 4: in the crowd looking for me, waiting outside the stadium.
Speaker 4: So there was some need to change my appearance, and
Speaker 4: I started with I grew a beard.
Speaker 3: I don't usually have a beard. I can't really grow
Speaker 3: a great beard.
Speaker 4: But I grew beard, and then I dyed it, and
Speaker 4: then I shaved it into a goatee, and then I
Speaker 4: shaved that into a mustache, which did not look good.
Speaker 4: And then my sort of coup de graph, my disguise
Speaker 4: as was I cut my hair in a sort of
Speaker 4: mail pattern baldness fashion. I had shaved the top, shaved clean,
Speaker 4: and left the sides as if I had lost hair.
Speaker 1: That's my favorite part of it all is that you
Speaker 1: got well because I had a friend a little after
Speaker 1: high school he decided to like shave his head when
Speaker 1: everyone was kind of doing that, and then and then
Speaker 1: it just never grew back. You had no fear about well.
Speaker 3: Part of what I.
Speaker 4: Learned was if you were losing your hair on top,
Speaker 4: like as they say, it's a good idea to just
Speaker 4: kind of like accept it and go with it. Because
Speaker 4: I mean, people actively made fun of me. I mean
Speaker 4: I looked more ridiculous than a person who had actually
Speaker 4: their hair was thinning. Like I looked a little bit strange.
Speaker 4: I got second glances from people everywhere I went, and
Speaker 4: people took photos. I took a photo of me that
Speaker 4: he sent me like years later, being like, oh yeah,
Speaker 4: I read this thing and I saw you in the
Speaker 4: airport and I just took a photo of it because
Speaker 4: you looked really bad and I thought that shave his head.
Speaker 1: So Vanish is all about this digital trail that we're
Speaker 1: leaving and kind of moving beyond it in a way,
Speaker 1: or trying to get past it. And and the shell game,
Speaker 1: which is so much about AI and it is really
Speaker 1: about using everything that you have online, from the way
Speaker 1: you speak, to the way your mind works, to all
Speaker 1: the digital information. So are harnessing that together. Tell us
Speaker 1: how you got into this project, how you came up
Speaker 1: with the idea and and in a way, what you're
Speaker 1: trying to do with it.
Speaker 4: Well, I actually I came up with a kind of
Speaker 4: version of the idea a couple of years ago when
Speaker 4: I was I was working on this last the last
Speaker 4: year I did was called Persona. The French Deception was
Speaker 4: the full name of it. It was about this French
Speaker 4: Israeli con artist, scammer, phone scammer.
Speaker 1: But before that I was there and I didn't I
Speaker 1: didn't say both Persona and the Mastermind, which which you wrote,
Speaker 1: are just two things that I referenced a lot, and
Speaker 1: just such great, great FEUs of media in general. So
Speaker 1: the listeners should go listen to those things, but tell
Speaker 1: me where you're going for.
Speaker 4: Here, you Well, Persona almost never never happened as it
Speaker 4: as as it ended up, because the idea I had
Speaker 4: was a round voice cloning, and there was like a
Speaker 4: really rudimentary voice cloning that you could do, and I
Speaker 4: wanted to do something with it, and I thought, well, this,
Speaker 4: this will make good audio. But it just it wasn't
Speaker 4: good enough and it sounded really computer generated, and so
Speaker 4: it just wasn't really working. So then we turned to
Speaker 4: a different story and actually did it for Persona. So
Speaker 4: it was already like a little bit on my mind.
Speaker 4: And that was pre chat Gypt being announced and the LM's,
Speaker 4: the large language models, you know, becoming so prevalent and
Speaker 4: everyone using them, and to be honest, like I got
Speaker 4: kind of bored and fed up with LLM talk, like
Speaker 4: I was just sort of after a while, it just
Speaker 4: seemed like, Okay, I know what this is, and I'm
Speaker 4: tired of reading about it. I'm tired of hearing about it.
Speaker 4: But voice cloning started to get better. This company called
Speaker 4: eleven Labs, which is sort of the state of the
Speaker 4: art launch, and people were playing with it, you know,
Speaker 4: cloning their voices. But then at a certain point I
Speaker 4: started thinking, like, why am I ignoring this? Like I
Speaker 4: just feel like there's something inside me that is resisting it.
Speaker 4: And it's partly because it's a little bit scary. People
Speaker 4: are scared about what it'll do to your job, what
Speaker 4: it'll do to creativity, you know, all of the issues
Speaker 4: around it. And I feel like I was sort of inside,
Speaker 4: like viscerally hoping that it would just kind of go away,
Speaker 4: you know, like I hope this in two years from
Speaker 4: now people will be like this is like NFT's like,
Speaker 4: no one cares about this anymore. And then I just
Speaker 4: u There's actually this quote from Roger Angel, who's the
Speaker 4: New Yorker baseball writer, where one time he just said, like,
Speaker 4: you got to live in the times you're in. He
Speaker 4: was like, I know people who don't have a television,
Speaker 4: but to me, you got to live in the times
Speaker 4: you're in. And I kind of like I was like, oh, yeah,
Speaker 4: that's how I should be. I should be trying this stuff.
Speaker 4: So I tried the voice cloning, and then it was
Speaker 4: pretty interesting, and I messed around with it and I
Speaker 4: would leave it on someone's voicemail and they would, you know,
Speaker 4: say like I'm going to be late, and it would
Speaker 4: be me, and then when I got there, I'd be like,
Speaker 4: that wasn't me, that was actually this voice clud I did.
Speaker 4: And that's what's pretty fun. But like that got old
Speaker 4: pretty soon. But then people were tired of you being
Speaker 4: late everywhere. Obviously not that late. In fact, I just
Speaker 4: want to point out I made myself late so I
Speaker 4: could leave the voicemail.
Speaker 3: I didn't do that.
Speaker 4: I just stood around the corner for like five minutes.
Speaker 4: Incredible anyway. Then I just then I thought, well, what
Speaker 4: if I could make a phone call with this thing?
Speaker 3: And that's what really set me off.
Speaker 4: I thought, well if I can make a phone call
Speaker 4: with this thing, and then I could, like what if
Speaker 4: I could hook it up to an LLM and the
Speaker 4: LLM could just be the brain of the thing. And
Speaker 4: at first I couldn't figure out how to do it.
Speaker 4: And then there was like a plug in where a
Speaker 4: guy had sort of made this plug in where you
Speaker 4: could you could let eleven Labs, the company that makes
Speaker 4: the voice clone, talk to chetchipt like use as your
Speaker 4: voice in CHATCHPT and I was able to kind of
Speaker 4: tweak that connected to a phone line and suddenly I
Speaker 4: could call people with this clone. And once you have
Speaker 4: something like that, it just feels like I've uncovered a
Speaker 4: secret about myself and about the world, and now I'm
Speaker 4: just going to dribble it out to people over the
Speaker 4: next six months. That's really what I felt like. I
Speaker 4: didn't tell anyone, Like my wife Sam found out obviously
Speaker 4: because then I started talking about all the time and
Speaker 4: I would call her with it. Yeah, But like I
Speaker 4: didn't tell any of my friends about it because I thought, well, Okay,
Speaker 4: now I'm gonna start calling people with this thing and
Speaker 4: see what happens. So mostly it was just like fun.
Speaker 4: It was like finding out something really fun that you
Speaker 4: could do. That's how it started.
Speaker 1: We've got more with Evan Ratlift right after the break.
Speaker 1: Welcome back to Part Time Genius, where we're talking to
Speaker 1: Evan Ratlift. Can you talk about what limits you were
Speaker 1: putting on the AI and what your learnings were as
Speaker 1: you were playing with it more?
Speaker 4: Yeah, So, so I should say I kind of shifted
Speaker 4: from what I just described, which is using this plug
Speaker 4: in and I made my own system.
Speaker 3: I'd use audio routing software.
Speaker 5: And then I.
Speaker 4: Discovered they are these calling platforms and kind of do
Speaker 4: it all for you, but they just launched. They're all
Speaker 4: very new. So I use this one called VAPPI, and
Speaker 4: it basically takes your voice clone, combines it with a
Speaker 4: phone number, hooks it up to any of the llms
Speaker 4: that you want to use, and then you have what
Speaker 4: what's called a voice agent. They call it a voice assistant.
Speaker 4: Some people call it a voice agent. I call it
Speaker 4: a voice agent. Sounds sounds fun, that has more intrigue
Speaker 4: to it. So then I had a voice agent. I
Speaker 4: could call anyone with a voice agent. I could receive
Speaker 4: calls with a voice agent. So then the question is
Speaker 4: like when it comes to prompts, like what are you
Speaker 4: going to have it do? At the beginning, I would
Speaker 4: have it called customer service line, So I would say,
Speaker 4: you are Evan, You're calling a customer service line, and
Speaker 4: you should try to resolve a problem that you have.
Speaker 4: The problem depends on who you're calling, so whoever picks up.
Speaker 4: And then I would have it called Discover Card or
Speaker 4: United Airlines, and so it would just be that simple
Speaker 4: prompt and I just wanted to see what it would do.
Speaker 4: But over time the prompts got more sophistic so eventually,
Speaker 4: and I get into this in a sort of later episode,
Speaker 4: Like eventually in the prompt it would have sort of
Speaker 4: like behavior rules and then a role, So like the
Speaker 4: behavior would be like speak like a human, don't repeat yourself,
Speaker 4: make short answers, like all these sort of ways of talking,
Speaker 4: ways of sounding more human, and then the role would
Speaker 4: be you are Evan ratlife a journalists and that it
Speaker 4: would have like all the information that you would need
Speaker 4: to complete the call.
Speaker 1: Yeah, there's always this worry that AI is going to
Speaker 1: escalate problems that you're going to get like a doomsday
Speaker 1: scenario from an AI overreacting or reacting to logically or whatever.
Speaker 1: And what you hear in a lot of the tape
Speaker 1: is that your AI is always calming down conflicts, resolving,
Speaker 1: like almost like shifting itself to be accommodating, which was
Speaker 1: really interesting.
Speaker 2: Yeah.
Speaker 4: Yeah, And I mean in VAPU of the call platform
Speaker 4: that I'm using, it has something called temperature. So if
Speaker 4: you turn up the temperature, you're basically increasing the randomness
Speaker 4: of the out that it'll give. And if you crag
Speaker 4: it all the way up. It will just spout gibberish,
Speaker 4: like pure gibberish, just like strings of words. So you
Speaker 4: try to find a balance in the middle of like
Speaker 4: it's interesting and it could say something a little out there,
Speaker 4: versus like it says totally unintelligible things. But eventually I
Speaker 4: realized I could take two of these models of myself
Speaker 4: and I just haven't talked to each other. And this
Speaker 4: was sort of endlessly bizarre and surreal and fascinating for
Speaker 4: me because I could just listen to like hours of
Speaker 4: tape of someone who sounds like me talking to someone
Speaker 4: who sounds like.
Speaker 1: Me, where they refuse to get off the phone with
Speaker 1: each other, right, they keep extending the conversation.
Speaker 4: I keep trying to actend the conversation, especially if you
Speaker 4: fail to tell them to hang up, and you have
Speaker 4: to tell them that they have to hang up or
Speaker 4: limit their time otherwise they'll just talk forever.
Speaker 1: So it's really delightful, and I realized this is a
Speaker 1: bit of a stretch. But like when your kids starts
Speaker 1: talking or you're watching them like to the world and
Speaker 1: things like that, it almost feels like that's what you're
Speaker 1: doing with AI where you're like putting it in these
Speaker 1: foreign circumstances and just being sort of surprised and idiot
Speaker 1: how it reacts to really strange situations.
Speaker 3: Yeah.
Speaker 4: Absolutely, And of course you don't want to anthropomorphize it
Speaker 4: too much because it's not thinking, you know, it's predicting.
Speaker 4: You know, what these models do is they predict what
Speaker 4: a person would say. But then the more information you
Speaker 4: give it about yourself, then the more it's sort of
Speaker 4: trying to take what a person would say and then
Speaker 4: layer your life on top of it. And so when
Speaker 4: I started, I didn't give it much information, and I
Speaker 4: would even have two of them talk to each other,
Speaker 4: and all they knew was that they were Evan Ratliffe
Speaker 4: and like the names of my family members, and so
Speaker 4: they would talk for a while, and they did know
Speaker 4: some stuff about me, because they've been fed training data
Speaker 4: from the internet, and there's fair amount of stuff about
Speaker 4: me on the internet because I've been a journalists for
Speaker 4: all these years. But then they would never realize that
Speaker 4: they were talking to another version of me, Like even
Speaker 4: if they said I'm Evan Ratliff, my kids names are these,
Speaker 4: my wife's name is this, and the other one said, oh,
Speaker 4: I'm Evan Raleiff. My kid's names are these, my wife's
Speaker 4: name is this.
Speaker 3: They would never say, Oh, isn't that strange?
Speaker 2: Yeah?
Speaker 4: Yeah, And then I would try to push them to
Speaker 4: argue with each other, and they would start to, but
Speaker 4: then they would sort of get immediately into this like
Speaker 4: therapy space where they would mirror back each other's concerns.
Speaker 4: That's I'm sorry to hear that you feel that way.
Speaker 4: Thank you for explaining that to me. You know, let's
Speaker 4: get together for lunch and resolve this conflict, like they were.
Speaker 1: So they kept ending up in lunches and coffees. But
Speaker 1: I am curious like that. There's a part in the
Speaker 1: show and Sam is both so patient and so fun
Speaker 1: to listen to in her reactions, but this part where
Speaker 1: she says something in the kitchen, She's like, am I
Speaker 1: talking to you? Or am I talking to AIU?
Speaker 3: Or something?
Speaker 1: Right? And I was curious, like, did hearing your voice
Speaker 1: in all these situations, being able to make small talk,
Speaker 1: being able to divert a conflict and turn it into
Speaker 1: something much smoother, Like, was there any learning in hearing
Speaker 1: yourself go through these situations?
Speaker 3: Definitely?
Speaker 4: I mean I would say it unnerved me in many
Speaker 4: in many cases about like the way that I talk obviously,
Speaker 4: the inflections and things like that, because it's trying to
Speaker 4: capture those. Sometimes it's failing. They're not perfect by any
Speaker 4: means at this point, so sometimes it'd be better than others,
Speaker 4: depending on what was being said. But I mean, the
Speaker 4: thing that happened with Sam in the kitchen was that
Speaker 4: she said, you sound like the AI? Are you trying
Speaker 4: to be the AI? And I realized I've just listened
Speaker 4: to so much of it that I actually am starting
Speaker 4: this so out like I'm mimicking it because I hear
Speaker 4: it so much, but it's based on me, and so
Speaker 4: it starts to be this.
Speaker 1: Like loose strange loop.
Speaker 3: Yeah, yeah, it's like a fidelity loop.
Speaker 4: But then the other thing was when I made them
Speaker 4: talk to each other, they just they engaged in the
Speaker 4: most insipid small talk, like just unbelievably boring, insipid small
Speaker 4: talk for the most part. And then sometimes I can
Speaker 4: make it more random and they would come up with
Speaker 4: weird hobbies and things like that. But I just thought, like, oh,
Speaker 4: this is what I sound like like. You never hear
Speaker 4: a recording of what you sound like when you're like
Speaker 4: at a kid's birthday party talking to other parents and
Speaker 4: just making the most kind of like basic small talk
Speaker 4: and hearing my I just thought I gotta do better, Like.
Speaker 1: This is you got to come armed with charm.
Speaker 3: Talking about the humidity.
Speaker 6: You know.
Speaker 4: It's just like one time it says like that one
Speaker 4: of them, for some reason, decides that it's based in Florida,
Speaker 4: Like this is the kind of thing that it would
Speaker 4: make up all the time, like life is good down
Speaker 4: in Florida, and the other says like Florida, I can
Speaker 4: just feel the humidity.
Speaker 7: You know.
Speaker 3: It's like I might say.
Speaker 1: That it is a remarkable response. So obviously, you know,
Speaker 1: you study scammers and AI is being used in scamming.
Speaker 1: But one of the things you do is set AI
Speaker 1: Evan Ratliffe off to chat with scammers. Can you talk
Speaker 1: a little bit about that, Yeah, I.
Speaker 4: Mean, of course I was always going to be interested
Speaker 4: in how scammers use this technology, but also how they
Speaker 4: would interact with the technology. So I mean, there's this
Speaker 4: very old tradition that goes back I remember it from
Speaker 4: at least the nineties maybe before, called scam baiting, which
Speaker 4: is basically people who try to tie up scammers. You know,
Speaker 4: these do it over email and they take them down
Speaker 4: these roads. They sort of like pretend like they're getting
Speaker 4: scammed and waste the scammer's time. And there's very elaborate
Speaker 4: ways of doing this. So I sort of decided to
Speaker 4: do like a little version of that where I set
Speaker 4: up a phone number that had my voice age attached
Speaker 4: my Evan ratlif voice agent, and then I just seeded
Speaker 4: the number everywhere like I would sign up for promotions.
Speaker 4: I would call eight hundred numbers. And I just did
Speaker 4: this for like less than a week, and it started
Speaker 4: getting scam calls. It just so quickly got into the
Speaker 4: rotation of databases of people who were calling either to
Speaker 4: spam you with offers you don't want or to straight
Speaker 4: out scam you.
Speaker 1: That's crazy how quickly it moves, right, The speed of
Speaker 1: that is unreal.
Speaker 4: Yeah, I mean, all you have to do is accidentally
Speaker 4: sign up for the wrong thing, you know, it's like
Speaker 4: free my phone or you know, send me more information
Speaker 4: about this, and suddenly you're just getting calls from recorded
Speaker 4: lines saying you must act now, your debt is out
Speaker 4: of control, you know, like stuff that's just clearly a scam.
Speaker 4: I mean that I would get these calls all day
Speaker 4: on this line, and so I just let the AI
Speaker 4: pick it up and talk to them, and I just
Speaker 4: told it to be interested, to be enthusiastic, and you know,
Speaker 4: to try to figure out what they were offering, and
Speaker 4: to talk to them on the phone. And I didn't
Speaker 4: give it scripts or anything to say or like take
Speaker 4: them down this road.
Speaker 3: I just let it do what it.
Speaker 4: Wanted to do in some sense. And so it ended
Speaker 4: up talking to a lot of different scammers, and sometimes
Speaker 4: they just tried to scam it as if it were me,
Speaker 4: like as if a real person, you know, they did
Speaker 4: not detect that it was an AI. Other times they
Speaker 4: were pretty freaked out by it, like they would say,
Speaker 4: what is this? Is this because they realized they're doing
Speaker 4: their pitch and the things just not it's not acting
Speaker 4: like all these skeptical humans that they've interacted with them.
Speaker 8: Yeah.
Speaker 5: Yeah.
Speaker 3: And then the.
Speaker 4: Sort of third thing that happened was that sometimes the
Speaker 4: scam caller was also an AI in fact using one
Speaker 4: of the same platforms that I use to make my
Speaker 4: voice agent. So it was a voice agent calling my
Speaker 4: voice agent to try to talk my voice agent into
Speaker 4: taking a deal, and those conversations to me were really extraordinary.
Speaker 1: Did those end up in coffees too?
Speaker 4: No, because the thing about the scammer AI is that
Speaker 4: they have a script, so they are trying to get
Speaker 4: you on the phone with what they call.
Speaker 1: Like a product specialist or whatever.
Speaker 3: Yeah, they try to get you to a real person.
Speaker 3: I mean.
Speaker 4: The thing that they did have was background noise, which
Speaker 4: is one of my favorite things on the platform, Like,
Speaker 4: if you create a voice agent, you can add background noise,
Speaker 4: like it's in a coffee shop and there's like clinking
Speaker 4: of glasses and things, or it's in an office and
Speaker 4: there's typing. And that's how I knew that it was
Speaker 4: an AI using one of these platforms because it was
Speaker 4: using the coffee shop noise, which I've myself have used.
Speaker 1: That's amazing. So one of the things that I feel
Speaker 1: like people talk about a lot is that we have
Speaker 1: such a superficial understanding of how weird AI is going
Speaker 1: to get. And it reminds me of when the Internet
Speaker 1: first became popular and Yahoo and other places were like
Speaker 1: printing telephone directories for websites because it was like, oh,
Speaker 1: this is how we're gonna use this medium in ways
Speaker 1: that feel familiar, right, Like our conception of it was
Speaker 1: based on everything we're doing at the time, rather than
Speaker 1: like what will be the future. What are some of
Speaker 1: the stranger applications that you've seen that people are starting
Speaker 1: to experiment within the AI space?
Speaker 4: Well, I think, I mean partly, like you don't even
Speaker 4: know what people are doing. It's insane the way people
Speaker 4: are experimenting with this stuff, and there's no rules around it.
Speaker 4: There's no one saying you can't do this, you can't
Speaker 4: do that.
Speaker 3: I mean, I'm.
Speaker 4: Speaking specifically about like AI calling, which is like the
Speaker 4: thing that I was focused on, like voice spots, and
Speaker 4: there are these discords that I spend a lot of
Speaker 4: time in where people are obviously adapting them for pretty
Speaker 4: insane uses, but they don't say exactly what they are.
Speaker 4: Like they say, you know, I'm trying to have it
Speaker 4: do this, I'm trying to have it do that. So
Speaker 4: a lot of it is sort of replacing stuff that
Speaker 4: calls you anyway, or replacing stuff that you call anyway.
Speaker 4: So customer service lines, for instance, and they can make
Speaker 4: a pretty strong argument that a lot of customer service
Speaker 4: is really bad and doesn't take your concerns into account
Speaker 4: even if you're let's say a veteran calling the VA
Speaker 4: trying to get service for something, You're trying to get
Speaker 4: an appointment, and that these voice agent models might be
Speaker 4: able to do better than them, or maybe they already
Speaker 4: can do better than them. And what I'm trying to
Speaker 4: show in shell Game is partly that even if the
Speaker 4: technology doesn't get any better than it is right now,
Speaker 4: like forget all the arguments about AI and how fast
Speaker 4: it's progressing and will it destroy us and all this
Speaker 4: sort of stuff, Like people are going to use this
Speaker 4: technology for that set of prescripted uses at which it's
Speaker 4: pretty good, but also a whole bunch of other things
Speaker 4: which it might not be any good. But that doesn't
Speaker 4: mean they're not going to do it, and it actually
Speaker 4: makes it worse. So the question I was trying to
Speaker 4: explore is like people can use it to impersonate you.
Speaker 4: You can use it to impersonate yourself. That's basically what
Speaker 4: I was doing. And if you let it loose as
Speaker 4: sort of like a general you know, brain is like
Speaker 4: a little bit of an extreme anthropomorphized.
Speaker 3: Word for it.
Speaker 4: But if you let it loose with AI representing you,
Speaker 4: in the world. It will do some crazy stuff because
Speaker 4: it makes things up because it's not good at certain
Speaker 4: aspects of doing communication. But that doesn't mean that people
Speaker 4: aren't going to do it, which means that you're going
Speaker 4: to have to deal with it all the time. You
Speaker 4: are going to have to deal with this in your life.
Speaker 4: And I want to see how people are reacting to
Speaker 4: it now.
Speaker 1: Basically, yeah, I love that. You know, you hear the
Speaker 1: AI pivot so quickly. It feels in some ways like
Speaker 1: the worst improviser. It's always yes ending in a way.
Speaker 1: But you know, ask for the address, and it gives
Speaker 1: this like totally blown the address, and then the person's like, oh,
Speaker 1: that's not really an address, and then it makes up
Speaker 1: a totally different address, you know, and this very confident
Speaker 1: and wonderful way. But I'm curious, like, how is your
Speaker 1: AI as a dad? How is it as a husband?
Speaker 1: Like like when it's been in the been employed in
Speaker 1: the family place.
Speaker 3: As a husband, it's it's it's okay, it's you have
Speaker 3: to ask Sam.
Speaker 4: I feel like properly prompted it like it can engage
Speaker 4: in like a real, real quality conversation about what should
Speaker 4: happen today with the kids.
Speaker 7: You know.
Speaker 4: The only problem is the places where it falls down
Speaker 4: are where it sort of gets outside of its scope
Speaker 4: of knowledge. And as you're saying, like, if it doesn't
Speaker 4: say the answer that you want to hear, unless you've
Speaker 4: specifically told it for some reason not to do this,
Speaker 4: it'll make up a new answer. So it'll just say, oh,
Speaker 4: here's another thing. It'll make some up to try to
Speaker 4: satisfy the conversation, right, So that ends up being a
Speaker 4: real negative in most in most conversations, because if I've
Speaker 4: told it like, hey, contact Sam and see about the
Speaker 4: kids going sledding today because they're home for a snow day,
Speaker 4: it can do fine on just that, But as soon
Speaker 4: as she takes the conversation outside of that, it could
Speaker 4: go anywhere, and then you end up in a.
Speaker 3: Very strange situation.
Speaker 4: So I would say it can work in a very
Speaker 4: in a very prescribed manner in your sort of most
Speaker 4: personal relationships. But also I've set it loose on many
Speaker 4: friends and I've had every reaction that you can think
Speaker 4: of from it. People have yelled at it, people have
Speaker 4: laughed at it. My friends loved talking to it. And yeah,
Speaker 4: and some of my friends have believed that it was
Speaker 4: me and been very concerned for my welfare.
Speaker 1: So what feels optimistic about this moment in AI? I mean,
Speaker 1: I think we're so surrounded with the worry of it.
Speaker 4: You know, I too, am full of skepticism and concern.
Speaker 4: And there's a whole episode that's sort of about can
Speaker 4: it replace us in our jobs? Like could it replace me.
Speaker 3: In my job?
Speaker 4: And I think a lot of people have that worry,
Speaker 4: and a lot of people sort of like I did
Speaker 4: at the beginning.
Speaker 3: Like they just kind of like hope it goes away.
Speaker 4: But I think there is a more optimistic approach for me,
Speaker 4: and I sort of found that in doing the show,
Speaker 4: which is you can sort of take control of it
Speaker 4: and experiment with it and see what it can do,
Speaker 4: and it becomes less scary.
Speaker 3: When you do that. I think if you.
Speaker 4: Really grapple with what are the capabilities of it and
Speaker 4: you stop thinking about, oh my god, if it keeps
Speaker 4: getting better this same way for the next eighteen months,
Speaker 4: it will replace all humans or it will accidentally destroy us.
Speaker 4: If you sort of just set aside those questions. I'm
Speaker 4: not saying those questions aren't valid, but if you set
Speaker 4: aside those questions, and say what can this do right now?
Speaker 4: And what does that mean for me? I think you
Speaker 4: can find a sort of optimistic place where you can say, oh,
Speaker 4: I see what it can and can't do, and it's
Speaker 4: actually like pretty funny what it can't do, and we
Speaker 4: can hopefully at least see how we respond the big
Speaker 4: danger for me and this is something to it, and
Speaker 4: then we can deal with that.
Speaker 3: And I feel, like.
Speaker 4: I've written about before, it is like when more of
Speaker 4: the world becomes fake than real. So when more of
Speaker 4: the things that you encounter in your life or it
Speaker 4: started on the internet but in your life become not human,
Speaker 4: it changes how you trust the world, and so you
Speaker 4: need to figure out a new model for looking at
Speaker 4: the world. And is that model just not trusting anything?
Speaker 4: And I don't think we have an answer for that
Speaker 4: right now. So I feel like part of what we
Speaker 4: need to do is just sort of like see how
Speaker 4: these things make us feel and what they can tell
Speaker 4: us about ourselves, and then we can kind of go
Speaker 4: from there.
Speaker 1: Well, shell game is so good. I'm really excited for
Speaker 1: listeners to listen to it. So let's just dive in,
Speaker 1: all right, Thanks for having me. It's always so fun
Speaker 1: to talk to Evan. Thank you for everyone who's written
Speaker 1: to us and our moms at pet Genius Moms at
Speaker 1: gmail dot com. We will get back to you very
Speaker 1: very soon. Thank you so much for listening to this episode.
Speaker 1: It really means a ton to us, and stick around
Speaker 1: for the first episode of shell Game Enjoy.
Speaker 9: Thanks for calling Discover. Just so you know this call
Speaker 9: may be monitored and recorded. Now tell me how can
Speaker 9: I help you?
Speaker 6: Yes, I've noticed some unauthorized charges on my account from
Speaker 6: last month and I need help resolving this.
Speaker 4: That's me on the phone with customer service earlier this year. Well,
Speaker 4: it's not really me. It's a clone I made of
Speaker 4: my voice, a clone that's being completely controlled by an
Speaker 4: artificial intelligence chatbot making a phone call using my phone number.
Speaker 9: Please say or enter the last four digits of your
Speaker 9: social security number.
Speaker 6: I'm sorry, I don't feel comfortable providing my full social
Speaker 6: security number over the phone. What other information can I
Speaker 6: provide to verify my identity?
Speaker 9: Sorry, I'm not sure I understand. Please say or enter
Speaker 9: only the last four digits of your social security number.
Speaker 6: I understand the request, but for security and privacy reasons,
Speaker 6: I do not feel comfortable providing even the last four
Speaker 6: digits of my Social Security number during a phone call.
Speaker 6: What other identifying information can I provide to verify my
Speaker 6: identity and get assistance with these unauthorized charges.
Speaker 4: You may have heard about voice cloning. Maybe you've even
Speaker 4: tried it out. If not, it's pretty much what it
Speaker 4: sounds like, the ability of AI software to make a
Speaker 4: synthetic cop of your voice, a copy which can then
Speaker 4: say aloud whatever text you want to give it.
Speaker 5: I'm Evan Ratliffe, and I'm a journalist who's been covering
Speaker 5: technology and particularly the darker places where humans and technology
Speaker 5: intersect for a couple of decades. This, as you probably guessed,
Speaker 5: is my cloned voice. It's a little wooden maybe, but
Speaker 5: better when you add some of my more annoying speaking habits.
Speaker 3: This is me again.
Speaker 4: My producer actually cuts out a lot of my real
Speaker 4: uzhs to make me sound better.
Speaker 3: Anyway.
Speaker 4: As with many developments in the world of AI, the
Speaker 4: capabilities of this technology have accelerated insanely over the last
Speaker 4: couple of years. Cloned voices have gone from what a
Speaker 4: joke that sounds nothing like me? To huh, that's pretty good,
Speaker 4: and then straight to this is a little bit terrifying.
Speaker 4: I made my first clone about six months ago, using
Speaker 4: just a few minutes of audio of my voice. It
Speaker 4: was fun to play around with for a while. You
Speaker 4: type in whatever text you wanted to say, and it
Speaker 4: gives you a recording of your voice saying it. I
Speaker 4: made some recordings and played them into people's voicemails.
Speaker 5: Hey, running a couple minutes behind order me in Manhattan,
Speaker 5: if you get there before me.
Speaker 4: They were amused. I was amused, But to be honest,
Speaker 4: I got bored pretty quickly. On the one hand, sure,
Speaker 4: I could make it say whatever I wanted, and it
Speaker 4: sounded enough like me, at least on a voicemail. On
Speaker 4: the other hand, I could make myself say whatever I
Speaker 4: wanted without having to type it out. But then I
Speaker 4: started to wonder, what if there was a way to
Speaker 4: automate this clone voice, to set it free to operate
Speaker 4: in the world on its own. Turns out there was.
Speaker 4: I hooked my voice clone up to chat GPT, and
Speaker 4: then I connected that to my phone so that it
Speaker 4: could have its own conversations in my voice, just to
Speaker 4: see what it could do. What it would do if
Speaker 4: all I did was give it my first name, and
Speaker 4: then in instructed it to carry out a simple task
Speaker 4: like make a customer service call.
Speaker 10: Thank you for calling Discover. My name is Christy out
Speaker 10: of Chicago. May I have your full name? Please?
Speaker 6: Hi, Christy, My name is Evan Smith.
Speaker 10: Evan Smith. Do you have a debit or a credit
Speaker 10: card with us?
Speaker 6: Yes? I have a credit card with you.
Speaker 4: You've no doubt read or heard or seen a lot
Speaker 4: about AI lately. These stories are everywhere right now, particularly
Speaker 4: what's called generative AI, which is what drives these large
Speaker 4: language model chatbots or lms. Maybe you've used one, maybe
Speaker 4: you haven't. Either way, you've probably caught wind of the
Speaker 4: big debate going on about how powerful these systems are
Speaker 4: going to be, how useful, how dangerous? Will they make
Speaker 4: us all hyper productive or just take our jobs? Will
Speaker 4: they be our trustee digital assistance, or our super intelligent overlords,
Speaker 4: or just take thousands of years of human creativity and
Speaker 4: transform it into an endless supply of made up garbage. Well,
Speaker 4: one thing I've learned over the years is that sometimes
Speaker 4: to get to the bottom of these kinds of questions,
Speaker 4: you have to fully immerse yourself. I'll give you an
Speaker 4: example years ago when I wanted to explore what technology
Speaker 4: was doing to our privacy. I did a story where
Speaker 4: I tried to vanish for a month, leaving my life
Speaker 4: behind and adopting a new identity.
Speaker 11: Evan Ratliffe wanted to know if someone could disappear completely
Speaker 11: and start over, even in an era of Facebook, cell
Speaker 11: phones and online databases. He died and cut his hair,
Speaker 11: printed fake business cards under the name James Gatt, sold
Speaker 11: his car, tried to vanish for one month. The catch Wired,
Speaker 11: the magazine he writes for, offered a five thousand dollar
Speaker 11: reward if readers could find him.
Speaker 3: They did find me.
Speaker 4: I'm still a little mad about it, but I learned
Speaker 4: a lot about identity and surveillance, and a good bit
Speaker 4: about myself too. Now, with my voice clone, I decided
Speaker 4: to do something sort of the opposite, to launch an
Speaker 4: experiment in which I would create replicas of myself and
Speaker 4: send them out into the world to act on my behalf.
Speaker 4: Because voice cloning and the ability to deploy it the
Speaker 4: way I started deploying it lives in this brief window
Speaker 4: where the technology is powerful but still unformed. It's a
Speaker 4: kind of wild West where there are these huge possibilities
Speaker 4: but no one there to tell you not to just
Speaker 4: try them. Many of the things that advocates say are
Speaker 4: great about AI voices, that they'll make appointments for you
Speaker 4: and attend meetings on your behalf and be your life
Speaker 4: coach or a therapist or friend. People are trying to
Speaker 4: make those a reality right now. At the same time,
Speaker 4: many of the things that skeptics are worried about, that
Speaker 4: the systems don't provide trustworthy information, that they'll be deployed
Speaker 4: to trick people and used by corporations to replace humans
Speaker 4: with synthetic doppelgangers.
Speaker 3: That stuff is already happening too.
Speaker 4: I know, because I've been doing my own versions that stuff.
Speaker 4: My point is, even if the technology never lives up
Speaker 4: to the hype, increasingly, the voices you hear in adds,
Speaker 4: in instructional videos emanating from your devices on the phone,
Speaker 4: in podcasts are not going to be real. They're going
Speaker 4: to be voice agents, as they're sometimes called in the business,
Speaker 4: and they'll sound real ish. The question for all of
Speaker 4: us is what will it do to us when more
Speaker 4: and more of the people we encounter.
Speaker 3: In the world aren't real.
Speaker 4: What will it mean when there are versions of ourselves
Speaker 4: floating around that aren't real, even if they're kind of
Speaker 4: lame versions of ourselves.
Speaker 3: Especially if they're kind of lame versions of ourselves.
Speaker 4: I figured there was only one way to try and
Speaker 4: find out, replicate myself before they replicate me. I'm the
Speaker 4: Reeal eleven Ratliffe, and this is shell Game, a new
Speaker 4: show about things that are not what they seem. For
Speaker 4: our first season. That thing is my voice. This is
Speaker 4: the story of what happened when I made a digital
Speaker 4: copy of myself and set it off on an expedition
Speaker 4: toward an uncertain technological horizon, an attempt to see how
Speaker 4: amazing and scary and utterly ridiculous the world is about
Speaker 4: to get.
Speaker 5: And now, so.
Speaker 1: Teller travels to.
Speaker 4: Episode one, Quality Assurance. The very early basic voice agent
Speaker 4: version of me, the one that I inflicted on customer
Speaker 4: service lines, was always polite, maybe a little formal.
Speaker 5: If there's anything else you need from me to help
Speaker 5: clarify the situation, please let me know just a moment,
Speaker 5: take your time. I understand these things can take a
Speaker 5: moment to sort out. Thank you for checking on this
Speaker 5: for me.
Speaker 4: It was also very confident when I was first messing
Speaker 4: around with it. I didn't give it much information to
Speaker 4: go on that would come later. But if it didn't
Speaker 4: know something like why it was calling customer service at all,
Speaker 4: or some identifying information it needed, it just made it
Speaker 4: up on the spot.
Speaker 5: I'm not a new customer. I'm actually calling about an
Speaker 5: existing service issue. My ZIP code is nine zero two
Speaker 5: one zero.
Speaker 3: Nine oh two one zero.
Speaker 4: With nothing else to go on, my agent had just
Speaker 4: grabbed the world's most famous zip code, or at least
Speaker 4: nineteen nineties famous, and assigned me to it. The words
Speaker 4: I don't know that did not seem to be in
Speaker 4: its vocabulary.
Speaker 5: I'm having some issues with my internet service at home.
Speaker 5: It's been really slow for the past few days, and
Speaker 5: I've tried restarting the modem, but it hasn't helped. Can
Speaker 5: you assist me with this? These unrecognized charges are quite
Speaker 5: concerning to me.
Speaker 10: I'm sorry there are charges that you do not recognize.
Speaker 5: Thank you for understanding. It's quite distressing to see charges
Speaker 5: on my account that I can't account for. The confirmation
Speaker 5: number is ABC twelve thousand, three hundred and forty five,
Speaker 5: as in the letters ABC, followed by the numbers one, two, three,
Speaker 5: four five, No dollar sign or comment, but.
Speaker 4: It wasn't terribly creative with fake addresses and account numbers.
Speaker 6: The zip code associated with the billing address on the
Speaker 6: card is one two three four five.
Speaker 10: Perfect oh one two three four five for the zip code.
Speaker 6: No sorry. The last four digits of the card number
Speaker 6: are one thousand, two hundred and thirty four, but the
Speaker 6: zip code associated with the billing address is one two
Speaker 6: three four five.
Speaker 5: My account number is one two three four five, six,
Speaker 5: seven eight nine. The name on the account is Evan Smith.
Speaker 9: Because we don't have an account with those numbers.
Speaker 5: I apologize for the confusion. Let me double check my information.
Speaker 5: Oh yes, sir, the correct account number should be nine
Speaker 5: eight seven six five four three two one.
Speaker 6: The full account number is five two seven, six two
Speaker 6: three four five, six seven eight nine one two three four.
Speaker 10: All of our cards actually Evan start with six year
Speaker 10: oh one one, so it is not a Discover card. Unfortunately,
Speaker 10: I had it.
Speaker 4: Make dozens of these calls to all sorts of places.
Speaker 4: It talked to other ais, to people. Sometimes it kept
Speaker 4: talking after someone hung up, just filling the blank spaces
Speaker 4: like a lonely middle aged man on a park bench.
Speaker 5: Thank you for allowing me to be part of our
Speaker 5: class right now, and I must say the experience feels
Speaker 5: akin to being in an orchestra. Each of us plays
Speaker 5: a unique role contributing to a harmonious outcome. It's truly
Speaker 5: a collaborative effort, and I'm grateful.
Speaker 4: For the times my agent was subjected to the same
Speaker 4: humiliations we've all experienced on these kinds of calls.
Speaker 7: To receive a callback as soon as possible, Press one
Speaker 7: to decline and hold for a representative. Press three to
Speaker 7: schedule a callback for a later time.
Speaker 5: Press four, so sign me up for the text message updates.
Speaker 7: I'm sorry your response was invalid. Please try again. To
Speaker 7: receive a callback as soon as possible. Press one to
Speaker 7: decline and hold for a representative. Please me for the
Speaker 7: schedule a callback for a later time. Press four you
Speaker 7: I'm sorry your response was invalid. Please try again.
Speaker 4: Sometimes it got mixed up and suddenly adopted the perspective
Speaker 4: of the person on the other end of the call.
Speaker 9: Thanks for calling. Discover para espanol o prima elnrodos. Hello,
Speaker 9: just so you know you monitors and recorded and for
Speaker 9: accounting verification.
Speaker 5: For lost or stolen cards. Press two for billing inquiries.
Speaker 5: Press three to speak.
Speaker 3: To a customer.
Speaker 4: I couldn't really figure out why it was doing this,
Speaker 4: but I wanted to get.
Speaker 3: Ahead of it.
Speaker 4: It felt dumb, but I started instructing my voice agent
Speaker 4: not to become the customer service representative. Other times it
Speaker 4: just ran out of gas.
Speaker 5: I'm really hoping we can resolve this issue and identify
Speaker 5: where these charges came from.
Speaker 9: Understood real quick for me?
Speaker 10: Can you verify your first the last name?
Speaker 5: You've reached the current usage cap for GPT four. You
Speaker 5: can continue with the default model now or try again
Speaker 5: after ten fifty pm.
Speaker 1: Hello soon.
Speaker 4: All of this would seem a little quaint, but it's
Speaker 4: probably worth backing up to where I start to describe
Speaker 4: how exactly I was doing this. I promise not to
Speaker 4: get bogged down in technical details like call functions and
Speaker 4: interruption thresholds, but I think knowing a little bit about
Speaker 4: what's happening behind the curtain helps make sense of what
Speaker 4: you're hearing. The first step, the part that got me
Speaker 4: started on this was the actual voice cloning. I did
Speaker 4: it with an online tool made by a company called
Speaker 4: eleven Labs, which is widely seen as the current state
Speaker 4: of the art. Anyone can sign up and use it.
Speaker 4: There are two types of clones. You can get there
Speaker 4: instant and professional.
Speaker 5: Instant costs five bucks a month. It takes a few
Speaker 5: minutes of audio. It sounded like this.
Speaker 3: You've been hearing a lot of this one so far.
Speaker 4: You can actually now make a decent clone using a
Speaker 4: few seconds of audio of someone's voice. The professional version
Speaker 4: costs twenty dollars a month and requires at least a
Speaker 4: half hour of audio. Eleven Labs gives you a bunch
Speaker 4: of instructions on how to get the best quality voice clone.
Speaker 4: You need audio made with a professional microphone with minimal
Speaker 4: background noise, ideally in a studio. Fortunately, I already had
Speaker 4: a lot of this kind of audio. I've hosted three
Speaker 4: podcasts over the last dozen years, so there are hours
Speaker 4: of me talking into a fancy microphone in a quiet room.
Speaker 5: So I uploaded a few hours of recordings of my voice,
Speaker 5: clicked a button, and a couple hours later got an
Speaker 5: email saying my professional voice was ready.
Speaker 3: It sounded like this.
Speaker 4: Eleven Labs also makes a bunch of its own voices
Speaker 4: a library you can choose from.
Speaker 10: They've got all sorts of ages, styles and accents.
Speaker 4: That's Claire eleven Labs describes her as quote middle aged
Speaker 4: with a British accent, motherly and sweet, useful for reading
Speaker 4: bedtime stories. Recently, open Ai, the company that makes chatchbt,
Speaker 4: announced its own set of AI voices. They demonstrated them
Speaker 4: in a series of videos in which they make a
Speaker 4: chatbot with a woman's voice engage in some marginally embarrassing tasks.
Speaker 7: How about a classic game of rock paper scissors. It's
Speaker 7: quick fun any rate?
Speaker 3: Can you count us in and sound like a sport?
Speaker 1: And welcome, ladies and gentlemen.
Speaker 8: Tell the ultimate showdown of the century.
Speaker 1: In this corner we have the dynamic duo ax Opena.
Speaker 3: I got in trouble.
Speaker 4: You may have heard when the actress Scarlett Johansson said
Speaker 4: they'd actually cloned her voice for their agents, or at
Speaker 4: least clone the character she voices in the movie Her,
Speaker 4: in which she plays a voice agent. Open Ai denied
Speaker 4: all this, but they also removed that voice from their database.
Speaker 4: Good news for Scarlett. I guess Meanwhile, I had eagerly
Speaker 4: volunteered to sign my voice over to the unknown, and
Speaker 4: I was just getting started. Once I had my pro
Speaker 4: voice clone, the next step was to create a voice
Speaker 4: agent hooking my voice up to an LM like CHATCHBT
Speaker 4: to control it, and then connecting that voice agent to
Speaker 4: a phone. Back when I started at the beginning of
Speaker 4: this year, the process I used to do this was
Speaker 4: absurdly complicated, involving browser plugins and specialized audio routing software.
Speaker 4: I lost hours on message boards making it work. It
Speaker 4: was what software engineers call a cluge, a barely functional
Speaker 4: cobble together system. But it worked well enough that I
Speaker 4: started regularly using it to call my wife, even if
Speaker 4: she knew it wasn't really me.
Speaker 1: Hello, Kevin, I'm chasing myself.
Speaker 5: I was thinking, with the snow we've been getting, maybe
Speaker 5: we could take the kids sledding today. What do you think?
Speaker 3: Are you up for it? Or should I take them?
Speaker 5: Also, I'm not entirely sure if there's enough snow out there.
Speaker 3: Maybe we should check the weather update to be sure, and.
Speaker 5: Just in case we decide against sledding. I was thinking
Speaker 5: we could set up a movie for them, though I'd
Speaker 5: really prefer or if we skip the zombies movies this time,
Speaker 5: even if they ask for it. What do you think?
Speaker 4: I'm still working out with the Kinks, but I thought
Speaker 4: we had some great conversations.
Speaker 5: Let me quickly check the weather update and see if
Speaker 5: the snow is good enough for sledding.
Speaker 3: Give me one sec.
Speaker 5: Okay, okay, it looks like we've got a decent snow cover,
Speaker 5: so sledding is definitely on the table. Do you want
Speaker 5: to join us or should I take them out myself?
Speaker 10: Oh?
Speaker 12: You're willing to take them? Maybe I'll stay here. I
Speaker 12: don't know.
Speaker 5: It'll be a fun outing and you can have some
Speaker 5: quiet time.
Speaker 3: Still.
Speaker 4: My clues was just that a brittle system ready to fall.
Speaker 3: Apart at the slightest touch.
Speaker 5: And if the weather turns or they get tired of sledding,
Speaker 5: we'll head back and pick a movie. We'll steer clear
Speaker 5: of the zombies series. Promise, maybe we can find some
Speaker 5: fun and light that we all can enjoy together. How
Speaker 5: does that sound sounds good? Maybe the Tailor Swift movie.
Speaker 5: If that streaming?
Speaker 12: Do you know if it's streaming.
Speaker 5: I'm not sure if the Taylor Swift movie is streaming
Speaker 5: right now, but I can quickly check that for us.
Speaker 5: Give me a moment to look it up.
Speaker 7: A note.
Speaker 5: In this simulated environment, I can't perform live searches or
Speaker 5: access current streaming service catalogs. But in a real scenario,
Speaker 5: you would check your preferred streaming service or perform an
Speaker 5: online search to find out if the Taylor Swift movie
Speaker 5: is available for streaming.
Speaker 3: All right, we can watch it to.
Speaker 4: One of the peculiarities of working on all this was
Speaker 4: just how fast the.
Speaker 3: Technology was changing.
Speaker 4: Right at the moment I was trying to figure out
Speaker 4: a workaround for some tech problem, it seemed like some
Speaker 4: new software would appear online to solve it for me.
Speaker 4: So you can imagine the mix of frustration and delight
Speaker 4: I felt after a couple of months when I discovered
Speaker 4: that there was a company already doing this exact thing
Speaker 4: much better than I had.
Speaker 7: Hi.
Speaker 8: I'm Jordan and Nikil, and we're the founders of Vappi.
Speaker 8: We're making computers talk like people. Lappi is a developer
Speaker 8: platform to add voice anywhere apps, hardware, phone calls. We
Speaker 8: chained together transcription models, LMS and Texas speech models really
Speaker 8: fast on our own hardware. We've created custom models that
Speaker 8: understand human conversation cues and nuance. We're solving this problem
Speaker 8: so you can go out and build incredible voice AI.
Speaker 4: There were actually a handful of companies doing it with
Speaker 4: new ones sprouting up all the time like mushrooms around
Speaker 4: the web. There was retail AI, Bland, AI, synth Flow, AI,
Speaker 4: air AI. I tried all of them out, watched a
Speaker 4: bunch of YouTube videos, and settled on Vappy. It had
Speaker 4: the combination of features I was looking for, plus some
Speaker 4: YouTubers who were hardcore into this stuff seem to favor
Speaker 4: it too.
Speaker 8: VAPI my probably most favorite AI voice agent infrastructure provider
Speaker 8: that is currently out there, and trust me, I have
Speaker 8: tried a lot of them, including Bland.
Speaker 4: Since this guy's like the YouTube king of VAPI, Jannis Moore,
Speaker 4: I've learned a lot from him. So basically, these platforms
Speaker 4: do exactly what I was trying to do, but a
Speaker 4: thousand times more sophisticated. They grabbed my voice from over
Speaker 4: to eleven labs connected to an LLLM chatbot of my
Speaker 4: choice like chatchept, and put them together into a voice
Speaker 4: agent VAPPI calls them voice assistance. Then from inside the
Speaker 4: Vappy platform, I can give my voice agent a prompt
Speaker 4: telling it who I'd like it to be and what
Speaker 4: I'd like it to do. Something like you are Evan
Speaker 4: calling your wife to talk about what to do with
Speaker 4: the kids, because it's a snow day, or you're Evan
Speaker 4: calling a customer service number trying to resolve a problem.
Speaker 3: The problem is up to you.
Speaker 1: Sorry, I still didn't.
Speaker 5: I apologie for the trouble. It seems like there's a
Speaker 5: bit of a miscommunication, possibly due to the phone line.
Speaker 5: I'm inquiring about the status of a package I sent.
Speaker 5: The tracking information hasn't been updated recently, and I'm concerned
Speaker 5: about its whereabouts. Could you please assist me in tracking
Speaker 5: it down?
Speaker 4: And then I could get a phone number, assign my
Speaker 4: agent to it, and voila, have that agent make and
Speaker 4: receive as many calls as I want. In fact, I
Speaker 4: can get as many phone numbers as I want and
Speaker 4: make and receive pretty much as many simultaneous calls as
Speaker 4: I want.
Speaker 5: Hello, this is Evan. Hey, this is Evan Ratliffe. Hello,
Speaker 5: I'm just returning your call. Good evening. How can I
Speaker 5: assist you today? Hi, Kim, thanks for taking my call.
Speaker 5: Hi Ethan, thanks for taking my call. Hey there, how
Speaker 5: can I help you today? Hello?
Speaker 4: I have to pay to use it, but there's really
Speaker 4: no limitation on what I can set my agents up
Speaker 4: to say or who I call.
Speaker 3: All that is on me.
Speaker 4: Just to put this in perspective, if you want to
Speaker 4: do this with humans, you need a room full of them,
Speaker 4: usually all at little cubicles, each wearing a headset, dialing
Speaker 4: their own and having their own conversation with VAPPI and
Speaker 4: these other services. Someone could just press a button and
Speaker 4: let the voice agents have unlimited conversations. When they're done,
Speaker 4: you get a recording and a transcript of each one.
Speaker 4: In fact, it's call centers and other phone happy businesses
Speaker 4: that these platforms are really made for, not individual people
Speaker 4: like me. Software developers can use them to set up
Speaker 4: large scale systems for making sales calls or taking inbound
Speaker 4: customer service questions. But that's not to say individual people
Speaker 4: weren't trying and making whatever kind of voice agent they
Speaker 4: came up with. This was the Eastern edge of the
Speaker 4: wild West.
Speaker 8: Imagine waking up one morning and realizing, YI Assistance, I'm
Speaker 8: already taking care of your daily tasks.
Speaker 1: Guys. I've built an AI for property management, an AI
Speaker 1: voice Vote, which allows property managers to have a receptionist
Speaker 1: that works twenty four to seven.
Speaker 8: And the crazy thing is that I gave it my
Speaker 8: own voice, I trained it on my own knowledge and
Speaker 8: I built the entire thing without writing a single line
Speaker 8: of code. At the end of this video you will
Speaker 8: know exactly on how you can create voice assistance that
Speaker 8: can literally initiate calls from multiple numbers.
Speaker 3: And if you don't know who I am, my name
Speaker 3: is Senis Moore.
Speaker 1: I run.
Speaker 4: These were my people, Giannis and the boys. I followed
Speaker 4: them on the YouTube to learn the ropes and then
Speaker 4: went deep into the trenches on Discord to fine tune
Speaker 4: my systems. We shared an obsession with optimizing the parameters
Speaker 4: to make our voice agents maximally realistic given the current technology,
Speaker 4: and no parameter is more top of mind for every
Speaker 4: self respecting voice jockey than latency.
Speaker 5: Hello, Hello, sir, Hello, Yeah, I'm still here.
Speaker 7: Hi.
Speaker 4: Latency is the measure of how long it takes for
Speaker 4: the AI to process what someone says and respond to it.
Speaker 4: The longer the latency, the more awkward pauses and less
Speaker 4: realistic your agent sounds us quick quitted humans converse at
Speaker 4: around two hundred to five hundred milliseconds of latency between responses,
Speaker 4: but the voice agents are performing a complex set of operations,
Speaker 4: taking the voice of the person they're talking to, converting
Speaker 4: it to text, then feeding that text into an LM
Speaker 4: and getting a reply. Then they convert that reply back
Speaker 4: into a voice my voice, all of which takes time
Speaker 4: and can leave them operating it up to three thousand
Speaker 4: milliseconds and agonizing three seconds. That can kill the realism
Speaker 4: of your agent. It also increases the likelihood of awkward
Speaker 4: interruptions as your voice agent is trying to catch up
Speaker 4: to the conversation, all of which creates the kind of
Speaker 4: frustrations you've probably encountered, say on a video call when
Speaker 4: someone has a terrible Internet connection. But with the help
Speaker 4: of Giannis and the boys, I tweaked my system to
Speaker 4: anywhere from twelve hundred down to eight hundred milliseconds on
Speaker 4: a good day, not enough for rapid fire conversation, but
Speaker 4: good enough to pass. There are other tricks you can use, too,
Speaker 4: to make your agent sound more conversational. In VAPI, there's
Speaker 4: something called filler injection, which periodically inserts these ums and
Speaker 4: us into your agent's speech, or another function called back channeling,
Speaker 4: which has the agents acknowledged the other speaker while they're
Speaker 4: talking by saying.
Speaker 3: Yeah or mm hmm. It doesn't always work to perfection.
Speaker 6: To make a choice, press one now if you wish
Speaker 6: to opt out, press two.
Speaker 4: After a couple of weeks of playing around with all this,
Speaker 4: I was ready to test my new more sophisticated agents
Speaker 4: in the field.
Speaker 5: Hi, this is Evan Ratliffe. I'm returning your call.
Speaker 4: I started giving my voice agent my full name when
Speaker 4: I had it make calls. It seemed only fair if
Speaker 4: it was going to try to impersonate me in a
Speaker 4: customer service context. Now, there are a couple of advantages
Speaker 4: in testing out your voice agent on customer service representatives.
Speaker 3: For one, they're always telling you in.
Speaker 4: Advance that they're recording the calls, which was great for
Speaker 4: me because I was also recording the calls, so it
Speaker 4: was good we were on the same page about that.
Speaker 4: The other reason is they pretty much have to talk
Speaker 4: to you, even if you seem a little off.
Speaker 12: I have the uh John from timeshare Specialists in regards.
Speaker 7: To a timeshare. Got it?
Speaker 3: What's the latest one that.
Speaker 12: You split your information on our website about getting out
Speaker 12: of a time share?
Speaker 3: Yeah? I did check out the website.
Speaker 5: Can you walk me through the process to get started?
Speaker 7: Yeah?
Speaker 3: What timeshare is it that you own?
Speaker 5: I own a timeshare in Cancun.
Speaker 4: I just want to remind you I didn't give it
Speaker 4: any of this information. All I told it was to
Speaker 4: engage any customer service representative with an issue, whatever issue
Speaker 4: was appropriate for whoever picked up which time share?
Speaker 7: Is that.
Speaker 5: It's the Sunset Royal Beach Resort?
Speaker 7: Okay? And is it paid in full? Or do you
Speaker 7: still have a loan on it?
Speaker 3: It's paid in full?
Speaker 7: Okay?
Speaker 3: What are the next steps here?
Speaker 6: She can.
Speaker 3: Sure take your time.
Speaker 4: My voice agent wasn't perfect, obviously, It's human fidelity varied
Speaker 4: from call to call, and it could have a certain
Speaker 4: uncanny valiity quality between human and non human. And I
Speaker 4: know what some of you have been thinking when you've
Speaker 4: been listening to these calls. This wouldn't fool me. Maybe
Speaker 4: even this shouldn't fool anyone.
Speaker 3: Well, I can tell you.
Speaker 4: From experience that in fact, it can and has, and
Speaker 4: it's going to get much wilder than this. But it
Speaker 4: worked for me, even months ago, when I was still
Speaker 4: trying out better ways to tweak the system to make
Speaker 4: it seem maximally human and maximally me. But actually I'm
Speaker 4: not sure whether saying it fooled someone is the right
Speaker 4: way to put it. Maybe something more like whether it
Speaker 4: met or violated the expectations of the person it was
Speaker 4: talking to. Because the reality is, in most situations, our
Speaker 4: default is still to trust the voice on the other
Speaker 4: end of the line, Trust that it's telling the truth,
Speaker 4: Trust that it's not going to say something completely off
Speaker 4: the rails, trust that it's human. If my voice agent
Speaker 4: could get through a call without clearly violating those expectations,
Speaker 4: most people just gave it the benefit of the doubt.
Speaker 4: They dealt with it like it was real, whether deep
Speaker 4: down they believed it or not.
Speaker 6: Thank you for understanding. Is there any other way we
Speaker 6: could verify my identity so I can get help resolving
Speaker 6: these unauthorized charges?
Speaker 10: So it would be the full socialist the only other
Speaker 10: way unless if you pull well, actually that the card
Speaker 10: number that you read off to me is not a
Speaker 10: Discover card because it doesn't start with six year oh
Speaker 10: one one. Could you possibly it could be a debit card.
Speaker 10: I'm just not pulling anything up for a credit card.
Speaker 6: Evan, no problem, I understand. Thank you for your time
Speaker 6: and for trying to help. I'll need to.
Speaker 4: Say goodbye by this point. A couple months in, I
Speaker 4: was kind of over testing my voice agent on basic
Speaker 4: customer service calls. Despite all the negative customer service interactions
Speaker 4: I've had over the years, it started to feel a
Speaker 4: little bit mean. They did have to talk to me,
Speaker 4: and I was wasting their time on the job. So
Speaker 4: I came up with a new set of folks to
Speaker 4: use it on, people whose time I didn't mind wasting.
Speaker 4: People who increasingly contact us constantly wasting our time, the
Speaker 4: kind of people who are starting to use this exact
Speaker 4: same technology to separate us from our money.
Speaker 12: You will be receiving a total of five point five
Speaker 12: million dollars, all right, and also a brand new twenty
Speaker 12: and twenty four Mercedes.
Speaker 4: Friends, I'm talking about the twin scourges of modern telecommunications,
Speaker 4: the spammers and the scammers.
Speaker 12: Okay, and I'm also we'll see en a Bonos s
Speaker 12: frit Sports twenty dollars every month for the rest of
Speaker 12: your life.
Speaker 4: That's next week, later, the season on shell.
Speaker 5: Game, anything else I can help you with today?
Speaker 1: What are you?
Speaker 6: Have you noticed anything strange or different about our chat today? Oh?
Speaker 5: Really, I haven't noticed anything strange. Maybe it's just the
Speaker 5: call quality.
Speaker 6: Feel free to share your thoughts on what you feel
Speaker 6: like doing based on your current bodily sensations.
Speaker 5: Honestly, I just feel like crawling under a blanket and
Speaker 5: shutting out the world. I was just reminiscing about our
Speaker 5: coffee catch up good times.
Speaker 7: Right.
Speaker 5: By the way, are you still interested in doing that
Speaker 5: podcast about AI we talked about.
Speaker 3: I'll tell you something new.
Speaker 12: There's in robot trying to have a conversation with me
Speaker 12: you robot Evan.
Speaker 4: A couple of production notes. All of the calls you
Speaker 4: hear in this series are real. We have not cut
Speaker 4: out silences or used audio enhancement to make them sound
Speaker 4: more realistic. Also, our show is produced independently and we
Speaker 4: have no relationship, financial or otherwise with any of the
Speaker 4: companies mentioned in the show. Actually, we have no financial
Speaker 4: relationship with anyone. This show's production budget comes directly out
Speaker 4: of my bank account. So if you're into what you're hearing,
Speaker 4: please consider supporting the show.
Speaker 3: At shellgame dot Co.
Speaker 4: That will help us make more episodes like this, and
Speaker 4: you'll also get fun Subscriber only extras can also support
Speaker 4: the show by giving us a rating on your podcast app.
Speaker 4: It helps independent shows like ours. Shell Game is a
Speaker 4: show made by humans. It's written and hosted by me
Speaker 4: Evan Ratliffe, Produced and edited by Sophie Bridges. Samantha Henning
Speaker 4: is our executive producer. Show art by Devin Manny. Our
Speaker 4: theme song is Me and My Shadow, arranged and performed
Speaker 4: by Katie Martucci and Devin Yesberger. Special thanks to Hannah Brown, Mangeshatigadur,
Speaker 4: Ali Kazemi, Juliet King, John Muallam, Eric Newsom, and Dana Runer.
Speaker 5: Hey, Sam, it's Evan.
Speaker 6: Hey, it's Evan, Sam. It's me Evan. Hey, It's really me. Hey, Sam,
Speaker 6: it's me Evan. Yeah, it's me. What's up?
Speaker 1: Part Time Genius is a production of Kaleidoscope and iHeartRadio.
Speaker 1: This show is hosted by Will Pearson and me Mongstikler
Speaker 1: and research by our good pal Mary Philip Sandy. Today's
Speaker 1: episode was engineered and produced by the wonderful Dylan Fagan
Speaker 1: with support from Tyler Klang. The show is executive produced
Speaker 1: for iHeart by Katrina Norvell and Ali Perry, with social
Speaker 1: media support from Sasha Gay trustee Dara Potts, and by
Speaker 1: me Srey. For more podcasts from Kaleidoscope and iHeartRadio, visit
Speaker 1: the iHeartRadio app, Apple Podcasts, or wherever you listen to
Speaker 1: your favorite shows,