WEBVTT - Smart Talks with IBM - Salesforce & IBM: Revolutionizing Experiences with Generative AI

0:00:04.680 --> 0:00:12.840
<v Speaker 1>Welcome to Tech Stuff, a production from iHeartRadio. Today, we

0:00:12.880 --> 0:00:15.880
<v Speaker 1>are witnessed to one of those rare moments in history,

0:00:16.239 --> 0:00:19.439
<v Speaker 1>the rise of an innovative technology with the potential to

0:00:19.600 --> 0:00:24.320
<v Speaker 1>radically transform business and society forever. That technology, of course,

0:00:24.800 --> 0:00:28.360
<v Speaker 1>is artificial intelligence, and it's the central focus for this

0:00:28.520 --> 0:00:32.519
<v Speaker 1>new season of Smart Talks with IBM. Join hosts from

0:00:32.560 --> 0:00:36.280
<v Speaker 1>your favorite Pushkin podcasts as they talk with industry experts

0:00:36.280 --> 0:00:39.920
<v Speaker 1>and leaders to explore how businesses can integrate AI into

0:00:39.960 --> 0:00:43.280
<v Speaker 1>their workflows and help drive real change in this new

0:00:43.360 --> 0:00:47.040
<v Speaker 1>era of AI, and of course, host Malcolm Gladwell will

0:00:47.040 --> 0:00:49.360
<v Speaker 1>be there to guide you through the season and throw

0:00:49.440 --> 0:00:52.360
<v Speaker 1>in his two cents as well. Look out for new

0:00:52.360 --> 0:00:55.280
<v Speaker 1>episodes of Smart Talks with IBM every other week on

0:00:55.320 --> 0:00:59.560
<v Speaker 1>the iHeartRadio app, Apple Podcasts, wherever you get your podcasts.

0:01:00.080 --> 0:01:04.000
<v Speaker 1>Learn more at IBM dot com slash smart Talks.

0:01:06.319 --> 0:01:09.920
<v Speaker 2>Hello, Hello, Welcome to Smart Talks with IBM, a podcast

0:01:09.959 --> 0:01:16.319
<v Speaker 2>from Pushkin Industries, iHeartRadio and IBM. I'm Malcolm Glappo. This season,

0:01:16.360 --> 0:01:20.479
<v Speaker 2>we're continuing our conversations with new creators visionaries who are

0:01:20.560 --> 0:01:25.280
<v Speaker 2>creatively applying technology and business to drive change, but with

0:01:25.319 --> 0:01:30.080
<v Speaker 2>a focus on the transformative power of artificial intelligence and

0:01:30.120 --> 0:01:33.320
<v Speaker 2>what it means to leverage AI as a game changing

0:01:33.440 --> 0:01:39.080
<v Speaker 2>multiplier for your business. Today's episode highlights the power of collaboration.

0:01:39.880 --> 0:01:42.600
<v Speaker 2>IBM has long been a supporter of the better Together

0:01:42.720 --> 0:01:47.000
<v Speaker 2>mindset and embrace his partnerships. They have been working together

0:01:47.040 --> 0:01:50.920
<v Speaker 2>with Salesforce for more than two decades, but have recently

0:01:51.000 --> 0:01:56.600
<v Speaker 2>launched a new collaborative effort surrounding generative AI. Pushkin's very

0:01:56.600 --> 0:02:00.800
<v Speaker 2>own Jacob Goldstein sat down with Matt Candy and sus Emerson.

0:02:01.360 --> 0:02:04.920
<v Speaker 2>Matt is the global managing Partner of Generative AI at

0:02:04.960 --> 0:02:09.360
<v Speaker 2>IBM Consulting, helping clients and partners around the world embrace

0:02:09.440 --> 0:02:14.000
<v Speaker 2>this new era of technology, and Susan is a senior

0:02:14.080 --> 0:02:19.400
<v Speaker 2>vice president for Salesforce dedicated to AI, analytics and data.

0:02:20.280 --> 0:02:23.880
<v Speaker 2>They discussed the historic collaboration between the two tech giants,

0:02:24.480 --> 0:02:28.560
<v Speaker 2>explored the opportunity AI presents for customer service, and walk

0:02:28.639 --> 0:02:35.480
<v Speaker 2>through how businesses can use generative AI to interface with clients. Okay,

0:02:35.800 --> 0:02:37.080
<v Speaker 2>let's get to the conversation.

0:02:39.680 --> 0:02:42.919
<v Speaker 3>Thank you guys for coming this morning. So I'm interested

0:02:42.960 --> 0:02:46.760
<v Speaker 3>in how you both came to generative AI, or maybe

0:02:46.760 --> 0:02:48.120
<v Speaker 3>it sort of came to you in the way it

0:02:48.160 --> 0:02:50.160
<v Speaker 3>sort of came to all of us, But how did

0:02:50.200 --> 0:02:52.360
<v Speaker 3>you arrive at working on generative AI.

0:02:52.760 --> 0:02:55.560
<v Speaker 4>As part of my remitted Salesforce. Over the years, I've

0:02:55.600 --> 0:02:59.280
<v Speaker 4>brought a lot of analytics and data and machine learning

0:02:59.280 --> 0:03:04.040
<v Speaker 4>products to life under the Einstein brand at Salesforce. So

0:03:04.520 --> 0:03:09.480
<v Speaker 4>as we pivoted Salesforce into taking advantage of the generative

0:03:09.480 --> 0:03:12.600
<v Speaker 4>AI moment, it was natural that I became part of

0:03:12.639 --> 0:03:19.519
<v Speaker 4>the advanced team leveraging generative AI, and it's become interesting.

0:03:19.639 --> 0:03:23.360
<v Speaker 4>But what I see as I speak with customers the

0:03:23.440 --> 0:03:25.840
<v Speaker 4>moment that everyone is facing in terms of how they

0:03:26.040 --> 0:03:31.959
<v Speaker 4>incorporate genitive AI into their businesses, their workforces, and their

0:03:32.000 --> 0:03:35.280
<v Speaker 4>technical stacks. It's actually opening up a lot of doors

0:03:35.360 --> 0:03:40.320
<v Speaker 4>to other utility of analytics, data and AI. So it's

0:03:40.360 --> 0:03:44.400
<v Speaker 4>been this big pull through in terms of incorporating not

0:03:44.520 --> 0:03:48.640
<v Speaker 4>just generative AI, but a larger conversation around how we

0:03:49.080 --> 0:03:52.720
<v Speaker 4>become all better using data in our day jobs.

0:03:54.280 --> 0:03:56.960
<v Speaker 3>So that's a great frame for sort of what's going

0:03:57.000 --> 0:04:00.840
<v Speaker 3>on at Salesforce with generative AI. Tell us a little

0:04:00.880 --> 0:04:03.080
<v Speaker 3>bit about you know, how that fits with the way

0:04:03.520 --> 0:04:04.920
<v Speaker 3>IBM is approaching with space.

0:04:05.680 --> 0:04:08.880
<v Speaker 5>Yeah, so I guess through three sides to that question.

0:04:09.520 --> 0:04:12.360
<v Speaker 5>And so there's the technology side of it. So IBM

0:04:12.440 --> 0:04:15.720
<v Speaker 5>has a technology organization, and so you know, we are

0:04:15.760 --> 0:04:19.400
<v Speaker 5>building and have been over many years decades. In fact,

0:04:19.480 --> 0:04:22.919
<v Speaker 5>IBM has been working in this space a generative AI

0:04:23.080 --> 0:04:30.600
<v Speaker 5>stack that allows organizations to adopt generative AI technology aimed

0:04:30.640 --> 0:04:35.200
<v Speaker 5>at enterprise and business use within their organizations. So then

0:04:35.240 --> 0:04:37.839
<v Speaker 5>within the consulting business, you know, we have one hundred

0:04:37.839 --> 0:04:41.400
<v Speaker 5>and sixty thousand people who work every day with clients

0:04:41.440 --> 0:04:47.080
<v Speaker 5>across every industry, regulated industries, government organizations, and so this,

0:04:47.320 --> 0:04:50.800
<v Speaker 5>you know, is a really important technology that those companies

0:04:50.839 --> 0:04:53.080
<v Speaker 5>are going to be using to drive the next level

0:04:53.080 --> 0:04:57.359
<v Speaker 5>of transformation in their enterprises processes and the types of

0:04:57.400 --> 0:05:00.479
<v Speaker 5>experiences they build for their customers. And so you know,

0:05:00.520 --> 0:05:05.880
<v Speaker 5>we work extensively with partners technology such as Salesforce, AWS, Microsoft,

0:05:06.400 --> 0:05:09.760
<v Speaker 5>as well as our own technology. And then finally, I

0:05:09.760 --> 0:05:12.600
<v Speaker 5>guess the third angle is the work that we've got

0:05:12.640 --> 0:05:15.560
<v Speaker 5>to do to reinvent the business of consulting. And so

0:05:15.720 --> 0:05:18.880
<v Speaker 5>if I think about you know, consulting in systems integration,

0:05:19.320 --> 0:05:22.839
<v Speaker 5>you know, ultimately we are knowledge workers, right, and so

0:05:23.120 --> 0:05:25.880
<v Speaker 5>from an industry perspective, I think, you know, our industry

0:05:25.960 --> 0:05:29.080
<v Speaker 5>is same as many others is it's going to go

0:05:29.279 --> 0:05:33.359
<v Speaker 5>undergo a level of disruption caused by this technology, but

0:05:33.440 --> 0:05:36.160
<v Speaker 5>therefore that will also create a huge opportunity for us

0:05:36.640 --> 0:05:37.039
<v Speaker 5>as well.

0:05:37.120 --> 0:05:40.080
<v Speaker 6>So those three aspects, Jacob, great.

0:05:39.920 --> 0:05:42.040
<v Speaker 3>So, so that's the point of view sort of from

0:05:42.080 --> 0:05:46.279
<v Speaker 3>your companies in your work. I'm curious to talk for

0:05:46.360 --> 0:05:48.960
<v Speaker 3>a moment about AI from the point of view of

0:05:49.720 --> 0:05:53.599
<v Speaker 3>consumers and employees kind of out in the world today.

0:05:53.640 --> 0:05:56.560
<v Speaker 3>So just to start with consumers, when I'm just out

0:05:57.160 --> 0:05:59.479
<v Speaker 3>as a person as a consumer in the world, how

0:05:59.480 --> 0:06:01.320
<v Speaker 3>am I AI today?

0:06:02.480 --> 0:06:03.840
<v Speaker 6>I'll give you a great little use case.

0:06:03.880 --> 0:06:07.919
<v Speaker 5>Actually, I was on holiday three weeks ago in Tenerif

0:06:07.960 --> 0:06:10.919
<v Speaker 5>in Spain, and I was trying to find somewhere to

0:06:10.960 --> 0:06:11.960
<v Speaker 5>park the car with the.

0:06:11.920 --> 0:06:13.360
<v Speaker 6>Family for dinner that evening.

0:06:14.000 --> 0:06:19.240
<v Speaker 5>And I found this area next to this kind of

0:06:19.279 --> 0:06:22.359
<v Speaker 5>shopping center and there was this sign there and I

0:06:22.360 --> 0:06:24.719
<v Speaker 5>couldn't quite work out if it was saying I could

0:06:24.760 --> 0:06:27.760
<v Speaker 5>park there or not, And so I took a photo

0:06:27.839 --> 0:06:30.719
<v Speaker 5>of the sign and I uploaded it to an AI

0:06:31.080 --> 0:06:33.279
<v Speaker 5>tool and I said, what does this mean? And it

0:06:33.320 --> 0:06:35.479
<v Speaker 5>basically explained to me what the sign was saying and

0:06:35.520 --> 0:06:37.640
<v Speaker 5>basically told me that I shouldn't be parking there, and

0:06:37.680 --> 0:06:40.920
<v Speaker 5>so I drove on and I found some somewhere else

0:06:40.960 --> 0:06:45.520
<v Speaker 5>to park. But you know, that allowed me in under

0:06:45.560 --> 0:06:49.440
<v Speaker 5>sixty seconds to probably avoid one hundred euro fine by

0:06:49.480 --> 0:06:52.960
<v Speaker 5>parking the car there. So just a simple example, but

0:06:53.080 --> 0:06:56.400
<v Speaker 5>I think the ability that these tools have to take

0:06:56.480 --> 0:06:59.320
<v Speaker 5>friction out of our daily lives, you know, and to

0:06:59.400 --> 0:07:02.400
<v Speaker 5>be able to make just things that we do in

0:07:02.440 --> 0:07:06.040
<v Speaker 5>our everyday life simple and more frictionless. You know. That's

0:07:06.080 --> 0:07:09.080
<v Speaker 5>how I look at how mat the consumer is going

0:07:09.120 --> 0:07:11.120
<v Speaker 5>to benefit from some of this type of technology.

0:07:11.840 --> 0:07:15.400
<v Speaker 4>And from my perspective, it's also a travel story. I

0:07:15.440 --> 0:07:18.480
<v Speaker 4>spend a lot of time on the road for work,

0:07:18.840 --> 0:07:22.840
<v Speaker 4>but recently had to send my sister and her family

0:07:23.000 --> 0:07:25.960
<v Speaker 4>to a destination they had never been to for a wedding.

0:07:26.640 --> 0:07:30.240
<v Speaker 4>And it was really quick and easy to use some

0:07:30.600 --> 0:07:33.520
<v Speaker 4>generitive tools to come up with a whole plan for

0:07:33.560 --> 0:07:35.800
<v Speaker 4>them because they love to hike and to be outdoors

0:07:36.160 --> 0:07:39.920
<v Speaker 4>and to hike in areas that aren't overly crowded with people,

0:07:40.520 --> 0:07:43.840
<v Speaker 4>and so Jenai very quickly gave me an itinerary of

0:07:43.880 --> 0:07:47.280
<v Speaker 4>a bunch of terrific hikes for them for a destination.

0:07:47.680 --> 0:07:48.720
<v Speaker 4>So things like that.

0:07:48.920 --> 0:07:53.440
<v Speaker 3>Great, And then what about the effect of AI and

0:07:53.480 --> 0:07:57.600
<v Speaker 3>of automation more generally on employees on the workforce.

0:07:58.280 --> 0:08:01.360
<v Speaker 4>Well, there's so many dimensions to take that from. Generative

0:08:01.400 --> 0:08:05.119
<v Speaker 4>AI really can up level a workforce in all sorts

0:08:05.120 --> 0:08:09.400
<v Speaker 4>of ways by providing these consistent ways to engage with technology,

0:08:09.480 --> 0:08:13.080
<v Speaker 4>with these natural language experiences. So I think it changes

0:08:13.120 --> 0:08:17.200
<v Speaker 4>everything from it finds us content, it generates us content,

0:08:17.480 --> 0:08:20.200
<v Speaker 4>It makes it easier to work with our systems of

0:08:20.240 --> 0:08:25.520
<v Speaker 4>engagement and operation, and for many organizations it can be

0:08:25.960 --> 0:08:29.120
<v Speaker 4>a lifting factor in terms of bringing a more consistent

0:08:29.400 --> 0:08:33.600
<v Speaker 4>workforce experience because these tools can just be ever present

0:08:33.840 --> 0:08:35.800
<v Speaker 4>in our systems of work.

0:08:36.679 --> 0:08:38.760
<v Speaker 5>I mean, I'll give you a little example here in IBM,

0:08:38.880 --> 0:08:42.240
<v Speaker 5>we have something called our Skajar and so that's our

0:08:42.320 --> 0:08:47.320
<v Speaker 5>conversational AI interface that we use to interact with HR

0:08:47.520 --> 0:08:52.200
<v Speaker 5>services and ninety four percent of every employee interaction now

0:08:52.640 --> 0:08:56.040
<v Speaker 5>happens without human intervention through that interface.

0:08:56.360 --> 0:08:57.320
<v Speaker 6>But you would never know that.

0:08:58.280 --> 0:09:01.560
<v Speaker 5>And so if I think about, you know, our HR processes,

0:09:01.760 --> 0:09:05.480
<v Speaker 5>You know, we have this amazing conversational based AI that

0:09:05.520 --> 0:09:08.520
<v Speaker 5>we use for all of our HR interactions, and we

0:09:08.640 --> 0:09:12.199
<v Speaker 5>surface that through SLACK and so Slack becomes the front

0:09:12.240 --> 0:09:15.200
<v Speaker 5>door for how we access a lot of these different

0:09:15.320 --> 0:09:19.600
<v Speaker 5>enterprise processes and capabilities and how we surface AI. In fact,

0:09:19.600 --> 0:09:21.640
<v Speaker 5>I'm taking a flight shortly back to the UK and

0:09:22.120 --> 0:09:24.600
<v Speaker 5>our our skar Bos is reminding me that it's raining

0:09:24.600 --> 0:09:26.640
<v Speaker 5>in the UK and I should take an umbrella.

0:09:27.440 --> 0:09:29.880
<v Speaker 4>Isn't it always like raining in England?

0:09:32.240 --> 0:09:34.320
<v Speaker 5>Yeah, I don't think there's any AI needed for that.

0:09:34.360 --> 0:09:37.720
<v Speaker 5>I think that's just a hard coded If England, then

0:09:37.760 --> 0:09:38.480
<v Speaker 5>take umbrella.

0:09:38.520 --> 0:09:39.640
<v Speaker 4>That's right, that's just a rule.

0:09:39.800 --> 0:09:40.280
<v Speaker 2>That's just a.

0:09:40.320 --> 0:09:43.600
<v Speaker 5>Rule, right, and you're able to converse and yeah, I

0:09:43.640 --> 0:09:46.640
<v Speaker 5>need to book holiday, I need to move somebody between managers.

0:09:46.840 --> 0:09:49.640
<v Speaker 5>I need to figure out the policy on this. And

0:09:49.720 --> 0:09:53.400
<v Speaker 5>the AI basically navigates across the different systems to be

0:09:53.440 --> 0:09:56.440
<v Speaker 5>able to help get that information, to summarize it back,

0:09:56.920 --> 0:09:59.040
<v Speaker 5>to be able to carry out the transactions that I

0:09:59.080 --> 0:10:01.760
<v Speaker 5>need carried out, and it just just removes all of

0:10:01.760 --> 0:10:05.800
<v Speaker 5>that complexity and makes it easier to get things done.

0:10:06.520 --> 0:10:13.640
<v Speaker 3>When you are working with companies to implement generative AI. Now,

0:10:14.360 --> 0:10:17.720
<v Speaker 3>what do you find tends to be their primary focus?

0:10:18.400 --> 0:10:20.680
<v Speaker 4>I mean I speak with a lot of customers each week,

0:10:20.760 --> 0:10:25.000
<v Speaker 4>and for the last several months, most organizations have just

0:10:25.080 --> 0:10:29.280
<v Speaker 4>been reorienting themselves in terms of where are we in

0:10:29.280 --> 0:10:32.880
<v Speaker 4>this moment, what is this technology capable of? What are

0:10:32.920 --> 0:10:36.520
<v Speaker 4>the risks and governance and frameworks that I need to

0:10:36.880 --> 0:10:41.040
<v Speaker 4>establish in order to engage and talk to everyone. Talk

0:10:41.040 --> 0:10:44.040
<v Speaker 4>to my vendors, talk to my cloud providers, talk to

0:10:44.120 --> 0:10:48.960
<v Speaker 4>my consultants, talk to academics, and generally get your sea

0:10:49.000 --> 0:10:53.440
<v Speaker 4>legs under them. And the sort of the unstructured hand

0:10:53.480 --> 0:10:57.680
<v Speaker 4>on keyboards fiddling with technology seems to be moving towards

0:10:57.880 --> 0:11:00.760
<v Speaker 4>let's get some points on the board, turn this stuff

0:11:00.800 --> 0:11:03.320
<v Speaker 4>on and go. So that's what I've been seeing in

0:11:03.400 --> 0:11:07.440
<v Speaker 4>terms of, you know, the work within the salesforce ecosystem. Matt,

0:11:07.480 --> 0:11:11.199
<v Speaker 4>you've got a larger aperture as well. What are you seeing?

0:11:11.800 --> 0:11:14.400
<v Speaker 6>Yeah, so I definitely agree.

0:11:14.440 --> 0:11:17.959
<v Speaker 5>I think, you know, there's been lots of getting sea

0:11:18.040 --> 0:11:21.520
<v Speaker 5>legs experimentation, just trying to build knowledge, being able to

0:11:21.559 --> 0:11:27.040
<v Speaker 5>try and build almost you know, internal organizational point of

0:11:27.080 --> 0:11:29.959
<v Speaker 5>view and reference framework. I've seen lots of what I

0:11:30.000 --> 0:11:32.040
<v Speaker 5>would have referred to as random acts of AI.

0:11:34.000 --> 0:11:36.359
<v Speaker 6>In terms of in terms of experimentation.

0:11:36.440 --> 0:11:38.559
<v Speaker 5>But I think I think people now looking into twenty

0:11:38.600 --> 0:11:41.680
<v Speaker 5>twenty four and this is all about now adoption and scaling.

0:11:42.280 --> 0:11:46.160
<v Speaker 5>What's become really clear is organizations have started to realize

0:11:46.200 --> 0:11:48.280
<v Speaker 5>this is going to be a very multi model world

0:11:48.400 --> 0:11:49.880
<v Speaker 5>that they're going to live in. There is no one

0:11:49.920 --> 0:11:53.719
<v Speaker 5>AI that is the answer for their organization, and so

0:11:53.960 --> 0:11:57.360
<v Speaker 5>they're going to have lots of different generative AI models

0:11:58.040 --> 0:12:00.640
<v Speaker 5>and technologies that they're going to sit in the organization

0:12:00.920 --> 0:12:05.880
<v Speaker 5>servicing different use cases, different domain areas, different products and services,

0:12:07.160 --> 0:12:10.040
<v Speaker 5>and so therefore having to figure out how they're going

0:12:10.080 --> 0:12:13.160
<v Speaker 5>to navigate and manage this kind of open world that

0:12:13.160 --> 0:12:15.439
<v Speaker 5>they're going to be sitting in and the decisions that

0:12:15.480 --> 0:12:17.920
<v Speaker 5>they're going to have to make around that. I think

0:12:17.960 --> 0:12:21.160
<v Speaker 5>the second thing that I've seen that people are now

0:12:21.200 --> 0:12:23.640
<v Speaker 5>becoming very clear that this needs to be what I

0:12:23.679 --> 0:12:26.400
<v Speaker 5>would refer to as use case lead and outcome focused,

0:12:27.679 --> 0:12:31.080
<v Speaker 5>and so really needing to start with thinking about the

0:12:31.120 --> 0:12:34.120
<v Speaker 5>business outcome and the problem that you know we're trying

0:12:34.200 --> 0:12:38.199
<v Speaker 5>to solve, and therefore, how do I use generative AI

0:12:38.880 --> 0:12:42.280
<v Speaker 5>as part of the mechanism to solve that problem? And

0:12:42.320 --> 0:12:44.960
<v Speaker 5>I think you know what Susan and the Salesforce team

0:12:45.000 --> 0:12:46.840
<v Speaker 5>do is an amazing example of that. You know, they've

0:12:46.840 --> 0:12:51.240
<v Speaker 5>got this incredible platform and engine that allows companies to

0:12:51.280 --> 0:12:54.319
<v Speaker 5>transform their sales and service processes and to be able

0:12:54.320 --> 0:12:56.360
<v Speaker 5>to put data in the hands of users, to be

0:12:56.400 --> 0:12:59.440
<v Speaker 5>able to make better decisions, et cetera. And so now

0:12:59.480 --> 0:13:02.320
<v Speaker 5>by weaving generative AI into that platform, we're going to

0:13:02.320 --> 0:13:05.319
<v Speaker 5>be able to make those processes workflows even more efficient. Right,

0:13:05.360 --> 0:13:08.319
<v Speaker 5>So it's generative AI plus all of these other amazing

0:13:08.360 --> 0:13:10.160
<v Speaker 5>things that are there, but it will be led through

0:13:10.360 --> 0:13:13.679
<v Speaker 5>business outcome, and it will be led through use case

0:13:13.800 --> 0:13:16.760
<v Speaker 5>and the business problem or workflow that we're trying to improve.

0:13:17.520 --> 0:13:19.360
<v Speaker 5>And then I think the third thing is shifting from

0:13:19.360 --> 0:13:22.280
<v Speaker 5>this experimentation to scale. You know, I think everybody's really

0:13:22.320 --> 0:13:26.679
<v Speaker 5>early in this journey, but what's become clear is that

0:13:26.800 --> 0:13:30.840
<v Speaker 5>you know, everybody now need realizes and is starting to

0:13:30.920 --> 0:13:35.360
<v Speaker 5>lay down these these ground rules, the guardrails, the frameworks

0:13:35.400 --> 0:13:39.760
<v Speaker 5>to allow them to scale this across the organization. So,

0:13:40.600 --> 0:13:43.080
<v Speaker 5>you know, I think we're in for an exciting, exciting

0:13:43.120 --> 0:13:44.400
<v Speaker 5>time in twenty twenty four.

0:13:45.160 --> 0:13:47.880
<v Speaker 3>So now that we're getting to this moment, what are

0:13:47.880 --> 0:13:51.199
<v Speaker 3>the key things companies have to figure out about scaling

0:13:51.280 --> 0:13:51.920
<v Speaker 3>generative AI?

0:13:54.360 --> 0:13:57.600
<v Speaker 4>I would put that in kind of two categories and

0:13:57.679 --> 0:14:01.320
<v Speaker 4>following on what Matt was saying in terms of use,

0:14:01.360 --> 0:14:04.800
<v Speaker 4>case defined and outcome lead one hundred percent on that

0:14:04.880 --> 0:14:07.600
<v Speaker 4>in terms of starting with a hypothesis of value, while

0:14:07.600 --> 0:14:11.480
<v Speaker 4>at the same time people are getting closer to the

0:14:11.520 --> 0:14:14.280
<v Speaker 4>technology to know what their bounds are. But the biggest

0:14:14.360 --> 0:14:18.480
<v Speaker 4>you know, set of conversations is in the enterprise area

0:14:19.520 --> 0:14:22.800
<v Speaker 4>in terms of embarking and using with generative AI, how

0:14:22.800 --> 0:14:26.560
<v Speaker 4>to do it in ways that is safe for use

0:14:26.600 --> 0:14:30.560
<v Speaker 4>of data that is safe around not just the larger

0:14:30.640 --> 0:14:35.440
<v Speaker 4>topic of generative AI and hallucinations, which which are fun

0:14:35.480 --> 0:14:36.640
<v Speaker 4>to talk about in the media.

0:14:36.800 --> 0:14:39.560
<v Speaker 3>But it's a fun word, right. If it was called

0:14:39.600 --> 0:14:42.720
<v Speaker 3>something other than hallucinations, people wouldn't talk about it as much.

0:14:42.840 --> 0:14:46.360
<v Speaker 4>It was just mistakes, Yeah, that's right, just things that

0:14:46.400 --> 0:14:48.880
<v Speaker 4>aren't factually true. We've been doing a lot of work

0:14:48.880 --> 0:14:53.280
<v Speaker 4>at Salesforce around using you know, dynamic and structured grounding

0:14:53.320 --> 0:14:56.360
<v Speaker 4>the data so we can give very strong and non

0:14:56.480 --> 0:15:00.440
<v Speaker 4>naive prompt instructions to lllms to get return on that. So,

0:15:00.920 --> 0:15:04.680
<v Speaker 4>just to summarize, top of mind for organizations using you know,

0:15:04.960 --> 0:15:08.160
<v Speaker 4>large language models is using their data in ways that

0:15:08.240 --> 0:15:13.520
<v Speaker 4>are safe, trusted, not exposed, and reducing the opportunity for

0:15:13.560 --> 0:15:16.640
<v Speaker 4>hallucinations and maximizing relevant content.

0:15:17.200 --> 0:15:17.480
<v Speaker 5>Great.

0:15:17.520 --> 0:15:19.800
<v Speaker 3>So, so Matt Susan was talking about, you know, both

0:15:19.840 --> 0:15:23.760
<v Speaker 3>what organizations are concerned with as they scale generative AI

0:15:23.960 --> 0:15:27.680
<v Speaker 3>and how Salesforce is working to sort of address those concerns.

0:15:28.240 --> 0:15:31.200
<v Speaker 3>What are you seeing at IBM.

0:15:30.720 --> 0:15:34.360
<v Speaker 5>Here, So I think certainly from a scaling of generative

0:15:34.360 --> 0:15:39.560
<v Speaker 5>AI perspective, you know this topic of governance, you know,

0:15:39.600 --> 0:15:41.600
<v Speaker 5>and how organizations are going to have to govern all

0:15:41.600 --> 0:15:45.400
<v Speaker 5>of these models that sit withinside, how they manage kind

0:15:45.400 --> 0:15:49.760
<v Speaker 5>of bias fairness, model drift, you know, if you think

0:15:49.760 --> 0:15:53.080
<v Speaker 5>about the data that's gone into a model and the

0:15:53.120 --> 0:15:56.480
<v Speaker 5>output it gives to start with, not because the model changes,

0:15:56.480 --> 0:15:58.760
<v Speaker 5>but because the context of the world moves on. And

0:15:58.800 --> 0:16:01.080
<v Speaker 5>so being able to kind of manage this model drift

0:16:01.160 --> 0:16:03.160
<v Speaker 5>is going to be a really important thing. I think

0:16:03.240 --> 0:16:08.760
<v Speaker 5>data really matters, and so quality access security around data

0:16:08.800 --> 0:16:11.040
<v Speaker 5>within the enterprise is going to be critical to scaling

0:16:11.080 --> 0:16:13.560
<v Speaker 5>generative AI. And the other one I think that's going

0:16:13.560 --> 0:16:16.120
<v Speaker 5>to be really important, and I think many organizations haven't

0:16:16.120 --> 0:16:18.080
<v Speaker 5>even got there yet in their thinking is around the

0:16:18.320 --> 0:16:22.120
<v Speaker 5>ESG implications. So carbon you know, the use of this

0:16:22.200 --> 0:16:25.560
<v Speaker 5>technology does not come without a cost of carbon.

0:16:25.880 --> 0:16:28.640
<v Speaker 3>Carbon meaning it's very energy intensive.

0:16:28.520 --> 0:16:32.120
<v Speaker 5>Correct, Yeah, the training of the models and so thinking

0:16:32.120 --> 0:16:36.200
<v Speaker 5>about carbon disclosures and thinking about where I'm infusing it

0:16:36.240 --> 0:16:38.560
<v Speaker 5>into my business and how much I'm using it and

0:16:38.600 --> 0:16:41.560
<v Speaker 5>what the carbon cost of that is. As I think

0:16:41.600 --> 0:16:46.960
<v Speaker 5>about the you know, you know, my own organizational responsibilities

0:16:46.960 --> 0:16:49.000
<v Speaker 5>to reduce carbon I think, you know, there's all of

0:16:49.040 --> 0:16:51.240
<v Speaker 5>these things that I think are going to become important

0:16:51.280 --> 0:16:54.320
<v Speaker 5>factors as people are thinking about the scaling implications of

0:16:54.360 --> 0:16:55.160
<v Speaker 5>this technology.

0:16:56.080 --> 0:16:59.560
<v Speaker 2>AI is already making new experiences possible, but we must

0:16:59.600 --> 0:17:02.600
<v Speaker 2>be in mind in how we integrate this new technology

0:17:02.760 --> 0:17:07.119
<v Speaker 2>as we continue scaling generative AI. Matt touched on some

0:17:07.200 --> 0:17:11.520
<v Speaker 2>crucial aspects from an IBM perspective. Governance, bias, fairness, and

0:17:11.520 --> 0:17:16.040
<v Speaker 2>security are all key considerations when organizations aim to expand

0:17:16.080 --> 0:17:21.400
<v Speaker 2>their use of generative AI. The environmental aspect is especially important,

0:17:21.960 --> 0:17:25.040
<v Speaker 2>and it's refreshing to hear leading thinkers like Matt and

0:17:25.119 --> 0:17:30.240
<v Speaker 2>Susan highlight these issues. As this technology continues to evolve,

0:17:30.720 --> 0:17:35.640
<v Speaker 2>these factors are becoming increasingly important for organizations to address.

0:17:36.520 --> 0:17:40.679
<v Speaker 2>The Historic collaboration between IBM and Salesforce is helping to

0:17:40.800 --> 0:17:44.159
<v Speaker 2>remedy issues companies face when scaling AI.

0:17:45.320 --> 0:17:50.240
<v Speaker 3>So IBM and Salesforce recently announced a new collaborative project

0:17:50.400 --> 0:17:53.280
<v Speaker 3>around generative AI. Tell me more about that.

0:17:54.520 --> 0:17:59.240
<v Speaker 5>We've been partners for over two decades now IBM and Salesforce,

0:17:59.280 --> 0:18:02.359
<v Speaker 5>and so within our consulting business, you know, we work

0:18:02.400 --> 0:18:05.919
<v Speaker 5>with Salesforce technology to help our clients implement that technology

0:18:05.960 --> 0:18:09.640
<v Speaker 5>to transform their businesses. We've got a huge practice, over

0:18:09.800 --> 0:18:14.000
<v Speaker 5>twelve thousand people with certifications around Salesforce platforms, and so

0:18:14.760 --> 0:18:16.760
<v Speaker 5>you know, as Susan and her team and the broader

0:18:16.760 --> 0:18:20.120
<v Speaker 5>team in Salesforce are infusing more capability into the platform

0:18:20.160 --> 0:18:23.480
<v Speaker 5>around generative AI, then our mission is really simple. It's

0:18:23.560 --> 0:18:27.680
<v Speaker 5>to help clients who are using the Salesforce platform adopt

0:18:27.720 --> 0:18:29.200
<v Speaker 5>those capabilities to help.

0:18:29.040 --> 0:18:31.240
<v Speaker 6>Them get more benefit within their organization.

0:18:31.800 --> 0:18:34.960
<v Speaker 5>You know, we're also a significant user of Salesforce technology

0:18:35.000 --> 0:18:38.520
<v Speaker 5>within IBM. We're one of Salesforce's largest customers globally, and

0:18:38.600 --> 0:18:41.400
<v Speaker 5>so you know, as we continue to transform our own

0:18:41.480 --> 0:18:45.560
<v Speaker 5>sales and service processes within IBM, then you know, our

0:18:45.680 --> 0:18:48.760
<v Speaker 5>use of the generative AI capabilities that they're infusing into

0:18:48.800 --> 0:18:52.399
<v Speaker 5>sales cloud, service, cloud slack, et cetera will be something

0:18:52.400 --> 0:18:56.000
<v Speaker 5>that will become really important to us driving productivity within

0:18:56.080 --> 0:18:58.160
<v Speaker 5>the company. And then the other thing that I would

0:18:58.160 --> 0:19:00.160
<v Speaker 5>say is, you know, as I think about the work

0:19:00.160 --> 0:19:03.119
<v Speaker 5>that we do with clients, you know, as they're implementing

0:19:03.119 --> 0:19:05.639
<v Speaker 5>and on their generative AI journeys, you know, they're going

0:19:05.680 --> 0:19:09.600
<v Speaker 5>to utilize and leverage the salesforce capabilities within the platform

0:19:09.640 --> 0:19:13.240
<v Speaker 5>and their generative AI technologies. But then you start thinking

0:19:13.280 --> 0:19:16.840
<v Speaker 5>about processes and workflows that run beyond the walls of CRM,

0:19:16.920 --> 0:19:20.120
<v Speaker 5>right that run into supply chain and into the finance

0:19:20.200 --> 0:19:23.280
<v Speaker 5>area of the organization. And so there is work that

0:19:23.320 --> 0:19:26.080
<v Speaker 5>we're doing with clients where we're using ibms. What's the

0:19:26.160 --> 0:19:30.120
<v Speaker 5>next platform to be able to help get access to

0:19:30.119 --> 0:19:33.440
<v Speaker 5>to generate insights from data sources that sit in all

0:19:33.480 --> 0:19:35.680
<v Speaker 5>of these kind of back office areas of the enterprise,

0:19:36.240 --> 0:19:38.399
<v Speaker 5>and to be able to get that data across the

0:19:38.480 --> 0:19:43.040
<v Speaker 5>salesforce into these customer interaction points and into the employees

0:19:43.080 --> 0:19:47.280
<v Speaker 5>who are servicing those customers using salesforces AI and generative

0:19:47.280 --> 0:19:48.199
<v Speaker 5>AI technologies.

0:19:48.200 --> 0:19:49.160
<v Speaker 6>So there's a.

0:19:49.160 --> 0:19:52.080
<v Speaker 5>Kind of one plus one equals three kind of you know,

0:19:52.240 --> 0:19:55.399
<v Speaker 5>better together, you know, and being able to bring our

0:19:55.440 --> 0:19:59.520
<v Speaker 5>technologies together in service of these clients. Problems as you

0:19:59.560 --> 0:20:03.680
<v Speaker 5>think about these processes that run across their enterprise. So, yeah,

0:20:03.840 --> 0:20:06.560
<v Speaker 5>it's so huge hutunity and what we're doing together in

0:20:06.560 --> 0:20:08.000
<v Speaker 5>the market to help clients.

0:20:08.600 --> 0:20:10.879
<v Speaker 4>Yeah, and just building it on that. It is a

0:20:10.960 --> 0:20:15.840
<v Speaker 4>huge moment for organizations and for technology companies like Salesforce,

0:20:15.840 --> 0:20:18.639
<v Speaker 4>and we couldn't be happier to have partnerships like we

0:20:18.720 --> 0:20:23.439
<v Speaker 4>have with IBM. Like the range of thought leadership that

0:20:24.280 --> 0:20:27.679
<v Speaker 4>is appropriate at the moment is everything from what is

0:20:27.680 --> 0:20:30.720
<v Speaker 4>that hypothesis of value and what are those use cases?

0:20:30.760 --> 0:20:33.240
<v Speaker 4>And what is the order of operation in terms of

0:20:33.280 --> 0:20:37.120
<v Speaker 4>approaching it just in terms of focus, but then things

0:20:37.200 --> 0:20:41.480
<v Speaker 4>that would help organizations assess their AI readiness and then

0:20:41.520 --> 0:20:44.719
<v Speaker 4>their approach like you know, we talked earlier about frameworks

0:20:44.760 --> 0:20:48.040
<v Speaker 4>and guardrails. You know, what are use cases that we're

0:20:48.080 --> 0:20:50.920
<v Speaker 4>comfortable with given the state of the technology that face

0:20:50.960 --> 0:20:55.160
<v Speaker 4>employees or face customers. So creating these much larger roadmaps

0:20:55.200 --> 0:20:58.000
<v Speaker 4>in terms of how to approach this over a series

0:20:58.080 --> 0:21:03.400
<v Speaker 4>of initiatives, it can fundamentally change the way we engage

0:21:03.400 --> 0:21:07.800
<v Speaker 4>with technology and what that means for the you know,

0:21:07.880 --> 0:21:13.000
<v Speaker 4>training and change management and use cases that fundamentally shift

0:21:13.160 --> 0:21:17.080
<v Speaker 4>how you engage with systems like salesforces. There's just a

0:21:17.080 --> 0:21:19.040
<v Speaker 4>massive opportunity for us together.

0:21:19.840 --> 0:21:23.680
<v Speaker 3>So you're talking in sort of general terms, I'm interested in,

0:21:23.840 --> 0:21:28.240
<v Speaker 3>you know, thinking in particular about the way generitive AI

0:21:28.359 --> 0:21:32.280
<v Speaker 3>can essentially lead to better business outcomes, right Like, what

0:21:32.320 --> 0:21:34.840
<v Speaker 3>does that look like? How do you measure it? You know,

0:21:34.960 --> 0:21:37.480
<v Speaker 3>there's a certain bottom line question there, right like, how

0:21:37.480 --> 0:21:40.000
<v Speaker 3>does AI make businesses work better? And in what ways?

0:21:40.640 --> 0:21:44.920
<v Speaker 4>You know, as consumers of products and services, we all

0:21:44.960 --> 0:21:47.560
<v Speaker 4>love and respect great service, you know, in terms of

0:21:47.560 --> 0:21:50.920
<v Speaker 4>getting timely, quick answers, resolving issues quickly, all those those

0:21:50.960 --> 0:21:55.920
<v Speaker 4>types of things. And from the perspective of using generative

0:21:55.960 --> 0:22:00.160
<v Speaker 4>and predictive capabilities for agents who are interacting with customers,

0:22:00.520 --> 0:22:03.760
<v Speaker 4>there is just a whole ton of opportunity to take

0:22:03.760 --> 0:22:06.280
<v Speaker 4>friction out of the process in terms of finding answers,

0:22:06.320 --> 0:22:10.000
<v Speaker 4>resolving issues, in terms of using these generative capabilities that

0:22:10.080 --> 0:22:13.200
<v Speaker 4>will bring you know, answers and content to the fingertips

0:22:13.240 --> 0:22:18.480
<v Speaker 4>more easily to the human agents that are working with customers. Now,

0:22:18.600 --> 0:22:22.200
<v Speaker 4>taking that to the next step for organizations when they're

0:22:22.240 --> 0:22:26.040
<v Speaker 4>ready to move into more customer facing automation, that's yet

0:22:26.080 --> 0:22:28.919
<v Speaker 4>another channel. As a consumer, we'll all enjoy with the

0:22:28.920 --> 0:22:31.120
<v Speaker 4>brands and the products and the services that we want

0:22:31.160 --> 0:22:34.679
<v Speaker 4>in terms of fast answers and resolutions to customers. And

0:22:34.720 --> 0:22:39.480
<v Speaker 4>as we all know, great customer experience yields return business.

0:22:40.000 --> 0:22:43.240
<v Speaker 4>Now on the sales side, you know, maybe a different example,

0:22:43.800 --> 0:22:46.760
<v Speaker 4>and these are areas where I think the capability of

0:22:46.920 --> 0:22:50.439
<v Speaker 4>predictive and generative go very well together in terms of

0:22:50.480 --> 0:22:54.280
<v Speaker 4>focusing on business outcomes. And a classic example would be,

0:22:54.800 --> 0:22:59.159
<v Speaker 4>you know, predictions that help us understand customer health. You know,

0:22:59.280 --> 0:23:03.200
<v Speaker 4>is this customer engaged, is this customer at risk? Predictions

0:23:03.240 --> 0:23:07.359
<v Speaker 4>that help us understand next best product or next best conversation.

0:23:07.880 --> 0:23:13.520
<v Speaker 4>These all help focus sales team's time on a customer

0:23:13.600 --> 0:23:17.200
<v Speaker 4>or a territory, and so that deep focus puts all

0:23:17.200 --> 0:23:19.520
<v Speaker 4>the wood behind an arrow, so to speak, in terms

0:23:19.560 --> 0:23:24.000
<v Speaker 4>of where we should be engaging. And those types of

0:23:24.520 --> 0:23:29.199
<v Speaker 4>driven sales organizations that have these capabilities just lead to

0:23:29.240 --> 0:23:34.080
<v Speaker 4>better performance and outcomes and customer experience too. Now, let's

0:23:34.119 --> 0:23:38.600
<v Speaker 4>also layer in generitive capabilities where we're using the generative

0:23:38.640 --> 0:23:42.680
<v Speaker 4>capabilities to assist and augment a sales team, where we're

0:23:42.720 --> 0:23:46.800
<v Speaker 4>using the power de generitive for everything like generating personalized

0:23:46.880 --> 0:23:51.720
<v Speaker 4>and relevant customer interaction content, for example, leveraging our customer

0:23:51.800 --> 0:23:56.720
<v Speaker 4>data like engagement history, product purchases, service history to create

0:23:56.760 --> 0:23:59.760
<v Speaker 4>an email or a campaign. And this scale a lout

0:23:59.760 --> 0:24:03.119
<v Speaker 4>of has just never been possible before. And you know,

0:24:03.160 --> 0:24:05.640
<v Speaker 4>maybe even taking this one step further re genitive, where

0:24:05.720 --> 0:24:08.200
<v Speaker 4>we take all the administrative friction out of the day

0:24:08.280 --> 0:24:11.640
<v Speaker 4>job and doing things for sales teams like summarizing their

0:24:11.680 --> 0:24:15.040
<v Speaker 4>calls or creating a meeting plan for them, and you know,

0:24:15.200 --> 0:24:18.880
<v Speaker 4>very broadly speaking, using generative AI to change the interaction

0:24:19.000 --> 0:24:23.760
<v Speaker 4>mode with systems like Salesforce from clicks and training where

0:24:23.800 --> 0:24:26.840
<v Speaker 4>people have to focus on the process to more conversational

0:24:27.000 --> 0:24:31.560
<v Speaker 4>user experiences which are much more engaging and easier to use.

0:24:32.040 --> 0:24:35.960
<v Speaker 4>So all of this together is just incredible and transformational

0:24:36.359 --> 0:24:39.399
<v Speaker 4>and makes all businesses and people work better.

0:24:40.000 --> 0:24:42.480
<v Speaker 3>So I just want to spend one more moment on

0:24:42.560 --> 0:24:48.000
<v Speaker 3>the partnership between IBM and Salesforce and genitive AI. And

0:24:48.040 --> 0:24:52.200
<v Speaker 3>there's this phrase that's interesting to me. It's ecosystem partnership

0:24:52.480 --> 0:24:55.280
<v Speaker 3>that I think is relevant here. So what is an

0:24:55.320 --> 0:24:58.399
<v Speaker 3>ecosystem partnership and why is it you know, helpful in

0:25:00.280 --> 0:25:02.000
<v Speaker 3>scalable AI solutions.

0:25:02.880 --> 0:25:06.959
<v Speaker 5>This idea of being open I think is probably one

0:25:07.000 --> 0:25:11.200
<v Speaker 5>of the most important premises for US as technology companies,

0:25:11.320 --> 0:25:15.000
<v Speaker 5>for US as consultancies and system integrators, and for our

0:25:15.040 --> 0:25:18.840
<v Speaker 5>clients to think about that the sources of value that

0:25:18.920 --> 0:25:22.920
<v Speaker 5>can be created through taking an open approach is hugely important.

0:25:23.000 --> 0:25:26.840
<v Speaker 5>So if I think about for US, ecosystem means making

0:25:26.880 --> 0:25:31.240
<v Speaker 5>sure that we have all of the different partnerships that

0:25:31.280 --> 0:25:35.639
<v Speaker 5>we need with technology providers, with service providers that we

0:25:35.760 --> 0:25:41.080
<v Speaker 5>can bring to our clients the right set of capabilities

0:25:41.119 --> 0:25:43.400
<v Speaker 5>to solve the problem that they've got and not thinking

0:25:43.560 --> 0:25:46.960
<v Speaker 5>that just you know, what we have in house, or

0:25:46.960 --> 0:25:49.040
<v Speaker 5>what we have with just one other partner that we

0:25:49.119 --> 0:25:51.359
<v Speaker 5>work with, you know, is the right thing. And so

0:25:51.600 --> 0:25:54.280
<v Speaker 5>you know, I think every problem that our clients have

0:25:54.480 --> 0:25:58.000
<v Speaker 5>is solved through a range of technologies that come together

0:25:58.640 --> 0:26:01.320
<v Speaker 5>in service of creating that business outcome.

0:26:01.800 --> 0:26:07.159
<v Speaker 3>I want to touch briefly on ethics and governance. Something

0:26:07.280 --> 0:26:12.240
<v Speaker 3>like eighty percent of CEOs see explainability, ethics, bias, trust

0:26:12.480 --> 0:26:16.879
<v Speaker 3>as major concerns on the road to AI adoption, and

0:26:16.920 --> 0:26:21.840
<v Speaker 3>so I'm curious how business leaders navigate these things, and

0:26:21.880 --> 0:26:26.440
<v Speaker 3>in particular, how Salesforce and IBM are building these concerns

0:26:26.480 --> 0:26:29.000
<v Speaker 3>into how they work with customers.

0:26:29.520 --> 0:26:34.520
<v Speaker 4>You know, we've been incorporating predictive machine learning into our

0:26:34.600 --> 0:26:38.280
<v Speaker 4>products since mid last decade, and at that time we

0:26:38.400 --> 0:26:42.240
<v Speaker 4>started with all of our ethics and governance work at

0:26:42.280 --> 0:26:45.520
<v Speaker 4>that time in terms of frameworks for engaging with AI

0:26:46.000 --> 0:26:49.399
<v Speaker 4>in ethical and safe ways and have a lot of

0:26:49.400 --> 0:26:52.920
<v Speaker 4>guidance for customers in terms of those programs. The machine

0:26:52.960 --> 0:26:56.280
<v Speaker 4>learning focus that we've had at Salesforce has always been

0:26:56.400 --> 0:27:00.679
<v Speaker 4>deeply focused on explainability. So if we're making you know,

0:27:00.760 --> 0:27:05.199
<v Speaker 4>predictive recommendations to explain how we got to that, you know,

0:27:05.240 --> 0:27:08.680
<v Speaker 4>whether that's something that a user sees, is they're engaging

0:27:08.680 --> 0:27:11.280
<v Speaker 4>with it so they have full trust in terms of

0:27:11.400 --> 0:27:15.120
<v Speaker 4>interacting with it, but also for the practitioners who are

0:27:15.119 --> 0:27:18.560
<v Speaker 4>building it. So we have this like long standing vibe

0:27:18.560 --> 0:27:22.600
<v Speaker 4>and capability with our predictive side of the house and

0:27:22.720 --> 0:27:24.960
<v Speaker 4>on the generative side of the house. You know, the

0:27:25.000 --> 0:27:28.520
<v Speaker 4>state of the marketplace right now is llms for most

0:27:28.520 --> 0:27:32.960
<v Speaker 4>people are are largely black boxes in terms of not

0:27:33.119 --> 0:27:35.399
<v Speaker 4>fully interpretable in terms of how they come up with

0:27:35.440 --> 0:27:38.600
<v Speaker 4>their content. Now that said, there is a lot that

0:27:38.680 --> 0:27:42.600
<v Speaker 4>you can do in terms of audit, in terms of

0:27:42.760 --> 0:27:46.280
<v Speaker 4>you know, transparency in terms of what are the prompts

0:27:46.320 --> 0:27:49.920
<v Speaker 4>that are being submitted to these llms, what do these

0:27:50.040 --> 0:27:53.840
<v Speaker 4>llms provide back in terms of return? And then what

0:27:53.880 --> 0:27:55.960
<v Speaker 4>did the human do to change it, use it, or

0:27:56.280 --> 0:27:59.160
<v Speaker 4>adjust it. So we've been updating all of our ethics

0:27:59.240 --> 0:28:02.280
<v Speaker 4>and government it's frameworks now, I guess I would call

0:28:02.320 --> 0:28:05.040
<v Speaker 4>it with safety components as well in terms of how

0:28:05.040 --> 0:28:08.680
<v Speaker 4>to work with data in safe ways and with these

0:28:08.720 --> 0:28:10.880
<v Speaker 4>trened parents governance models. Yeah.

0:28:10.960 --> 0:28:12.959
<v Speaker 5>So, I mean this is an area that IBM has

0:28:13.000 --> 0:28:15.359
<v Speaker 5>been kind of working on for many years. And so

0:28:15.680 --> 0:28:18.480
<v Speaker 5>you know, our AI Ethics Board that we have internally

0:28:19.200 --> 0:28:23.000
<v Speaker 5>kind of governs and provides frameworks and guidance for everything

0:28:23.000 --> 0:28:25.159
<v Speaker 5>that we do in the company. There's a lot of

0:28:25.160 --> 0:28:28.480
<v Speaker 5>work that we do to help our clients and organizations

0:28:28.600 --> 0:28:32.199
<v Speaker 5>establish their strategies for AI governance as well as their

0:28:32.240 --> 0:28:37.840
<v Speaker 5>own internal policies, models, approaches, ethics boards, et cetera. And so,

0:28:38.240 --> 0:28:41.280
<v Speaker 5>you know, helping them put in place these ground rules

0:28:41.320 --> 0:28:47.560
<v Speaker 5>and guardrails, organizational process changes, et cetera. I think is

0:28:47.600 --> 0:28:50.080
<v Speaker 5>a really important part of this scaling discussion that we

0:28:50.080 --> 0:28:52.400
<v Speaker 5>were having earlier, as people are going to be kind

0:28:52.400 --> 0:28:55.880
<v Speaker 5>of rolling out more of this technology internally, and then

0:28:55.920 --> 0:28:59.680
<v Speaker 5>I think there's a lot that organizations are going to

0:28:59.680 --> 0:29:02.080
<v Speaker 5>have to do to think about, especially in the generative world,

0:29:02.680 --> 0:29:05.320
<v Speaker 5>around all of the different types of models that they're using,

0:29:05.600 --> 0:29:09.120
<v Speaker 5>models that they're training and tuning and building, and how

0:29:09.160 --> 0:29:13.320
<v Speaker 5>they manage all of those for explainability and bias drift

0:29:13.400 --> 0:29:18.200
<v Speaker 5>and actually regulatory requirements, Like if you think about what's

0:29:18.280 --> 0:29:22.400
<v Speaker 5>happening around the world, there's different countries, the EUAI Act,

0:29:22.480 --> 0:29:25.400
<v Speaker 5>you know, there's lots of different regulatory requirements that are

0:29:25.400 --> 0:29:28.080
<v Speaker 5>going to be coming in and so for multinational companies

0:29:28.840 --> 0:29:33.480
<v Speaker 5>operating across multiple countries, how they're going to have to

0:29:33.560 --> 0:29:37.040
<v Speaker 5>make sure that they're complying with all of not only

0:29:37.080 --> 0:29:41.520
<v Speaker 5>their own internal policies, but the requirements of the country

0:29:42.240 --> 0:29:47.480
<v Speaker 5>as well as potentially industry regulatory requirements as well.

0:29:47.520 --> 0:29:48.680
<v Speaker 6>And so there's a lot.

0:29:48.520 --> 0:29:50.800
<v Speaker 5>That we are doing and going to be doing in

0:29:51.360 --> 0:29:55.240
<v Speaker 5>helping them manage complexity. But IBM has a very firm

0:29:55.320 --> 0:29:57.920
<v Speaker 5>view that we believe that this is all about regulating

0:29:57.960 --> 0:30:02.920
<v Speaker 5>AI risk, not ail rhythms, and so focusing on precision regulation,

0:30:03.280 --> 0:30:07.720
<v Speaker 5>so you know, use the bodies and regulatory bodies that

0:30:07.760 --> 0:30:11.880
<v Speaker 5>are out there to provide the control as opposed to

0:30:11.880 --> 0:30:13.360
<v Speaker 5>trying to regulate the technology.

0:30:14.160 --> 0:30:18.120
<v Speaker 3>So genitive AI is changing kind of absurdly quickly. Right,

0:30:18.160 --> 0:30:19.600
<v Speaker 3>a year and a half ago, we wouldn't have been

0:30:19.600 --> 0:30:23.160
<v Speaker 3>having this conversation. We're here today. Everything's happening now. I'm

0:30:23.160 --> 0:30:26.160
<v Speaker 3>curious what you both think about about the near term

0:30:26.240 --> 0:30:29.160
<v Speaker 3>future of genitive A. Right, if we came back in

0:30:29.320 --> 0:30:31.000
<v Speaker 3>a year, or let's say two years from now. If

0:30:31.000 --> 0:30:33.640
<v Speaker 3>we came back two years from now to talk about

0:30:33.640 --> 0:30:35.840
<v Speaker 3>the work you're doing in genitive AI, what would we

0:30:35.920 --> 0:30:36.520
<v Speaker 3>be talking about.

0:30:38.200 --> 0:30:42.240
<v Speaker 4>I use this example sometimes I have three kids, and

0:30:42.960 --> 0:30:46.760
<v Speaker 4>I don't think any of them have ever gone into

0:30:46.800 --> 0:30:49.680
<v Speaker 4>a bank to deposit a check. Right, They pull out

0:30:49.720 --> 0:30:52.640
<v Speaker 4>their mobile phone and they scan the check with the

0:30:52.680 --> 0:30:53.800
<v Speaker 4>camera and they're done.

0:30:53.920 --> 0:30:56.200
<v Speaker 3>I'm surprised that they even know what a check is.

0:30:56.040 --> 0:30:59.320
<v Speaker 4>For the record, but yeah, right, well, yeah, sometimes their

0:30:59.360 --> 0:31:03.800
<v Speaker 4>parents give them one, like they get direct deposit. But anyway,

0:31:03.880 --> 0:31:07.080
<v Speaker 4>like this experience of like, what do you mean I

0:31:07.200 --> 0:31:09.320
<v Speaker 4>go into a branch in cash a check. I just

0:31:09.400 --> 0:31:11.720
<v Speaker 4>do this with my mobile phone. And I think a

0:31:11.760 --> 0:31:14.040
<v Speaker 4>little bit of it that way, in terms of the

0:31:14.080 --> 0:31:17.520
<v Speaker 4>systems that we use at work. I can imagine explaining

0:31:17.560 --> 0:31:21.200
<v Speaker 4>to my kids like, oh yeah, at Salesforce. You know,

0:31:21.320 --> 0:31:23.640
<v Speaker 4>back when someone had their first day on the job,

0:31:24.000 --> 0:31:27.080
<v Speaker 4>you know, as a service agent or as a salesperson,

0:31:27.520 --> 0:31:29.920
<v Speaker 4>they would have tabs on the screen and they would

0:31:29.960 --> 0:31:33.360
<v Speaker 4>be trained where to click, and they'd have documented processes

0:31:33.520 --> 0:31:36.880
<v Speaker 4>in manuals and that showed them where to get from

0:31:36.920 --> 0:31:40.360
<v Speaker 4>point A to point B. And as the clock turns forward,

0:31:40.880 --> 0:31:44.960
<v Speaker 4>they're just interacting with the natural language prompt. But it

0:31:45.080 --> 0:31:49.160
<v Speaker 4>just kind of fundamentally changes the way we'll be able

0:31:49.200 --> 0:31:51.240
<v Speaker 4>to interact with our systems a record at work.

0:31:51.760 --> 0:31:55.080
<v Speaker 3>It'll be just much more conversational. Instead of clicking through something,

0:31:55.240 --> 0:31:57.600
<v Speaker 3>you'll just basically have a conversation.

0:31:57.400 --> 0:31:58.640
<v Speaker 4>Much more conversational.

0:31:58.800 --> 0:32:01.200
<v Speaker 5>Yeah, this is the biggest paradigm shift in how we

0:32:01.240 --> 0:32:03.840
<v Speaker 5>interact with technology, I think since the invention of the

0:32:03.880 --> 0:32:07.520
<v Speaker 5>graphical user interface, and it's going to enable us to

0:32:07.680 --> 0:32:11.960
<v Speaker 5>almost put aside all of that complexity within organizations around

0:32:12.080 --> 0:32:15.920
<v Speaker 5>system silos, process silos, flows, because you're just going to

0:32:16.000 --> 0:32:20.120
<v Speaker 5>layer this just simple natural language interface over all of

0:32:20.160 --> 0:32:21.040
<v Speaker 5>that complexity.

0:32:22.000 --> 0:32:23.000
<v Speaker 6>Yeah, it's going to.

0:32:22.960 --> 0:32:26.960
<v Speaker 5>Amplify, i think the potential of every person on every

0:32:26.960 --> 0:32:29.400
<v Speaker 5>team in a way that we've never been able to

0:32:29.440 --> 0:32:32.160
<v Speaker 5>see before. And the other thing that I think as

0:32:32.240 --> 0:32:34.560
<v Speaker 5>you project forward in a couple of years, and Susan

0:32:34.640 --> 0:32:36.200
<v Speaker 5>just picking up on the point that you talked about

0:32:36.240 --> 0:32:37.800
<v Speaker 5>about blanking, you know.

0:32:37.840 --> 0:32:39.840
<v Speaker 6>I think there's a wonderful little example.

0:32:40.080 --> 0:32:41.800
<v Speaker 5>Look, if you think back to the seventies and the

0:32:41.840 --> 0:32:45.040
<v Speaker 5>eighties when the ATM kind of cash machines were rolling out,

0:32:45.720 --> 0:32:49.680
<v Speaker 5>and at that time, it wasn't really a reaction that

0:32:49.800 --> 0:32:52.520
<v Speaker 5>was one of awe or appreciation for convenience, but people

0:32:52.560 --> 0:32:55.880
<v Speaker 5>were concerned that we were automating away the bank teller jobs.

0:32:56.640 --> 0:32:58.280
<v Speaker 6>Right. But now, when.

0:32:58.160 --> 0:33:00.880
<v Speaker 5>You think about it, what actually had and was this

0:33:01.120 --> 0:33:05.360
<v Speaker 5>technology allowed the banks to scale their branch networks, more

0:33:05.400 --> 0:33:09.240
<v Speaker 5>branches never before, more bank tellers than ever before. Bank

0:33:09.320 --> 0:33:12.680
<v Speaker 5>teller employment and salaries increased, even though we automated them

0:33:12.680 --> 0:33:15.480
<v Speaker 5>out of work, because when they weren't having to spend

0:33:15.480 --> 0:33:18.400
<v Speaker 5>their time counting cash out for people, they were able

0:33:18.400 --> 0:33:20.680
<v Speaker 5>to do more valuable things, right, and new types of

0:33:20.720 --> 0:33:24.120
<v Speaker 5>financial products and services and mortgages and so like. If

0:33:24.160 --> 0:33:26.600
<v Speaker 5>I think back to that in the seventies and eighties

0:33:26.640 --> 0:33:28.840
<v Speaker 5>and then I project to where we are today, we're

0:33:28.840 --> 0:33:32.880
<v Speaker 5>just going to unleash this creativity and potential for employees

0:33:32.920 --> 0:33:35.680
<v Speaker 5>and enterprises by freeing up the time that they're spending

0:33:35.760 --> 0:33:38.000
<v Speaker 5>on things that you know, they can do far more

0:33:38.080 --> 0:33:40.200
<v Speaker 5>value added tasks. And so I think we're going to

0:33:40.200 --> 0:33:43.960
<v Speaker 5>be amazed I think around what happens and what companies

0:33:44.000 --> 0:33:45.440
<v Speaker 5>and people are going to be able to do as

0:33:45.480 --> 0:33:47.720
<v Speaker 5>we give them the time and space to be able

0:33:47.760 --> 0:33:49.040
<v Speaker 5>to do that great.

0:33:49.680 --> 0:33:52.840
<v Speaker 3>So, just to close, I want to talk about how

0:33:52.880 --> 0:33:56.400
<v Speaker 3>both of you use creativity in your own work. Just

0:33:56.440 --> 0:33:58.600
<v Speaker 3>to start with you, Matt, I know that you love

0:33:58.680 --> 0:34:04.560
<v Speaker 3>to combine create and technology through design. Do you use

0:34:04.640 --> 0:34:07.000
<v Speaker 3>generative AI in your own creative process?

0:34:07.400 --> 0:34:07.760
<v Speaker 6>Yeah?

0:34:07.840 --> 0:34:12.360
<v Speaker 5>So I'm a firm believer that this combination of experience

0:34:12.400 --> 0:34:14.799
<v Speaker 5>in AI is going to be the thing that makes

0:34:14.800 --> 0:34:18.000
<v Speaker 5>a difference. Like these large language models, and this technology

0:34:18.000 --> 0:34:20.680
<v Speaker 5>has been around actually for a number of years, and

0:34:20.719 --> 0:34:24.080
<v Speaker 5>it's only at the point late twenty twenty two where

0:34:24.360 --> 0:34:27.520
<v Speaker 5>open AI wrapped a digital experience around this and put

0:34:27.520 --> 0:34:30.319
<v Speaker 5>it in the hands of people that suddenly the transformative

0:34:30.360 --> 0:34:33.399
<v Speaker 5>power of this technology was realized. And so I think

0:34:33.440 --> 0:34:36.920
<v Speaker 5>the way that we surface these capabilities and put them

0:34:36.960 --> 0:34:40.160
<v Speaker 5>in the hands of people to be able to adopt

0:34:40.200 --> 0:34:42.960
<v Speaker 5>it in a really frictionless way is the thing that's

0:34:43.000 --> 0:34:45.520
<v Speaker 5>going to be hugely important to the adoption and.

0:34:45.560 --> 0:34:46.080
<v Speaker 6>Scaling of this.

0:34:46.200 --> 0:34:49.080
<v Speaker 5>So I think the most important thing for companies to

0:34:49.080 --> 0:34:53.120
<v Speaker 5>do is to make people, not technology central to their strategy.

0:34:53.800 --> 0:34:56.680
<v Speaker 3>Just to go more broadly into your works as a

0:34:56.840 --> 0:34:59.920
<v Speaker 3>I mean, I know that you have launched sales for

0:35:00.080 --> 0:35:03.000
<v Speaker 3>versus AI products into the market, and that you know

0:35:03.040 --> 0:35:05.960
<v Speaker 3>a lot of those have been built obviously given Salesforce

0:35:06.000 --> 0:35:10.840
<v Speaker 3>business around helping people build stronger customer relationships, right, and

0:35:10.920 --> 0:35:14.040
<v Speaker 3>so I'm curious what creativity did you bring to that work.

0:35:14.960 --> 0:35:17.480
<v Speaker 4>Some of the products that I've worked with Salesforce, they're

0:35:17.640 --> 0:35:22.080
<v Speaker 4>they're deeply visually focused. And my personal perspective is is

0:35:22.120 --> 0:35:26.600
<v Speaker 4>that the world can be really noisy. We're just inundated

0:35:27.239 --> 0:35:30.279
<v Speaker 4>with all sorts of demands on our time through so

0:35:30.400 --> 0:35:33.640
<v Speaker 4>many channels, right, Like the phone is firing off, you're

0:35:33.640 --> 0:35:37.719
<v Speaker 4>getting instant messages, you're getting slack messages, you're getting you know, DMS,

0:35:38.000 --> 0:35:41.440
<v Speaker 4>you're getting emails, your phone is ringing. There's processes that

0:35:41.480 --> 0:35:44.759
<v Speaker 4>are bearing down on you. And if we can use

0:35:44.840 --> 0:35:49.680
<v Speaker 4>really good design to filter out and essentially weed the garden,

0:35:50.200 --> 0:35:52.960
<v Speaker 4>because you know, we have this this phrase at Salesforces everything,

0:35:53.000 --> 0:35:57.320
<v Speaker 4>if everything's important, nothing's important. So using really good design

0:35:57.960 --> 0:36:02.680
<v Speaker 4>to create the user experience in salesforce, that just brings

0:36:02.880 --> 0:36:05.920
<v Speaker 4>stuff to life in the most powerful way. So I

0:36:05.960 --> 0:36:08.319
<v Speaker 4>always think of it from that perspective, like, if I'm

0:36:08.320 --> 0:36:11.759
<v Speaker 4>going to put this on a screen and salesforce, what

0:36:11.920 --> 0:36:14.799
<v Speaker 4>did I not put on? Is this the most important thing?

0:36:15.239 --> 0:36:17.400
<v Speaker 4>And is this the thing that's going to align everyone

0:36:17.440 --> 0:36:20.640
<v Speaker 4>to the larger initiative of the firm. So it's that

0:36:20.760 --> 0:36:24.520
<v Speaker 4>kind of design thinking that I use probably every moment

0:36:24.520 --> 0:36:27.760
<v Speaker 4>of the day, whether I'm building a demo or talking

0:36:27.760 --> 0:36:29.920
<v Speaker 4>to an executive as a company in terms of as

0:36:29.960 --> 0:36:31.920
<v Speaker 4>I see a vision for how they might deploy our

0:36:31.960 --> 0:36:34.600
<v Speaker 4>products to actual product development.

0:36:35.840 --> 0:36:38.040
<v Speaker 3>Just to kind of bring together these two themes we've

0:36:38.080 --> 0:36:40.040
<v Speaker 3>been talking about, on the one hand, the sort of

0:36:40.360 --> 0:36:44.439
<v Speaker 3>ecosystem partnerships and on the other hand, creativity. I mean,

0:36:44.719 --> 0:36:48.319
<v Speaker 3>can you talk a little bit about how working with

0:36:49.080 --> 0:36:52.480
<v Speaker 3>working with partners can foster a different kind of creativity.

0:36:53.160 --> 0:36:56.120
<v Speaker 4>More perspectives are always better than few perspectives.

0:36:56.760 --> 0:36:57.840
<v Speaker 6>I completely agree.

0:36:57.920 --> 0:37:01.879
<v Speaker 5>I think the mole minds, the more perspective, the more experiences.

0:37:03.200 --> 0:37:05.560
<v Speaker 5>You know, if I think about some of the best sessions,

0:37:05.760 --> 0:37:09.439
<v Speaker 5>best workshops, best work we do with clients. It's when

0:37:09.480 --> 0:37:13.680
<v Speaker 5>you've got people not just from one industry, but from

0:37:13.680 --> 0:37:17.680
<v Speaker 5>many industries, because actually the adjacencies and the things that

0:37:17.680 --> 0:37:20.560
<v Speaker 5>are happening in these other spaces trigger new thoughts and

0:37:20.600 --> 0:37:24.000
<v Speaker 5>new ideas. And so, you know, I think the richness

0:37:24.000 --> 0:37:27.960
<v Speaker 5>that we get when we partner with Salesforce together around

0:37:27.960 --> 0:37:32.239
<v Speaker 5>helping clients transform their front office, their sales service marketing processes.

0:37:32.600 --> 0:37:33.960
<v Speaker 6>We all bring these unique.

0:37:33.719 --> 0:37:36.759
<v Speaker 5>Experiences, and I think that just opens the aperture to

0:37:36.840 --> 0:37:40.680
<v Speaker 5>better outcomes and better perspectives for our clients.

0:37:41.640 --> 0:37:43.839
<v Speaker 4>Well, you know, you've been asking these questions about like

0:37:44.080 --> 0:37:47.239
<v Speaker 4>the use of tech and AI and creativity are sort

0:37:47.280 --> 0:37:49.360
<v Speaker 4>of in the same sentence. And one of the things

0:37:49.360 --> 0:37:53.160
<v Speaker 4>that I also think of is in terms of remaining

0:37:53.200 --> 0:37:57.719
<v Speaker 4>deeply creative is the actual process of unplugging from all

0:37:57.719 --> 0:38:02.520
<v Speaker 4>that stuff. So taking a trail run with no earphones

0:38:02.719 --> 0:38:06.680
<v Speaker 4>in your head, for me, is always a really good

0:38:06.680 --> 0:38:10.239
<v Speaker 4>way of unleashing and unbridening a lot of you know,

0:38:10.400 --> 0:38:14.960
<v Speaker 4>creative spirit. Just that downtime and the unstructured time where

0:38:14.960 --> 0:38:17.799
<v Speaker 4>your brain can just run free, actually not assisted by

0:38:17.800 --> 0:38:20.720
<v Speaker 4>any kind of device in my head or in my face.

0:38:20.880 --> 0:38:24.960
<v Speaker 3>So I think with that praise of unplugged time. We

0:38:25.000 --> 0:38:27.719
<v Speaker 3>should say goodbye and let's unplug it. It's lovely to

0:38:27.719 --> 0:38:29.920
<v Speaker 3>talk with you guys. It was really interesting to learn

0:38:29.960 --> 0:38:32.120
<v Speaker 3>about your work and the relationship between the company. So

0:38:32.239 --> 0:38:33.120
<v Speaker 3>thank you for your time.

0:38:33.960 --> 0:38:35.200
<v Speaker 6>Thank you, Jacob, thank you.

0:38:36.760 --> 0:38:39.080
<v Speaker 2>A huge thanks is due to Jacob, Matt and Susan

0:38:39.200 --> 0:38:44.399
<v Speaker 2>for illuminating the possibilities of generative AI. This technology has

0:38:44.440 --> 0:38:48.279
<v Speaker 2>great promise for creating new experiences in the future, but

0:38:48.480 --> 0:38:54.040
<v Speaker 2>requires the scaling capabilities made possible by partnerships like IBM

0:38:54.600 --> 0:38:58.839
<v Speaker 2>and Salesforce. As our conversation with Susan and Matt illustrated,

0:38:59.200 --> 0:39:03.440
<v Speaker 2>we're at an exiting phase of adoption. Most companies have

0:39:03.560 --> 0:39:08.200
<v Speaker 2>moved beyond experimentation and are now prioritizing scaling. The key

0:39:08.280 --> 0:39:13.239
<v Speaker 2>areas of focus for organizations now include managing multiple AI models,

0:39:13.680 --> 0:39:18.800
<v Speaker 2>as well as thinking about specific use cases and desired outcomes. However,

0:39:18.880 --> 0:39:22.000
<v Speaker 2>this scale is difficult for companies to do on their own.

0:39:22.600 --> 0:39:27.560
<v Speaker 2>To unlock the real potential of generative AI in transforming experiences,

0:39:27.680 --> 0:39:32.480
<v Speaker 2>they'll require the scaling capabilities made possible by partnerships like

0:39:32.600 --> 0:39:37.320
<v Speaker 2>IBM and Salesforce. This conversation showed the promise of teamwork.

0:39:38.040 --> 0:39:42.359
<v Speaker 2>When massive companies combine their brain power to push forward technology,

0:39:42.680 --> 0:39:49.239
<v Speaker 2>their collaborative efforts have the potential to revolutionize industries. One

0:39:49.360 --> 0:39:52.279
<v Speaker 2>quick programming note, we will be taking a little time

0:39:52.320 --> 0:39:55.120
<v Speaker 2>off and will be returning in just a few weeks

0:39:55.640 --> 0:39:59.400
<v Speaker 2>with a new episode. Smart Talks with IBM is produced

0:39:59.400 --> 0:40:04.759
<v Speaker 2>by mattro Joey Fishground, David Jaw and Jacob Goldstein. We're

0:40:04.880 --> 0:40:08.360
<v Speaker 2>edited by Lydia Jane Kott. Our engineers are Jason Gambrel,

0:40:08.760 --> 0:40:14.560
<v Speaker 2>Sarah Bruguier and Ben Holliday. Theme song by Gramoscope. Special

0:40:14.560 --> 0:40:18.080
<v Speaker 2>thanks to Andy Kelly, Kathy Callahan and the eight Bar

0:40:18.239 --> 0:40:22.080
<v Speaker 2>and IBM teams, as well as the Pushkin marketing team.

0:40:22.440 --> 0:40:25.440
<v Speaker 2>Smart Talks with IBM is a production of Pushkin Industries

0:40:25.680 --> 0:40:30.160
<v Speaker 2>and Ruby Studio at iHeartMedia. To find more Pushkin podcasts,

0:40:30.480 --> 0:40:34.799
<v Speaker 2>listen on the iHeartRadio app, Apple Podcasts, or wherever you

0:40:34.960 --> 0:40:39.440
<v Speaker 2>listen to podcasts. I'm Malcolm Gladwell. This is a paid

0:40:39.480 --> 0:40:47.520
<v Speaker 2>advertisement from IBM.