WEBVTT - Smart Talks with IBM: Salesforce & IBM: Revolutionizing Experiences with Generative AI

0:00:00.120 --> 0:00:02.840
<v Speaker 1>Hey everyone, it's Robert and Joe here. Today we've got

0:00:02.840 --> 0:00:04.720
<v Speaker 1>something a little bit different to share with you. It

0:00:04.840 --> 0:00:08.000
<v Speaker 1>is a new season of the Smart Talks with IBM

0:00:08.119 --> 0:00:09.119
<v Speaker 1>podcast series.

0:00:09.600 --> 0:00:11.680
<v Speaker 2>Today we are witnessed to one of those rare moments

0:00:11.680 --> 0:00:14.360
<v Speaker 2>in history, the rise of an innovative technology with the

0:00:14.360 --> 0:00:18.680
<v Speaker 2>potential to radically transform business and society forever. The technology,

0:00:18.760 --> 0:00:22.200
<v Speaker 2>of course, is artificial intelligence, and it's the central focus

0:00:22.239 --> 0:00:24.800
<v Speaker 2>for this new season of Smart Talks with IBM.

0:00:25.320 --> 0:00:28.400
<v Speaker 1>Join hosts from your favorite Pushkin podcasts as they talk

0:00:28.480 --> 0:00:31.640
<v Speaker 1>with industry experts and leaders to explore how businesses can

0:00:31.680 --> 0:00:35.360
<v Speaker 1>integrate AI into their workflows and help drive real change

0:00:35.400 --> 0:00:38.200
<v Speaker 1>in this new era of AI. And of course, host

0:00:38.280 --> 0:00:40.440
<v Speaker 1>Malcolm Gladwell will be there to guide you through the

0:00:40.479 --> 0:00:42.640
<v Speaker 1>season and throw in his two cents as well.

0:00:43.120 --> 0:00:46.120
<v Speaker 2>Look out for new episodes of Smart Talks with IBM

0:00:46.400 --> 0:00:49.519
<v Speaker 2>every other week on the iHeartRadio app, Apple Podcasts, or

0:00:49.560 --> 0:00:53.360
<v Speaker 2>wherever you get your podcasts, and learn more at IBM

0:00:53.479 --> 0:00:55.480
<v Speaker 2>dot com slash smart talks.

0:00:57.200 --> 0:01:00.840
<v Speaker 3>Hello, Hello, Welcome to Smart Talks with IBM, a podcast

0:01:00.840 --> 0:01:06.760
<v Speaker 3>from Pushkin Industries, iHeartRadio and IBM. I'm Malcolm Glapo. This

0:01:06.880 --> 0:01:11.160
<v Speaker 3>season we're continuing our conversations with new creators visionaries who

0:01:11.200 --> 0:01:15.760
<v Speaker 3>are creatively applying technology in business to drive change, but

0:01:16.080 --> 0:01:20.360
<v Speaker 3>with a focus on the transformative power of artificial intelligence

0:01:20.880 --> 0:01:23.679
<v Speaker 3>and what it means to leverage AI as a game

0:01:23.800 --> 0:01:28.959
<v Speaker 3>changing multiplier for your business. Today's episode highlights the power

0:01:29.040 --> 0:01:32.720
<v Speaker 3>of collaboration. IBM has long been a supporter of the

0:01:32.760 --> 0:01:37.520
<v Speaker 3>better Together mindset and embraces partnerships. They have been working

0:01:37.560 --> 0:01:41.280
<v Speaker 3>together with Salesforce for more than two decades, but have

0:01:41.400 --> 0:01:47.319
<v Speaker 3>recently launched a new collaborative effort surrounding generative AI. Pushkin's

0:01:47.360 --> 0:01:50.600
<v Speaker 3>very own Jacob Goldstein sat down with Matt Candy and

0:01:50.680 --> 0:01:55.120
<v Speaker 3>Susan Emerson. Matt is the global managing partner of Generative

0:01:55.200 --> 0:01:59.320
<v Speaker 3>AI at IBM Consulting, helping clients and partners around the

0:01:59.360 --> 0:02:03.920
<v Speaker 3>world in raised this new era of technology, and Susan

0:02:04.400 --> 0:02:08.160
<v Speaker 3>is a senior vice president for Salesforce dedicated to AI,

0:02:08.760 --> 0:02:13.720
<v Speaker 3>analytics and data. They discussed the historic collaboration between the

0:02:13.760 --> 0:02:18.560
<v Speaker 3>two tech giants, explored the opportunity AI presents for customer service,

0:02:19.040 --> 0:02:23.440
<v Speaker 3>and walk through how businesses can use generative AI to

0:02:23.639 --> 0:02:28.520
<v Speaker 3>interface with clients. Okay, let's get to the conversation.

0:02:30.600 --> 0:02:33.799
<v Speaker 4>Thank you guys for coming this morning. So I'm interested

0:02:34.120 --> 0:02:37.639
<v Speaker 4>in how you both came to generative AI, or maybe

0:02:37.639 --> 0:02:39.000
<v Speaker 4>it sort of came to you in the way it

0:02:39.040 --> 0:02:41.040
<v Speaker 4>sort of came to all of us, But how did

0:02:41.080 --> 0:02:43.320
<v Speaker 4>you arrive at working on generative AI.

0:02:43.639 --> 0:02:46.440
<v Speaker 5>As part of my remitted Salesforce. Over the years, I've

0:02:46.480 --> 0:02:50.160
<v Speaker 5>brought a lot of analytics and data and machine learning

0:02:50.200 --> 0:02:54.880
<v Speaker 5>products to life under the Einstein brand at Salesforce. So

0:02:55.400 --> 0:03:00.360
<v Speaker 5>as we pivoted Salesforce into taking advantage of the enertive

0:03:00.400 --> 0:03:03.480
<v Speaker 5>AI moment, it was natural that I became part of

0:03:03.520 --> 0:03:10.440
<v Speaker 5>the advanced team leveraging generative AI and it's become interesting.

0:03:10.520 --> 0:03:14.240
<v Speaker 5>But what I see as I speak with customers the

0:03:14.320 --> 0:03:16.760
<v Speaker 5>moment that everyone is facing in terms of how they

0:03:16.919 --> 0:03:22.839
<v Speaker 5>incorporate genitive AI into their businesses, their workforces, and their

0:03:22.880 --> 0:03:26.160
<v Speaker 5>technical stacks. It's actually opening up a lot of doors

0:03:26.240 --> 0:03:31.239
<v Speaker 5>to other utility of analytics, data and AI. So it's

0:03:31.240 --> 0:03:35.320
<v Speaker 5>been this big pull through in terms of incorporating not

0:03:35.400 --> 0:03:39.520
<v Speaker 5>just generative AI, but a larger conversation around how we

0:03:39.960 --> 0:03:43.640
<v Speaker 5>become all better using data in our day jobs.

0:03:45.200 --> 0:03:47.839
<v Speaker 4>So that's a great frame for sort of what's going

0:03:47.880 --> 0:03:51.480
<v Speaker 4>on at Salesforce with generative AI. Matt tell us a

0:03:51.520 --> 0:03:54.800
<v Speaker 4>little bit about how that fits with the way IBM

0:03:54.920 --> 0:03:55.800
<v Speaker 4>is approaching the space.

0:03:56.560 --> 0:03:59.800
<v Speaker 6>Yeah, so I guess through three sides to that question.

0:04:00.400 --> 0:04:03.280
<v Speaker 6>And so there's the technology side of it. So IBM

0:04:03.320 --> 0:04:06.640
<v Speaker 6>has a technology organization, and so you know, we are

0:04:06.680 --> 0:04:10.360
<v Speaker 6>building and have been over many years, decades In fact,

0:04:10.400 --> 0:04:13.800
<v Speaker 6>IBM has been working in this space a generative AI

0:04:13.960 --> 0:04:21.480
<v Speaker 6>stack that allows organizations to adopt generative AI technology aimed

0:04:21.520 --> 0:04:26.080
<v Speaker 6>at enterprise and business use within their organizations. So then

0:04:26.120 --> 0:04:28.719
<v Speaker 6>within the consulting business, you know, we have one hundred

0:04:28.760 --> 0:04:32.279
<v Speaker 6>and sixty thousand people who work every day with clients

0:04:32.320 --> 0:04:38.000
<v Speaker 6>across every industry, regulated industries, government organizations, and so this,

0:04:38.240 --> 0:04:41.720
<v Speaker 6>you know, is a really important technology that those companies

0:04:41.720 --> 0:04:43.960
<v Speaker 6>are going to be using to drive the next level

0:04:43.960 --> 0:04:48.279
<v Speaker 6>of transformation in their enterprises processes and the types of

0:04:48.279 --> 0:04:51.359
<v Speaker 6>experiences they build for their customers. And so you know,

0:04:51.440 --> 0:04:56.720
<v Speaker 6>we work extensively with partners technology such as Salesforce, AWS, Microsoft,

0:04:57.279 --> 0:05:00.680
<v Speaker 6>as well as our own technology. And then find I

0:05:00.680 --> 0:05:03.520
<v Speaker 6>guess the third angle is the work that we've got

0:05:03.520 --> 0:05:06.440
<v Speaker 6>to do to reinvent the business of consulting. And so

0:05:06.600 --> 0:05:09.760
<v Speaker 6>if I think about you know, consulting in systems integration.

0:05:10.200 --> 0:05:13.719
<v Speaker 6>You know, ultimately we are knowledge workers, right, and so

0:05:14.000 --> 0:05:16.919
<v Speaker 6>from an industry perspective, I think you know, our industry is,

0:05:17.160 --> 0:05:19.839
<v Speaker 6>same as many others, is going to is going to

0:05:19.880 --> 0:05:23.880
<v Speaker 6>go undergo a level of disruption caused by this technology.

0:05:24.160 --> 0:05:26.800
<v Speaker 6>But therefore that will also create a huge opportunity for

0:05:26.880 --> 0:05:27.960
<v Speaker 6>us as well.

0:05:28.000 --> 0:05:30.160
<v Speaker 7>So those three aspects, Jacob.

0:05:30.400 --> 0:05:32.680
<v Speaker 4>Great, So, so that's the point of view sort of

0:05:32.720 --> 0:05:37.080
<v Speaker 4>from your companies in your work. I'm curious to talk

0:05:37.120 --> 0:05:39.720
<v Speaker 4>for a moment about AI from the point of view

0:05:39.800 --> 0:05:44.480
<v Speaker 4>of consumers and employees kind of out in the world today.

0:05:44.520 --> 0:05:47.440
<v Speaker 4>So just to start with consumers, when I'm just out

0:05:48.040 --> 0:05:50.360
<v Speaker 4>as a person as a consumer in the world, how

0:05:50.400 --> 0:05:52.200
<v Speaker 4>am I experiencing AI today?

0:05:53.360 --> 0:05:54.719
<v Speaker 7>I'll give you a great little use case.

0:05:54.760 --> 0:05:58.839
<v Speaker 6>Actually, I was on holiday three weeks ago in Tenerif

0:05:58.880 --> 0:06:01.800
<v Speaker 6>in Spain, and I was trying to find somewhere to

0:06:01.839 --> 0:06:04.240
<v Speaker 6>park the car with the family for dinner that evening,

0:06:04.880 --> 0:06:10.080
<v Speaker 6>and I found this area next to this kind of

0:06:10.160 --> 0:06:13.240
<v Speaker 6>shopping center and there was this sign there and I

0:06:13.279 --> 0:06:15.640
<v Speaker 6>couldn't quite work out if it was saying I could

0:06:15.640 --> 0:06:18.640
<v Speaker 6>park there or not, And so I took a photo

0:06:18.720 --> 0:06:21.599
<v Speaker 6>of the sign and I uploaded it to an AI

0:06:21.960 --> 0:06:24.159
<v Speaker 6>tool and I said what does this mean? And it

0:06:24.200 --> 0:06:26.359
<v Speaker 6>basically explained to me what the sign was saying and

0:06:26.400 --> 0:06:28.520
<v Speaker 6>basically told me that I shouldn't be parking there, and

0:06:28.560 --> 0:06:31.800
<v Speaker 6>so I drove on and I found some somewhere else

0:06:31.839 --> 0:06:36.360
<v Speaker 6>to park. But you know, that allowed me, in under

0:06:36.440 --> 0:06:40.360
<v Speaker 6>sixty seconds to probably avoid one hundred euro fine by

0:06:40.400 --> 0:06:43.880
<v Speaker 6>parking the car there. So just a simple example, but

0:06:43.960 --> 0:06:47.280
<v Speaker 6>I think the ability that these tools have to take

0:06:47.360 --> 0:06:50.240
<v Speaker 6>friction out of our daily lives, you know, and to

0:06:50.279 --> 0:06:53.320
<v Speaker 6>be able to make just things that we do in

0:06:53.320 --> 0:06:55.680
<v Speaker 6>our everyday life simple and more frictionless.

0:06:56.440 --> 0:06:56.600
<v Speaker 2>You know.

0:06:56.680 --> 0:06:59.880
<v Speaker 6>That's how I look at how mat the consumer's going

0:06:59.920 --> 0:07:02.000
<v Speaker 6>to benefit from some of this type of technology.

0:07:02.720 --> 0:07:06.279
<v Speaker 5>And from my perspective, it's also a travel story. I

0:07:06.320 --> 0:07:09.400
<v Speaker 5>spend a lot of time on the road for work,

0:07:09.760 --> 0:07:13.720
<v Speaker 5>but recently had to send my sister and her family

0:07:13.880 --> 0:07:16.840
<v Speaker 5>to a destination they had never been to for a wedding,

0:07:17.520 --> 0:07:21.120
<v Speaker 5>and it was really quick and easy to use some

0:07:21.480 --> 0:07:24.560
<v Speaker 5>generitive tools to come up with a whole plan for them.

0:07:24.560 --> 0:07:27.160
<v Speaker 5>Because they love to hike and to be outdoors and

0:07:27.200 --> 0:07:30.840
<v Speaker 5>to hike in areas that aren't overly crowded with people,

0:07:31.400 --> 0:07:34.760
<v Speaker 5>and so Jenai very quickly gave me an itinerary of

0:07:34.760 --> 0:07:38.200
<v Speaker 5>a bunch of terrific hikes for them for a destination.

0:07:38.560 --> 0:07:40.120
<v Speaker 7>So things like that great.

0:07:40.560 --> 0:07:44.480
<v Speaker 4>And then what about the effect of AI and of

0:07:44.520 --> 0:07:47.600
<v Speaker 4>automation more generally on employees on the.

0:07:47.520 --> 0:07:51.520
<v Speaker 5>Workforce, Well, there's so many dimensions to take that from

0:07:51.800 --> 0:07:55.680
<v Speaker 5>generitive AI really can up level a workforce in all

0:07:55.720 --> 0:07:59.280
<v Speaker 5>sorts of ways by providing these consistent ways to engage

0:07:59.360 --> 0:08:03.400
<v Speaker 5>with technology, with these natural language experiences. So I think

0:08:03.400 --> 0:08:07.360
<v Speaker 5>it changes everything from it finds us content, it generates

0:08:07.440 --> 0:08:10.000
<v Speaker 5>us content, it makes it easier to work with our

0:08:10.040 --> 0:08:16.000
<v Speaker 5>systems of engagement and operation, and for many organizations it

0:08:16.040 --> 0:08:19.160
<v Speaker 5>can be a lifting factor in terms of bringing a

0:08:19.200 --> 0:08:23.760
<v Speaker 5>more consistent workforce experience because these tools can just be

0:08:23.800 --> 0:08:26.679
<v Speaker 5>ever present in our systems of work.

0:08:27.560 --> 0:08:29.640
<v Speaker 6>I mean, I'll give you a little example here in IBM,

0:08:29.800 --> 0:08:33.120
<v Speaker 6>we have something called our skjar and so that's our

0:08:33.200 --> 0:08:38.200
<v Speaker 6>conversational AI interface that we use to interact with HR

0:08:38.400 --> 0:08:43.080
<v Speaker 6>services and ninety four percent of every employee interaction now

0:08:43.520 --> 0:08:47.760
<v Speaker 6>happens without human intervention through that interface. But you would

0:08:47.760 --> 0:08:50.520
<v Speaker 6>never know that. And so if I think about, you know,

0:08:51.200 --> 0:08:54.520
<v Speaker 6>our HR processes. You know, we have this amazing conversational

0:08:54.559 --> 0:08:57.880
<v Speaker 6>based AI that we use for all of our HR

0:08:58.040 --> 0:09:02.280
<v Speaker 6>interactions and we surface that through SLACK, and so SLACK

0:09:02.320 --> 0:09:05.360
<v Speaker 6>becomes the front door for how we access a lot

0:09:05.400 --> 0:09:09.360
<v Speaker 6>of these different enterprise processes and capabilities and how we

0:09:09.440 --> 0:09:11.839
<v Speaker 6>surface AI. In fact, I'm taking a flight shortly back

0:09:11.840 --> 0:09:14.679
<v Speaker 6>to the UK and our our skhar boss is reminding

0:09:14.720 --> 0:09:16.439
<v Speaker 6>me that it's raining in the UK and I should

0:09:16.440 --> 0:09:17.559
<v Speaker 6>take an umbrella.

0:09:18.360 --> 0:09:20.840
<v Speaker 5>Isn't it always like raining in England?

0:09:23.120 --> 0:09:25.240
<v Speaker 6>Yeah, I don't think there's any AI needed for that.

0:09:25.280 --> 0:09:28.600
<v Speaker 6>I think that's just a hard coded If England, then

0:09:28.640 --> 0:09:29.360
<v Speaker 6>take umbrella.

0:09:29.440 --> 0:09:30.520
<v Speaker 7>That's right, that's just a rule.

0:09:30.679 --> 0:09:33.760
<v Speaker 6>That's just a rule, right, and you're able to converse

0:09:33.800 --> 0:09:35.840
<v Speaker 6>and yeah, I need to book holiday, I need to

0:09:35.880 --> 0:09:38.880
<v Speaker 6>move somebody between managers. I need to figure out the

0:09:38.920 --> 0:09:43.120
<v Speaker 6>policy on this. And the AI basically navigates across the

0:09:43.160 --> 0:09:46.040
<v Speaker 6>different systems to be able to help get that information,

0:09:46.240 --> 0:09:48.800
<v Speaker 6>to summarize it back to be able to carry out

0:09:48.800 --> 0:09:51.480
<v Speaker 6>the transactions that I need carried out, and it just

0:09:51.760 --> 0:09:54.720
<v Speaker 6>removes all of that complexity and makes it easier to

0:09:54.720 --> 0:09:55.319
<v Speaker 6>get things.

0:09:55.160 --> 0:10:04.520
<v Speaker 4>Done when you are working with companies to implement generative AI. Now,

0:10:05.240 --> 0:10:08.600
<v Speaker 4>what do you find tends to be their primary focus?

0:10:09.280 --> 0:10:11.560
<v Speaker 5>I mean I speak with a lot of customers each week,

0:10:11.640 --> 0:10:15.880
<v Speaker 5>and for the last several months, most organizations have just

0:10:15.960 --> 0:10:20.160
<v Speaker 5>been reorienting themselves in terms of where are we in

0:10:20.200 --> 0:10:23.760
<v Speaker 5>this moment, what is this technology capable of? What are

0:10:23.800 --> 0:10:27.400
<v Speaker 5>the risks and governance and frameworks that I need to

0:10:27.760 --> 0:10:31.920
<v Speaker 5>establish in order to engage and talk to everyone. Talk

0:10:31.960 --> 0:10:34.960
<v Speaker 5>to my vendors, talk to my cloud providers, talk to

0:10:35.000 --> 0:10:39.840
<v Speaker 5>my consultants, talk to academics, and generally get your sea

0:10:39.920 --> 0:10:44.320
<v Speaker 5>legs under them. And the sort of the unstructured hand

0:10:44.360 --> 0:10:48.600
<v Speaker 5>on keyboards fiddling with technology seems to be moving towards

0:10:48.760 --> 0:10:51.280
<v Speaker 5>let's get some points on the board, let's turn this

0:10:51.320 --> 0:10:54.040
<v Speaker 5>stuff on and go. So that's what I've been seeing

0:10:54.120 --> 0:10:58.360
<v Speaker 5>in terms of the work within the salesforce ecosystem. Matt,

0:10:58.360 --> 0:11:02.079
<v Speaker 5>you've got a larger apperture as well. What are you seeing?

0:11:02.679 --> 0:11:05.280
<v Speaker 7>Yeah, so I definitely agree.

0:11:05.320 --> 0:11:10.400
<v Speaker 6>I think, you know, there's been lots of getting sea legs, experimentation,

0:11:10.760 --> 0:11:12.840
<v Speaker 6>just trying to build knowledge, being able to try and

0:11:13.840 --> 0:11:18.240
<v Speaker 6>build almost you know, internal organizational point of view and

0:11:18.280 --> 0:11:21.160
<v Speaker 6>reference framework. I've seen lots of what I would have

0:11:21.200 --> 0:11:22.920
<v Speaker 6>referred to as random acts of AI.

0:11:24.920 --> 0:11:27.280
<v Speaker 7>In terms of in terms of experimentation.

0:11:27.320 --> 0:11:29.439
<v Speaker 6>But I think I think people now looking into twenty

0:11:29.480 --> 0:11:32.600
<v Speaker 6>twenty four and this is all about now adoption and scaling,

0:11:33.200 --> 0:11:37.040
<v Speaker 6>what's become really clear is organizations have started to realize

0:11:37.080 --> 0:11:39.200
<v Speaker 6>this is going to be a very multi model world

0:11:39.280 --> 0:11:40.760
<v Speaker 6>that they're going to live in. There is no one

0:11:40.800 --> 0:11:44.560
<v Speaker 6>AI that is the answer for their organization, and so

0:11:44.840 --> 0:11:48.240
<v Speaker 6>they're going to have lots of different generative AI models

0:11:48.960 --> 0:11:51.520
<v Speaker 6>and technologies that they're going to sit in the organization

0:11:51.840 --> 0:11:56.760
<v Speaker 6>servicing different use cases, different domain areas, different products and services,

0:11:58.040 --> 0:12:00.959
<v Speaker 6>and so therefore having to figure out how they're going

0:12:01.000 --> 0:12:04.079
<v Speaker 6>to navigate and manage this kind of open world that

0:12:04.080 --> 0:12:06.360
<v Speaker 6>they're going to be sitting in and the decisions that

0:12:06.360 --> 0:12:08.800
<v Speaker 6>they're going to have to make around that. I think

0:12:08.840 --> 0:12:12.079
<v Speaker 6>the second thing that I've seen that people are now

0:12:12.120 --> 0:12:14.559
<v Speaker 6>becoming very clear that this needs to be what I

0:12:14.600 --> 0:12:17.199
<v Speaker 6>would refer to as use case lead and outcome focus,

0:12:18.600 --> 0:12:21.960
<v Speaker 6>and so really needing to start with thinking about the

0:12:22.040 --> 0:12:25.000
<v Speaker 6>business outcome and the problem that you know, we're trying

0:12:25.080 --> 0:12:29.080
<v Speaker 6>to solve, and therefore, how do I use generative AI

0:12:29.760 --> 0:12:33.160
<v Speaker 6>as part of the mechanism to solve that problem. And

0:12:33.200 --> 0:12:35.840
<v Speaker 6>I think, you know, what Susan and the Salesforce team

0:12:35.880 --> 0:12:37.720
<v Speaker 6>do is an amazing example of that. You know, they've

0:12:37.720 --> 0:12:42.120
<v Speaker 6>got this incredible platform and engine that allows companies to

0:12:42.160 --> 0:12:45.199
<v Speaker 6>transform their sales and service processes and to be able

0:12:45.240 --> 0:12:47.280
<v Speaker 6>to put data in the hands of users, to be

0:12:47.280 --> 0:12:50.320
<v Speaker 6>able to make better decisions, et cetera. And so now

0:12:50.360 --> 0:12:53.200
<v Speaker 6>by weaving generative AI into that platform, we're going to

0:12:53.200 --> 0:12:56.199
<v Speaker 6>be able to make those processes workflows even more efficient. Right,

0:12:56.280 --> 0:12:59.240
<v Speaker 6>So it's generative AI plus all of these other amazing

0:12:59.240 --> 0:13:02.079
<v Speaker 6>things that are there. It will be led through business outcome,

0:13:02.520 --> 0:13:04.960
<v Speaker 6>and it will be led through use case and the

0:13:05.040 --> 0:13:08.480
<v Speaker 6>business problem or workflow that we're trying to improve. And

0:13:08.520 --> 0:13:10.320
<v Speaker 6>then I think the third thing is shifting from this

0:13:10.440 --> 0:13:13.520
<v Speaker 6>experimentation to scale. You know, I think everybody's really early

0:13:13.559 --> 0:13:17.960
<v Speaker 6>in this journey, but what's become clear is that you know,

0:13:18.360 --> 0:13:22.320
<v Speaker 6>everybody now need realizes and is starting to lay down

0:13:22.400 --> 0:13:27.280
<v Speaker 6>these ground rules, the guardrails, the frameworks to allow them

0:13:27.760 --> 0:13:31.719
<v Speaker 6>to scale this across the organization. So, you know, I

0:13:32.080 --> 0:13:34.760
<v Speaker 6>think we're in for an exciting, exciting time in twenty

0:13:34.840 --> 0:13:35.320
<v Speaker 6>twenty four.

0:13:36.040 --> 0:13:38.760
<v Speaker 4>So now that we're getting to this moment, what are

0:13:38.800 --> 0:13:42.079
<v Speaker 4>the key things companies have to figure out about scaling

0:13:42.160 --> 0:13:42.840
<v Speaker 4>generative AI.

0:13:45.240 --> 0:13:48.520
<v Speaker 5>I would put that in kind of two categories, and

0:13:48.559 --> 0:13:52.199
<v Speaker 5>following on what Matt was saying in terms of use,

0:13:52.240 --> 0:13:55.720
<v Speaker 5>case defined and outcome, LAD one hundred percent on that

0:13:55.760 --> 0:13:58.480
<v Speaker 5>in terms of starting with a hypothesis of value while

0:13:58.520 --> 0:14:02.160
<v Speaker 5>at the same time people are getting you know, closer

0:14:02.160 --> 0:14:04.600
<v Speaker 5>to the technology to know what their bounds are. But

0:14:04.640 --> 0:14:07.720
<v Speaker 5>the biggest, you know, set of conversations is in the

0:14:07.880 --> 0:14:13.040
<v Speaker 5>enterprise area in terms of embarking and using with generative AI,

0:14:13.520 --> 0:14:16.280
<v Speaker 5>how to do it in ways that is safe for

0:14:17.280 --> 0:14:21.000
<v Speaker 5>use of data that is safe around not just the

0:14:21.120 --> 0:14:26.120
<v Speaker 5>larger topic of generative AI and hallucinations, which which are

0:14:26.160 --> 0:14:27.520
<v Speaker 5>fun to talk about in the media.

0:14:27.680 --> 0:14:30.440
<v Speaker 4>But it's a fun word, right If it was called

0:14:30.480 --> 0:14:33.640
<v Speaker 4>something other than hallucinations, people wouldn't talk about it as much.

0:14:33.720 --> 0:14:34.200
<v Speaker 2>It was just.

0:14:34.280 --> 0:14:38.440
<v Speaker 5>Mistakes, Yeah, that's right, just things that aren't factually true.

0:14:38.640 --> 0:14:40.840
<v Speaker 5>We've been doing a lot of work at Salesforce around

0:14:40.920 --> 0:14:44.800
<v Speaker 5>using you know, dynamic and structured grounding the data so

0:14:44.840 --> 0:14:49.120
<v Speaker 5>we can give very strong and non naive prompt instructions

0:14:49.120 --> 0:14:51.920
<v Speaker 5>to lllms to get return on that. So so just

0:14:51.920 --> 0:14:55.560
<v Speaker 5>to summarize top of mind for organizations using you know,

0:14:55.840 --> 0:14:59.040
<v Speaker 5>large language models, is using their data in ways that

0:14:59.120 --> 0:15:04.440
<v Speaker 5>are safe, trusted, not exposed, and reducing the opportunity for

0:15:04.480 --> 0:15:07.520
<v Speaker 5>hallucinations and maximizing relevant content.

0:15:08.080 --> 0:15:08.360
<v Speaker 2>Great.

0:15:08.440 --> 0:15:10.920
<v Speaker 4>So, Matt Susan was talking about, you know, both what

0:15:11.080 --> 0:15:15.000
<v Speaker 4>organizations are concerned with as a scale generative AI and

0:15:15.040 --> 0:15:18.560
<v Speaker 4>how Salesforce is working to sort of address those concerns.

0:15:19.120 --> 0:15:21.840
<v Speaker 4>What are you seeing at IBM here?

0:15:21.920 --> 0:15:26.960
<v Speaker 6>So, I think certainly from a scaling of generative AI perspective,

0:15:27.000 --> 0:15:30.760
<v Speaker 6>you know, this topic of governance, you know, and how

0:15:30.840 --> 0:15:32.800
<v Speaker 6>organizations are going to have to govern all of these

0:15:32.800 --> 0:15:38.360
<v Speaker 6>models that sit withinside, how they manage kind of bias fairness,

0:15:38.560 --> 0:15:41.320
<v Speaker 6>model drift, you know, if you think about the data

0:15:41.360 --> 0:15:44.880
<v Speaker 6>that's gone into a model and the output it gives

0:15:44.920 --> 0:15:47.800
<v Speaker 6>to start with, not because the model changes, but because

0:15:47.840 --> 0:15:50.120
<v Speaker 6>the context of the world moves on. And so being

0:15:50.160 --> 0:15:52.200
<v Speaker 6>able to kind of manage this model drift is going

0:15:52.280 --> 0:15:55.200
<v Speaker 6>to be a really important thing. I think data really matters,

0:15:55.640 --> 0:16:00.480
<v Speaker 6>and so quality access security around data within the enterprise

0:16:00.600 --> 0:16:03.240
<v Speaker 6>is going to be critical to scaling generative AI. And

0:16:03.280 --> 0:16:05.320
<v Speaker 6>the other one I think that's going to be really important,

0:16:05.320 --> 0:16:07.880
<v Speaker 6>and I think many organizations haven't even got there yet.

0:16:07.880 --> 0:16:11.240
<v Speaker 6>In their thinking is around the ESG implications. So carbon

0:16:12.080 --> 0:16:14.480
<v Speaker 6>you know, the use of this technology does not come

0:16:14.560 --> 0:16:16.040
<v Speaker 6>without a cost of carbon.

0:16:16.760 --> 0:16:19.040
<v Speaker 4>Carbon meaning it's very energy intensive.

0:16:19.400 --> 0:16:23.000
<v Speaker 6>Correct, Yeah, the training of the models and so thinking

0:16:23.000 --> 0:16:27.080
<v Speaker 6>about carbon disclosures and thinking about where I'm infusing it

0:16:27.120 --> 0:16:29.440
<v Speaker 6>into my business and how much I'm using it and

0:16:29.520 --> 0:16:32.440
<v Speaker 6>what the carbon cost of that is. As I think

0:16:32.480 --> 0:16:37.840
<v Speaker 6>about the you know, you know, my own organizational responsibilities

0:16:37.840 --> 0:16:39.880
<v Speaker 6>to reduce carbon I think, you know, there's all of

0:16:39.920 --> 0:16:42.080
<v Speaker 6>these things that I think are going to become important

0:16:42.160 --> 0:16:45.200
<v Speaker 6>factors as people are thinking about the scaling implications of

0:16:45.240 --> 0:16:46.040
<v Speaker 6>this technology.

0:16:47.000 --> 0:16:50.480
<v Speaker 3>AI is already making new experiences possible, but we must

0:16:50.520 --> 0:16:53.840
<v Speaker 3>be mindful in how we integrate this new technology as

0:16:53.840 --> 0:16:58.480
<v Speaker 3>we continue scaling generative AI. Matt touched on some crucial

0:16:58.520 --> 0:17:02.960
<v Speaker 3>aspects from an IBM perspective. Governance, bias, fairness, and security

0:17:03.240 --> 0:17:07.080
<v Speaker 3>are all key considerations when organizations aim to expand their

0:17:07.160 --> 0:17:12.280
<v Speaker 3>use of generative AI. The environmental aspect is especially important,

0:17:12.840 --> 0:17:15.919
<v Speaker 3>and it's refreshing to hear leading thinkers like Matt and

0:17:16.000 --> 0:17:21.120
<v Speaker 3>Susan highlight these issues As this technology continues to evolve.

0:17:21.640 --> 0:17:26.520
<v Speaker 3>These factors are becoming increasingly important for organizations to address

0:17:27.400 --> 0:17:31.560
<v Speaker 3>the historic collaboration between IBM and Salesforce is helping to

0:17:31.680 --> 0:17:35.040
<v Speaker 3>remedy issues companies face when scaling AI.

0:17:36.200 --> 0:17:41.119
<v Speaker 4>So IBM and Salesforce recently announced a new collaborative project

0:17:41.280 --> 0:17:44.240
<v Speaker 4>around generative AI. Tell me more about that.

0:17:45.400 --> 0:17:50.119
<v Speaker 6>We've been partners for over two decades now IBM and Salesforce,

0:17:50.160 --> 0:17:54.040
<v Speaker 6>and so within our consulting business, we work with Salesforce

0:17:54.200 --> 0:17:57.400
<v Speaker 6>technology to help our clients implement that technology to transform

0:17:57.440 --> 0:18:01.480
<v Speaker 6>their businesses. We've got a huge practice, over twelve thousand

0:18:01.880 --> 0:18:05.840
<v Speaker 6>people with certifications around Salesforce platforms, and so you know,

0:18:05.880 --> 0:18:07.920
<v Speaker 6>as Susan and her team and the broader team in

0:18:07.960 --> 0:18:12.040
<v Speaker 6>Salesforce are infusing more capability into the platform around generative AI,

0:18:12.600 --> 0:18:15.400
<v Speaker 6>then our mission is really simple. It's to help clients

0:18:15.960 --> 0:18:20.040
<v Speaker 6>who are using the Salesforce platform adopt those capabilities to help.

0:18:19.920 --> 0:18:22.119
<v Speaker 7>Them get more benefit within their organization.

0:18:22.680 --> 0:18:25.879
<v Speaker 6>You know, we're also a significant user of Salesforce technology

0:18:25.880 --> 0:18:29.399
<v Speaker 6>within IBM. We're one of Salesforce's largest customers globally, and

0:18:29.480 --> 0:18:32.280
<v Speaker 6>so you know, as we continue to transform our own

0:18:32.359 --> 0:18:36.440
<v Speaker 6>sales and service processes within IBM, then you know our

0:18:36.560 --> 0:18:39.960
<v Speaker 6>use of the generative AI capabilities that they're infusing into sales,

0:18:40.000 --> 0:18:43.359
<v Speaker 6>cloud service, cloud slack, et cetera will be something that

0:18:43.359 --> 0:18:47.520
<v Speaker 6>will become really important to us driving productivity within the company.

0:18:47.920 --> 0:18:49.439
<v Speaker 6>And then the other thing that I would say is,

0:18:49.680 --> 0:18:51.240
<v Speaker 6>you know, as I think about the work that we

0:18:51.320 --> 0:18:54.240
<v Speaker 6>do with clients, you know, as they're implementing and on

0:18:54.280 --> 0:18:57.240
<v Speaker 6>their generative AI journeys, you know they're going to utilize

0:18:57.240 --> 0:19:00.760
<v Speaker 6>and leverage the salesforce capabilities within the platform and their

0:19:00.800 --> 0:19:05.040
<v Speaker 6>generative AI technologies. But then you start thinking about processes

0:19:05.080 --> 0:19:07.959
<v Speaker 6>and workflows that run beyond the walls of CRM right

0:19:08.000 --> 0:19:11.359
<v Speaker 6>that run into supply chain and into the finance area

0:19:11.359 --> 0:19:14.360
<v Speaker 6>of the organization. And so there is work that we're

0:19:14.359 --> 0:19:17.200
<v Speaker 6>doing with clients where we're using ibms. What's the next

0:19:17.280 --> 0:19:21.080
<v Speaker 6>platform to be able to help get access to to

0:19:21.200 --> 0:19:24.399
<v Speaker 6>generate insights from data sources that sit in all of

0:19:24.440 --> 0:19:27.239
<v Speaker 6>these kind of back office areas of the enterprise and

0:19:27.280 --> 0:19:29.959
<v Speaker 6>to be able to get that data across the salesforce,

0:19:30.040 --> 0:19:34.160
<v Speaker 6>into these customer interaction points and into the employees who

0:19:34.160 --> 0:19:39.080
<v Speaker 6>are servicing those customers using salesforces AI and generative AI technologies.

0:19:39.080 --> 0:19:42.120
<v Speaker 6>So there's a kind of one plus one equals three

0:19:42.320 --> 0:19:45.560
<v Speaker 6>kind of you know, better together, you know, and being

0:19:45.560 --> 0:19:48.320
<v Speaker 6>able to bring our technologies together in service of these

0:19:48.320 --> 0:19:52.280
<v Speaker 6>clients problems as you think about these processes that run

0:19:52.320 --> 0:19:56.520
<v Speaker 6>across their enterprise. So yeah, so huge hut unity and

0:19:56.520 --> 0:19:58.880
<v Speaker 6>what we're doing together in the market to help clients.

0:19:59.480 --> 0:20:02.720
<v Speaker 5>Yeah, building on that, it is a huge moment for

0:20:03.880 --> 0:20:07.240
<v Speaker 5>organizations and for technology companies like Salesforce, and we couldn't

0:20:07.280 --> 0:20:10.360
<v Speaker 5>be happier to have partnerships like we have with IBM.

0:20:10.880 --> 0:20:16.040
<v Speaker 5>Like the range of thought leadership that is appropriate at

0:20:16.040 --> 0:20:19.520
<v Speaker 5>the moment is everything from what is that hypothesis of

0:20:19.600 --> 0:20:22.359
<v Speaker 5>value and what are those use cases? And what is

0:20:22.400 --> 0:20:25.000
<v Speaker 5>the order of operation in terms of approaching it just

0:20:25.040 --> 0:20:28.760
<v Speaker 5>in terms of focus, but then things that would help

0:20:28.880 --> 0:20:33.280
<v Speaker 5>organizations assess their AI readiness and then their approach Like

0:20:33.320 --> 0:20:37.040
<v Speaker 5>you know, we talked earlier about frameworks and guardrails. You know,

0:20:37.080 --> 0:20:40.000
<v Speaker 5>what are use cases that we're comfortable with given the

0:20:40.040 --> 0:20:43.440
<v Speaker 5>state of the technology that face employees or face customers.

0:20:43.480 --> 0:20:46.760
<v Speaker 5>So creating these much larger roadmaps in terms of how

0:20:46.800 --> 0:20:51.080
<v Speaker 5>to approach this over a series of initiatives, the way

0:20:51.280 --> 0:20:55.200
<v Speaker 5>it can fundamentally change the way we engage with technology

0:20:55.800 --> 0:20:59.479
<v Speaker 5>and what that means for the you know, training and

0:20:59.560 --> 0:21:04.399
<v Speaker 5>change management and use cases that fundamentally shift how you

0:21:05.320 --> 0:21:09.080
<v Speaker 5>engage with systems like Salesforce. There's just a massive opportunity

0:21:09.200 --> 0:21:09.919
<v Speaker 5>for us together.

0:21:10.720 --> 0:21:14.560
<v Speaker 4>So you're talking in sort of general terms, I'm interested in,

0:21:14.760 --> 0:21:19.120
<v Speaker 4>you know, thinking in particular about the way generitive AI

0:21:19.240 --> 0:21:23.159
<v Speaker 4>can essentially lead to better business outcomes, right Like, what

0:21:23.200 --> 0:21:25.760
<v Speaker 4>does that look like? How do you measure it? You know,

0:21:25.880 --> 0:21:28.360
<v Speaker 4>there's a certain bottom line question there, right like, how

0:21:28.359 --> 0:21:30.879
<v Speaker 4>does AI make businesses work better? And in what ways?

0:21:31.520 --> 0:21:35.800
<v Speaker 5>You know, as consumers of products and services, we all

0:21:35.840 --> 0:21:38.440
<v Speaker 5>love and respect great service, you know, in terms of

0:21:38.480 --> 0:21:41.800
<v Speaker 5>getting timely, quick answers, resolving issues quickly, all those those

0:21:41.840 --> 0:21:46.800
<v Speaker 5>types of things. And from the perspective of using generitive

0:21:46.880 --> 0:21:51.040
<v Speaker 5>and predictive capabilities for agents who are interacting with customers,

0:21:51.400 --> 0:21:54.640
<v Speaker 5>there is just a whole ton of opportunity to take

0:21:54.680 --> 0:21:57.120
<v Speaker 5>friction out of the process in terms of finding answers,

0:21:57.200 --> 0:22:00.919
<v Speaker 5>resolving issues, in terms of using these generatives capabilities that

0:22:00.960 --> 0:22:04.080
<v Speaker 5>will bring you know, answers and content to the fingertips

0:22:04.119 --> 0:22:09.399
<v Speaker 5>more easily to the human agents that are working with customers. Now,

0:22:09.480 --> 0:22:13.080
<v Speaker 5>taking that to the next step, for organizations when they're

0:22:13.119 --> 0:22:16.960
<v Speaker 5>ready to move into more customer facing automation. That's yet

0:22:17.000 --> 0:22:19.800
<v Speaker 5>another channel. As a consumer, we'll all enjoy with the

0:22:19.840 --> 0:22:22.000
<v Speaker 5>brands and the products and the services that we want

0:22:22.040 --> 0:22:25.600
<v Speaker 5>in terms of fast answers and resolutions to customers, and

0:22:25.640 --> 0:22:30.400
<v Speaker 5>as we all know, great customer experience yields return business.

0:22:30.880 --> 0:22:34.119
<v Speaker 5>Now on the sales side, you know, maybe a different example,

0:22:34.720 --> 0:22:37.639
<v Speaker 5>and these are areas where I think the capability of

0:22:37.840 --> 0:22:41.320
<v Speaker 5>predictive and generative go very well together in terms of

0:22:41.359 --> 0:22:45.160
<v Speaker 5>focusing on business outcomes. And a classic example would be,

0:22:45.680 --> 0:22:50.040
<v Speaker 5>you know, predictions that help us understand customer health. You know,

0:22:50.160 --> 0:22:54.120
<v Speaker 5>is this customer engaged, is this customer at risk? Predictions

0:22:54.119 --> 0:22:58.240
<v Speaker 5>that help us understand next best product or next best conversation.

0:22:58.760 --> 0:23:04.400
<v Speaker 5>These all help focus sales team's time on a customer

0:23:04.480 --> 0:23:08.080
<v Speaker 5>or a territory, and so that deep focus puts all

0:23:08.080 --> 0:23:10.359
<v Speaker 5>the wood behind an arrow, so to speak, in terms

0:23:10.440 --> 0:23:14.919
<v Speaker 5>of where we should be engaging. And those types of

0:23:15.400 --> 0:23:20.119
<v Speaker 5>driven sales organizations that have these capabilities just lead to

0:23:20.160 --> 0:23:25.000
<v Speaker 5>better performance and outcomes and customer experience too. Now, let's

0:23:25.040 --> 0:23:29.480
<v Speaker 5>also layer in generitive capabilities, where we're using the generative

0:23:29.520 --> 0:23:33.560
<v Speaker 5>capabilities to assist and augment a sales team where we're

0:23:33.640 --> 0:23:37.680
<v Speaker 5>using the power de generitive for everything like generating personalized

0:23:37.760 --> 0:23:42.600
<v Speaker 5>and relevant customer interaction content, for example, leveraging our customer

0:23:42.720 --> 0:23:47.639
<v Speaker 5>data like engagement history, product purchases, service history to create

0:23:47.640 --> 0:23:51.080
<v Speaker 5>an email or a campaign. And this scale of automation

0:23:51.240 --> 0:23:54.240
<v Speaker 5>has just never been possible before. And you know, maybe

0:23:54.280 --> 0:23:56.719
<v Speaker 5>even taking this one step further with genitive where we

0:23:56.760 --> 0:23:59.400
<v Speaker 5>take all the administrative friction out of the day job

0:24:00.119 --> 0:24:03.119
<v Speaker 5>doing things for sales teams like summarizing their calls or

0:24:03.160 --> 0:24:06.240
<v Speaker 5>creating a meeting plan for them, and you know, very

0:24:06.280 --> 0:24:10.200
<v Speaker 5>broadly speaking, using generative AI to change the interaction mode

0:24:10.280 --> 0:24:14.960
<v Speaker 5>with systems like Salesforce from clicks and training where people

0:24:15.000 --> 0:24:18.160
<v Speaker 5>have to focus on the process to more conversational user

0:24:18.240 --> 0:24:22.480
<v Speaker 5>experiences which are much more engaging and easier to use.

0:24:22.920 --> 0:24:26.880
<v Speaker 5>So all of this together is just incredible and transformational

0:24:27.240 --> 0:24:30.280
<v Speaker 5>and makes all businesses and people work better.

0:24:30.880 --> 0:24:33.360
<v Speaker 4>So I just want to spend one more moment on

0:24:33.440 --> 0:24:38.879
<v Speaker 4>the partnership between IBM and Salesforce and generitive AI. And

0:24:38.920 --> 0:24:43.080
<v Speaker 4>there's this phrase that's interesting to me. It's ecosystem partnership

0:24:43.359 --> 0:24:46.200
<v Speaker 4>that I think is relevant here. So what is an

0:24:46.200 --> 0:24:51.760
<v Speaker 4>ecosystem partnership and why is it helpful in creating scalable

0:24:51.840 --> 0:24:52.879
<v Speaker 4>AI solutions.

0:24:53.800 --> 0:24:57.879
<v Speaker 6>This idea of being open, I think is probably one

0:24:57.920 --> 0:25:02.119
<v Speaker 6>of the most important premises for US as technology companies,

0:25:02.200 --> 0:25:06.320
<v Speaker 6>for us as consultancies and system integrators, and for our clients.

0:25:06.359 --> 0:25:10.080
<v Speaker 6>To think about the sources of value that can be

0:25:10.119 --> 0:25:14.000
<v Speaker 6>created through taking an open approach is hugely important. So

0:25:14.320 --> 0:25:18.040
<v Speaker 6>if I think about for US, ecosystem means making sure

0:25:18.080 --> 0:25:22.320
<v Speaker 6>that we have all of the different partnerships that we

0:25:22.400 --> 0:25:26.880
<v Speaker 6>need with technology providers, with service providers that we can

0:25:27.920 --> 0:25:32.080
<v Speaker 6>bring to our clients the right set of capabilities to

0:25:32.119 --> 0:25:34.560
<v Speaker 6>solve the problem that they've got, and not thinking that

0:25:35.000 --> 0:25:38.000
<v Speaker 6>just you know, what we have in house, or what

0:25:38.080 --> 0:25:40.399
<v Speaker 6>we have with just one other partner that we work with,

0:25:40.520 --> 0:25:42.639
<v Speaker 6>you know, is the right thing. And so you know,

0:25:42.680 --> 0:25:45.800
<v Speaker 6>I think every problem that our clients have is solved

0:25:45.880 --> 0:25:50.160
<v Speaker 6>through a range of technologies that come together in service

0:25:50.240 --> 0:25:52.200
<v Speaker 6>of creating that business outcome.

0:25:52.680 --> 0:25:58.080
<v Speaker 4>I want to touch briefly on ethics and governance. Something

0:25:58.160 --> 0:26:03.119
<v Speaker 4>like eighty percent of CEOs see explainability, ethics, bias, trust

0:26:03.359 --> 0:26:07.760
<v Speaker 4>as major concerns on the road to AI adoption, and

0:26:07.800 --> 0:26:12.720
<v Speaker 4>so I'm curious how business leaders navigate these things, and

0:26:12.760 --> 0:26:17.320
<v Speaker 4>in particular, how Salesforce and IBM are building these concerns

0:26:17.359 --> 0:26:19.719
<v Speaker 4>into how they work with customers.

0:26:20.400 --> 0:26:25.440
<v Speaker 5>You know, we've been incorporating predictive machine learning into our

0:26:25.480 --> 0:26:29.199
<v Speaker 5>products since mid last decade, and at that time we

0:26:29.280 --> 0:26:33.159
<v Speaker 5>started with all of our ethics and governance work at

0:26:33.200 --> 0:26:36.399
<v Speaker 5>that time in terms of frameworks for engaging with AI

0:26:36.880 --> 0:26:40.280
<v Speaker 5>and ethical and safe ways, and have a lot of

0:26:40.280 --> 0:26:43.800
<v Speaker 5>guidance for customers in terms of those programs. The machine

0:26:43.880 --> 0:26:47.200
<v Speaker 5>learning focus that we've had at Salesforce has always been

0:26:47.280 --> 0:26:51.560
<v Speaker 5>deeply focused on explainability. So if we're making you know,

0:26:51.640 --> 0:26:56.080
<v Speaker 5>predictive recommendations to explain how we got to that, you know,

0:26:56.119 --> 0:26:59.560
<v Speaker 5>whether that's something that a user sees as they're engaging

0:26:59.560 --> 0:27:02.920
<v Speaker 5>with it, they have full trust in terms of interacting

0:27:02.960 --> 0:27:06.560
<v Speaker 5>with it, but also for the practitioners who are building it.

0:27:07.000 --> 0:27:10.359
<v Speaker 5>So we have this like long standing vibe and capability

0:27:10.520 --> 0:27:13.840
<v Speaker 5>with our predictive side of the house and on the

0:27:13.880 --> 0:27:16.280
<v Speaker 5>generative side of the house. You know, the state of

0:27:16.320 --> 0:27:20.080
<v Speaker 5>the marketplace right now is llms for most people are

0:27:20.560 --> 0:27:25.040
<v Speaker 5>largely black boxes in terms of not fully interpretable in

0:27:25.119 --> 0:27:27.920
<v Speaker 5>terms of how they come up with their content. Now

0:27:27.960 --> 0:27:30.120
<v Speaker 5>that said, there is a lot that you can do

0:27:30.760 --> 0:27:34.880
<v Speaker 5>in terms of audit, in terms of you know, transparency,

0:27:34.960 --> 0:27:37.800
<v Speaker 5>in terms of what are the prompts that are being

0:27:37.920 --> 0:27:42.680
<v Speaker 5>submitted to these llms, what do these llms provide back

0:27:42.720 --> 0:27:45.359
<v Speaker 5>in terms of return, and then what did the human

0:27:45.480 --> 0:27:48.119
<v Speaker 5>do to change it, use it, or adjust it. So

0:27:48.160 --> 0:27:51.719
<v Speaker 5>we've been updating all of our ethics and governance frameworks

0:27:51.760 --> 0:27:54.440
<v Speaker 5>now I guess I would call it with safety components

0:27:54.480 --> 0:27:56.960
<v Speaker 5>as well, in terms of how to work with data

0:27:57.840 --> 0:28:01.200
<v Speaker 5>in safe ways and with these turned parents governance models.

0:28:01.520 --> 0:28:03.719
<v Speaker 6>Yeah, So I mean this is an area that IBM

0:28:03.760 --> 0:28:06.120
<v Speaker 6>has been kind of working on for many years. And

0:28:06.200 --> 0:28:08.639
<v Speaker 6>so you know, our AI Ethics Board that we have

0:28:08.800 --> 0:28:13.439
<v Speaker 6>internally kind of governs and provides frameworks and guidance for

0:28:13.520 --> 0:28:15.919
<v Speaker 6>everything that we do in the company. There's a lot

0:28:15.960 --> 0:28:18.399
<v Speaker 6>of work that we do to help our clients and

0:28:18.560 --> 0:28:22.919
<v Speaker 6>organizations establish their strategies for AI governance as well as

0:28:22.960 --> 0:28:27.600
<v Speaker 6>their own internal policies, models, approaches, ethics boards, et cetera.

0:28:28.320 --> 0:28:30.920
<v Speaker 6>And so you know, helping them put in place these

0:28:31.400 --> 0:28:38.160
<v Speaker 6>ground rules and guardrails, organizational process changes, et cetera. I

0:28:38.160 --> 0:28:40.680
<v Speaker 6>think is a really important part of this scaling discussion.

0:28:40.720 --> 0:28:43.000
<v Speaker 6>That we were having earlier, as people are going to

0:28:43.000 --> 0:28:45.600
<v Speaker 6>be kind of rolling out more of this technology internally,

0:28:46.520 --> 0:28:50.360
<v Speaker 6>and then I think there's a lot that organizations are

0:28:50.360 --> 0:28:52.000
<v Speaker 6>going to have to do to think about, especially in

0:28:52.000 --> 0:28:55.000
<v Speaker 6>the generative world, around all of the different types of

0:28:55.040 --> 0:28:58.959
<v Speaker 6>models that they're using, models that they're training and tuning

0:28:59.000 --> 0:29:01.320
<v Speaker 6>and building, and how they manage all of those for

0:29:01.400 --> 0:29:07.680
<v Speaker 6>explainability and bias drift, and actually regulatory requirements, Like if

0:29:07.760 --> 0:29:11.520
<v Speaker 6>you think about what's happening around the world, there's different countries,

0:29:12.120 --> 0:29:15.400
<v Speaker 6>the EUAI Act, you know, there's lots of different regulatory

0:29:15.440 --> 0:29:17.280
<v Speaker 6>requirements that are going to be coming in, and so

0:29:17.360 --> 0:29:23.719
<v Speaker 6>for multinational companies operating across multiple countries, how they're going

0:29:23.760 --> 0:29:27.160
<v Speaker 6>to have to make sure that they're complying with all

0:29:27.200 --> 0:29:31.240
<v Speaker 6>of not only their own internal policies, but the requirements

0:29:31.280 --> 0:29:37.160
<v Speaker 6>of the country as well as potentially industry regulatory requirements

0:29:37.200 --> 0:29:38.360
<v Speaker 6>as well.

0:29:38.400 --> 0:29:39.720
<v Speaker 7>And so there's a lot that.

0:29:39.680 --> 0:29:42.560
<v Speaker 6>We are doing and going to be doing in helping

0:29:42.600 --> 0:29:46.440
<v Speaker 6>them manage complexity. But IBM has a very firm view

0:29:46.480 --> 0:29:49.560
<v Speaker 6>that we believe that this is all about regulating AI risk,

0:29:50.080 --> 0:29:53.800
<v Speaker 6>not AI algorithms, and so focusing on precision regulation.

0:29:54.160 --> 0:29:58.680
<v Speaker 7>So you know, use the bodies and regulatory bodies that.

0:29:58.640 --> 0:30:02.760
<v Speaker 6>Are out there to provide the control as opposed to

0:30:02.760 --> 0:30:04.240
<v Speaker 6>trying to regulate the technology.

0:30:05.040 --> 0:30:09.000
<v Speaker 4>So genitive AI is changing kind of absurdly quickly. Right,

0:30:09.040 --> 0:30:10.440
<v Speaker 4>a year and a half ago, we wouldn't have been

0:30:10.480 --> 0:30:14.040
<v Speaker 4>having this conversation. We're here today. Everything's happening now. I'm

0:30:14.040 --> 0:30:17.080
<v Speaker 4>curious what you both think about about the near term

0:30:17.120 --> 0:30:20.080
<v Speaker 4>future of genitive AI. Right, if we came back in

0:30:20.200 --> 0:30:21.920
<v Speaker 4>a year, or let's say two years from now, if

0:30:21.920 --> 0:30:24.520
<v Speaker 4>we came back two years from now to talk about

0:30:24.560 --> 0:30:26.760
<v Speaker 4>the work you're doing in genitive AI, what would we.

0:30:26.800 --> 0:30:27.400
<v Speaker 7>Be talking about.

0:30:29.120 --> 0:30:33.160
<v Speaker 5>I use this example sometimes I have three kids, and

0:30:33.840 --> 0:30:37.640
<v Speaker 5>I don't think any of them have ever gone into

0:30:37.680 --> 0:30:40.560
<v Speaker 5>a bank to deposit a check. Right, They pull out

0:30:40.600 --> 0:30:43.520
<v Speaker 5>their mobile phone and they scan the check with the

0:30:43.560 --> 0:30:44.680
<v Speaker 5>camera and they're done.

0:30:44.840 --> 0:30:46.880
<v Speaker 4>I'm surprised that they even know what a check is,

0:30:46.960 --> 0:30:47.960
<v Speaker 4>for the record.

0:30:47.680 --> 0:30:51.680
<v Speaker 5>But yes, well yeah, sometimes their parents give them one,

0:30:51.920 --> 0:30:55.880
<v Speaker 5>like they get direct deposit. But anyway, like this experience

0:30:56.000 --> 0:30:58.840
<v Speaker 5>of like, what do you mean a go into a

0:30:58.880 --> 0:31:00.840
<v Speaker 5>branch in cash at check? Just do this with my

0:31:00.920 --> 0:31:03.760
<v Speaker 5>mobile phone? And I think a little bit of it

0:31:03.840 --> 0:31:05.920
<v Speaker 5>that way in terms of the systems that we use

0:31:05.960 --> 0:31:10.640
<v Speaker 5>at work. I can imagine explaining to my kids, like, oh, yeah,

0:31:10.880 --> 0:31:13.680
<v Speaker 5>at Salesforce, you know, back when someone had their first

0:31:13.720 --> 0:31:16.840
<v Speaker 5>day on the job, you know, as a service agent

0:31:16.920 --> 0:31:19.520
<v Speaker 5>or as a salesperson, they would have tabs on the

0:31:19.560 --> 0:31:22.360
<v Speaker 5>screen and they would be trained where to click, and

0:31:22.360 --> 0:31:27.080
<v Speaker 5>they'd have documented processes in manuals, and that showed them

0:31:27.120 --> 0:31:29.720
<v Speaker 5>where to get from point A to point B. And

0:31:29.800 --> 0:31:33.280
<v Speaker 5>as the clock turns forward, they're just interacting with the

0:31:33.400 --> 0:31:38.320
<v Speaker 5>natural language prompt. But it just kind of fundamentally changes

0:31:38.760 --> 0:31:41.320
<v Speaker 5>the way we'll be able to interact with our systems

0:31:41.360 --> 0:31:42.120
<v Speaker 5>or record at work.

0:31:42.640 --> 0:31:46.000
<v Speaker 4>It'll be just much more conversational. Instead of clicking through something,

0:31:46.120 --> 0:31:48.480
<v Speaker 4>you'll just basically have a conversation.

0:31:48.280 --> 0:31:49.520
<v Speaker 5>Much more conversational.

0:31:49.720 --> 0:31:52.080
<v Speaker 6>Yeah, this is the biggest paradigm shift in how we

0:31:52.160 --> 0:31:54.760
<v Speaker 6>interact with technology I think since the invention of the

0:31:54.760 --> 0:31:58.440
<v Speaker 6>graphical user interface, and it's going to enable us to

0:31:58.560 --> 0:32:02.920
<v Speaker 6>almost put us all of that complexity within organizations around

0:32:02.960 --> 0:32:06.840
<v Speaker 6>system silos, process silos flows, because you're just going to

0:32:06.920 --> 0:32:11.040
<v Speaker 6>layer this just simple natural language interface over all of

0:32:11.040 --> 0:32:11.960
<v Speaker 6>that complexity.

0:32:12.880 --> 0:32:15.200
<v Speaker 7>Yeah, it's going to amplify.

0:32:15.320 --> 0:32:18.080
<v Speaker 6>I think the potential of every person on every team

0:32:18.120 --> 0:32:21.040
<v Speaker 6>in a way that we've never been able to see before.

0:32:21.120 --> 0:32:23.760
<v Speaker 6>And the other thing that I think as you project

0:32:23.760 --> 0:32:25.840
<v Speaker 6>forward in a couple of years, and Susan just picking

0:32:25.880 --> 0:32:27.840
<v Speaker 6>up on the point that you talked about about banking,

0:32:28.520 --> 0:32:28.720
<v Speaker 6>you know.

0:32:28.720 --> 0:32:30.720
<v Speaker 7>I think there's a wonderful little example.

0:32:30.960 --> 0:32:32.720
<v Speaker 6>Look, if you think back to the seventies and the

0:32:32.720 --> 0:32:35.920
<v Speaker 6>eighties when the ATM kind of cash machines were rolling out,

0:32:36.640 --> 0:32:40.560
<v Speaker 6>and at that time, it wasn't really a reaction that

0:32:40.680 --> 0:32:43.400
<v Speaker 6>was one of awe or appreciation for convenience, but people

0:32:43.440 --> 0:32:46.760
<v Speaker 6>were concerned that we were automating away the bank teller jobs.

0:32:47.520 --> 0:32:47.760
<v Speaker 2>Right.

0:32:47.920 --> 0:32:51.200
<v Speaker 6>But now, when you think about it, what actually happened

0:32:51.320 --> 0:32:55.960
<v Speaker 6>was this technology allowed the banks to scale their branch networks,

0:32:56.080 --> 0:32:59.360
<v Speaker 6>more branches never before, more bank tellers than ever before,

0:33:00.200 --> 0:33:03.600
<v Speaker 6>teler employment and salaries increased, even though we automated them

0:33:03.600 --> 0:33:06.360
<v Speaker 6>out of work, because when they weren't having to spend

0:33:06.400 --> 0:33:09.280
<v Speaker 6>their time counting cash out for people, they were able

0:33:09.280 --> 0:33:11.560
<v Speaker 6>to do more valuable things, right, and new types of

0:33:11.640 --> 0:33:15.000
<v Speaker 6>financial products and services and mortgages and so like. If

0:33:15.040 --> 0:33:17.480
<v Speaker 6>I think back to that in the seventies and eighties,

0:33:17.520 --> 0:33:19.720
<v Speaker 6>and then I project to where we are today, we're

0:33:19.720 --> 0:33:23.800
<v Speaker 6>just going to unleash this creativity and potential for employees

0:33:23.800 --> 0:33:26.600
<v Speaker 6>and enterprises by freeing up the time that they're spending

0:33:26.640 --> 0:33:28.880
<v Speaker 6>on things that you know, they can do far more

0:33:28.960 --> 0:33:31.080
<v Speaker 6>value added tasks. And so I think we're going to

0:33:31.120 --> 0:33:34.840
<v Speaker 6>be amazed. I think around what happens and what companies

0:33:34.880 --> 0:33:36.360
<v Speaker 6>and people are going to be able to do as

0:33:36.360 --> 0:33:38.640
<v Speaker 6>we give them the time and space to be able

0:33:38.640 --> 0:33:39.920
<v Speaker 6>to do that great.

0:33:40.560 --> 0:33:43.720
<v Speaker 4>So, just to close, I want to talk about how

0:33:43.760 --> 0:33:47.320
<v Speaker 4>both of you use creativity in your own work. Just

0:33:47.320 --> 0:33:49.520
<v Speaker 4>to start with you, Matt, I know that you love

0:33:49.560 --> 0:33:55.440
<v Speaker 4>to combine creativity and technology through design. Do you use

0:33:55.520 --> 0:33:57.720
<v Speaker 4>generative AI in your own creative process?

0:33:58.280 --> 0:33:58.640
<v Speaker 7>Yeah?

0:33:58.720 --> 0:34:02.600
<v Speaker 6>So, I I'm a firm believer that this combination of

0:34:02.640 --> 0:34:05.400
<v Speaker 6>experience in AI is going to be the thing that

0:34:05.440 --> 0:34:08.040
<v Speaker 6>makes a difference. Like these large language models, and this

0:34:08.320 --> 0:34:10.840
<v Speaker 6>technology has been around actually for a number of years,

0:34:11.400 --> 0:34:14.520
<v Speaker 6>and it's only at the point late twenty twenty two

0:34:14.640 --> 0:34:18.200
<v Speaker 6>where open AI wrapped a digital experience around this and

0:34:18.239 --> 0:34:20.440
<v Speaker 6>put it in the hands of people that suddenly the

0:34:20.480 --> 0:34:24.120
<v Speaker 6>transformative power of this technology was realized. And so I

0:34:24.120 --> 0:34:27.680
<v Speaker 6>think the way that we surface these capabilities and put

0:34:27.680 --> 0:34:30.520
<v Speaker 6>them in the hands of people to be able to

0:34:30.600 --> 0:34:33.600
<v Speaker 6>adopt it in a really frictionless way is the thing

0:34:33.640 --> 0:34:36.400
<v Speaker 6>that's going to be hugely important to the adoption and

0:34:36.440 --> 0:34:39.239
<v Speaker 6>scaling of this. So I think the most important thing

0:34:39.280 --> 0:34:42.440
<v Speaker 6>for companies to do is to make people, not technology

0:34:42.600 --> 0:34:44.000
<v Speaker 6>central to their strategy.

0:34:44.680 --> 0:34:48.000
<v Speaker 4>Just to go more broadly into your work, Susan, I mean,

0:34:48.200 --> 0:34:52.520
<v Speaker 4>I know that you have launched Salesforce's AI products into

0:34:52.560 --> 0:34:54.520
<v Speaker 4>the market, and that you know a lot of those

0:34:54.560 --> 0:34:58.680
<v Speaker 4>have been built obviously given Salesforce business around helping people

0:34:58.760 --> 0:35:03.279
<v Speaker 4>build stronger customer relationships, right, And so I'm curious what

0:35:03.360 --> 0:35:04.960
<v Speaker 4>creativity did you bring to that work.

0:35:05.840 --> 0:35:08.399
<v Speaker 5>Some of the products that I've worked with a Salesforce there,

0:35:08.520 --> 0:35:12.960
<v Speaker 5>they're deeply visually focused. And my personal perspective is is

0:35:13.000 --> 0:35:17.480
<v Speaker 5>that the world can be really noisy. We're just inundated

0:35:18.120 --> 0:35:21.160
<v Speaker 5>with all sorts of demands on our time through so

0:35:21.280 --> 0:35:24.520
<v Speaker 5>many channels. Right, Like the phone is firing off, you're

0:35:24.520 --> 0:35:28.640
<v Speaker 5>getting instant messages, you're getting slack messages, you're getting you know, dms,

0:35:28.920 --> 0:35:32.319
<v Speaker 5>you're getting emails, your phone is ringing. There's processes that

0:35:32.400 --> 0:35:35.680
<v Speaker 5>are bearing down on you. And if we can use

0:35:35.719 --> 0:35:40.560
<v Speaker 5>really good design to filter out and essentially weed the garden,

0:35:41.080 --> 0:35:43.320
<v Speaker 5>because you know, we have this this phrase at Salesforce

0:35:43.400 --> 0:35:47.440
<v Speaker 5>is everything. If everything's important, nothing's important. So using really

0:35:47.480 --> 0:35:52.279
<v Speaker 5>good design to create the user experience in Salesforce, that

0:35:52.840 --> 0:35:56.080
<v Speaker 5>just brings stuff to life in the most powerful way.

0:35:56.520 --> 0:35:58.839
<v Speaker 5>So I always think of it from that perspective, like,

0:35:58.920 --> 0:36:01.960
<v Speaker 5>if I'm going to put this on a screen and Salesforce,

0:36:02.560 --> 0:36:04.799
<v Speaker 5>what did I not put on? Is this the most

0:36:04.840 --> 0:36:07.480
<v Speaker 5>important thing? And is this the thing that's going to

0:36:07.480 --> 0:36:10.759
<v Speaker 5>align everyone to the larger initiative of the firm. So

0:36:11.239 --> 0:36:14.800
<v Speaker 5>it's that kind of design thinking that I use probably

0:36:14.840 --> 0:36:17.640
<v Speaker 5>every moment of the day, whether I'm building a demo

0:36:18.160 --> 0:36:20.560
<v Speaker 5>or talking to an executive as a company in terms

0:36:20.560 --> 0:36:22.279
<v Speaker 5>of as I see a vision for how they might

0:36:22.280 --> 0:36:25.480
<v Speaker 5>deploy our products to actual product development.

0:36:26.760 --> 0:36:28.920
<v Speaker 4>Just to kind of bring together these two themes we've

0:36:28.960 --> 0:36:30.920
<v Speaker 4>been talking about, on the one hand, the sort of

0:36:31.239 --> 0:36:35.319
<v Speaker 4>ecosystem partnerships and on the other hand, creativity, I mean,

0:36:35.600 --> 0:36:40.440
<v Speaker 4>can you talk a little bit about how working with

0:36:40.520 --> 0:36:43.399
<v Speaker 4>partners can foster a different kind of creativity.

0:36:44.080 --> 0:36:47.000
<v Speaker 5>More perspectives are always better than few perspectives.

0:36:47.680 --> 0:36:48.760
<v Speaker 7>I completely agree.

0:36:48.800 --> 0:36:52.759
<v Speaker 6>I think the more minds, the more perspectives, the more experiences.

0:36:54.080 --> 0:36:56.279
<v Speaker 6>You know, if I think about some of the best sessions,

0:36:56.640 --> 0:37:00.560
<v Speaker 6>best workshops, best work we do with clients when you've

0:37:00.600 --> 0:37:05.440
<v Speaker 6>got people not just from one industry, but from many industries,

0:37:05.520 --> 0:37:09.080
<v Speaker 6>because actually the adjacencies and the things that are happening

0:37:09.120 --> 0:37:12.160
<v Speaker 6>in these other spaces trigger new thoughts and new ideas,

0:37:12.200 --> 0:37:15.160
<v Speaker 6>and so, you know, I think the richness that we

0:37:15.239 --> 0:37:19.560
<v Speaker 6>get when we partner with salesforce together around helping clients

0:37:19.600 --> 0:37:23.560
<v Speaker 6>transform their front office, their sales service marketing processes. We

0:37:23.640 --> 0:37:26.360
<v Speaker 6>all bring these unique experiences, and I think that just

0:37:26.520 --> 0:37:30.920
<v Speaker 6>opens the aperture to better outcomes and better perspectives for

0:37:31.000 --> 0:37:31.560
<v Speaker 6>our clients.

0:37:32.520 --> 0:37:34.719
<v Speaker 5>Well, you know, you've been asking these questions about like

0:37:34.960 --> 0:37:38.160
<v Speaker 5>the use of tech and AI and creativity are sort

0:37:38.160 --> 0:37:40.239
<v Speaker 5>of in the same sentence. And one of the things

0:37:40.239 --> 0:37:44.040
<v Speaker 5>that I also think of is in terms of remaining

0:37:44.080 --> 0:37:48.600
<v Speaker 5>deeply creative, is the actual process of unplugging from all

0:37:48.600 --> 0:37:53.399
<v Speaker 5>that stuff. So taking a trail run with no earphones

0:37:53.600 --> 0:37:57.560
<v Speaker 5>in your head, for me, is always a really good

0:37:57.560 --> 0:38:02.120
<v Speaker 5>way of unleashing and writing a lot of creative spirit.

0:38:02.719 --> 0:38:06.200
<v Speaker 5>Just that downtime and the unstructured time where your brain

0:38:06.280 --> 0:38:09.200
<v Speaker 5>can just run free, actually not assisted by any kind

0:38:09.200 --> 0:38:11.600
<v Speaker 5>of device in my head or in my face.

0:38:11.760 --> 0:38:15.840
<v Speaker 4>So I think with that praise of unplugged time, we

0:38:15.880 --> 0:38:18.960
<v Speaker 4>should say goodbye and let's unplug it. It's lovely to talk.

0:38:18.840 --> 0:38:19.279
<v Speaker 3>With you guys.

0:38:19.280 --> 0:38:21.480
<v Speaker 4>It was really interesting to learn about your work and

0:38:21.520 --> 0:38:24.120
<v Speaker 4>the relationship between the company. So thank you for your time.

0:38:24.840 --> 0:38:26.120
<v Speaker 7>Thank you, Jacob, thank you.

0:38:27.640 --> 0:38:30.000
<v Speaker 3>A huge thanks is due to Jacob, Matt and Susan

0:38:30.080 --> 0:38:35.279
<v Speaker 3>for illuminating the possibilities of generative AI. This technology has

0:38:35.320 --> 0:38:39.200
<v Speaker 3>great promise for creating new experiences in the future, but

0:38:39.360 --> 0:38:44.920
<v Speaker 3>requires the scaling capabilities made possible by partnerships like IBM

0:38:45.480 --> 0:38:49.719
<v Speaker 3>and Salesforce. As our conversation with Susan and Matt illustrated,

0:38:50.120 --> 0:38:54.360
<v Speaker 3>we're at an exciting phase of adoption. Most companies have

0:38:54.480 --> 0:38:59.160
<v Speaker 3>moved beyond experimentation and are now prioritizing scaling. The key

0:38:59.160 --> 0:39:04.120
<v Speaker 3>areas of focus for organizations now include managing multiple AI models,

0:39:04.560 --> 0:39:09.680
<v Speaker 3>as well as thinking about specific use cases and desired outcomes. However,

0:39:09.760 --> 0:39:12.879
<v Speaker 3>this scale is difficult for companies to do on their own.

0:39:13.480 --> 0:39:18.200
<v Speaker 3>To unlock the real potential of generative AI in transforming experiences,

0:39:18.560 --> 0:39:23.960
<v Speaker 3>they'll require the scaling capabilities made possible by partnerships like IBM,

0:39:24.400 --> 0:39:29.160
<v Speaker 3>and salesforce. This conversation showed the promise of teamwork. When

0:39:29.200 --> 0:39:33.239
<v Speaker 3>massive companies combine their brain power to push forward technology,

0:39:33.600 --> 0:39:40.160
<v Speaker 3>their collaborative efforts have the potential to revolutionize industries. One

0:39:40.239 --> 0:39:43.160
<v Speaker 3>quick programming note, we will be taking a little time

0:39:43.200 --> 0:39:46.000
<v Speaker 3>off and will be returning in just a few weeks

0:39:46.520 --> 0:39:50.320
<v Speaker 3>with a new episode. Smart Talks with IBM is produced

0:39:50.320 --> 0:39:55.040
<v Speaker 3>by Matt Romano, Joey fish Ground, David Jaw and Jacob Goldstein.

0:39:55.480 --> 0:39:59.240
<v Speaker 3>We're edited by Lydia gene Kott. Our engineers are Jason Gambrel,

0:39:59.600 --> 0:40:05.440
<v Speaker 3>Sarah Bruger and Ben Holliday. Theme song by Gramoscope. Special

0:40:05.480 --> 0:40:08.960
<v Speaker 3>thanks to Andy Kelly, Kathy Callahan and the eight Bar

0:40:09.120 --> 0:40:13.000
<v Speaker 3>and IBM teams, as well as the Pushkin marketing team.

0:40:13.360 --> 0:40:16.320
<v Speaker 3>Smart Talks with IBM is a production of Pushkin Industries

0:40:16.560 --> 0:40:21.040
<v Speaker 3>and Ruby Studio at iHeartMedia. To find more Pushkin podcasts,

0:40:21.360 --> 0:40:25.680
<v Speaker 3>listen on the iHeartRadio app, Apple Podcasts, or wherever you

0:40:25.840 --> 0:40:30.360
<v Speaker 3>listen to podcasts. I'm Malcolm Gladwell. This is a paid

0:40:30.360 --> 0:40:39.080
<v Speaker 3>advertisement from IBM.