00:00:02 Speaker 1: Bloomberg Audio Studios, Podcasts, Radio News. Hello and welcome to another episode of The Odd Lots Podcast. I'm Joe Wisenthal, and I'm Tracy Alloway. Tracy, I'm very interested in AI. No really, really, Joe, I am. 00:00:30 Speaker 2: That's a surprise. 00:00:31 Speaker 1: I'm very interested in the investment context, specifically, I mean the actual implementation of like how do investors use it? Because I think obviously just sort of substantively incredibly important question for reasons they need no explaining. But I also think it like raises very interesting sort of like puzzles about what the technology is used for. And I remember like when chadgic BT came out and people were like asking it like what stock should I or we did that prediction market episode recently, and it's like one thing you definitely can't get much value out of is saying like which contract should I buy? Or what's inflation going to be so I can trade this contract? So like, But that doesn't mean that there aren't interesting ways. It just seems like, you know, the sort of the most crude version of quote using AI for investing is obviously a dead end. 00:01:25 Speaker 2: DA here's the question I have. 00:01:28 Speaker 3: You know, we've been through technological revolutions and investing before, notably, you know, we had robo advisors, that's right, remember that, we had systematic investing wants, we had high frequency trading. My big question is how much of the current use of AI is basically an iteration or an improvement on some of those kind of you know, machine learning dynamics, let's say, versus something more substantial or more revolutionary. Is it like a minor evolution or a moderate evolution or something big. 00:01:58 Speaker 1: Well, this came up a lit little bit in our conversation with Ian from Hudson River Trading. You and I'm glad you brought up the quant example because like, all right, big data in some sense has been part of quant since the very beginning. Like, how do you establish that quote value stocks outperform expensive stocks. Well, you just need like a lot of data and computers and running that math, et cetera to establish that fact. But this idea of yes, maybe cheap stocks outperform expensive ones, momentum stocks outperform stocks with bad momentum things that seem to be true, but we don't really know why. And there's a lot of disagreement as to the source of these quant things, and that really makes me think about AI because we can get these outputs from AI models that are obviously remarkable. You can recognize patterns, yes, but they they can't really explain how they arrived at that pattern. And I'm very interested in this sort of where this leads us with investing and whether it's like, Okay, do we get these ideas and strategies, et cetera that work, but we can't really articulate them in plann English. 00:03:04 Speaker 3: I'm glad you brought up data as well, because one thing you hear at basically every finance conference nactas is the importance of data when it comes to running llms and making sure that your data is actually processed, it's clean, that you have a lot of it, and that you have hopefully proprietary data, and the people we're going to talk to have a lot of data. 00:03:24 Speaker 1: Actually totally. There was just one more thing. I don't know if you caught it last week. Were recording this July seventh, last week while you're on vacation. It was a very interesting paper out for Bridgewater talking about their use of proprietary data to fine tune an open source version of Quinn and for a specific purpose of being able to identify what is newsworthy financial information and not. They found that the combination of open source models plus proprietary data got them better results than the most frontier US models. Yep, that is very interesting to me, and like these are the types of things that I'm very curious about. 00:04:03 Speaker 3: Where does is the secret sauce or the alpha actually come from? 00:04:06 Speaker 4: Totally? 00:04:06 Speaker 1: Well, yeah, especially when everyone is going to have access to like really really intelligent models. Anyway, enough talk from us. I'm really excited. We have the perfect guests to talk about this actually understanding the implementation of AI within the investment or asset management context. We're going to be speaking with Gary Collier Man Group CTO, as well as Tushara Fernando, the firm's head of data and AI. So, like I said, really the perfect guests. Gary and Tushara. Thank you both so much for coming on odlogs. Let's start with Gary, or maybe you know, we'll go both of you one after the other. Why don't you just give us a very quick description of your roles at Man Group and what specifically you. 00:04:47 Speaker 5: Do, so when I can start with that, perhaps useful to give a bit of context of the firm. I describe Mangrove really as a full spectro back to asset manager, So full spectrum being recover tips, we cover long only, we cover public markets, we cover private markets, we cover consystematic cover fundamental discretion investing. And we've got a solutions business that can bring all that together into custom client mandates. And what that means in terms of CTO role I described as as like full spectrum too, because all of the above, we're very opinionated in what every part of the text that looks like, right down from choice of servers, networking devices, all the way through to the end user facing pieces of software, and simply left to right. We build an awful lot of our own technology right from the custom data feeds all the way through research frameworks, trading systems, and the middle and back office operating platform So very much force spectrum. 00:05:44 Speaker 1: Role to sure. 00:05:45 Speaker 6: Yeah. 00:05:46 Speaker 7: So on my side, I look after data and AI. So that's everything from market data to alternative data, to all of the context and knowledge that we have that we plug into our AI models. Then from an perspective, it's about how do we give the great capabilities that we now have to our quants, to our researchers and to our fundamental portfolio managers. 00:06:10 Speaker 3: Yeah, Tshara, I wanted to ask you about this because I think your title actually used to be head of Data and Machine Learning and now it's Head of Data and AI, Like, what exactly how do you think about the difference between those two terms machine learning versus AI. 00:06:24 Speaker 7: That's a really good question, and I think it linked to one of the earlier points that you had around whether it was that we were using traditional machine learning techniques or whether we were using generative AI. And I think historically machine learning in a quantum was really about using these more traditional machine learning techniques that were looking at things like linear aggressions, they were looking at neural nets to try to predict some future, whereas. 00:06:55 Speaker 4: Now with the onset of generative AI, is more than that. 00:06:59 Speaker 7: It's really about enablement of people to create things as well as using these traditional techniques. So that's why we've changed the title of the role, because it encompasses both the generative AI aspects as well as the more traditional machine learning methods. 00:07:14 Speaker 2: Okay, that makes sense. 00:07:15 Speaker 3: So if I was sitting within a man group office today and I take Gary laid it out perfectly well, you guys have a lot of different roles, So you have discretionary sort of traditional portfolio managers, and then you have more systematic quants and all of that. But if I'm shadowing one of your traders or pms, and I'm watching what they're doing on a screen today versus what they were doing on a screen in let's say twenty twenty two or something like that, what exactly has changed with the use of generative AI? 00:07:46 Speaker 2: What are you doing differently? 00:07:48 Speaker 5: I think if you were to walk across the floor, you would say different windows, different tools in use now, regardless of role, whether it be trading, quant research, or discretionary investing. And so chatting to a couple of discretionary analysts last week and they're commenting to me on how everywhere you look across the discretionary floor, everybody has got an AI focused like window on their screen, and so it's affecting, improving, like augmenting pretty much every role we have in the firm, of course, in different ways depending on what the role is, but there's no role that's unaffected by AI. 00:08:30 Speaker 1: What are they doing again it Rather than talk about let's say I'm like a sort of traditional long only stock selector, like the sort of classic thing that in our minds we often think of it as an asset manager, and it's like, Okay, I have now access to some of the world's most advanced models. What am I doing with them? 00:08:52 Speaker 7: So if you think about traditionally how PM like that would work. They want to look across broad set of names and they want to get access to as much data as possible for those names. So they want to look at earnings reports, they want to look at broker research, they want to look at alternative data. They want to look at podcasts. But there's only so much time in the day. There's a few hours in the day, and there's fifty names. How are they going to cover them all? How do they get to the really important insight? And what AI has allowed us to do is allowed us to access all of those different types of data, lots of different modalities, podcasts, alternative data, things like broker research reports, and synthesize them into what's actually meaningful so that a PM can asynchronously get that inside. They could go away for a coffee, they can come in overnight and an agent that has actually distilled a change that's happened on the internet and given them the insider's meaningful to their portfolio. 00:10:02 Speaker 4: To their investment pieces. 00:10:04 Speaker 7: So just I suppose an example might be recently we had a PM that was covering the AI trade and really they're one of the important things is about where's the bottomneck? Where's the bottomneck here? 00:10:19 Speaker 4: Yea in is it? 00:10:22 Speaker 6: Yeah? 00:10:23 Speaker 4: And it's hard to know exactly where it is. 00:10:25 Speaker 7: And there was a podcast cast from one of the heads of engineering from a large hyper scaler and he was saying that it was increasingly important to have more and more GPS to train models, but data centers were becoming more scarce, and it was becoming increasingly difficult to find data centers that were actually. 00:10:50 Speaker 4: Big enough to train these models. 00:10:51 Speaker 7: So what you could see there was a couple of things like one that there's GPU scarce see and the other thing is that it's likely that we're going to need better networking between these large data sensors in the future. And that was something that came on a podcast from a head of engineering. This isn't someone who PM would usually interact with. They don't go to the investicles, that're not somebody they often have access to. But through AI, the PM was able to have an AI agent transcribe that podcast that synthesized that data so that they could get better insight into that investment idea. 00:11:28 Speaker 3: Yeah, I feel like podcasts are an important source of Alpha Joe. 00:11:32 Speaker 2: Everyone shall be listening to podcasts, you. 00:11:33 Speaker 1: Know, the non joke version of the which is one of the things I people say, we had Alex Namas on the podcast, and it's like, what's going to be scarceyftter agi. 00:11:43 Speaker 6: Yeah. 00:11:43 Speaker 1: People who are able to get good guests on their podcast. People who are able to get those people, you know. 00:11:49 Speaker 2: Okay, so we're clearly talking our own book. Yes, okay. 00:11:52 Speaker 3: Setting that aside for a second, it sounds like what most of your doing, and when you describe that process is augmenting research, you're allowing your investors, your managers to be more efficient in their research process. There's a lot of talk nowadays about agentic workflows and the actual idea that instead of having humans drive every step of a particular trade or project, you have a system that can you know, do the research. It can generate ideas, it can test the hypotheses, and then it can even execute on them. Is that something that you're sort of working towards or is it still too far away for you guys to even be contemplating. 00:12:32 Speaker 6: No, that's not too far away at all. 00:12:34 Speaker 5: In fact, that's something we've been working on for quite some time now. And if we shift focus to the quant the systematic parts. 00:12:40 Speaker 6: Of the business, what we've been doing now. 00:12:44 Speaker 5: Look, if you take a step back and think, well, technology plus quant techniques, that gives you the ability to build systematic strategies. So what do we get if we add AI in that mix. Well, we have the ability to think about systematizing the way that we build systematic strategies to begin with, and in effect giving a big force. 00:13:08 Speaker 4: Multiplier, big leverage multiplier to our. 00:13:10 Speaker 6: Quants, our researchers. 00:13:12 Speaker 5: So what we've been doing there for well over a year, actually a year and a half is building a system that can actually take all of those different parts of the quant research process. So the idea formation part looking at academic papers, looking at carefully labeled data sets, reasoning about the content of those papers, the content of those data sets, are the economic hypotheses in there that could be real or at least could be worth testing out, and then having other agents build the code to encapsulate those ideas, get the right market data, run the right back tests, etc. And then further agents that evaluate the output of the prior agent. 00:13:59 Speaker 6: So this is. 00:14:00 Speaker 5: Really one of these earlier ideas that we thought would give potentially great bang per book, and we're working on some time and just to make it real, to demonstrate this is not just something that's happening in the lab but doesn't have any real or practical consequences. There's been a bunch I think fifteen twenty models at the last count that had gone all the way through. They started off as models that were ideated by AI, went all the way through the signal construction, the validation process, were reviewed and validated by a human investment committee and deemed fit and proper to trade our client's assets with. 00:14:41 Speaker 6: So this is very real. It's not to make believe at this. 00:14:43 Speaker 1: Point, should you ma mention sort of hoovering up information that might appear on a podcast where someone identifies a particular bottleneck in their business. We are on a podcast. What is your bottleneck? What would you like to have more of right now in order to improve your process? Is it compute? Is it data? Or if you could snap your fingers and have more of something, what would it be, Well. 00:15:24 Speaker 5: You can always use more compute and you can always use more data. But I think what the bigger problem is the world of opportunity that's supported by the AI capabilities that we're seeing and of course being delivered all the time. That envelope is expanding so quickly that keeping up with it from a human perspective can be. 00:15:45 Speaker 6: Like quite hard. 00:15:45 Speaker 5: There's no sources of good ideas. Filtering ideas is important, but of course, whilst we're used to making lots of change mang Group, the level of organizations or change that we need to get involved in to put all of this stuff into effect, I think that's the bottleneck making sure because we're a regulated business, we've got produciary duty. We need to make sure that the things that we're doing, the things were deploying, are done with the minimum amounts of risk. And there's a lot of work in this field that really I think the industry doesn't have firm answers to yet. I mean evaluations testing the results of AI processes are good and proper. That's a rapidly expanding field. Thinking about how we run agents across the business in a safe and controlled fashion. You know, we all, I'm sure have seen and smiled at the well the AI deleted my inbox or the AI deleted all my photos and I can't get them back. We can't afford to have that type of thing happen at an enterprise level. So it's making sure that we can move quickly but safely. I think is the bottleneck if you like. 00:16:56 Speaker 1: Yeah, that makes sense. Let's get into a couple of specifics, and I want to get back to the sort of how you move forward safely. But both of you have now mentioned filtering, and that actually is precisely what I mentioned in the intro. There was a paper from Bridgewater about fine tuning a version of Quen on their own data, precisely for better filtering, so that the pms could just be, you know, have more efficient use of their time to see what signal. How do you build that? Is this an off the shelf thing? What is the tech the model, et cetera that you have to like this ingestion pipeline, like, what is it consist of? 00:17:34 Speaker 6: Yeah, I can say that one. 00:17:35 Speaker 7: So I think for us it really depends on the type of data. There's broadly three types of data that we look at the first one is market data that's often very structured tick data, things like order books. We ingest every tick from most exchanges, almost a terraby of data just from ticks per day. And then we have alternative and unstructured data that is much more messy, it's much more malformed, and there it's really about how we structure the data, how we tag it, how we connect it with each other. 00:18:17 Speaker 4: What's the knowledge layer on top of it. 00:18:19 Speaker 7: How do you think about the connectivity between tickers and sectors and companies. How does AI actually interrogate that data in a way that is uniform. What's the common language between all of those data sets? And then the last piece is really something that's quite new. It's our institutional knowledge, it's our context, and this is becoming a new layer in our data architecture. How do we tell AI about our processes, how do we make it speak mang group, how do we tell it the right way to run a back test? 00:18:57 Speaker 4: So those are really the three areas that we focus on. 00:19:02 Speaker 1: Sorry, just pushing on this point further, Like all of that makes a ton of sense to me, and especially you know the second two or like big problems and we know the generative AI in particular solves a lot of the unstructured data problem. You can actually get a lot of signal from you know, yeah, a bunch of texts dump dumped in a file. But what is what are you building? Like how does it work? And like do you have to can off the shelf frontier models? Are they the best for the job? Do you do your own in house fine tuning of open source models? Like right today? What is the best tech stack for that part of the process. 00:19:42 Speaker 7: So we have historically looked at fine tuning for a couple of cases, but where we're seeing the most bang for our book at the moment is proper tagging and structuring of the data, so pre processing. What we found is, though, if you take a data set like credit card data, for example, AI can look at that, It can see the columns, it can see the rows, but it doesn't really understand the nuances of it. It doesn't really understand what it is. So what we're having to do is invest in trying to add extra color, extra metadata to that information. We want to have descriptors to tell it the nuances. We will say things like when you look at this data set, each row really means that a person has gone into a shop and bought something, and you tell AI that in plain English, you give it those descriptors. 00:20:35 Speaker 4: Yeah, and you do that for all of your data sets. 00:20:38 Speaker 7: And then the second piece is how do you connect lots of data sets together. They use very different language, they use very different semantics. So investing in a shared language is said semantic layer are shared way of doing things is something that we've had to do so that we tag all of the columns with this unified language so the AI can connect different data sets together, because that's really an important thing in idea generation. That knows that a field in one data set is linked to a data set to a field in another data set, it can quickly navigate between tickers and sectors for macro. 00:21:22 Speaker 3: Insight, what do you think is most important having the latest frontier model or a beautiful set of structured, tagged and labeled data. 00:21:32 Speaker 7: Yeah, I'd say it depends on the task that you're trying to do. If you're looking at a coding task, you really want the latest frontier models. But for a quan research task, I think that looking at the underlying data is what fuels alpha research. Trying to just use a frontier model will get you nowhere. 00:21:55 Speaker 1: So this is something that comes up in a lot of our AI deployment questions, and maybe both of you could take this. We have all these different teams, and I assume everybody wants really, including people who don't know much about AI, intuitively think, oh, I want the strongest version of the model. I want to opus four point a, and I want fable whatever. And I assume, okay, yes, for like deep computational tasks or solve engineering problems, coding problems, Yes, probably those are the best, but there are probably a lot of people who do not need anything like that at all. How do you think about the question of internal provision of token consumption and not wasting money by having people use the most advanced models, but also giving people enough green space to explore and figure out what is the maximal potential value that they can get from AI. 00:22:51 Speaker 5: Yeah, the economics questions and interesting one. It's an important one. What we've done there is well, towards the end of last year, when we knew growth was likely to accelerate rapidly, we modeled what we thought the company would start to look like in terms of different classifications of users with different use cases, came up with certain budgets and then what we've done this year is federated that. 00:23:19 Speaker 4: Out to all of the business units within the firm. 00:23:22 Speaker 5: I mean strong believer in pushing decision making down to the also the lowest possible level that it makes sense to do so it allows people to be agile and use the economics at work for them and their departments. And of course budgets are pungible if departments wants to move money from some other spend and say right, I think we should buy more tokens than they are free to do that. And the platform that we've built, the air platform, has a very rich, not one hundred percent complete, but a very very rich set of models that can be chosen, including all of the main frontier models and a number of the different open source open white models. 00:24:03 Speaker 1: Do you build a model that routes queries to the optimal sort of like cost efficient model. I know there's a lot of interest in this. The sort of classifiers and the big AI labs have them themselves, but the classifiers that route queries, is that something that you built that you have in house or how do you solve their problem. 00:24:23 Speaker 4: We could do that we've chosen not to. 00:24:25 Speaker 7: I think that the reason is that we want people to understand the dynamics of how best to use AI and which models to use. Okay, So what we've leaned on instead is education. So we have a very rich data set of how people are using AI, so you have great insight, and some of the things that we saw were just quite basic mistakes. 00:24:48 Speaker 4: So often people would be doing multiple tasks in the same context window. 00:24:54 Speaker 7: They'd be trying to figure out the best way to write an investment thesis, and then they were trying to figure out where to go to lunch, and then they were trying to ask. 00:25:03 Speaker 2: Fable what the weather will be tomorrow. 00:25:05 Speaker 4: Yeah, exactly, And that is. 00:25:09 Speaker 7: I suppose, like a well known problem if you're in the weeds of AI. But we have seventeen eighteen hundred people at my group, and the technical understanding of how things work at a fundamental. 00:25:22 Speaker 4: Level is varied. So we've been really focusing on education. 00:25:26 Speaker 7: We're very transparent about the budgets that people have and how they're being spent, and we talk to them about the different classes of models, and it's through that that we have seen better results and we've actually seen people finding quite creative ways to reduce token spend and contributing that back to the platform. 00:25:51 Speaker 4: As a result of it. 00:25:52 Speaker 2: Wait, say more about that. 00:25:54 Speaker 4: So, for example, if. 00:25:56 Speaker 7: You are using a coding agent and you want to do some basic get commands to interact with the version control system, often the coding agent will send the command, it will process the entire result that comes back from that command as tokens. Instead, there's some really simple tools and simple basic steps that you could use the instead of calling an LLLM to do inference and tool calls, it can just intercept that tool call and do it outside of the agentic loop. 00:26:30 Speaker 3: If I was looking at a chart of your overall token consumption, what would I mean? I assume it's upward sloping despite some of these efficiency efforts, but like how steep is the slope at the moment? 00:26:43 Speaker 7: So since January, I think token consumption has gone up eighty six times. 00:26:50 Speaker 2: Wow. 00:26:51 Speaker 7: So it's really really quite quite incredible. We were not expecting usage to be the way there has been, and it's been across the board where it's not just been in the tech and tech adjacent departments. We have seen people in finance, people in operations, people in the people team using agentic coding workflows, and as a technologist, that's just super exciting to give this new capability, this new power to people who haven't been able to use it before. 00:27:23 Speaker 1: Well, this actually gets the question that I've been wondering about, and it definitely feels like December and January we're just like a very pivotal period. And from your perspective, that sharp inflection point up, how much was it driven by the capability of the models themselves, whether going from an opus four point seven or four point five to four point six and beyond, or this sort of discovery of these very high quality harnesses like a cloud code or cowork or whatever. I think that's what it's called. That really allows someone to do things with AI that are beyond asking questions and actually manipulate real work. The model or the harness, which would you describe as the key driver of that huge acceleration. 00:28:12 Speaker 6: I think the two are couple. 00:28:14 Speaker 7: I think one of the interesting benchmarks to look at for this is a benchmark called meter and what that tries to do is it looks at tasks that humans would do for different time periods from a couple of minutes to many hours. And what we're seeing is that every seven months or so, the amount of time that an ergentic workflow can go away and do a task is doubling. So now you can ask an agent to do a task that would take a human sixteen hours, and that changes the way that you think about teams. It changes the way that you think about interacting with these agents. 00:28:54 Speaker 4: You go from a place where you're. 00:28:58 Speaker 6: In the loop. 00:28:59 Speaker 7: You're sking an agent to solve a problem like writing a unit test, to a problem like building an entire feature of an application, or an entire application in itself. So I think it's the scalability that has allowed larger tasks to be completed. There's resulted in larger token usage. 00:29:39 Speaker 3: I want to go back to I guess the oversight question. And we all know that finance is highly regulated environment and you've touched on this earlier, but you're still approving a lot of these model outputs through humans, So there's some oversight there. And I would assume that when you're approving, if a human is improving a new model or an output, that they have to understand what's actually coming out of it, right, there has to be some explainability there. If I'm a PM or I don't know, a quant sitting in front of a risk management committee or a regulator, what does explainability actually look like? And how am I translating the model outputs into something that is understandable and also I guess defensible. 00:30:28 Speaker 6: Yeah, you're right. 00:30:29 Speaker 5: Explainability is super importance to us. And to be clear, the sort of business that we're in is not the high frequency trading business where people are constructing huge neural nets and looking through like multi dimensional spaces and the output not being at all in serviceable. We're not in that space trading and holding period horizons specifically days to weeks, two months, so all of our trading decisions are ultimately explainable. We never want to be in a position where we don't know why that trade happened. 00:31:05 Speaker 6: The AI did it. 00:31:07 Speaker 5: And going back to some of the things that we talked about earlier, take the example of the AI coming up with brand new trading hypotheses based on what it's seen in terms of content of a data set, what it's seen in the content of an academic paper, and the model will go as far the system, the agent goes far as naming and writing the investment hypothesis. 00:31:31 Speaker 4: It's one of the first things it does before it moves on to writing codes. 00:31:35 Speaker 5: It's giving us a real English description of what it thinks. The rationale for the trading signal is I'm curious. 00:31:45 Speaker 1: You know, obviously we haven't even gotten to the question of like what is the future of labor and the humans in the loop and how many humans in the loop will we need in the future. But one thing I'm curious about is a way to ask this question differently. Has AI allowed you to look at markets that you wouldn't have had the bandwidth before. So, for example, I'm at, you know, let's take the Ethiopian stock exchange or something like that. There's a certain amount of human labor that would be required to gain any familiarity with it whatsoever, setting aside everything else, And no matter how much potential profit there is in say frontier market, there is a minimum amount that's going to cost and that might take some investment opportunities off the board because the potential profit isn't big enough to justify the spend to getting up to speed. This strikes me as something that AI could potentially help with or solve for of creating a new opportunity set by reducing some of the upfront human labor costs. Is that something that you think about or have seen specifically so far in terms of Man group, I. 00:32:54 Speaker 5: Think it's likely happening incrementally at the margins if we start to sum up all of the different micro augmentations that we see across the firm. 00:33:04 Speaker 6: For example, and here is a related one, someone had. 00:33:08 Speaker 5: Built a relatively simple aisystem to take data from complex instruments, PDFs, specifications and automatically populate our reference data store with that. So yes, I think it's it's absolutely happening, but it's just some of a lot of different parts across the firm. 00:33:28 Speaker 7: I think what was seeing as well in the systematic space is that you need a few prerequisites to build a systematic strategy. You need to have some connectivity to trade the instrument, and you need to be able to understand what the price of the market is. Those are two real fundamental things, and for developed. 00:33:49 Speaker 4: Markets that's really easy you go and look at. 00:33:51 Speaker 7: The order book, but for less developed markets, things like cryptosecuritized credit, they're often harder to can too. There may be traded more verbally, or the contracts are complicated and it's difficult to understand the price where there's these unstructured data nuances in the derivation of that price. We've seen that AI allows us to think about accessing that market in a systematic way earlier than we could before. 00:34:26 Speaker 3: Just going back to the labor market side of things, I guess you know if I'm a PM at Man Group, and more and more of my job is using AI for research or even basically supervising agents that I maybe help develop. What does that mean for what you're looking for in terms of talent? Are you looking for engineers who can tweak these models? Are you looking for more traditional investors who I guess have stronger intuition about how these things might play out, or some sort of combination of characteristics. 00:35:01 Speaker 2: What do you look for now? 00:35:03 Speaker 5: I think very fair to saying this is something I've been making a strong caseful that everyone we hire now into the firm should up the bar with respect to AI, regardless of the role that they're coming in to do. And I think that applies as much in the operation space as it does in the front office space. 00:35:27 Speaker 1: What does that mean? 00:35:27 Speaker 6: So? 00:35:27 Speaker 1: What like someone like Okay, I'm capable of upping the bar with respect to air like, what does that say more about Okay? In the recruiting process, what does that person look like? 00:35:40 Speaker 5: That means being as familiar with the technology as you could reasonably expect a person to be, given the wealth of information that's out there. When I'm when I'm hiring people, you know what sort of people don't want. I want bright people, and I want people who are motivated, They get things done and passionate about the subject matter their field of expertise. And I think it's very hard to fulfill all of those criteria chicking nowadays and say, well, you know, AI, I don't know much about it. I don't really use it as part of my job. 00:36:16 Speaker 6: Yeah. 00:36:16 Speaker 7: I think the other piece that you want is somebody who's a bit more of a long term thinker, somebody who really wants to automate a process from end to end. They are happy not to be in the weeds in the loop, And when you think about technologists, that's actually quite difficult. People love being in the weeds, they love debugging issues, getting into the nitty gritty, but actually, fundamentally, you want to level up. 00:36:43 Speaker 4: You want to be a kind of a conductor of these agents. 00:36:48 Speaker 7: You want to be in charge of the end to end process rather than necessarily being in the weeds, almost like a manager who has a lot of technical expertise, so who is thinking about things in broader strategic terms is much more value than they used to be. 00:37:07 Speaker 3: So this leads to the other thing I wanted to ask, which is you could see the arrival of AI tools generating like two different outcomes here, where you have some people who are just really really good at using AI and they become superstars and orchestrators of a bunch of different agents, as you put it, or you could have this sort of democratizing effect where maybe you're a junior employee with not as much experience, but now you can automate a bunch of tasks, you can learn from AI, you can use it for research and things like that. What are you seeing more of at the moment, the superstar dynamic or the democratization of skill sets throughout man group. 00:37:48 Speaker 5: I think we're saying both genuinely both, I think given the size of the firm, though with saying more of the latter, I mean, as I said at the start of the chat almost or everybody using it to day to day, but examples of huge, genuine right at the cutting edge of thinking. I think they're naturally more rare, but there's a fair view of them, even saying that. 00:38:14 Speaker 4: They often cut across multiple teams as well. 00:38:17 Speaker 7: And that is hard because you need to move from a space where you spend most of your time executing to a space where you spend most of your time planning. The time to execute is just going down and down. It's becoming cheaper and cheaper to do that. You can build code, you can build features very quickly, so the focus really needs to be on what should we build, how does it connect together, and what is the process that we want to develop across multiple teams. And it's very difficult sometimes to take people out of the seat and get them to collaborate and plan a workflow rather than just going and trying to build a proof of concept and execute on the idea. 00:39:03 Speaker 1: Let's talk more about the eighty six x increase in token spend. If we were having this conversation back in February or January, a lot of the chat would have been very much about like, what does this mean for legacy software? Companies because that's when the big software company software is all off was you know, really was quite intense. But I feel like this conversation in July is becoming like, no, these companies are not going after the world of software, They're going after the world of labor. And you see a lot of these conversations like people talk about the ratio of token spend to employee salaries, et cetera, and that that is the tam that it's like all human labor, and maybe we're not going to get there for a while. 00:39:47 Speaker 4: I kind of hope not. 00:39:49 Speaker 1: But is token spend part of your tech budget or is it like something that is a true line item that's distinct, that's more on par with labor. And when you think about Man Group in twenty two, twenty seven, twenty twenty eight, do you talk about expected ratios of salaries to token spend. 00:40:08 Speaker 5: We genuinely haven't started having that conversation yet. I mean, I would get at some point it will come, And the company is set up in such a way that we want to direct resources to where they produce the best economic outcome for us. 00:40:25 Speaker 6: So I'm sure that time will come. 00:40:28 Speaker 7: One of the interesting things in the token budgeting process. I suppose is that what we're increasingly seeing is that the spend is actually not by people, is by agents, and the agents relate to workflows, and who owns the workflows? 00:40:46 Speaker 4: Is it this department? Is it that department? 00:40:48 Speaker 7: And that's a new problem for us, one that we haven't solved yet, but it's a great problem to have. 00:40:55 Speaker 3: I brought up earlier, those sort of machine learning parallel I guess, and I know you guys don't do a lot of high frequency trading, but we've certainly seen a dynamic in HFT where everyone's competing and it's sort of a race to the bottom where I. 00:41:10 Speaker 2: Can't even remember where we where we're at. 00:41:12 Speaker 1: In terms of like micrometers. 00:41:13 Speaker 3: Yeah, in terms of second increments or time increments, but it's the sort of race to the bottom dynamic. Would you expect AI driven alpha to get sort of competed or arbitraged away relatively quickly as everyone seems to be hopping on the same bandwagon, or are there certain advantages you know, we talked about data for instance, scale perhaps that you would expect to stick around for some time. 00:41:42 Speaker 7: Yeah, I'd say it goes back to your question around where is the alpha? And what is true is that it is easier for people to onboard data sets, analyze them, and build features, But that doesn't mean that they can trade them. We've been doing this for decades. So what we have are capabilities to actually access these markets. We have the relationships with the brokers, We have access to data that isn't just available off the shelf. So it's putting all of those things together, putting those expertise together, the access to markets, all of the data that we have, the rich market data, and then giving AI access to the capabilities such as back testing, compute. It's this whole network, this whole ecosystem that together I think drives alpha. There isn't one code, repository and man group that I can point out and say that's where the alpha is. It's really this network of different systems that interact with each other. So I think the definitely some features of data sets will become table stakes. They go from being alpha to being a risk factor. But because everybody has them and it moves the market, but it isn't the only way that we make money. We are able to connect different data sets, different ways of doings together and then actually trade on those signals. 00:43:11 Speaker 1: Garry, I want to go back to something you said earlier when we were talking about bottlenecks, and it's like, sure, everybody wants more data, everyone wants more compute, No one would complain about these things. But where the rubber meets the road is like, does the institution have the capacity to actually maybe from a cultural standpoint, a sort of hierarchy standpoint, to actually get the most out of these tools. And this is clearly a very hot area. And so for example, just last week, Microsoft announced a new thing which they're calling the Frontier Company, which is basically a new like sort of subdivision that seems to want to specifically solve this problem, go into an organization and figure out this optimal structure. And you know, arguably this is even like what a company like Pallenteer is trying to do, which is, you know, there deployed engineers. We know about Claude sending or Anthropics sending engineers inside Goldman Sachs to really leverage I hate using that word because it's so cliche, but yes, leverage these tools. What specifically are you seeing happening on that front. Do you have third party companies who are coming to you and saying, look, we can work with you to find what is the org structure of the future for man group such that it's getting the most out of these tools for a long time. 00:44:32 Speaker 5: Yeah, I did smile at the multi billion dollar for deployed engineer and division that you just mentioned, partly because I mean that's the way we've been like set up internally here for about. 00:44:45 Speaker 6: I think fifteen years. Same. 00:44:47 Speaker 5: We're very big on We're very big on platforms, and we've got a bunch of teams and Tashara runs one of those that build out these big cross cutting elements of platform technology, in his case the Data iplatform, but a big part of the tech team are already and having for a decade and a half forward deployed engineers sitting with our quants, sitting with our discretionary managers. And one of my jokes often the people I'd be interfering to come join the team is all right, let's go walk across the fifth floor here in the bank House, and I want you to tell me who the engineers are and who the quants are. And I bet you're going to get it wrong, because what you'll see is very similar stuff on the screen, and that holds just as true today as it did decade ago. 00:45:34 Speaker 1: One last question, but another thing I'm curious about in the investment context. So we know that AI works when there's a big pool of data, and then it can pull in the unstructured data and the structured data, et cetera, and communicate across them. In an entity such as man Group, are there any alignment issues in which you know, if I have a subject better expertise that generates alpha, this might be why I have a seat at an organization, or I might be a rain maker. You know you hear this at all kinds of different firms where compensation is linked to someone's like deep expertise in some area, do you think about alignment so that the firm, the franchise Man Group is actually capturing some of the expertise and data of the superstar. How do you get them to sort of, I guess, contribute as much information as possible to this thing that requires a lot of data and information. 00:46:40 Speaker 4: I think in some areas that's still a little bit of a work in progress. 00:46:44 Speaker 5: That's saying in some areas because in others, notably the systematic, the quant areas of the business. This highly collaborative approach and shad code basis. That's just been the way that those areas have worked for a long time. 00:47:00 Speaker 4: Now. 00:47:01 Speaker 5: I'm not saying that you walk across the discretionary part of the flaw and all of the fundamental investors are going to be quite so free and open. I've talked to a bunch of them about their processes, and you know, they're open with ninety percent, but there's the ten percent. Well, you know, this is where my personal value add lives. I'm not so comfortable talking about about that. But even that said, there's a very decent and genuine amounts of collaboration there as well. And it's only when you get perhaps to the very sensitive areas that people might be. 00:47:34 Speaker 6: A little bit more reluctant to talk. 00:47:37 Speaker 7: Yeah, I think the high level there's a huge amount of shared workflows. If you think about the way that we baptest, the way that you read an investment report, these are all workflows that are people's expertise, but they're not necessarily the ten percent that produces the returns. So those areas are encapsulated in AI playbooks, AI skills that we put in our knowledge platform and they can be used across the floor, whereas some of the particulars around how the strategy works and the investment pieces somewhat held back in certain cases. 00:48:16 Speaker 1: It makes sense, all right, Gary and Toshara, thank you so much for coming on. Odd lad, really appreciate your taking your time and talk about where you're at. 00:48:24 Speaker 6: Thank you. 00:48:24 Speaker 4: I'll pleasure pensilup. 00:48:38 Speaker 6: You know what. 00:48:38 Speaker 1: I think it was really interesting about their conversation and part is like there is so much to figure out still, right. 00:48:45 Speaker 3: I mean just the basic token budget and like where stuff that's allocated. 00:48:48 Speaker 1: Like eighty six x in since January is pretty crazy. 00:48:52 Speaker 3: Well, this is the other thing I was thinking, like eighty six times growth in token usage, Like at some point that needs to show up in another on crete number, whether it's expense reduction or revenue generation income generation. 00:49:06 Speaker 2: And I don't know how much like leeway there. 00:49:09 Speaker 6: Is for that. 00:49:09 Speaker 1: No, and you figure, like right now, so you have this eighty six x explosion, but as they say, there's still in the moment where they haven't gotten to We wanted to build like an internal router to minimize this. So even with the eighty six they're still in the phase where it's okay, you know, figure out what model you want to use an experiment, et cetera, which to my mind is actually kind of bullish if you think about it. For token spend that you can grow eighty six x and it still doesn't get you to the point where like, oh, we got to really like clamp down on this, Like maybe you know, who knows like what the point is for a lot of firms that are just starting out where they actually have to start imposing some token austerity. 00:49:52 Speaker 2: I guess we'll find out at some point. 00:49:55 Speaker 3: But the other thing that stood out to me, you know, you asked the question about how do you get how do you at workers to give up their own sauce that basically is responsible for them having a job in the first place. 00:50:07 Speaker 2: Key stroke surveillance solves all of this, right. 00:50:10 Speaker 1: Yeah, you know those articles I have to say, you need them to offer it up. 00:50:16 Speaker 6: You just I. 00:50:18 Speaker 1: Have to say. There was some story that came out a while back about OMETA it was going to start using like training its models on its own, and I was like, they weren't doing this already, Like I was actually like really surprised that this wasn't already. 00:50:32 Speaker 3: Especially in finance and investment, which is a highly regulated industry already and I'm sure is monitoring pretty much everything anyway. 00:50:40 Speaker 1: Yeah, I kind of assumed that all of these companies are really building models, were already using all of the data that their own employees were generating. But yeah, you have to like, oh, does the person does the rain maker suddenly just start writing everything down on pen and paper. They're not implicitly uploading all of their knowledge to the AI. I think that's a pretty interesting question in itself. 00:51:03 Speaker 3: All right, clearly lots of interesting questions. 00:51:06 Speaker 1: But shall we leave it there for Let's leave it there. 00:51:07 Speaker 6: Okay. 00:51:08 Speaker 3: This has been another episode of the Audthoughts podcast. I'm Tracy Alloway. You can follow me at Tracy Alloway. 00:51:13 Speaker 1: And I'm Joe Wisenthal. You can follow me at The Stalwart. Follow our producers Carmen Rodriguez at Carmen Arman, dash Ol Bennett at Dashbot, Calebrooks at Kelebrooks, and Kevin Lozano at Kevin Lloyd Lozano. And for more Odd Loge content, go to Bloomberg dot com, slash od lots or of a daily newsletter and all of our episodes and you could shout about all of these topics twenty four to seven in our discord discord dot gg slash hodlogs. 00:51:37 Speaker 3: And if you enjoy od loots, if you like it when we talk about how finance firms are actually implementing AI, then please leave us a positive review on your favorite podcast platform. And remember, if you are a Bloomberg subscriber, you can listen to all of our episodes absolutely ad free. All you need to do is find the Bloomberg channel on Apple Podcasts and follow the instructions there. 00:51:56 Speaker 2: Thanks for listening 00:52:14 Speaker 6: It in