WEBVTT - Using AI for Fiction Writing 0:00:01.360 --> 0:00:04.560 Welcome to Unsupervised Learning, a security, AI and meaning focused 0:00:04.559 --> 0:00:07.320 podcast that looks at how best to thrive as humans 0:00:07.480 --> 0:00:11.520 in a post AI world. It combines original ideas, analysis, 0:00:11.520 --> 0:00:14.760 and mental models to bring not just the news, but 0:00:14.760 --> 0:00:17.600 why it matters and how to respond. All right, welcome 0:00:17.600 --> 0:00:19.720 to unsupervised learning. This is Daniel Miessler. All right. I 0:00:19.720 --> 0:00:24.000 want to talk about writing fiction using AI today. And 0:00:24.000 --> 0:00:26.480 I want to show a couple of different things that 0:00:26.480 --> 0:00:29.680 I'm thinking about this both for current use and also 0:00:29.840 --> 0:00:32.360 where I think all of this is going. So I 0:00:32.360 --> 0:00:36.200 want to start off with talking about LM studio. So 0:00:36.240 --> 0:00:38.560 LM studio is what I'm going to use for this. 0:00:38.560 --> 0:00:40.640 I'm also going to talk a little bit about how 0:00:40.640 --> 0:00:43.560 to do this in Olama, but I want to focus 0:00:43.560 --> 0:00:46.159 on LM studio because it's a little more visual. I 0:00:46.159 --> 0:00:49.400 think it's a little easier to get into. So LM 0:00:49.400 --> 0:00:52.199 studio is an app. You can just go and download it. 0:00:52.200 --> 0:00:57.280 It's like LM studio dot AI or.com. I'm not sure exactly. 0:00:57.520 --> 0:00:59.900 It doesn't really matter if you search for LM studio, 0:00:59.940 --> 0:01:01.220 you're going to find it. It's going to be the 0:01:01.220 --> 0:01:04.140 first thing you see. So you download that. I'm on 0:01:04.140 --> 0:01:06.740 a mac. I think it runs on lots of different things, 0:01:06.740 --> 0:01:09.860 but it's mostly Mac friendly, I think. All right. So 0:01:09.860 --> 0:01:12.060 you're going to download that. And what this does is 0:01:12.060 --> 0:01:16.220 it allows you to download different models. Now if we 0:01:16.260 --> 0:01:21.380 come over here to the internet we have basically um, 0:01:21.420 --> 0:01:25.060 hugging face is a place that I really, really enjoy 0:01:25.260 --> 0:01:27.620 going to get models is the place you want to 0:01:27.620 --> 0:01:30.740 be using for this type of thing, because it allows 0:01:30.740 --> 0:01:33.780 you to download and mess with lots of different models. 0:01:33.780 --> 0:01:38.260 And if we actually go to just the models directory here, 0:01:38.260 --> 0:01:42.860 look at this. Over 1 million different AI models are 0:01:42.860 --> 0:01:45.820 now available and these are all open source. You can 0:01:45.819 --> 0:01:49.180 just download and mess with these however you want. So 0:01:49.180 --> 0:01:54.020 what I did was I went and looked on Reddit 0:01:54.020 --> 0:01:56.700 and said, hey, I want to write some fiction. I 0:01:56.700 --> 0:01:59.370 want to be able to write long stories, and I 0:01:59.370 --> 0:02:01.290 want them to be high quality and blah, blah, blah. 0:02:01.330 --> 0:02:05.450 I basically said, hey, what's the best models, you know, 0:02:05.450 --> 0:02:08.810 open source models available today that you could use to 0:02:08.850 --> 0:02:12.530 write decent fiction? And they came back with a whole 0:02:12.530 --> 0:02:15.530 bunch of answers. Um, and I tried a bunch of 0:02:15.530 --> 0:02:18.010 them and we'll see them in the list a little 0:02:18.010 --> 0:02:20.209 bit later on. But so this is one I kind 0:02:20.210 --> 0:02:23.290 of settled on. Uh, we'll just go with this. There 0:02:23.290 --> 0:02:27.530 might be better ones. There might be. There's definitely worse ones. Uh, 0:02:27.530 --> 0:02:29.769 but this has got a few things that are pretty interesting. 0:02:29.770 --> 0:02:37.770 First of all, it's uncensored. So violence, uh, like romantic stuff. Um, 0:02:37.810 --> 0:02:41.690 you know, spicy stuff, essentially. Uh, any sorts of combat, 0:02:41.810 --> 0:02:45.490 things like that, that might be, um, blocked by, like 0:02:45.530 --> 0:02:49.649 a standard llama model, uh, or a standard open AI 0:02:49.650 --> 0:02:54.010 model or whatever. Well, first of all, those OpenAI, you'd 0:02:54.050 --> 0:02:55.970 be charged for it. Second of all, there's lots of 0:02:55.970 --> 0:02:59.310 lots of restrictions on them which make them potentially like. 0:02:59.510 --> 0:03:03.630 I don't think Harry Potter would pass the filters for 0:03:03.630 --> 0:03:06.230 a commercial model. So you got to think about like, 0:03:06.270 --> 0:03:09.270 that's the reason we're using open source models. Second reason 0:03:09.270 --> 0:03:12.350 is because they're free. Other than you have to have 0:03:12.389 --> 0:03:15.470 a machine that can run them. But other than that 0:03:15.510 --> 0:03:19.389 it's like producing stuff for you for free. So that's 0:03:19.389 --> 0:03:21.590 the reason we're using open source models. And they keep 0:03:21.590 --> 0:03:25.510 getting better and better and better. So this particular model 0:03:25.510 --> 0:03:30.429 is based around llama three, llama 318B in struct. And 0:03:30.430 --> 0:03:33.110 the context size is quite large. So that's what we 0:03:33.110 --> 0:03:36.270 like about this. It's quite large. In fact, the one 0:03:36.270 --> 0:03:38.630 I'm going to show you might even be larger than 0:03:38.630 --> 0:03:44.030 that might actually be like a 32,000 context or even more. 0:03:44.670 --> 0:03:48.350 And a lot of big models are 128 K contexts. 0:03:48.350 --> 0:03:50.870 But I mean, it goes even higher than that. And 0:03:50.870 --> 0:03:53.830 the reason you want a big context is so that 0:03:53.830 --> 0:03:56.170 it understands all the parts of the story. When it 0:03:56.170 --> 0:03:59.050 gets ready to create a new scene, or a new chapter, 0:03:59.530 --> 0:04:02.210 or even a new paragraph or whatever. It has to 0:04:02.250 --> 0:04:05.050 understand what has already happened in the story, for it 0:04:05.050 --> 0:04:09.090 to have what it writes actually be cohesive with that, right? 0:04:09.570 --> 0:04:14.650 So that is basically about that with the model itself. Um, 0:04:14.650 --> 0:04:16.570 and what we're going to do is I'm going to 0:04:16.570 --> 0:04:21.210 pull down a model. Actually, I already have it downloaded, uh, 0:04:21.210 --> 0:04:23.930 which is pretty easy to download these as well. That's 0:04:23.930 --> 0:04:25.890 not a thing I'm going to do a tutorial on, 0:04:25.890 --> 0:04:29.010 because it's just super simple, and all you have to 0:04:29.010 --> 0:04:32.210 do is look at a tutorial on LM studio or 0:04:32.250 --> 0:04:34.770 like it'll just guide you through it. It's no big deal. 0:04:35.130 --> 0:04:37.850 But anyway, I've got all these different models downloaded. What 0:04:37.850 --> 0:04:40.609 I do want to show you is how to configure it. Okay, 0:04:40.650 --> 0:04:43.930 so there's a few different ways to configure, um over 0:04:43.930 --> 0:04:46.169 here on the side. So down here in the bottom 0:04:46.170 --> 0:04:47.810 left let me show you this down here in the 0:04:47.810 --> 0:04:50.530 bottom left this says user, this says power user this 0:04:50.529 --> 0:04:54.440 says developer. And by the way they change. LM studio 0:04:54.600 --> 0:04:58.039 a decent amount. So like the interfaces kind of moves around. 0:04:58.200 --> 0:05:00.800 I imagine that's going to calm down soon, but it's 0:05:00.800 --> 0:05:02.800 a little bit annoying right now because I keep coming 0:05:02.800 --> 0:05:07.760 in here and like they've moved menus and stuff, but, um, 0:05:07.920 --> 0:05:10.480 either way, I like to keep it on developer or 0:05:10.480 --> 0:05:12.560 power user. And for the purpose of this video, I'm 0:05:12.560 --> 0:05:14.880 going to be on Power User. And so now what 0:05:14.880 --> 0:05:16.560 you have is this interface over here. You have the 0:05:16.560 --> 0:05:18.680 name of the chat here in case you have a 0:05:18.720 --> 0:05:21.800 lot up here at the top, you have um, let 0:05:21.800 --> 0:05:24.120 me see if I can make the size bigger. Oh yeah. Cool. 0:05:24.480 --> 0:05:25.719 All right. I'm going to make the size a little 0:05:25.720 --> 0:05:28.719 bigger just for the video. Um, you have the name 0:05:28.720 --> 0:05:31.800 of the model up here, and if you pull those down, 0:05:31.800 --> 0:05:34.320 you have the different models you can switch to. And 0:05:34.320 --> 0:05:38.080 the one I'm using here is actually, uh. Yeah. Dark 0:05:38.120 --> 0:05:43.320 idol two one, uncensored 32. Okay, cool. So that's another one. 0:05:43.680 --> 0:05:45.880 And you see all these different ones, right? They're all 0:05:45.920 --> 0:05:48.520 kind of story based because that's kind of the the 0:05:48.520 --> 0:05:51.120 route I was going down. But anyway, you can see 0:05:51.120 --> 0:05:54.140 that there. And look at this. This is really important. 0:05:54.339 --> 0:05:59.060 This right here. Context. 131 072. Okay. So what I'm 0:05:59.060 --> 0:06:00.219 going to do is I'm going to go over here 0:06:00.220 --> 0:06:03.580 to models and I'm going to look at this one. 0:06:03.580 --> 0:06:05.460 Is it this one. Yeah I think it is. And 0:06:05.460 --> 0:06:09.060 I'm going to click on here and look at this 0:06:09.620 --> 0:06:12.940 I'm going to slide this up okay. I'm going to 0:06:12.940 --> 0:06:16.060 slide this up to like whatever that. And um I'm 0:06:16.060 --> 0:06:20.339 going to say close. And yeah so that basically moved that. 0:06:20.339 --> 0:06:23.660 And now if I reload it which I already did before. 0:06:23.660 --> 0:06:25.659 So it's going to show that value. But the point 0:06:25.660 --> 0:06:29.300 is you go to models and you could change parameters 0:06:29.300 --> 0:06:31.340 of how big of a size you want to use 0:06:31.339 --> 0:06:33.780 for these different things. Right. So let's click on this one. 0:06:33.779 --> 0:06:37.060 Look at this okay. We're at 131. We can move this. 0:06:37.060 --> 0:06:39.980 We can slide it around right. So that's the whole point. 0:06:39.980 --> 0:06:42.380 And once you do that when you reload that thing 0:06:42.380 --> 0:06:45.100 it's going to be in the new configuration. So that's important. 0:06:45.140 --> 0:06:47.299 All right. So now let's get into the the basic 0:06:47.300 --> 0:06:52.720 concept here. Um And this is both a technical tutorial, 0:06:52.720 --> 0:06:55.520 but it's also me telling you what I think is 0:06:55.520 --> 0:06:59.920 about to happen with writing. Okay. Uh, so so let's 0:06:59.920 --> 0:07:03.480 get into that first. The difficulty of writing a long 0:07:03.480 --> 0:07:06.560 story is that you have so many things going on 0:07:06.560 --> 0:07:10.280 at once. Okay. You have a setting you're trying to 0:07:10.280 --> 0:07:12.440 get through. They're like, I'm going to use Harry Potter 0:07:12.440 --> 0:07:15.320 a lot. I think it's a it's a good example. 0:07:15.440 --> 0:07:18.920 So Harry Potter, you have like the school experience. You 0:07:18.920 --> 0:07:23.000 have like the orphan experience. You have like going into 0:07:23.000 --> 0:07:25.400 the school and the school is so big and there's 0:07:25.440 --> 0:07:27.760 ones and there's a sorting hat and there's just like 0:07:27.760 --> 0:07:32.200 this feeling of of adventure and magic and like the 0:07:32.200 --> 0:07:34.800 size of the castle. I think it's a castle. Is 0:07:34.800 --> 0:07:37.800 it a castle? Yeah. The size of the building or whatever. 0:07:37.800 --> 0:07:42.320 The school. It's like all that stuff is, like, really, 0:07:42.320 --> 0:07:46.360 really powerful. So the scene, the setting, the vibe. Right. 0:07:46.360 --> 0:07:49.510 That's one element. And if you do that really well, 0:07:49.830 --> 0:07:53.350 like it's memorable. Okay. Then you have characters. So you've 0:07:53.350 --> 0:07:56.750 got these different characters. You've got the orphan. You've got 0:07:56.750 --> 0:08:00.470 the smarty pants person. You've got the troublemakers, which are 0:08:00.470 --> 0:08:03.790 the brothers. And so you've got all those components of 0:08:03.830 --> 0:08:06.510 the of the characters. And if you read a book 0:08:06.630 --> 0:08:09.710 something like the Art of storytelling, which is my favorite 0:08:09.710 --> 0:08:13.350 book on fiction writing, by the way. Um, although I 0:08:13.350 --> 0:08:16.510 think might apply to nonfiction as well. But anyway, it's 0:08:16.510 --> 0:08:21.390 it's a fantastic book and it talks about character change. Okay. 0:08:21.670 --> 0:08:24.750 So if you're an author and you're thinking about your characters, 0:08:24.750 --> 0:08:27.990 you're thinking about how they start off, how they change 0:08:27.990 --> 0:08:30.190 over time and how they end up at the end, 0:08:30.790 --> 0:08:33.550 that's a huge part of the story. Okay. So now 0:08:33.550 --> 0:08:36.390 you have setting and these aren't in any particular order. 0:08:36.390 --> 0:08:38.670 By the way, if I were to say anything were 0:08:38.670 --> 0:08:42.710 most important it would probably be characters. Um, but anyway, 0:08:42.710 --> 0:08:46.670 you have characters, you have a setting, then you have plot. Okay. 0:08:46.710 --> 0:08:48.929 So you've got plot, which is like, what are the 0:08:48.929 --> 0:08:51.290 things that happen? What is the like the the ups 0:08:51.290 --> 0:08:54.650 and downs, right. Then I would say as maybe a 0:08:54.690 --> 0:08:57.130 sub piece of the plot. And by the way, I'm 0:08:57.170 --> 0:09:00.730 not putting this out as an expert sort of analysis 0:09:00.730 --> 0:09:03.290 of the components of a story. I might do a 0:09:03.290 --> 0:09:05.690 piece on that, but even then I wouldn't be an expert. 0:09:05.890 --> 0:09:08.610 I would say the expert is go read this book. 0:09:09.250 --> 0:09:13.610 It's not specifically about this breakdown of stories, but, um, 0:09:13.610 --> 0:09:17.050 I am thinking about doing a breakdown just like this. Um, 0:09:17.250 --> 0:09:18.810 just so I can have it in my own mind 0:09:18.809 --> 0:09:21.370 so I could actually put better input into the AI 0:09:21.410 --> 0:09:24.210 to do this. But, um, I would say that a 0:09:24.210 --> 0:09:28.410 component of the, um, the plot is going to be 0:09:28.530 --> 0:09:31.290 the mystery. So this is one thing that I'm going 0:09:31.290 --> 0:09:33.210 to have in all of my prompts when I go 0:09:33.210 --> 0:09:36.690 to work on this, and even when I'm writing just 0:09:36.690 --> 0:09:39.449 completely by myself and I'm not using the AI during 0:09:39.450 --> 0:09:42.090 that period, I am always going to be thinking about 0:09:42.090 --> 0:09:45.329 these things. In fact, I plan when I write my 0:09:45.330 --> 0:09:47.840 first fiction book, I'm going to have a giant whiteboard 0:09:48.040 --> 0:09:51.440 and I'm going to have these listed as layers. Okay. 0:09:51.480 --> 0:09:53.720 At the bottom I'm going to have like this deep 0:09:53.720 --> 0:09:57.640 mystery layer. Okay. So in Harry Potter, one of the 0:09:57.640 --> 0:10:00.000 very first scenes, I can't remember how early it is. 0:10:00.000 --> 0:10:02.480 One of the very first scenes is someone comes in 0:10:02.480 --> 0:10:06.000 and kills or tries to kill the baby in the crib. 0:10:06.120 --> 0:10:08.880 And a mom blocks it and the mom gets killed 0:10:08.880 --> 0:10:11.400 and the kid survives. Okay, that's one of the first 0:10:11.400 --> 0:10:15.880 things that happens that immediately starts a mystery of like, okay, 0:10:15.880 --> 0:10:19.320 why were they trying to kill the kid who blocked it? Um, well, 0:10:19.320 --> 0:10:21.640 I guess it was the mom, um, who was the 0:10:21.640 --> 0:10:25.040 one who attacked. Why did they attack? So we automatically 0:10:25.040 --> 0:10:29.480 have these questions, right? And that becomes essentially one of 0:10:29.480 --> 0:10:32.000 the main mysteries that takes you all the way through. 0:10:32.000 --> 0:10:34.679 So I like to have this going across the entire whiteboard. 0:10:34.679 --> 0:10:36.760 I want to be able to see my entire story 0:10:36.920 --> 0:10:40.320 in this one whiteboard. Right. And across the bottom is 0:10:40.320 --> 0:10:42.680 the mystery. And what I could do is I could 0:10:42.720 --> 0:10:46.420 trickle in. I could say, look at this point. This 0:10:46.420 --> 0:10:49.140 is revealed at this point, this is revealed at this point. 0:10:49.340 --> 0:10:52.860 And so I, I have a visual indicator of where 0:10:52.860 --> 0:10:56.980 I'm unlocking the different components of the mystery. Okay. Well 0:10:56.980 --> 0:10:59.860 then I add on to the top. Let's put let's 0:10:59.860 --> 0:11:02.780 say this next layer is setting. Okay. So I'm going 0:11:02.780 --> 0:11:05.820 to say in the setting okay. Reveal this about the setting. 0:11:05.820 --> 0:11:08.940 Reveal this about the setting. Reveal this next layer up 0:11:08.940 --> 0:11:11.700 I'm going to have characters okay. This character is introduced. 0:11:11.700 --> 0:11:14.780 This character is introduced. On top of that I'm going 0:11:14.780 --> 0:11:19.059 to have events. Okay. So here yeah. Someone someone's going 0:11:19.059 --> 0:11:21.860 to be introduced here. Someone's going to go through this 0:11:21.860 --> 0:11:27.180 big transition period here. Someone dies here okay. Maybe the 0:11:27.179 --> 0:11:30.740 pet dies or whatever it is. No spoilers. You might 0:11:30.740 --> 0:11:33.700 not have gotten to, uh, Harry Potter because it just 0:11:33.700 --> 0:11:37.500 came out. Just kidding. It's very old. Anyway, um, big 0:11:37.500 --> 0:11:40.980 things that happen to characters. Okay, so that's here. And 0:11:40.980 --> 0:11:43.800 what I love about this. Watch this. You're seeing these 0:11:43.800 --> 0:11:48.240 layers now you're seeing. Okay, this big character event happens here. 0:11:48.360 --> 0:11:51.800 How does that correspond with the mystery portion? How does 0:11:51.800 --> 0:11:54.560 it correspond with the setting? How does it correspond with 0:11:54.559 --> 0:11:57.600 all these other pieces. Right. So now I'm not sure 0:11:57.600 --> 0:11:59.360 how many layers it's going to end up being maybe 0:11:59.360 --> 0:12:01.520 five or so. I mean, we already have character. We 0:12:01.520 --> 0:12:05.000 already have plot, we already have mystery which might be 0:12:05.000 --> 0:12:08.480 inside a plot. Not sure. And then we have, um, yeah, 0:12:08.520 --> 0:12:10.760 I think those are kind of the main ones. Maybe 0:12:10.760 --> 0:12:13.040 it's only three, maybe it's five, maybe it's seven. I'm 0:12:13.040 --> 0:12:15.320 not sure. But it ends up being a visual so 0:12:15.320 --> 0:12:18.560 you can see how these pieces add up. Then when 0:12:18.559 --> 0:12:21.400 you're thinking in your mind, and this is the thing 0:12:21.400 --> 0:12:24.320 that always stops me from writing is like, I think 0:12:24.320 --> 0:12:25.920 about this cool thing. I'm like, oh yeah, I want 0:12:25.920 --> 0:12:28.000 to incorporate that. But how does it affect this? Or 0:12:28.000 --> 0:12:30.120 how does it affect that? I want to see it 0:12:30.120 --> 0:12:34.760 all there. That's where AI comes in okay. Because watch this. 0:12:34.920 --> 0:12:37.040 One of the things I'm really good at with AI 0:12:37.040 --> 0:12:41.150 is explaining things to AIS. So this is what is 0:12:41.150 --> 0:12:45.550 about to become an unlock for writing fiction with AI. 0:12:45.550 --> 0:12:49.350 The problem with current AIS and well, not so much current, 0:12:49.350 --> 0:12:53.790 but a year ago, two years ago definitely is. First 0:12:53.790 --> 0:12:56.670 of all, they have very small context, and two, they're 0:12:56.670 --> 0:12:58.670 not very good at writing, right? They just write the 0:12:58.670 --> 0:13:02.350 same kind of stuff over and over. It's like, you know, 0:13:02.350 --> 0:13:04.790 it uses a lot of cliches. Oh, and then they 0:13:04.830 --> 0:13:07.230 couldn't believe how much their life had changed and blah, 0:13:07.230 --> 0:13:11.550 blah blah. It's like it's just, you know, really obviously 0:13:11.550 --> 0:13:16.110 copying from, um, old stories and they're just like totally 0:13:16.110 --> 0:13:19.230 ripping it off in a very cliche and lame way. 0:13:19.830 --> 0:13:22.670 So it just wasn't very good. I mean, it was 0:13:22.670 --> 0:13:26.150 halfway decent. There's people putting out books with it, but 0:13:26.150 --> 0:13:29.070 you could totally tell it's AI that is going to 0:13:29.070 --> 0:13:32.590 be going away soon because the quality of the models, 0:13:32.710 --> 0:13:36.270 but also the context sizes and also our knowledge of 0:13:36.270 --> 0:13:38.590 how to prompt. And that's a big part of what 0:13:38.590 --> 0:13:40.330 I'm going to teach you teach you right now. So 0:13:40.690 --> 0:13:44.330 imagine this whiteboard that I just showed you or just described, 0:13:44.450 --> 0:13:47.650 that has these layers in it. Now imagine and I'm 0:13:47.650 --> 0:13:49.449 probably going to do a follow up to this video 0:13:49.450 --> 0:13:52.130 where I do an actual example of a story that 0:13:52.130 --> 0:13:53.770 I want to write, and I'm going to have all 0:13:53.770 --> 0:13:55.890 these layers. I should have done that in this one, 0:13:55.890 --> 0:13:58.650 but I actually I'm so excited about this. I just 0:13:58.650 --> 0:14:01.170 wanted to get it out there for you to give 0:14:01.170 --> 0:14:03.370 you a head start, because a lot of you who 0:14:03.370 --> 0:14:05.809 are listening are like, oh crap, I know where he's 0:14:05.809 --> 0:14:07.370 about to go. So let me tell you where I'm 0:14:07.370 --> 0:14:10.809 about to go. If you take that whiteboard that I 0:14:10.809 --> 0:14:14.929 just described and you describe it in text, okay, and 0:14:14.929 --> 0:14:18.250 you give that to an AI that has one of these, 0:14:18.250 --> 0:14:21.770 look at this very large contexts. You already start to 0:14:21.770 --> 0:14:25.690 get way better stuff. And you combine that with a 0:14:25.690 --> 0:14:31.290 really good prompt and actually good story idea, right. So 0:14:31.290 --> 0:14:33.250 here's the thing. You don't have to give it like, 0:14:33.250 --> 0:14:35.130 I don't know I don't know of a good story. 0:14:35.170 --> 0:14:38.510 I mean something sci fi I don't know, something like 0:14:38.510 --> 0:14:42.190 there's a, there's a space fight or something like then 0:14:42.190 --> 0:14:44.430 you're giving all the work to the AI and it's 0:14:44.430 --> 0:14:47.150 going to give you worse stuff. What I'm specifically targeting 0:14:47.150 --> 0:14:51.710 in this video is somebody who has amazing ideas. Somebody 0:14:51.710 --> 0:14:54.590 who knows a lot of the plot points. They know 0:14:54.590 --> 0:14:58.350 their characters decently well. They know how it ends. Or 0:14:58.350 --> 0:15:00.790 maybe they know how it begins. Or maybe they know, 0:15:00.830 --> 0:15:02.830 like key points in the middle, and they know a 0:15:02.830 --> 0:15:05.470 whole bunch of setting stuff, but they can't get it 0:15:05.470 --> 0:15:09.430 organized and they can't get it to move forward in 0:15:09.430 --> 0:15:12.030 a way that gets them excited to go and write 0:15:12.030 --> 0:15:13.950 some of their own. I'm not trying to make it 0:15:13.950 --> 0:15:16.710 so that I writes a story for you. I mean, 0:15:16.710 --> 0:15:20.590 that's one possibility as well. Um, and maybe people want 0:15:20.590 --> 0:15:22.430 to go do that and pump them out and sell 0:15:22.430 --> 0:15:25.430 them or whatever, and that's that's fine. I'm more trying 0:15:25.430 --> 0:15:29.030 to help an author who has wanted to write forever 0:15:29.030 --> 0:15:32.750 and just couldn't quite get it together, couldn't quite put 0:15:32.750 --> 0:15:36.150 the pieces together. And that's why I'm so excited about 0:15:36.150 --> 0:15:39.460 what this has the ability to do. Right. So now 0:15:39.460 --> 0:15:42.940 imagine that whiteboard. But that whiteboard is structured as a 0:15:42.940 --> 0:15:46.620 text file. Okay. You're going to have all your different characters. 0:15:46.620 --> 0:15:49.020 You're going to you're going to take all your notes 0:15:49.020 --> 0:15:51.820 from all these years you've been collecting about your characters. 0:15:51.940 --> 0:15:53.980 You're going to put it in that context file. Then 0:15:53.980 --> 0:15:57.580 you're going to take the the setting elements. Then you're 0:15:57.580 --> 0:16:00.100 going to take the deep mystery that that permeates the 0:16:00.100 --> 0:16:03.740 entire story. Then you're going to take these key events, right? 0:16:03.860 --> 0:16:07.060 You're going to describe all of that into a file. 0:16:07.420 --> 0:16:10.700 So let me let me take you over to, um, 0:16:10.700 --> 0:16:13.740 another interface that you could potentially use for this, which 0:16:13.740 --> 0:16:16.300 is Olama. It's a different tool. I actually have a 0:16:16.300 --> 0:16:20.660 whole video and blog post on how to set up 0:16:20.660 --> 0:16:22.860 a lama to do something like this. But let me 0:16:22.860 --> 0:16:26.340 show you this. This is a model file, um, which 0:16:26.620 --> 0:16:30.300 is um, it's essentially a file that tells the model 0:16:30.300 --> 0:16:33.860 how to behave. And, uh, this is pointing to an 0:16:33.860 --> 0:16:36.120 actual model file. There's a is a little bit technical, 0:16:36.120 --> 0:16:38.200 but it doesn't matter. What I'm actually showing you here 0:16:38.200 --> 0:16:42.240 right now. Is this system prompt okay. System prompt is 0:16:42.240 --> 0:16:45.000 what tells the model how to behave. It's not giving 0:16:45.000 --> 0:16:49.760 it instructions really, of what to write specifically. But when 0:16:49.760 --> 0:16:53.400 it does do its instructions, what rules does it follow 0:16:53.400 --> 0:16:57.360 to carry out those instructions? That's what a system prompt does. 0:16:57.840 --> 0:17:01.360 So look at this. You are an expert fiction writing 0:17:01.360 --> 0:17:05.200 service that understands how to write complex, intricate, detailed stories 0:17:05.200 --> 0:17:09.680 given input from an author. Okay, they give you setting 0:17:09.680 --> 0:17:14.440 character ideas, plot points, setting ideas. Said that twice. Key 0:17:14.480 --> 0:17:18.160 drama points, key ideas that need to get expressed, key 0:17:18.200 --> 0:17:24.480 character transformations, and maybe key points like start ending, whatever. 0:17:24.640 --> 0:17:26.840 Take all of that. Think for four hours. This is 0:17:26.840 --> 0:17:28.959 kind of a little prompt trick. I'm not sure how 0:17:28.960 --> 0:17:32.680 much it works. Um, it doesn't really matter. Think about 0:17:32.680 --> 0:17:37.780 the full arc of the story over ten 2000 page books. 0:17:38.060 --> 0:17:39.939 So this is the type of prompt that's going to 0:17:39.980 --> 0:17:42.620 work better and better. The better the models get, the 0:17:42.619 --> 0:17:45.300 smarter the AI gets, right? So right now, maybe this 0:17:45.300 --> 0:17:48.060 is halfway decent. Maybe in two months a new model 0:17:48.060 --> 0:17:51.659 is going to come out. It's just absolutely insane. For example, 0:17:51.660 --> 0:17:54.419 I'm going to give this to O1, which is the 0:17:54.420 --> 0:17:57.659 new model out of OpenAI, and I'm going to give 0:17:57.660 --> 0:18:00.100 it a prompt, which I'm going to show you. Actually, 0:18:00.260 --> 0:18:02.900 that has tons of detail about a story I actually 0:18:02.900 --> 0:18:05.420 want to write. And what that thing is able to do, 0:18:05.420 --> 0:18:08.740 it's able to deeply think about all the different pieces 0:18:08.740 --> 0:18:11.740 of instruction that you gave it in the prompt. Right. 0:18:11.980 --> 0:18:14.379 So I think we're going to get way better results 0:18:14.380 --> 0:18:17.860 from that. I'll let you know in a future video. Anyway, 0:18:18.260 --> 0:18:21.619 current models can already do this fairly well. Then I'm 0:18:21.619 --> 0:18:23.780 going to tell it how exactly I want you to write. 0:18:23.780 --> 0:18:26.100 And ideally you would give it your own writing style 0:18:26.100 --> 0:18:28.379 that you really like, and you would tell it to 0:18:28.420 --> 0:18:30.940 model after that. In this case, I'm just giving an 0:18:30.940 --> 0:18:36.170 example I like clean writing descriptive. Also, I want it 0:18:36.170 --> 0:18:39.170 in first person. Not a lot of third party narration. 0:18:39.410 --> 0:18:44.170 Don't use cliches. Write every scene realizing the overall story 0:18:44.170 --> 0:18:49.050 arc that you've constructed. And don't add the context directly 0:18:49.050 --> 0:18:53.169 into the text, but refer to it indirectly, in other words. Yeah, 0:18:53.170 --> 0:18:57.170 just just be. Show. Don't tell. Essentially. So, um, and 0:18:57.170 --> 0:19:00.290 then write the scene or chapter or the story that 0:19:00.290 --> 0:19:04.210 you were asked for. Okay. So watch that. Um, so 0:19:04.210 --> 0:19:07.369 now if I go, like, and I run this one 0:19:07.369 --> 0:19:09.850 and this is the Lama version, this is a text version. 0:19:09.850 --> 0:19:11.770 We're going to do the exact same thing back in 0:19:11.770 --> 0:19:14.850 the other interface. And I go up, look at this, 0:19:14.850 --> 0:19:17.210 write a scene about a story in a young about 0:19:17.210 --> 0:19:20.890 a young couple in love in 2023 when I is 0:19:20.890 --> 0:19:26.530 become asi superintelligence. And, um, they've people are uploading their 0:19:26.530 --> 0:19:32.150 brains into the hive, waiting for transfer to await body transfer. 0:19:32.150 --> 0:19:34.909 So they're going to get new bodies. The main character, 0:19:34.910 --> 0:19:37.510 her name is Ari. She's in love with her boyfriend, 0:19:37.510 --> 0:19:40.510 but he doesn't want to upload. She uploads and he doesn't. 0:19:40.670 --> 0:19:44.510 And they meet in the scene later on. Um, and 0:19:44.510 --> 0:19:47.590 the scene is basically like, she's at some very nice 0:19:47.590 --> 0:19:50.590 event because she's now super, you know, super smart and 0:19:50.590 --> 0:19:54.590 super awesome and powerful and super attractive. And she's at 0:19:54.590 --> 0:19:59.470 this private exclusive event, and her old boyfriend is one 0:19:59.470 --> 0:20:03.230 of the people serving the food. And he serves her 0:20:03.310 --> 0:20:07.310 a glass of wine and he, like, notices it's her. 0:20:07.470 --> 0:20:10.350 Or at least it looks like her. But she's just 0:20:10.350 --> 0:20:13.869 unbelievably gorgeous. And the staff has already told him not 0:20:13.869 --> 0:20:17.389 to ever speak to anyone here because that's like, disrespectful. 0:20:17.390 --> 0:20:21.150 And there's like this big hierarchy and everything. She realizes 0:20:21.150 --> 0:20:24.230 it's him and like, she's been thinking about him anyway, 0:20:24.230 --> 0:20:28.149 but now she's like, she realizes she still loves him. Whatever. 0:20:28.170 --> 0:20:31.250 So this is the instruction that we're giving to the AI. 0:20:31.290 --> 0:20:34.450 So I'm going to press enter. So this looks a 0:20:34.450 --> 0:20:38.409 little low end right. Trashy. Um I do want to 0:20:38.410 --> 0:20:41.010 tell you millions of these books are sold all the time. 0:20:41.170 --> 0:20:43.890 And a lot of I mean, it's actually fiction. The 0:20:43.890 --> 0:20:48.130 point is, it's actually writing according to my instructions. It's 0:20:48.130 --> 0:20:52.010 writing according to the system instruction. It's writing according to 0:20:52.369 --> 0:20:55.730 the scene that I laid out in the user instruction 0:20:55.730 --> 0:20:58.689 that I just sent it, um, for a moment, in 0:20:58.730 --> 0:21:03.409 that crowded garden, surrounded by thrumming heartbeat of the party like, yeah, 0:21:03.410 --> 0:21:06.810 is it great? Uh, maybe. Maybe not. It depends what 0:21:06.810 --> 0:21:10.370 you like, right? The point is, it's actually real. It's 0:21:10.410 --> 0:21:14.210 actually following my instructions. So, um, I'm going to I'm 0:21:14.210 --> 0:21:19.010 going to just add to this, uh, write another scene 0:21:19.010 --> 0:21:23.930 where the boy is lying in bed, bed, looking at 0:21:23.930 --> 0:21:30.000 the application for upload, thinking about doing the process he 0:21:30.000 --> 0:21:34.359 dreads so he can be with her. So it switches to. 0:21:34.400 --> 0:21:36.680 I lay on my back because I told it to 0:21:36.720 --> 0:21:39.960 follow the first person, right? So it kind of followed 0:21:39.960 --> 0:21:42.600 the instruction, right? So what I'm going to do is 0:21:42.600 --> 0:21:45.360 I'm going to go do the same thing. I'm going 0:21:45.400 --> 0:21:48.159 to grab actually this stuff here, and I'm going to 0:21:48.160 --> 0:21:50.400 copy that, and we're going to switch back over here. 0:21:50.400 --> 0:21:52.359 And I'm going to put this in the system prompt. 0:21:52.359 --> 0:21:55.720 And then I'm going to go and I'm going to 0:21:55.720 --> 0:21:59.800 run this again, and I'm going to grab this. And 0:21:59.800 --> 0:22:02.720 I'm going to put that in the chat here okay. 0:22:02.760 --> 0:22:04.520 And it's got a bunch of garbage in here. No 0:22:04.520 --> 0:22:07.200 big deal. I'm going to hit send. Look at this. 0:22:07.240 --> 0:22:09.399 Look at this. This is actually much better. It's the 0:22:09.400 --> 0:22:12.720 same model actually. But this one just feels way better. 0:22:12.720 --> 0:22:15.880 Maybe just because the text looks better. But look at this. 0:22:15.920 --> 0:22:18.240 I mean, I'm not sure I would read this. It's 0:22:18.240 --> 0:22:23.160 just not my genre, but it's following the instructions, right? 0:22:23.240 --> 0:22:27.220 It's following the instructions. So these are the instructions. I 0:22:27.220 --> 0:22:30.780 haven't even done the full breakout of the whiteboard with 0:22:30.780 --> 0:22:33.979 a full like, very clear text file with tons of 0:22:33.980 --> 0:22:36.620 detail in there. So I'm just going to leave this 0:22:36.619 --> 0:22:39.180 up and I'm going to talk through this for you. Um, 0:22:39.180 --> 0:22:42.900 this is a oh, look at this context is 1.2% full. 0:22:43.100 --> 0:22:45.660 That is that's a new feature. I like that a lot. 0:22:45.780 --> 0:22:49.820 So we have these larger context models. Okay I want 0:22:49.820 --> 0:22:54.420 you to describe that. You write a ten page very 0:22:54.420 --> 0:22:59.300 clear text file describing every character in detail, describing everything 0:22:59.300 --> 0:23:01.820 that you have in terms of like, there's this big 0:23:01.859 --> 0:23:04.500 event that happens three quarters of the way through. There's 0:23:04.500 --> 0:23:07.020 another one that happens one quarter of the way through. 0:23:07.260 --> 0:23:09.620 This is the big conflict that happens. This is the 0:23:09.619 --> 0:23:11.860 description of the bad guy. And the bad guy used 0:23:11.859 --> 0:23:14.380 to be their best friend and blah, blah, blah. All 0:23:14.380 --> 0:23:17.900 this stuff, plus all the setting stuff, plus the mystery 0:23:18.140 --> 0:23:21.179 that everyone needs to be solving the whole time through. Oh, 0:23:21.180 --> 0:23:23.100 and maybe there's a big reveal at the end, and 0:23:23.100 --> 0:23:26.090 it turns out she actually made two copies of her 0:23:26.090 --> 0:23:29.330 mind and actually got two different bodies. And there's one 0:23:29.330 --> 0:23:33.650 that's like, super aggressive and crazy and like, um, sexual 0:23:33.650 --> 0:23:35.850 or whatever. And then there's like this other one that's 0:23:35.850 --> 0:23:38.290 like super nice and it's like a nice version and 0:23:38.290 --> 0:23:40.050 maybe like, he's in love with both of them and 0:23:40.050 --> 0:23:44.690 he's got to choose. Maybe there's vampires and werewolves, whatever. 0:23:44.690 --> 0:23:48.969 Some Twilight stuff. You get the point, right? Whatever it 0:23:48.970 --> 0:23:51.370 is you want to write, whether it's high fiction and, like, 0:23:51.369 --> 0:23:54.090 the best thing ever, or it's just like you want 0:23:54.130 --> 0:23:56.530 to pump out some novels, you want to make some money. 0:23:56.690 --> 0:23:58.409 Here's here's what I'm telling you and I want you 0:23:58.410 --> 0:24:01.250 to pay attention to. We are about to have a 0:24:01.250 --> 0:24:04.650 situation where you could put that in ten pages of 0:24:04.650 --> 0:24:11.250 content describing the characters, describing scenes, describing, you know, vibes 0:24:11.250 --> 0:24:13.889 that you want to give to the reader and blah, blah, blah, blah, 0:24:13.890 --> 0:24:18.370 and basically have tons of detail in there, um, across 0:24:18.369 --> 0:24:22.250 all these different layers. Right? The characters, the setting, the 0:24:22.310 --> 0:24:25.870 The mystery, the plot, the changes in the characters, all 0:24:25.869 --> 0:24:29.950 of that. And with I'm telling you, within a few months, 0:24:29.950 --> 0:24:32.390 up to a few years. I mean, it's just going 0:24:32.390 --> 0:24:34.990 to get better and better already. Starting now, you are 0:24:34.990 --> 0:24:37.550 going to be able to make anyone is going to 0:24:37.550 --> 0:24:42.270 be able to make a full novel, a full novel. 0:24:42.310 --> 0:24:46.429 I'm talking about multiple books. I'm talking about clean chapters 0:24:46.430 --> 0:24:49.710 that transition and have the context that maintain it all 0:24:49.710 --> 0:24:52.550 the way through. We are not that far away from 0:24:52.550 --> 0:24:56.870 someone being able to write entire scripts, entire manuscripts, and 0:24:56.869 --> 0:25:02.669 most importantly for this video, entire novels and series of novels. Okay. 0:25:02.710 --> 0:25:04.350 A lot of the stuff that I'm reading right now, 0:25:04.550 --> 0:25:07.229 I'm reading some lit RPG stuff and a lot of 0:25:07.230 --> 0:25:10.190 that stuff, it's actually just one story, like I'm on 0:25:10.190 --> 0:25:15.030 book 12, but book 11 ended at one paragraph, in 0:25:15.030 --> 0:25:17.629 book 12 started at the next paragraph. And it was 0:25:17.750 --> 0:25:21.050 honestly just a perfect continuation. There wasn't like wasn't like 0:25:21.050 --> 0:25:23.410 a closing of that story. And then you go to 0:25:23.450 --> 0:25:25.970 the next one. No, it's just one long thing. And 0:25:25.970 --> 0:25:27.890 I is really good at doing that. I mean, it's 0:25:27.890 --> 0:25:31.050 just going to make a giant, you know, 500 000 0:25:31.050 --> 0:25:33.970 word thing and maybe that's five books, maybe that's ten books, 0:25:33.970 --> 0:25:36.810 whatever it is, you know, a million words. It could 0:25:36.810 --> 0:25:40.450 be a giant archive of sets of series or whatever. 0:25:40.450 --> 0:25:42.850 Then you could just be like, okay, make a spin 0:25:42.850 --> 0:25:46.690 off that takes like Taj's story and does a whole 0:25:46.690 --> 0:25:49.570 spin off on that and give it another ten pages 0:25:49.570 --> 0:25:52.330 of detail on how that spin off is going to look. 0:25:52.369 --> 0:25:55.010 And boom, you just launched a whole nother series using 0:25:55.010 --> 0:25:59.290 your same exact idea. This is extremely close to happening, 0:25:59.290 --> 0:26:01.170 and I'm telling you right now, you could just take 0:26:01.170 --> 0:26:03.130 what I've shown you in this video and you could 0:26:03.130 --> 0:26:07.170 already make massive progress. Look at some of these models. Okay, 0:26:07.210 --> 0:26:08.610 this one I don't think I ever got to work. 0:26:08.609 --> 0:26:11.410 I think that one was broken. But like you've got. Oh, 0:26:11.450 --> 0:26:14.169 that one was broken too. I think they're actually the same. 0:26:14.650 --> 0:26:19.370 Any one of these already works. Okay. You need some 0:26:19.520 --> 0:26:22.800 halfway decent hardware, like the better. Um, I'm on a 0:26:22.800 --> 0:26:26.960 mac with a decent hardware, so it's pretty good at it, but, um. Yeah, 0:26:26.960 --> 0:26:29.600 if you use an AI machine, if you use a 0:26:29.600 --> 0:26:32.119 decent Mac, like you're going to be able to do 0:26:32.119 --> 0:26:34.720 lots of stuff with this for the store you already 0:26:34.720 --> 0:26:37.840 have using the models we already have. And then here's 0:26:37.840 --> 0:26:42.040 the thing. That ten page, okay, just just do this 0:26:42.040 --> 0:26:46.399 for me. Make sure you get your story idea fully 0:26:46.400 --> 0:26:49.000 into one of these, uh, files. And by the way, 0:26:49.000 --> 0:26:51.960 I call these Telos files for for a different reason. 0:26:51.960 --> 0:26:55.000 But let's say this is a telos file for writing 0:26:55.000 --> 0:26:58.639 a book. So, um, take your book idea, have the 0:26:58.640 --> 0:27:02.719 different layers described in extreme detail and fill it out 0:27:02.720 --> 0:27:06.119 three pages, five pages, ten pages, 20 pages. However much 0:27:06.119 --> 0:27:09.240 detail you have, take all your notes, transcribe them into 0:27:09.240 --> 0:27:11.720 this thing now, and here's what's cool about it. Once 0:27:11.720 --> 0:27:14.120 you have that thing, you can also go back in 0:27:14.119 --> 0:27:16.600 there and you can update and be like, oh, actually, 0:27:16.600 --> 0:27:18.500 this is going to happen with the with the world, 0:27:18.500 --> 0:27:20.379 and the two worlds are going to meet. And actually, 0:27:20.380 --> 0:27:23.300 this planet fights this planet, and she falls in love 0:27:23.300 --> 0:27:26.900 with this thing and all those different pieces. You could 0:27:26.900 --> 0:27:29.340 just add to that and keep it updated or whatever. 0:27:29.420 --> 0:27:33.700 Here's what's awesome. When that next model drops and it's like, hey, 0:27:33.700 --> 0:27:37.620 we just expanded. It's no longer 500,000 things of context. 0:27:37.619 --> 0:27:41.820 It's now a million things of context. And actually, it's 0:27:41.820 --> 0:27:45.980 four times better at maintaining cohesive vibes throughout a story. Oh, 0:27:45.980 --> 0:27:47.899 and also the new Mac came out. You get your 0:27:47.900 --> 0:27:51.260 new Mac or whatever, and now it's like faster or whatever. 0:27:51.380 --> 0:27:54.859 Or maybe the the, the new model requires that you 0:27:54.859 --> 0:27:58.060 have more hardware. Doesn't matter. The point is, all these 0:27:58.060 --> 0:28:00.859 upgrades are going to be happening in our in our 0:28:00.859 --> 0:28:05.820 AI enabled hardware. The model, intelligence and understanding of how 0:28:05.820 --> 0:28:09.300 to write, and the ability to match your actual writing 0:28:09.300 --> 0:28:12.700 style that's going to improve the context links is going 0:28:12.700 --> 0:28:14.820 to improve, so we can see your entire story and 0:28:14.820 --> 0:28:17.800 keep that in its memory as it writes scenes and 0:28:17.800 --> 0:28:21.520 chapters in entire books. And I'm telling you, here's my prediction. 0:28:21.520 --> 0:28:24.240 I'm going to say it again. You will very soon. 0:28:24.280 --> 0:28:26.280 I mean, you could already do this now. You could 0:28:26.280 --> 0:28:29.080 already do this now, and it will produce something halfway decent. 0:28:29.200 --> 0:28:31.600 You might actually be pretty happy with it. It depends 0:28:31.600 --> 0:28:33.960 on the level that you need. Right? If you need 0:28:33.960 --> 0:28:36.600 just a level to pump out books on Amazon, you 0:28:36.600 --> 0:28:38.800 could already do it now just using the stuff I 0:28:38.800 --> 0:28:42.640 just told you. Okay. What I'm saying is very soon, 0:28:42.640 --> 0:28:46.920 within the next few months, next couple of years, you 0:28:46.920 --> 0:28:50.520 are going to be able to produce a super, super 0:28:50.520 --> 0:28:55.640 high quality, complete novel, very long novel that follows your 0:28:55.640 --> 0:29:01.600 instructions and adds creativity and basically produces stuff that could 0:29:01.600 --> 0:29:05.520 be on a bestseller list, like on par with Harry 0:29:05.520 --> 0:29:07.760 Potter and a lot of these other stories that are 0:29:07.760 --> 0:29:10.600 human written. So that's what I wanted to cover. I 0:29:10.600 --> 0:29:13.280 wanted to show you a couple of different tools for 0:29:13.280 --> 0:29:16.270 using it. One is llama again? There's a video out 0:29:16.270 --> 0:29:18.430 there that I have, and a blog post about how 0:29:18.430 --> 0:29:20.990 to use llama to do this exact thing, but this 0:29:20.990 --> 0:29:24.910 one is mostly focused on LM studio. But most importantly, 0:29:25.150 --> 0:29:30.070 the concept of explaining your story to the AI in 0:29:30.110 --> 0:29:33.510 as much detail as possible and as the improvements happen 0:29:33.510 --> 0:29:37.030 to the models and context sizes and hardware, it's just 0:29:37.030 --> 0:29:40.990 going to get better and better. So see you next time! 0:29:41.030 --> 0:29:44.030 Unsupervised learning is produced and edited by Daniel Miessler on 0:29:44.030 --> 0:29:48.710 a Neumann U87 AI microphone using Hindenburg. Intro and outro 0:29:48.710 --> 0:29:51.950 music is by zombie with a Y. And to get 0:29:51.950 --> 0:29:54.070 the text and links from this episode, sign up for 0:29:54.070 --> 0:29:59.790 the newsletter version of the show at daniel.com/newsletter. We'll see 0:29:59.790 --> 0:30:00.510 you next time.