Connect with us

Digital Marketing

How to use Stable Diffusion to create AI-generated images



A simplified user interface design representing a portion of Zapier's platform. There's a vertical menu of platform options. At the top is a dominant orange button with text inside that reads 'Create Zap.' Beneath the button is a stack of menu icons to represent dashboard, Zaps, and Transfers.

Stable Diffusion is the most flexible AI image generator. It’s entirely open source, and you can even train your own models based on your own dataset to get it to generate exactly the kind of images you want. 

This means that there are really lots of ways to use Stable Diffusion: you can download it and run it on your own computer, set up your own model using Leap AI, or use something like NightCafe to access the API. But the simplest option—and the one I’ll walk you through here—is through Stability AI‘s official DreamStudio web app. It’s easy to use and a great way to get play around with Stable Diffusion. So let’s dive in.

How to sign up for Stable Diffusion

DreamStudio is the official Stable Diffusion web app. Here’s how to sign up for DreamStudio:

  1. Go to

  2. Close any pop-ups about new features, and agree to the terms of service if it asks.

  3. Click Login in the top-right, and create a new account. 

Log in to DreamStudio, the web app used to access Stable Diffusion

Once you sign up, you get 25 free credits—which is enough to try seven different prompts and generate around 30 images with the default settings. Extra credits are pretty cheap, too: $10 gets you 1,000 of them. Once you run out, you can also explore running Stable Diffusion for free on your own computer. 

How to generate an image with Stable Diffusion

Let’s start by generating your first image. Over in the left sidebar, DreamStudio has all the controls. You get a lot more options than you do with DALL·E 2, for example, but let’s start simple. 

DreamStudio, the web app used to access Stable Diffusion

The Style dropdown allows you to choose a specific style of image for Stable Diffusion to generate. The options here are pretty broad. The default, Enhance, produces realistic—but not photorealistic—images and is always a good option. Otherwise, feel free to try whatever catches your eye: you can choose from Anime, Photographic, Digital Art, Comic Book, Fantasy Art, Analog Film, Neon Punk, Isometric, Low Poly, Origami, Line Art, Craft Clay, Cinematic, 3D Model, or Pixel Art. Have fun.

The most important bit is the Prompt box. This is where you enter a description of what you want Stable Diffusion to create. There’s always a random suggestion there to give you some inspiration (and you can cycle through for more), but you should enter whatever you want. Some of my favorites ones to try are:

  • A painting in the style of Vermeer of a large fluffy Irish wolfhound enjoying a pint of beer in a traditional pub 

  • A Canadian man riding a moose through a maple forest, impressionist painting

  • A portrait of a cartoon purple cow, high definition digital art.

With your prompt entered, you can ignore the other options for now, and click Dream

(The numbers on the button let you know how many credits it will cost to generate the artwork with the settings you’ve selected. By default, it will be 3.33.)

Wait a few moments for DreamStudio to do its thing, and you’ll have four options to choose from. Select your favorite image, and then you can use the buttons at the top of the right sidebar to download it (and optionally upscale the resolution), reuse the prompt, generate additional variations, edit it, or set it as the initial image—which makes it part of the prompt. 

Selecting one image in DreamStudio

Refine your image in Stable Diffusion

While the Style options give you some control over the images Stable Diffusion generates, most of the power is still in the prompts. With DreamStudio, you have a few options. 

Focus on the prompt

The Prompt box is always going to be the most important. To make the most of it, describe the image you want to create in as much detail as possible, though it’s worth bearing a few things in mind:

  • The more specific you are, the better. If you want bananas, don’t say fruit—say bananas. 

  • But don’t make your prompts too complicated. The more details you include, the more likely things are to get confused. Similarly, the current generation of art generators can struggle to understand specific quantities, sizes, and colors. 

  • Consider the details. You can add descriptors for the subject, medium, environment, lighting, color, mood, and composition, among other things.

  • Play around. The best way to learn is just by trying different things. 

Changing the prompt in DreamStudio

Use negative prompts

The Negative prompt box allows you to list the things you don’t want included in your image. It’s not quite as effective as I’d like, but it can help skew your generated images in certain directions.

For example, in the image above, I’ve used “hills, grass, trees, fields, farms” as a negative prompt. While some of the backgrounds still have these details, they’re less present across the four images than when I just use the prompt “a portrait of a purple cow, high definition digital art.”

Use an image as part of the prompt

The Image box lets you upload an image to use as part of the prompt. It’s incredibly powerful and allows you to control the composition, color, and other details of the image. Once you upload an image, you can set how strongly you want it to impact the generated art. Thirty-five percent is the default and works pretty well, though you can play around with it. 

Images of a zombies running through the woods: the top row looks like the uploaded image quite a bit; the bottom row is much more stylized.

In the images above, I’ve used the prompt “a zombie running through the woods” along with a photo of me actually running through the woods. The bottom options had the image strength set to 35%, and the top options had it set to 70%. In both cases, you can see just how much of an impact the base image had on the overall look of things. 

More Stable Diffusion image settings

Stable Diffusion has a few more settings you can play around with, though they all affect how many credits each generation costs. 

Let’s start with the two basic ones:

  • Aspect ratio: The default is 1:1, but you also can select 7:4, 3:2, 4:3, 5:4, 4:5, 3:4, 2:3, and 7:4 if you want a wider image.

  • Image count: You can generate anywhere between one and ten images for each prompt. 

Adjusting the prompt strength in the Stable Diffusion DreamStudio web app (the stronger one looks much more like the prompt)

Under Advanced, you get four other options:

  • Prompt strength: This controls how strongly Stable Diffusion weights your prompt when it’s generating images. It’s a number between 1 and 30 (the default appears to be around 15). In the image above, you can see the prompt strength set to 1 (top) and 30 (bottom).

  • Generation steps: This controls how many diffusion steps the model takes. More is generally better, though you do get diminishing returns. 

  • Seed: This controls the random seed used as the base of the image. It’s a number between 1 and 4,294,967,295. If you use the same seed with the same settings, you’ll get similar results each time. 

  • Model: You can choose between three different versions of Stable Diffusion: 2.1, 2.1-768, and a preview of SDXL (the default). 

While you won’t often need to dive into these settings, they’re a great way to understand what Stable Diffusion is actually doing when you give it a prompt. 

How to edit images with Stable Diffusion

The editing options in DreamStudio

DreamStudio also supports inpainting and outpainting, where you use an AI art generator to change the details of an image or expand it beyond its borders. To inpaint or outpaint:

  1. Select the Edit option at the top of the left sidebar. 

  2. Create a new image or import one from your computer. 

  3. Use the arrow tool to select an overlapping area, enter a prompt, and click Dream. You’ll get four potential options for expanding your canvas. 

  4. Or use the eraser tool to delete something from an image, and then replace it using a prompt. 

To be honest, DreamStudio’s inpainting and outpainting tools feel less cohesive than DALL·E 2’s—I find it doesn’t blend new AI generations as well. But it’s fun to play around with, and it showcases how AI image generators may well be used commercially over the next few years. 

Going further with Stable Diffusion

DreamStudio is the fastest way to get started with Stable Diffusion, but it’s far from the only way. If you like it, you should consider diving deeper and doing something like training your own model or installing it on your own computer, so you can generate as many images as you want—for free. 

Stable Diffusion is getting better and better, but if you want to try something different, you should also check out DALL·E 2 and Midjourney, the two other leading AI image generators.

Related reading:

Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Copyright © 2022 Dogeared Digital News