Stable Diffusion is also available in Blender, just as it is in Canva and Photoshop. Stable Diffusion in Blender is great news for game developers and Blender artists. Hereafter, they can create images from text easily and then build upon the AI-generated image using Blender.
Stable Diffusion in Blender
Stable Diffusion in Blender can enable artists to quickly create textures, photography, concept art, and custom art. Then, they can utilize AI-generated images for their main project. The name of the plug-in that we are going to use is “Dream Textures”.
How to Use Stable Diffusion in Blender
- Download the Plug-in
- Open Blender
- Install Dream Textures Plug-in
- Download Weights from Hugging Face
- Move the Downloaded File into Target Directory
- Use Dream Textures
1. Download the Plug-in
Go to Carson Katri’s Dream Textures GitHub page and click on “Code”.
Then, you will be able to see two options: “Open with GitHub Desktop” and “Download ZIP”.
Click “Download ZIP”.
2. Open Blender
After the download, you need to open the Blender application as “Administrator”. To do so, click “Run as administrator”.
Once the Blender gets opened, click “Edit”.
Now, you will be able to see multiple options. Click “Preferences”.
3. Install Dream Textures Plug-in
After clicking “Preferences”, navigate to “Add-ons” and click “Install”.
Find Dream Textures using the search box given. Then, select the “platform” from the dropdown.
Next, click “Install dependencies”. This may take a while.
4. Download Weights from Hugging Face
Next, you need to download the model from Hugging Face.
To do so, just click “Download Weights from Hugging Face” in the Blender application.
Now, it will take you to the Hugging Face page, log in to Hugging Face and click “Access repository”.
Then, click “sd-v1-4.ckpt” under “Download the weights”. Keep in mind that the file is 4 GB of data.
5. Move the Downloaded File into Target Directory
After the download, open Blender and click “Open Target Directory” to copy the downloaded files into that folder.
Now, the downloaded file needs to be renamed from “sd-v1-4.ckpt” to “model.ckpt”.
Then, you will notice the new option called “Validate Installation” in the Blender application. Click on it.
Lastly, click on the “hamburger menu” and click “Save Preferences”.
6. Use Dream Textures
Now, you need to go to the “Image Editor” on the Blender application.
You will be able to see the “Dream Textures” option in the top right corner inside the Image Editor. Click on it.
If you want some kind of texture, leave the “Preset” option unchanged. Enter what kind of texture you want in the “Subject” field.
Lastly, click “OK”.
If you want more than a texture, click the “Preset” dropdown box and choose the type of art you want.
Then, as usual, enter the text description in the “Subject” field.
Use the “Custom” option from the “Preset” dropdown if you want to give a full description like “a highly detailed modern truck, cinematic look, 4k”.
Conclusion
This is how you can use the Stable Diffusion plug-in called “Dream Textures” in Blender to create textures, photography-style images, concept art, and custom art.
If you want, you can also check out the other variant of this plug-in available on the Gumroad. This lets users input images as prompts.
