background dots

HowTo use Dreambooth to personalize Stable Diffusion models

time to read icon 2 min read
Author image

Mahesh Patil

Step-by-Step guide to personalize the text-to-image stable diffusion models using Tiyaro model training

blog thumbnail

Start with Model training at ‘Model Sudio’ -> ‘Train’ . Click ‘New Training Project’

1s.png

In the popup select the ‘Dreambooth’ tile as shown below and Click ‘Next’

2s.png

The next screen asks you the configuration information for the training. The 3 most important and required inputs for configuration are

  1. Upload Dataset. (Format of the dataset zip file explained below)
  2. instance prompt
  3. class prompt

Rest all the other parameters are 'optional' and you can simply use the defaults.

3s.png

Dataset is a zip file. The Zip file contents should have the following structure. The instance class images (the images which add the concept to the stable diffusion) must be directly zipped at the root level. These images are required. If you need to add class images to your zip then you should add them to a folder called 'dataset_class'. Class images are for images generated by the stable diffusion model for a dataset prompt and they are optional. For reference you can download the dog toy dataset and examine it. You will see something like the following.

.
└── dataset.zip/
  ├── image1.jpeg
  ├── image2.jpeg
  ├── .
  ├── .
  └── dataset_class/
    ├── image1.jpeg
    └── image2.jpeg

Next add the name of the project and follow the guided ‘Next’ buttons to ‘Submit’ the job.

Once the job is submitted it typically takes 30-45 minutes to complete. You will receive an email once the job is finished.

You can find the trained job again in the ‘Model Studio’ -> ‘Train’ window. See below. 4s.png

In the above screenshot, ‘dreambooth-training-example’ shows a completed job. You can click on the model in the ‘Models’ column .e.g ‘dreambooth-training-example’ to take you to the model card of your ‘Custom model’

You can also find a link to this trained model by clicking on the training project row in the ‘Results’ sub tab, see below.

5s.png

Clicking on ‘dreambooth-training-example’ in Results->TrainedModels above will take you to your custom model card.

The custom model card is similar to any other model hosted as API with the API url, sample code, demo etc.

Summary

With a few clicks you can use the Tiyaro Model Studio to personalize stable diffusion models using Dreambooth

Start using AI today.

© 2022 Tiyaro, Inc.