Introduction

‍

Guiding Portrait Creation with Reference Images

Achieving your artistic vision is crucial when creating something as significant as a character portrait. If you intend to use portraits in a simple animation workflow, consistency is also vital. In this guide, we will walk you through the optimal steps for realizing your artistic vision for your character portrait designs.

‍

Guiding with Image to Image

To create your desired output, begin by uploading your chosen image to the Reference Image box. Supplement this with any additional prompts, such as emotions or facial expressions, to further guide the results.

Next, adjust the Influence of your image. Lowering the influence will reduce detail carryover from the reference image, while increasing it will preserve more details. Typically, setting the influence below 20 will introduce many new details, whereas values above 60 will result in minimal changes to the original image.

Once you've made your adjustments, click Generate to produce the output.

‍

Guiding with Dual Reference Images

To modify the reference image mode, select Image to Image + IP Adapter. This step allows you to guide key features of your character by uploading an image to the IP Adapter section. It's acceptable to use the same image for both the Image to Image and IP Adapter sections. However, if you choose to use the same image for both, you'll need to set lower influence values for each.

Next, adjust the Image to Image Influence to approximately 10. This value may require fine-tuning based on the results you obtain. Similarly, set the IP Adapter Influence to around 20, keeping in mind that adjustments might be necessary depending on the output.

The Image to Image reference will provide guidance on color, structure, and some detail, while the IP Adapter reference will facilitate the basic transfer of facial features and offer greater flexibility to the prompt.

As an alternative, you can also use Controlnet + IP Adapter, particularly if you don't want to adhere to the color information of the first reference image and only desire the general outline. In this case, select either Controlnet Pose or Controlnet Structure, with an influence range of 50-100 for these modes. Some experimentation will be required to achieve the desired outcome.

Next Steps

To complete the character portrait creation, particularly when your requirements are for perfect consistency such as animation sprites, follow this additional workflow:

Pulling together Animation Portraits in Canvas.

‍