There are many ways to use IP Adapters, here are some tips to get you started
1. Add image to the Reference Image section.
2. Switch to IP Adapters (or one of the + IP Adapters options.)
3. Adjust the influence as needed.
If you want your character or creation to be in the same style*as your reference image, you must train or pick a model in the same style or a close stylistic match.
IP Adaptors are Image Prompts. It is taking into context what it senses from your image.
If you have a portrait of a woman as your reference image, you probably don't need to say "portrait of a woman in the prompt" unless you're having trouble making a woman appear.
The prompts I use are super simple. Like this:
This is an unfortunate truth, and one we are investigating more, but do not expect the IP Adapters to work quite as magically for photorealistic images.
AI relies on Probability.
As a general rule of thumb, 0.50 influence is a good starting off point.
However, depending on how much the model associates the image you use with the model you are prompting from, you may need to go much higher or lower in influence.
We could, and will, write a whole article on IP Adapters and other reference image control methods together. They can be super powerful.
The easiest, most direct method to try this out is by using a portrait in the IP Adapter and a Pose with ControlNet (Character Mode).