Getting a character in the foreground when using two ControlNets

[simonknittel]

Hey!

I'm trying to generate a character sitting on top a planet. So far I've got the pose and planet nailed down thanks to the OpenPose and LineArt models. Also the general composition and size of elements is correct. However, the character gets rendered behind the planet. I would like to have it in front/on top of the character.

Is there a trick to achieve that?

Example

ControlNet Nodes in the ComfyUI Workflow

Completel Workflow
workflow.zip

I've already tried to be more specific in the prompt. I tried to play around with the strenghts of the ControlNet nodes. Nothing really changed.

[dayunbao]

I asked a similar question in the sd-webui-controlnet repo here. The maintainer of that repo built a new external tool that will allow you to do that.

[geroldmeisinger]

why do want to achieve everything with Stable Diffusion alone? couldn't you just generate the images separatly and merge them in Gimp or something.