Skip to content

Conversation

@GreggHelt2
Copy link
Contributor

Trying to get a few ControlNet extras in before 3.0 release:

  • SegmentAnything ControlNet preprocessor node
  • LeResDepth ControlNet preprocessor node (but commented out till controlnet_aux v0.0.6 is released & required by InvokeAI)
  • TileResampler ControlNet preprocessor node (should be equivalent to Mikubill/sd-webui-controlnet extension tile_resampler)
  • fix for Midas ControlNet preprocessor error with images that have alpha channel

Example usage of SegmentAnything preprocessor node:
Screenshot from 2023-06-26 16-53-44

…entAnything preprocessor. Cause was controlnet_aux randomization of segmentation coloring, which seems to lead to some randomization of resulting images using ControlNet seg model. Switched to using deterministic ADE20K color palette instead, which solved the problem.
…ontrolnet_aux v0.0.6 (supported on controlnet_aux current main, but not on latest release v0.0.5)
Also fixes to SegmentAnything ControlNet preprocessor node.
…mat then convert to RGB (otherwise MediapipeFace image processing throws an error)
@blessedcoolant blessedcoolant merged commit 201b843 into main Jun 28, 2023
@blessedcoolant blessedcoolant deleted the feat/controlnet_extras branch June 28, 2023 05:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants