Fix Hands in Stable Diffusion

Creating beautiful realistic images using AI can often be challenging. Hands and fingers anatomy sometimes can be wonky, which has been a general complaint across AI image generators. Thankfully, the Stable Diffusion community is quick to respond to this problem by developing a new controlNet that can fix 90% of hand problems. In this blog post, we will explore how to fix hands using ComfyUI workflow & Automatic1111 in DiffusionHub by the help of Hand Refiner ControlNet & Meshgraphormer.

Fix Hands in ComfyUI

What you need: 

• Login to your DiffusionHub, choose comfyUI, and don’t forget to press update all. 
• Restart the comfyUI page by refreshing the browser
• Go to ComfyUI manager, and choose install models. Type in controlNet and you should see many options available. One thing to note, If you use SDXL model, this is the control net you need to install: 

• If you use SD 1.5 model, choose this one :

• Click refresh on the Comfyui Manager. 
• Load this workflow: https://openart.ai/workflows/insect_whimsical_83/fixing-hands/4348HPdYFw9jwFb6uAQ0

This comfyUI workflow is using MeshGraphormer Depth Pre-processor node. MeshGraphormer is designed to correct the 3D mesh of incorrectly shaped hands, including too many fingers or slightly melted hands. 

Fix Hands in Automatic1111

If you think ComfyUI nodes look like a spaghetti mess, there is also an option to fix hands in Automatic1111. Using Hand Refiner, fixing hands can be done in a breeze. Hand Refiner is a controlNet model whichemploys a conditional inpainting approach to rectify malformed hands while leaving other parts of the image untouched. 

For this method, you will need: 

1. Login to DiffusionHub, choose Automatic1111. 
2. Go to Model Downloader tab, and tick control net model box, paste this link in the download URL box. This is the hand refiner controlNet model.
3. Start generating your image, send the image with bad hands to img2img Inpainting tab by clicking this icon: 

4. Here’s an example of a girl :

5. Begin to inpaint the misshaped hands. You can adjust the brush.

Configure the ControlNet setting by choosing Depth Hand Refiner for Pre Processor and Control SD Inpaint Depth Hand as below: 

• denoising strength to 0.75.
• Enable: Yes
• Preprocessor: depth_hand_refiner
• Model: control_sd15_inpaint_depth_hand_fp16

Here is the result: 

Conclusion

AI-generated Image often have flaws in the details of human body part. Specifically for hands, we now have resources to correct these flaws by adding controlNet configuration. This controlNet is quite useful and can be easily downloaded using DiffusionHub. Try it yourself with our FREE 30-minute trial today!-

Share on Facebook

Post on X

Follow us

Save