Fix Hands in Stable Diffusion Yeni, March 25, 2024March 22, 2024 Creating beautiful realistic images using AI can often be challenging. Hands and fingers anatomy sometimes can be wonky, which has been a general complaint across AI image generators. Thankfully, the Stable Diffusion community is quick to respond to this problem by developing a new controlNet that can fix 90% of hand problems. In this blog post, we will explore how to fix hands using ComfyUI workflow & Automatic1111 in DiffusionHub by the help of Hand Refiner ControlNet & Meshgraphormer. Fix Hands in ComfyUI What you need: Login to your DiffusionHub, choose comfyUI, and don’t forget to press update all. Restart the comfyUI page by refreshing the browser Go to ComfyUI manager, and choose install models. Type in controlNet and you should see many options available. One thing to note, If you use SDXL model, this is the control net you need to install: If you use SD 1.5 model, choose this one : Click refresh on the Comfyui Manager. Load this workflow: https://openart.ai/workflows/insect_whimsical_83/fixing-hands/4348HPdYFw9jwFb6uAQ0 This comfyUI workflow is using MeshGraphormer Depth Pre-processor node. MeshGraphormer is designed to correct the 3D mesh of incorrectly shaped hands, including too many fingers or slightly melted hands. Fix Hands in Automatic1111 If you think ComfyUI nodes look like a spaghetti mess, there is also an option to fix hands in Automatic1111. Using Hand Refiner, fixing hands can be done in a breeze. Hand Refiner is a controlNet model whichemploys a conditional inpainting approach to rectify malformed hands while leaving other parts of the image untouched. For this method, you will need: Login to DiffusionHub, choose Automatic1111. Go to Model Downloader tab, and tick control net model box, paste this link in the download URL box. This is the hand refiner controlNet model. Start generating your image, send the image with bad hands to img2img Inpainting tab by clicking this icon: 4. Here’s an example of a girl : 5. Begin to inpaint the misshaped hands. You can adjust the brush. Configure the ControlNet setting by choosing Depth Hand Refiner for Pre Processor and Control SD Inpaint Depth Hand as below: denoising strength to 0.75. Enable: Yes Preprocessor: depth_hand_refiner Model: control_sd15_inpaint_depth_hand_fp16 Here is the result: Conclusion AI-generated Image often have flaws in the details of human body part. Specifically for hands, we now have resources to correct these flaws by adding controlNet configuration. This controlNet is quite useful and can be easily downloaded using DiffusionHub. Try it yourself with our FREE 30-minute trial today!- Share on FacebookPost on XFollow usSave Automatic1111 ControlNet Uncategorized Hand Refiner
Uncategorized Stable Diffusion 3 April 29, 2024April 29, 2024 This week, Stable Diffusion community has been buzzing with the release of Stable Diffusion 3 API. Just what is exactly difference between the previous model and SD 3? We’ll deep dive into this blog post! What is Stable Diffusion 3? Stable Diffusion 3 (SD3) is an advanced text-to-image generation model… Read More
Automatic1111 Ultimate SD Upscale in Stable Diffusion March 29, 2024March 22, 2024 Stable Diffusion is one of the powerful image generation model that can produce high-quality images based on text descriptions. It also includes the ability to upscale photos, which allows you to enhance the resolution of an image without sacrificing quality. Ultimate SD Upscale in img2img is one of the extensions… Read More
Generative AI Introducing HelloWorld: a realistic SDXL base model February 7, 2024February 14, 2024 Table of Contents: HelloWorld Evolution It’s 2024 and AI photography has evolved so much compared to the last year. The new SDXL model HelloWorld marks a groundbreaking transition from the established SD1.5 platform to the futuristic SDXL series. This new SDXL base model series not only symbolizes a departure… Read More