Fix Hands in Stable Diffusion Yeni, March 25, 2024March 22, 2024 Creating beautiful realistic images using AI can often be challenging. Hands and fingers anatomy sometimes can be wonky, which has been a general complaint across AI image generators. Thankfully, the Stable Diffusion community is quick to respond to this problem by developing a new controlNet that can fix 90% of hand problems. In this blog post, we will explore how to fix hands using ComfyUI workflow & Automatic1111 in DiffusionHub by the help of Hand Refiner ControlNet & Meshgraphormer. Fix Hands in ComfyUI What you need: Login to your DiffusionHub, choose comfyUI, and don’t forget to press update all. Restart the comfyUI page by refreshing the browser Go to ComfyUI manager, and choose install models. Type in controlNet and you should see many options available. One thing to note, If you use SDXL model, this is the control net you need to install: If you use SD 1.5 model, choose this one : Click refresh on the Comfyui Manager. Load this workflow: https://openart.ai/workflows/insect_whimsical_83/fixing-hands/4348HPdYFw9jwFb6uAQ0 This comfyUI workflow is using MeshGraphormer Depth Pre-processor node. MeshGraphormer is designed to correct the 3D mesh of incorrectly shaped hands, including too many fingers or slightly melted hands. Fix Hands in Automatic1111 If you think ComfyUI nodes look like a spaghetti mess, there is also an option to fix hands in Automatic1111. Using Hand Refiner, fixing hands can be done in a breeze. Hand Refiner is a controlNet model whichemploys a conditional inpainting approach to rectify malformed hands while leaving other parts of the image untouched. For this method, you will need: Login to DiffusionHub, choose Automatic1111. Go to Model Downloader tab, and tick control net model box, paste this link in the download URL box. This is the hand refiner controlNet model. Start generating your image, send the image with bad hands to img2img Inpainting tab by clicking this icon: 4. Here’s an example of a girl : 5. Begin to inpaint the misshaped hands. You can adjust the brush. Configure the ControlNet setting by choosing Depth Hand Refiner for Pre Processor and Control SD Inpaint Depth Hand as below: denoising strength to 0.75. Enable: Yes Preprocessor: depth_hand_refiner Model: control_sd15_inpaint_depth_hand_fp16 Here is the result: Conclusion AI-generated Image often have flaws in the details of human body part. Specifically for hands, we now have resources to correct these flaws by adding controlNet configuration. This controlNet is quite useful and can be easily downloaded using DiffusionHub. Try it yourself with our FREE 30-minute trial today!- Share on FacebookPost on XFollow usSave Automatic1111 ControlNet Uncategorized Hand Refiner
Uncategorized 5 Cool LoRA to Elevate Your AI Images April 17, 2024April 17, 2024 Stable Diffusion community is always quick with new update, quirky checkpoints and new styles of LoRA. CivitAI is home of most Stable Diffusion creators who are always very generous to share their work to the masses. In this blog post, we round up 5 new cool LoRA for you to… Read More
Exploring JuggernautXL Checkpoint April 12, 2024 AI development for Image generation is in lightning speed. Everyday, creators create new AI model that is better, faster and often produce brilliant results. One of the most popular Stable Diffusion Model is JuggernautXL. Juggernaut has been downloaded 500,000 times in CivitAI and often makes it into several go-to checkpoints… Read More
Uncategorized Guide to Deforum in Automatic1111 March 7, 2024March 7, 2024 Content What is Deforum? Deforum is one of the tools in Stable Diffusion to create animation. It use Stable Diffusion’s image-to-image function to generate a series of images, which are then stitched together to form the video. Furthermore, Deforum makes minor changes to an image frame and then uses the… Read More