How to Create Anime Image from Photo using Fooocus

You can do many things with Fooocus in terms of creating AI images. One of them is to transform a photo into an anime style. Today we will learn how to change a photo into an anime style, using Fooocus from Stable Diffusion and AnimagineXL checkpoints. 

Things you need:

1. 1. Your DiffusionHub Account

1. 1. Animagine XL in CivitAI. You can also use other anime checkpoint, however please note that that Fooocus is only compatible with SDXL checkpoint.

Method:

Login to your DiffusionHub account, choose Automatic1111 > and choose Model Downloader.

In different tab, Download AnimageXL from this link, copy the link and paste it in the “Model Downloader” tab, select a checkpoint.

Once you paste the link, Go to Services, and change into Fooocus UI 

When you already in Fooocus UI, make sure to tick Input Image &  Advanced. Another drop down will open up and choose “Describe” Tab. Upload your image and choose Art/Anime. Click Describe this image in Prompt

Here we have a photo of Lisa Blackpink with ticked Anime in which we click “Describe” afterwards. You can see it gives the prompt in the prompt box. Make sure that the prompt is correct with the description. Generally, a photo will result in “realistic” prompt, consider to remove the realistic part.

Now let’s make sure we choose the correct checkpoint and uncheck some advanced settings. In this case, we choose AnimagineXL in model tab, select None in Lora, and uncheck styles in Style tab. (You can choose this later – this is to show you the basic first).

Now, back to Image Prompt tab, tick the “advanced” button in the bottom. Load your image, You will see option for Image prompt, Pyracanny, CPDS. you can customise the settings at “Stop At” & “Weight”, also choose PyraCanny. In this case, we play around with PyraCanny, with Stop At 0.5 & Weight 1. Click Generate.

Here are the results: 

You can absolutely play around with PyraCanny and CPDS Settings and with added style as well. Here are just an example of what we play around with the settings. 

Conclusion

Fooocus is very versatile tool where you can generate many styles of AI Images. With DiffusionHub, you don’t have to think about complicated installations. Stay tuned for more tutorial!