Date:

Studio Ghibli Dreams in ComfyUI

ChatGPT’s Studio Ghibli Style Conversion: A Step-by-Step Guide

ChatGPT recently introduced the ability to convert user-uploaded photos into Studio Ghibli-style aesthetics. While the free plan is slow, the paid version offers faster processing. But what if you’re not satisfied with the results? Can you create your own workflow to achieve the desired outcome? The answer is yes, and it’s easier than you think.

Using ComfyUI for Image-to-Image Processing

Image-to-image processing in ComfyUI is the key to creating your own Studio Ghibli-style workflow. You can use a fast/turbo SDXL (Stable Diffusion XL) model with a Studio Ghibli LoRA to generate the desired result. Here’s a step-by-step guide on how to do it:

Creating the Workflow

I found a workflow on my computer that I had downloaded earlier, and I modified it to get the results I wanted. The workflow uses Florence2Model to help interpret the image and supply it as a prompt. This model is downloaded automatically the first time you run the workflow and saved locally for future use.

Modifying the Workflow

To get the desired results, I added a color correction node that improves the vibrancy of the output image. The output image is only a preview, so you can replace it with a Save Image node if you want to save the results.

Batch Processing

If you want to batch process images, consider using my WW Image Batch Loader node, which can interrogate a batch folder and load images one by one to process in your workflow.

Downloading the Workflow

You can download the workflow in a zip file containing two formats: PNG and JSON. Simply unzip the file and drag either of the files into ComfyUI to load the workflow.

Results

Here are some of the results I was able to achieve with this workflow:

Conclusion

With this step-by-step guide, you can create your own Studio Ghibli-style workflow using ComfyUI and Image-to-Image processing. While the free plan may be slow, the paid version offers faster processing. Whether you’re a tech-savvy individual or just looking for a creative outlet, this workflow is a great way to achieve the desired outcome.

Frequently Asked Questions

Q: What is ComfyUI?
A: ComfyUI is a software that allows you to create workflows for image-to-image processing.

Q: What is Stable Diffusion XL (SDXL)?
A: SDXL is a fast/turbo model used in ComfyUI for image-to-image processing.

Q: How do I download the workflow?
A: You can download the workflow in a zip file containing two formats: PNG and JSON. Simply unzip the file and drag either of the files into ComfyUI to load the workflow.

Q: Can I modify the workflow?
A: Yes, you can modify the workflow by adding or removing nodes to achieve the desired outcome.

Q: How do I batch process images?
A: You can use my WW Image Batch Loader node to interrogate a batch folder and load images one by one to process in your workflow.

Latest stories

Read More

LEAVE A REPLY

Please enter your comment!
Please enter your name here