Flux on Runpod.io
Overcoming VRAM Limitations
Flux has two models, Dev and Schnell, which are rated to require upwards of 32GB VRAM. While there are other solutions available that allow you to run Flux under 12GB, to truly explore the power of this model and its higher resolutions, more VRAM is necessary.
Runpod Solution
As a user of RTX 4080 16GB on my local PC, I found a solution to overcome this VRAM limitation by using Runpod and their A40 GPU. For just $0.35 per hour, or half a cent per minute, this is an affordable and readily available option on their platform.
Running Flux on Runpod
I use the ComfyUI Image for Runpod, which provides the latest ComfyUI version with standard SD and SDXL models. To download the models, I created a JupyterLab Notebook with all the links, making it easy to download and use the required models. For Flux Dev, a Huggingface access Token is required, which is free and easy to obtain.
Step-by-Step Guide
To set up Flux on Runpod, simply upload the notebook provided (IPYNB) in the Workspace folder and double-click to open. Once launched, click on the play button for each cell with links and update the access token as necessary. The workflow will automatically download the required models and install the necessary nodes.
Conclusion
Using Runpod and their affordable GPU options, it’s now possible to run Flux without the need for 32GB VRAM. This solution is ideal for those who want to take advantage of the higher resolutions and capabilities of Flux but don’t have the necessary VRAM. With this solution, you can easily and affordably run Flux and unlock its full potential.
FAQs
Q: What is the cost of using Runpod?
A: The cost of using Runpod is $0.35 per hour, or half a cent per minute.
Q: Do I need a Huggingface access Token for Flux Dev?
A: Yes, a Huggingface access Token is required for Flux Dev, but it is free and easy to obtain.
Q: Can I customize the workflow settings?
A: Yes, you can modify the workflow settings to suit your needs.
Q: What if I encounter red boxes when loading the workflow?
A: Simply use the ComfyUI Manager to install the missing nodes.
Q: Is there a video walkthrough available?
A: Yes, a video walkthrough of my setup on Runpod is available on my YouTube channel.
