View source for Install ComfyUI

= What is ComfyUI =
'''ComfyUI''' is a powerful and modular graphical interface for running and creating '''Stable Diffusion''' workflows for generating images and videos from text or images.

It allows you to build complex diffusion pipelines visually by connecting nodes, without needing to write code. It is designed for flexibility, performance, and transparency, letting you see exactly how each part of a [[Diffussion models|diffusion model]] (VAE, CLIP, sampler, etc.) is connected and processed.

= Installation =

== Installing on linux ==

Make sure you have '''Python 3.10 or higher''' and '''git''' installed:

<syntaxhighlight lang="bash">
sudo apt install python3 python3-venv python3-pip git
</syntaxhighlight>

Clone the ComfyUI repository:

<syntaxhighlight lang="bash">
git clone https://github.com/comfyanonymous/ComfyUI.git
cd ComfyUI
</syntaxhighlight>

Create a virtual environment and install dependencies:

<syntaxhighlight lang="bash">
python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt
</syntaxhighlight>

'''Install NVIDIA dependencies'''<syntaxhighlight lang="bash">
pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu130
pip install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu130

</syntaxhighlight>Run ComfyUI:

<syntaxhighlight lang="bash">
python main.py
</syntaxhighlight>

The interface will open in your browser at

'''http://127.0.0.1:8188'''

== Installing and running on windows ==

# [https://github.com/comfyanonymous/ComfyUI/releases/latest/download/ComfyUI_windows_portable_nvidia.7z Download comfyUI]
# Unzip the downloaded file
# Double click either run nvidia_gpu.bat or run cpu.bat depending on your computer’s configuration to launch ComfyUI.
# You can access to http://127.0.0.1:8188 when you see it in the opened window.

= Understanding workflows and nodes =

== What workflows are ==
A '''workflow''' in ComfyUI is a graph that defines how data (text prompts, models, images, etc.) flows between nodes to generate an output media.

Example workflow of image to video:
[[File:ComfUI example i2v.png|none|thumb|484x484px]]This is the file with the previous workflow in json format: [[File:ComfyUI image to video example workflow.json|none|thumb]]

Each workflow is saved as a .json file that can be shared or loaded into ComfyUI. They are stored in your '''ComfyUI/user/default/workflows''' folder.

== What nodes are ==
Nodes are the building blocks of a workflow. Each node performs a specific task, such as:

* loading a model
* encoding a text prompt
* generating noise
* decoding the latent image

Nodes are connected through inputs and outputs, creating a chain of operations that define the diffusion process.

Common node types include:

'''Checkpoint Loader''' - loads the main diffusion model

'''VAE Loader''' - loads a Variational Autoencoder

'''CLIP Text Encoder''' - processes text prompts

'''Sampler''' - controls the diffusion steps

'''Save Image''' - exports the final result

You can double-click on the canvas to add new nodes or search for them by name.

= Workflow templates and dependencies =
You can import a workflows by:

* dragging directly into the interface a JSON file or media (image or video) generated with comfyUI
* On the right sidebar, in the "Templates" menu, you can find many different workflows for all type of media.
When loading workflows, they might have nodes that are not installed yet on your system. To install them, click on "Manager" at the top right of the interface, then on "Install missing custom nodes".

= ComfyUI folder structure =

ComfyUI organizes its files in:

'''/ComfyUI/models/unet''' - diffussion models

'''/ComfyUI/models/vae''' - Variational Autoencoders (VAEs)

'''/ComfyUI/models/clip''' - CLIP encoders for text and image embeddings

'''/ComfyUI/models/checkpoints''' - checkpoints that contain with model, vae and clip loader.

'''/ComfyUI/custom_nodes''' - external or user-made node scripts

'''/ComfyUI/output''' - generated media

'''ComfyUI/user/default/workflows''' - saved workflow files in JSON format

= Loading assets on your workflow =
Depending on how much VRAM does your graphics card has and how much RAM you have, you will be able to use resources up to the total amount of memory you have.

'''Example'''

* Computer available memory 56GB, distributed in:
** graphics card VRAM: 24GB
** computer RAM: 32GB

* Resources on nodes 38,5GB:
** Model wan2.2_i2v_high_noise_14B_Q8_0.gguf : 15GB
** Model wan2.2_i2v_low_noise_14B_Q8_0.gguf : 15GB
** LoRA wan2.2_i2v_A14b_high_noise_lora_rank64_lightx2v_4step_1022.safetensors: 0,6GB
** LoRA wan2.2_i2v_A14b_low_noise_lora_rank64_lightx2v_4step_1022.safetensors: 0,7GB
** VAE wan_2.1_vae.safetensors: 0,3GB
** Text Encoder umt5_xxl_fp8_e4m3fn_scaled.safetensors: 6,7GB
* ComfyUI processing and temporary data: 10-20% of assets

With this configuration, we would fit the requirements, as we have 56GB of memory and the process requires less than 50GB.

If comfyUI stops abruptly, it's probably due to an excessive usage of memory. You will have to reduce the size of the assets you are using.

= Assets resources =

== Previous examples resources ==

'''Wan GGUFs (Models). Destiny folder: models/unet'''

https://huggingface.co/bullerwins/Wan2.2-I2V-A14B-GGUF/tree/main

'''Wan VAE. Destiny folder: models/vae'''

https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/vae

'''Wan sampling LoRAs. Destiny folder: models/loras'''

https://huggingface.co/lightx2v/Wan2.2-Distill-Loras/tree/main

'''Wan ext encoder. Destiny folder: models/text_encoders'''

https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/tree/main/split_files/text_encoders

== LoRAs resources ==
You can use additional LoRAs in your workflow to get better results for specific prompts. Your can get them from:

https://civitai.com/

'''IMPORTANT:''' LoRAs are trained using specific Models (Wan, Flux, SD, etc). Make sure that the LoRAs you download use your base model. Otherwise, change your base model to use LoRA's.
[[index.php?title=Category:AI: Generate media locally]]