GGUF quantizations of Black Forest Labs' FLUX 3 Image Klein (16-step distilled checkpoint) for use with ComfyUI-GGUF.
A pre-configured Text-to-Image (T2I) workflow is included in this repository:
A pre-configured Image-edit (I2I) workflow is included in this repository:
(Simply drag and drop the JSON file directly into ComfyUI)
| Filename | Quant Type | Size | Quality Tier | Recommended Use Case / Target Hardware |
|---|---|---|---|---|
flux3_image_klein_sd_Q2_K.gguf | Q2_K | 1.99 GB | β οΈ Experimental | Extreme low memory / dry-run testing only (lossy, prone to visual artifacts) |
flux3_image_klein_sd_Q3_K_S.gguf | Q3_K_S | 2.55 GB | Acceptable | Ultra-budget / low VRAM setups (6 GB GPUs) |
flux3_image_klein_sd_Q3_K_M.gguf | Q3_K_M | 2.55 GB | Good | Budget 6 GBβ8 GB GPUs (slightly better attention retention than _S) |
flux3_image_klein_sd_Q4_K_S.gguf | Q4_K_S | 3.27 GB | Very Good | 8 GB GPUs (lean footprint, strong prompt adherence) |
flux3_image_klein_sd_Q4_K_M.gguf | Q4_K_M | 3.27 GB | Very Good | 8 GBβ12 GB GPUs (balanced standard for everyday inference) |
flux3_image_klein_sd_Q5_K_S.gguf | Q5_K_S | 3.95 GB | Excellent | 10 GBβ12 GB GPUs (high fidelity, lean weight footprint) |
flux3_image_klein_sd_Q5_K_M.gguf | Q5_K_M | 3.95 GB | β Best Value | 12 GB GPUs (sweet spot between visual fidelity and generation speed) |
flux3_image_klein_sd_Q6_K.gguf | Q6_K |
Place the downloaded files into your ComfyUI models directory:
π ComfyUI/models/
βββ π diffusion_models/ (or models/unet/)
β βββ flux3_image_klein_sd_Q5_K_M.gguf <-- (Your chosen quant from this repo)
βββ π text_encoders/
β βββ qwen3vl_4b_int8_convrot.safetensors <-- (From official BFL repo)
βββ π vae/
βββ flux2-vae.safetensors <-- (From official BFL repo)
Auxiliary Models Required:
- Text Encoder:
qwen3vl_4b_int8_convrot.safetensors(or BF16) from BFL repo text_encoders.- VAE:
flux2-vae.safetensorsfrom BFL repo vae.
eulersimple4-161.0 (Guidance is distilled into the model; leave CFG at 1.0)Governed under the FLUX Kommunity License v1.0.
| Near-Lossless |
| 12 GBβ16 GB GPUs (imperceptible difference from master BF16) |
flux3_image_klein_sd_Q8_0.gguf | Q8_0 | 5.99 GB | Reference Grade | 16 GB+ GPUs (bit-exact reference fidelity, zero perceptible degradation) |