Model Card for nunchaku-qwen-image-edit

This repository contains Nunchaku-quantized versions of Qwen-Image-Edit, an image-editing model based on Qwen-Image, advances in complex text rendering. It is optimized for efficient inference while maintaining minimal loss in performance.

No recent news. Stay tuned for updates!

Model Details

Model Description

• Developed by: Nunchaku Team
• Model type: image-to-image
• License: apache-2.0
• Quantized from model: Qwen-Image-Edit

Model Files

• svdq-int4_r32-qwen-image-edit.safetensors: SVDQuant INT4 (rank 32) Qwen-Image-Edit model. For users with non-Blackwell GPUs (pre-50-series).
• svdq-int4_r128-qwen-image-edit.safetensors: SVDQuant INT4 (rank 128) Qwen-Image-Edit model. For users with non-Blackwell GPUs (pre-50-series). It offers better quality than the rank 32 model, but it is slower.
• svdq-int4_r32-qwen-image-edit-lightningv1.0-4steps.safetensors: SVDQuant INT4 (rank 32) 4-step Qwen-Image-Edit model by fusing Qwen-Image-Edit-Lightning-4steps-V1.0-bf16.safetensors using LoRA strength = 1.0. For users with non-Blackwell GPUs (pre-50-series).
• svdq-int4_r128-qwen-image-edit-lightningv1.0-4steps.safetensors: SVDQuant INT4 (rank 128) 4-step Qwen-Image-Edit model by fusing Qwen-Image-Edit-Lightning-4steps-V1.0-bf16.safetensors using LoRA strength = 1.0. For users with non-Blackwell GPUs (pre-50-series).
• svdq-int4_r32-qwen-image-edit-lightningv1.0-8steps.safetensors: SVDQuant INT4 (rank 32) 8-step Qwen-Image-Edit model by fusing Qwen-Image-Edit-Lightning-8steps-V1.0-bf16.safetensors using LoRA strength = 1.0. For users with non-Blackwell GPUs (pre-50-series).
• svdq-int4_r128-qwen-image-edit-lightningv1.0-8steps.safetensors: SVDQuant INT4 (rank 128) 8-step Qwen-Image-Edit model by fusing Qwen-Image-Edit-Lightning-8steps-V1.0-bf16.safetensors using LoRA strength = 1.0. For users with non-Blackwell GPUs (pre-50-series).
• svdq-fp4_r32-qwen-image-edit.safetensors: SVDQuant NVFP4 (rank 32) Qwen-Image-Edit model. For users with Blackwell GPUs (50-series).
• svdq-fp4_r128-qwen-image-edit.safetensors: SVDQuant NVFP4 (rank 128) Qwen-Image-Edit model. For users with Blackwell GPUs (50-series). It offers better quality than the rank 32 model, but it is slower.
• svdq-fp4_r32-qwen-image-edit-lightningv1.0-4steps.safetensors: SVDQuant NVFP4 (rank 32) 4-step Qwen-Image-Edit model by fusing Qwen-Image-Edit-Lightning-4steps-V1.0-bf16.safetensors using LoRA strength = 1.0. For users with Blackwell GPUs (50-series).
• svdq-fp4_r128-qwen-image-edit-lightningv1.0-4steps.safetensors: SVDQuant NVFP4 (rank 128) 4-step Qwen-Image-Edit model by fusing Qwen-Image-Edit-Lightning-4steps-V1.0-bf16.safetensors using LoRA strength = 1.0. For users with Blackwell GPUs (50-series).
• svdq-fp4_r32-qwen-image-edit-lightningv1.0-8steps.safetensors: SVDQuant NVFP4 (rank 32) 8-step Qwen-Image-Edit model by fusing Qwen-Image-Edit-Lightning-8steps-V1.0-bf16.safetensors using LoRA strength = 1.0. For users with Blackwell GPUs (50-series).
• svdq-fp4_r128-qwen-image-edit-lightningv1.0-8steps.safetensors: SVDQuant NVFP4 (rank 128) 8-step Qwen-Image-Edit model by fusing Qwen-Image-Edit-Lightning-8steps-V1.0-bf16.safetensors using LoRA strength = 1.0. For users with Blackwell GPUs (50-series).

Model Sources

• Inference Engine: nunchaku
• Quantization Library: deepcompressor
• Paper: SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
• Demo: svdquant.mit.edu

Usage

• Diffusers Usage: See qwen-image-edit.py and qwen-image-edit-lightning.py. Check this tutorial for more advanced usage.
• ComfyUI Usage: See nunchaku-qwen-image-edit.json.

Performance

Citation

@inproceedings{
  li2024svdquant,
  title={SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models},
  author={Li*, Muyang and Lin*, Yujun and Zhang*, Zhekai and Cai, Tianle and Li, Xiuyu and Guo, Junxian and Xie, Enze and Meng, Chenlin and Zhu, Jun-Yan and Han, Song},
  booktitle={The Thirteenth International Conference on Learning Representations},
  year={2025}
}