Rare Concept Generation via Counterfactual Inference in Diffusion Models
Researchers introduce CI-Diff, a diffusion model that applies counterfactual inference to improve the generation of images depicting rare concepts with unusual attributes. By reformulating classifier-free guidance, CI-Diff aims to reduce common knowledge bias and better capture atypical features in text-to-image synthesis. Experiments on the RareBench benchmark show that CI-Diff outperforms previous state-of-the-art diffusion models for rare concept generation.
Why it matters: This work demonstrates a novel application of causal inference to address a key limitation in diffusion models, enabling more accurate generation of rare or atypical concepts in text-to-image tasks.
Full story at: arXiv Computer Vision ↗