Inverse-and-Edit: Simple and Effective Framework for Fast Image Editing

arXiv:2506.19103v2 Announce Type: replace Abstract: Diffusion-based text-to-image models have recently been distilled into few-step samplers and fast generators, reducing inference cost while maintaining high image quality. However, text-guided editing with such accelerated backbones remains challenging: inversion in a small number of steps is unreliable, local errors accumulate along the trajectory, and existing fast-editing methods typically rely on backbone-specific inversion procedures, which limits their transferability. In this work, we propose a simple and universal framework for text-guided image editing with arbitrary accelerated diffusion and flow-matching models. Instead of optimizing local, per-timestep objectives, we directly minimize a global editing objective over the entire inversion-generation trajectory. The framework fine-tunes only 1.5-7 % of the base-model parameters through two lightweight LoRA adapters (forward and backward), trained on fewer than 10 K triplets from the publicly available HQ-Edit dataset. We validate our method on three architecturally distinct backbones: consistency-distilled SD1.5 LCM-Dreamshaper, adversarial-distilled SDXL-Turbo, and rectified-flow-distilled Z-Image-Turbo. On PIE-Bench, our method achieves the strongest editing alignment within each backbone family while ensuring a strong level of content preservation. Inference adds no extra steps beyond the standard inversion and editing passes. The project page with visual results is available at iliabeletskii.github.io/inverse-and-edit.