
SZ
Shulian Zhang, Xiangyu Shu, Wenbo Li, Jian Chen, Yong Guo
· 1 min read
ResearcharXiv cs.CV
Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering
arXiv:2609.34178v1 Announce Type: new
Abstract: Video text editing aims to replace or add text in a video while keeping the rest of the video unchanged, which requires the edited text to be correct in every frame and to move coherently with the scene. Despite the remarkable progress of video diffusion models, they struggle to reproduce exact stroke structures and often produce garbled or wrong characters, especially for characters with complex strokes. To address this, we propose a trajectory-aligned glyph rendering reference that provides explicit per-frame glyph guidance following the position and perspective of the text, and a depth-normalized recognizer feature supervision that supervises the generated text on multi-depth features of a frozen text recognizer with per-depth normalized errors, targeting stroke errors overlooked by the diffusion loss. We further build VTEdit, a benchmark of 288 real-scene clips with 440 annotated text trajectories covering text replacement and text addition, which will be publicly released to facilitate future research. Experiments on VTEdit show that our method outperforms image text editing methods, video editing methods, and commercial models in text accuracy and background preservation, achieving a sentence accuracy of 0.9408, and receives the highest preference in a user study.
Original source
This story was published by arXiv cs.CV and written by Shulian Zhang, Xiangyu Shu, Wenbo Li, Jian Chen, Yong Guo. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


