SyncAI.news, a Varaisys broadcasting
Synthesis and editing of multi-instrument audio mixtures using scalar-quantised latents with MIDI Span conditioning
SC

Sungkyun Chang, Keshav Bhandari, Simon Dixon, Emmanouil Benetos

· 1 min read

ResearcharXiv cs.LG

Synthesis and editing of multi-instrument audio mixtures using scalar-quantised latents with MIDI Span conditioning

arXiv:2609.25546v1 Announce Type: cross Abstract: Music creation often involves iterative refinement, changing selected musical details while retaining the rest. To support such refinement, we introduce SpanSynth-Edit, a flow-matching model for MIDI-guided synthesis and editing of multi-instrument audio mixtures using low-frame-rate scalar-quantised latents. MIDI Span encodes instrument-labelled note lifecycles as unordered event sets with continuous-valued attributes and pools each set into one conditioning vector per audio-latent frame. The model uses contextual audio for instrument-specific timbre guidance and supports editing by resynthesising the target region from revised MIDI. Experiments on single- and multi-instrument benchmarks show competitive performance and demonstrate within-frame onset control. We also discuss limitations of transcription-based note-adherence evaluation.

Original source

This story was published by arXiv cs.LG and written by Sungkyun Chang, Keshav Bhandari, Simon Dixon, Emmanouil Benetos. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News