SyncAI.news, a Varaisys broadcasting
Closing the Cross-Dialect Gap: Query Plans as a Portable Interface in Text-to-SQL
CR

Corentin Royer (IBM Research, Zurich, Switzerland, ETH Zurich, Zurich, Switzerland), Robin Oester (IBM Research, Zurich, Switzerland), Yotam Perlitz (IBM Research, Zurich, Switzerland), Yannick Metz (ETH Zurich, Zurich, Switzerland), Andrea Giovannini (IBM Research, Zurich, Switzerland), Mennatallah El-Assady (ETH Zurich, Zurich, Switzerland)

· 1 min read

ResearcharXiv cs.CL

Closing the Cross-Dialect Gap: Query Plans as a Portable Interface in Text-to-SQL

arXiv:2609.33670v1 Announce Type: new Abstract: Text-to-SQL systems are typically trained and evaluated on a single dialect (SQLite), yet production deployments span PostgreSQL, MySQL, ClickHouse, and beyond. We show that this single-dialect assumption leads to a substantial drop in cross-dialect accuracy for every model we tested. The drop persists across scale, architecture, and even purpose-built text-to-SQL systems. We argue that the fix is to change the generation target: instead of asking an LLM to emit dialect-specific SQL, we have it emit a dialect-agnostic relational algebra query plan, which a deterministic compiler then renders into SQL for any supported backend. Across thirteen models from 3B to frontier scale, this restores cross-dialect portability nearly uniformly, at a small cost in peak accuracy on the model's home dialect for capable prompted models and none once fine-tuned on plans; under matched fine-tuning, plan supervision yields a stronger model than SQL supervision. We also introduce MetricName, a question-aware result-set comparator needed to evaluate fairly across dialects, where existing metrics confound semantic errors with benign cross-dialect variation. More broadly, the result is a reminder that a generation target chosen for execution is not necessarily the one that maximizes generation quality.

Original source

This story was published by arXiv cs.CL and written by Corentin Royer (IBM Research, Zurich, Switzerland, ETH Zurich, Zurich, Switzerland), Robin Oester (IBM Research, Zurich, Switzerland), Yotam Perlitz (IBM Research, Zurich, Switzerland), Yannick Metz (ETH Zurich, Zurich, Switzerland), Andrea Giovannini (IBM Research, Zurich, Switzerland), Mennatallah El-Assady (ETH Zurich, Zurich, Switzerland). SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News