SyncAI.news, a Varaisys broadcasting
TabDAG: Structured Evolutionary Search for Tabular Feature Engineering
AV

Anastasia Volkova (FusionBrain Lab), Andrey Kuznetsov (FusionBrain Lab), Ivan Oseledets (AXXX), Valentin Khrulkov (FusionBrain Lab, AXXX)

· 1 min read

ResearcharXiv cs.LG

TabDAG: Structured Evolutionary Search for Tabular Feature Engineering

arXiv:2611.22828v1 Announce Type: cross Abstract: Feature engineering can improve tabular prediction, but useful transformations are compositional, data-dependent, and subject to leakage constraints. We present TabDAG, a framework that combines evolutionary search with a graph representation of feature-engineering programs. Nodes implement row-wise or data-fitted transformations; edges encode dependencies among raw variables, intermediate values, and final features. The representation supports interactions, statistical encodings, clustering- and neighborhood-based features, and multi-stage compositions in a single executable program. Mutations are structured edits constrained by a parent-specific schema and checked before evaluation. In our experiments, no structurally invalid program reached evaluation, although proposals could be rejected and valid graphs could still fail at runtime. Across ten regression and classification datasets and three tabular model families, evolved features improve predictive performance over raw inputs. TabDAG and its combination with OpenFE achieve the two best mean ranks among the compared methods; pairwise rank differences between feature-engineering methods do not survive multiple-testing correction. The LLM-based searches use the same backbone and candidate-evaluation budget. A controlled ablation compares free-form Python, whole-graph JSON, and constrained graph edits with the search engine, budget, and backbone held fixed. Constrained edits yield fewer failed evaluations than either rewrite baseline. The resulting graphs expose the transformations and dependencies selected by search, enabling feature-level analysis of the observed gains.

Original source

This story was published by arXiv cs.LG and written by Anastasia Volkova (FusionBrain Lab), Andrey Kuznetsov (FusionBrain Lab), Ivan Oseledets (AXXX), Valentin Khrulkov (FusionBrain Lab, AXXX). SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News