SyncAI.news, a Varaisys broadcasting
Embedding Foundation Model Predictions in Discrete-Choice Models with Structural Guarantees
YW

Yingshuo Wang, Xian Sun, Yanhang Li, Zhichao Fan, Zexin Zhuang

· 1 min read

ResearcharXiv cs.LG

Embedding Foundation Model Predictions in Discrete-Choice Models with Structural Guarantees

arXiv:2606.26432v2 Announce Type: replace Abstract: Tabular foundation models achieve strong accuracy on choice prediction tasks, but their predictions often violate the economic logic those tasks require: raising a price can increase predicted demand, implied estimates of willingness to pay are frequently negative or implausible, and unavailable alternatives receive nonzero probability. We propose TabFM-Logit, an adapter that takes a foundation model's predicted choice probabilities as a precomputed feature and embeds them inside a multinomial logit's utility. In Stage 1, we fit the multinomial logit's structural coefficients by maximum likelihood with sign constraints. In Stage 2, we freeze those coefficients and fit a small neural correction operating on the foundation model's predictions. We prove that this composition exactly preserves the multinomial logit's marginal rate of substitution, so the analytically computable value of time becomes a mathematical guarantee rather than an empirical accident, and that training the two stages jointly breaks identifiability of the structural coefficients. Counterfactual derivatives and response signs are therefore the multinomial logit's by construction, and the foundation model contributes accuracy on observed choices. On respondents and households unseen in training, the adapter gains 5.7-6.8 percentage points (pp) of test accuracy on Swissmetro, 1.5 pp on LPMC, and 3.3-3.6 pp on IoT-Wearables over the multinomial logit (4.2 pp on average), stays within 1.0 pp of the raw foundation model, maintains 100% cost monotonicity, and keeps the multinomial logit's values of time exactly. The gain is largest where the multinomial logit is weakest and smallest where it is already strong. In every case it comes with the multinomial logit's guarantees, which the raw foundation models lack.

Original source

This story was published by arXiv cs.LG and written by Yingshuo Wang, Xian Sun, Yanhang Li, Zhichao Fan, Zexin Zhuang. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on arxiv.org

Similar News