New Adapter Embeds Foundation Model Predictions in Choice Models

Yingshuo Wang, Xian Sun, Yanhang Li, Zhichao Fan, Zexin Zhuang· June 26, 2026 View original

▶ The 2-minute explainer

Summary

This paper introduces a two-stage adapter that embeds foundation model predictions into discrete-choice models, specifically multinomial logit, while guaranteeing economic logic. It ensures properties like cost monotonicity and plausible willingness-to-pay estimates, significantly improving accuracy over traditional logit models without violating structural constraints.

Foundation models are increasingly accurate in choice prediction tasks, yet their predictions often lack the economic consistency required for real-world applications. Issues include illogical outcomes like increased demand with higher prices, implausible willingness-to-pay estimates, and non-zero probabilities for unavailable options. This research addresses these shortcomings by proposing a novel two-stage adapter. The adapter is designed to integrate the choice probabilities predicted by a foundation model as a precomputed feature within the utility function of a multinomial logit model. In the first stage, the structural coefficients of the multinomial logit are fitted using maximum likelihood, incorporating necessary sign constraints to enforce economic principles. The second stage then freezes these structural coefficients and fits a small neural correction layer that operates directly on the foundation model's predictions. A key theoretical contribution is the proof that this composition precisely preserves the multinomial logit's marginal rate of substitution. This ensures that analytically computable values, such as the value-of-time, become a mathematical guarantee rather than an empirical coincidence. Across three datasets and two foundation models, the adapter demonstrated an average accuracy gain of 6.4 percentage points over the standard multinomial logit, maintained 100% cost monotonicity, and produced value-of-time estimates within established economic ranges for transportation datasets. The system also showed graceful degradation under context restriction, retaining significant accuracy gains even with limited foundation model input.

Why it matters

For professionals in economics, marketing, and policy-making who use discrete-choice models, this innovation allows leveraging powerful foundation models for prediction while maintaining critical economic interpretability and structural guarantees. It enables more accurate and trustworthy models for consumer behavior, policy impact, and market analysis.

How to implement this in your domain

  1. 1Identify choice prediction tasks where foundation models are used but economic consistency is critical.
  2. 2Implement the two-stage adapter to embed foundation model predictions into discrete-choice models.
  3. 3Apply sign constraints during the first stage of fitting to enforce economic logic.
  4. 4Evaluate the adapter's performance on accuracy, cost monotonicity, and the plausibility of derived economic values.

Who benefits

EconomicsMarketingTransportationPublic PolicyRetail

Key takeaways

  • Foundation model predictions often violate economic logic in choice tasks.
  • A two-stage adapter embeds foundation model predictions into discrete-choice models.
  • The adapter guarantees economic properties like cost monotonicity and plausible willingness-to-pay.
  • It significantly improves prediction accuracy while maintaining structural interpretability.

Original post by Yingshuo Wang, Xian Sun, Yanhang Li, Zhichao Fan, Zexin Zhuang

"arXiv:2606.26432v1 Announce Type: new Abstract: Tabular foundation models achieve strong accuracy on choice prediction tasks, but their predictions often violate the economic logic those tasks require: raising a price can increase predicted demand, implied willingness-to-pay esti…"

View on X

Originally posted by Yingshuo Wang, Xian Sun, Yanhang Li, Zhichao Fan, Zexin Zhuang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses