SkillTFM Enables Training-Free Adaptation for Tabular Foundation Models

Yi He, Zhengkang Guan, Anpeng Wu, Peng Cui, Fei Wu, Kun Kuang· August 7, 2026 View original

Key takeaways

  • SkillTFM enables training-free adaptation of Tabular Foundation Models (TFMs).
  • It uses a verifiable skill bank and gated skill evolution to adapt to new tasks.
  • The system significantly improves AUC and handles distribution shifts effectively.
  • SkillTFM reduces the need for costly fine-tuning and labeled data.

Who benefits

Financial ServicesHealthcareE-commerceManufacturingGovernment

Summary

SkillTFM is a novel training-free system that adapts Tabular Foundation Models (TFMs) to new tasks by evolving agentic skills rather than parameter updates. It uses a verifiable skill bank with boundary evidence identification and gated skill evolution, significantly improving AUC and addressing distribution shifts and heterogeneous feature semantics.

Tabular data is pervasive across many industries, driving predictions and decisions in science, finance, healthcare, and more. Tabular Foundation Models (TFMs) offer a promising paradigm for general-purpose tabular learning, aiming to provide reusable predictors that reduce the need for extensive task-specific training and tuning. However, their practical deployment is often hindered by challenges like distribution shifts, varied feature semantics, and unique task patterns that are difficult to capture without costly fine-tuning or additional labeled data. To address these limitations, researchers propose SkillTFM, a training-free system that redefines TFM adaptation. Instead of updating model parameters, SkillTFM focuses on the gated evolution of "agentic skills." At its core, SkillTFM features a verifiable and extensible skill bank. This bank combines boundary evidence identification, which characterizes task structure and identifies base-model failure patterns, with gated skill evolution, which retrieves and extends reusable skills under explicit validation. Experiments conducted across simulated boundary settings and real-world electricity-price forecasting demonstrate SkillTFM's effectiveness. It improved AUC by 0.128–0.142 and raised nonlinear-boundary AUC from 0.699 to 0.898. Furthermore, its efficacy and generality were confirmed across various TFM backbones, validating the power of skill-based adaptation for tabular data.

Why it matters

Professionals working with tabular data can leverage SkillTFM to rapidly adapt powerful foundation models to new, specific tasks without the need for expensive fine-tuning or large amounts of labeled data, accelerating deployment and reducing development costs.

How to implement this in your domain

  1. 1Evaluate existing tabular data pipelines and identify areas where foundation models struggle with distribution shifts or require extensive fine-tuning.
  2. 2Explore the SkillTFM framework for adapting pre-trained tabular foundation models to new, label-scarce tasks without parameter updates.
  3. 3Develop or integrate a "skill bank" mechanism that can identify task structures and retrieve or evolve reusable skills for specific tabular prediction problems.
  4. 4Benchmark SkillTFM's performance against traditional fine-tuning approaches on real-world tabular datasets to quantify improvements in accuracy and efficiency.

Original post by Yi He, Zhengkang Guan, Anpeng Wu, Peng Cui, Fei Wu, Kun Kuang

"arXiv:2608.06137v1 Announce Type: new Abstract: Tabular data are ubiquitous in real-world applications and are crucial for data-driven prediction and decision-making across science, industry, finance, healthcare, and public services. Tabular foundation models (TFMs) have emerged…"

View on X

Originally posted by Yi He, Zhengkang Guan, Anpeng Wu, Peng Cui, Fei Wu, Kun Kuang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses