ORCA Enables Black-Box Online Adaptation for Time Series Foundation Models

Xilin Dai, Yiding Liu, Hongjie Xia, Yifan Hu, Zewei Dong, Jiang-Ming Yang, Qiang Xu· June 15, 2026 View original

Summary

Researchers introduce ORCA, a method for black-box online adaptation of Time Series Foundation Models (TSFMs) by learning the context of errors. This approach addresses the challenge of adapting closed-source TSFMs without access to internal parameters, significantly improving forecasting performance across diverse datasets.

Time Series Foundation Models (TSFMs) have greatly advanced zero-shot forecasting across various domains. As these models increasingly become commercialized, closed-source API services, traditional online adaptation methods that rely on white-box access for fine-tuning or gradient backpropagation become impractical. A new approach called ORCA (Online Residual Contextual Adaptation) has been proposed to enable black-box online adaptation for TSFMs. The core insight behind ORCA is that the predictive errors of a base model are conditioned on both its input and output, forming a "context of errors" that can be learned. Extensive experiments across 5 state-of-the-art TSFMs and 8 datasets demonstrate ORCA's effectiveness. Ablation studies further quantify the impact of different adapter learning hypotheses on adaptation performance in black-box scenarios, validating the approach's robustness and utility for real-world applications.

Why it matters

This research is critical for professionals who need to adapt powerful, proprietary Time Series Foundation Models to their specific, evolving data without direct access to the model's internals. It enables more accurate and reliable forecasting in dynamic business environments, from finance to supply chain.

How to implement this in your domain

  1. 1Explore black-box online adaptation techniques like ORCA for fine-tuning commercial or proprietary Time Series Foundation Models.
  2. 2Implement mechanisms to learn the "context of errors" by analyzing the relationship between model inputs, outputs, and prediction errors.
  3. 3Develop residual adaptation modules that can correct base model predictions without requiring access to internal parameters or gradients.
  4. 4Apply ORCA to improve forecasting accuracy in real-time applications where TSFMs are consumed as API services.
  5. 5Benchmark the performance of black-box adaptation strategies against traditional white-box methods to demonstrate their efficacy and practicality.

Who benefits

FinanceRetailSupply ChainEnergyManufacturing

Key takeaways

  • Black-box online adaptation is crucial for commercial Time Series Foundation Models offered as APIs.
  • ORCA learns the "context of errors" by analyzing base model inputs and outputs.
  • This approach significantly improves forecasting performance without requiring white-box access.
  • The method is robust and effective across various TSFMs and datasets.

Original post by Xilin Dai, Yiding Liu, Hongjie Xia, Yifan Hu, Zewei Dong, Jiang-Ming Yang, Qiang Xu

"arXiv:2606.14222v1 Announce Type: new Abstract: The rapid evolution of Time Series Foundation Models (TSFMs) has advanced zero-shot forecasting across diverse domains. Inspired by the current form of Large Language Models, future TSFMs may be offered as commercialized, closed-sou…"

View on X

Originally posted by Xilin Dai, Yiding Liu, Hongjie Xia, Yifan Hu, Zewei Dong, Jiang-Ming Yang, Qiang Xu on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses