Physical Self-Supervised Learning Improves IMU Sensing.

Yuyang Leng (Richard), Renyuan Liu (Richard), Shaohan Hu (Richard), Peijun Zhao (Richard), Chun-Fu Chen (Richard), Songqing Chen, Shuochao Yao· July 22, 2026 View original

Summary

This paper introduces physical self-supervised learning, a label-free paradigm for IMU-based sensing that uses an auto-adaptive physics decoder instead of a neural one. It significantly reduces errors in inertial tracking and full-body motion capture by enforcing explicit physical structure and adapting across environments without manual labels.

The research presents a novel paradigm called physical self-supervised learning, designed to overcome the limitations of costly labeled data and poor robustness in IMU-based sensing. Unlike existing methods that still require some labeled data for domain adaptation, this approach eliminates the need for manual labels entirely. The core innovation lies in replacing the conventional neural decoder with an auto-adaptive physics decoder. This decoder is a learnable family of kinematic equations that not only enforces explicit physical structure but also adapts across diverse environments. The framework also incorporates a hybrid two-stage IMU encoder with reconstruction in a structured latent space to mitigate sensor noise, probabilistic frequency-spatial constraints to disentangle motion, a multi-view kinematic tree for sparse signals, and an uncertainty-aware formulation to handle inference ambiguity. This results in substantial error reductions for inertial tracking and motion capture across challenging generalization scenarios.

Why it matters

Eliminating the need for manual labels in IMU-based sensing drastically reduces development costs and time, making robust motion tracking and activity recognition more accessible and scalable for a wide range of applications.

How to implement this in your domain

  1. 1Evaluate the physical self-supervised learning framework for specific IMU-based applications, such as sports analytics or industrial worker safety.
  2. 2Integrate the auto-adaptive physics decoder into existing IMU data processing pipelines to reduce reliance on labeled datasets.
  3. 3Develop custom hardware or software interfaces to leverage the multi-view kinematic tree for enhanced sensing.
  4. 4Explore the application of this label-free approach in scenarios with highly heterogeneous IMU devices or placements.

Who benefits

Sports & FitnessHealthcare (rehabilitation)RoboticsGamingIndustrial Safety

Key takeaways

  • Physical self-supervised learning enables label-free IMU sensing, reducing data labeling costs.
  • It uses an auto-adaptive physics decoder to enforce physical structure and adapt to environments.
  • The framework significantly improves accuracy in inertial tracking and motion capture.
  • It offers robustness to heterogeneous devices, placements, and users without manual labels.

Original post by Yuyang Leng (Richard), Renyuan Liu (Richard), Shaohan Hu (Richard), Peijun Zhao (Richard), Chun-Fu Chen (Richard), Songqing Chen, Shuochao Yao

"arXiv:2607.18361v1 Announce Type: new Abstract: Deep neural networks have become a promising approach for IMU-based sensing, but their scalability is fundamentally limited by costly labeled data and poor robustness to heterogeneous devices, placements, and users. Existing unsuper…"

View on X

Originally posted by Yuyang Leng (Richard), Renyuan Liu (Richard), Shaohan Hu (Richard), Peijun Zhao (Richard), Chun-Fu Chen (Richard), Songqing Chen, Shuochao Yao on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses