CheckOne Offers Lightweight Fault Detection for Vision Transformers.

Researchers have introduced CheckOne, a new method designed to enhance the reliability of Vision Transformers (ViTs) in safety-critical applications. As ViTs become more prevalent, concerns about hardware faults impacting their performance and safety grow. While Algorithm-Based Fault Tolerance (ABFT) methods exist, they often come with significant computational overhead for ViTs. CheckOne addresses this by offering a lightweight and cost-effective solution for fault detection and mitigation. It provides symmetric protection across the various layers of ViTs, which is crucial for maintaining their integrity. Extensive experiments demonstrate that CheckOne can mitigate critical faults up to 26 times more effectively and achieves an average of 3.8 times higher performance compared to conventional ABFT methods, making ViTs more robust for demanding applications.