RAG-HAR+ Boosts Cost-Efficient Human Activity Recognition on Edge

Hansi Karunarathna, Nirhoshan Sivaroopan, Chamara Madarasingha, Anura Jayasumana, Kanchana Thilakarathna· July 30, 2026 View original

Summary

RAG-HAR+ is an extension of Retrieval-Augmented Generation for Human Activity Recognition (RAG-HAR) that enhances retrieval and reduces LLM dependence for edge deployment. It uses an offline agent to design dataset-specific features and defers only uncertain cases to an LLM, maintaining performance while cutting LLM usage and inference time.

This paper introduces RAG-HAR+, an advanced framework for Human Activity Recognition (HAR) from wearable sensors, optimized for cost-efficient edge deployment. Building upon the existing RAG-HAR, which frames HAR as a training-free, retrieval-augmented task, RAG-HAR+ significantly strengthens its retrieval capabilities while minimizing reliance on Large Language Model (LLM) inference. Traditional deep learning HAR methods often demand extensive labeled data and retraining for new sensor settings or activity taxonomies. RAG-HAR+ addresses these challenges through a "retrieval-first" approach. It incorporates an offline Retrieval Designer Agent that intelligently selects dataset-specific feature groups from a diverse pool of motion descriptors. This allows for more precise comparison of sensor windows based on activity patterns. During inference, the system primarily uses majority voting from retrieved neighbors for samples with high confidence. Only cases deemed uncertain are then passed to an LLM-based Ambiguity Resolver Agent. This strategy enables RAG-HAR+ to achieve competitive or improved performance across six HAR benchmarks while substantially reducing LLM usage, token consumption, and inference time, demonstrating practical feasibility for mobile sensing.

Why it matters

Professionals developing edge AI solutions for human activity recognition can deploy more efficient, cost-effective, and adaptable systems, reducing reliance on expensive LLM inference while maintaining high accuracy.

How to implement this in your domain

  1. 1Adopt a retrieval-first architecture for edge-based HAR systems to minimize LLM inference costs and latency.
  2. 2Utilize an offline agent to design and optimize dataset-specific feature sets for improved retrieval accuracy in HAR.
  3. 3Implement a confidence-based deferral mechanism, sending only truly ambiguous cases to LLMs for classification.
  4. 4Explore RAG-HAR+'s principles for other edge AI applications where resource efficiency and adaptability are critical.

Who benefits

HealthcareFitnessSmart HomesWearable TechElderly Care

Key takeaways

  • RAG-HAR+ enhances Human Activity Recognition (HAR) for edge devices by optimizing retrieval and reducing LLM dependence.
  • An offline agent designs dataset-specific features for better sensor window comparison.
  • The system uses majority voting for confident predictions, deferring only uncertain cases to an LLM.
  • RAG-HAR+ maintains performance while significantly cutting LLM usage, token consumption, and inference time.

Original post by Hansi Karunarathna, Nirhoshan Sivaroopan, Chamara Madarasingha, Anura Jayasumana, Kanchana Thilakarathna

"arXiv:2607.26631v1 Announce Type: new Abstract: Human Activity Recognition (HAR) from wearable sensors supports applications in healthcare, rehabilitation, fitness tracking, and smart environments. Yet, existing deep learning approaches require dataset-specific training, large la…"

View on X

Originally posted by Hansi Karunarathna, Nirhoshan Sivaroopan, Chamara Madarasingha, Anura Jayasumana, Kanchana Thilakarathna on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses