Personal Data Crucial for PPG Emotion Detection AI.

Dominika Kunc, Przemys{\l}aw Kazienko, Stanis{\l}aw Saganowski· August 18, 2026 View original

Key takeaways

  • General SSL representations from PPG are effective for objective tasks.
  • They are insufficient for subjective real-life emotion detection.
  • Personalization with individual data is crucial for accurate emotion recognition.
  • Future emotion AI needs to prioritize individual-specific fine-tuning.

Who benefits

Wearable TechDigital HealthMental HealthHuman-Computer Interaction

Summary

This study found that while Self-Supervised Learning (SSL) effectively extracts general representations from physiological signals (PPG) for objective tasks, these general representations fail for subjective real-life emotion detection. Personalization with individual data during fine-tuning proved to be the main driver of performance for emotion recognition.

Researchers investigated the effectiveness of Self-Supervised Learning (SSL) in extracting general representations from photoplethysmography (PPG) signals for real-life emotion detection. They first pre-trained a Real-Life PPG encoder (RL-PPG) on unconstrained data and confirmed its strong transferability to an objective task, such as physical activity recognition, where it significantly outperformed baselines. This demonstrated the SSL model's ability to learn robust general features from noisy physiological data. However, when these same general representations were applied to the highly subjective task of real-life emotion detection, they failed to surpass naive baselines in a leave-one-subject-out evaluation. The study found that incorporating an individual's personal data during the fine-tuning phase was the critical factor for achieving predictive performance, outweighing the benefits of population-level pre-training. This suggests that for subjective affective inference, general SSL representations alone are insufficient, and personalization is a key component for successful real-world emotion recognition systems. The code and pre-trained weights are shared to support future research.

Why it matters

This research highlights a critical limitation of general SSL models for highly subjective tasks like emotion detection, emphasizing the necessity of personalization for accurate and practical applications in areas like mental health monitoring or human-computer interaction.

How to implement this in your domain

  1. 1Design emotion detection AI systems with a strong emphasis on personalized fine-tuning data.
  2. 2Collect individual-specific physiological data for training models intended for subjective tasks.
  3. 3Develop adaptive AI models that continuously learn from individual user feedback and data.
  4. 4Re-evaluate the scope of general SSL models for highly subjective physiological signal analysis.

Original post by Dominika Kunc, Przemys{\l}aw Kazienko, Stanis{\l}aw Saganowski

"arXiv:2608.14675v1 Announce Type: new Abstract: While Self-Supervised Learning (SSL) effectively extracts general representations from noisy, unconstrained physiological signals such as photoplethysmography (PPG), its suitability for highly subjective tasks remains unproven. In t…"

View on X

Originally posted by Dominika Kunc, Przemys{\l}aw Kazienko, Stanis{\l}aw Saganowski on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses