New Framework Boosts Long-Term User Engagement in Recommender Systems

Dingsu Wang, Filip Ryzner, Kelly He, Armando Ordorica, David Woo, Aditya Mantha, Liyao Lu, Usha Amrutha Nookala, Haoran Guo, Jiacong He, Olafur Gudmundsson, Matt Chun, Krystal Benitez, Dhruvil Deven Badani, Yijie Dylan Wang· July 17, 2026 View original

Summary

This paper introduces a model-agnostic framework for optimizing long-term user value in large-scale recommendation systems by learning downstream rewards. It identifies early observable behaviors predictive of future retention and derives reward signals from user action patterns across multiple sources.

Recommender systems traditionally focused on short-term user interactions, but the industry is shifting towards optimizing for long-term engagement and retention. Directly measuring retention is challenging due to sparse and delayed feedback signals. Existing solutions often involve complex, task-specific reward engineering and significant computational overhead, making them difficult to generalize across different platforms. Researchers have developed a new, unified framework designed to optimize long-term user value in large-scale recommendation systems. This model-agnostic approach learns downstream rewards by first identifying session-level behaviors that are both observable early in a user's journey and highly predictive of their future retention. It then derives various reward signals from observed user action patterns across diverse sources. The framework has been successfully deployed across multiple Pinterest surfaces, including Homefeed, Related Pins, Search, and Notifications. Online A/B experiments have consistently shown improvements in key engagement and retention metrics, demonstrating its practical effectiveness and scalability.

Why it matters

Professionals in product development and data science can leverage this framework to move beyond short-term metrics and build more sustainable, engaging user experiences that drive long-term value.

How to implement this in your domain

  1. 1Analyze existing user data to identify early behavioral signals that correlate with long-term retention.
  2. 2Implement an offline screening framework to validate the predictive power of these early signals.
  3. 3Develop and integrate model-agnostic downstream reward signals into current recommendation algorithms.
  4. 4Conduct A/B tests to measure the impact of the new reward signals on engagement and retention metrics.
  5. 5Iteratively refine the reward learning process based on experimental results and user feedback.

Who benefits

E-commerceSocial MediaMedia & EntertainmentSaaSGaming

Key takeaways

  • Optimizing for long-term user engagement is crucial for sustainable product growth.
  • This framework offers a model-agnostic way to learn retention-predictive reward signals.
  • Early observable behaviors can effectively predict future user retention.
  • Successful deployment on Pinterest demonstrates its practical applicability and benefits.

Original post by Dingsu Wang, Filip Ryzner, Kelly He, Armando Ordorica, David Woo, Aditya Mantha, Liyao Lu, Usha Amrutha Nookala, Haoran Guo, Jiacong He, Olafur Gudmundsson, Matt Chun, Krystal Benitez, Dhruvil Deven Badani, Yijie Dylan Wang

"arXiv:2607.14192v1 Announce Type: new Abstract: As recommender systems mature in the past few years, their optimization objectives have evolved from a primary focusing on short-term behavioral signals to a broader emphasis on long-term user engagement and retention. However, dire…"

View on X

Originally posted by Dingsu Wang, Filip Ryzner, Kelly He, Armando Ordorica, David Woo, Aditya Mantha, Liyao Lu, Usha Amrutha Nookala, Haoran Guo, Jiacong He, Olafur Gudmundsson, Matt Chun, Krystal Benitez, Dhruvil Deven Badani, Yijie Dylan Wang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses