LLMs Abstract User Actions into Interpretable Workflows Across Diverse Applications.

Gaurav Verma, Scott Counts· June 15, 2026 View original

Summary

WorkflowView, a new framework, uses large language models to transform low-level, noisy user action sequences from digital applications into high-level, interpretable activities. This approach demonstrates effectiveness and generality across various domains, including browser logs, MOOC interactions, and document workflows.

Understanding how users interact with digital applications is crucial for product improvement, but raw interaction logs are often too granular and noisy to yield clear insights. Traditional deep learning methods for clustering user actions into higher-level activities have struggled with noise sensitivity and cross-application generalization. A new framework called WorkflowView addresses these limitations by leveraging large language models (LLMs) to abstract these low-level action sequences into meaningful, high-level activities. This method has been tested across three distinct and challenging sequential tasks, proving its effectiveness and versatility. For instance, it can reconstruct task descriptions from browser logs with high semantic similarity, predict student dropout from MOOC logs with high accuracy using minimal examples, and perform privacy-preserving analysis of AI tool integration in document workflows. This research highlights LLM-based abstraction as a robust and efficient way to convert behavioral data into actionable insights, with practical considerations for deployment efficiency and user privacy.

Why it matters

Professionals can gain deeper, more actionable insights into user behavior and product usage, enabling data-driven improvements and personalized experiences. This framework simplifies the analysis of complex interaction data, making it accessible for product managers, UX designers, and data analysts.

How to implement this in your domain

  1. 1Integrate LLM-based abstraction into existing user logging and analytics pipelines.
  2. 2Apply WorkflowView to analyze user journeys in your digital products for pain points and optimization opportunities.
  3. 3Develop custom prompts and few-shot examples to tailor LLM abstraction to specific application domains.
  4. 4Prioritize user privacy and computational efficiency when deploying LLM-based inference in production environments.

Who benefits

Software DevelopmentEdTechE-commerceMarketingProduct Management

Key takeaways

  • WorkflowView uses LLMs to abstract low-level user actions into high-level, interpretable workflows.
  • The framework is robust and generalizes across diverse applications and domains.
  • It provides actionable insights for improving digital products based on real-world user interactions.
  • Practical deployment considerations include computational efficiency and user privacy.

Original post by Gaurav Verma, Scott Counts

"arXiv:2606.14654v1 Announce Type: new Abstract: Sequential or time-stamped interaction logs provide objective records of digital application usage, yet their granularity and noise often obscure meaningful insights into people's work. Such insights are essential for improving digi…"

View on X

Originally posted by Gaurav Verma, Scott Counts on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses