Seer Accelerates Diffusion MLLMs by Truncating Redundant Output

Qicheng Zhao, Qi Sun, Zheyu Yan· July 17, 2026 View original

Summary

Seer is a training-free framework that accelerates Diffusion Multimodal Large Language Models (DMLLMs) by detecting the valid semantic boundary at the first denoising step using MLP activation sparsity. It performs one-shot truncation of redundant output, boosting throughput by up to 31x while maintaining or improving accuracy on complex visual tasks.

Diffusion Multimodal Large Language Models (DMLLMs) are highly effective for multimodal reasoning, but their inference efficiency is severely hampered by fixed-length generation constraints. Since the actual output length is unknown, sequences are padded to a maximum length, leading to substantial wasted computation on unnecessary end-of-sequence (EOS) tokens. This research introduces Seer, a training-free framework that addresses this inefficiency. Seer leverages a key discovery: DMLLMs implicitly reveal their valid semantic boundary at the very first denoising step through a distinct shift in MLP activation sparsity. By using a Signal-to-Noise Ratio (SNR)-based criterion, Seer detects this boundary and performs a one-shot truncation of the redundant suffix for all subsequent computations. To maintain these gains during batched serving, Seer employs a hybrid execution strategy that maximizes throughput while seamlessly accommodating dynamic sequence lengths. Experimental results demonstrate that Seer effectively eliminates padding waste, accelerating throughput by up to 31 times. Crucially, it robustly maintains overall performance across nine benchmarks and even improves accuracy on complex visual tasks by mitigating noise leakage.

Why it matters

For professionals deploying or developing DMLLMs, Seer offers a significant breakthrough in inference efficiency, drastically reducing computational costs and latency without requiring retraining, making these powerful models more practical for real-world applications.

How to implement this in your domain

  1. 1Evaluate current DMLLM inference pipelines for inefficiencies caused by fixed-length generation and padding.
  2. 2Investigate integrating training-free acceleration frameworks like Seer to optimize DMLLM throughput.
  3. 3Explore MLP activation sparsity as a signal for dynamic output truncation in generative models.
  4. 4Implement hybrid execution strategies to manage dynamic sequence lengths efficiently in batched serving environments.

Who benefits

AI InfrastructureCloud ComputingContent GenerationComputer VisionRobotics

Key takeaways

  • DMLLM inference is inefficient due to fixed-length generation and padding.
  • Seer is a training-free framework that accelerates DMLLMs by detecting semantic boundaries.
  • It uses MLP activation sparsity at the first denoising step for one-shot truncation.
  • Seer boosts throughput by up to 31x while maintaining or improving accuracy.

Original post by Qicheng Zhao, Qi Sun, Zheyu Yan

"arXiv:2607.14557v1 Announce Type: new Abstract: Diffusion Multimodal Large Language Models (DMLLMs) are highly effective for multimodal reasoning, yet their inference efficiency is significantly hindered by fixed-length generation constraints. Since the actual output length is un…"

View on X

Originally posted by Qicheng Zhao, Qi Sun, Zheyu Yan on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses