Ghost Attractor Networks Offer Efficient, Controllable AI for Sequential Generation.

Tianyu Wang, Ying Wang, Zhihao Liu, Xi Vincent Wang, Lihui Wang· June 18, 2026 View original

Summary

Ghost Attractor Networks (GANs) are introduced as a novel dynamical decoder for sequential output generation, offering significant efficiency improvements over large Transformers and diffusion models. This new architecture provides structured latent representations crucial for closed-loop control, enabling more effective robotic action decoding.

Traditional large-scale Transformer and diffusion decoders for sequential output generation face challenges with memory consumption and iterative computation, especially as sequence length increases. While smaller feed-forward decoders can improve efficiency, they often lack the structured latent representations needed for advanced closed-loop control, such as phase-conditioned action generation. A new approach, Ghost Attractor Networks (GANs), addresses these limitations by introducing a theoretically derived dynamical decoder. This model's latent space evolves under a learned potential, inherently creating a basin-attractor structure. This design supports multi-modality, single-pass switching, and constant memory usage, with mode transitions occurring through saddle-node bifurcations. Empirical evaluations show that a 2.3-million-parameter Ghost model achieves comparable offline accuracy to a 1.07-billion-parameter Diffusion Transformer, but with significantly fewer parameters (462x less) and lower latency (32x less). When applied as a robotic action decoder on the LIBERO-10 benchmark, Ghost demonstrated a 13.5 percentage-point improvement in success rate over a feed-forward MLP baseline through phase conditioning, reaching a 95.7% success rate with persistent-latent ensembling.

Why it matters

This research offers a path to developing more efficient and controllable AI systems for tasks requiring sequential generation, potentially reducing computational costs and enabling more sophisticated real-time applications in robotics and other domains. Professionals can leverage this for deploying high-performance models in resource-constrained environments.

How to implement this in your domain

  1. 1Explore Ghost Attractor Networks for deploying AI models in edge computing or real-time control systems where memory and latency are critical.
  2. 2Investigate the potential of basin-structured latents for improving closed-loop control in robotic systems or autonomous agents.
  3. 3Benchmark existing sequential generation models against the Ghost architecture for specific applications to assess potential efficiency gains.
  4. 4Consider integrating the principles of dynamical decoders into new AI system designs to achieve better control and interpretability of latent spaces.

Who benefits

RoboticsAutonomous SystemsEdge AIManufacturingGaming

Key takeaways

  • Ghost Attractor Networks offer a highly efficient alternative to large Transformer and diffusion models for sequential generation.
  • The architecture provides structured latent representations essential for robust closed-loop control.
  • Significant reductions in parameter count and latency are achievable without sacrificing accuracy in certain applications.
  • This approach has shown strong empirical performance in robotic action decoding tasks.

Original post by Tianyu Wang, Ying Wang, Zhihao Liu, Xi Vincent Wang, Lihui Wang

"arXiv:2606.18315v1 Announce Type: new Abstract: Sequential output generation with large-scale Transformer and diffusion decoders pays a memory cost that grows with sequence length, plus iterative per-step computation. Replacing them with small feed-forward decoders restores effic…"

View on X

Originally posted by Tianyu Wang, Ying Wang, Zhihao Liu, Xi Vincent Wang, Lihui Wang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses