MEL Improves EEG-to-fMRI Translation with Coordinate-Preserving Tokenization.

Xiangyu Liu, Zeting Yan, Zhitong Yin, Boyang Li, Xi Zhang· September 1, 2026 View original

Key takeaways

  • Translating EEG to fMRI is crucial but challenged by representation mismatch.
  • MEL uses coordinate-preserving tokenization to align EEG with fMRI.
  • It explicitly captures hemodynamic latency and spectral-spatial dynamics.
  • MEL significantly improves prediction accuracy over existing baselines.

Who benefits

HealthcareMedical DevicesNeuroscience ResearchAI Development

Summary

MEL (Multi-band EEG Latent-state Tokenization) is a new framework that enhances the translation of EEG signals into fMRI by creating coordinate-preserving representations. It explicitly captures hemodynamic latency and spectral-spatial dynamics, aligning fMRI-pertinent EEG features with controlled readouts.

Translating electroencephalography (EEG) data into functional magnetic resonance imaging (fMRI) is a critical challenge in neuroimaging, aiming to infer spatially organized brain activity from fast, accessible electrophysiological recordings. Existing approaches often struggle with the fundamental representation mismatch between EEG and fMRI, which involves differences in temporal lag, channel identity, and frequency-band structure. Researchers propose Multi-band EEG Latent-state Tokenization (MEL), a novel coordinate-preserving EEG representation framework. MEL addresses the mismatch by anchoring each target fMRI response to its preceding EEG history and organizing it into lag-channel-frequency neural-state tokens. This explicit capture of hemodynamic latency and spectral-spatial dynamics allows MEL to align fMRI-relevant EEG representations with capacity-controlled readouts, rather than relying solely on model scaling. Experiments on standard EEG-fMRI benchmarks and external datasets demonstrate that MEL significantly improves prediction accuracy over strong baselines, with ablations confirming that these gains stem from its structured EEG representation.

Why it matters

For professionals in medical imaging, neuroscience, and AI in healthcare, improving EEG-to-fMRI translation offers a less invasive, faster, and more accessible way to infer detailed brain activity, potentially revolutionizing diagnostics and brain-state monitoring.

How to implement this in your domain

  1. 1Investigate MEL's coordinate-preserving tokenization for multimodal neural data integration projects.
  2. 2Apply MEL's approach to align disparate temporal and spatial data streams in other domains.
  3. 3Explore using MEL in clinical settings for real-time brain-state monitoring or diagnostic support.
  4. 4Develop new decoders or analysis tools that leverage MEL's structured EEG representations.

Original post by Xiangyu Liu, Zeting Yan, Zhitong Yin, Boyang Li, Xi Zhang

"arXiv:2608.29304v1 Announce Type: new Abstract: Translating electroencephalography (EEG) into functional magnetic resonance imaging (fMRI) is important for medical neuroimaging, clinical brain-state monitoring, and multimodal neural decoding, because it aims to infer spatially or…"

View on X

Originally posted by Xiangyu Liu, Zeting Yan, Zhitong Yin, Boyang Li, Xi Zhang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses