CellFill Enables Bit-Identical, Revocable Updates for Quantized LLMs.

Zifeng Liu, Zhiyong Du, Yaxin Lu, Yiming Mao, Zhenhe Wang, Wenqi Shi, Zhengkun Jing· August 24, 2026 View original

Key takeaways

  • CellFill enables bit-identical, revocable updates for quantized LLMs, preserving original model integrity.
  • New knowledge is written into per-weight residuals within quantization cells, preventing model drift.
  • The method significantly reduces cross-domain forgetting compared to traditional adapter merging.
  • It offers a machine-checkable guarantee for model invariance, crucial for production environments.

Who benefits

Software DevelopmentFinancial ServicesHealthcareGovernmentAI Development

Summary

Researchers propose CellFill, a novel method for updating deployed quantized Large Language Models (LLMs) by writing new knowledge strictly within the dequantization gap, ensuring updates are bit-identical to the original model and fully revocable. This approach prevents model drift and preserves original evaluations, offering a machine-checkable guarantee of invariance.

When updating deployed language models, traditional methods like fine-tuning or adapter merging replace the original checkpoint, invalidating previous evaluations and caches. This paper introduces CellFill, a new paradigm for "in-cell learning" that addresses this issue by performing updates within the dequantization gap of 4-bit quantized LLMs. The core idea is to write new knowledge only into the per-weight residual, which remains strictly within each quantization decision cell, leaving the integer codes and scales frozen. This method offers several critical advantages. Firstly, re-quantization returns the model to its original bit-for-bit state, providing a machine-checkable guarantee of invariance. Secondly, updates are exactly revocable by simply dropping the residual. Thirdly, model drift is inherently bounded. The research presents six propositions and three training paths, with CellFill being a bounded reparameterization that structurally ensures this invariance. Experiments show that this constrained approach nearly matches the performance of unconstrained methods in fact recall while significantly reducing cross-domain forgetting. It also transfers effectively to larger models, such as a 27B hybrid linear-attention model, demonstrating that matched recall can be achieved with about half the cross-domain perplexity cost compared to smaller models.

Why it matters

This innovation provides a robust and auditable way to update deployed quantized LLMs without compromising their original integrity or requiring extensive re-validation, which is crucial for maintaining model reliability and compliance in production environments.

How to implement this in your domain

  1. 1Investigate CellFill's applicability for maintaining and updating production-grade quantized LLMs.
  2. 2Develop internal prototypes to test the bit-identical update and revocation capabilities.
  3. 3Assess the trade-offs between knowledge acquisition and cross-domain forgetting for specific use cases.
  4. 4Integrate this technique into MLOps pipelines for controlled and auditable model updates.
  5. 5Collaborate with research teams to explore further optimizations and broader applicability.

Original post by Zifeng Liu, Zhiyong Du, Yaxin Lu, Yiming Mao, Zhenhe Wang, Wenqi Shi, Zhengkun Jing

"arXiv:2608.20873v1 Announce Type: new Abstract: Every way of teaching a deployed language model something new -- full fine-tuning, adapter merging, model editing -- replaces the released checkpoint, and with it every evaluation and cache that referred to those exact bits. We inst…"

View on X

Originally posted by Zifeng Liu, Zhiyong Du, Yaxin Lu, Yiming Mao, Zhenhe Wang, Wenqi Shi, Zhengkun Jing on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses

More in AI Engineering & DevTools