MaxSAT Feedback Improves VLM Logical Consistency in Sudoku.

Pedro Orvalho, Guillem Aleny\`a, Felip Many\`a· July 15, 2026 View original

Summary

This paper proposes a neuro-symbolic approach using a Maximum Satisfiability (MaxSAT) oracle to integrate formal constraint reasoning into Vision-Language Models (VLMs) for structured visual tasks like Sudoku. The MaxSAT solver provides structured feedback to guide VLM refinements, significantly improving logical consistency and solving rates.

Vision-Language Models (VLMs) have shown promise in structured visual reasoning, such as solving grid-based puzzles like Sudoku. However, despite their strong visual understanding, these models often struggle with logical consistency, frequently producing solutions that violate underlying rules. To address this, researchers introduce a neuro-symbolic method that embeds formal constraint reasoning directly into the VLM's problem-solving process. This approach utilizes a Maximum Satisfiability (MaxSAT) oracle, which doesn't solve the puzzle directly but acts as a validator and refinement engine. Candidate placements generated by the VLM are treated as "soft" clauses, while the strict Sudoku rules are "hard" clauses within a partial MaxSAT formulation. When inconsistencies are detected, the MaxSAT solver identifies the largest consistent subset of assignments. This information is then translated into structured textual and visual feedback, which guides the VLM in making subsequent refinements. Experiments on a Sudoku dataset, using various VLMs, demonstrate that this MaxSAT-based feedback significantly enhances logical consistency and increases the number of successfully solved instances, particularly when refining full boards. This highlights the potential of symbolic optimization to boost the reliability of VLM reasoning.

Why it matters

This research offers a method to enhance the logical consistency and reliability of VLMs, which is crucial for applications requiring precise, rule-based reasoning beyond mere pattern recognition.

How to implement this in your domain

  1. 1Explore integrating symbolic reasoning components into existing VLM pipelines for tasks requiring strict logical constraints.
  2. 2Develop feedback mechanisms that translate symbolic inconsistencies into actionable guidance for neural models.
  3. 3Test neuro-symbolic approaches on internal structured reasoning tasks to assess performance gains.
  4. 4Consider fine-tuning VLMs with data augmented by symbolic feedback to improve inherent logical capabilities.
  5. 5Collaborate with AI research teams to stay updated on advancements in neuro-symbolic AI.

Who benefits

RoboticsManufacturingHealthcareGamingEducation

Key takeaways

  • VLMs struggle with logical consistency in structured visual reasoning tasks.
  • A MaxSAT oracle provides symbolic feedback to guide VLM refinements.
  • This neuro-symbolic approach significantly improves logical consistency and solving rates.
  • Symbolic optimization can enhance the reliability of vision-language reasoning.

Original post by Pedro Orvalho, Guillem Aleny\`a, Felip Many\`a

"arXiv:2607.12711v1 Announce Type: new Abstract: Vision--Language Models (VLMs) have recently demonstrated promising performance on structured visual reasoning tasks, including grid-based puzzles. However, despite strong perceptual capabilities, these models lack explicit mechanis…"

View on X

Originally posted by Pedro Orvalho, Guillem Aleny\`a, Felip Many\`a on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses