Graph Tools Enhance Small Language Models for Molecular Prediction.

Konstantinos Bougiatiotis, Dimitrios Kelesis, Georgios Paliouras· July 16, 2026 View original

Summary

Small language models (SLMs) for molecular property prediction from SMILES strings often lack structural understanding. This paper proposes a Context-Augmented Prompting framework that uses a GNN expert and an explanatory subgraph extractor as tools, significantly improving SLM accuracy by providing graph-derived context.

Small language models (SLMs) show promise for predicting molecular properties directly from SMILES strings, but they often struggle with "structural blindness" because sequence representations don't fully capture crucial graph-topological information. To overcome this, a new "Context-Augmented Prompting" framework has been developed. This framework enables SLMs to use agentic tools during inference. Specifically, a trained Graph Neural Network (GNN) expert provides a predictive hint along with its confidence, and another GNN extracts an instance-specific explanatory subgraph (e.g., a subgraph SMILES and a descriptive paragraph). By enriching prompts with this graph-derived context, the framework achieved substantial accuracy gains across multiple datasets, sometimes exceeding 74% relative improvement. While significant, a gap still remains between these enhanced SLMs and specialized GNN models, indicating both the value and current limits of text-conditioned reasoning for molecular structures.

Why it matters

This research offers a practical method to significantly improve the accuracy of small language models in molecular property prediction, making them more useful for drug discovery and materials science applications.

How to implement this in your domain

  1. 1Integrate graph-based tools into existing language model pipelines for tasks requiring structural understanding.
  2. 2Develop agentic prompting frameworks that allow LLMs to leverage external expert models for context.
  3. 3Experiment with providing explanatory subgraphs or other structured data to enhance model reasoning.
  4. 4Benchmark the performance of context-augmented SLMs against specialized graph neural networks for specific molecular tasks.

Who benefits

PharmaceuticalsBiotechnologyMaterials ScienceChemical ManufacturingAI/ML Development

Key takeaways

  • SLMs struggle with structural blindness in molecular property prediction.
  • Context-Augmented Prompting uses GNNs as tools to provide structural context.
  • Graph-derived context significantly improves SLM accuracy (up to 74% relative gain).
  • A gap still exists between augmented SLMs and specialized GNNs.

Original post by Konstantinos Bougiatiotis, Dimitrios Kelesis, Georgios Paliouras

"arXiv:2607.13115v1 Announce Type: new Abstract: Small language models (SLMs) have shown promise for zero-shot molecular property prediction from SMILES strings, yet they often suffer from structural blindness because sequence representations under-specify key graph-topological cu…"

View on X

Originally posted by Konstantinos Bougiatiotis, Dimitrios Kelesis, Georgios Paliouras on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses