LLMs Automate Neural Architecture Search for Cross-Lingual OCR

Mobina Kashaniyan, Amirhossein Ghassemi, Nasser Mozayani· July 20, 2026 View original

Summary

A new AutoML framework uses advanced LLMs (GPT-5, GPT-4o, Claude Sonnet 4) to autonomously design, train, and refine neural network architectures for cross-lingual handwritten OCR. This system consistently discovers accurate and efficient models without manual intervention, achieving high accuracy across multiple languages.

This paper introduces an innovative AutoML framework that leverages large language models (LLMs) like GPT-5, GPT-4o, and Claude Sonnet 4 to automate the entire process of neural architecture search. The system focuses on developing models for cross-lingual handwritten optical character recognition (OCR). Each LLM acts as an independent designer, iteratively generating, training, evaluating, and refining neural network architectures based on performance feedback. The framework was rigorously tested across Arabic, Persian, and English handwriting datasets through numerous experiments. It consistently produced highly accurate and computationally efficient models, achieving over 93% mean test accuracy and low inference latency, all without requiring manual architecture design, domain-specific preprocessing, or hyperparameter tuning. This demonstrates the potential of LLMs as powerful AutoML agents for complex machine learning tasks.

Why it matters

Professionals can use this approach to rapidly develop high-performing, language-agnostic OCR solutions, significantly reducing development time and specialized expertise requirements.

How to implement this in your domain

  1. 1Explore integrating advanced LLMs into your MLOps pipeline for automated model design and optimization.
  2. 2Identify specific tasks where neural architecture search could accelerate model development, such as image processing or natural language understanding.
  3. 3Pilot an LLM-driven AutoML approach for a challenging data type like handwritten text in diverse languages.
  4. 4Establish clear performance metrics and feedback loops for LLMs to iteratively refine generated architectures.
  5. 5Investigate the computational resources required to run such an automated architecture search process.

Who benefits

Document ManagementHealthcareLegalEducationGovernment

Key takeaways

  • LLMs can autonomously design and optimize neural network architectures.
  • The framework achieves high accuracy in cross-lingual handwritten OCR without manual tuning.
  • Automated neural architecture search reduces development time and expertise needs.
  • LLMs act as effective AutoML agents for complex machine learning tasks.

Original post by Mobina Kashaniyan, Amirhossein Ghassemi, Nasser Mozayani

"arXiv:2607.15509v1 Announce Type: cross Abstract: We present a fully automated closed-loop AutoML framework that uses GPT-5, GPT-4o, and Claude Sonnet 4 as autonomous neural architecture designers for cross-lingual handwritten optical character recognition. Each large language mo…"

View on X

Originally posted by Mobina Kashaniyan, Amirhossein Ghassemi, Nasser Mozayani on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses