AI Uses Multimodal Video for Dengue Mosquito Diagnosis

Danial Sharifrazi, Saadat Behzadi, Julakha Jahan Jui, Mojtaba Mohammadi, Nouman Javed, Roohallah Alizadehsani, Prasad N. Paradkar, Asim Bhatti· August 14, 2026 View original

Key takeaways

  • A new AI framework uses YOLO and CLIP for highly accurate Dengue mosquito diagnosis from video.
  • The multimodal approach aligns visual features with textual prompts to identify infection-related behavioral changes.
  • The system achieved 98.54% accuracy and 99.91% sensitivity at the frame level.
  • Vision-language models show promise for analyzing subtle biological behaviors from video data.

Who benefits

Public HealthAgricultureBiotechnologyEnvironmental Monitoring

Summary

Researchers propose a vision-language framework combining YOLO and CLIP to classify Dengue-infected mosquitoes from video, achieving high accuracy by aligning visual features with textual prompts. The model effectively identifies infection-related behavioral changes in mosquitoes, demonstrating the utility of multimodal AI for biological analysis.

This study introduces an innovative AI framework designed to detect Dengue virus infection in mosquitoes by analyzing their behavior in video footage. The system leverages a combination of computer vision (YOLO) to isolate mosquitoes and a vision-language model (CLIP) to interpret their movements. By aligning visual data with descriptive text prompts, the model learns to differentiate between infected and uninfected mosquitoes. The core of the approach involves fine-tuning the multimodal model using supervised contrastive learning, which helps create a shared embedding space for visual and textual features. This allows for highly accurate classification of mosquito flight patterns. The research highlights that while the textual component aids in semantic alignment, the visual representations and fine-tuning are crucial for achieving the reported 98.54% accuracy and 99.91% sensitivity at the frame level, leading to perfect video-level performance.

Why it matters

This research offers a highly accurate, non-invasive method for early detection of vector-borne diseases, potentially enabling more targeted and efficient public health interventions. Professionals in public health and entomology can leverage such AI systems for improved disease surveillance and control strategies.

How to implement this in your domain

  1. 1Integrate similar vision-language models into existing pest control and disease surveillance programs.
  2. 2Develop automated systems for monitoring mosquito populations in high-risk areas using video analytics.
  3. 3Collaborate with AI researchers to adapt this framework for detecting other vector-borne diseases or biological changes.
  4. 4Pilot test the technology in specific geographic regions to assess its effectiveness in real-world conditions.

Original post by Danial Sharifrazi, Saadat Behzadi, Julakha Jahan Jui, Mojtaba Mohammadi, Nouman Javed, Roohallah Alizadehsani, Prasad N. Paradkar, Asim Bhatti

"arXiv:2608.12677v1 Announce Type: new Abstract: Detecting infection-related behavioral changes in mosquitoes from video data is challenging because mosquitoes are small, move rapidly and irregularly, and are affected by environmental factors such as background, lighting, and shad…"

View on X

Originally posted by Danial Sharifrazi, Saadat Behzadi, Julakha Jahan Jui, Mojtaba Mohammadi, Nouman Javed, Roohallah Alizadehsani, Prasad N. Paradkar, Asim Bhatti on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses

More in AI Research

AI Engineering & DevToolsAI ResearchAI Investing

FlowLOB Generates Realistic, Controllable Limit Order Books Efficiently

This paper introduces FlowLOB, a conditional flow-matching generator for Limit Order Book (LOB) trajectories that offers realistic market dynamics, efficient sampling, and controllable scenario generation, outperforming existing agent-based and deep generative simulators. FlowLOB achieves high fidelity with significantly fewer computational steps than diffusion models and transfers effectively to unseen instruments.

Zhuohan Wang, Andreea Bacalum, Ollie Olby, Carmine Ventre, Namid StillmanAug 14, 2026
AI Engineering & DevToolsAI Research

Auditing Reveals Bias in Neural Combinatorial Optimization Benchmarks

This paper audits test-time budget allocation in Neural Combinatorial Optimization (NCO) solvers, revealing that reported gains from non-uniform sampling often stem from "sampling luck" rather than true allocation benefits on in-distribution data. It proposes a correction procedure and demonstrates real gains under distribution shift, emphasizing the need for rigorous evaluation.

Jinhyung BaeAug 14, 2026
AI Engineering & DevToolsAI Research

Diffusion Models Solve Mixed-Integer Optimization Problems Faster

This paper introduces Constrained Graph Diffusion (CGD), a novel learning-based approach that uses a graph-based generative diffusion model to approximately solve mixed-integer optimization problems (MIPs). CGD integrates a training-free feasibility projection operator into the diffusion process, significantly improving solution quality and feasibility while achieving substantial speedups over traditional numerical solvers.

Vincenzo Di Vito, Mehdi Taghizadeh, Deepjyoti Deka, Kaarthik Sundar, Ferdinando FiorettoAug 14, 2026