Skip to main navigation Skip to search Skip to main content

Agentic Ontology-guided Image Generation and Evaluation for Rare-event Data Augmentation in Safety-critical Perception

Research output: Contribution to journal › Article › peer-review

Abstract

Safety-critical perception systems depend on rare, stochastic events that are difficult to collect at scale due to adverse conditions and ethical constraints. Conventional augmentation operates at the pixel level and cannot introduce new object interactions or high-risk configurations, leaving datasets sparse at the semantic-event level. Recent generative models enable photorealistic synthesis from natural language prompts, yet most lack explicit semantic control, systematic evaluation, and iterative improvement mechanisms. This paper proposes an agentic ontology-guided framework for rare-event synthetic image generation, using wildlife–traffic interaction as a safety-critical case study. The framework integrates a formal semantic ontology, autonomous generation agents, Large Multimodal Model (LMM)-based evaluation agents, and a closed-loop refinement and regeneration mechanism, enabling controlled comparison between reference-based and referenceless generation across OpenAI, Gemini, and Grok models. Evaluation combines objective no-reference image quality metrics, LMM-as-a-Judge, a Panel of LMM Evaluators, human ratings, and downstream zero-shot object detection. Among referenceless models, Gemini 3 Pro Image consistently leads on perceptual criteria while OpenAI-generated images achieve particularly strong recall, mAP, and false-negative reduction, especially under Grounding DINO zero-shot detector. These findings demonstrate that comprehensive evaluation of rare-event synthetic data requires both perceptual quality metrics and task-aware detectability criteria, and that the proposed framework supports this multi-dimensional assessment within a unified agentic pipeline.

Original languageEnglish
Article number100932
JournalArray
Volume30
DOIs
StatePublished - Jul 2026

Bibliographical note

Publisher Copyright:
© 2026 The Author

Keywords

  • Agentic AI
  • Data augmentation
  • Image generation
  • Ontology
  • Rare-event
  • Safety-critical perception

ASJC Scopus subject areas

  • General Computer Science

Fingerprint

Dive into the research topics of 'Agentic Ontology-guided Image Generation and Evaluation for Rare-event Data Augmentation in Safety-critical Perception'. Together they form a unique fingerprint.

Cite this