Enhancing General‐Purpose Visual Inspection With a Vision‐Language Model
Hiroto Tsuchida, Hideaki Omote, Yoshikazu Hayashi, Shiryu Ueno, Kunihito Kato, Kousaku OhsawaABSTRACT
Research on applying Vision‐Language Models (VLM) to automate visual inspection has attracted growing attention. However, off‐the‐shelf VLMs lack the domain‐specific expertise required to handle the wide variety of products and defects encountered in industrial inspection, making high‐accuracy judgment difficult without additional training. In this study, we automatically construct dialog‐style training data from a diverse set of images—including products not covered by existing evaluation benchmarks—using GPT‐4o, and fine‐tune a VLM (LLaVA‐OneVision) with the generated data. Experimental results on the MMAD benchmark under zero‐shot and one‐shot settings show improved average accuracy across multiple tasks including good/bad decisions. In particular, we observe notable performance gains on MVTec AD and VisA.