DOI: 10.3390/electronics15215069 ISSN: 2079-9292

Edge-Constrained Food Retrieval System

Andrea Spagnolo, Simone Bianco, Raimondo Schettini, Danilo Pau

Fine-grained food image and text retrieval requires models that can distinguish subtle differences in ingredients, preparation methods, and visual appearance. While vision language models provide strong multimodal reasoning capabilities, their computational requirements can make direct deployment on edge devices impractical. This paper proposes a training free retrieval framework that combines efficient candidate retrieval with selective vision language reasoning. For ingredient retrieval, Qwen3-VL performs closed choice selection over the retrieved candidates, while dense caption retrieval uses Qwen3-VL-Reranker as a second stage multimodal reranker. An efficiency oriented configuration, Stage 4-E, further introduces confidence based execution, allowing the VLM components to be skipped when the initial retrieval is sufficiently confident. The proposed approach is evaluated on the Dishcovery challenge and on auxiliary food retrieval datasets, with particular attention to the tradeoff between retrieval quality and computational cost. The final pipeline is also deployed on two different edge AI platforms, the NVIDIA Jetson AGX Orin and the Qualcomm Dragonwing IQ-9075 EVK, using platform specific model representations and execution backends. The results show that selective multimodal reasoning, confidence based execution, and hardware aware optimization can substantially reduce inference cost while preserving most of the retrieval performance, making the proposed architecture suitable for practical edge deployment.

More from our Archive