← Back
FisherAI — Automated Shelf Card Generation
Work project: processing store ads to generate shelf cards automatically.
Overview
FisherAI processes scanned store ads and shelf imagery to extract product information and automatically generate shelf cards for in-store displays. The pipeline combines object detection, OCR, and layout-aware document understanding to robustly parse heterogeneous ad/layout formats and produce structured product metadata for downstream card rendering.
How it works
- Detect product regions and visual elements using YOLO-based object detection.
- Extract text from images and ads with PaddleOCR for multi-language OCR and robust recognition.
- Apply LayoutLMv3 to model document/layout context and resolve entity relationships (price, product name, brand).
- Post-process and normalize extracted fields, then generate shelf-card assets (images + metadata) automatically.
My role & tech
Work project — responsible for end-to-end pipeline design, model integration, and productionization.
Tech stack: Tauri (Rust) + ONNX Runtime for desktop integration and inference, and TypeScript + React for UI and operator tools.
Outcome
Automated generation reduced manual time-to-shelf by X% and improved consistency of in-store merchandising. The lightweight Tauri client enabled cross-platform deployment with efficient on-device inference using ORT.