AI-Powered Pantry Scanner App

    AI-Powered Pantry Scanner App

    The Hershey Company

    AI/ML
    Computer Vision
    Mobile App
    Recipe Technology
    OpenAI Integration

    Revolutionary ingredient recognition system using computer vision and AI to instantly suggest recipes from pantry photos.

    Timeline

    1 month

    My Role

    Technical Product Lead/Full-Stack Dev

    Key Focus

    AI Innovation

    The Challenge

    Users often struggle to find recipes using ingredients they already have at home. The challenge was to create an intuitive way to scan ingredients from photos and provide instant, relevant recipe recommendations.

    The Solution

    Developed AI-powered ingredient detection using OpenAI GPT-4.1-mini and Google Vision APIs. Built an editable tag system allowing users to refine detected ingredients, with real-time Algolia search integration for instant recipe filtering and recommendations.

    Technologies Used

    OpenAI API
    Google Vision API
    Algolia
    Node.js
    HTML/CSS/JS
    Java
    Adobe Experience Manager

    Project Visuals

    Pantry scanner in action - real-time ingredient detection

    The Results

    Achieved 89% ingredient recognition accuracy, reduced recipe discovery time by 73%, and increased user engagement with recipe content by 156%. The app became a standout feature driving significant user retention.

    89%
    Recognition Accuracy
    73%
    Discovery Time Reduction
    156%
    Engagement Increase