Restaurant Order Matching Using Customer Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Restaurants face significant financial losses and customer dissatisfaction due to serving errors, where waiters struggle to accurately deliver dishes to the correct customers, especially in busy environments where customers may change seats or appear similar, leading to inefficiencies and increased costs.

Innovation Solution

A system utilizing a camera and customer matching module based on deep neural networks that captures visual information of customers during ordering and serving, allowing waiters to focus on serving without memorizing orders, by matching features of detected customers with those captured during ordering to ensure accurate delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If more restaurant staff are hired to reduce serving errors, then serving accuracy may improve, but labor costs and restaurant crowding increase

Engineering Contradiction:
Improveserving accuracyVSAvoidlabor cost
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent replaces the mechanical human memory and recognition system with an automated image capture and matching system. Cameras capture images of customers during ordering and serving, then automatically match them using image processing algorithms, eliminating the need for waiters to manually remember and identify customers.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary image matching system between the ordering process and the serving process. This system acts as a mediator that automatically links the customer who placed an order with the customer present at the dining area, removing the need for direct human intervention in customer identification.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If professional training is provided to waiters to reduce serving errors, then serving accuracy may improve, but training time and operational burden increase

Engineering Contradiction:
Improveserving accuracyVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces the need for human training and skill development with an automated technological system. Instead of training waiters to remember customer appearances and orders, the system uses image capture and automated matching to perform these functions, eliminating training requirements entirely.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If waiters manually track and remember customer orders to ensure accurate delivery, then serving accuracy may improve, but waiter workload and customer waiting time increase

Engineering Contradiction:
Improveserving accuracyVSAvoidwaiter workload
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces the human cognitive system (memory, attention, and manual tracking) with an automated image processing system. The system automatically captures images, processes them through matching algorithms, and provides identification information to waiters, eliminating the manual tracking burden.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service in the sense that the technology serves itself by automatically performing customer identification without requiring waiter intervention. The image capture and matching process occurs autonomously, and the system provides results to waiters who then simply follow the automated guidance.

Inventive Principle:
Principle #25Self-service

4Ease of operation

If traditional POS systems are used for automated services, then customer experience may improve, but serving error identification capability is not provided

Engineering Contradiction:
Improvecustomer experienceVSAvoidserving error identification
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent extends the functionality of restaurant service systems by adding image capture and matching capabilities to the existing POS ecosystem. The system integrates multiple functions: customer identification through image matching, order tracking, and serving guidance, creating a multi-functional platform that goes beyond traditional POS capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11682065B2Systems and methods for reducing service errors for restaurants
Publication Date: 2023.06.20 FUJIFILM BUSINESS INNOVATION CORP
  • US11682065B2 patent drawing
  • US11682065B2 patent drawing
  • US11682065B2 patent drawing

AI summary

A computer-implemented method, comprising receiving an order associated with a user, and capturing information associated with a physical attribute of the user; for the order being completed, performing a matching operation on the physical attribute of the user and information associated with a region of the user that includes the physical attribute of the user and respective physical attributes of other users, to determine a closest match; and generating an output that identifies the user associated with the closest match in the information associated with the region of the user, and providing the output to a server to deliver the order to the user.