In-Store Face Detection and Registration for Customer Data Expansion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing face authentication techniques for in-store customer analysis are limited to collecting data only from customers who have pre-registered their face information, restricting the scope of information gathered.

Innovation Solution

A processing apparatus and method that includes a customer information storage unit, detection unit, behavior monitoring unit, and second customer registration unit, which captures images in-store, detects registered and unregistered customers, determines their behavior, and generates face information for unregistered individuals to register them, allowing for the collection of data from both groups.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If face authentication is performed using pre-registered face information only, then customer identification accuracy is improved, but the scope of collectable customer information is restricted

Engineering Contradiction:
Improvecustomer identification accuracyVSAvoidscope of collectable customer information
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The system performs preliminary face registration to create a database of face information before actual customer identification occurs. This preliminary action enables subsequent authentication while also allowing the system to identify and register new customers during store visits, thus expanding the collectable information scope without compromising identification accuracy for registered customers

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system automatically captures images, performs face recognition, and registers new customers without requiring manual intervention or pre-registration by the customers themselves. This self-service approach allows the system to expand its database of collectable information while maintaining accurate identification of both registered and unregistered customers through automated processes

Inventive Principle:
Principle #25Self-service

2Reliability

If the system only processes pre-registered customers, then data processing reliability is improved, but the quantity of collected customer data is reduced

Engineering Contradiction:
Improvedata processing reliabilityVSAvoidquantity of collected customer data
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system performs preliminary face registration to build a reliable database before actual data collection begins. This preliminary action ensures that when the system processes customer data, it has established reference information for accurate matching, thereby maintaining reliability while enabling the collection of additional data from newly registered customers

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously updates its face information database by comparing captured images against registered faces and automatically registering new customers. This feedback mechanism allows the system to maintain high processing reliability through accurate matching while simultaneously expanding the quantity of collected customer data by incorporating new registrations into the database

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240221008A1Processing apparatus, processing method, and non-transitory storage medium
Publication Date: 2024.07.04 NEC CORP
  • US20240221008A1 patent drawing
  • US20240221008A1 patent drawing
  • US20240221008A1 patent drawing

AI summary

The present invention provides a processing apparatus (10) including: a customer information storage unit (11) that stores customer information of a first customer who has registered customer attribute information and face information and customer information of a second customer who has registered face information without registering customer attribute information; a detection unit (12) that detects the first customer and the second customer in an image captured in a store; a behavior monitoring unit (13) that determines in-store behavior of the first customer and the second customer, and registers the detected in-store behavior in the customer information; and a second customer registration unit (14) that generates, when an unregistered person whose face information is not registered is detected in the image, face information of the unregistered person, and registers the generated face information, as the face information of the second customer, in the customer information.