Store Product Gaze Detection Using Segmented Camera Zones

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for collecting information about customer interactions with products in stores, such as using cameras, face challenges in accurately determining which products are being looked at by customers due to insufficient camera coverage, leading to inaccurate data collection and potential duplication of customer information.

Innovation Solution

An information collection system with multiple devices installed near each product type, equipped with image pickup and communication functions, collects and processes information associated with customers and products, allowing for accurate identification of product interest and reducing duplicate data collection by ensuring each customer is linked to the correct product.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the number of cameras is smaller than the number of product types, then the device complexity is reduced, but the measurement precision of product gaze estimation deteriorates

Engineering Contradiction:
Improvenumber of camerasVSAvoidproduct gaze estimation accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system segments the store environment by assigning dedicated cameras to specific product types or display shelves. Each camera is responsible for monitoring a particular product category, creating discrete observation zones that enable accurate product-gaze mapping without requiring comprehensive coverage of all products.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of using uniform camera placement throughout the store, the system implements local quality by positioning cameras specifically at display shelves or product types where gaze estimation is most critical. This localized approach concentrates measurement resources where they are most needed for accurate product identification.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If cameras are installed at every display shelf, then the measurement precision of customer interaction data is improved, but the device complexity and cost increase

Engineering Contradiction:
Improvecustomer interaction data accuracyVSAvoidnumber of cameras
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies partial action by installing cameras only at selected display shelves or product types rather than universally at all locations. This selective deployment achieves sufficient measurement precision for the intended analysis while avoiding the excessive complexity and cost of full coverage.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

Cameras installed at strategic locations serve multiple functions: they capture customer gaze direction, identify products of interest, and track customer movement patterns. This multi-functionality allows the system to achieve high measurement precision without proportionally increasing the number of cameras.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If multiple cameras are used to cover all product types, then the measurement precision is improved, but the loss of information due to duplicate customer data increases

Engineering Contradiction:
Improveproduct gaze estimation accuracyVSAvoidduplicate customer information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system segments the monitoring responsibility by assigning specific cameras to specific product types or display zones. This segmentation creates clear boundaries for data collection, allowing the system to distinguish between customers viewed by different cameras and accurately attribute interactions to the correct product types, thereby reducing duplicate information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system incorporates feedback mechanisms that track which customers have already been recorded by which cameras. When a customer is detected by multiple cameras, the system uses feedback information to identify and exclude duplicate records, maintaining measurement precision while preventing information loss through redundant data.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12026748B2Information collection system, electronic shelf label, electronic pop advertising, and character information display device
Publication Date: 2024.07.02 SONY GROUP CORP
  • US12026748B2 patent drawing
  • US12026748B2 patent drawing
  • US12026748B2 patent drawing

AI summary

Provided are an information collection system, an electronic shelf label, an electronic POP advertising, and a character information display device that allow information with higher accuracy to be collected. An information collection device that collects information associated with a customer or a product is included for each product type. Alternatively, an information processing device that supplies information associated with a product and an information display terminal that displays information associated with a product supplied from the information processing device are included.