Cashier-less Store Subject Linking via Semaphore Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in accurately linking subjects in real space with user accounts without using personal identifying biometric information, particularly in environments like shopping stores where multiple individuals are moving and interacting with inventory.

Innovation Solution

A system that uses image processing and signal processing to identify subjects in real space by matching locations of mobile devices with user accounts, employing techniques such as semaphore images, radio signals, and accelerometer data to determine subject locations without requiring personal biometric information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If facial recognition or biometric recognition techniques are used to identify subjects and link them with accounts, then identification accuracy is improved, but security and privacy risks increase due to access requirements for databases storing personal identifying biometric information

Engineering Contradiction:
Improveidentification accuracyVSAvoidsecurity and privacy risks
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent introduces mobile devices as intermediaries that display semaphore images to communicate subject identity to the image processing system. Instead of the system directly accessing biometric databases, the mobile device serves as a mediator that receives authentication credentials from the user and presents visual signals (semaphore images) that the system can recognize without storing or accessing sensitive biometric data, thus resolving the security and privacy risks while maintaining identification capability

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent uses semaphore images as visual copies or representations of user identity rather than direct biometric data. These semaphore images are simplified visual signals (such as colored circles or patterns) that convey user information without containing actual biometric characteristics, allowing the system to identify subjects without storing or processing sensitive personal identifying information, thereby eliminating the security risks associated with biometric database access

Inventive Principle:
Principle #26Copying

2Area of stationary object

If image processing systems process images of large spaces to identify subjects, then coverage area is improved, but system complexity increases relating to image data processing and reliability determination

Engineering Contradiction:
Improvecoverage areaVSAvoidsystem complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent segments the large monitoring area into multiple zones covered by individual cameras, with each camera capturing a specific field of view. The system processes images from multiple cameras independently and then integrates the results to identify subjects across the entire large space. This segmentation approach allows the system to handle large coverage areas by breaking down the complex task into manageable units, reducing overall system complexity while maintaining comprehensive monitoring capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds the temporal dimension to image processing by analyzing sequences of images over time. Instead of processing single static images, the system examines how subjects move and interact with semaphore images across multiple time frames. This temporal dimension helps the system distinguish between legitimate users and false positives, improving reliability without requiring excessive computational complexity for spatial analysis alone

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Object-affected harmful factors

If the system links identified subjects to user accounts without using biometric information, then privacy and security are improved, but matching reliability becomes more difficult to determine

Engineering Contradiction:
Improveprivacy and securityVSAvoidmatching reliability
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the image processing system detects when a subject is holding or interacting with a mobile device displaying a semaphore image. This visual feedback confirms the identity association between the subject and the user account linked to that mobile device. The system continuously monitors for this feedback signal to verify matching reliability without requiring biometric data, maintaining both privacy/security and confidence in subject-account linkage

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces the mechanical/biometric verification system with an optical/visual system. Instead of using fingerprints, facial recognition, or other physical biometric measurements, the system uses semaphore images as visual signals that subjects must interact with (hold or point at) to confirm their identity. This substitution maintains reliable matching while eliminating the need for biometric data collection and processing, thereby preserving privacy and security

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11538186B2Systems and methods to check-in shoppers in a cashier-less store
Publication Date: 2022.12.27 STANDARD COGNITION CORP
  • US11538186B2 patent drawing
  • US11538186B2 patent drawing
  • US11538186B2 patent drawing

AI summary

Systems and techniques are provided for linking subjects in an area of real space with user accounts. The user accounts are linked with client applications executable on mobile computing devices. A plurality of cameras are disposed above the area. The cameras in the plurality of cameras produce respective sequences of images in corresponding fields of view in the real space. A processing system is coupled to the plurality of cameras. The processing system includes logic to determine locations of subjects represented in the images. The processing system further includes logic to match the identified subjects with user accounts by identifying locations of the mobile computing devices executing client applications in the area of real space and matching locations of the mobile computing devices with locations of the subjects.