Moving Image Recognition for Multi-Surface Code Association

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Point-of-sales (POS) systems struggle to associate data codes and labels when they are arranged on different surfaces of the same object, leading to difficulties in performing price reductions or discounts, as existing techniques require both to be captured in the same image.

Innovation Solution

A moving image recognition apparatus and method that includes a moving image input unit, buffer unit, moving object detection unit, data code reading unit, label recognition unit, and association unit, which detect and decode data codes and recognize labels, even when they are on different surfaces, by associating the recognition results and outputting them together.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If both data code and label are captured in the same image, then recognition accuracy is improved, but the system cannot handle labels on different surfaces

Engineering Contradiction:
Improverecognition accuracyVSAvoidhandling capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system transitions from two-dimensional static image analysis to three-dimensional spatial-temporal analysis by tracking object movement across multiple frames. This allows the system to associate data codes and labels that appear on different surfaces by observing their relative positions and movements in three-dimensional space over time.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system performs preliminary detection of both data codes and labels separately in the moving image sequence, then performs association processing in a subsequent step. This two-stage approach allows flexible handling of cases where targets appear in different frames or positions, resolving the contradiction between requiring simultaneous capture and handling different surface positions.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If label is attached on different surface from data code, then versatility is improved, but association difficulty increases

Engineering Contradiction:
Improvelabel placement flexibilityVSAvoidassociation difficulty
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system employs dynamic tracking of object movement to associate data codes and labels. By continuously monitoring the movement trajectory of the object carrying both elements, the system can correlate their positions across different frames even when they appear on different surfaces, reducing association difficulty while maintaining placement flexibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses the object itself as an intermediary to associate the data code and label. By detecting the object's movement and using it as a reference frame, the system can link the data code detected in one position with the label detected in another position, facilitating association despite different surface placements.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If static image capture is used, then system simplicity is maintained, but price reduction processing fails for different surface labels

Engineering Contradiction:
Improvesystem simplicityVSAvoidprice reduction processing capability
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The system captures images periodically at fixed intervals to create a moving image sequence. This periodic capture approach maintains relatively simple system architecture while enabling the detection and association of data codes and labels that appear at different times in the sequence, thereby achieving price reduction processing for labels on different surfaces.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system continuously processes the moving image sequence to detect and associate data codes and labels. This continuous processing approach maintains system simplicity by using a unified processing framework while enabling price reduction processing for various label placements by leveraging the temporal continuity of the moving image data.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS9779326B2Moving image recognition apparatus and moving image recognition method
Publication Date: 2017.10.03 KK TOSHIBA
  • US9779326B2 patent drawing
  • US9779326B2 patent drawing
  • US9779326B2 patent drawing

AI summary

According to an embodiment, a moving image recognition apparatus includes a moving object detection unit, a data code reading unit, a label recognition unit, an association unit, and an output unit. The moving object detection unit detects moving objects from a moving image stored in a buffer unit and identifies each of the moving objects. The data code reading unit detects a data code from each frame of the moving image and decodes the detected data code. The label recognition unit detects and recognizes a label from each frame of the moving image. When the recognized label and the decoded data code exist on the same object, the association unit associates them. The output unit outputs together the decoding result of the data code and the recognition result of the label associated with the decoding result.