Task Assistance System Shelf Region Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in accurately identifying which region of a shelf a hand has extended to, due to the lack of a method for easily forming information using a coordinate system capable of calculating location coordinates, leading to potential misidentification of objects as hands.

Innovation Solution

A task assistance system that includes location detection means for calculating hand location information, region setting means for defining sensing regions, and pass-through region determination means to identify which region the hand has extended to, using location information from a sensing plane.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If location coordinates of hand are calculated using laser or distance sensors, then hand location can be identified, but objects other than hands may be erroneously sensed as hands

Engineering Contradiction:
Improvehand location identification accuracyVSAvoidobject classification accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The invention segments the detection task into two independent parts: location detection (using laser/distance sensors) and image recognition (using image capture devices). The location information and image information are processed separately and then integrated, allowing the system to identify both where an object is and what it is, thereby preventing misclassification of non-hand objects as hands.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention introduces an intermediary integration process that combines location information from laser/distance sensors with image information from image capture devices. This intermediary step allows cross-validation between the two detection methods, enabling the system to confirm whether a detected object at a specific location is actually a hand by comparing location data with visual data.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If information for identifying each placement region is held using location coordinates, then hand-to-region mapping can be determined, but no easy method is available for forming such information

Engineering Contradiction:
Improveregion information formation easeVSAvoidcoordinate system integration complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The invention adds a new dimension to the coordinate system by integrating image coordinates with physical location coordinates. The image capture device provides a visual dimension that can be mapped to the physical shelf space coordinates, creating a multi-dimensional coordinate system that naturally represents both the visual field and the physical storage regions, making region information formation straightforward.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The integrated coordinate system serves multiple functions simultaneously: it identifies hand location, defines placement regions, and maps between visual and physical spaces. This universal coordinate system eliminates the need for separate information structures for different purposes, simplifying the formation and management of region information.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9690983B2Task assistance system, task assistance method, and program
Publication Date: 2017.06.27 NEC CORP
  • US9690983B2 patent drawing
  • US9690983B2 patent drawing
  • US9690983B2 patent drawing

AI summary

A task assistance system includes: a location detection unit (101) for setting a sensing plane in a first face side of a display means capable of displaying a plurality of articles and calculating location information of a hand located on the sensing plane or location information of an object different from the hand; a region setting unit (102) for setting a plurality of sensing regions on the sensing plane using the location information of the hand or the location information of the object calculated by the location detection unit (101); and a pass-through region determination unit (104) for determining which one of the plurality of sensing regions a hand extended to the display means from the first face side has passed through using the location information of the hand calculated by the location detection unit (101), after the region setting unit (102) sets the plurality of sensing regions.