Hand-Tracking Operating Region for Image Display Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image recognition devices face challenges in determining the timing of calibration and increasing processing load when defining an operating plane based on body position, especially in multi-user scenarios and when users are in non-standard positions, leading to difficulties in selecting the correct operator and efficient operation.

Innovation Solution

An image display device that uses a camera to recognize a user's hand position and dynamically adjusts an operating region within an imaging plane based on the hand's movement, allowing the user to intuitively interact with the device without significant processing overhead, by predefining the operating region around the hand's projected position and adjusting its size according to hand-waving motions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the operating plane is defined in accordance with body position, then the operating region can be established for user interaction, but the timing of calibration cannot be determined with ease and processing load is increased

Engineering Contradiction:
Improveoperating region establishmentVSAvoidprocessing load
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the hand position recognition from the overall body position recognition process. Instead of recognizing and processing complete body posture to define the operating plane, the system specifically detects hand position and uses it to establish the operating region. This extraction reduces processing complexity while maintaining the ability to create an effective operating plane for user interaction.

Inventive Principle:
Principle #2Taking out (Extraction)

2Device complexity

If the operating region is created based on hand position, then processing load is reduced, but the timing of calibration cannot be determined with ease

Engineering Contradiction:
Improveprocessing loadVSAvoidcalibration timing determination
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent implements preliminary action by automatically establishing the operating region as soon as hand position is detected, without requiring a separate calibration phase. The system proactively creates the operating plane based on the detected hand position, eliminating the need for users to perform calibration actions or for the system to determine specific calibration timing. This preliminary establishment of the operating region resolves the timing uncertainty.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If the operating region is predefined around hand projected position, then user interaction becomes intuitive, but the operating region may be positioned apart from the presumed operating region when hand extends from below

Engineering Contradiction:
Improveuser interaction intuitivenessVSAvoidoperating region positioning accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by making the operating region movable rather than fixed. When the detected hand position moves away from the current operating region boundaries, the system dynamically repositions the operating region to remain centered on the hand. This dynamic adjustment ensures that the operating region stays aligned with the user's intended interaction area, whether the hand is extended from below or from other positions, resolving the positioning accuracy issue while maintaining intuitiveness.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9400560B2Image display device and display control method thereof
Publication Date: 2016.07.26 MAXELL LTD
  • US9400560B2 patent drawing
  • US9400560B2 patent drawing
  • US9400560B2 patent drawing

AI summary

Disclosed is an image display device capable of recognizing a hand of a user and predefining an operating region. Image recognition means recognizes the position of a hand of the user. Operating region setup means predefines the operating region, on an imaging region plane of imaging means and around a position on which the user's hand is projected, for the purpose of enabling the user to issue instructions to the image display device. When the position on which the user's hand is projected moves and comes close to the periphery of the operating region, the operating region setup means moves the operating region in the direction of the movement of the position on which the user's hand is projected. Further, the image recognition means recognizes a hand-waving motion of the user, whereas the operating region setup means sets the size of the operating region in accordance with the magnitude of the user's hand-waving motion. Consequently, the image display device provides increased ease of operation and makes it possible to define the operating region in accordance with a user's intention without imposing a significant processing load on itself.