3D Gesture Sensor Click Scroll Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D gesture detection techniques for large display devices face challenges in accurately detecting user intentions, particularly in distinguishing between click and scroll operations due to the difficulty in precise hand movement detection, leading to incorrect input operations and increased user burden.
Innovation Solution
A 3D gesture detection method using a 3D gesture sensor that tracks the coordinates and distance between feature points on a user's hand, such as the index finger and thumb, to differentiate between scroll and click operations by analyzing time-series data, and incorporates gestures to manage sensor range limitations and user-friendly interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a user presses hand toward the display screen to perform click operation, then the depth direction gesture is detected, but the hand movement in parallel directions (x-axis or y-axis) is also detected causing incorrect scroll operation detection
Solution Approach 1:
The patent segments the gesture detection process into distinct phases: detection phase (tracking hand position and movement), determination phase (analyzing whether the gesture is click or scroll based on movement characteristics), and execution phase (performing the identified operation). This segmentation allows the system to separately handle the complexity of distinguishing between click and scroll gestures by evaluating multiple criteria including movement distance, direction, and velocity in different phases.
Solution Approach 2:
The patent implements feedback mechanisms where the system continuously monitors hand movement characteristics and adjusts its determination of user intent based on real-time analysis. The determination unit receives feedback from the detection unit about hand position, movement direction, and velocity, and uses this feedback to dynamically distinguish between click and scroll operations, correcting for the inherent difficulty in isolating pure depth-direction movement.
2Measurement precision
If conventional 3D gesture detection is used to detect hand movement in depth direction, then click operation can be detected, but the physical burden on user increases due to requiring more joints movement
Solution Approach 1:
The patent changes the parameters used for gesture detection from requiring pure depth-direction movement to analyzing multiple movement parameters including lateral movement distance, movement velocity, and acceleration patterns. By changing these detection parameters, the system can identify click gestures even when accompanied by natural lateral hand movements, thereby reducing the physical burden on users while maintaining detection accuracy.
3Device complexity
If sensor detection range is limited, then device complexity is reduced, but gesture detection reliability decreases when hand moves beyond detection range
Solution Approach 1:
The patent makes the gesture detection system universal by implementing multiple detection methods that can handle both in-range and out-of-range gestures. The system can detect gestures within the sensor's primary detection range using standard 3D gesture detection, and simultaneously detect gestures beyond this range by analyzing hand movement patterns and trajectories, thereby extending the effective detection range without adding complex additional sensors.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The method effectively reduces user burden by accurately detecting intended operations, preventing misinterpretation of gestures and ensuring intuitive control over display devices, even when the hand moves beyond the sensor's detection range.
Implementation Method 1
A motion detection apparatus implementing the aforementioned 3D gesture detection technique may include a distance image sensor, which may include an image sensor (e.g., CMOS sensor) and infrared ray light emitting diode (LED).
Implementation Method 2
a distance image sensor, which may include an image sensor (e.g., CMOS sensor) and infrared ray light emitting diode (LED)
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A device includes a display and one or more motion sensors configured to track positions of two or more feature points of an object when the object is used to perform a gesture at a position remote from the display, and generate, based on the tracked positions of the feature points, sequential position data that indicates a relative position of the feature points with respect to each other and to the display. The device includes circuitry configured to determine, based on the sequential position data, whether the gesture corresponds to one of a plurality of predetermined input operations, and execute processing related to the predetermined input operation when a correspondence is determined. The circuitry is configured to determine whether the gesture corresponds to the predetermined input operation based on variations in the relative positions of the feature points with respect to each other and to the display.