3D Gesture Input Expansion via Depth and Texture Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gesture-based input methods on electronic devices are limited in the amount of information they can convey, as users can only memorize and perform a small number of gestures or tracks, restricting the amount of input information that can be efficiently input.
Innovation Solution
An information processing method and electronic device that obtain track data and identification data from an operating body's motion and texture, using these to derive corresponding input data, allowing for a larger range of input data through combinations of limited gestures and tracks, and enabling input operations similar to keyboard typing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If gesture-based input methods are used, then input speed and accuracy are improved, but the amount of input information is limited
Solution Approach 1:
The patent transitions from traditional 2D gesture recognition to 3D spatial gesture recognition by incorporating depth information from the distance sensor. This adds a new dimension (depth/distance) to the gesture input space, allowing users to perform gestures at different distances from the device, thereby exponentially increasing the number of distinguishable gesture types and the amount of information that can be conveyed without sacrificing input speed
Solution Approach 2:
The patent introduces distance as a new parameter for gesture recognition. By measuring the distance between the operating body and the electronic device, the system creates additional differentiation between gestures. This parameter change allows the same 2D gesture pattern to have multiple meanings based on distance, significantly expanding the information capacity while maintaining fast gesture-based input
2Quantity of substance
If traditional keyboard input is used, then large amount of information can be input, but input area is limited and errors increase
Solution Approach 1:
The patent makes the entire display screen surface functional for input by recognizing gestures anywhere on the screen, not just in specific keyboard regions. The screen serves multiple functions: display, touch input, and now 3D gesture recognition surface. This universal utilization of the screen area eliminates the physical keyboard's space constraint while maintaining high information input capability through the combination of position + distance + gesture pattern
3Quantity of substance
If more gestures are memorized to increase input information, then input capability improves, but user memory burden increases
Solution Approach 1:
The patent implements dynamic gesture recognition where the same basic gesture pattern can convey different information based on the distance parameter. Instead of requiring users to memorize many different gesture shapes, the system dynamically interprets gestures based on spatial context. This reduces the memorization burden to a small set of fundamental gestures while maintaining high information capacity through dynamic parameter-based differentiation
Data Source
AI summary
An information processing method and an electronic device are described. The method is applied to an electronic device and includes obtaining first track data of a motion of an operating body with respect to the electronic apparatus, and obtaining first identification data of the operating body; deriving first input data corresponding to the first identification data and the first track data; and the electronic apparatus responding to the first input data.