3D Gesture Control for Portable Device Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current user interfaces for portable devices, such as mobile phones, are inconvenient for controlling additional functions beyond basic call functions due to limitations in input and output methods.
Innovation Solution
A method using a 3D multi-sensor to detect motions of input units like fingers or stylus pens in space, allowing for intuitive control of widgets and graphic objects on a touchscreen without physical contact, enabling easier manipulation of 3D images and functions through gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touchscreens and touchpads are mounted on portable devices to improve user interface, then ease of operation is improved, but device complexity increases and space limitations are exacerbated
Solution Approach 1:
The patent extends the interaction space from two-dimensional touchscreen surface to three-dimensional space above the device. The 3D sensor detects gestures in the air space, allowing users to manipulate virtual objects without physical contact with the device surface. This dimensional extension resolves the contradiction by providing enhanced ease of operation through natural hand gestures while avoiding the need to mount additional physical input devices on the portable device.
Solution Approach 2:
The patent introduces an intermediary 3D sensor system that detects hand gestures in the air space between the user and the device. This intermediary mediates between the user's natural hand movements and the device's processing system, enabling intuitive control without requiring direct physical contact or additional mounted input devices. The intermediary sensor field captures gesture information and translates it into device control commands.
2Adaptability or versatility
If more input/output devices are mounted on portable devices to add functions, then adaptability is improved, but ease of manufacture deteriorates due to space constraints
Solution Approach 1:
The patent implements a universal 3D gesture recognition system that can control multiple different functions and applications through a single integrated interface. The same 3D sensor and gesture recognition software can adapt to control various device functions (messaging, browsing, media playback, etc.), eliminating the need for separate specialized input devices for each function. This multi-functionality approach improves adaptability while maintaining ease of manufacture by using a single versatile system rather than multiple specialized components.
3Ease of operation
If touch-based interfaces are used to control functions, then ease of operation is improved, but loss of information occurs due to lack of intuitive control for complex functions
Solution Approach 1:
The patent inverts the traditional interaction model by allowing users to manipulate virtual objects directly through hand gestures in 3D space, rather than requiring users to adapt their natural gestures to fit a fixed touchscreen interface. This inversion enables more intuitive control where the interface adapts to the user's natural movements, improving both ease of operation and control intent accuracy. The system captures the full spatial information of hand gestures, preserving more information about user intent compared to flat touch inputs.
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
Provided is a method capable of making various modifications to widgets, graphic objects, or images, which are displayed on a display device, according to motions of a plurality of input units such as finger or stylus pen, with the use of a three-dimensional multi-sensor configured to detect the motions of the input units in a space, without touching the display device.