Palm Hover Interaction Using Proximity Sensor Arrays on Small Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Ensuring accurate human-computer interaction on terminals with small screens is challenging, particularly without physical contact.
Innovation Solution
Implementing a palm-based interaction method using an array of proximity sensors to capture sensor data, recognize hovering interaction actions, and perform response operations without physical contact.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touchscreen capture is used for interaction, then interaction capability is provided, but interaction accuracy deteriorates on small screens
Solution Approach 1:
The patent replaces the mechanical touch system with an optical sensing system using a camera and image processing. Instead of relying on touchscreen coordinates which become imprecise on small screens, the system captures images of the user's hand, performs feature extraction and matching, and determines interaction intent through computer vision algorithms, thereby substituting a mechanical interaction model with an optical recognition model to achieve higher precision.
Solution Approach 2:
The patent introduces an image processing and recognition system as an intermediary between the user and the terminal. The camera captures hand images, the processing unit analyzes these images to recognize interaction intentions, and then executes corresponding operations. This intermediary layer translates physical hand gestures into digital commands, bridging the gap between user intent and system response while maintaining accuracy independent of screen size.
2Reliability
If physical contact interaction is used, then interaction reliability is improved, but hygiene and convenience deteriorate
Solution Approach 1:
The patent replaces physical contact interaction with non-contact optical recognition. The camera captures images of the user's hand in proximity to the device, and the processing unit recognizes interaction intentions through image analysis without requiring skin-to-device contact. This substitution eliminates the hygiene contamination issue while maintaining interaction reliability through robust image processing and recognition algorithms.
3Measurement precision
If more sensors are added to improve interaction accuracy, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent substitutes a complex multi-sensor array with a simpler camera-based optical system. Instead of using multiple proximity sensors, force sensors, or other complex sensing elements that would increase device complexity, the system uses a standard camera module combined with image processing algorithms to achieve high-precision interaction recognition, thereby maintaining measurement precision while reducing hardware complexity.
Data Source
AI summary
This application discloses a palm-based human-computer interaction method performed by a computer device. The method includes: obtaining, by a palm-based interaction device, sensor data of a palm that is captured by at least two proximity sensors, the at least two proximity sensors being disposed in an array on the palm-based interaction device; recognizing a hovering interaction action of the palm based on the sensor data of the palm that is captured by the at least two proximity sensors; and performing a response operation for the hovering interaction action. This application provides a new interaction manner. A proximity sensor recognizes a hovering interaction operation performed by a palm, so that a user can control a palm-based interaction device without touching or any physical contact. This improves efficiency of interaction.