Gesture Recognition System for Electronic Display Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems lack effective methods for users to interact with electronic display devices using gestures, such as hand movements and object identification, to modify application execution dynamically.
Innovation Solution
A system comprising image sensors, an electronic display device, and processors that analyze image data to recognize gestures and object identities, allowing for real-time modification of application execution, including launching, switching, and adjusting settings based on user input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional input methods (keyboard, mouse, touch) are used to interact with electronic display devices, then the interface is well-defined and easy to implement, but the user interaction lacks intuitiveness and flexibility
Solution Approach 1:
The patent replaces traditional mechanical input devices (keyboard, mouse, touch screen) with a gesture recognition system that uses image sensors and computer vision algorithms to detect hand movements and object interactions in the air space in front of the display, eliminating the need for physical contact and providing more intuitive interaction
Solution Approach 2:
The patent introduces an intermediary layer consisting of image sensors, processing units, and gesture recognition algorithms that translate physical hand movements and object interactions into digital commands, bridging the gap between natural human gestures and device control without requiring direct mechanical input
2Adaptability or versatility
If gesture recognition systems are implemented to improve user interaction, then interaction flexibility increases, but system complexity and computational requirements increase
Solution Approach 1:
The patent implements a universal gesture recognition system that can identify multiple types of gestures (hand movements, object interactions, spatial positions) and map them to various application functions, allowing a single system to handle diverse interaction scenarios without requiring separate mechanisms for each gesture type
Solution Approach 2:
The patent uses image sensors to create visual copies (images) of the user's hand and held objects, then analyzes these copied visual data through processing units to recognize gestures and identify objects, avoiding the need for direct physical sensors while maintaining accurate gesture detection
3Speed
If real-time image analysis is performed to recognize gestures and objects, then interaction responsiveness improves, but processing time and computational energy increase
Solution Approach 1:
The patent performs preliminary actions by continuously capturing images and pre-processing visual data in real-time, preparing gesture and object identification results in advance so that when a gesture is made, the system can quickly match it against pre-computed patterns and provide immediate feedback without intensive real-time computation
Solution Approach 2:
The patent segments the image analysis process into distinct stages: image capture, pre-processing, gesture pattern recognition, object identification, and command generation, allowing each segment to be optimized independently and processed efficiently in sequence rather than requiring intensive simultaneous computation
Data Source
AI summary
A method of modifying execution of one or more applications being executed by one or more processors includes receiving image data reproducible as one or more images of (i) at least a portion of a hand of a user, (ii) at least a portion of an object held in the hand of the user, or (iii) both (i) and (ii); analyzing the image data, using the one or more processors, to determine (i) one or more gestures performed by the hand of the user, (ii) an identity of the object held in the hand of the user, or (iii) both (i) and (ii); and based at least in part on the one or more gestures, the identity of the object, or both, modifying the execution of the one or more applications being executed by the one or more processors.