Gesture Recognition User Interface System for Remote Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional user interface systems on mobile and computing devices lack efficient interaction methods since they often require users to be within arm's length of the screen, limiting convenience and usability, especially in environments where multiple users may interact simultaneously.
Innovation Solution
A gesture-based user interface system that recognizes body parts using image recognition techniques, allowing users to interact through gestures, determining interaction times and relationships between body parts to perform actions such as selecting content or invoking applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Weight of stationary object
If a touch-screen display with soft-keyboard is used to reduce size and weight, then device portability is improved, but user interaction convenience deteriorates because the user must be within arm's length of the display
Solution Approach 1:
The patent replaces the mechanical touch-screen interface with a gesture recognition system using image capture devices and computer vision algorithms. The system captures images of the user's body and performs gesture recognition through software processing, eliminating the need for physical contact with the device while maintaining interaction capability.
Solution Approach 2:
The patent introduces an intermediary gesture recognition system between the user and the device interface. Instead of direct touch interaction, the system uses image capture devices to detect body gestures and translates them into control commands, serving as a mediator that enables remote interaction without requiring the user to be close to the display.
2Ease of operation
If conventional user input devices are used to ensure ease of interaction, then user interaction convenience is improved, but device size and weight increase
Solution Approach 1:
The patent replaces conventional mechanical input devices (keyboards, mice, buttons) with an optical gesture recognition system. Image capture devices and image processing algorithms substitute for physical input mechanisms, enabling interaction without adding mechanical components that would increase device weight.
Solution Approach 2:
The patent extracts the input function from physical devices and relocates it to the software/gesture recognition domain. By separating the interaction capability from physical form factors, the system eliminates the need for heavy input devices while maintaining full interaction functionality through gesture-based control.
3Ease of operation
If gesture recognition is implemented to enable remote interaction, then user interaction convenience is improved, but system complexity increases
Solution Approach 1:
The patent implements a universal gesture recognition framework that can identify multiple types of gestures (hand gestures, body postures, movements) using a single integrated system. The image processing module serves multiple functions including gesture detection, classification, and translation into control commands, reducing the need for separate specialized components for each gesture type.
Data Source
Figure 1
Figure 2~3
Figure 4~5C
AI summary
A method to provide a user interface (Ul), the method may be controlled by one or more controllers and may include one or more acts of obtaining image information from a sequence of images of a user; analyzing the image information to recognize the user; recognizing first and second reference objects at least one of which corresponding with respective body parts of the user from the image information; determining whether a first reference object has been placed over or is within a threshold scaled distance of a second reference object; calculating an interaction time (Ti) between the first reference object and the second reference object when it is determined that the first reference object has been placed over or is within the threshold scaled distance of the second reference object; comparing the interaction time with a threshold reference time (Trt); and performing an action in accordance with results of the comparison.