Image Processing Apparatus Gesture Feedback via Combined Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gesture recognition technologies, such as those described in PTL 1, often lead to incorrect user interactions due to the lack of immediate feedback on gesture performance, especially as the complexity of gestures increases, making it difficult for users to accurately execute processes using body or hand gestures.
Innovation Solution
An image processing apparatus and method that combines a displayed image with a captured image to provide real-time feedback of gesture operations on the user interface, allowing users to visually confirm their gestures through a combined display on the screen, thereby enhancing maneuverability and reducing errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If gesture recognition technology is implemented without visual feedback, then the device can execute processes according to body or hand gestures, but the user is highly likely to perform wrong manipulations as the number of gestures increases or gestures become complex
Solution Approach 1:
The patent applies feedback by capturing images of the user's gestures using an imaging device and displaying them on a display device in real-time. This visual feedback loop allows users to confirm their gestures are being correctly recognized, thereby improving manipulation accuracy while maintaining gesture recognition versatility
Solution Approach 2:
The patent creates a visual copy of the user's physical gesture by capturing it with an imaging device and displaying the captured image. This copy serves as feedback to the user, allowing them to verify their gesture without adding physical complexity to the system
2Adaptability or versatility
If multiple body gestures or hand gestures are required for complex processes, then more functions can be controlled, but the user is highly likely to perform wrong manipulations
Solution Approach 1:
By displaying captured images of gestures in real-time, the system provides immediate feedback that helps users understand whether their gestures are being correctly interpreted. This reduces the cognitive load and physical trial-and-error required when performing multiple complex gestures
Solution Approach 2:
The display device acts as an intermediary between the user's physical gesture and the system's interpretation. By showing the captured gesture image, it mediates the interaction, allowing users to verify their input before the system executes the corresponding function
Data Source
Figure 1
Figure 2A~2E
Figure 3A~3F
AI summary
An information processing system that acquires image data corresponding to a target object that is a target for gesture recognition captured by an imaging device; determines whether a distance between the target object and the imaging device is inadequate for recognition of a gesture made by the target object; and outputs a notification when the determining determines that the distance between the target object and the imaging device is inadequate for recognition of a gesture made by the target object.