Portable Handheld Posture And Gesture Recognition Through Camera Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing human-machine interaction systems using portable equipment with sensors increase weight and risk loss of posture and gesture recognition due to sensor damage, leading to ineffective user interaction.
Innovation Solution
A posture identification method and device utilizing a portable, flexible device with modeling and identifying entity features, captured by an image collector, processed by a processor to determine user postures through reference and comparison models, and communicated to interactive systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If various sensors are used on portable equipment to determine user posture, then posture recognition capability is improved, but the weight of the equipment increases
Solution Approach 1:
The patent replaces physical sensors with an image collector (camera) and image processing system. Instead of using inertial sensors, pressure sensors, or other mechanical/physical sensing elements on the portable device, the system captures images and processes them to determine user posture. This substitution eliminates the need for heavy sensor components while maintaining posture recognition functionality.
2Reliability
If multiple sensors are installed on portable equipment for gesture recognition, then interaction accuracy is improved, but the risk of recognition loss due to sensor damage increases
Solution Approach 1:
The patent uses visual copying through image collection to represent physical gestures. Instead of relying on physical sensors that can be damaged, the system creates visual copies (images) of the user's hand gestures and processes these copies to determine gesture meaning. This approach eliminates the vulnerability of physical sensors while maintaining gesture recognition accuracy.
3Adaptability or versatility
If sensors are used to detect user actions, then interaction functionality is improved, but the device complexity increases
Solution Approach 1:
The patent makes the image collector serve multiple functions: it captures images for posture recognition, gesture recognition, and various interaction scenarios. Instead of requiring separate sensors for different interaction types, a single image collector handles all recognition tasks, reducing device complexity while maintaining versatile interaction functionality.
Data Source
AI summary
A method of detecting and identifying postures and gestures of a human user generates a reference model from a reference image and obtains an image of action or gesture being performed. The image is of a user and his flexible and hand-held portable device, and the image comprises a second identification feature. A state of a second feature of the second identification feature in the reference model can generate posture identification. The state of the second feature comprises size, shape, and location of the second identification feature in the hands of the user. A portable device and a non-volatile storage medium of a computer are also disclosed.