Realistic Virtual Object Displacement Through Markerless Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional motion capture systems for virtual reality and augmented reality environments are cumbersome, expensive, and lack real-time capability due to the use of markers or sensors, and systems with multiple cameras struggle with data analysis, limiting their deployment and user experience.
Innovation Solution
A method for manipulating virtual objects using real motions of hands in a 3D sensory space, capturing hand images, sensing their location, and incorporating them into a virtual reality scene, allowing for realistic interactions such as grasping, rotating, and stretching virtual objects based on the number of contact points and hand gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional motion capture systems use markers or sensors, then motion tracking capability is achieved, but device complexity and cost increase
Solution Approach 1:
The patent uses image capture devices to create visual copies of hand positions and gestures, then processes these images to extract motion data. This replaces physical markers or sensors with optical copying and computational analysis, achieving motion tracking without adding physical complexity to the user's hands or environment.
Solution Approach 2:
The patent replaces mechanical motion capture systems (with physical markers, sensors, and multiple cameras) with an optical-computational system. Instead of mechanical tracking devices, it uses image processing algorithms to detect hand positions, gestures, and movements from captured images, substituting mechanical complexity with computational processing.
2Measurement precision
If multiple cameras are used for motion capture, then tracking accuracy improves, but data analysis complexity and processing time increase
Solution Approach 1:
The patent extracts only the necessary motion information (hand positions, gestures, movements) directly from captured images using image processing algorithms. Instead of analyzing complete multi-camera datasets, it extracts specific features of interest from the images, reducing data analysis complexity while maintaining tracking accuracy for hand interactions.
Solution Approach 2:
The system creates processed copies of hand positions and gestures from captured images, then uses these processed representations for interaction control. This copying and processing approach simplifies the data representation while preserving the essential motion information needed for accurate tracking and interaction.
3Reliability
If conventional systems use fixed sensors or markers, then motion capture is achieved, but ease of operation and natural movement are reduced
Solution Approach 1:
The patent enables the system to automatically capture and process hand images without requiring users to wear or attach any devices. The image capture devices autonomously track hands and gestures in the environment, and the system self-processes the images to extract motion data, eliminating the need for user cooperation with physical markers or sensors.
Solution Approach 2:
Instead of requiring users to attach tracking devices to themselves (conventional approach), the patent inverts the approach by having the system actively search for and capture images of hands and gestures in the environment. This reversal allows natural, unencumbered movement while maintaining reliable motion capture capability.
4Adaptability or versatility
If conventional motion capture systems are deployed, then virtual reality interaction is enabled, but cost and accessibility are reduced
Solution Approach 1:
The patent uses standard image capture devices (cameras) to create visual copies of hand gestures and positions, then processes these images to enable virtual reality interaction. This approach replaces expensive specialized motion capture hardware with readily available imaging devices, significantly reducing deployment cost while maintaining interaction capability.
Solution Approach 2:
The patent replaces expensive mechanical motion capture systems with an optical-computational approach using image processing. This substitution eliminates the need for costly specialized hardware while enabling the same virtual reality interaction capabilities through software-based gesture recognition and hand tracking algorithms.
Data Source
AI summary
The technology disclosed relates to a method of realistic displacement of a virtual object for an interaction between a control object in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a 2D sub-component free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting rotation of the virtual object by the 3D solid control object model.