Virtual Hand Pose Interpolation for Immersive Object Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interactive content systems require additional hardware or processing resources to enhance immersion, leading to implementation burdens and limitations in user interaction, particularly in examining objects from various angles.
Innovation Solution
A blend space system is employed to manipulate and render object poses based on user inputs, using a two-dimensional coordinate system to interpolate and procedurally generate hand and object poses, allowing natural and unconstrained examination of objects within a virtual environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If additional hardware elements (such as new controllers or cameras) are introduced to enhance immersion, then the level of immersion is improved, but the device complexity and implementation burden increase
Solution Approach 1:
The patent uses virtual representations of hands and objects within a virtual environment to replicate real-world interaction. Instead of requiring additional physical hardware, the system creates digital copies of hand models and object representations that can be manipulated through software-based pose interpolation and procedural generation, achieving immersive interaction without extra physical devices
Solution Approach 2:
The patent replaces mechanical hardware requirements with computational methods. Rather than needing additional cameras or controllers to track hand movements and object poses, the system uses software algorithms to interpolate poses and generate virtual hand models, substituting mechanical sensing and actuation with computational processing
2Reliability
If additional processing resources are dedicated to improve immersion, then the level of immersion is improved, but the processing power requirements and content scaling options are limited
Solution Approach 1:
The patent applies partial action by using pose interpolation and procedural generation to create only the necessary visual details for immersion, rather than rendering every possible detail at full resolution. The system generates hand poses and object representations on-demand using algorithms, requiring less processing power than would be needed for complete pre-rendered animations or high-fidelity real-time tracking
Solution Approach 2:
The patent changes parameters by using blend spaces with defined pose boundaries and interpolation factors to generate hand and object poses. Instead of requiring complex real-time computation for every possible hand position, the system uses predefined pose boundaries and mathematical interpolation to generate intermediate poses, reducing processing requirements while maintaining immersive interaction
3Reliability
If more powerful processing devices are required to handle immersion-improving processes, then the level of immersion is improved, but the cost and accessibility of the system increase
Solution Approach 1:
The patent uses virtual hand models and object representations that can be rendered on standard processing devices. By creating digital copies of hands and objects that are manipulated through software algorithms rather than requiring hardware acceleration or specialized processors, the system can achieve immersive interaction on more accessible, cost-effective devices
Solution Approach 2:
The patent substitutes hardware-intensive processes with software-based algorithms for pose interpolation and procedural generation. This replacement reduces the processing power requirements and makes the immersive interaction technology accessible to devices with standard hardware capabilities, increasing system accessibility and reducing costs
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
An image generation system operable to generate updated views of an object in a scene, the system comprising an input obtaining unit configured to obtain one or more user inputs for controlling the pose of the object, an object pose modification unit configured to determine an updated pose of the object in accordance with the obtained user inputs, a hand pose determination unit configured to determine a pose for each of the hands associated with the object in accordance with the obtained user inputs, wherein the determining comprises generating a corresponding representation of the hands with the respective determined poses based upon two or more reference views of the hands, the reference views corresponding to different respective poses of the hands, a grab pose determination unit configured to determine a grab pose for each of the hands, the grab pose comprising a pose for fingers of each of the hands determined in dependence upon the updated object pose and a corresponding hand pose, and a rendering unit configured to generate one or more images of the object and associated hands in dependence upon the determined poses of the object, hands, and fingers.