VR Object Scaling Using 6DoF Motion Vectors for Stereoscopic Depth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR image scaling methods using mainstream encoding schemes like H.264, H.265, or HEVC result in equal-proportion scaling of the whole VR image, failing to provide a stereoscopic and realistic VR experience.
Innovation Solution
An image processing method that utilizes six-degree-of-freedom data to determine a motion vector and scale specific objects within the VR image, employing a 6-parameter affine model to achieve stereoscopic scaling effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If equal-proportion scaling of the whole VR image is used, then the implementation is simple using mainstream encoding schemes, but the stereoscopic and realistic VR experience is lost
Solution Approach 1:
The patent segments the VR image into multiple regions based on depth information, identifying different objects or areas that require different scaling treatments. This allows selective scaling of specific regions rather than uniform scaling of the entire image, thereby achieving stereoscopic effects while maintaining implementation feasibility through region-based processing.
Solution Approach 2:
The patent applies different scaling qualities to different regions of the VR image based on their depth characteristics. Objects or regions closer to the user receive different scaling treatment compared to distant objects, creating local quality variations that produce the desired stereoscopic scaling effect and enhance the realistic VR experience.
2Manufacturing precision
If selective scaling of specific objects is implemented, then the stereoscopic VR experience is improved, but the processing complexity increases
Solution Approach 1:
The patent performs preliminary actions by pre-processing the VR image to extract depth information and identify objects or regions before scaling operations. This preliminary segmentation and depth analysis are done in advance, allowing the actual scaling process to operate on pre-identified regions, thereby reducing the complexity of real-time selective scaling while maintaining stereoscopic accuracy.
Data Source
AI summary
The present disclosure provides an image processing method and apparatus, a device, and a medium. The method is applied in a virtual reality headset and includes: obtaining six-degree-of-freedom data of the virtual reality headset and a virtual reality image corresponding to the six-degree-of-freedom data; determining a motion vector of a user in a target direction based on the six-degree-of-freedom data; determining a to-be-processed object from the virtual reality image; and scaling the to-be-processed object based on the motion vector. In the present disclosure, stereoscopic scaling of a VR image displayed by a VR device is implemented to achieve a stereoscopic scaling effect of the image, thereby satisfying use requirements for a user.


