VR Image Processing with Local Distortion Correction for Beautification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality live streaming using binocular cameras results in distorted target objects, leading to poor beautification effects and user experience due to high computational demands and inaccurate object detection.
Innovation Solution
Perform distortion correction on target object areas within the image frame to obtain distortion-free images, apply image processing operations, and then reverse the correction to ensure accurate beautification effects while reducing computational load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If distortion correction operation is performed on target object area images, then beautification effect is improved, but computational load increases
Solution Approach 1:
The patent divides the image processing into distinct segments: first extracting target object area images from the full image frame, then performing distortion correction only on these extracted regions, and finally compositeing them back. This segmentation allows distortion correction to be applied selectively to relevant areas rather than the entire image, improving beautification effect while managing computational load.
Solution Approach 2:
The patent applies different processing qualities to different parts of the image. Distortion correction is applied locally to target object area images where it is most needed for beautification, while other areas of the image frame maintain their original characteristics. This local quality approach optimizes the balance between beautification effect and computational resources.
2Manufacturing precision
If distortion correction operation is performed on target object area images, then target object processing precision is improved, but processing time increases
Solution Approach 1:
The patent performs preliminary extraction of target object area images from the full image frame before applying distortion correction. By pre-identifying and isolating the target objects, the system can apply distortion correction more efficiently to specific regions rather than processing the entire image frame, thus improving processing precision while reducing overall processing time.
Solution Approach 2:
The patent applies distortion correction partially - only to the extracted target object area images rather than the complete image frame. This partial action approach focuses computational resources on the most critical areas (target objects) where distortion correction most impacts processing precision, while avoiding unnecessary processing of other image regions.
3Productivity
If beautification operation is performed directly on images from binocular virtual reality camera, then processing speed is improved, but beautification effect deteriorates due to distortion
Solution Approach 1:
The patent segments the image processing workflow into distinct stages: extraction of target object area images, distortion correction, beautification processing, and compositing. This segmentation allows each stage to be optimized independently - extraction and compositing maintain processing speed, while distortion correction specifically targets quality improvement for target objects.
Solution Approach 2:
The patent performs preliminary distortion correction on extracted target object area images before applying beautification operations. This preliminary action ensures that the base images are distortion-free before beautification is applied, guaranteeing high beautification effect while maintaining efficient processing through the structured workflow.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
Provided in the embodiments of the present disclosure are an image processing method and apparatus, and a device, a computer-readable storage medium and a product. The method comprises: acquiring at least one target object area image in a target image frame corresponding to a virtual-reality live broadcast; performing a distortion correction operation on the at least one target object area image, so as to obtain at least one distortion-free image; performing an image processing operation on the basis of the at least one distortion-free image, so as to obtain at least one processed image; performing an inverse transformation operation of the distortion correction operation on the at least one processed image, so as to obtain at least one inversely transformed image; and replacing the at least one target object area image in the target image frame with the at least one inversely transformed image, so as to obtain a target image frame.