VR Live-Streaming Frame Processing for 3D Beautification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing beautifying techniques cannot implement image optimization operations in virtual reality (VR) scenarios.
Innovation Solution
A system comprising a terminal device, binocular image acquisition apparatus, and virtual reality device is used to acquire and process live streaming image frames, performing first and global processing operations to generate a beautified 3D live streaming experience by combining 4K images from different angles into an 8K input, applying face recognition and rendering, and displaying the processed image on a virtual reality device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If existing beautifying techniques are applied to 2D scenarios, then image optimization can be achieved, but the technique cannot implement beautifying operation in VR scenario
Solution Approach 1:
The patent extends the beautifying technique from 2D image processing to 3D VR scenario by processing binocular image frames. The system acquires left and right eye images, processes them separately through the beautifying algorithm, and reconstructs 3D content, thereby adapting the 2D technique to 3D dimensionality while maintaining beautifying capability.
2Manufacturing precision
If global processing operation is performed on entire image frame, then complete beautifying effect is achieved, but computational load increases
Solution Approach 1:
The patent segments the image processing into two distinct operations: a first processing operation performed on a determined area (face region) to achieve detailed beautifying effect, and a second processing operation performed on the entire image frame for global optimization. This segmentation allows targeted processing of critical regions while maintaining overall efficiency.
Solution Approach 2:
The patent applies different processing strategies to different regions: intensive processing on the face area where beautifying is most critical, and lighter processing on the background and other regions. This local quality approach ensures high beautifying effect where needed while reducing overall computational load.
Data Source
AI summary
Embodiments of the present disclosure provide a method and an apparatus for processing a live streaming image frame, an electronic device, a computer-readable storage medium, a computer program product, and a computer program. The method includes: acquiring an image frame processing request; acquiring, according to the image frame processing request, a live streaming image frame corresponding to virtual reality live streaming content; determining an area to be processed in the live streaming image frame, and performing a first processing operation on the area to be processed, to obtain an image frame to be processed; performing, according to a first color lookup table corresponding to the live streaming image frame, a global second processing operation on the image frame to be processed, to obtain a processed target image frame; and displaying the target image frame.