VR Image Rendering Using Pose Threshold Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current electronic devices, such as VR head-mounted devices, experience rendering delays and jitters due to the need to re-render each frame in its entirety when the user's head moves, even with small amplitude changes, resulting in unstable image display and degraded user experience.
Innovation Solution
An image processing method that acquires pose change quantities using inertial measurement data to determine if the change is below a threshold, allowing for reduced data rendering by calculating the near viewport distance and merging previous frames with changed images to create the current frame, thereby reducing data to be rendered and eliminating jitters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the electronic device re-renders each frame in the virtual scene as a whole when the wearer's head moves, then the rendering completeness is maintained, but the rendering time increases and causes delay and jitters
Solution Approach 1:
The patent segments the rendering process by dividing the frame into unchanged regions (copied from previous frame) and changed regions (re-rendered only where necessary). This segmentation allows the system to maintain rendering completeness for important areas while reducing overall rendering time by skipping redundant rendering of unchanged portions.
Solution Approach 2:
The patent extracts only the changed portions of the scene that require re-rendering, separating them from the unchanged portions. By taking out only the necessary changed regions for re-rendering and copying the rest from the previous frame, the system achieves both completeness where needed and time efficiency elsewhere.
2Stability of the object's composition
If the electronic device re-renders each frame in the virtual scene as a whole when the wearer's head moves, then the image stability is maintained, but the frame rate decreases due to increased data processing
Solution Approach 1:
The patent segments the frame processing into stable unchanged regions (copied from previous frame to maintain stability) and dynamic changed regions (re-rendered to update content). This segmentation allows the system to preserve image stability in unchanged areas while improving frame rate by reducing the total amount of data that needs to be re-rendered.
Solution Approach 2:
The patent applies partial rendering action by re-rendering only the necessary changed portions rather than the entire frame. This partial action maintains image stability where needed while significantly reducing processing workload, thereby improving frame rate.
3Manufacturing precision
If the electronic device produces a large amount of data to be rendered, then the rendering detail is improved, but the data processing time increases causing delays
Solution Approach 1:
The patent extracts and processes only the changed portions of the scene that require detailed re-rendering, while copying unchanged portions from the previous frame. This extraction approach maintains rendering detail where changes occur while dramatically reducing the total data processing time by excluding unchanged regions from the rendering pipeline.
Solution Approach 2:
The patent segments the rendering data into detailed re-rendered changed regions and copied unchanged regions. This segmentation allows the system to maintain high rendering detail in areas that have changed while reducing overall data processing time by handling unchanged areas through simple copying rather than full rendering.
4Stability of the object's composition
If the electronic device renders the virtual scene as a whole, then the scene consistency is maintained, but the user experience deteriorates due to jitters and delays
Solution Approach 1:
The patent segments the scene rendering into consistent unchanged portions (copied from previous frame to maintain scene consistency) and updated changed portions (re-rendered to reflect current state). This segmentation preserves scene consistency in stable areas while improving user experience by reducing jitters and delays through faster overall processing.
Solution Approach 2:
The patent applies partial rendering action only where scene changes occur, maintaining scene consistency in unchanged areas through copying while improving user experience by reducing processing time and eliminating jitters caused by full-frame re-rendering delays.
Data Source
AI summary
The present application discloses an image processing method and apparatus for an electronic device, and the electronic device. The method includes; acquiring a pose change quantity of the electronic device from a previous frame moment to a current frame moment; judging whether the pose change quantity is less than a set threshold; acquiring, in the case where the pose change quantity is less than the set threshold, to-be-rendered image data at the current frame moment according to a current value of a near viewport distance at the current frame moment; rendering the to-be-rendered image data at the current frame moment to acquire a changed image at the current frame moment; and merging a previous frame of image with the changed image to acquire a current frame of image at the current frame moment.