User-Aware HMD VR Rendering with Preparatory Region Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted display (HMD) systems face delays in generating high-resolution images when a user's line of sight moves to regions without pre-acquired reference images, leading to increased processing load.
Innovation Solution
An image processing device that sets a first region for high-resolution rendering and a second region for preparatory processing based on user information and additional conditions, allowing for low-load generation of high-resolution images without delay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If high-resolution images are generated for regions not visually recognized by the user, then image generation delay is reduced, but processing load increases
Solution Approach 1:
The patent applies different quality levels to different regions of the VR image. The first region (visually recognized area) is rendered in high resolution, while the second region (not visually recognized) is rendered in lower resolution. This local quality differentiation reduces overall processing load while maintaining high resolution where the user actually looks, thus resolving the contradiction between reducing image generation delay and minimizing processing load.
Solution Approach 2:
The patent performs preparatory processing in advance to acquire reference images for the second region before the user actually views them. By pre-acquiring these reference images during periods when the user is viewing the first region, the system prepares data ahead of time so that when the user moves their line of sight to the second region, high-resolution images can be generated immediately without delay, while the processing is distributed over time rather than occurring all at once.
2Productivity
If reference images are acquired in advance for the user's viewpoint, then high-resolution images can be generated without delay, but processing load increases when user moves line of sight to unrecognized regions
Solution Approach 1:
The patent selectively applies high-resolution rendering only to the first region where the user's line of sight is currently positioned, while using lower-resolution reference images for the second region. This local quality approach ensures high image generation speed for the currently viewed area without requiring high-resolution processing for the entire VR scene, thus maintaining productivity while controlling processing load.
Solution Approach 2:
The patent performs preparatory processing partially - acquiring reference images for the second region in advance but not rendering them in full high resolution until needed. This partial action allows the system to prepare data ahead of time (improving future productivity) without performing complete high-resolution processing for all regions simultaneously (controlling current processing load).
Data Source
AI summary
An image processing device includes one or more processors and/or circuitry configured to: perform first setting processing to set a first region that is a region rendered in higher resolution than other regions in a VR image; perform second setting processing to set a second region to which preparatory processing is applied in order to perform rendering in the resolution of the first region, based on user information relating to a first user visually recognizing the VR image, and region information relating to a region that is set in accordance with conditions not related to the first user; and perform generating processing to generate the VR image based on the first region and the second region.