Imaging System for VR Context and Focus Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional imaging equipment for virtual reality devices face limitations in capturing high-resolution two-dimensional images, require excessive bandwidth for communication, and consume significant power, failing to meet data throughput and power efficiency requirements.
Innovation Solution
An imaging system comprising at least one imaging sensor per eye of a user, a processor, and an optical combiner, which captures and processes images to generate context and focus images with varying resolutions, adjusts sensor orientation based on user gaze and head orientation, and employs high dynamic range techniques to optimize image capture and communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional imaging equipment captures high-resolution two-dimensional images, then image quality is improved, but bandwidth requirements and power consumption increase significantly
Solution Approach 1:
The patent divides the imaging task into two separate imaging sensors: one dedicated to capturing context information at lower resolution, and another dedicated to capturing focus information at higher resolution. This segmentation allows each sensor to be optimized for its specific function, reducing the total power consumption compared to using a single high-resolution sensor for the entire field of view.
Solution Approach 2:
The patent applies different quality levels to different regions of the visual field. The context image captures the peripheral field of view at lower resolution, while the focus image captures the central region of interest at higher resolution. This local quality approach ensures high image quality where needed (in the focus region) while reducing power consumption in less critical areas (peripheral context region).
2Measurement precision
If conventional imaging equipment captures high-resolution two-dimensional images, then image quality is improved, but communication bandwidth requirements increase
Solution Approach 1:
The patent segments the visual information into context and focus components, each processed and transmitted separately. The context image data (lower resolution) and focus image data (higher resolution) are transmitted through the communication network independently, reducing the total data bandwidth requirement compared to transmitting a single full-resolution image of the entire field of view.
Solution Approach 2:
The patent transmits high-quality image data only for the focal region where the user's attention is directed, while transmitting lower-quality data for the peripheral context region. This approach reduces the total quantity of data transmitted over the communication network while maintaining perceptual quality in the important focal area.
3Device complexity
If conventional imaging equipment is used, then simplicity of the system is maintained, but ability to capture high-resolution images and meet bandwidth limitations is compromised
Solution Approach 1:
The patent uses two specialized imaging sensors instead of one general-purpose sensor. Each sensor is optimized for its specific function (context capture vs. focus capture), which improves overall image resolution and bandwidth efficiency. The segmentation of functions allows simpler, more specialized sensor designs compared to a single complex high-resolution sensor.
Solution Approach 2:
The processor performs multiple functions: it processes both context and focus images, manages the optical combiner, tracks gaze direction, and coordinates the imaging sensors. This multi-functionality consolidates complexity into the processing domain rather than requiring complex hardware in each imaging component.
4Measurement precision
If the field of view of the focus imaging sensor is made narrower to increase resolution, then measurement precision is improved, but the field of view is reduced
Solution Approach 1:
The patent segments the total field of view into two regions: the context region captured by the context imaging sensor at lower resolution, and the focus region captured by the focus imaging sensor at higher resolution. This segmentation allows the focus sensor to have a narrower field of view with higher resolution while the context sensor provides the broader field of view coverage.
Solution Approach 2:
The patent applies high resolution locally to the focal region where the user's attention is directed, while accepting lower resolution in the peripheral context region. This local quality approach maximizes the effective field of view at high resolution without requiring the entire sensor array to operate at maximum resolution, thereby maintaining a practical field of view.
Data Source
Figure 1~2
Figure 3
Figure 4~5A
AI summary
Disclosed is an imaging system and a method of producing a context image and a focus image for a display apparatus, via the imaging system. The imaging system comprises at least one imaging sensor per eye of a user, and a processor coupled thereto. The processor is configured to control the imaging sensors to capture at least one image of a real world environment, and is arranged to be communicably coupled with the display apparatus. Furthermore, the processor is configured to: receive, from the display apparatus, information indicative of a gaze direction of the user; determine a region of visual accuracy of the at least one image, based upon the gaze direction of the user; process the at least one image to generate the context image and the focus image; and communicate the generated context image and the generated focus image to the display apparatus.