Head-Mounted Display Image Processing Using Dual Sensor Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional head-mounted display devices using a video see-through method face challenges in providing a view close to the real world due to differences in imaging unit positions and the need for high-resolution color images, which increases costs and processing loads.
Innovation Solution
An image processing device that includes a first image sensor for obtaining distance information, a second image sensor, and a display, which processes images to generate a color image for display by combining grayscale images from the first image sensor with color images from the second image sensor based on distance information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If two high-resolution color imaging units are provided for left and right eyes, then a view close to the real view can be provided to the user, but the device cost increases and processing load increases
Solution Approach 1:
The imaging function is segmented into two specialized sensors: a first image sensor (grayscale/depth) and a second image sensor (color). Each sensor is optimized for its specific function, allowing the system to achieve high-quality imaging without requiring two full-color high-resolution sensors, thus reducing cost while maintaining image quality.
2Measurement precision
If two high-resolution color imaging units are provided for left and right eyes, then a view close to the real view can be provided to the user, but the processing load increases requiring expensive processors and memories
Solution Approach 1:
The processing load is segmented by separating depth processing from color processing. The first image sensor provides grayscale/depth information that requires less processing power, while the second color sensor handles color information. This segmentation allows the use of less powerful (and cheaper) processors compared to processing two full-color high-resolution images simultaneously.
Solution Approach 2:
The grayscale image from the first sensor acts as an intermediary that carries depth and structural information. This intermediary representation allows the system to process spatial relationships more efficiently before combining with color information, reducing the overall processing burden compared to directly processing two color images.
Data Source
AI summary
An image processing device according to the present invention is usable together with a head-mounted display device including a first image sensor configured to obtain distance information, a second image sensor different from the first image sensor, and a display, and includes: one or more processors and/or circuitry configured to execute a first acquisition processing to acquire a first image of an outside world captured by the first image sensor; execute a second acquisition processing to acquire a second image of the outside world captured by the second image sensor; and execute a generation processing to generate, on a basis of the distance information corresponding to the first image, an image of the outside world, which is a color image to be displayed on the display, by combining the first image which is a grayscale image, and the second image which is a color image.