Composite Image Generation for Video See-Through VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video see-through (VST) systems, high-definition imaging is essential for realistic display, but finer pixels lead to longer exposure times, causing imaging blur and increased VR sickness, while processing and data transfer delays result in positional deviations and higher prediction failure probabilities, necessitating a solution for reducing blur and delay while maintaining high image quality.
Innovation Solution
An image processing device that generates a composite image by combining a first image captured in a longer exposure time with a second image from a partial region captured in a shorter exposure time, with the second image's imaging timing set closer to the display output timing than the first image's, and uses binning processing to reduce noise and adjust exposure, thereby minimizing delay and blur.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If exposure time is extended to maintain high definition, then image quality is improved, but imaging blur increases
Solution Approach 1:
The patent divides the image into a region of interest and a region of non-interest, applying different exposure strategies to each. The region of interest uses longer exposure time for high definition, while the region of non-interest uses shorter exposure time to avoid blur, thus resolving the contradiction locally across different spatial regions
Solution Approach 2:
The patent implements local quality by applying different exposure times to different regions of the image. The region of interest receives longer exposure for sharpness, while the region of non-interest receives shorter exposure to minimize motion blur, allowing each region to have optimal image quality for its specific requirements
2Productivity
If processing load is reduced by thinning out non-interest regions, then processing speed is improved, but image quality deteriorates
Solution Approach 1:
The patent segments the image processing into two parts: processing the region of interest at full resolution for high quality, and processing the region of non-interest at reduced resolution for speed. This segmentation allows the system to maintain image quality where needed while improving overall processing speed
Solution Approach 2:
The patent applies partial action by processing only the necessary region (region of interest) at full resolution, while applying reduced processing to the region of non-interest. This partial processing approach maintains sufficient image quality for the critical region while significantly reducing overall processing load and improving speed
3Reliability
If imaging timing is delayed to capture complete image, then processing completeness is improved, but positional deviation increases
Solution Approach 1:
The patent segments the imaging process into two timing streams: the region of interest is captured at timing closer to display output for low delay, while the region of non-interest is captured at an earlier timing for processing completeness. This segmentation allows the system to achieve both low positional deviation for critical regions and processing completeness for non-critical regions
Data Source
AI summary
An image processing device of an embodiment includes a control unit that generates a composite image obtained by combining a first image captured in a first exposure time and having first resolution and a second image that is an image corresponding to a partial region of the first image and is captured in a second exposure time shorter than the first exposure time and having second resolution higher than the first resolution, the first image and the second image being input from an image sensor, and outputs the composite image to a display device.