Optical See-Through AR Vision Correction for Low-Light Subject Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AR devices and chromatic vision correction glasses face issues with reduced field of vision due to excessive light shielding, loss of color information, and decreased identifiability in low-light conditions, particularly for users with abnormal chromatic vision and in night vision scenarios.
Innovation Solution
An image processing apparatus with an optical see-through configuration that captures external light, extracts specific regions, generates virtual images for correction, and superimposes them on the external light to enhance identifiability, using a processor and circuit units for region extraction, virtual image generation, and display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If light is shielded to match colors with low sensitivity in chromatic vision correction glasses, then chromatic vision is corrected, but the entire field of vision becomes dark
Solution Approach 1:
The patent divides the vision correction function into two separate systems: chromatic vision correction glasses that selectively block specific wavelengths, and an AR device that provides additional illumination. This segmentation allows each system to perform its specialized function without the negative side effects of the other - the correction glasses maintain their wavelength-selective blocking capability while the AR device compensates for the resulting darkness through targeted light emission.
Solution Approach 2:
The AR device acts as an intermediary system that bridges the gap between chromatic vision correction and adequate illumination. It captures images through its imaging unit, processes them to identify regions needing enhancement, and displays corrected images through the display unit that overlays information on the user's field of view without blocking external light.
2Illumination intensity
If visible light is not observed in night vision apparatus, then ambient light such as infrared rays can be collected, but color information is lost
Solution Approach 1:
The patent merges the capabilities of multiple imaging systems into a single AR device. The imaging unit can capture both visible light and infrared radiation, while the display unit processes and combines this information to create images that preserve color information even when observing in low-light conditions. This merging allows the system to simultaneously collect ambient light including infrared rays while maintaining color information through image processing.
Solution Approach 2:
The system dynamically changes operational parameters based on lighting conditions. The imaging unit adjusts its sensitivity and wavelength range according to ambient light levels, and the display unit applies appropriate image processing algorithms to enhance visibility while preserving color information. This parameter adjustment allows optimal performance across different lighting environments from bright daylight to complete darkness.
3Reliability
If a non-transmissive display device is used for chromatic vision correction, then correction can be achieved, but the technology cannot be applied to an optical see-through type of HMD
Solution Approach 1:
The patent employs dynamic image processing that adapts to different display types and viewing conditions. The system processes images in real-time and adjusts the correction algorithm based on whether the output is a non-transmissive display or an optical see-through display. This dynamic adaptation allows the same chromatic vision correction technology to be effectively applied across different HMD architectures without requiring separate dedicated systems.
4Area of stationary object
If external light is transmitted in an optical see-through type of HMD, then the field of view is maintained, but chromatic vision correction and night vision improvement are insufficient
Solution Approach 1:
The AR device continuously captures images through its imaging unit, processes them through the region extraction and virtual image generation units, and displays the corrected information through the display unit. This continuous processing and overlay of corrected images on the user's field of view ensures that chromatic vision correction and night vision improvement are maintained without interrupting the transmission of external light, thereby preserving the natural field of view while enhancing identifiability.
Data Source
AI summary
An image processing apparatus capable of allowing a user to visually perceive an image by transmitting external light comprises an imaging unit configured to capture an image of an external world; a region extraction unit configured to extract a specific region from an external-world image acquired by imaging by the imaging unit; a virtual image generation unit configured to generate a virtual image for correcting a vision of a user for the specific region; and a virtual image display unit configured to display the virtual image so as to be superimposed on a region corresponding to the specific region of the transmitted external light, wherein the region extraction unit extracts the subject region as a specific region by detecting a subject region corresponding to a predetermined subject from the external image, and wherein the virtual image generation unit generates a virtual image for correcting the identifiability of the predetermined subject based on pixel information of the specific region and a dark night vision correction coefficient.