3D Video See-Through Display Rectification Without PC
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video see-through head-mounted display (HMD) technologies require a PC to process images from multiple camera modules for generating three-dimensional images in virtual or augmented reality, which is cumbersome and inefficient, and they face challenges in minimizing storage space and access to break point look-up tables for rectification.
Innovation Solution
A three-dimensional information augmented video see-through display device and method that processes images from multiple camera modules using a hardware chip without a PC, incorporating a camera interface module, rectification module, lens distortion correction module, and image generation module to generate three-dimensional images, while minimizing storage space by sequentially storing break point information and using differential values for efficient coordinate conversion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a PC is used to process images from multiple camera modules for generating three-dimensional images, then image processing capability is improved, but device complexity and portability are worsened
Solution Approach 1:
The patent extracts the image processing function from a PC and implements it in a standalone HMD device. The HMD includes a camera interface module, rectification module, lens distortion correction module, and image generation module that collectively perform three-dimensional image processing locally without requiring an external PC, thereby reducing device complexity while maintaining processing capability
Solution Approach 2:
The HMD device integrates multiple functions including camera capture, rectification, lens distortion correction, and three-dimensional image generation within a single portable unit. This multi-functional integration eliminates the need for separate PC equipment while maintaining comprehensive image processing capabilities
2Measurement precision
If a break point look-up table is used for rectification, then rectification accuracy is improved, but storage space requirements are worsened
Solution Approach 1:
The patent segments the rectification process by storing only break point information in the look-up table rather than complete rectification data for all pixels. The rectification module uses these break points to determine coordinate conversion target pixel groups and performs differential calculations, significantly reducing storage space while maintaining rectification accuracy through selective sampling
Solution Approach 2:
The patent changes the parameter representation from storing complete coordinate conversion data to storing only break point coordinates and differential values. This parameter transformation reduces the quantity of stored data while preserving the essential information needed for accurate rectification through differential calculation
3Measurement precision
If complete coordinate conversion information is stored for all pixels, then rectification accuracy is improved, but access time to the look-up table is worsened
Solution Approach 1:
The patent segments the pixel coordinate space by identifying break points that divide the image into regions requiring different coordinate conversions. The rectification module determines coordinate conversion target pixel groups based on these break points, allowing the system to access only relevant look-up table entries rather than searching through complete pixel data, thus reducing access time while maintaining accuracy
Solution Approach 2:
The patent performs preliminary organization of break point information in the look-up table to enable efficient retrieval. By pre-structuring the break point data and establishing conversion rules, the system prepares the necessary rectification information in advance, reducing the time needed during actual real-time processing
Data Source
AI summary
A three-dimensional information augmented video see-through display device according to an exemplary embodiment of the present disclosure includes a camera interface module which obtains at least two real images from at least two camera modules, a rectification module which performs rectification on the at least two real images, a lens distortion correction module which corrects at least two composite images obtained by combining a virtual image to the at least two real images, based on a lens distortion compensation value indicating a value for compensating for a distortion of a wide angle lens for the at least two real images, and an image generation module which performs side-by-side image processing on the at least two composite images to generate a three-dimensional image for virtual reality VR or augmented reality AR.