Mixed Reality Glass Camera Array for Focus Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality technologies face challenges in providing an immersive experience by accurately registering real and virtual spaces, especially in maintaining focus and distance perception, and in efficiently storing and sharing mixed reality images across users.
Innovation Solution
A camera-based mixed reality glass apparatus equipped with multiple cameras, a real image processor, a virtual image processor, and a mixed reality image processor, which generates and corrects 360-degree images, overlays virtual content, and adjusts camera angles in real-time to provide optimal focus and distance perception, while interlinking with a video repository for storage and sharing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple cameras are mounted on smart glasses to capture 360-degree images, then the immersive experience and focus accuracy are improved, but the device complexity and weight increase
Solution Approach 1:
The camera system is divided into multiple independent camera units mounted at different positions on the smart glasses frame. Each camera captures a specific field of view, and the images are later stitched together to form a complete 360-degree view. This segmentation allows for improved focus accuracy in different directions while keeping each individual camera unit simple and manageable.
Solution Approach 2:
Multiple cameras are nested within the compact structure of the smart glasses frame, with each camera positioned to capture specific angular ranges. The cameras are integrated into the existing glasses structure rather than adding external bulky components, maintaining a sleek design while achieving 360-degree coverage through nested camera arrangements.
2Productivity
If real-time image processing and overlaying of virtual content is performed, then the mixed reality experience is improved, but the processing time and energy consumption increase
Solution Approach 1:
The system performs preliminary actions by capturing and processing images from multiple cameras in advance, creating a database of real-world environments before the mixed reality experience is needed. Virtual content is pre-generated and stored, allowing for faster retrieval and overlaying during actual use, thus reducing real-time processing requirements and energy consumption.
Solution Approach 2:
The image processing system operates continuously in the background, maintaining live feeds from all cameras and pre-processing images for later use. This continuous operation ensures that when mixed reality content needs to be displayed, the processing pipeline is already ready, minimizing interruptions and reducing peak energy consumption during critical rendering moments.
3Adaptability or versatility
If 360-degree images are generated and stored in a video repository, then the sharing capability and immersive experience are improved, but the storage requirements and data management complexity increase
Solution Approach 1:
The system extracts and stores only the essential features and keyframes from the 360-degree image sequences rather than storing every pixel of every frame. Important visual information is extracted and compressed, while redundant data is discarded. This extraction approach significantly reduces storage requirements while maintaining the quality and sharing capability of the immersive content.
Solution Approach 2:
The video repository is designed to store multiple types of data formats and serve multiple functions - storing 360-degree images, compressed video streams, extracted features, and metadata. This multi-functional storage system handles diverse data types efficiently, reducing overall storage requirements compared to storing all raw data in multiple formats separately.
Data Source
AI summary
A camera-based mixed reality glass apparatus, includes: a smart glass unit including: a band-type flexible display disposed in an eye direction of a user, a head engaging band mounting the band-type flexible display and formed along a head of the user and a plurality of cameras mounted on an opposite direction to the eye of the user in the band-type flexible display and disposed along the head of the user, a real image processor for generating and transmitting a peripheral image of the user through the plurality of cameras, a virtual image processor for generating a direct or indirect virtual image according to a control of the user, and a mixed reality image processor for overlaying the virtual image on the peripheral image of the user and displaying the virtual image on the band-type flexible display.