Head-Mounted Display Environment Map Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The conventional process of building a mixed reality environment is time-consuming and challenging due to the difficulty in aligning camera or calibrator matching points with the head-mounted display, which hinders the creation of accurate lighting data for a mixed reality application.
Innovation Solution
A method and system that utilize a head-mounted display with image capturing and motion sensing capabilities to calculate the viewing and translation directions, generate an importance map, and stitch captured images in real-time to create a panoramic environment map, reducing the time required to access mixed reality applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a conventional building tool is executed before user access to create lighting data, then accurate lighting data can be generated, but the process is time-consuming and delays application access
Solution Approach 1:
The system performs preliminary actions by capturing images and calculating viewing/translation directions in advance, but allows the application to access a preliminary environment map before the complete building process finishes. This enables partial preliminary action where the core functionality is available while refinement continues in the background.
Solution Approach 2:
The system implements partial action by allowing the application to run with an incomplete or preliminary environment map, rather than requiring the complete building process to finish first. The stitching and refinement can continue partially in the background while the application uses what is available.
2Measurement precision
If the user manually aligns camera or calibrator matching points with the head-mounted display, then accurate environment mapping can be achieved, but the operation is difficult and time-consuming
Solution Approach 1:
The system performs self-service by automatically calculating viewing directions from image content analysis and automatically determining translation directions from motion sensor data and location information. The system stitches images automatically based on these calculated parameters without requiring manual user alignment operations.
Solution Approach 2:
The patent replaces the manual mechanical alignment process with automated computational methods. Instead of manually aligning physical camera or calibrator matching points, the system uses image processing algorithms to detect viewing directions and sensor data to determine translation directions, substituting manual mechanical operations with automated computational processes.
3Reliability
If multiple captured images are stitched to generate a panoramic image, then a complete environment map is created, but the processing time increases
Solution Approach 1:
The system applies local quality by calculating an importance map that identifies which regions of the panoramic image are more important based on viewing directions and translation directions. The stitching process can then prioritize or refine important regions while using lower processing effort for less important regions, achieving a balance between completeness and processing speed.
Data Source
AI summary
A method, a system and a recording medium for building environment map are provided. In the method, a plurality of captured images are captured by using a head-mounted display (HMD). Then, a viewing direction and a translation direction of the HMD are calculated, and an importance map corresponding to the captured images is determined according to the viewing direction and the translation direction of the HMD. Finally, the captured images are stitched to generate a panoramic image according to the importance map.