Modular Mixed Reality Imaging via Smartphone Calculation and Semi-Transparent Mirror
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current modular mixed reality (MR) devices are costly and inconvenient due to their complex optical paths and high-performance computing requirements, making them less accessible for widespread use.
Innovation Solution
A modular MR device imaging method that employs a smart phone as the MR calculation module, combined with an MR optical path module and posture module, using a semi-transparent semi-reflective mirror to mix virtual and real images, allowing for flexible and cost-effective rendering of MR interaction effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional high-performance computing devices and complicated optical paths are used in MR devices, then the imaging quality and computational capability are improved, but the manufacturing cost and device complexity increase significantly
Solution Approach 1:
The MR device is divided into separate functional modules: a mobile phone serving as the calculation module, a head-mounted display as the optical module, and optional control devices. This segmentation allows each module to be optimized independently and reduces overall system complexity while maintaining imaging quality.
Solution Approach 2:
The mobile phone serves multiple functions: it acts as the computing device for MR processing, the display device for rendering virtual images, and the imaging device through its camera. This multi-functionality eliminates the need for separate dedicated components, reducing device complexity and cost.
2Power
If traditional high-performance computing devices are used in MR devices, then the computational capability is improved, but the manufacturing cost increases significantly
Solution Approach 1:
The mobile phone provides computational capability through its existing processor and graphics unit, which are already optimized for high-performance tasks. By reusing this existing computational platform rather than designing a dedicated MR processor, the manufacturing cost is significantly reduced while maintaining sufficient computational power for MR applications.
Solution Approach 2:
The mobile phone's existing sensors (accelerometer, gyroscope, magnetometer) and processing capabilities are utilized directly for MR computations without requiring additional dedicated sensors or processing units. This self-service approach leverages already-available resources, eliminating the need for expensive custom hardware.
3Ease of manufacture
If modular design with mobile phone is used, then the manufacturing cost is reduced, but the integration complexity and interface requirements increase
Solution Approach 1:
The mobile phone serves as a universal platform that can be integrated with different head-mounted display configurations and control devices through standard wireless communication protocols. This universality simplifies integration by using common interfaces rather than requiring custom connection solutions for each component combination.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach significantly reduces the manufacturing cost of MR devices, enhances interactive functionality, and allows for easy upgrades and integration with various control devices, improving the overall utility and affordability of MR technology.
Implementation Method 1
the virtual-image light is reflected by means of the virtual-image introduction surface onto the observation end
Implementation Method 2
real environment light is transmitted through to the observation end by means of the real-image introduction surface
Implementation Method 3
being mixed with the virtual image to form a mixed reality image
Implementation Method 4
image light of double-split screen is reflected through the total reflection mirror onto the two Fresnel lenses
Implementation Method 5
the two Fresnel lenses, which then refract image light of double-split screen, so that image light forms two virtual-image light paths with preset field angle
Data Source
AI summary
An imaging method is provided for a modular mixed reality (MR) device having an MR calculation module, an MR optical path module and an MR posture module. The MR calculation module is configured to adjust display content according to data from the MR posture module. The MR optical path module comprises a virtual-image optical path and a mixed optical path. A semi-transparent semi-reflective mirror is provided in the mixed optical path. One surface of the mirror is a real-image introduction surface facing a real environment, while the other is a virtual-image introduction surface facing the virtual-image optical path. Virtual-image light is reflected by the virtual-image introduction surface onto an observation end and mixed with real environment light transmitted to the observation end by the real-image introduction surface to form a mixed reality image.


