Modular Mixed Reality Imaging via Smartphone Calculation and Semi-Transparent Mirror

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current modular mixed reality (MR) devices are costly and inconvenient due to their complex optical paths and high-performance computing requirements, making them less accessible for widespread use.

Innovation Solution

A modular MR device imaging method that employs a smart phone as the MR calculation module, combined with an MR optical path module and posture module, using a semi-transparent semi-reflective mirror to mix virtual and real images, allowing for flexible and cost-effective rendering of MR interaction effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional high-performance computing devices and complicated optical paths are used in MR devices, then the imaging quality and computational capability are improved, but the manufacturing cost and device complexity increase significantly

Engineering Contradiction:
Improveimaging qualityVSAvoidoptical path complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The MR device is divided into separate functional modules: a mobile phone serving as the calculation module, a head-mounted display as the optical module, and optional control devices. This segmentation allows each module to be optimized independently and reduces overall system complexity while maintaining imaging quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The mobile phone serves multiple functions: it acts as the computing device for MR processing, the display device for rendering virtual images, and the imaging device through its camera. This multi-functionality eliminates the need for separate dedicated components, reducing device complexity and cost.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Power

If traditional high-performance computing devices are used in MR devices, then the computational capability is improved, but the manufacturing cost increases significantly

Engineering Contradiction:
Improvecomputational capabilityVSAvoidmanufacturing cost
Core Design Contradiction:
PowerVSEase of manufacture

Solution Approach 1:

The mobile phone provides computational capability through its existing processor and graphics unit, which are already optimized for high-performance tasks. By reusing this existing computational platform rather than designing a dedicated MR processor, the manufacturing cost is significantly reduced while maintaining sufficient computational power for MR applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The mobile phone's existing sensors (accelerometer, gyroscope, magnetometer) and processing capabilities are utilized directly for MR computations without requiring additional dedicated sensors or processing units. This self-service approach leverages already-available resources, eliminating the need for expensive custom hardware.

Inventive Principle:
Principle #25Self-service

3Ease of manufacture

If modular design with mobile phone is used, then the manufacturing cost is reduced, but the integration complexity and interface requirements increase

Engineering Contradiction:
Improvemanufacturing costVSAvoidintegration complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The mobile phone serves as a universal platform that can be integrated with different head-mounted display configurations and control devices through standard wireless communication protocols. This universality simplifies integration by using common interfaces rather than requiring custom connection solutions for each component combination.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach significantly reduces the manufacturing cost of MR devices, enhances interactive functionality, and allows for easy upgrades and integration with various control devices, improving the overall utility and affordability of MR technology.

Implementation Method 1

the virtual-image light is reflected by means of the virtual-image introduction surface onto the observation end

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

real environment light is transmitted through to the observation end by means of the real-image introduction surface

Methodology Applied
Scientific EffectTransmission:

Implementation Method 3

being mixed with the virtual image to form a mixed reality image

Methodology Applied
Scientific EffectOptical mixing:

Implementation Method 4

image light of double-split screen is reflected through the total reflection mirror onto the two Fresnel lenses

Methodology Applied
Scientific EffectTotal internal reflection: Total Internal Reflection

Implementation Method 5

the two Fresnel lenses, which then refract image light of double-split screen, so that image light forms two virtual-image light paths with preset field angle

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS11709360B2Imaging method for modular mixed reality (MR) device
Publication Date: 2023.07.25 HOLO INTERACTIVE US INC
  • US11709360B2 patent drawing
  • US11709360B2 patent drawing
  • US11709360B2 patent drawing

AI summary

An imaging method is provided for a modular mixed reality (MR) device having an MR calculation module, an MR optical path module and an MR posture module. The MR calculation module is configured to adjust display content according to data from the MR posture module. The MR optical path module comprises a virtual-image optical path and a mixed optical path. A semi-transparent semi-reflective mirror is provided in the mixed optical path. One surface of the mirror is a real-image introduction surface facing a real environment, while the other is a virtual-image introduction surface facing the virtual-image optical path. Virtual-image light is reflected by the virtual-image introduction surface onto an observation end and mixed with real environment light transmitted to the observation end by the real-image introduction surface to form a mixed reality image.