Head-Mounted VR Display With Smartphone Image Superimposition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users wearing head-mounted displays with non-transmissive displays cannot visually recognize information processors such as smartphones while experiencing immersive content, making it difficult to perform necessary operations like responding to incoming calls or browsing information.

Innovation Solution

The head-mounted display includes a non-transmissive display, a camera, and a controller that analyzes captured images to determine if the user is holding an information processor, then superimposes the processor's image onto the VR image for simultaneous use.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a non-transmissive display is used in the HMD to provide high-quality VR imaging, then the VR image quality is improved, but the user cannot visually recognize the information processor (smartphone) while experiencing content

Engineering Contradiction:

ImproveVR image qualityVSAvoidvisibility of information processor

Core Design Contradiction:

Illumination intensityVSLoss of information

Solution Approach 1:

The patent combines the VR image display function with the information processor display function into a single non-transmissive display. The controller merges the VR content with the smartphone screen image, allowing both to be displayed simultaneously on the same display surface without requiring separate displays or transmissive technology.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The camera acts as an intermediary to capture the smartphone screen image, and the controller processes this captured image to composite it with the VR image. This intermediary processing enables the smartphone display to be visible through the non-transmissive display while maintaining VR immersion.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If the user wants to browse information or respond to incoming calls on the information processor while wearing the HMD, then the usability of the information processor should be improved, but the non-transmissive display prevents timely operations

Engineering Contradiction:

Improveusability of information processorVSAvoidtime to perform operations

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The system proactively detects when the user is holding the information processor using camera image analysis, and automatically displays the smartphone screen image on the HMD display before the user needs to interact with it. This preliminary detection and display action eliminates the delay of having to remove the HMD to check the smartphone.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The camera continuously monitors the user's hand position and smartphone holding state, providing real-time feedback to the controller. When the controller detects the smartphone in the captured images, it immediately responds by displaying the smartphone screen on the HMD, creating a closed-loop feedback system that enables timely interaction.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12513277B2Head mounted display

Publication Date: 2025.12.30 MAXELL LTD

AI summary

A head mounted display includes a non-transmissive display for displaying a VR image, a camera, and a controller, the controller analyzing a captured image generated by the camera while a user is experiencing VR contents, and when it is determined from the captured image that the user is holding an information processor, causing a non-transmissive display to superimpose the VR image and an image of the information processor and display them.