HMD Display Segmentation for External Object Recognition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users of head-mounted display (HMD) devices face difficulties in recognizing external situations and using external interfaces without removing the device, as existing technologies have limitations in detecting and responding to external objects and user gestures effectively.

Innovation Solution

An HMD device equipped with a display, a detection unit (such as a camera), and a processor that changes the screen state based on detected object movement, size, and user gestures, allowing the user to view the external environment by overlaying images or adjusting transparency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the HMD device displays virtual reality content to provide immersive experience, then the virtual reality service quality is improved, but the user's ability to recognize external situations deteriorates

Engineering Contradiction:

Improvevirtual reality service qualityVSAvoidexternal situation recognition

Core Design Contradiction:

ReliabilityVSLoss of information

Solution Approach 1:

The display area is segmented into virtual reality content area and external environment display area, allowing simultaneous presentation of both virtual and real-world information without completely blocking external views

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The external environment camera acts as an intermediary to capture and transmit real-world scenes to the display, enabling users to view external situations through the HMD device without removing it

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If the HMD device blocks external view to enhance immersion, then the virtual reality experience is improved, but the usability of external interfaces deteriorates

Engineering Contradiction:

Improvevirtual reality experienceVSAvoidexternal interface usability

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The system preliminarily detects object movement and user gestures before requiring external interface interaction, then proactively switches to external environment display mode to facilitate seamless external device operation

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The display dynamically switches between virtual reality content and external environment views based on detected user actions, allowing flexible transition between immersive mode and external interaction mode

Inventive Principle:

Principle #15Dynamics

3Device complexity

If the HMD device uses traditional external object recognition methods, then the system complexity is reduced, but the recognition accuracy and responsiveness deteriorates

Engineering Contradiction:

Improvesystem complexityVSAvoidobject recognition accuracy

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

The system replaces traditional mechanical or manual object recognition methods with automated image processing and pattern recognition algorithms, enabling accurate and rapid detection of object movement and user gestures

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11164546B2HMD device and method for controlling same

Publication Date: 2021.11.02 SAMSUNG ELECTRONICS CO LTD

AI summary

An example head mounted display (HMD) device includes a display for displaying a content; a detection unit for detecting the movement of the object in front of the HMD device; and a processor for changing, on the basis of the location of the object, a screen state of the display to provide image of the front of the HMD device, when the movement of the object is detected.