HMD Display Object Positioning for External Scene Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted display devices (HMDs) face challenges in providing intuitive operation while maintaining visibility of the external scene, as existing systems require frequent adjustments in display position or luminance, which can be cumbersome for users.

Innovation Solution

A head-mounted display device with a display unit, image pickup unit, and operation detection unit that detects pointing elements within the picked-up image, allowing the control unit to display a display object showing the position or shape of the pointing element, while adjusting transmittance to maintain visibility of the external scene.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If the image light is made more intense to improve image visibility, then the external field visibility drops because the external field may be blocked by the image light

Engineering Contradiction:
Improveimage light intensityVSAvoidexternal field blocking
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by making the display position and luminance adjustable rather than fixed. The control unit dynamically changes the display position and luminance based on the detected pointing element position, allowing the system to adapt between image visibility and external field visibility requirements

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes physical parameters (display position coordinates and luminance intensity) to resolve the contradiction. By adjusting these parameters based on pointing element detection, the system optimizes both image visibility and external field visibility under different operational conditions

Inventive Principle:
Principle #35Parameter changes

2Object-affected harmful factors

If the display position or luminance is adjusted to maintain external field visibility, then the operation becomes troublesome for the user

Engineering Contradiction:
Improveexternal field visibilityVSAvoidoperation convenience
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The system performs self-service by automatically detecting the pointing element position and autonomously adjusting the display position and luminance without user intervention. The operation detection unit and control unit work together to make the system self-regulating, eliminating the need for manual adjustments

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements feedback by using the image pickup unit to detect the pointing element position and feeding this information back to the control unit, which then adjusts the display parameters accordingly. This closed-loop control ensures optimal visibility while maintaining operational simplicity

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If the display unit displays an image superimposed on the external scene, then the user can visually recognize both the image and external scene, but the pointing element becomes harder to recognize

Engineering Contradiction:
Improvedisplay functionalityVSAvoidpointing element detectability
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system uses feedback from the image pickup unit to detect the pointing element position in the superimposed display condition and adjusts the display object position accordingly, making the pointing element recognizable even when the image is displayed

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent employs visual differentiation by displaying the pointing element as a distinct display object with different visual characteristics than the superimposed image, allowing the user to distinguish the pointing element position from the image content

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS10948974B2Head-mounted display device, program, and method for controlling head-mounted display device
Publication Date: 2021.03.16 SEIKO EPSON CORP
  • US10948974B2 patent drawing
  • US10948974B2 patent drawing
  • US10948974B2 patent drawing

AI summary

A head-mounted display device includes: an image display unit which is mounted on a head of a user and displays an image in such a way that the user can visually recognize an external scene; a camera; a detection control unit which detects an operation with a pointing element, based on a picked-up image picked up by the camera; and an operation control unit which controls the image on the image display unit, based on the operation detected by the detection control unit. If the pointing element is detected from the picked-up image picked up by the camera, the operation control unit causes the image display unit to display a hand-finger image showing at least one of position and shape of the pointing element.