HMD Object Information Continuity via Preview Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted display (HMD) devices fail to maintain continuity in information display when an object image is not detected within the view angle, leading to user confusion, and may incorrectly display information if the object image is not detected, causing misunderstandings.

Innovation Solution

The HMD device is designed to separately display a contents image including an object image and its information even if the object image is not detected, ensuring continuity and correct association of information with the object, and to prevent overlap with external device images by controlling display positions and timings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Duration of action of moving object

If the HMD device maintains display of information on an object image even when the object image is not detected, then continuity in providing information is improved, but the user may misunderstand the information as belonging to other object images

Engineering Contradiction:
Improveduration of information displayVSAvoidinformation accuracy
Core Design Contradiction:
Duration of action of moving objectVSLoss of information

Solution Approach 1:

The HMD device displays a preview image of the object image that is captured before it enters the current view angle area. This preliminary display action allows the information to be shown continuously while maintaining accurate association with the correct object, preventing user misunderstanding when the object moves out of view.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If the HMD device does not display information on an object image when the object image is not detected, then information accuracy is improved, but continuity in providing information is lost causing user confusion

Engineering Contradiction:
Improveinformation accuracyVSAvoidduration of information display
Core Design Contradiction:
Loss of informationVSDuration of action of moving object

Solution Approach 1:

The system performs preliminary capture and display of the object image before it leaves the detection area. This allows the information to be maintained on screen with the preview image, ensuring continuity without sacrificing accuracy.

Inventive Principle:
Principle #10Preliminary action

3Duration of action of moving object

If the HMD device displays contents image and information separately when object image is not detected, then information continuity is improved, but device complexity increases

Engineering Contradiction:
Improveduration of information displayVSAvoiddisplay control complexity
Core Design Contradiction:
Duration of action of moving objectVSDevice complexity

Solution Approach 1:

The display area is segmented into different regions: one for displaying the current view angle area and another for displaying the preview image of the object that has moved out. This segmentation allows separate display of contents image and information while maintaining a relatively simple overall structure.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3039476B1Head mounted display device and method for controlling the same
Publication Date: 2020.11.18 LG ELECTRONICS INC
  • EP3039476B1 patent drawingFigure 1~2
  • EP3039476B1 patent drawingFigure 3
  • EP3039476B1 patent drawingFigure 4

AI summary

A head mounted display (HMD) device according to one embodiment comprises a communication unit configured to transmit and receive data; a display unit configured to display visual information; a camera unit configured to capture an image; and a processor configured to control the communication unit, the display unit and the camera unit, wherein the processor is further configured to : detect an object image from a first image, which includes the object image, the first image being displayed in an external device located in an angle of view area of the camera unit, display information related to the object image, and display the first image in addition to the information when detecting that the first image is switched to a second image, which does not include the object image.