Head-Mounted Display Image Positioning via Object Marker Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted display devices that overlay images on external scenes often hinder the user's visual field and lack the ability to easily adjust the position of the overlaid image to user intention.

Innovation Solution

A head-mounted display apparatus equipped with a display unit, an imaging unit, and a detector that captures images of objects, allowing the display controller to determine and adjust the position of the overlaid image based on detected features such as marker images, object colors, or frames, enabling the image to be displayed at a position and size conforming to the object's characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If an image is displayed overlapped on outside scenery in a head-mounted display, then the user can access information while viewing the external scene, but the user's visual field is hindered and the image position cannot be easily adjusted to user intention

Engineering Contradiction:
Improveimage position adjustment capabilityVSAvoiddifficulty to adjust image position
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system automatically detects objects in the external scene using an imaging unit and detector, then autonomously determines and displays the image at the appropriate position without requiring manual adjustment by the user. The display controller automatically matches the image position with the detected object position, allowing the system to serve itself in positioning rather than requiring user intervention.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical adjustment mechanisms with an automated optical-detection system. Instead of requiring users to physically adjust or manually position images, the system uses an imaging unit to capture external scenes, a detector to identify objects, and a display controller to automatically calculate and set the image position based on detected object coordinates, substituting mechanical user adjustment with automated electronic positioning.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If an image is displayed overlapped on outside scenery, then information can be superimposed on the visual field, but the image position is fixed and not easily changeable to match user intention

Engineering Contradiction:
Improveposition flexibilityVSAvoidsystem complexity for position control
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The imaging unit serves multiple functions: it captures the external scene for the user to view through the head-mounted display, simultaneously detects objects within that scene, and provides positional information for image overlay. This multi-functional approach allows the system to achieve position flexibility without adding separate dedicated components, as the same imaging unit performs viewing, detection, and positioning tasks.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically determines image position based on object detection results without requiring external input or complex control mechanisms. The display controller self-adjusts the image position by calculating coordinates based on detected object locations, enabling position flexibility through automated self-positioning rather than complex manual control systems.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If an image is displayed overlapped on outside scenery, then the user can see information in context, but the image position cannot be easily changed by the user

Engineering Contradiction:
Improveuser control over image positionVSAvoidcontrol mechanism complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically positions images based on detected objects without requiring user control inputs. The display controller autonomously determines the optimal image position by processing detection data from the detector, eliminating the need for complex user control mechanisms while still achieving user-intended positioning through automated object-based placement.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11009706B2Head-mounted display apparatus and method for controlling head-mounted display apparatus for determining position of image to be displayed
Publication Date: 2021.05.18 SEIKO EPSON CORP
  • US11009706B2 patent drawing
  • US11009706B2 patent drawing
  • US11009706B2 patent drawing

AI summary

Included are an image display unit to be worn on a user U's head and configured to display an image overlapped on outside scenery visually recognizable through the image, a camera, a detection controller configured to detect, under a condition that imaging data of the camera includes an image of a sheet, a marker as an identifiable feature of the sheet from the imaging data, and a display controller configured to determine, based on the marker detected by the detection controller, a position for the image to be displayed, and to display the image at the position being determined.