HMD Display Controller Position-Based Image Coordination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display systems lack the ability to control and synchronize the display of images between a head-mounted display device and an external device, such as a PC, to correspond to the position of the external device in the user's visual field, limiting the flexibility and coordination of the display modes.

Innovation Solution

A display system comprising a head-mounted display device and an external electronic device that includes an acquisition unit to capture images from the external device, a display controller to superimpose images on the user's visual scene, and a control unit to adjust the display based on the relative position of the external device, allowing for virtual expansion and masking of images to coordinate the display between the two devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the HMD displays all images from the external device, then the display integration is achieved, but the display coordination with the external device position is lost

Engineering Contradiction:
Improvedisplay integrationVSAvoiddisplay coordination
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system dynamically adjusts the display mode based on the relative position between the HMD and external device. The display controller switches between different display modes (integration mode and coordination mode) according to real-time position information, making the system adaptable to different usage scenarios while maintaining ease of operation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes display parameters such as the area ratio of the external device display unit in the composite image, the position of the external device icon, and the transparency of overlays based on the detected relative position. This allows the system to optimize both display integration and coordination by adjusting parameters according to the spatial relationship between devices.

Inventive Principle:
Principle #35Parameter changes

2Illumination intensity

If the external device display unit area is increased in the composite image, then the visibility of the external device is improved, but the field of view of the HMD is reduced

Engineering Contradiction:
Improvevisibility of external deviceVSAvoidfield of view
Core Design Contradiction:
Illumination intensityVSArea of stationary object

Solution Approach 1:

The area ratio of the external device display unit in the composite image is dynamically adjusted based on the relative position between the HMD and external device. When the external device is closer or more important, its display area increases; when it's farther or less important, the area decreases. This dynamic adjustment optimizes both visibility and field of view according to the spatial context.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If the display mode is switched between integration and coordination, then the adaptability to different scenarios is improved, but the system complexity increases

Engineering Contradiction:
Improvedisplay mode flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system uses position detection feedback to automatically determine the appropriate display mode. The display controller continuously monitors the relative position between the HMD and external device, and based on this feedback, automatically switches between integration mode and coordination mode. This feedback mechanism simplifies the user's decision-making process while maintaining high adaptability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs automatic display mode selection and parameter adjustment without requiring manual user input. The display controller autonomously determines the optimal display configuration based on the detected relative position, reducing the complexity of user interaction while maintaining versatile display capabilities.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11380287B2Display system, electronic device, and display method
Publication Date: 2022.07.05 SEIKO EPSON CORP
  • US11380287B2 patent drawing
  • US11380287B2 patent drawing
  • US11380287B2 patent drawing

AI summary

A display system including a PC and an HMD, and in the display system, the PC includes an I/F unit configured to output image data, the HMD includes an I/F unit configured to acquire the image data output by the PC, an image display unit configured to superimpose an image on an outside scene visually recognized in a state where the HMD is worn, and to display the image, and a display controller configured to cause the image display unit to display the image data acquired by the I/F unit, and the display controller causes the image display unit to display the image data in correspondence to a position of the PC visually recognized as an outside scene.