Dominant Eye Image Selection for HMD Content Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for sharing content from a head-mounted display (HMD) with an external display apparatus face challenges in accurately selecting and displaying images for an audience, particularly when a virtual object is near the point of view, leading to incomplete sharing of the HMD wearer's experience, and require high-resolution displays, increasing system size and cost.

Innovation Solution

An information processing apparatus determines the dominant eye image based on user input or automatic calculation, using a graphical user interface and magnetic field sensors to select and display the appropriate image on an external display, ensuring that the image primarily viewed by the HMD wearer is shared with the audience, without the need for high-resolution displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If one of the image for the left eye and the image for the right eye is displayed to the audience, then the content can be shared with the audience, but if the image that is mainly viewed by the observer is not selected as appropriate, the content viewed by the HMD wearer cannot be shared with the audience

Engineering Contradiction:
Improvecontent sharing accuracyVSAvoidimage selection complexity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system automatically determines which eye's image to display by detecting the observer's gazing direction and identifying the dominant eye, eliminating the need for manual selection by the operator. The determination unit automatically selects the appropriate image based on the detected gazing direction and stored dominant eye information.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual image selection with an automated optical detection system. Magnetic field sensors and cameras detect the gazing direction, and the determination unit automatically identifies the dominant eye image, substituting mechanical/manual operations with automated sensing and processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If a panoramic image is generated by combining the image for the left eye and the image for the right eye, then a complete view is provided, but a display apparatus with a resolution higher than or equal to that of the HMD is needed, leading to an increase in size and price of the system

Engineering Contradiction:
Improveview completenessVSAvoiddisplay apparatus requirements
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Instead of combining both eye images into a panoramic view, the system extracts only the necessary single-eye image (the dominant eye image) for display on the external display apparatus. This extraction approach provides sufficient viewing information without requiring high-resolution displays.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent accepts that the external display will show only one eye's image rather than a combined panoramic view, using a simpler, lower-resolution display apparatus. This trade-off reduces system complexity and cost while still achieving the goal of sharing the HMD wearer's experience with the audience.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS11703682B2Apparatus configured to display shared information on plurality of display apparatuses and method thereof
Publication Date: 2023.07.18 CANON KK
  • US11703682B2 patent drawing
  • US11703682B2 patent drawing
  • US11703682B2 patent drawing

AI summary

An apparatus connected to a first display apparatus of head mounted type including two or more displays and to a second display apparatus includes a determination unit configured to determine an image to be displayed on a display that corresponds to a dominant eye of a wearer wearing the first display apparatus among the two or more displays of the first display apparatus based on information about the dominant eye of the wearer of the first display apparatus and a control unit configured to perform control to display the determined image on the second display apparatus.