HMD Optical Axis Tracking for Smartphone Display Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted displays are limited in their ability to accommodate various sizes and types of smartphones, as they are designed for specific devices, restricting flexibility in displaying moving images based on the performance and characteristics of the portable terminal.

Innovation Solution

A head-mounted display system that includes an optical system for guiding image light to the user's eyes, a portable terminal with an imaging unit to photograph the display surface, and a display control section that adjusts the image display according to the position information of the optical axis, allowing for flexible image placement based on the terminal's performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a dedicated smartphone is used with a fixed housing position, then the moving image display region is determined in advance, but the system cannot accommodate various kinds of smartphones with different display surface sizes

Engineering Contradiction:
Improvecompatibility with various smartphone typesVSAvoidcomplexity of determining display region
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The imaging unit on the smartphone automatically captures the display surface, and the control unit automatically determines the optical axis position and display region based on the captured image data. This self-service mechanism eliminates the need for manual configuration or complex external calibration equipment, enabling automatic adaptation to different smartphone models while maintaining system simplicity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system dynamically adjusts the display region parameters based on the detected optical axis position and smartphone display characteristics. By changing the display parameters (region coordinates, size, position) according to the specific smartphone model detected, the system achieves versatility across different devices without requiring complex physical reconfiguration

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the display region is determined in advance for a dedicated smartphone, then the system structure is simplified, but the system cannot adapt to smartphones with different display surface sizes and performances

Engineering Contradiction:
Improveflexibility in smartphone selectionVSAvoidprecision of optical axis position determination
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system replaces complex mechanical positioning and calibration mechanisms with an imaging-based detection method. The imaging unit captures the display surface, and software algorithms automatically determine the optical axis position, eliminating the need for precise mechanical alignment while achieving high positioning accuracy through image processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The imaging unit serves as an intermediary between the optical system and the control unit. It captures the display surface information and transmits it to the control unit, which then determines the optimal display region. This intermediary mechanism enables accurate adaptation to different smartphones without requiring direct complex interactions between the optical system and various device specifications

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the display of moving images in an appropriate region of the display surface, accommodating different smartphone sizes and types, ensuring a comfortable viewing experience regardless of the portable terminal's performance.

Implementation Method 1

an imaging unit for photographing a front of a display surface

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

an optical system for guiding image light to an eye of a user

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS11906740B2Display system, program, display method, and head mounted device
Publication Date: 2024.02.20 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11906740B2 patent drawing
  • US11906740B2 patent drawing
  • US11906740B2 patent drawing

AI summary

There is provided a display system used for a head mounted display including a head mounted device having a lens for guiding image light to an eye of a user and configured to be mounted on a head of the user and a portable terminal having an imaging unit for photographing a front of a display surface and capable of being housed in the head mounted device. The display system includes a display control section configured to display a moving image on the display surface, an image information obtaining section configured to obtain image information photographed by the imaging unit, and a position information obtaining section configured to obtain position information of an optical axis of the lens on the display surface on the basis of position information of at least two reference positions whose relative positions with respect to the optical axis are determined in advance, the at least two reference positions being included in the image information. The display control section displays the moving image in a region of the display surface according to the position information of the optical axis.