Head-Mounted Display Viewpoint Control via Center-of-Gravity and Line-of-Sight

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted display technologies face challenges in providing a sufficient immersive feeling due to the strong operational feeling associated with controlling line-of-sight direction, often requiring manual input devices that restrict hand movement and can lead to inaccurate gesture recognition.

Innovation Solution

An information processing apparatus that acquires line-of-sight and center-of-gravity movement information to intuitively control the viewpoint of a display image by moving the viewpoint in the center-of-gravity direction while maintaining the imaging posture when the directions are parallel, and rotating the posture when they are not, allowing for more natural and accurate movement control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If controller-type input device is used to control line-of-sight direction, then control precision is improved, but immersive feeling deteriorates due to strong operational feeling

Engineering Contradiction:
Improveline-of-sight direction control precisionVSAvoidimmersive feeling
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system uses the user's own body movements (center of gravity changes) and head movements (line-of-sight direction) to control the viewpoint, eliminating the need for external controllers. The user's natural actions directly serve the control function, creating an immersive experience without manual input devices

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical controller system with a sensor-based detection system that captures the user's line-of-sight direction and center of gravity movement. This substitution eliminates the need for physical controllers while maintaining control precision through automated detection of user intentions

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If manual input devices are used for gesture recognition, then control flexibility is improved, but recognition accuracy deteriorates

Engineering Contradiction:
Improvecontrol flexibilityVSAvoidgesture recognition accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system replaces manual gesture input devices with optical and motion sensors that directly detect the user's line-of-sight direction and center of gravity movement. This substitution provides more accurate and reliable data for control decisions without requiring complex gesture recognition algorithms

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary processing system that combines line-of-sight direction and center of gravity movement information to determine the user's intended viewpoint direction. This intermediary approach provides more accurate control interpretation than direct gesture recognition alone

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11609428B2Information processing apparatus and information processing method
Publication Date: 2023.03.21 SONY GROUP CORP
  • US11609428B2 patent drawing
  • US11609428B2 patent drawing
  • US11609428B2 patent drawing

AI summary

Provided is an information processing apparatus that includes a line-of-sight information acquisition unit which acquires line-of-sight information related to a line-of-sight direction of a user, a movement information acquisition unit which acquires a center-of-gravity movement information related to a center-of-gravity movement direction of a body of the user, and a display control unit which performs a first display control for controlling a display device by moving a viewpoint of the imaging unit in the center-of-gravity movement direction while substantially maintaining the imaging posture of the imaging unit when the line-of-sight direction and the center-of-gravity movement direction are substantially parallel and performs a second display control for controlling the display device by rotating the imaging posture of the imaging unit and moving the viewpoint of the imaging unit in the center-of-gravity movement direction when the line-of-sight direction and the center-of-gravity movement direction are not substantially parallel.