HMD Image Processor Disparity Control for Motion Sickness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When displaying stereoscopic images using a head-mounted display (HMD), rapid changes in the user's viewing orientation can cause discomfort and motion sickness, and existing methods either replace images with moderate versions or set upper limits on movement rates, which can impair operability and lead to uncomfortable feelings.

Innovation Solution

An image processor that generates disparity images based on user viewing information, switching between predetermined modes depending on the user's viewing direction and position relative to a coordinate system, including shifting the original point to the viewing position to maintain image stability and prevent collapse.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If the image is replaced with a moderate image when rapid change in viewing orientation is detected, then motion sickness is suppressed, but uncomfortable feeling occurs and operability is impaired

Engineering Contradiction:
Improvemotion sicknessVSAvoidoperability
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The patent changes the parameter of disparity amount dynamically based on viewing orientation. When rapid change in viewing orientation is detected, the disparity amount is reduced to a smaller value instead of completely replacing the image. This allows the system to suppress motion sickness while maintaining natural viewing experience and operability, resolving the contradiction between comfort and ease of operation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements dynamic adjustment of disparity images based on real-time detection of viewing orientation changes. The system continuously monitors viewing orientation and adaptively modifies the disparity amount, transitioning smoothly between different disparity levels. This dynamic approach prevents motion sickness without impairing operability, as the system responds flexibly to user actions rather than imposing fixed limitations.

Inventive Principle:
Principle #15Dynamics

2Object-affected harmful factors

If an upper limit is set in movement rate or movement angular rate, then motion sickness is prevented, but superiority in operability where position of motion sensor absolutely corresponds is impaired

Engineering Contradiction:
Improvemotion sicknessVSAvoidposition correspondence accuracy
Core Design Contradiction:
Object-affected harmful factorsVSMeasurement precision

Solution Approach 1:

Instead of setting a fixed upper limit on movement rate or angular rate, the patent changes the disparity amount parameter dynamically based on the detected viewing orientation change. This allows the system to accommodate rapid movements without losing position correspondence accuracy, while still preventing motion sickness by adjusting the visual output to match the speed and nature of the movement.

Inventive Principle:
Principle #35Parameter changes

3Ease of manufacture

If disparity image is generated based on absolute viewing position, then stereoscopic effect is enhanced, but image collapse occurs during rapid movement

Engineering Contradiction:
Improvestereoscopic effect qualityVSAvoidimage stability
Core Design Contradiction:
Ease of manufactureVSStability of the object's composition

Solution Approach 1:

The patent implements dynamic adjustment of disparity amount based on the speed and magnitude of viewing orientation changes. During rapid movement, the system automatically reduces the disparity amount to prevent image collapse, while maintaining the stereoscopic effect. This dynamic approach allows the system to preserve image stability during fast movements while still providing high-quality stereoscopic viewing during normal, slower movements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the disparity amount parameter dynamically based on viewing conditions. When rapid movement is detected, the disparity amount is reduced to prevent image collapse. When movement is slow or stable, the full disparity amount is applied to enhance the stereoscopic effect. This parameter adjustment resolves the contradiction between image stability and stereoscopic quality.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11109009B2Image processor and control method of image processor
Publication Date: 2021.08.31 SONY GROUP CORP
  • US11109009B2 patent drawing
  • US11109009B2 patent drawing
  • US11109009B2 patent drawing

AI summary

A disparity image in a stereoscopic image is generated not to collapse. In a case where a viewing position in the entire celestial image space, specified on the basis of position information of a user, is within a range of a predetermined distance from an original point in a coordinate system of the entire celestial image, a disparity image based on the viewing position is generated, and in a case where the viewing position in the entire celestial image space is not within the range of a predetermined distance from the original point in the coordinate system of the entire celestial image, the viewing position in the entire celestial image space is moved to the original point of the entire celestial image space, and the disparity image is generated. The present disclosure can be applied to an HMD.