Head-Mounted Display Projection Plane Control for Stereoscopic Vision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted displays face challenges in appropriately generating stereo images for real-time captured images, leading to unnatural display and potential motion sickness, as they often fail to accurately convert the point of view and provide parallax from the user's perspective.

Innovation Solution

A head-mounted display system that includes a captured image acquisition section, a display image generation section, a projection plane controlling section, and an outputting section, which acquires and processes images from a camera, displays them in a virtual three-dimensional space, adjusts the projection plane based on the user's situation, and outputs the images to ensure accurate stereoscopic vision.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a captured image is displayed in real-time on a head-mounted display without appropriate point of view conversion and parallax provision, then the display process is simple and fast, but the captured image is displayed unnaturally and may cause motion sickness

Engineering Contradiction:
Improvereal-time display speedVSAvoiddisplay naturalness and user comfort
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system pre-calculates and prepares projection planes at multiple predetermined positions before actual display needs arise. When a captured image needs to be displayed, the system can immediately select and use the pre-prepared projection plane without performing complex real-time calculations, thus achieving both real-time display speed and natural display quality with proper point of view conversion and parallax provision.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If a process for converting point of view and providing parallax is appropriately performed, then the captured image is displayed naturally and user comfort is improved, but the processing time increases and real-time display becomes difficult

Engineering Contradiction:
Improvedisplay naturalness and user comfortVSAvoidreal-time display speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system pre-calculates and prepares projection planes at multiple predetermined positions before actual display needs arise. When a captured image needs to be displayed, the system can immediately select and use the pre-prepared projection plane without performing complex real-time calculations, thus achieving both real-time display speed and natural display quality with proper point of view conversion and parallax provision.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically selects the most appropriate pre-prepared projection plane based on the current display situation and user position. By having multiple projection planes prepared in advance and selecting from them dynamically, the system maintains high display quality while avoiding real-time computational complexity.

Inventive Principle:
Principle #15Dynamics

3Productivity

If multiple projection planes are prepared in advance, then the processing speed for real-time display is improved, but the device complexity increases

Engineering Contradiction:
Improvereal-time display speedVSAvoidnumber of projection planes
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system divides the three-dimensional space into multiple discrete projection plane positions and prepares projection planes for each position separately. This segmentation allows the system to handle complex spatial transformations in a structured, modular way, improving real-time processing speed while keeping the complexity manageable through systematic organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system varies parameters such as projection plane position, orientation, and curvature to adapt to different display situations. By preparing projection planes with different parameter sets in advance, the system can quickly adapt to various scenarios without increasing fundamental device complexity, simply selecting from pre-configured parameter combinations.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240036327A1Head-mounted display and image displaying method
Publication Date: 2024.02.01 SONY INTERACTIVE ENTERTAINMENT LLC
  • US20240036327A1 patent drawing
  • US20240036327A1 patent drawing
  • US20240036327A1 patent drawing

AI summary

Disclosed is a head-mounted display including a captured image acquisition section that acquires data of an image captured by a camera mounted on the head-mounted display, a display image generation section that displays the captured image on a projection plane set in a virtual three-dimensional space as a display target and draws an image obtained when the captured image is viewed from a virtual camera, to generate a display image including the captured image, a projection plane controlling section that changes the projection plane according to a situation, and an outputting section that outputs the display image.