Head-Mounted Display Image Processing for Virtual-Reality Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of head-mounted display apparatuses experience discomfort due to mismatches between virtual and reality spaces, such as virtual objects being out of reach or reality objects being unreachable, leading to an uncomfortable feeling.

Innovation Solution

An image processing apparatus that acquires information about the reality space, detects objects, and configures a virtual space by positioning virtual objects correspondingly, generating stereovision images for display, thereby aligning virtual and reality spaces to reduce discomfort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a non-transmission type display apparatus is used to display virtual images, then the user can view virtual three-dimensional space, but the user experiences discomfort when virtual objects do not correspond to reality space objects

Engineering Contradiction:
Improvevirtual-reality space correspondenceVSAvoiduser comfort
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent uses a camera to capture images of the reality space and displays these captured images on the display unit, creating a copy of the reality space in the virtual display. This allows virtual objects to correspond accurately to real-world objects, resolving the discomfort caused by mismatches between virtual and reality spaces

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system continuously captures images of the reality space using a camera and updates the display in real-time, creating a feedback loop that maintains accurate correspondence between virtual displayed objects and actual reality space objects, thereby improving reliability of spatial correspondence

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If virtual objects are displayed without corresponding reality objects, then the virtual space can be freely configured, but the user experiences discomfort due to unreachable virtual objects

Engineering Contradiction:
Improvevirtual space configuration freedomVSAvoiduser comfort
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

By copying reality space images and displaying them with corresponding virtual objects, the system maintains the freedom to configure virtual spaces while ensuring that virtual objects have realistic spatial references, preventing user discomfort from unreachable or misplaced virtual objects

Inventive Principle:
Principle #26Copying

3Measurement precision

If reality space objects are displayed without corresponding virtual objects, then the reality space can be viewed accurately, but the user experiences discomfort when reachable reality objects are not interactable in virtual space

Engineering Contradiction:
Improvereality space accuracyVSAvoiduser comfort
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system captures reality space images and displays them on the display unit, ensuring accurate representation of reality objects. Virtual objects are then overlaid or integrated into this copied reality space, maintaining both measurement precision of reality space and interactability through virtual object correspondence

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10540825B2Image processing apparatus
Publication Date: 2020.01.21 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10540825B2 patent drawing
  • US10540825B2 patent drawing
  • US10540825B2 patent drawing

AI summary

Disclosed herein is an image processing apparatus connected with a display apparatus used by a user wearing the apparatus at a head portion thereof. The image processing apparatus acquires information on a reality space around the user, detects positions of objects in the reality space based on the acquired information on the reality space, and configures information on a virtual space by disposing a virtual body at a position in the virtual space corresponding to the detected position of each of the objects. The image processing apparatus further generates an image of the configured virtual space and outputs the generated image to the display apparatus.