Virtual Obstacle Overlay for Head-Mounted Display Collision Avoidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users wearing head-mounted displays cannot see the outside world, leading to potential collisions with obstacles while playing games, as they are fully immersed in the virtual environment and lose awareness of their surroundings.

Innovation Solution

An obstacle avoidance system that detects real-world obstacles using a camera, replaces them with virtual objects within the head-mounted display's virtual space, and provides warnings to prevent collisions, allowing users to focus on the game without physical hazards.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user wears a head mounted display to enhance immersion in the game, then the user's engagement with the game is improved, but the user cannot see the outside world and may bump into obstacles

Engineering Contradiction:
Improveuser engagement with gameVSAvoidcollision with obstacles
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent creates a virtual copy of the real obstacle and displays it within the head-mounted display's virtual environment. This virtual copy mirrors the position and characteristics of the actual obstacle, allowing the user to perceive the hazard through the display without needing to see the real obstacle directly. The virtual object serves as a representative that conveys obstacle information within the immersive game context.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The head-mounted display acts as an intermediary between the real obstacle and the user. Instead of requiring direct visual contact with the physical obstacle, the system translates real-world obstacle information into a virtual representation that appears within the game environment. This intermediary layer allows the user to perceive spatial hazards while maintaining immersion in the virtual world.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the user focuses entirely on the head mounted display screen, then immersion in the virtual environment is enhanced, but awareness of the physical surroundings is lost

Engineering Contradiction:
Improveimmersion in virtual environmentVSAvoidawareness of surroundings
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent merges real obstacle detection data with the virtual game environment by overlaying virtual obstacle representations onto the game world. This integration combines the immersive virtual experience with critical real-world spatial information, allowing the user to maintain awareness of surroundings while remaining engaged with the game. The virtual obstacles are seamlessly incorporated into the game landscape rather than appearing as separate warnings.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system creates virtual copies of real obstacles and integrates them into the game environment, preserving the spatial relationships and characteristics of actual obstacles while presenting them within the virtual world. This copying approach maintains the user's immersion while conveying essential environmental awareness through the virtual representation of physical hazards.

Inventive Principle:
Principle #26Copying

3Loss of information

If the system displays real obstacles directly to the user, then obstacle awareness is improved, but the user's immersion in the game is broken

Engineering Contradiction:
Improveobstacle awarenessVSAvoidimmersion in game
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

Instead of displaying actual real-world obstacles directly, the system creates virtual copies that replicate the essential characteristics and positions of real obstacles within the game environment. These virtual representations maintain the user's immersion by presenting obstacles as part of the game world rather than as external warnings, while still conveying the necessary obstacle information for safety awareness.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system transforms real obstacle parameters (position, size, shape) into virtual object parameters that are compatible with the game environment. By converting real-world spatial data into virtual representations that fit within the game's graphical framework, the system maintains immersion while preserving obstacle awareness. The virtual objects are rendered with appropriate graphical properties suitable for the game context.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9599818B2Obstacle avoidance apparatus and obstacle avoidance method
Publication Date: 2017.03.21 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9599818B2 patent drawing
  • US9599818B2 patent drawing
  • US9599818B2 patent drawing

AI summary

An obstacle detecting unit detects an obstacle for a user wearing a head mounted display from an image of the outside world. A distance calculating unit calculates the distance from a detected obstacle to the user wearing the head mounted display. An obstacle replacing unit replaces the detected obstacle with a virtual object. A virtual object synthesizing unit generates a virtual object at a position within a virtual space displayed on the head mounted display, in which the position is determined according to the distance to the obstacle.