HMD Display Control for Immersive Gaming Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display control technologies for head-mounted displays do not adequately enhance user convenience during gaming, leading to reduced immersion and engagement due to limited visual field and lack of real-world interaction awareness.

Innovation Solution

A display control apparatus and method that acquires and processes information about the position and attitude of both the head-mounted display and input apparatus, generating images that accurately reflect the relative positions and attitudes, allowing for enhanced immersion by displaying the input apparatus within the game environment based on real-time user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a head mounted display is used for gaming, then the user's sense of absorption and game entertainment is enhanced, but the user loses awareness of their surroundings and real-world interaction context

Engineering Contradiction:
Improveimmersion in gameVSAvoidawareness of surroundings
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent introduces an intermediary system that captures real-world images via camera and overlays them with virtual game elements (such as the controller image) on the HMD display. This mediator layer allows simultaneous presentation of virtual game content and real-world context, resolving the contradiction between immersion and situational awareness.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges real-world visual information (captured by camera) with virtual game information (displayed on HMD) into a single composite display. The controller image is positioned according to its actual spatial relationship with the user, creating a unified view that maintains both game engagement and environmental awareness.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If the user focuses only on the HMD screen, then game absorption increases, but the user cannot perceive the physical position and relationship of the input apparatus

Engineering Contradiction:
Improvegame absorptionVSAvoidperception of input apparatus position
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent creates a visual copy of the physical controller and displays it on the HMD screen at its actual measured position relative to the user's head. This virtual copy accurately represents the controller's spatial location, allowing users to perceive controller position through the display without breaking immersion.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system continuously tracks the controller's position and provides visual feedback by displaying the controller image at the corresponding location on the HMD. This real-time feedback loop maintains accurate spatial perception of the input apparatus while the user remains engaged with the game content.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12072505B2Display control apparatus, display control method, and recording medium
Publication Date: 2024.08.27 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12072505B2 patent drawing
  • US12072505B2 patent drawing
  • US12072505B2 patent drawing

AI summary

A display control apparatus includes: a head mounted display information acquisition block configured to acquire information indicative of a position of a head mounted display worn on a head of a user; an input apparatus information acquisition block configured to acquire information indicative of a position of an input apparatus for use by the user; an instruction input acquisition block configured to acquire information indicative of an instruction entered in the input apparatus; and an image generation block configured to generate an image to be displayed on the head mounted display on a basis of an instruction acquired by the instruction input acquisition block. The image generation block displays an image of the input apparatus at a position in the image determined on a basis of a relative position with the head mounted display of the input apparatus.