Multi-User Virtual Display Control With HMD and External Views

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head mounted display technologies do not provide sufficient user convenience for multiple users to enjoy games, leading to a lack of immersion and engagement.

Innovation Solution

A display control program that acquires instructions from multiple input devices, controls events in a virtual three-dimensional space, and generates images for both the head mounted display and a separate display apparatus, enhancing user interaction and immersion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a head mounted display is used for gaming, then the sense of absorption and game entertainment are enhanced, but the user cannot view the display from outside and multiple users cannot share the experience

Engineering Contradiction:
Improvemulti-user gaming capabilityVSAvoiddisplay system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display system is segmented into two distinct output paths: one for the head mounted display (first image) and one for the external display apparatus (second image). This allows the system to serve multiple user types simultaneously without requiring a single complex display device to fulfill all functions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The display control apparatus is designed to perform multiple functions by generating different images for different display devices. It can simultaneously provide an immersive first-person view for the HMD user and a third-person or spectator view for external display users, making the system versatile for both single-player and multi-player scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If separate display systems are provided for HMD and external display, then multiple users can interact, but the system complexity increases

Engineering Contradiction:
Improvemulti-user interaction convenienceVSAvoidimage generation and control complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the control of multiple display outputs into a single display control apparatus. The game machine and display control apparatus work together as an integrated system that handles both HMD and external display outputs, reducing the need for separate control systems and simplifying the overall architecture.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The display control apparatus acts as an intermediary between the game machine and the two different display devices. It receives game data from the game machine and distributes processed image data to both the HMD and external display apparatus, mediating the interaction and simplifying the interface requirements for each component.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If the HMD displays only the video shown on the display, then the sense of absorption is enhanced, but other users cannot view or interact with the game

Engineering Contradiction:
Improveimmersive experience reliabilityVSAvoidmulti-user engagement capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

Different quality and type of visual information is provided to different users based on their role. The HMD user receives a first image optimized for immersion and first-person perspective, while external display users receive a second image optimized for observation and interaction, with each image tailored to the specific viewing context and user needs.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system adds a new dimension to the gaming experience by creating parallel viewing modes. Instead of a single display perspective, it generates multiple image dimensions - the immersive first-person dimension for HMD users and the external observation dimension for other users - allowing both experiences to coexist without interfering with each other.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12434142B2Display control program, display control apparatus and display control method
Publication Date: 2025.10.07 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12434142B2 patent drawing
  • US12434142B2 patent drawing
  • US12434142B2 patent drawing

AI summary

Methods and apparatus provide for carrying out a method for rendering a virtual-three dimensional space on a display, including: acquiring information indicative of a position of a head mounted display worn on a head of a user; acquiring information indicative of a position of an input apparatus for use by the user; acquiring information indicative of an instruction entered in the input apparatus; and generating an image of the virtual three-dimensional space to be displayed on the head mounted display at a viewpoint position and a sightline direction, wherein the generating includes generating an image of the input apparatus at the position in the image determined on a basis of a relative position between the head mounted display of the input apparatus, and wherein the generating includes generating an image of an object which is emitted from the input apparatus in response to the user manipulating the input apparatus.