Video Game Controller Position Tracking for Immersive Multi-Surface Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems for creating a sense of immersion in virtual spaces, such as video game environments, fall short in effectively utilizing controller operations to enhance user engagement and immersion due to limited feedback and synchronization of image changes with user inputs.

Innovation Solution

A computer-readable medium and system that processes video game operations by obtaining controller position and direction data, generating corresponding determination areas in a virtual space, determining positional relationships, and displaying results across multiple display areas, thereby enhancing user immersion through synchronized and interactive virtual environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If video display apparatuses are provided on multiple surfaces with synchronized video projection, then the visual coverage is improved, but the sense of immersion in virtual space is insufficient

Engineering Contradiction:
Improvevisual coverage areaVSAvoidsense of immersion
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The system dynamically adjusts the determination area in virtual space based on real-time controller position and direction data. As the user moves the controller, the determination area updates accordingly, creating a dynamic interaction that enhances immersion. This resolves the contradiction by making the virtual environment responsive to user actions across the multi-surface display area.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system provides immediate visual feedback by displaying images corresponding to determination results on the multi-surface display apparatuses. When the controller's determination area intersects with determination targets in virtual space, the result is instantly displayed, creating a feedback loop that enhances the user's sense of presence and immersion in the virtual environment.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If steering apparatus operations are used to change image development content, then user input responsiveness is improved, but the feeling to move in virtual space is insufficient

Engineering Contradiction:
Improveuser input responsivenessVSAvoidfeeling to move in virtual space
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system replaces traditional mechanical steering apparatus operations with wireless controller operations that track position and direction. The controller functions as a virtual steering mechanism, where position and direction data substitute for mechanical inputs. This substitution enables more intuitive control that enhances the feeling of movement through the determination area in virtual space.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system adds spatial dimensions to user input by tracking controller position and direction in three-dimensional space. Instead of limited mechanical steering inputs, the system captures positional coordinates and directional orientation, creating a multi-dimensional control system that enhances the sensation of moving through virtual space across multiple display surfaces.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If determination area is generated based on controller position and direction, then interaction accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveinteraction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The determination area serves as an intermediary between the controller and determination targets in virtual space. Instead of directly comparing controller coordinates with target positions, the system generates a determination area that acts as a buffer zone. This intermediary simplifies the interaction logic while maintaining high precision, as the area-based comparison is computationally simpler than point-to-point tracking.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10722794B2Video game processing program, video game processing method, and video game processing system
Publication Date: 2020.07.28 SQUARE ENIX HLDG CO LTD
  • US10722794B2 patent drawing
  • US10722794B2 patent drawing
  • US10722794B2 patent drawing

AI summary

A non-transitory computer-readable medium including a video game processing program product for causing a computer to realize functions to control progress of a video game on a basis of an operation of a controller by a user in a predetermined space including a display area is provided. Operation information, containing a position or a direction of the controller in the predetermined space, is obtained. In a case where the position or the direction of the controller is changed, a determination area is generated in a virtual space corresponding to the predetermined space on a basis of the operation information corresponding to the change. An image corresponding to a positional relationship between a determination target and the determination area is displayed in the display area.