HMD Camera Touch Button for Game Play Image Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality gaming systems lack the ability to seamlessly integrate real-world user interactions into virtual game environments, limiting the immersive experience and social sharing of in-game moments.

Innovation Solution

A system and method that uses a head-mounted display (HMD) to capture and render images of a user interacting in a physical space during game play, allowing users to pause gameplay, activate external cameras to capture selfies, and associate these images with specific game frames for later viewing and sharing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a head-mounted display is used to provide immersive virtual content, then the user experiences enhanced immersion in the virtual game environment, but the user cannot easily capture and share real-world interactions during gameplay

Engineering Contradiction:
Improveintegration of real-world and virtual contentVSAvoidsystem complexity for capturing and associating images
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the HMD display function with image capture functionality by integrating an image capturing device into the HMD system. The computing device associates captured images with corresponding virtual content frames, enabling seamless blending of real-world user moments with virtual game environment, thus resolving the contradiction between immersion and shareability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The computing device acts as an intermediary between the HMD display system and the image capture system. It receives virtual content frames from the HMD, captures corresponding real-world images, associates them through time synchronization, and enables their integrated display or sharing, thereby bridging the gap between virtual immersion and real-world capture

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the HMD displays only virtual game content to maintain immersion, then the user experience remains focused on the virtual environment, but real-world user interactions and social sharing are lost

Engineering Contradiction:
Improvedual content rendering capabilityVSAvoiduser interaction for capturing moments
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system enables self-service moment capture by automatically associating captured images with corresponding virtual content frames based on time synchronization. The computing device handles the complex task of matching real-world and virtual content without requiring manual user intervention, thus maintaining ease of operation while adding versatility

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary action by capturing images at specific moments during gameplay and pre-associating them with the corresponding virtual content frames in the computing device. This preparation allows the integrated content to be readily displayed or shared without requiring real-time complex processing during the actual gameplay moment

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If the system captures and renders user images during gameplay, then social sharing and personalization are enhanced, but the gameplay experience may be interrupted

Engineering Contradiction:
Improvesocial sharing functionalityVSAvoidgameplay interruption time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system applies partial action by capturing images only at specific meaningful moments during gameplay rather than continuously. The computing device identifies appropriate capture moments based on gameplay events or user triggers, minimizing interruption while still capturing significant moments for social sharing

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The image capture operates periodically rather than continuously, triggered by specific gameplay events, user actions, or time intervals. This periodic capture approach ensures that social sharing functionality is available without constantly interrupting the gameplay flow, thus balancing versatility with time loss

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11571620B2Using HMD camera touch button to render images of a user captured during game play
Publication Date: 2023.02.07 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11571620B2 patent drawing
  • US11571620B2 patent drawing
  • US11571620B2 patent drawing

AI summary

Methods and systems for presenting an image of a user interacting with a video game includes providing images of a virtual reality (VR) scene of the video game for rendering on a display screen of a head mounted display (HMD). The images of the VR scene are generated as part of game play of the video game. An input provided at a user interface on the HMD received during game play is used to initiate a signal to pause the video game and to generate an activation signal to activate an image capturing device. The activation signal causes the image capturing device to capture an image of the user interacting in a physical space. The image of the user captured by the image capturing device during game play is associated with a portion of the video game that corresponds with a time when the image of the user was captured. The association causes the image of the user to be transmitted to the HMD for rendering on the display screen of the HMD.