Composite Real and Virtual Images for Third-Party VR Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems for enabling players to interact with virtual spaces do not provide a sufficiently engaging experience for third-party observers, as they primarily view the player's movements without understanding the virtual space interactions.
Innovation Solution
A terminal device and system that composite real-space images of players with virtual-space images, allowing third parties to view the player's interactions in virtual spaces through a real-space camera and virtual camera synchronization, enhancing the visual appeal and realism of the experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a player wears a head mounted display to experience virtual reality, then the player can recognize the virtual space and operate objects, but third persons can only view the player's operation without sufficient engagement
Solution Approach 1:
The patent adds a new dimension to the virtual reality experience by capturing the player's head movements and viewpoint information, then rendering the virtual space from that perspective for third-person viewing. This transforms the traditionally private first-person VR experience into a shareable third-person perspective without affecting the player's own immersion
Solution Approach 2:
The system creates a visual copy of the virtual space as seen by the player, rendering it from the player's viewpoint and overlaying it with the player's real-world video feed. This allows third persons to see what the player sees while maintaining the player's authentic VR experience
2Loss of information
If third persons view the player's operation in virtual space, then they can observe the interaction, but the viewing experience lacks attractiveness and engagement
Solution Approach 1:
The patent merges multiple visual elements into a single composite image: the player's video feed from the real world, the rendered virtual space from the player's viewpoint, and the player's head-mounted display. This combination provides third persons with both the player's physical presence and their virtual environment, creating an engaging and informative viewing experience
Solution Approach 2:
The system segments the visual information into distinct components (player video, virtual space rendering, viewpoint data) that are processed separately and then composited together. This allows optimized handling of each element and enables flexible composition to enhance third-person engagement
Data Source
AI summary
A terminal device includes a memory configured to store computer-readable instructions and a processor configured to perform the computer-readable instructions. The processor is configured to: cause a real space camera in a real space to capture a real space image including a real player; cause a virtual space camera in a virtual space to capture a virtual space image including a virtual object, the real player performing an instruction input to the virtual object; create a composite image that is formed by composing part of the virtual space image stored in the memory and a player image in the real space image stored in the memory; and output the composite image to a display so that the display is configured to display the composite image.