Virtual Reality Video Synthesis for Player Perspective Simulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for providing a player with a preliminary experience of a match environment, such as viewing videos of past pitches, are inadequate as they do not replicate the actual viewpoint and field of view, and installing an omnidirectional camera in a batter's box during a match is impractical.
Innovation Solution
A virtual reality system that includes a video presentation apparatus capable of obtaining and processing video sequences, separating frames into foreground and background regions, and using patch-search-based completion or paste synthesis to fill gaps, allowing a player to experience a match from their perspective through a head-mounted display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If an omnidirectional camera is installed in a batter's box during a match to capture 360° panoramic images, then the player can experience the match from their perspective, but the implementation becomes difficult and impractical
Solution Approach 1:
The patent uses multiple ordinary cameras positioned around the field to capture images, which are then processed to synthesize a virtual 360° panoramic view. This copying approach replicates the effect of an omnidirectional camera without requiring actual installation in the batter's box, thus maintaining authenticity while improving ease of implementation
Solution Approach 2:
The patent introduces an image processing system as an intermediary between the captured images and the player's experience. This intermediary processes multiple standard camera feeds to create the virtual panoramic view, eliminating the need for direct omnidirectional camera installation while preserving the player perspective authenticity
2Ease of manufacture
If standard cameras are used to capture match videos, then the setup is simple and practical, but the video does not replicate the actual viewpoint and field of view that a player experiences
Solution Approach 1:
The patent divides the field of view into multiple segments captured by different cameras positioned at various locations. Each camera captures a specific portion of the overall scene, and these segmented views are then stitched together to form a complete panoramic perspective that accurately replicates what a player would see
Solution Approach 2:
The patent transitions from standard 2D camera views to a synthesized 360° panoramic dimension. By processing images from multiple cameras and creating a virtual omnidirectional view, the system adds a new dimensional perspective that accurately represents the player's actual field of view while still using ordinary cameras
Data Source
AI summary
A virtual reality system is provided that includes a video presentation apparatus, the virtual reality system comprising: the video presentation apparatus which includes circuitry configured to: obtain as input a video sequence composed of a plurality of frames and mask information specifying a complementation target region in the video sequence; separate a frame into a foreground region and a background region based on binary images representing differences between the plurality of frames included in the video sequence; determine either one of patch-search-based completion and paste synthesis as a complementation method for the complementation target region based on a number of pixels belonging to the foreground region and located within a given distance from a periphery of the complementation target region; and complement the complementation target region in accordance with the complementation method; and a virtual reality head mounted display which presents the complemented video sequence to the user.