Free Viewpoint Video Subject Information Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In free viewpoint video generation, information related to specific subjects, such as players in sports games, is often not accurately displayed, making it difficult for viewers to watch the game while concurrently viewing the subject's motions and associated information.
Innovation Solution
A video generation program and device that tracks the position of three-dimensional models of subjects using multiple cameras, generates positional information, and synthesizes video by combining subject information with background areas in the free viewpoint video, ensuring accurate display of subject-related data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If information related to subjects is displayed in free viewpoint video, then the information can be viewed, but it may overlap with the video content making it difficult to watch the game while viewing subject information
Solution Approach 1:
The patent applies local quality by creating subject-specific background areas where information is displayed only in regions corresponding to each subject's position in the free viewpoint video. This ensures information appears near the relevant subject without overlapping video content, as the background area is dynamically adjusted based on subject position and video coverage.
Solution Approach 2:
The patent introduces a spatial dimension for information display by defining background areas in three-dimensional space that correspond to subject positions. Information is displayed in these spatial regions rather than overlaying the video plane, separating information and video content in the depth dimension while maintaining their visual association.
2Measurement precision
If background areas are defined for each subject, then information can be accurately positioned, but the complexity of tracking and synthesizing multiple subjects increases
Solution Approach 1:
The patent segments the video generation process into distinct modules: subject tracking to obtain position information, background area generation based on position, and information synthesis in the defined areas. This segmentation allows each module to handle one aspect independently, reducing overall system complexity while maintaining precision.
Solution Approach 2:
The patent creates a universal background area generation mechanism that works for multiple subjects simultaneously. The same process of obtaining position information, generating background areas, and synthesizing information is applied to each subject, allowing the system to handle any number of subjects with a consistent approach rather than requiring subject-specific complex processing.
Data Source
AI summary
A non-transitory computer-readable recording medium having stored therein a video generation program for causing a computer to execute a process comprising: tracking a position of a three-dimensional model of each of a plurality of subjects in a three-dimensional space generated by combining, for the subjects, a plurality of imaging frames captured by a plurality of cameras in a plurality of directions; obtaining positional information of the subjects included in the three-dimensional space; obtaining information related to the subjects; and generating synthesized video by combining the information related to the subjects with a background area near the subjects based on the positional information of the subjects among areas of free viewpoint video generated on the basis of the three-dimensional model of each of the subjects.