Free Viewpoint Video Viewpoint Selection Assistance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing free viewpoint video generation technologies face challenges in selecting a suitable viewpoint for a given scene due to high selectability, making it difficult for viewers to capture all relevant features, such as the ball and player movements, within the field of view.

Innovation Solution

A method and apparatus for viewpoint selection assistance that acquires three-dimensional information from multiple cameras, identifies the ball and player paths, sets a video output range containing these paths, and generates video within that range, providing a focused viewpoint selection to capture features of interest in sports spectating.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If free viewpoint video is generated with high viewpoint selectability, then viewers can choose from many perspectives, but it becomes difficult to automatically select a viewpoint that captures all relevant features (ball and player movements)

Engineering Contradiction:
Improveviewpoint selectabilityVSAvoidviewpoint selection difficulty
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system automatically selects appropriate viewpoints by analyzing 3D information, ball paths, and player paths without requiring manual viewer intervention. The viewpoint selection apparatus performs self-service by autonomously determining which viewpoint range should be displayed based on the analyzed sports scene data

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary analysis of 3D information, ball trajectories, and player positions before generating the final video output. By pre-identifying the paths and determining the appropriate viewpoint range in advance, the system prepares the optimal viewing perspective before the video is presented to the viewer

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If multiple cameras are used to capture comprehensive 3D information, then all relevant features can be tracked, but the system complexity increases

Engineering Contradiction:
Improvefeature capture completenessVSAvoidcamera system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system extracts only the essential information needed for viewpoint selection from the data captured by multiple cameras. By focusing on identifying ball paths and player paths rather than processing all camera data equally, the system reduces computational complexity while maintaining complete feature capture

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system introduces an intermediary processing layer that analyzes 3D information from multiple cameras and synthesizes it into simplified path representations. This intermediary step converts complex multi-camera data into manageable ball and player trajectory information that can be used for viewpoint determination

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10681337B2Method, apparatus, and non-transitory computer-readable storage medium for view point selection assistance in free viewpoint video generation
Publication Date: 2020.06.09 FUJITSU LTD
  • US10681337B2 patent drawing
  • US10681337B2 patent drawing
  • US10681337B2 patent drawing

AI summary

A method for viewpoint selection assistance in free viewpoint video generation includes: executing acquisition processing that includes acquiring three-dimensional information with respect to a subject on a field by using a plurality of cameras placed around the field; executing first identification processing that includes identifying a path of a ball for a predetermined period based on the three-dimensional information; executing second identification processing that includes identifying at least one player located within a predetermined distance from a position of the ball for a predetermined duration of time or longer in the predetermined period; executing setting processing that includes setting, as a video output range, a range containing both of the path of the ball and a path of the at least one player; and executing generation processing that includes generating video for the range set by the setting processing.