Virtual Viewpoint Camera Array Control for Sports Events

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing systems for generating virtual viewpoint images require significant manual settings adjustments for different types of events, such as soccer and baseball games, increasing operational burden as the imaging directions and settings vary significantly between events.

Innovation Solution

A system comprising multiple cameras and microphones connected through a daisy chain network, with a control station and virtual camera operation UI, that automatically synchronizes camera settings and adjusts image processing to generate synchronized virtual viewpoint images across multiple viewpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual settings are performed for each game type, then appropriate imaging directions and settings can be achieved, but operational burden increases

Engineering Contradiction:
Improveimaging settings appropriatenessVSAvoidoperational burden
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The control device automatically determines imaging directions and settings by receiving game type information and autonomously configuring camera parameters, eliminating the need for manual operator intervention. The system serves itself by automatically adapting to different game types (soccer, baseball, etc.) without requiring human operators to manually adjust each setting.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes imaging parameters (imaging direction, focal length, aperture) based on game type information. Different parameter sets are automatically applied for different sports events, allowing the system to adapt its configuration dynamically without manual intervention while maintaining appropriate settings for each specific game type.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If multiple cameras are connected through daisy chain, then system integration is improved, but synchronization complexity increases

Engineering Contradiction:
Improvesystem integrationVSAvoidsynchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The control device merges the functions of multiple cameras into a unified system under single control. By receiving images from multiple cameras connected in daisy chain configuration and processing them centrally, the system integrates multiple imaging devices while maintaining simplified synchronization through centralized control rather than requiring complex peer-to-peer coordination.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses feedback mechanisms where the control device receives image data from multiple cameras, processes synchronization information, and adjusts timing accordingly. The synchronous imaging control unit uses feedback from received images to maintain proper synchronization across all cameras in the daisy chain configuration.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3466062B1Control device and method for generating a virtual image from a camera array with default parameters associated to the selected type of sport event
Publication Date: 2023.08.02 CANON KK
  • EP3466062B1 patent drawingFigure 1
  • EP3466062B1 patent drawingFigure 2
  • EP3466062B1 patent drawingFigure 3

AI summary

A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.