Multi-Camera Virtual Viewpoint System with Asymmetric Angles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating high-quality virtual viewpoint images in sports events with multiple objects, such as soccer or rugby, require a large number of cameras, which is impractical due to physical space, cost, and installation constraints.

Innovation Solution

The system employs a configuration of image capturing devices with varying viewing angles, where at least one pair of cameras has a different viewing angle than the others, with one camera having a wider angle and the other a narrower angle, to capture high-resolution images while maintaining a sufficient number of viewpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If all cameras are installed with wide viewing angles to include the entire field, then it is possible to obtain a sufficient number of multi-viewpoint images for any player position, but the size of captured objects becomes small and texture resolution becomes low

Engineering Contradiction:
Improvenumber of multi-viewpoint imagesVSAvoidtexture resolution
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent applies local quality by differentiating camera parameters based on their specific positions and functions. Cameras are divided into two groups: those facing the center of the field with wide viewing angles to capture multiple players, and those positioned at corners with narrow viewing angles to capture high-resolution images of players in their specific zones. This localized optimization of camera parameters resolves the contradiction between capturing sufficient viewpoints and maintaining high texture resolution.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements asymmetry by intentionally creating non-uniform camera configurations. Instead of installing identical cameras with the same viewing angles throughout the field, the system uses asymmetric camera placement and parameter settings - corner cameras have different (narrower) viewing angles compared to center-facing cameras. This asymmetric arrangement allows each camera to be optimized for its specific location, simultaneously achieving sufficient viewpoint coverage and high texture resolution.

Inventive Principle:
Principle #4Asymmetry

2Manufacturing precision

If a non-fixed zoom camera is added to chase specific objects with high-resolution texture, then the quality of virtual viewpoint image for that specific object is improved, but a large number of cameras are necessary to cover all objects

Engineering Contradiction:
Improvetexture resolution for specific objectVSAvoidnumber of cameras
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies universality by designing corner cameras that serve multiple functions simultaneously. These cameras have narrow viewing angles that focus on specific corner zones, providing high-resolution coverage for players in those areas while also contributing to the overall multi-viewpoint image set. This multi-functional design eliminates the need for separate dedicated high-resolution cameras for each player, reducing the total camera count while maintaining high texture resolution where needed.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If cameras are installed to face the center of the field, then it is possible to generate high-quality virtual viewpoint image for players at the center, but players at the end portion of the field have limited camera coverage

Engineering Contradiction:
Improvevirtual viewpoint image quality for center playersVSAvoidnumber of cameras covering end players
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies segmentation by dividing the field into distinct zones - a central area covered by center-facing cameras and corner areas covered by corner cameras with narrow viewing angles. This spatial segmentation allows each camera group to specialize in capturing images for its designated zone, ensuring that players at the end portions of the field are adequately covered by corner cameras while center players are covered by center-facing cameras, thereby improving overall coverage without increasing total camera count.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11297301B2Image capturing system, arrangement determination apparatus, arrangement determination method, and storage medium
Publication Date: 2022.04.05 CANON KK
  • US11297301B2 patent drawing
  • US11297301B2 patent drawing
  • US11297301B2 patent drawing

AI summary

The image capturing system for generating a virtual viewpoint image has a plurality of cameras installed so as to capture a predetermined position from different directions. The plurality of cameras includes at least one pair of cameras including a first camera and a second camera installed at a position of two-fold symmetry of the first camera with an axis passing the predetermined position and vertical to an image capturing field being taken as a center, or a position closest to the position of two-fold symmetry. Further, between the first camera and the second camera, a parameter that affects at least one of a texture resolution of an object in a captured image and an image capturing range of a camera among parameters specifying characteristics of image capturing devices is different.