Virtual Viewpoint Image Selection for Multi-Camera Sports Judgment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In competitive sports, identifying the correct camera used to capture an image for judgment becomes increasingly cumbersome with multiple cameras, as existing methods do not efficiently manage and select the appropriate viewpoint and image capture apparatuses.

Innovation Solution

An image processing apparatus that identifies and selects the appropriate image capture apparatuses based on user-designated viewpoints and eye directions, utilizing three-dimensional shape data and virtual viewpoint images to streamline the selection process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple cameras are installed to capture images from various directions, then the ability to capture useful judgment images is improved, but the work involved in finding the appropriate camera increases

Engineering Contradiction:
Improveability to capture useful judgment imagesVSAvoidwork involved in finding the appropriate camera
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system introduces an intermediary processing layer that automatically analyzes images from multiple cameras, extracts key information, and ranks them by importance. This intermediary process mediates between the multiple camera inputs and the user's selection need, eliminating manual searching through automated image evaluation and ranking based on predetermined evaluation criteria.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service by automatically performing image evaluation, ranking, and selection without requiring user intervention in the analysis process. The predetermined evaluation criteria are applied automatically to rank images, and the system presents the ranked results for user selection, making the system serve itself in the information processing task.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If more cameras are used to improve judgment accuracy, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvejudgment accuracyVSAvoidnumber of cameras and selection process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the complex task of image selection into distinct processing stages: automatic image extraction from multiple cameras, evaluation based on predetermined criteria, ranking generation, and presentation. This segmentation allows each stage to handle a specific aspect of the problem, managing complexity through structured decomposition of the overall process.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes parameters by introducing automated evaluation criteria and ranking metrics that transform the selection process from manual inspection to automated assessment. By changing the selection parameter from human judgment to algorithmic evaluation based on image quality, relevance, and capture conditions, the system manages complexity while maintaining or improving judgment accuracy.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11825063B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2023.11.21 CANON KK
  • US11825063B2 patent drawing
  • US11825063B2 patent drawing
  • US11825063B2 patent drawing

AI summary

An image processing apparatus comprising: an identifying unit that identifies, from multiple image capture apparatuses that capture images of an image capture space from multiple directions, two or more image capture apparatuses that capture images of a predetermined position in the image capture space; a camera path setting unit that sets multiple viewpoints that are based on the two or more image capture apparatuses identified by the identifying unit; a virtual viewpoint image generating unit that generates multiple viewpoint images corresponding to the multiple viewpoints based on three-dimensional shape data generated using multiple images captured by the multiple image capture apparatuses; and an image capture apparatus selecting unit that selects, from the two or more image capture apparatuses identified by the identifying unit, an image capture apparatus close to the position of the viewpoint corresponding to a viewpoint image designated by a user from the multiple viewpoint images.