Shape Data Generation for Virtual Viewpoint Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating virtual viewpoint images from multiple camera angles struggle with accurately processing shape data in imaging spaces containing objects with varying sizes and motion characteristics, such as in sports events, leading to inaccuracies in generating shape data for objects like balls and players.

Innovation Solution

A shape estimation apparatus that divides the imaging space into partial spaces with distinct processing parameters for each, using different camera angles and types (telescopic and wide-angle cameras) to capture images, allowing for accurate shape data generation by identifying the type of object and adjusting processing parameters accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the same processing is used for generating shape data throughout the entire imaging space, then the processing is simple and consistent, but the generation accuracy deteriorates due to variations in object size and motion characteristics across different spaces

Engineering Contradiction:
Improveshape data generation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The imaging space is divided into multiple partial spaces (first partial space, second partial space, etc.) based on object characteristics such as size and motion. Each partial space is processed separately with appropriate processing parameters, allowing accurate shape data generation for different objects while maintaining overall system coherence.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing parameters are applied to different partial spaces according to the specific characteristics of objects in each space. For example, small high-speed objects like balls receive different processing than large slower objects like players, optimizing shape data generation accuracy for each local region.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If different processing parameters are used for different partial spaces, then the shape data generation accuracy improves for objects with varying characteristics, but the processing complexity increases

Engineering Contradiction:
Improveshape data generation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The processing system dynamically selects and applies appropriate processing parameters based on the type of object detected in each partial space. The system adapts its behavior according to object characteristics (size, motion speed) rather than using a fixed processing pipeline, enabling accurate shape data generation while managing complexity through adaptive decision-making.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11928831B2Information processing apparatus, shape data generation method, and storage medium
Publication Date: 2024.03.12 CANON KK
  • US11928831B2 patent drawing
  • US11928831B2 patent drawing
  • US11928831B2 patent drawing

AI summary

An information processing apparatus generates shape data on an object included in a first partial space based on one or more captured images obtained from one or more of a plurality of imaging apparatuses and a first parameter corresponding to the first partial space, the first partial space being included in a plurality of partial spaces in an imaging space which is an image capturing target for the plurality of imaging apparatuses, and generates shape data on an object included in a second partial space based on one or more captured images obtained from one or more of the plurality of imaging apparatuses and a second parameter corresponding to the second partial space, the second partial space being included in the plurality of partial spaces, the second parameter being different from the first parameter.