Virtual Viewpoint Image Data Transmission via Selective Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating virtual viewpoint images face challenges in reducing the large data amount required for transmission, leading to bandwidth pressure and potential omission of necessary information, as seen in Japanese Patent No. 5563545, which focuses solely on configuration density of shapes.

Innovation Solution

A system that selectively provides three-dimensional geometric data of varying quality to user terminals based on data requests, utilizing multiple classes of model data with different qualities to efficiently manage data transmission, including background and object geometric data, texture data, and animation data, ensuring optimal image quality and reduced bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If model data with high configuration density is transmitted to ensure complete object information, then the reliability of virtual viewpoint image generation is improved, but the data transmission bandwidth requirement increases

Engineering Contradiction:
Improvecompleteness of object informationVSAvoiddata transmission bandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies local quality by transmitting model data with different configuration densities for different objects based on their individual characteristics. Important objects (e.g., players, balls) are transmitted with high configuration density to ensure complete information, while less important objects (e.g., background elements, spectators) are transmitted with low configuration density. This selective approach maintains reliability for critical objects while reducing overall data bandwidth requirements.

Inventive Principle:
Principle #3Local quality

2Quantity of substance

If model data with low configuration density is transmitted to reduce data amount, then the data transmission bandwidth requirement is reduced, but the reliability of virtual viewpoint image generation deteriorates

Engineering Contradiction:
Improvedata transmission bandwidthVSAvoidcompleteness of object information
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent changes the configuration density parameter of model data based on object importance. By adjusting this parameter dynamically, the system transmits high-resolution model data for important objects and low-resolution model data for less important objects. This parameter change enables the system to optimize the balance between data transmission bandwidth and information completeness, preventing reliability deterioration while reducing overall data amount.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If all objects are transmitted with high model data quality to ensure image generation accuracy, then the manufacturing precision of virtual viewpoint images is improved, but the data transmission bandwidth requirement increases

Engineering Contradiction:
Improvevirtual viewpoint image qualityVSAvoiddata transmission bandwidth
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by transmitting model data with different configuration densities for different objects based on their individual characteristics. Important objects (e.g., players, balls) are transmitted with high configuration density to ensure complete information, while less important objects (e.g., background elements, spectators) are transmitted with low configuration density. This selective approach maintains reliability for critical objects while reducing overall data bandwidth requirements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12137198B2Providing apparatus, providing method and computer readable storage medium for performing processing relating to a virtual viewpoint image
Publication Date: 2024.11.05 CANON KK
  • US12137198B2 patent drawing
  • US12137198B2 patent drawing
  • US12137198B2 patent drawing

AI summary

A providing apparatus configured to provide three-dimensional geometric data to be used to generate a virtual viewpoint image receives a data request from a communication apparatus, decides which of a plurality of pieces of three-dimensional geometric data including first three-dimensional geometric data and second three-dimensional geometric data with a different quality than the first three-dimensional geometric data is to be provided to the communication apparatus from which the received data request was transmitted, and provides the three-dimensional geometric data decided on from among the plurality of pieces of three-dimensional geometric data, to the communication apparatus as a response to the received data request.