Information Processing for Virtual Viewpoint Data Format Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems struggle to appropriately process data for generating virtual viewpoint images when the data format is not supported by the output destination apparatus, leading to improper processing.

Innovation Solution

An information processing apparatus that acquires and outputs material data in formats compatible with the capabilities of the data output destination, selecting data based on the format identification information of the destination apparatus.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple types of material data are generated to support different virtual viewpoint image generation methods, then the adaptability to different apparatuses is improved, but the device complexity increases

Engineering Contradiction:
Improvecompatibility with different apparatusesVSAvoiddata management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary classification and organization of material data according to different formats and types before output. The information processing apparatus pre-processes the material data into multiple categorized types (point cloud data, distance image data, foreground image data, mesh data) and stores them in an organized manner, so that when an output request is received, the appropriate data type can be quickly selected and provided to the corresponding apparatus without requiring complex real-time conversion or selection logic.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If data is output in a fixed format, then the processing simplicity is improved, but the adaptability to different apparatuses deteriorates

Engineering Contradiction:
Improveprocessing simplicityVSAvoidformat compatibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The information processing apparatus is designed with multi-functionality to handle multiple data formats and types. It can generate, store, and output various types of material data (point cloud data, distance image data, foreground image data, mesh data) in accordance with different virtual viewpoint image generation methods. The apparatus universally supports different output formats by maintaining an organized repository of multiple data types and selecting the appropriate type based on the receiving apparatus capabilities, thus achieving both processing simplicity and format compatibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12400392B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2025.08.26 CANON KK
  • US12400392B2 patent drawing
  • US12400392B2 patent drawing
  • US12400392B2 patent drawing

AI summary

An information processing apparatus includes a management unit configured to acquire a plurality of material data for use in generation of a virtual viewpoint image based on a plurality of images captured with a plurality of cameras by imaging an object, the plurality of material data including first material data and second material data different from the first material data, and a transmission/reception unit configured to output, to a device, material data that has been selected from among the plurality of acquired material data based on information for identifying a format of material data processable by the device.