Standardized Vvvm File for Cross-Device Virtual Viewpoint Image Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face difficulties in generating virtual viewpoint images across various apparatuses due to differences in material data formats and acquisition methods, limiting the ability of devices like smartphones to reproduce such images.

Innovation Solution

A file generation apparatus that creates a standardized Vvvm file containing material data and type information, enabling more devices to generate virtual viewpoint images by integrating multi-viewpoint images, camera parameters, and background 3D models into a common format, which can be used by virtual viewpoint image generation apparatuses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If material data is stored in a database with different formats for each apparatus, then each apparatus can generate and store material data in its own format, but other apparatuses cannot interpret and use the material data

Engineering Contradiction:
Improvecompatibility of material data across apparatusesVSAvoidcomplexity of data format management
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a file format as an intermediary between different apparatuses. The file includes a header with format information and type information that describes the material data structure. This intermediary layer allows apparatuses from different manufacturers to interpret and use material data without needing to understand the internal formats of other apparatuses, thus resolving the compatibility issue while maintaining format diversity in the database.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a universal file format that can accommodate material data from multiple apparatus types. The file structure includes generic fields (header, type information, data) that can represent different material data formats through standardized descriptors. This universal interface enables any apparatus with the necessary decoder to interpret the file, achieving multi-functionality and broad compatibility without requiring apparatus-specific proprietary formats.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If each apparatus defines its own material data format, then data can be optimized for each apparatus's specific requirements, but terminal devices cannot generate virtual viewpoint images due to format incompatibility

Engineering Contradiction:
Improveability of terminal devices to generate virtual viewpoint imagesVSAvoidreliability of material data interpretation
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The file acts as an intermediary carrier that reliably transports material data from generation apparatuses to terminal devices. The header and type information fields provide structured, reliable descriptions of the data format, ensuring that terminal devices can accurately interpret the material data without ambiguity. This intermediary structure maintains data integrity and interpretation reliability across different apparatus types.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameters of data representation by introducing standardized metadata fields (format information, type information) that describe the material data characteristics. These parameter changes allow terminal devices to adapt to different material data formats by reading the descriptive metadata and adjusting their interpretation accordingly, thereby enhancing both versatility and reliability simultaneously.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If a standardized file format is created for material data, then more apparatuses can generate and use virtual viewpoint images, but the system requires additional type information fields in the file

Engineering Contradiction:
Improvenumber of apparatuses that can generate virtual viewpoint imagesVSAvoidstructure of file format
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal file structure where the additional type information fields serve multiple purposes: identifying the material data type, describing the format characteristics, and enabling compatibility across apparatuses. These fields are not redundant but rather provide essential metadata that allows the same file structure to accommodate diverse material data from different apparatus types, achieving universality without excessive complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The file structure is segmented into distinct functional components: header section, type information section, and data section. This segmentation allows the type information to be clearly separated from the actual material data, making the file format easier to parse and implement. The segmented structure reduces complexity by organizing information hierarchically, with each section serving a specific purpose while working together to achieve broad compatibility.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11715263B2File generation apparatus, image generation apparatus based on file, file generation method and storage medium
Publication Date: 2023.08.01 CANON KK
  • US11715263B2 patent drawing
  • US11715263B2 patent drawing
  • US11715263B2 patent drawing

AI summary

A file generation apparatus generates a file which includes material data used for generation of a virtual viewpoint image that is based on a multi-viewpoint image and type information for specifying a type of the material data, and outputs the generated file.