Virtual Viewpoint Image File Generation with Integrated Advertisement Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual viewpoint image generation techniques fail to effectively display additional information, such as virtual advertisements, leading to unclear images and missed advertising opportunities, as they do not integrate advertisement information into the image generation process.

Innovation Solution

A system comprising an image capturing apparatus, an advertisement database, and image file generation and display devices that acquire and integrate material information and advertisement data to generate a virtual viewpoint image with assigned virtual advertisement information, using the ISO BMFF standard to format the image file, ensuring clear display of advertisements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual viewpoint image generation is performed without integrating advertisement information, then the image generation process is simple, but advertising opportunities are lost and additional information cannot be effectively displayed

Engineering Contradiction:
Improveadvertisement integration capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the image generation process into distinct modules: material information acquisition, advertisement information acquisition, and file generation. This allows advertisement integration capability to be added without complicating the entire system, as each module operates independently but coordinates through standardized interfaces.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The file generation apparatus is designed with multi-functionality, serving both virtual viewpoint image generation and advertisement information integration. The same system infrastructure handles both tasks, making the system versatile without requiring separate dedicated systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If advertisement information is integrated into the virtual viewpoint image generation process, then advertising opportunities are enhanced and clear display is achieved, but the system complexity increases

Engineering Contradiction:
Improveadvertisement display clarityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Advertisement information is acquired and prepared in advance before the actual image generation process. By pre-acquiring advertisement information and organizing it in a structured format, the system ensures clear and reliable advertisement display without adding complexity during the critical image rendering phase.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary file structure (ISO BMFF format) that mediates between the advertisement information and the virtual viewpoint image. This standardized intermediate format allows seamless integration of advertisement data with image data, ensuring reliable display while keeping the system architecture manageable through standardization.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If multiple information types are integrated into a single file, then data organization is improved and processing efficiency increases, but file structure complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidfile structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The file structure is designed to be dynamic and extensible, allowing different types of information (material information, advertisement information, image data) to be integrated in a flexible manner. The ISO BMFF format provides a dynamic framework that can accommodate various data types without requiring a completely new file structure for each combination.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the organizational parameters of the file structure by adopting ISO BMFF standard, which provides a hierarchical and modular parameter system. This allows efficient processing of multiple information types while managing complexity through standardized parameter definitions and relationships.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11436788B2File generation apparatus, image generation apparatus, file generation method, and storage medium
Publication Date: 2022.09.06 CANON KK
  • US11436788B2 patent drawing
  • US11436788B2 patent drawing
  • US11436788B2 patent drawing

AI summary

The present invention is a file generation apparatus that generates a file for generating a virtual viewpoint image. The image file generation apparatus in one aspect of the present invention has a material information accumulation unit 520 configured to acquire and accumulate material information used for generation of a virtual viewpoint image, a virtual advertisement information acquisition unit 530 configured to acquire advertisement information that is displayed on a virtual viewpoint image, and an image file generation unit 540 configured to generate an image file including material information and advertisement information.