Blockchain-Based Virtual Viewpoint Image Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods lack a controlled process for displaying digital content items used to form virtual viewpoint images, particularly in relation to ownership and user information management.

Innovation Solution

An information processing apparatus that acquires and manages user information and material data recorded on a blockchain, allowing users to select and display virtual viewpoint images based on owned material data and virtual viewpoint information, including the ability to manipulate virtual camera positions and orientations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple material data owned by different users are output and made available for selection, then the versatility and user choice are improved, but the complexity of ownership management and system coordination increases

Engineering Contradiction:
Improveuser choiceVSAvoidownership management
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments material data by ownership, organizing multiple material data from different users into distinct categories. The system separates ownership information from material data content, allowing independent management of each. This segmentation enables the system to handle multiple owners' data without creating a monolithic complex structure, as each user's material data can be managed separately while still being accessible for virtual viewpoint image generation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary information processing apparatus that mediates between multiple users and the virtual viewpoint image generation process. This intermediary manages ownership information, coordinates material data selection, and controls the generation process based on user permissions. By positioning this intermediary layer, the system handles ownership complexity centrally rather than requiring direct coordination between all users, thus reducing overall system complexity while maintaining versatility.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If users can select and control material data used in virtual viewpoint image formation, then user control and content protection are improved, but the complexity of the display control process increases

Engineering Contradiction:
Improveuser controlVSAvoiddisplay control process
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by having users pre-select and designate specific material data to be used in virtual viewpoint image generation before the actual generation process. Users can designate their owned material data in advance, and the system stores these designations. When generating virtual viewpoint images, the system automatically uses the pre-designated material data without requiring real-time user intervention, thus simplifying the control process while maintaining user control and content protection.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent incorporates feedback mechanisms where the system provides information to users about which material data is being used or can be used in virtual viewpoint image generation. This feedback loop allows users to understand the relationship between their designated material data and the generated images, enabling informed control decisions. The system monitors and reports on material data usage, ownership status, and generation results, creating a transparent control process that balances user autonomy with system automation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP4343598A1Information processing apparatus
Publication Date: 2024.03.27 CANON KK
  • EP4343598A1 patent drawingFigure 1
  • EP4343598A1 patent drawingFigure 2
  • EP4343598A1 patent drawingFigure 3

AI summary

An image processing apparatus includes first output means configured to output, regarding multiple material data recorded on a blockchain and generated based on images captured by multiple image capturing apparatuses, the multiple material data including one or more material data owned by a first user who is a current owner and one or more material data owned by a second user who is a current owner, information indicating the material data owned by the first user who is the current owner, second acquisition means configured to acquire information indicating the material data selected by the first user, and second output means configured to output a virtual viewpoint image that is formed based on the material data corresponding to the information acquired by the second acquisition means and indicating the material data.