Virtual Viewpoint Image Processing Apparatus

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for generating virtual viewpoint images struggle to handle large numbers of user requests efficiently and uniformly, leading to potential processing failures and inappropriate cost recovery for virtual viewpoint images with varying content.

Innovation Solution

An information processing apparatus that obtains viewpoint information for virtual viewpoint images captured by multiple cameras, determines an evaluation value based on this information, and outputs the virtual viewpoint image, allowing for differentiated processing and charging based on the image content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the system uniformly processes all user requests for virtual viewpoint images, then all users can receive service, but the processing capability is exceeded and processing cannot be completed for any requests

Engineering Contradiction:
ImproveAbility to handle multiple user requestsVSAvoidProcessing completion rate
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent applies local quality by differentiating the processing priority and resource allocation based on the evaluation values of individual virtual viewpoint images. High-priority images (with higher evaluation values) receive preferential processing resources, while low-priority images are processed later or with reduced resources. This resolves the contradiction by making the system adaptable to handle multiple requests while maintaining high processing completion rates for important images.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the parameter of processing priority by introducing evaluation values that quantify the importance of each virtual viewpoint image. By dynamically adjusting processing parameters (such as queue position, resource allocation) based on these evaluation values, the system can adaptively handle varying numbers of requests while ensuring critical images are processed successfully.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If the system uniformly charges all users for virtual viewpoint image generation, then charging is simple, but the cost cannot be appropriately recovered for images with different generation costs

Engineering Contradiction:
ImproveCharging simplicityVSAvoidCost recovery accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent applies local quality by implementing differentiated charging based on the evaluation values of virtual viewpoint images. Instead of uniform charging, the system charges different amounts according to the specific characteristics and generation costs of each image type. This resolves the contradiction by maintaining charging simplicity through automated evaluation-based differentiation while achieving accurate cost recovery.

Inventive Principle:
Principle #3Local quality

3Device complexity

If the system processes virtual viewpoint images without differentiation, then processing is straightforward, but processing capability is exceeded when many users make requests

Engineering Contradiction:
ImproveProcessing complexityVSAvoidSystem processing capacity
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent applies preliminary action by calculating evaluation values for virtual viewpoint images before actual processing. This pre-assessment of image importance allows the system to plan resource allocation and processing sequences in advance, preventing processing capability overload. The complexity is managed by performing simple evaluation calculations beforehand rather than complex real-time decision-making during processing.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10951873B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2021.03.16 CANON KK
  • US10951873B2 patent drawing
  • US10951873B2 patent drawing
  • US10951873B2 patent drawing

AI summary

An information processing apparatus includes an obtaining unit configured to obtain viewpoint information indicating at least a position of a virtual viewpoint corresponding to a virtual viewpoint image that is generated based on a plurality of images obtained by a plurality of image capturing apparatuses each capturing an image of an imaging target area in a different direction, and an output unit configured to output a value of the virtual viewpoint image corresponding to the position of the virtual viewpoint indicated by the viewpoint information obtained by the obtaining unit, wherein the value is determined based on the viewpoint information.