Multi-Mode Image Processing for Synchronized Virtual Viewpoint Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems face challenges in maintaining consistent imaging conditions and optimizing image processing parameters across multiple imaging apparatuses, leading to difficulties in generating accurate virtual viewpoint images and synchronously reproducing images without system reconstruction.

Innovation Solution

An image processing apparatus that includes units for acquiring, processing, and transmitting image data, with features like daisy-chain connectivity, time synchronization, and mode switching to streamline image processing and reduce system reconstruction, enabling efficient generation of virtual viewpoint images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image processing parameters are optimized through multiple workflow executions, then image processing quality is improved, but imaging conditions and subject conditions change making evaluation difficult

Engineering Contradiction:
Improveimage processing parameter optimizationVSAvoidimaging condition consistency
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by capturing and storing reference images under controlled conditions before the main image processing tuning process. These reference images serve as a stable baseline for evaluating image processing parameters, allowing multiple workflow executions without the imaging conditions changing during the optimization process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses reference images as copies of the original imaging conditions. By creating and storing these reference images separately, the system can repeatedly evaluate image processing parameters against the same stable reference, eliminating the problem of changing imaging conditions during multiple workflow executions.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If system reconstruction occurs during process switching, then apparatus configuration can be changed, but system operation continuity is disrupted

Engineering Contradiction:
Improveapparatus change capabilityVSAvoidsystem operation continuity
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent applies dynamics by enabling the image processing apparatus to switch between different operational modes (image processing tuning process and main image capturing process) without requiring physical system reconstruction. The system dynamically reconfigures its operation through software control, allowing apparatus changes and mode switching while maintaining continuous operation.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If multiple imaging apparatuses are used for virtual viewpoint images, then image quality and viewing angles are improved, but system complexity and synchronization difficulty increase

Engineering Contradiction:
Improvevirtual viewpoint image accuracyVSAvoidsystem configuration complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the multi-apparatus system into independent image processing apparatuses, each handling its own image capturing and processing. Each apparatus operates semi-independently with its own processing unit, reducing the complexity of centralized control while maintaining the ability to generate accurate virtual viewpoint images through coordinated operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies universality by designing image processing apparatuses that can perform multiple functions: capturing images for virtual viewpoint generation, performing image processing tuning, and executing main image capturing processes. This multi-functionality reduces overall system complexity by eliminating the need for separate specialized devices for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12439014B2Image processing system, image processing apparatus, control method of image processing apparatus, and storage medium
Publication Date: 2025.10.07 CANON KK
  • US12439014B2 patent drawing
  • US12439014B2 patent drawing
  • US12439014B2 patent drawing

AI summary

An image processing apparatus that supplies image data to an image processing system processing a plurality of pieces of image data that are based on a plurality of pieces of image capturing data acquires first image capturing data from an imaging unit configured to capture an image of an image capturing target. The image processing apparatus acquires second image capturing data from a storage unit storing the second image capturing data captured by the imaging unit. The image processing apparatus acquires image data by performing predetermined image processing on the acquired first image capturing data or the acquired second image capturing data in accordance with a setting of a mode. The image processing apparatus transmits the image data to an external device.