Arbitrary Viewpoint Image Generation With Seamless Mode Switching

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies cannot generate and display images viewed from arbitrary viewpoints using multi-viewpoint image data captured simultaneously, limiting user interaction and flexibility in viewing modes.

Innovation Solution

An information processing apparatus and method that inputs and switches between first and second image data modes, generates images from arbitrary viewpoints based on parallel shooting with multiple image capturing apparatuses, and stores designated viewpoints for seamless mode switching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional single-viewpoint images or pre-captured still images are used, then the system is simple to operate, but the viewer cannot view images from arbitrary viewpoints

Engineering Contradiction:

Improveviewpoint flexibilityVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The information processing apparatus integrates multiple functions including 2D image display, 3D image display, and arbitrary viewpoint image generation within a single system. The generation unit can produce images from any viewpoint based on multi-viewpoint image data, making the system universally applicable for different viewing needs without requiring separate devices for each function.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an information processing apparatus as an intermediary between the multi-viewpoint image data and the viewer. This apparatus includes a generation unit that processes the multi-viewpoint data to create images from arbitrary viewpoints, mediating the complex data processing requirements and presenting simplified viewing options to the user.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If 2D and 3D images are converted and displayed automatically, then viewer fatigue is reduced, but arbitrary viewpoint images cannot be generated

Engineering Contradiction:

Improveautomatic mode switchingVSAvoidarbitrary viewpoint generation

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically switches between different display modes (2D, 3D, arbitrary viewpoint) based on user input and conditions. The switching unit enables flexible transition between modes, and the generation unit can adaptively create images from different viewpoints as needed, providing dynamic responsiveness to user requirements.

Inventive Principle:

Principle #15Dynamics

3Adaptability or versatility

If multi-viewpoint image data is used for arbitrary viewpoint generation, then viewpoint flexibility is improved, but the system complexity increases

Engineering Contradiction:

Improveviewpoint flexibilityVSAvoidprocessing complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces complex mechanical or manual systems for viewpoint adjustment with computational image processing. Instead of physically moving cameras or requiring manual image stitching, the generation unit uses algorithms to synthesize arbitrary viewpoint images from multi-viewpoint data, substituting mechanical complexity with computational efficiency.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

4Stability of the object's composition

If viewpoint is stored and automatically designated upon mode switching, then viewing continuity is improved, but storage and management complexity increases

Engineering Contradiction:

Improveviewing continuityVSAvoidviewpoint management complexity

Core Design Contradiction:

Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by storing viewpoint information when it is relevant or when the user specifies a viewpoint. This pre-stored information is then automatically retrieved and used when switching to the second display mode, eliminating the need for users to re-specify viewpoints and ensuring viewing continuity without complex real-time processing.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12526392B2Information processing apparatus and method, and storage medium for generating arbitrary viewpoint images

Publication Date: 2026.01.13 CANON KK

AI summary

An information processing apparatus comprises: an input unit that inputs first image data used to display an image in a first mode and second image data used to display an image in a second mode; a switching unit that switches between the first and second modes; a generation unit that generates an image viewed from an arbitrary viewpoint based on the second image data; a designation unit that designates a viewpoint of an image to be generated by the generation unit; and a storage unit that stores the viewpoint of the image generated by the generation unit. The first and second image data are obtained by shooting a same subject in parallel with a plurality of image capturing apparatuses, and if a viewpoint is stored when the first mode is switched to the second mode, the designation unit designates the stored viewpoint.