Stereoscopic Image Processing Using Virtual Viewpoints and Distinct Planes

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for generating virtual viewpoint images from multiple image capturing devices fail to create attractive digital contents that incorporate both virtual and main images effectively.

Innovation Solution

An image processing system that generates stereoscopic digital contents by associating virtual viewpoint images with images from different viewpoints using multiple cameras, allowing users to freely select or automatically designate viewpoints based on image analysis, and integrates these images onto distinct planes for display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual viewpoint images are generated from multiple image capturing devices, then the virtual viewpoint image can be generated, but the digital contents lack attractiveness and engagement

Engineering Contradiction:

Improvevirtual viewpoint image generationVSAvoiddigital contents attractiveness

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent merges virtual viewpoint images with main images (images from fixed viewpoints) to create stereoscopic digital contents. This combination integrates the flexibility of virtual viewpoints with the engagement of main images, resolving the contradiction by making digital contents both versatile and attractive through unified presentation.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent adds a spatial dimension by displaying virtual viewpoint images and main images on different planes (first plane and second plane). This dimensional separation allows users to perceive both virtual and fixed viewpoints simultaneously, enhancing the attractiveness and engagement of digital contents while maintaining generation versatility.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Ease of operation

If multiple images from different viewpoints are integrated, then user interaction and engagement increase, but the system complexity increases

Engineering Contradiction:

Improveuser interactionVSAvoidsystem complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the digital contents into distinct planes: a first plane for virtual viewpoint images and a second plane for main images. This segmentation organizes the complexity by separating different types of images into structured layers, making the system more manageable while enabling rich user interaction across multiple viewpoints.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates a unified system that handles both virtual viewpoint images and main images through a single processing architecture. The image processing apparatus performs multiple functions (generation, association, display control) within one system, reducing overall complexity while maintaining ease of operation through multi-functional capabilities.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12388965B2Image processing system, image processing method, and storage medium

Publication Date: 2025.08.12 CANON KK

AI summary

In order to provide an image processing system that can generate appealing content, an image capturing system 100 generates stereoscopic form digital contents 200 including a first image that is a main camera image, and a second image that is a virtual viewpoint image, and associates the first image and the second image with a first plane 201 and a second plane 202 that configure the digital contents 200.