Virtual Viewpoint Rendering With Alternating Plane Visibility

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods do not effectively present virtual objects in a more appealing manner within virtual viewpoint images.

Innovation Solution

A generation apparatus that generates virtual viewpoint images by using a foreground model and a virtual object model, where the virtual object has alternating planes with different normal lines, allowing selective inclusion of these planes based on the virtual viewpoint, thereby creating a more appealing image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a virtual object with alternating planes is used in a virtual viewpoint image, then the appeal and engagement of the presentation is improved, but the complexity of the virtual object model increases

Engineering Contradiction:

Improveappeal of virtual object presentationVSAvoidcomplexity of virtual object model

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The virtual object is divided into multiple planar surfaces with different orientations (first planes and second planes). Each plane can be independently controlled for visibility based on the virtual viewpoint, allowing selective display to enhance appeal while managing complexity through modular structure

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The visibility of different planes of the virtual object is dynamically adjusted based on the virtual viewpoint position. The determination unit selectively determines which planes are visible from the current viewpoint, allowing the object to adapt its presentation to maximize appeal from any viewing angle

Inventive Principle:

Principle #15Dynamics

2Adaptability or versatility

If selective display of planes is implemented based on virtual viewpoint, then the viewing experience is enhanced, but the computational processing required increases

Engineering Contradiction:

Improveviewing experienceVSAvoidcomputational processing

Core Design Contradiction:

Adaptability or versatilityVSPower

Solution Approach 1:

The visibility determination is performed based on pre-established geometric relationships between the planes and the virtual viewpoint. By using the known orientations of the first and second planes relative to the viewpoint, the system can efficiently determine visible surfaces without requiring complex real-time rendering calculations for each plane

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12469208B2Generation apparatus, generation method, and non-transitory computer-readable storage medium

Publication Date: 2025.11.11 CANON KK

AI summary

A generation apparatus generates a virtual viewpoint image based on a foreground model, a virtual object model, and a virtual viewpoint. The virtual object has a shape with an alternate repetition of one of a plurality of first planes and one of a plurality of second planes. A normal line of each first plane and a normal line of each second plane extend in different directions. A virtual viewpoint image generated based on a first virtual viewpoint includes the first planes but does not include the second planes. And a virtual viewpoint image generated based on a second virtual viewpoint includes the second planes but does not include the first planes.