Virtual Viewpoint Camera Position Markers for Performer Gaze Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In systems generating virtual viewpoint images, performers lack guidance on where to direct their gaze since there is no real camera at the virtual viewpoint position, restricting their performance in studios and similar settings.

Innovation Solution

A processing system comprising multiple image capturing units and a presenting unit that determines the orientation of objects in space, using a network of cameras and projectors to display markers indicating the virtual camera position, allowing performers to align their gaze with the virtual viewpoint.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a plurality of cameras are arranged to capture images for generating virtual viewpoint images, then the realism and variety of viewing angles are improved, but the performer's ability to direct their gaze is worsened due to lack of visual cues about camera positions

Engineering Contradiction:
Improverealism of virtual viewpoint imagesVSAvoidperformer's gaze direction control
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces markers as intermediary visual elements that mediate between the invisible virtual camera positions and the performer's gaze. These markers are displayed on screens positioned around the performance space, providing direct visual guidance to performers about where to direct their attention, thereby solving the contradiction between maintaining realistic virtual viewpoint generation and enabling effective performer gaze control

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a visual copy or representation of the virtual camera positions through markers displayed on physical screens. Instead of directly showing the invisible virtual camera locations, the system projects marker images onto physical surfaces that performers can see and respond to, effectively copying the spatial information in a perceptible form that guides performer behavior

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11917117B2Processing system, processing method and non-transitory computer-readable storage medium
Publication Date: 2024.02.27 CANON KK
  • US11917117B2 patent drawing
  • US11917117B2 patent drawing
  • US11917117B2 patent drawing

AI summary

a processing system comprises a plurality of image capturing units configured to capture a space including an object and configured to be used for generating a virtual viewpoint image representing a view from a virtual viewpoint; and a presenting unit configured to perform presentation for determining an orientation of the object in the space.