Virtual Camera Path Visualization for Efficient Video Editing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face difficulties in quickly and efficiently finding a desired camera path among a large number of camera paths, especially when they are similar, due to the time-consuming process of manually reviewing multiple free viewpoint video images, which can lead to missed relevant scenes and increased playback times.

Innovation Solution

A display controlling apparatus that includes an obtaining unit for virtual camera path information, a generating unit for creating virtual camera path images, and a display controlling unit to display these images on a screen, allowing users to visualize and compare multiple camera paths efficiently by generating and displaying camera path images with customizable parameters such as position, visual field, and metadata.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple free viewpoint video images are simultaneously displayed on multiple screens, then the user can compare camera paths, but it takes much time to find the desired camera path among similar paths and the user may miss relevant scenes

Engineering Contradiction:
Improvecamera path comparison capabilityVSAvoidtime to find desired camera path
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the camera path information into two distinct visual components: the trajectory path itself and the preview image. By displaying these separately and allowing independent control of their visibility and positioning, the system enables users to efficiently scan multiple camera paths without being overwhelmed by simultaneous full video playback, thus reducing the time to identify the desired camera path.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a spatial dimension by allowing the preview image and trajectory to be displayed at different positions on the screen. This spatial separation enables users to visually distinguish between multiple camera paths more effectively, comparing trajectories in one area while referencing preview images in another, thereby improving search efficiency without missing relevant scenes.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If there are a large number of camera paths, then more comprehensive coverage is achieved, but it becomes impossible to display all free viewpoint video images at once requiring multiple playbacks

Engineering Contradiction:
Improvenumber of camera pathsVSAvoidease of finding desired camera path
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent extracts the essential visual information from the full video playback by displaying only the preview image and trajectory representation. This extraction allows multiple camera paths to be displayed simultaneously on a single screen without requiring full video playback, enabling users to browse through a large number of camera paths efficiently and select the desired one without repeated playbacks.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a simplified visual copy of the camera path experience through preview images and trajectory representations. These copies provide sufficient information for comparison and selection without requiring the full video content, allowing users to evaluate multiple camera paths quickly and accurately identify the desired path among a large number of options.

Inventive Principle:
Principle #26Copying

3Quantity of substance

If similar camera paths are displayed, then comprehensive coverage is improved, but it becomes difficult to distinguish and identify the desired path quickly

Engineering Contradiction:
Improvenumber of camera pathsVSAvoiddifficulty of distinguishing similar paths
Core Design Contradiction:
Quantity of substanceVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies local quality differentiation by allowing users to display preview images and trajectories with distinct visual characteristics at different screen positions. This enables subtle differences between similar camera paths to be more easily detected through visual comparison of localized features in the preview images and trajectory shapes, making it easier to distinguish and identify the desired path among similar options.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10715780B2Display controlling apparatus, display controlling method, and storage medium
Publication Date: 2020.07.14 CANON KK
  • US10715780B2 patent drawing
  • US10715780B2 patent drawing
  • US10715780B2 patent drawing

AI summary

There is provided a display controlling apparatus which comprises: an obtaining unit configured to obtain virtual camera path information related to a movement path of a virtual viewpoint related to a virtual viewpoint video image generated based on a plurality of shot images obtained by shooting a shooting target area with a plurality of cameras; a generating unit configured to generate a virtual camera path image representing the plurality of movement paths including first and second movement paths of the virtual viewpoint, based on the virtual camera path information obtained by the obtaining unit; and a display controlling unit configured to display the virtual camera path image generated by the generating unit, on a display screen.