Multi-Camera Background Switching for In-Camera VFX Alignment

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for capturing background images using multiple cameras in in-camera VFX systems face challenges such as reduced exposure time and difficulty in producing smooth videos due to misalignment of camera positions and orientations, particularly when increasing the number of cameras.

Innovation Solution

A control apparatus and method that utilizes a main-camera selecting apparatus to manage the display and capture of background images using multiple image pickup apparatuses, ensuring synchronization and alignment by detecting camera positions and orientations, and allowing user-controlled switching between background images displayed on a display apparatus.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the number of cameras is increased to capture multiple background images, then the coverage and flexibility of video capture are improved, but the exposure time of each camera is reduced and the display time of background images is reduced, leading to difficulty in producing smooth videos

Engineering Contradiction:

Improvecoverage and flexibility of video captureVSAvoidexposure time and display time

Core Design Contradiction:

Adaptability or versatilityVSDuration of action of moving object

Solution Approach 1:

The system pre-calculates and stores multiple background images corresponding to different camera positions and orientations before actual video capture. When a camera captures a foreground object, the control apparatus quickly retrieves and displays the pre-prepared background image that matches the camera's current position and orientation, eliminating the need for real-time background generation and allowing sufficient exposure time.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system divides the video capture process into separate foreground capture and background display operations. Multiple cameras capture foreground objects simultaneously or sequentially, while the control apparatus manages multiple background images independently, allowing each camera to have adequate exposure time while maintaining overall system flexibility.

Inventive Principle:

Principle #1Segmentation

2Adaptability or versatility

If the number of cameras is increased to capture multiple background images, then the coverage and flexibility of video capture are improved, but the position and orientation alignment between cameras and background images becomes difficult to maintain

Engineering Contradiction:

Improvecoverage and flexibility of video captureVSAvoidposition and orientation alignment

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The control apparatus continuously monitors the position and orientation of each camera using position detection apparatuses, and automatically selects and displays the background image that best matches the current camera state. This closed-loop feedback system ensures precise alignment between foreground capture and background display regardless of the number of cameras used.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system creates multiple copies of background images, each corresponding to a specific camera position and orientation. The control apparatus selects the appropriate background image copy that matches the current camera state, ensuring precise alignment without requiring complex real-time geometric transformations.

Inventive Principle:

Principle #26Copying

3Reliability

If background images are displayed in a time-division manner for multiple cameras, then the synchronization is improved, but the display time for each background image is reduced, making it difficult to produce smooth captured video

Engineering Contradiction:

Improvesynchronization between cameras and background imagesVSAvoiddisplay time of background image

Core Design Contradiction:

ReliabilityVSDuration of action of moving object

Solution Approach 1:

Multiple background images are prepared in advance for different cameras and time points. The control apparatus retrieves and displays the appropriate pre-prepared background image when needed, rather than generating or switching backgrounds in real-time, thus maintaining both synchronization and sufficient display time for smooth video output.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20260082135A1Control apparatus, imaging system, control method, and storage medium

Publication Date: 2026.03.19 CANON KK

AI summary

A control apparatus for an imaging system for capturing background images displayed on a display apparatus by using a plurality of image pickup apparatuses including a first image pickup apparatus and a second image pickup apparatus includes one or more processors that operate to cause the display apparatus to display a first background image corresponding to a first position and orientation of the first image pickup apparatus and a second background image corresponding to a second position and orientation of the second image pickup apparatus, and acquire a start instruction from a user to start display of the second background image on the display apparatus while the first background image is being displayed on the display apparatus. The one or more processors operate to start the display of the second background image on the display apparatus according to the start instruction.