Virtual Studio Background View Expansion Beyond the Shooting Area

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing in-camera VFX video capture systems struggle with recognizing the background image outside the shooting area due to limited field of view and synchronization challenges, making it difficult to capture images while understanding the entire background context.

Innovation Solution

An image processing apparatus and method that generates a first image based on the image capture apparatus' viewpoint, displays a part of this image as a background on a display device, and outputs a second image with a broader field of view to an external device, allowing for enhanced recognition of the background context.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a display device shows a background image based on camera position and orientation, then the captured area can be visualized, but the field of view remains limited and regions outside the shooting area cannot be recognized

Engineering Contradiction:
Improvebackground context informationVSAvoiddisplay device field of view
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The patent introduces a second image with a wider field of view that displays regions outside the captured area, adding a dimensional expansion to the display system. This allows operators to see beyond the limited display device field of view while maintaining the original background image display, thereby reducing information loss about the overall background context.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the display device shows only the captured area, then the shooting region is clearly visualized, but understanding of the entire background context is lost

Engineering Contradiction:
Improvebackground context informationVSAvoidbackground recognition
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent segments the background image display into two distinct components: a first image showing the captured area on the display device, and a second image showing a wider field of view on an external device. This segmentation allows operators to access different levels of background context as needed, improving both information availability and operational ease.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an external device as an intermediary between the camera system and the operator. This external device receives and displays the second image with the wider field of view, acting as a mediator that provides additional background context without interfering with the primary display device function.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If a single display device is used, then the system remains simple, but it cannot provide both captured area visualization and wider background context simultaneously

Engineering Contradiction:
Improvebackground context informationVSAvoiddisplay system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent makes the display system multi-functional by assigning different functions to different display components: the display device shows the captured area for precise shooting control, while the external device shows the wider field of view for background context. This universality allows the system to provide multiple functions without requiring a single complex device.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250363756A1Image processing apparatus, image processing method, virtual studio system, and image capture apparatus
Publication Date: 2025.11.27 CANON KK
  • US20250363756A1 patent drawing
  • US20250363756A1 patent drawing
  • US20250363756A1 patent drawing

AI summary

An image processing apparatus capable of assisting capture of in-camera VFX video while recognizing what a background image outside a shooting area is, is disclosed. The image processing apparatus causes a part of a first image that is based on a viewpoint of an image capture apparatus to be displayed on a display device. The image processing apparatus further outputs, to an external device different from the display device, a second image, which is a part of the first image, that includes a portion of the first image corresponding to a captured area captured by the image capture apparatus and that has a greater field of view than the captured area.