Virtual Studio Image Processing for Wider Background Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In-camera VFX video capture is challenging due to the background image changing with camera position and orientation, making it difficult to recognize the background outside the shooting area.
Innovation Solution
An image processing apparatus generates a first image based on the camera's viewpoint, displays a part of this image as a background on a display device, and outputs a second image with a broader field of view to an external device, assisting in-camera VFX video capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a display device shows only the captured area as background image, then the display device can show the shooting area clearly, but the user cannot recognize the background outside the shooting area
Solution Approach 1:
The patent divides the background image display into two separate segments: the display device shows the captured area (shooting area) while the imaging device's output shows the wider background area. This segmentation allows each display channel to fulfill its specific function without conflict, resolving the contradiction between showing detailed shooting area and broader background context.
Solution Approach 2:
The patent adds an additional dimension to the display system by outputting the wider field of view background image to an external device beyond the built-in display. This creates a multi-dimensional display architecture where different viewing angles and scopes are available simultaneously, allowing users to access both the detailed shooting area and the broader background context.
2Stability of the object's composition
If the background image changes dynamically with camera position and orientation, then the background image remains synchronized with camera movement, but it becomes difficult to recognize the background outside the current shooting area
Solution Approach 1:
The patent segments the background information display into two channels: one synchronized with camera position (display device showing captured area) and one providing broader context (external device showing wider field of view). This allows dynamic synchronization to be maintained where needed while preserving contextual information separately.
Solution Approach 2:
The imaging device acts as an intermediary that processes and distributes background image information to two different destinations with different requirements. It generates the first image based on camera viewpoint, then distributes portions to the display device and external device, mediating between the camera's dynamic position and the diverse display requirements.
3Measurement precision
If the display device shows a smaller captured area, then the shooting area can be displayed in detail, but the field of view is limited and background context is lost
Solution Approach 1:
The patent segments the field of view requirements into two parts: the display device handles the detailed captured area with smaller field of view, while the external device handles the broader background context with larger field of view. This segmentation allows each display to optimize for its specific purpose without compromise.
Solution Approach 2:
The patent extends the display architecture to another dimension by utilizing an external device in addition to the built-in display. This creates a multi-layered display system where different field of view requirements are satisfied simultaneously across different display dimensions and devices.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image processing apparatus capable of assisting capture of in-camera VFX video while recognizing what a background image outside a shooting area is, is disclosed. The image processing apparatus causes a part of a first image that is based on a viewpoint of an image capture apparatus to be displayed on a display device. The image processing apparatus further outputs, to an external device different from the display device, a second image, which is a part of the first image, that includes a portion of the first image corresponding to a captured area captured by the image capture apparatus and that has a greater field of view than the captured area.