3D Subject Capture Timing Control for Immersive Surround Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods using green screens or blue screens make it difficult to present images other than the screens to the subject, limiting the immersive experience in image-capturing and display applications.
Innovation Solution
An information processing apparatus and method that controls the timing of image-capturing and display to shift image-capturing and display timings, allowing for the generation of a 3D model of a subject while presenting audience videos around the subject, using a combination of cameras and displays arranged around the subject.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If green screens or blue screens are used to extract subject regions, then subject extraction becomes easier, but the ability to present images around the subject is limited
Solution Approach 1:
The system alternates between display periods and image-capturing periods in a periodic cycle. During display periods, images are presented around the subject; during image-capturing periods, the display is turned off to enable clear subject extraction. This periodic switching resolves the contradiction by allowing both functions to operate at different times within the same system.
2Adaptability or versatility
If images are displayed around the subject continuously, then immersive experience is enhanced, but subject extraction from captured images becomes difficult
Solution Approach 1:
The display and image-capturing operations are performed in alternating periodic intervals. The control section switches the display off during image-capturing periods to ensure clean subject extraction, then switches it on during display periods to provide immersive visual feedback. This temporal separation allows both high-quality subject extraction and immersive display experience.
Solution Approach 2:
The system dynamically adjusts the display state based on the operational phase. The display is dynamically turned off during image-capturing to improve extraction precision, and dynamically turned on during display periods to enhance immersive experience. This dynamic control resolves the contradiction by adapting the display state to current operational requirements.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
[Object] An information processing apparatus, an information processing method, and a system that can give a more highly entertaining experience by pursuing both image-capturing of a subject and displaying of images around the subject are provided. [Solving Means] An information processing apparatus includes a control section that performs control of image-capturing with multiple image-capturing sections for acquiring three-dimensional information regarding a subject and display control to display an image acquired from an outside in one or more display regions positioned around the subject, in which the control section performs control such that a timing when the image-capturing is performed and a timing when the image acquired from the outside is displayed in the display regions are made different from each other.