3D Capture Timing Control for Interactive Surround Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods using green screens or blue screens make it difficult to present images other than the screens to the subject, limiting the ability to create engaging and interactive experiences in applications like remote concerts.

Innovation Solution

An information processing apparatus and method that controls image-capturing and display timings differently for multiple image-capturing sections and display regions around a subject, allowing for the generation of a 3D model and simultaneous display of audience videos, enhancing interactive experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If green screens or blue screens are used to extract subject regions from images, then subject extraction becomes easier, but the ability to present images around the subject is lost

Engineering Contradiction:
Improvesubject extraction easeVSAvoidimage presentation capability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system alternates between display periods and image-capturing periods in a periodic cycle. During display periods, images are shown around the subject; during image-capturing periods, the display is turned off to enable clear subject extraction. This periodic switching resolves the contradiction by allowing both functions to operate at different times within the same system.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The display regions dynamically change state between being active (displaying images) and inactive (turning off for capture). This dynamic behavior allows the system to adapt its configuration based on the current operational mode, enabling both image presentation and subject extraction capabilities without permanent conflict.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If images are displayed around the subject continuously, then visual recognition and entertainment experience improve, but subject extraction quality deteriorates

Engineering Contradiction:
Improvevisual recognition qualityVSAvoidsubject extraction precision
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The system implements periodic switching between display-on and display-off states synchronized with capture cycles. This ensures that subject extraction occurs during periods when no display interference exists, while visual recognition benefits from display content during dedicated display periods.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The operational timeline is segmented into distinct display periods and image-capturing periods. This temporal segmentation separates the conflicting functions into non-overlapping time slots, allowing each function to operate at optimal conditions without compromising the other.

Inventive Principle:
Principle #1Segmentation

3Productivity

If image-capturing and display are performed simultaneously, then system efficiency improves, but image quality and subject recognition deteriorate

Engineering Contradiction:
Improvesystem efficiencyVSAvoidimage quality
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system achieves high productivity through rapid periodic cycling between display and capture modes. Although operations are not simultaneous, the high-frequency switching creates the perception of continuous operation while maintaining image quality, as each capture occurs during a dedicated display-off interval.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system maintains continuous useful action by ensuring that during display periods, valuable visual content is presented, and during capture periods, high-quality images are acquired. The seamless transition between these states ensures no time is wasted, maintaining overall system efficiency despite the alternating nature of operations.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12615355B2Information processing apparatus, information processing method, and system
Publication Date: 2026.04.28 SONY GROUP CORP
  • US12615355B2 patent drawing
  • US12615355B2 patent drawing
  • US12615355B2 patent drawing

AI summary

There is provided an information processing apparatus, an information processing method, and a system that can give a more highly entertaining experience by pursuing both image-capturing of a subject and displaying of images around the subject. The information processing apparatus includes a control section that performs control of image-capturing with multiple image-capturing sections for acquiring three-dimensional information regarding a subject and display control to display an image acquired from an outside in one or more display regions positioned around the subject, in which the control section performs control such that a timing when the image-capturing is performed and a timing when the image acquired from the outside is displayed in the display regions are made different from each other.