3D Background Rendering for Home Virtual Production

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual production technologies require dedicated studio setups, making them inaccessible for general users to perform at home.

Innovation Solution

An information processing device that renders a 3D model based on the relative position between a display device and a terminal device, enabling virtual production without the need for a dedicated studio, by associating the devices for real-time video rendering and capturing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a dedicated studio set with large display device is used for virtual production, then the quality of video content and imaging capability is improved, but the device complexity and ease of operation deteriorate as it requires specialized equipment and infrastructure

Engineering Contradiction:
Improvequality of video contentVSAvoidspecialized equipment and infrastructure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses a 3D model to represent the background scene, which is rendered and displayed on a regular display device. This 3D model approach allows the system to replicate the visual effect of a complex virtual production studio using ordinary hardware, thereby reducing device complexity while maintaining video quality

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the physical mechanical system of a dedicated studio set with a computational rendering system. Instead of requiring actual physical sets and large display devices, the system uses computer-generated 3D models and standard display hardware to achieve the same visual results, thus reducing hardware requirements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If a dedicated studio set with large display device is used for virtual production, then the imaging capability is improved, but the ease of operation deteriorates as it is difficult for general users to easily use

Engineering Contradiction:
Improveimaging capabilityVSAvoidease of use for general users
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent enables any terminal device with a camera and display to function as a virtual production system. By making the system universally applicable to ordinary users' devices rather than requiring specialized studio equipment, it significantly improves ease of operation while maintaining imaging capability through the 3D rendering engine

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a 3D model as an intermediary between the user's terminal device and the desired virtual production effect. This intermediary allows the simple hardware to generate complex visual results through computational rendering, bridging the gap between ordinary devices and professional imaging capabilities

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If virtual production is performed with devices at home, then the ease of operation is improved, but the manufacturing precision and quality control deteriorate due to lack of professional equipment

Engineering Contradiction:
Improveease of use at homeVSAvoidquality control of video content
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent replaces physical studio infrastructure with a software-based 3D rendering system that runs on standard hardware. This substitution allows home users to achieve professional-quality video content through computational precision rather than physical equipment precision, thereby maintaining quality control while improving ease of operation

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12621404B2Information processing device, video processing method, and program
Publication Date: 2026.05.05 SONY GROUP CORP
  • US12621404B2 patent drawing
  • US12621404B2 patent drawing
  • US12621404B2 patent drawing

AI summary

It is assumed that a terminal device captures an image of an object and a video displayed on a display device in a state in which the display device and the terminal device having an imaging function are associated with each other. In this case, an information processing device includes a video processing unit configured to render a 3D model on the basis of relative position information between the display device and the terminal device to generate a video to be displayed on the display device.