Display Image Pre-Correction for Virtual Production Shooting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image capture systems using LED displays in virtual production suffer from degradation due to lens aberration and LED characteristics, leading to reduced image quality and increased noise, which conventional camera corrections exacerbate.

Innovation Solution

An information processing device that calculates and applies correction values based on camera position, attitude, and shooting conditions to improve image quality by pre-processing the display image before shooting, addressing distortions, chromatic aberrations, brightness shading, and color shifts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional camera correction functions are used to correct lens aberration, then lens aberration is corrected, but image quality degrades with increased noise and narrower angle of view

Engineering Contradiction:
Improvelens aberration correctionVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies preliminary anti-action by pre-calculating and applying correction values to the display image before shooting. The information processing device calculates correction values based on camera position, attitude, and shooting conditions, then applies these corrections to the display image in advance. This prevents the need for post-shooting correction that would otherwise degrade image quality, thereby maintaining high image quality while correcting lens aberration.

Inventive Principle:
Principle #9Preliminary anti-action

Solution Approach 2:

The patent implements preliminary action by performing correction processing on the display image before the actual shooting occurs. The system calculates appropriate correction values based on predicted camera parameters and applies them to the display image in advance. This ensures that when the camera captures the image, the correction is already in place, avoiding the quality degradation that would result from applying correction after shooting.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If conventional camera correction functions are used, then lens aberration is corrected, but the angle of view becomes narrower

Engineering Contradiction:
Improvelens aberration correctionVSAvoidangle of view
Core Design Contradiction:
Measurement precisionVSLength of moving object

Solution Approach 1:

The patent applies preliminary anti-action by pre-calculating correction values that account for the relationship between lens aberration and angle of view. The information processing device computes correction values based on camera position, attitude, and shooting conditions, then applies these to the display image before shooting. This approach corrects lens aberration while preserving the original angle of view, avoiding the narrowing effect of conventional post-shooting correction methods.

Inventive Principle:
Principle #9Preliminary anti-action

3Reliability

If post-processing is applied to correct degradation, then image quality improves, but processing time and complexity increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements preliminary action by performing all necessary correction processing on the display image before the shooting occurs. The information processing device calculates correction values based on camera parameters and shooting conditions, applies these corrections to the display image in advance, and stores the corrected image. This eliminates the need for time-consuming post-processing after shooting, as the correction is already completed beforehand.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies preliminary anti-action by pre-calculating and applying correction values to prevent degradation from occurring in the first place. The system computes correction values based on predicted camera position, attitude, and shooting conditions, then applies these to the display image before shooting. This prevents the need for subsequent post-processing, reducing both time and computational complexity while maintaining high image quality.

Inventive Principle:
Principle #9Preliminary anti-action

Data Source

PatentUS12578910B2Information processing device, information processing method, and recording medium
Publication Date: 2026.03.17 SONY GROUP CORP
  • US12578910B2 patent drawing
  • US12578910B2 patent drawing
  • US12578910B2 patent drawing

AI summary

There is provided an information processing device, an information processing method, and a recording medium that enable high quality images to be displayed on a display. The information processing device includes a display control unit that reflects a correction corresponding to a post-process for a shot image shot by a camera for shooting a display to display of a display image on the display based on at least one of a position of the camera, an attitude of the camera, and a shooting condition. The present technology can be applied, for example, to a shooting system used in virtual production, in which a subject is shot with an image displayed on an LED display as a background.