Chroma Key Shadow Handling via Brightness-Dependent Transparency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Chroma key compositing techniques struggle to effectively handle shadows in image processing, as existing methods fail to accurately differentiate between key color regions and shadow areas of varying brightness, leading to imperfect substitution of backgrounds.

Innovation Solution

A computer-implemented method and apparatus that detect the presence of a predetermined key color, generate image textures with transparency values based on the brightness of the key color, and combine background, transparency, and foreground images to create a composite image, allowing for accurate shadow effects by setting background colors and transparency values accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If chroma key compositing is applied to replace background, then background substitution is achieved, but shadow areas with varying brightness cannot be accurately differentiated from key color regions

Engineering Contradiction:
Improvedifferentiation accuracy between key color regions and shadow areasVSAvoidaccuracy of background substitution
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the background processing into distinct operations: detecting key color regions, detecting shadow regions, and processing each type separately. This segmentation allows the system to differentiate between key color areas and shadow areas with varying brightness, applying appropriate processing to each region to achieve accurate background substitution while preserving shadow effects.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing qualities to different regions of the image. Shadow regions are identified by their brightness characteristics and processed differently from key color regions. The system adjusts transparency and blending parameters locally based on whether each pixel belongs to a key color region, shadow region, or foreground object, enabling accurate differentiation and substitution.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If transparency values are set based on key color brightness, then shadow effects are preserved, but processing complexity increases

Engineering Contradiction:
Improveaccuracy of shadow effect preservationVSAvoidimage processing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary detection of shadow regions based on brightness thresholds before the main compositing operation. By pre-identifying which pixels are shadows and which are key color regions, the system can prepare appropriate transparency values and blending parameters in advance, reducing the complexity of the main processing step while preserving accurate shadow effects.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes processing parameters dynamically based on region type. For shadow regions, higher transparency values are applied to preserve shadow effects, while key color regions use different parameters for clean substitution. This parameter adaptation allows accurate shadow preservation without requiring complex processing for every pixel uniformly.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3734554B1Background image processing method and apparatus
Publication Date: 2024.05.08 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3734554B1 patent drawingFigure 1~2
  • EP3734554B1 patent drawingFigure 3~4
  • EP3734554B1 patent drawingFigure 5a~5g

AI summary

An image processing method comprises detecting, for image positions in an input image, the presence of a predetermined key colour; generating an image texture, the generating step comprising: setting a texture background of the image texture to a predetermined background colour; generating transparency values at image positions of the image texture, the transparency value at an image position being dependent upon a detected property of the predetermined key colour in the input image, the transparency values; and providing a texture foreground of the image texture; and applying the image texture to the input image at image positions at which the predetermined key colour is present.