LED Wall Appearance Control via Camera Viewing Angle

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

LED walls in extended reality applications face challenges with visual artifacts due to varying brightness and color when viewed from different angles, leading to unsatisfactory seamless transitions between real and virtual content, especially when budget constraints limit the size of the LED wall and result in uneven lighting and color distortions.

Innovation Solution

A method to control the appearance of LED walls based on the camera's viewing angle by adjusting the brightness and color balance of individual LED pixels, using a computer-implemented system that determines the viewing angle and generates adjustment signals to ensure consistent appearance across different angles, thereby reducing visual artifacts and enhancing the quality of digitally augmented images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the size of the LED wall is reduced to meet budget constraints, then the cost is reduced, but the LED wall cannot fill the entire background and visual artifacts appear at the borders

Engineering Contradiction:
ImprovecostVSAvoidLED wall area
Core Design Contradiction:
Ease of manufactureVSArea of stationary object

Solution Approach 1:

The patent applies local quality by determining viewing angles for different regions of the LED wall and applying region-specific brightness and color adjustments. This allows each local area to be optimized for its specific viewing conditions, ensuring seamless integration with virtual content even when the LED wall is smaller and viewed from various angles.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamics by continuously adjusting the appearance of LED wall pixels based on real-time camera viewing angle data. The control system dynamically modifies brightness and color properties of individual pixels or regions to compensate for angular viewing effects, maintaining visual consistency as the camera moves.

Inventive Principle:
Principle #15Dynamics

2Area of stationary object

If the LED wall is viewed from different angles, then the coverage area increases, but brightness and color vary causing visual artifacts

Engineering Contradiction:
Improvecoverage areaVSAvoidbrightness and color consistency
Core Design Contradiction:
Area of stationary objectVSStability of the object's composition

Solution Approach 1:

The patent applies parameter changes by systematically adjusting brightness and color parameters of LED wall pixels based on their viewing angles. The control system modifies these parameters in real-time to compensate for angular dependencies, ensuring that the LED wall appearance remains stable and consistent across different viewing positions.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements feedback by using camera tracking data to determine viewing angles and feeding this information back to the LED wall control system. This closed-loop approach allows the system to continuously adapt the LED wall appearance based on the actual camera position and orientation.

Inventive Principle:
Principle #23Feedback

3Reliability

If chroma keying with excessive tolerance is used to ensure all background areas are selected, then no green artifacts remain, but real image content is inadvertently removed

Engineering Contradiction:
Improvebackground selection completenessVSAvoidimage content loss
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent applies local quality by determining viewing angles for different regions of the LED wall and applying region-specific brightness and color adjustments. This allows each local area to be optimized for its specific viewing conditions, ensuring seamless integration with virtual content even when the LED wall is smaller and viewed from various angles.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamics by continuously adjusting the appearance of LED wall pixels based on real-time camera viewing angle data. The control system dynamically modifies brightness and color properties of individual pixels or regions to compensate for angular viewing effects, maintaining visual consistency as the camera moves.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4345805A1Methods and systems for controlling the appearance of a LED wall and for creating digitally augmented camera images
Publication Date: 2024.04.03 GALIJASEVIC SENAD
  • EP4345805A1 patent drawingFigure 1~2
  • EP4345805A1 patent drawingFigure 3~4b
  • EP4345805A1 patent drawingFigure 5a~5c

AI summary

The present invention proposes a method, preferably computer-implemented method, for controlling the appearance of a LED wall 11 dependent on a viewing angle of a camera 2 relative to the LED wall 11, the method comprising: determining a LED wall viewing angle α, αh, αv of the camera 2 relative to the LED wall 11; and adjusting the appearance of the LED wall 11 based on the determined LED wall viewing angle α, αh, αv. Furthermore, a method for creating digitally augmented camera images based on input images containing image data of a LED wall 11 captured with a camera 2 and a control system for controlling the appearance of a LED wall 11 dependent on a viewing angle of a camera 2 relative to the LED wall 11 are proposed.