Adaptive Screen Illumination for Better Video Call Facial Lighting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Obtaining good lighting during video conferencing is difficult due to insufficient ambient light, leading to unsatisfactory images with underexposure, overexposure, unnatural hues, or reflections, exacerbated by video compression algorithms.

Innovation Solution

An adaptive content display system adjusts the content rendered on a display device to include a graphical element, such as a ring of light, to direct consistent lighting towards the user, enhancing image quality in various lighting environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If ambient light sensors are used to detect screen content, then facial illumination can be provided, but the sensors cannot accurately distinguish screen content from other light sources

Engineering Contradiction:
Improvefacial illuminationVSAvoidscreen content detection accuracy
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

The patent segments the ambient light spectrum into multiple wavelength bands (e.g., blue, green, red channels) and processes each band separately. By analyzing the spectral composition of light reflected from the screen versus other sources, the system can distinguish screen content characteristics from general ambient lighting, thereby improving measurement precision while maintaining facial illumination capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing layer that analyzes the temporal and spectral characteristics of detected light. This intermediary layer processes raw sensor data to identify patterns specific to screen content (such as refresh rate correlations and spectral signatures) before generating illumination commands, thereby resolving the ambiguity between screen content and other light sources.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If ambient light sensors detect screen content to provide facial illumination, then the effect is limited to devices with such sensors, but devices without ambient light sensors cannot achieve this effect

Engineering Contradiction:
Improvedevice compatibilityVSAvoidfacial illumination effectiveness
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements a universal solution that works across different device types by making the screen itself the illumination source. Instead of relying on external ambient light sensors, the display device uses its own screen to detect content and project reflected light onto the user's face. This approach makes the system universally applicable to all display devices regardless of whether they have dedicated ambient light sensors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The display device serves itself by using its own screen to both display content and provide facial illumination. The screen reflects ambient light in a controlled manner to illuminate the user's face, eliminating the need for separate sensing hardware. This self-service approach ensures reliability across all devices while maintaining adaptability.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If the screen is used as the light source for facial illumination, then device compatibility is improved, but the screen's primary display function may be compromised

Engineering Contradiction:
Improvedevice compatibilityVSAvoiddisplay quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent employs periodic modulation where the screen rapidly alternates between display mode and illumination mode at frequencies imperceptible to humans. During illumination phases, the screen reflects ambient light toward the user's face; during display phases, it shows content normally. This periodic action ensures that display quality is maintained while providing facial illumination, with no visible degradation to the primary display function.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts the screen's behavior based on real-time conditions, switching between display-only mode and dual display-illumination mode. The illumination intensity and timing are continuously optimized to maintain display quality while providing adequate facial lighting, ensuring that manufacturing precision and display quality are preserved.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system improves user illumination, making images appear more natural and satisfactory by compensating for ambient light deficiencies and reducing unwanted reflections.

Implementation Method 1

a projector to project light onto a screen

Methodology Applied
Scientific EffectLight projection: Light

Implementation Method 2

an ambient light sensor to detect light reflected from the screen

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

a controller to control the display device and direct light from a light source toward a user's face

Methodology Applied
Scientific EffectLight direction control: Light

Data Source

PatentEP4292056B1Optimized facial illumination from adaptive screen content
Publication Date: 2026.05.20 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP4292056B1 patent drawingFigure 1A~1B
  • EP4292056B1 patent drawingFigure 2A~2B
  • EP4292056B1 patent drawingFigure 3A~3B

AI summary

Aspects of the present disclosure relate to adjusting an illumination of a user depicted in one or more images when using a video conferencing application. In one example, one or more images depicting the user may be received from an image sensor. Further, an illumination of the user depicted in the one or more images may be determined to be unsatisfactory. For example, the user's face may be too bright or too dim. Accordingly, content displayed at a display device may identified and then modified. The modified content may then be rendered to a display device thereby changing the illumination of the user depicted in subsequent images. In examples, the modified content may include a graphical element, such as a ring of a specific color at least partially surrounding content rendered to and displayed at the display device.