Structured-Light Depth Imaging for Black Border Elimination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional depth images often suffer from black borders due to the absence of corresponding pixels at the image borders, which affects their application in fields like face authentication, leading to authentication failures and reduced field of view.

Innovation Solution

The method utilizes both first and second active pixels of an image sensor to generate a reference image, increasing its dimension and ensuring corresponding pixels are available for border regions, thereby eliminating or reducing black borders in the depth image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If only first active pixels are used to generate the reference image, then the device complexity is reduced, but black borders appear in the depth image due to insufficient pixel coverage at the image borders

Engineering Contradiction:
Improvedepth image qualityVSAvoidpixel utilization complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent utilizes a second set of active pixels (second active pixels) in addition to the first set, effectively adding another dimension of pixel coverage. This allows the reference image to have extended pixel coverage at the borders, enabling corresponding pixels to be found for target image pixels at the borders, thereby eliminating black borders in the depth image without requiring hardware changes.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If the reference image dimension is increased to cover border pixels, then the field of view is improved, but the device complexity increases due to additional pixel requirements

Engineering Contradiction:
Improvereference image dimensionVSAvoidimage sensor complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent employs second active pixels that are spatially arranged differently from the first active pixels, creating an extended pixel array that covers border regions. This dimensional extension allows the reference image to encompass a larger area without requiring a complete redesign of the image sensor, thus increasing the effective field of view while maintaining device feasibility.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The image sensor's active pixels are divided into two distinct sets: first active pixels for standard imaging and second active pixels for extended border coverage. This segmentation allows each set to serve specific functions, with the second set specifically addressing the border coverage issue, thereby increasing reference image dimension without overwhelming device complexity.

Inventive Principle:
Principle #1Segmentation

3Reliability

If second active pixels are used to generate the reference image, then black borders are reduced or eliminated, but the processing complexity increases

Engineering Contradiction:
Improveauthentication reliabilityVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

By incorporating second active pixels that provide extended spatial coverage, the patent ensures that border pixels in the target image have corresponding pixels in the reference image. This dimensional extension eliminates the need for complex post-processing to handle black borders, as the corresponding pixel relationships are established during image acquisition, thereby improving authentication reliability without excessive processing complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the field of view and improves the reliability of depth image applications by eliminating black borders, optimizing user experience and reducing authentication failures.

Implementation Method 1

imaging the target object through the first active pixel to obtain a target image; and obtaining the depth image of the target object according to the target image and the reference image

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentEP4033757B1Depth image generation method and apparatus, reference image generation method and apparatus, electronic device, and computer readable storage medium
Publication Date: 2026.04.22 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • EP4033757B1 patent drawingFigure 1~2
  • EP4033757B1 patent drawingFigure 3~4
  • EP4033757B1 patent drawingFigure 5

AI summary

The present application relates to the technical field of depth imaging, and provides a depth image generation method and apparatus, a reference image generation method, and an electronic device. The depth image generation method comprises: emitting structured light to a reference plane, and imaging the reference plane by using a first effective pixel and a second effective pixel of an image sensor so as to obtain a reference image; emitting structured light to a target object, and imaging the target object by using the first effective pixel so as to obtain a target image; and obtaining a depth image of the target object according to the target image and the reference image. The present application can reduce to a certain extent or prevent a black border in a depth image.