A method, apparatus, device and medium for correcting pixel data

By correcting pixel data, quantum efficiency and correction coefficients are used to correct the inconsistency of duty cycle in TOF ranging, thereby improving the accuracy and precision of ranging.

CN116859402BActive Publication Date: 2026-11-17NINGBO ABAX SENSING ELECTRONICS TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210313054.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-28
Publication Date
2026-11-17
Estimated Expiration
2042-03-28

AI Technical Summary

Technical Problem

In Time-of-Flight (TOF) ranging technology, the inconsistent duty cycles of received signals in different phases lead to a decrease in ranging accuracy.

Method used

By obtaining the number of photons and photogenerated electrons for each pixel, the quantum efficiency is calculated, and the correction coefficient and background correction value are obtained. The pixel data is then corrected to eliminate the influence of inconsistent duty cycles.

Benefits of technology

It improves the accuracy of distance measurement, reduces distance measurement error, and enhances the precision of distance measurement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116859402B_ABST
    Figure CN116859402B_ABST
Patent Text Reader

Abstract

This application provides a pixel data correction method, characterized by including at least the following steps: obtaining the quantum efficiency of each pixel by the number of photons and the number of photogenerated electrons; obtaining a correction coefficient by the mode of the quantum efficiency and the quantum efficiency; obtaining a background correction value by the correction coefficient and the background electron count of the pixel; and obtaining a correction value by the correction coefficient and the background correction value. This invention can correct the problem of reduced ranging accuracy caused by inconsistent duty cycles during ranging, thereby improving ranging accuracy.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of detection technology, and in particular to a method, apparatus, device and medium for correcting pixel data. Background Technology

[0002] Time-of-flight (TOF) technology has been developed as a method for measuring the distance to objects in a scene. This TOF technology can be applied to various fields, such as the automotive industry, human-machine interfaces, gaming, robotics, and security. Generally, TOF technology works by illuminating a scene with modulated light emitted from a light source and observing the reflected light from objects in the scene. In existing detection systems, to ensure higher detection efficiency and a wider field of view, an array-type receiver module is commonly used. This module can contain tens of thousands of pixels, each of which can be a diode of type CCD or CMOS, etc. However, this is not limited to using only these two types of diodes to form the array-type receiver module.

[0003] To obtain distance information, indirect time-of-flight (TOF) detection first obtains the delay information of the emitted and returned light, thus obtaining the delayed phase, or phase shift. This phase shift is then converted into the final result information. This method converts the distance information of the detected object into the phase shift of the emitted and returned light, rather than directly providing the distance result; this scheme is called Indirect Time-of-Flight (ITOF). In practical applications, complementary phase can be used to receive the returned light signal to obtain distance information; this method is called a two-phase scheme. There are also schemes using four phases (0°, 90°, 180°, and 270°) to obtain the target distance. Some literature has also attempted three-phase or even five-phase schemes to obtain the distance of the detected object. The phase-shifted electrical signal needs to be processed by a processing unit to obtain the final distance information. However, in multi-phase reception, the ideal received waveforms of different phases should be square waves with the same duty cycle. But due to design factors or signal instability, the duty cycles of the square wave waveforms of the received signals of different phases are inconsistent, which affects the accuracy of detection. Eliminating the inconsistency of the duty cycles of the square wave waveforms of the received signals of different phases is a technical problem that urgently needs to be solved. Summary of the Invention

[0004] The purpose of this application is to address the shortcomings of the prior art by providing a pixel data correction method, apparatus, device, and medium to correct the problem of reduced ranging accuracy caused by inconsistent duty cycles during ranging, thereby improving ranging accuracy.

[0005] To achieve the above objectives, the technical solutions adopted in the embodiments of this application are as follows:

[0006] This application provides a first aspect of a pixel data correction method, characterized by comprising at least the following steps:

[0007] The quantum efficiency of each pixel is obtained by measuring the number of photons and photogenerated electrons per pixel.

[0008] The correction coefficient is obtained by using the mode of the quantum efficiency and the quantum efficiency.

[0009] The background correction value is obtained by using the correction coefficient and the background electron count of the pixel;

[0010] The correction value is obtained by comparing the correction coefficient with the background correction value.

[0011] Optionally, the quantum efficiency, the correction coefficient, and the correction value correspond to different phase differences.

[0012] Optionally, the correction coefficient is the ratio of the mode of the quantum efficiency to the quantum efficiency.

[0013] Optionally, the background electron number is obtained by converting the electron value under no-light conditions into the quantized output value of the ADC.

[0014] Optionally, the background correction value is obtained by multiplying the correction coefficient by the background electron number.

[0015] Optionally, the correction value is obtained by multiplying the number of electrons in the pixel by the system and then subtracting the background correction value.

[0016] Optionally, the light received by the pixel is uniform light that has not passed through the lens.

[0017] A second aspect of this application provides a pixel data correction system, characterized in that it includes: a light source emitting module for emitting uniform probe light; a pixel receiving unit for receiving uniform probe light that has not passed through a lens; and a data processing unit for processing and correcting the signals received by the pixel unit.

[0018] A third aspect of this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, characterized in that the processor executes the computer program to implement the steps of the pixel data correction method according to any one of claims 1 to 7.

[0019] The beneficial effects of this application are:

[0020] This application provides a pixel data correction method, characterized by including at least the following steps:

[0021] The quantum efficiency of each pixel is obtained by measuring the number of photons and photogenerated electrons per pixel.

[0022] The correction coefficient is obtained by using the mode of the quantum efficiency and the quantum efficiency.

[0023] The background correction value is obtained by using the correction coefficient and the background electron count of the pixel;

[0024] By obtaining the correction value through the correction coefficient and the background correction value, the solution of the present invention can correct the problem of reduced ranging accuracy caused by inconsistent duty cycles during ranging, thereby improving ranging accuracy. Attached Figure Description

[0025] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0026] Figure 1 A schematic diagram illustrating the working principle of a detection system based on existing technology;

[0027] Figure 2 This diagram illustrates a scenario where the transmitted wave is a square wave.

[0028] Figure 3 This is a schematic diagram of a four-phase receiver provided in an embodiment of this application.

[0029] Figure 4 A schematic diagram of ranging error under inconsistent duty cycles is provided for an embodiment of this application;

[0030] Figure 5 A schematic diagram illustrating the ratio of the number of electrons received with different phase duty cycles, provided in an embodiment of this application;

[0031] Figure 6 A schematic diagram of a corrected ranging error provided in an embodiment of this application;

[0032] Figure 7 This is a schematic diagram of a duty cycle correction process provided in an embodiment of this application. Detailed Implementation

[0033] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0034] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0035] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0036] The current detection systems generally include a light emitting module, a processing module, and a light receiving module. Taking ITOF ranging as an example, the light emitting module includes, but is not limited to, semiconductor lasers, solid-state lasers, and other types of lasers. When using a semiconductor laser as the light source, a vertical-cavity surface-emitting laser (VCSEL) or an edge-emitting semiconductor laser (EEL) can be used. This is only an example and not a specific limitation. The light emitting module emits sine waves, square waves, triangular waves, etc. In ranging applications, lasers with a certain wavelength are often used, such as 950nm infrared lasers (ideally near-infrared lasers). The emitted light is projected into the field of view. The object being detected within the field of view can reflect the projected laser, forming a return light. The return light enters the detection system and is captured by the light receiving module. The light receiving module may include a photoelectric conversion unit, such as a CMOS sensor. An array-type sensor composed of CCDs, etc., can also contain multiple lenses to form more than one image plane. That is, the receiving module contains more than one image plane. The photoelectric conversion unit of the receiving module is located at one of these image planes. It can receive signals with delays of 0°, 90°, 180°, and 270° using the most common four-phase scheme. The distance calculation scheme using four phases is illustrated here using a sine wave method as an example. The amplitude of the received signal is measured at four equidistant points (e.g., 90° or 1 / 4λ intervals).

[0037]

[0038] The ratio of the difference between A1 and A3 to the difference between A2 and A4 is equal to the tangent of the phase angle. ArcTan is actually a bivariate arctangent function that can be mapped to the appropriate quadrant, defined as 0° or 180° when A2 = A4 and A1 > A3 or A3 > A1, respectively.

[0039] The distance to the target object is determined by the following formula:

[0040]

[0041] At this point, it is necessary to determine the frequency of the emitted laser to perform distance calculation, where c is the speed of light, φ is the phase angle (measured in radians), and f is the modulation frequency. The above scheme can achieve distance detection of objects within the field of view. This scheme is called the four-phase delay scheme for obtaining detection results. Of course, the receiving module converts photoelectric signals to generate different information. In some cases, a two-phase scheme of 0° and 180° is also used to acquire information about the detected object. Some literature discloses a three-phase scheme of 0°, 120°, and 240° to obtain target information, and some literature even discloses a five-phase difference delay scheme. This invention is not specifically limited to this. In actual measurements, square waves are also used for detection. The mechanism is similar to that of sine waves, only the calculation formula is different, which will not be elaborated here.

[0042] Figure 2 This diagram illustrates a square wave emitted by a detection system. Different regions indicate different colors of the emitted light. In practice, the emitted light can be either uniform or non-uniform; this is not limited. However, the wavelength variation of the emitted light used in practice is small and does not manifest as a color difference. Furthermore, the emitted light used in practice is infrared laser, which is safer for the human eye, with a wavelength range of 900nm–1000nm (this is not limited). The emitted light is reflected by the object being detected, thus forming reflected light. Figure 2 The phase shifts of the emitted light (1) and the returned light (2) are given, which actually represent the distance-related time-of-flight phase shift. As long as the phase shift can be obtained, the distance information can be obtained.

[0043] Figure 3 This is a schematic diagram of a four-phase receiver provided in an embodiment of this application. Figure 3 As shown, 301 is a schematic diagram of the emitted detection light signal, 302 is the echo signal reflected back from the detected object, 303 is the received signal with a phase difference of 0° from the detection signal 302, 304 is the received signal with a phase difference of 180° from the detection signal 302, 305 is the received signal with a phase difference of 90° from the detection signal 302, and 306 is the received signal with a phase difference of 270° from the detection signal 302. The four-phase received signals are arranged as follows... Figure 2The method of the illustrated embodiment measures the distance to the object being detected. However, due to factors such as circuitry and temperature, the duty cycles of the four-phase received signals may differ, resulting in the inability to eliminate background light and further reducing the ranging accuracy. Therefore, a technique is urgently needed to solve the problem of different duty cycles in the four-phase received signals in order to improve ranging accuracy. Three-phase and five-phase difference schemes are similar, and this invention is not specifically limited to these methods.

[0044] Figure 4 This is a schematic diagram illustrating ranging error under inconsistent duty cycles, provided as an embodiment of this application. Figure 4 It can be seen that when the duty cycles of the received waveforms are inconsistent, the accuracy difference between the actual distance and the measured distance can be as high as 80%. This shows that the ranging error caused by inconsistent duty cycles is quite serious, so a solution is urgently needed to address this problem.

[0045] Figure 5 This is a schematic diagram illustrating the ratio of the number of electrons received with different phase duty cycles, provided as an embodiment of this application. Figure 5 In the illustrated embodiment, four-phase signals are used to receive echo signals, and the number of photogenerated electrons in each phase is obtained by integration. Figure 5 The figures show the ratios of a phase difference of 0° to those of phase differences of 90°, 180°, and 270°. When the duty cycle of the square wave is the same for different phase differences, the ratio should be 1. However, from... Figure 5 It can be seen that the ratio of the number of photogenerated electrons obtained by integrating different phase differences fluctuates greatly due to the inconsistency of duty cycle. Therefore, a solution is urgently needed to solve the problem of inconsistent duty cycle.

[0046] In this embodiment of the invention, the following method is used to solve the problem of inconsistent duty cycles. First, under uniform light conditions, the integration time is traversed, and four phases are used to receive photogenerated electrons, requiring that the number of electrons in each of the four phases cannot be saturated. A curve is plotted, where the horizontal axis represents the number of photons and the vertical axis represents the number of photogenerated electrons received by the four phases. The slope of the curve should be the quantum efficiency. Under the condition that the duty cycles of the four phases are consistent, the slope should be fixed. However, due to the problem of inconsistent duty cycles, the slope of the plotted curve is not fixed. Therefore, it is necessary to fit the plotted curve based on the received data. This embodiment uses the following method to linearly fit the slope of the curve: First, the quantum efficiencies η0 and η1 of each pixel in the pixel region are recorded. 90 η 180 η 270 The values ​​of η0 and η are calculated for each pixel in the pixel region. 90 η 180 η 270 The mode η. Using η / η0 = k0,

[0047] η / η90 =k 90 η / η 180 =k 180 η / η 270 =k 270 The coefficients k0 and k were obtained respectively. 90 k 180 k 270 Where k0 and k 90 k 180 k 270 These are the correction coefficients for the curves with phase differences of 0°, 90°, 180°, and 270°, respectively. The intercept in the linear fitting is the background electron count (electron value under no-light conditions). The background electron count is converted into background DN (quantized value of ADC output) values ​​b0 and b... 90 b 180 b 270 Then, multiply by k0 and k respectively. 90 k 180 k 270 We get B0 and B 90 B 180 B 270 The number of electrons in the four phases obtained by integration is multiplied by k0 and k, respectively. 90 k 180 k 270 Subtract B0 and B respectively 90 B 180 B 270 This completes the correction process for inconsistent duty cycles.

[0048] Figure 6 This is a schematic diagram of a corrected ranging error provided in an embodiment of this application. Figure 6 As can be seen, after correcting the duty cycle inconsistency problem using the method described in the above embodiments, the ranging accuracy has been greatly improved, and the ranging error problem caused by the duty cycle inconsistency has been solved.

[0049] Figure 7 This is a schematic diagram illustrating a duty cycle correction process provided in an embodiment of this application. Figure 7 The illustrated embodiment includes the following steps:

[0050] S701: Sensor chip without a lens. The reason for not installing a lens is to ensure that the light received by each pixel is uniform.

[0051] S702: A uniform light source with constant optical power, recording its optical power density; converting optical power density and integration time into photon number.

[0052] S703: Traverse the sensor integration time, acquire t integration times, demodulate φ phase image data (LSBs); convert the image data (LSBs) into photogenerated electrons.

[0053] S704: For each pixel, plot φ curves of photon count and photogenerated electron count. After linear fitting, the slope of the curve is the quantum efficiency η, and the intercept is the background electron count e. Convert the background electron count into background image data (LSB).

[0054] S705: Calculate the mode η0 of the quantum efficiency of each pixel, and store φ K values ​​for each pixel. Φ =η0 / η Φ And B Φ =K Φ *LSB Φ。

[0055] S706: The image data obtained from each pixel is linearly corrected using K... Φ and B Φ Then, the calibration is complete.

[0056] It should be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0057] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application. It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need further definition and explanation in subsequent figures. The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for correcting pixel data, characterized in that, It should include at least the following steps: A uniform probe light with constant optical power is applied to an image sensor without a lens. By traversing multiple integration times of the image sensor, pixel image data under different demodulation phase differences are acquired; Each pixel image data is converted into the number of photogenerated electrons. For each pixel, a photon number-photogenerated electron number curve is plotted under different demodulation phase differences and linearly fitted to obtain the quantum efficiency and the background electron number. The quantum efficiency is the slope of the linearly fitted photon number-photogenerated electron number curve, and the background electron number is the intercept of the linearly fitted photon number-photogenerated electron number curve. The quantum efficiency corresponding to all pixels and all phase differences of the image sensor is statistically analyzed, and the mode of quantum efficiency is determined. The correction coefficient is calculated pixel by pixel and phase difference by phase difference, and the correction coefficient is the ratio of the mode of the quantum efficiency to the quantum efficiency. The background electron count under no-light conditions is converted into an ADC quantization value, and the background correction value is calculated. The correction value of a pixel is calculated based on the correction coefficient, the background correction value, and the number of electrons in the pixel. The correction value of a pixel is obtained by multiplying the number of electrons in the pixel by the correction coefficient and subtracting the background correction value.

2. The pixel data correction method as described in claim 1, characterized in that, The background correction value is obtained by multiplying the correction coefficient by the background electron number.

3. A pixel data correction system, characterized in that, include: The light source emitting module is used to emit uniform probe light; A pixel receiving unit is used to receive uniform probe light that has not passed through the lens; A data processing unit is used to process and use the correction method for pixel data as described in any one of claims 1-2 to correct the signal received by the pixel receiving unit.

4. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the pixel data correction method according to any one of claims 1 to 2.

5. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the pixel data correction method according to any one of claims 1 to 2.

Citation Information

Patent Citations

  • Method and device for correcting afterpulses of laser radar signals

    CN106842168A

  • Detection method for acquiring distance information

    CN114035197A

  • System and method of generating color correction matrix for an image sensor

    TW201102965A