A pixel array
By introducing a macro-pixel structure and a threshold determination mechanism into the pixel array, the problem of pixel array susceptibility to interference is solved, and the identification of effective signals and optimization of system power consumption are achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-09
- Publication Date
- 2026-03-20
AI Technical Summary
The pixel array in the existing detection system is susceptible to interference from factors such as sunlight and dark current, which leads to a decrease in the effective signal resolution capability. There is an urgent need to improve its resistance to random interference.
A macro-pixel structure is adopted, and valid triggers are identified by setting thresholds P and E. Combined with subsequent storage and processing units, the dynamic power consumption of the system is reduced.
Effective identification of valid signals improves the pixel array's resistance to random interference and reduces system dynamic power consumption.
Smart Images

Figure CN116609769B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of detection, in particular to a pixel array. BACKGROUND
[0002] As a method for measuring the distance from an object in a scene, time-of-flight (TOF) technology has been developed. This TOF technology can be applied in various fields, such as the automotive industry, human-machine interface, gaming, robotics, and security, etc. Generally speaking, the working principle of TOF technology is to use a light source to emit modulated light to illuminate a scene, and to observe the reflected light reflected by objects in the scene. In order to ensure that a higher detection efficiency can be obtained during the detection process and also ensure that the detection system has a wider field of view, an array type receiving module is currently more commonly used in existing detection systems. The array type receiving module can have thousands of pixel units, each of which can be a charge-coupled semiconductor (CCD) or a complementary metal-oxide-semiconductor (CMOS) type diode. Here, it is not limited to only these two types of diodes to form the array type receiving module.
[0003] The detection array is composed of thousands of pixel units. During the detection process, factors such as sunlight and dark current can cause random interference between pixels. If the pixel array receives a trigger caused by an effective signal, there is a high probability that spatially adjacent pixels will be triggered at the same time. If the pixel array receives a trigger caused by factors such as sunlight and dark current, the probability of adjacent pixels being triggered at the same time is lower. The performance of the pixel array against random interference directly affects its ability to distinguish effective signals. Therefore, it is urgent to propose a convenient and effective ability to identify effective signals to improve the performance of the pixel array against random interference. SUMMARY
[0004] The present application aims to provide a pixel array that can conveniently and effectively identify effective signals to improve the performance of the pixel array against random interference, in view of the deficiencies in the prior art.
[0005] To achieve the above object, the technical solutions adopted by the embodiments of the present application are as follows:
[0006] The embodiments of the present application provide a pixel array, characterized in that the pixel array includes X pixel units in the horizontal direction and Y pixel units in the vertical direction; and the pixel array includes:
[0007] a macro-pixel, which includes M pixel units in the horizontal direction and N pixel units in the vertical direction; wherein 1≤M≤X; 1≤N≤Y, and X, Y, M, and N are positive integers greater than or equal to 1.
[0008] Optionally, the macro-pixel includes a center macro-pixel and a neighboring macro-pixel.
[0009] Optionally, the number of triggered pixel units in the macro-pixel is Q, and a threshold P is preset, and when the threshold P meets a preset condition, the trigger is considered as an effective trigger.
[0010] Optionally, the preset threshold P is an arbitrary sequence value of a group of continuous times.
[0011] Optionally, the threshold P at each moment is determined by a method of addressing in a sequence.
[0012] Optionally, the total number of effective signals in the continuous time is G, the total number of signals of the center macro-pixel and the adjacent macro-pixel triggered at the same time is F, a threshold E is preset, and when the threshold E meets a preset condition, the trigger of the center macro-pixel is considered as an effective trigger.
[0013] Optionally, the threshold E is set according to an application scenario.
[0014] Optionally, when the trigger is an effective trigger, a subsequent storage and operation unit is started.
[0015] Optionally, the pixel array is a two-dimensional single-layer planar non-rectangular pixel.
[0016] Optionally, the pixel array is a three-dimensional multi-layer pixel array.
[0017] The beneficial effects of the present application are:
[0018] The pixel array provided by the embodiment of the present application has the characteristics that the pixel array includes X pixel units in the horizontal direction and Y pixel units in the vertical direction, and the pixel array includes:
[0019] a macro-pixel, which includes M pixel units in the horizontal direction and N pixel units in the vertical direction; wherein 1≤M≤X; 1≤N≤Y, and X, Y, M, and N are positive integers greater than or equal to 1, and the scheme of the present application can conveniently and effectively identify effective signals to improve the performance of the pixel array against random interference. BRIEF DESCRIPTION OF DRAWINGS
[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as a limitation on the scope, and for those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.
[0021] Figure 1 A schematic diagram of an array type receiving module provided by the embodiment of the present application is shown in the figure.
[0022] Figure 2 A pixel array schematic diagram provided for an embodiment of the present application;
[0023] Figure 3 A pixel array schematic diagram provided for an embodiment of the present application, in which a macro-pixel is 1*1;
[0024] Figure 4 A pixel array schematic diagram provided for an embodiment of the present application, in which a macro-pixel is 4*4;
[0025] Figure 5 A pixel array schematic diagram provided for an embodiment of the present application, in which a macro-pixel is 3840*3;
[0026] Figure 6 A pixel array schematic diagram provided for an embodiment of the present application, in which a macro-pixel is 3*4320;
[0027] Figure 7 Another pixel array schematic diagram provided for an embodiment of the present application;
[0028] Figure 8 A single-layer spherical pixel array schematic diagram provided for an embodiment of the present application;
[0029] Figure 9 A three-dimensional multi-layer pixel array schematic diagram provided for an embodiment of the present application. DETAILED DESCRIPTION
[0030] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. The components of the embodiments of the present application described and shown in the drawings herein can be arranged and designed in various different configurations.
[0031] Therefore, the detailed description of the embodiments of the present application provided below in the drawings is not intended to limit the scope of the claimed present application, but only represents selected embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative labor are within the scope of protection of the present application.
[0032] It should be noted that: similar reference numerals and letters represent similar items in the following drawings, therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.
[0033] The current detection system basically includes: light source module, processing module, and light receiving module, the light source module includes but is not limited to semiconductor laser, solid laser, and can also include other types of lasers, when the semiconductor laser is used as the light source, the vertical cavity surface emitting laser VCSEL (Vertical-cavity surface-emitting laser) or edge-emitting semiconductor laser EEL (edge-emitting laser) can be used, which is only exemplary and not specifically limited, the light source module emits sine wave or square wave or triangular wave, or pulse wave, etc., in the distance measurement application, it is mostly laser with a certain wavelength, such as 950nm infrared laser (optimally near-infrared laser), the emitted light is projected into the field of view, the detected object existing in the field of view can reflect the projected laser to form return light, the return light enters the detection system and is captured by the light receiving module, the light receiving module can include a photoelectric conversion part, such as an array sensor composed of CMOS, CCD, etc., and can also include multiple lenses that can form more than one image plane, that is, the receiving module includes more than one image plane, and the photoelectric conversion part of the receiving module is located at one of the image planes.
[0034] The receiving module can use an array type receiving module as shown in Figure 1 The array type receiving module includes a pixel unit composed of diodes, in actual implementation, M*N pixel units can be used to form the active area of the array type receiving module, and the pixel units can be in the order of tens of thousands, hundreds of thousands, or even hundreds of thousands, etc., which is not limited here, the array type receiving module can include a lens part 101 and a detection unit substrate part, the lens part includes multiple lens units, which can be composed of microlens units with a predetermined curvature, of course, in order to maximize the use of return light, the lens part can also include more than one layer of structure, which is not limited to the specific implementation scheme, in a more optimal case, the substrate part can be arranged at the focal plane position corresponding to the lens part, which can ensure that the detection pixel unit can maximize the acquisition of accurate return light information, in this case, the lens of the lens part can construct a light channel, so that the signal received by the photosensitive part of the detection unit is near the corresponding focal point position, the detection unit substrate part includes an array type arranged photosensitive pixel array, the photosensitive pixel can be formed by doping on the semiconductor substrate part to form a CCD or CMOS type photosensitive unit, and the semiconductor substrate part can also include all analog signal processing circuits used in pixel unit reading, pixel level control circuit, analog-to-digital conversion circuit (ADC), etc., in the positional relationship between the circuit and the photosensitive unit, the front illumination process of arranging the circuit layer upstream of the photosensitive unit in the return light propagation direction, or the back illumination process of arranging the circuit layer downstream of the photosensitive unit in the return light propagation direction can be used, which is not limited to the specific implementation.
[0035] Figure 2 A schematic diagram of a pixel array provided for an embodiment of this application; as shown Figure 2 The pixel array shown consists of X*Y pixel units 201. X represents the number of pixel units in the horizontal direction, and Y represents the number of pixel units in the vertical direction. Figure 2 The pixel array shown defines a macro-pixel matrix A consisting of M×N pixel units, where M is the number of macro-pixel units A in the horizontal direction and N is the number of macro-pixel units A in the vertical direction, where 1≤M≤X; 1≤N≤Y, and X, Y, M, and N are all positive integers greater than or equal to 1.
[0036] exist Figure 2 In the embodiment shown, macro pixels spatially adjacent to macro pixel A are defined, such as... Figure 2 Macro-pixels A1 and A2 shown are neighboring macro-pixels of macro-pixel A. Macro-pixel A and its neighboring macro-pixels A1 and A2 form set B. Figure 2 The neighboring macropixels A1 and A2 are for illustrative purposes only. The neighboring macropixels of macropixel A are not limited to A1 and A2. A macropixel can be defined as having at least one pixel unit adjacent to any pixel unit in macropixel A. Depending on the specific scenario requirements, a macropixel can also be defined as having no pixel units adjacent to any pixel unit in macropixel A. No specific restrictions are imposed here.
[0037] In set B, macropixel A is defined as the central macropixel of set S. At any given moment, the sum of the number of pixel units triggered within a macropixel is Q. When 0 ≤ P ≤ Q, the macropixel is considered to be triggered by a valid signal; otherwise, it is considered to be triggered by invalid signals such as sunlight or dark current, and is not treated as a valid trigger, thereby improving the anti-interference performance of pixel units. For example, in... Figure 2 In the illustrated embodiment, a macro pixel is defined as comprising 4*2=8 pixel units, and the value of P can be preset to 6. Figure 2 In a macropixel, if the number of triggered pixel units is greater than or equal to 6, the macropixel is considered to be effectively triggered. For example, in... Figure 3 A macropixel is considered to be validly triggered if the triggered pixel unit is 6, 7, or 8 (that is, Q is 6, 7, or 8).
[0038] Set P as a sequence of values in a continuous total time [0, T], the sequence values are arbitrary and fixed, and the threshold value determined at each time is addressed according to the time address in the sequence. For example, P is a function of temperature change, and P corresponds to the change due to temperature change in continuous time. For example, the macro-pixel is 3*3, and P is [1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 3, 3, 3, 4, 4, …, 8, 9].
[0039] The continuous total time is defined as [0, T]. A continuous time is defined as [0, S], S and T are time boundary moments, and 0≤S≤T. The total number of valid signals in the continuous time [0, S] is defined as G, the total number of signals triggered simultaneously by the center macro-pixel A and a certain adjacent macro-pixel in the set B in the continuous time [0, S] is defined as F, and 0≤F≤G. When 0≤E≤F≤G, the center macro-pixel A in the set is determined as valid signal triggering in the continuous time [0, S], otherwise it is determined as random interference triggering. When a certain adjacent macro-pixel of the center macro-pixel A in the set B is abnormal, the other adjacent macro-pixels of the center macro-pixel A in the set B can be referred to. The continuous time boundary S moment and the threshold value E can be set according to the actual situation, as long as the sample in the continuous time [0, S] is sufficient to determine that the macro-pixel A is valid signal triggering or random interference triggering.
[0040] In the case that the macro-pixel A and a certain adjacent macro-pixel are triggered simultaneously in the continuous time sequence [10ps, 20ps, 30ps, 40ps, 50ps, …, 990ps, 1ns], the triggering situation is [trigger, trigger, trigger, no trigger, trigger, …, no trigger, trigger], the total number of simultaneous triggering is 95 times, and the threshold value E is set as 90 times, then the macro-pixel A is determined as valid signal triggering in the continuous time [0, 1ns].
[0041] In the case that the macro-pixel A and a certain adjacent macro-pixel are triggered simultaneously in the continuous time sequence [1ps, 2ps, 3ps, 4ps, 5ps, …, 49ps, 50ps], the triggering situation is [trigger, no trigger, no trigger, no trigger, trigger, …, no trigger, trigger], the total number of simultaneous triggering is 6 times, and the threshold value E is set as 45 times, then the macro-pixel A is determined as random interference triggering in the continuous time [0, 50ps].
[0042] After the determination in the continuous time [0, S0] is completed, the determination in the next continuous time [S0, S1] (0≤S0≤S1≤T) can be started, and so on.
[0043] After the determination in the continuous time [0, S0] is completed, a period of time [S0, S1] can be interrupted, and the boundary S1 moment of the next continuous time [S1, S2] (0≤S0≤S1≤S2≤T) can be set according to the application scenario, and so on.
[0044] When the macro-pixel A is determined as a valid signal trigger in the continuous time [0, S], 0≤S≤T, the subsequent storage and operation unit is started, and when it is determined as a random interference trigger, the subsequent storage and operation unit is in an idle state. Therefore, the subsequent storage and operation unit is not always in a working state in the continuous total time [0, T], thereby reducing the dynamic power consumption of the system.
[0045] Figure 3 A macro-pixel provided for an embodiment of the present application is a pixel array of 1*1. As shown in the figure, Figure 3 The pixel array is composed of 960*540 pixel units 301. Among them, 960 is the number of pixel units in the horizontal direction, and 540 is the number of pixel units in the vertical direction. In the pixel array shown in the figure, Figure 4 The macro-pixel matrix A is defined in the pixel array shown in the figure and includes 1*1 pixel units. Among them, the number of pixel units of the macro-pixel A in the horizontal direction and the vertical direction is 1.
[0046] Figure 4 A macro-pixel provided for an embodiment of the present application is a pixel array of 1*1. As shown in the figure, Figure 4 The pixel array is composed of 1920*1080 pixel units 401. Among them, 1920 is the number of pixel units in the horizontal direction, and 1080 is the number of pixel units in the vertical direction. In the pixel array shown in the figure, Figure 5 The macro-pixel matrix A is defined in the pixel array shown in the figure and includes 4*4 pixel units. Among them, the number of pixel units of the macro-pixel A in the horizontal direction and the vertical direction is 4.
[0047] Figure 5 A macro-pixel provided for an embodiment of the present application is a pixel array of 3840*3. As shown in the figure, Figure 5 The pixel array is composed of 3840*2160 pixel units 501. Among them, 3840 is the number of pixel units in the horizontal direction, and 2160 is the number of pixel units in the vertical direction. In the pixel array shown in the figure, Figure 5 The macro-pixel matrix A is defined in the pixel array shown in the figure and includes 3840*3 pixel units. Among them, the number of pixel units of the macro-pixel A in the horizontal direction is consistent with the number of pixel units of the pixel array in the horizontal direction, which is 3840, and the number of pixel units of the macro-pixel in the vertical direction is 3. Figure 6 In the embodiment shown in the figure, the number of pixel units included in the macro-pixel in the horizontal direction is consistent with the number of pixel units included in the pixel array in the horizontal direction, and the macro-pixel also becomes a row pixel matrix.
[0048] Figure 6 A macro-pixel provided for an embodiment of the present application is a pixel array of 3*4320. As shown in the figure, Figure 6The pixel array shown is composed of 7680*4320 pixel units 601. Among them, 7680 is the number of pixel units in the horizontal direction, and 4320 is the number of pixel units in the vertical direction. Figure 6 The macro-pixel matrix A defined in the pixel array shown includes 3*4320 pixel units, wherein the macro-pixel A includes 3 unit pixels in the horizontal direction; the number of unit pixels in the vertical direction is consistent with the number of unit pixels in the vertical direction of the pixel array, which is 4320. Figure 7 In the embodiment shown, the number of unit pixels included by the macro-pixel in the vertical direction is consistent with the number of unit pixels included by the pixel array in the vertical direction, and the macro-pixel also becomes a column pixel matrix.
[0049] Figure 7 Another macro-pixel array diagram provided for the embodiments of the present application is shown as follows: Figure 7 The pixel array shown is composed of 480*270 pixel units 701. Among them, 480 is the number of pixel units in the horizontal direction, and 270 is the number of pixel units in the vertical direction. Figure 2 The macro-pixel matrix A defined in the pixel array shown includes 480*270 pixel units, wherein the macro-pixel is consistent with the size of the pixel array.
[0050] The method for determining whether the macro-pixel is an effective trigger in the receiving pixel array diagram in the above-described embodiments is similar to that in Figure 8 The determination method in the embodiment shown is similar, so it will not be described in each embodiment.
[0051] When the pixel array is arranged in a two-dimensional single-layer planar non-rectangular shape, such as a triangle, a hexagon, etc.
[0052] When the pixel array is arranged in a two-dimensional single-layer planar polygon or a two-dimensional single-layer planar circular shape, a two-dimensional single-layer planar non-rectangular macro-pixel can be defined, each macro-pixel contains a plurality of unit pixels that are spatially adjacent, and the shape of each macro-pixel can not be completely consistent, but can still be processed in a two-dimensional single-layer planar rectangular manner. The pixel array in the above embodiments is arranged in a rectangular shape for illustrative purposes, and is not specifically limited.
[0053] Figure 9 A single-layer spherical pixel array diagram provided for the embodiments of the present application is shown as follows: When the pixel array is arranged in a three-dimensional single-layer curved surface manner, such as a Bayer RGB single-layer sphere, a random Bayer RGB single-layer non-sphere, etc., a three-dimensional single-layer curved surface macro-pixel can be defined, each macro-pixel contains a plurality of unit pixels that are spatially adjacent, and the shape of each macro-pixel can not be completely consistent, but can still be determined as an effective trigger and a random interference trigger in the two-dimensional single-layer planar rectangular manner in the above-described embodiments. The specific process is similar, which will not be described here.
[0054] A three-dimensional multi-layer pixel array schematic diagram provided by the embodiment of the present application, when the pixel array is arranged in a three-dimensional multi-layer manner, such as three-layer RGB rectangular, four-layer RGBT spherical, five-layer RGBTS aspherical, etc., a three-dimensional macro-pixel body can be defined, each macro-pixel body contains a plurality of single pixels that are spatially adjacent, the shape of each macro-pixel body can not be completely consistent, and the effective trigger and random interference trigger can still be determined according to the two-dimensional single-layer planar rectangular manner in the above embodiment, and the specific process is similar, which will not be repeated here.
[0055] It should be noted that the terms "comprising", "containing", or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not only include those elements, but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.
[0056] The above only describes the preferred embodiments of the present application and is not intended to limit the present application. Those skilled in the art can make various modifications and changes to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that similar reference numbers and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. The above only describes the preferred embodiments of the present application and is not intended to limit the present application. Those skilled in the art can make various modifications and changes to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A pixel array, characterized in that, The pixel array comprises X pixel units in the horizontal direction and Y pixel units in the vertical direction; the pixel array includes macro pixels, each macro pixel comprising M pixel units in the horizontal direction and N pixel units in the vertical direction; where 1 ≤ M ≤ X; 1 ≤ N ≤ Y, and X, Y, M, and N are all positive integers greater than or equal to 1; The macro pixels include the central macro pixel and the adjacent macro pixels; The number of triggered pixel units in the macro pixel is Q. A threshold P is preset. The preset threshold P is an arbitrary sequence value of a continuous time. The threshold P at each time step is determined by addressing in the sequence. When Q≥P, the triggering of the macro pixel is initially determined to be a valid trigger. Within a continuous time period, the total number of signals that are simultaneously triggered by the central macropixel and the neighboring macropixels is counted. A threshold E is preset. When the total number of signals is greater than or equal to the threshold E, the triggering of the central macropixel is confirmed as a final valid trigger.
2. The pixel array as described in claim 1, characterized in that, The threshold E is set according to the application scenario.
3. The pixel array as described in claim 1, characterized in that, The trigger is the activation of the subsequent storage and processing unit when the trigger is valid.
4. The pixel array as described in claim 1, characterized in that, The pixel array is a two-dimensional single-layer planar non-rectangular pixel array.
5. The pixel array as described in claim 1, characterized in that, The pixel array is a three-dimensional multi-layer pixel array.
Citation Information
Patent Citations
Opto-electronic sensor and object detection method
EP2708913A1
Device and method for receiving a reflecting light pulse in a lidar system
EP3318895A1