Image Sensor

By setting multiple gain amplifiers on the vertical signal line of the image sensor to make their gain multiples different, the tailing phenomenon of high dynamic range images during high-speed moving objects is solved, and high dynamic range images are achieved in the shortest exposure time The shooting improves the dynamic range of the image.

CN112118403BActive Publication Date: 2024-12-17SHANGHAI JUYOU SMART INTELLIGENCE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201910538766.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-06-20
Publication Date
2024-12-17
Estimated Expiration
2039-06-20

AI Technical Summary

Technical Problem

In the prior art, high dynamic range images are prone to tailing when shooting high-speed moving objects, and it is difficult to complete the shooting in the shortest exposure time.

Method used

An image sensor is designed to generate high dynamic range images in the shortest exposure time by setting multiple gain amplifiers on the vertical signal line and making their gain multiples different to replace different exposure times in traditional multi-frame synthesis methods. .

Benefits of technology

It effectively solves the tailing phenomenon of high-dynamic range images when shooting high-speed moving objects, realizes shooting of high-dynamic range images in the shortest exposure time, and improves the dynamic range of the image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112118403B_ABST
    Figure CN112118403B_ABST
Patent Text Reader

Abstract

The present application discloses an image sensor. The image sensor includes: a pixel array unit, the pixel array unit includes a plurality of sensor pixels; a plurality of vertical signal lines respectively connected to each sensor pixel column of the pixel array unit; and a column processing unit, connected to the plurality of vertical signal lines, for receiving sensor pixel signals generated by sensor pixels of each sensor pixel column through the plurality of vertical signal lines, and outputting the received sensor pixel signals. The image sensor also includes a plurality of gain amplifiers, respectively arranged on each of the vertical signal lines, for amplifying the sensor pixel signals on the vertical signal lines, and the gain values ​​of the plurality of gain amplifiers are different. This solves the technical problem that the method for generating high dynamic range images in the prior art will produce a tailing phenomenon when shooting high-speed moving objects.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of imaging technology, and in particular to an image sensor. Background Art

[0002] High dynamic range images are images with a very wide range of brightness. They store more brightness data than other formats of images, and the way they record brightness is different from traditional images. Instead of compressing brightness information into 8-bit or 16-bit color space in a nonlinear way, they record brightness information in a direct correspondence way. Therefore, high dynamic range images record the real lighting information in the image environment.

[0003] In the prior art, high dynamic range images are generated by using a multi-frame synthesis method. That is, for the same scene, multiple frames of images are generated, and the exposure time of each frame increases successively. Thus, multiple frames of images with successively increasing exposure times are used to synthesize a high dynamic range image.

[0004] However, the conventional method of generating high dynamic range images will produce a tailing phenomenon when photographing objects moving at high speed. Therefore, a method is needed to increase the image dynamic range as much as possible and complete the photographing within the shortest exposure time.

[0005] However, there is still no better solution to the technical problem that the method of generating high dynamic range images in the prior art will produce a tailing phenomenon when photographing objects moving at high speed. Summary of the invention

[0006] The present disclosure provides an image sensor to solve the technical problem that a method for generating a high dynamic range image in the prior art may produce a tailing phenomenon when photographing a high-speed moving object.

[0007] According to one aspect of the present application, an image sensor is provided, comprising: a pixel array unit, the pixel array unit comprising a plurality of pixels; a plurality of vertical signal lines respectively connected to each pixel column of the pixel array unit; and a column processing unit, connected to the plurality of vertical signal lines, for receiving pixel signals generated by pixels of each pixel column through the plurality of vertical signal lines, and outputting the received pixel signals. In addition, the image sensor further comprises: a plurality of gain amplifiers, respectively arranged on each vertical signal line, for amplifying the pixel signals on the vertical signal lines, and the plurality of gain amplifiers are configured to enable the sensor pixel signals after being amplified by the plurality of gain amplifiers to have different gain multiples.

[0008] Optionally, the gain values ​​of the multiple gain amplifiers are different.

[0009] Optionally, the gain values ​​of the plurality of gain amplifiers are repeatedly arranged at a predetermined period according to the arrangement of the plurality of gain amplifiers.

[0010] Optionally, the image sensor further comprises a data processing unit connected to the column processing unit, configured to receive the pixel signal from the processing unit and output an image signal.

[0011] Optionally, the image sensor further includes a storage unit connected to the data processing unit.

[0012] Optionally, the image sensor further includes a vertical driving unit, wherein the vertical driving unit is connected to each pixel row of the pixel array unit through a plurality of horizontal signal lines.

[0013] Optionally, the image sensor further includes a horizontal driving unit, wherein the horizontal driving unit is connected to each pixel column of the pixel array unit through a plurality of vertical signal lines.

[0014] Optionally, the image sensor further includes a driving control unit, wherein the driving control unit is connected to the vertical driving unit, the horizontal driving unit and the column processing unit, and is used to control operations of the vertical driving unit, the horizontal driving unit and the column processing unit.

[0015] Optionally, the image sensor further includes analog-to-digital conversion units respectively arranged on each vertical signal line, and the analog-to-digital conversion units are arranged between the pixel array unit and the gain amplifier.

[0016] Optionally, the data processing unit is configured to perform the following operations: receive sensor pixel signals of the pixel array unit from the column processing unit; select sensor pixel signals of multiple sensor pixel columns from the received sensor pixel signals for generating designated image pixel columns of the output image; determine sensor pixel signals corresponding to designated image pixels of the designated image pixel columns from the selected sensor pixel signals; and determine pixel values ​​of designated image pixels based on the determined sensor pixel signals.

[0017] Optionally, the operation of determining the pixel value of the specified image pixel according to the determined sensor pixel signal includes: obtaining brightness information related to the specified image pixel; determining a gain value of a gain amplifier corresponding to the brightness information; obtaining a sensor pixel signal corresponding to the determined gain value from the determined sensor pixel signal; and determining the pixel value of the specified image pixel according to the sensor pixel signal corresponding to the determined gain value.

[0018] Optionally, the operation of obtaining brightness information related to the specified image pixel includes: obtaining a reference image related to the output image; and determining the brightness information related to the specified image pixel based on the brightness information of the reference image pixel corresponding to the specified image pixel in the reference image.

[0019] Optionally, the operation of determining the pixel value of a specified image pixel based on the determined sensor pixel signal includes: acquiring multiple reference images related to the output image; determining gain values ​​of gain amplifiers corresponding to pixels of the multiple reference images respectively; determining gain values ​​whose proportion is higher than a predetermined value from the gain values ​​corresponding to pixels of the multiple reference images respectively; acquiring a sensor pixel signal corresponding to the determined gain value from the determined sensor pixel signal; and determining the pixel value of the specified image pixel based on the sensor pixel signal corresponding to the determined gain value.

[0020] Optionally, it also includes multiple comparators corresponding to the multiple gain amplifiers respectively, the first input terminal of the comparator receives a reference voltage, the second input terminal of the comparator is connected to the vertical signal line, and the output terminal of the comparator is connected to the gain amplifier for adjusting the gain of the gain amplifier.

[0021] In summary, in the present disclosure, multiple gain amplifiers are used to amplify the pixel signals of each pixel column respectively, so that the gain multiples of the amplified pixel signals are different, thereby replacing the operation of generating multiple frames of images with different exposure times in the prior art. Therefore, the image sensor described in the present disclosure can complete the capture of high dynamic range images within the shortest exposure time. This solves the technical problem that the method of generating high dynamic range images in the prior art will produce a tailing phenomenon when capturing high-speed moving objects.

[0022] Based on the detailed description of the specific embodiments of the present application in combination with the accompanying drawings below, those skilled in the art will become more aware of the above and other objects, advantages and features of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Hereinafter, some specific embodiments of the present application will be described in detail in an exemplary and non-limiting manner with reference to the accompanying drawings. The same reference numerals in the accompanying drawings indicate the same or similar components or parts. It should be understood by those skilled in the art that these drawings are not necessarily drawn to scale. In the accompanying drawings:

[0024] Figure 1 is a schematic diagram of an image sensor according to Embodiment 1 of the present disclosure;

[0025] Figure 2 is a schematic diagram of another image sensor according to Embodiment 1 of the present disclosure;

[0026] Figure 3 is a schematic diagram of another image sensor according to Embodiment 1 of the present disclosure;

[0027] Figure 4is a flowchart of a method executed by a data processing unit in an image sensor according to Embodiment 1 of the present disclosure; and

[0028] Figure 5 is a schematic diagram of image pixels generating image pixel columns in the image sensor according to Embodiment 1 of the present disclosure; and

[0029] Figure 6 is a schematic diagram of an image sensor according to Embodiment 2 of the present disclosure. DETAILED DESCRIPTION

[0030] Example 1

[0031] Figure 1 is a schematic perspective view of an image sensor 100 according to Embodiment 1 of the present disclosure. Figure 1 As shown, the image sensor 100 includes: a pixel array unit 110, the pixel array unit 110 includes a plurality of sensor pixels; a plurality of vertical signal lines 152 respectively connected to each sensor pixel column of the pixel array unit 110; and a column processing unit 140, connected to the plurality of vertical signal lines 152, for receiving sensor pixel signals generated by sensor pixels of each pixel column through the plurality of vertical signal lines 152, and outputting the received sensor pixel signals. The image sensor 100 further includes a plurality of gain amplifiers 170, respectively disposed on each vertical signal line 152, for amplifying the sensor pixel signals on the vertical signal line 152, and the plurality of gain amplifiers 170 are configured to enable the sensor pixel signals amplified by the plurality of gain amplifiers 170 to have different gain multiples.

[0032] As described in the background technology, in the prior art, high dynamic range images are generated by using a multi-frame synthesis method. That is, for the same scene, multiple frames of images are generated, and the exposure time of each frame of the image increases successively. Thus, a high dynamic range image is synthesized using multiple frames of images with successively increasing exposure times. However, the method of generating high dynamic range images in the prior art will produce a tailing phenomenon when shooting high-speed moving objects. Therefore, a method is needed to increase the image dynamic range as much as possible and complete the shooting within the shortest exposure time.

[0033] In order to solve this technical problem, in the technical solution of the present disclosure, a gain amplifier 170 is provided on each vertical signal line 152 to amplify the sensor pixel signal on the vertical signal line 152. And the sensor pixel signals amplified by the multiple gain amplifiers 170 have different gain multiples. Therefore, after amplification by the gain amplifier 170, the sensor pixel signals of different pixel columns transmitted to the column processing unit 140 can be amplified at different multiples. Therefore, the sensor pixel signals received by the column processing unit 140 present the characteristics of a high dynamic range.

[0034] That is, in the present disclosure, multiple gain amplifiers 170 are used to amplify the sensor pixel signals of each pixel column respectively, replacing the operation of generating multiple frames of images with different exposure times in the prior art. Therefore, the image sensor described in the present disclosure can complete the capture of high dynamic range images within the shortest exposure time. This solves the technical problem that the method of generating high dynamic range images in the prior art will produce a tailing phenomenon when capturing high-speed moving objects.

[0035] Optionally, the gain values ​​of the multiple gain amplifiers 170 are different. That is to say, in the technical solution of this embodiment, the sensor pixel signals of each pixel column of the pixel array unit 110 are amplified by the gain amplifiers 170 on each vertical signal line 152. Since the gain values ​​of each gain amplifier 170 are different, after being amplified by the gain amplifier 170, the sensor pixel signals of different pixel columns transmitted to the column processing unit 140 are amplified by different multiples. Therefore, the sensor pixel signals received by the column processing unit 140 present the characteristics of a high dynamic range.

[0036] Optionally, the gain values ​​of the plurality of gain amplifiers 170 are repeatedly arranged at a predetermined period according to the arrangement of the plurality of gain amplifiers 170 .

[0037] Specifically, refer to Figure 2 As shown, the gain values ​​of the plurality of gain amplifiers 170 are repeatedly arranged in a predetermined period according to the arrangement of the plurality of gain amplifiers 170. For example, Figure 2 In each cycle, two gain amplifiers 171 and 172 are included. That is, in Figure 2 In the embodiment, two gain amplifiers are repeatedly arranged as one cycle. In one cycle, for example, a low-gain gain amplifier 171 and a high-gain gain amplifier 172 are included. In addition, each cycle may also include more gain amplifiers with different gains, such as 3, 4, etc.

[0038] Thus, since the gain values ​​of the plurality of gain amplifiers 170 are repeatedly arranged according to a predetermined period, it is convenient to control the gain of the sensor pixel signal of each pixel column, thereby facilitating the subsequent generation of an image signal with a high dynamic range.

[0039] Optionally, the image sensor 100 further includes a data processing unit 180 connected to the column processing unit 140 , configured to receive sensor pixel signals from the processing unit 140 and output image signals.

[0040] refer to Figure 3As shown, the image sensor 100 further includes a data processing unit 180. The data processing unit 180 is connected to the column processing unit 140, so that it can receive the sensor pixel signal from the column processing unit 140 and output the image signal.

[0041] Optionally, the image sensor 100 further includes a storage unit 190 connected to the data processing unit 180. Thus, the data processing unit 180 can use the storage unit 190 to temporarily store the received sensor pixel signal or the generated image signal, which is beneficial for the data processing unit 180 to process the received sensor pixel signal.

[0042] Optionally, the image sensor 100 further includes a vertical driving unit 121, wherein the vertical driving unit 121 is connected to each pixel row of the pixel array unit 110 via a plurality of horizontal signal lines 151. Thus, each row of pixels of the pixel array unit 110 can be driven and scanned by the vertical driving unit 121.

[0043] Optionally, the image sensor 100 further includes a horizontal driving unit 122, wherein the horizontal driving unit 122 is connected to each pixel column of the pixel array unit 110 via a plurality of vertical signal lines 152. Thus, each column of pixels of the pixel unit 110 can be driven and scanned by the horizontal driving unit 122.

[0044] Optionally, the image sensor 100 further includes a driving control unit 130, wherein the driving control unit 130 is connected to the vertical driving unit 121, the horizontal driving unit 122, and the column processing unit 140, and is used to control the operations of the vertical driving unit 121, the horizontal driving unit 122, and the column processing unit 140. Thus, the driving control unit 130 is used to coordinate the operations among the vertical driving unit 121, the horizontal driving unit 122, and the column processing unit 140.

[0045] Optionally, the image sensor 100 further includes an analog-to-digital conversion unit 160 disposed on each vertical signal line 152, and the analog-to-digital conversion unit 160 is disposed between the pixel array unit 110 and the gain amplifier 170. Thus, the analog-to-digital conversion unit 160 converts the analog pixel signal generated by the pixel array unit 110 into a digital pixel signal.

[0046] also, Figure 4 FIG. 1 is a flow chart showing a method for processing pixel signals by the data processing unit 180. As described above, the data processing unit 180 receives pixel data of each pixel column from the column processing unit, and outputs image data according to the received pixel data. Figure 4 As shown, the method executed by the data processing unit 180 includes:

[0047] S402: receiving a sensor pixel signal of a pixel array unit from a column processing unit;

[0048] S404: Selecting sensor pixel signals of a plurality of sensor pixel columns from the received sensor pixel signals for generating designated image pixel columns of an output image;

[0049] S406: Determine a sensor pixel signal corresponding to a designated image pixel of a designated image pixel column from the selected sensor pixel signals; and

[0050] S408: Determine a pixel value of a designated image pixel according to the determined sensor pixel signal.

[0051] Specifically, Figure 3 Taking the image sensor 100 shown in FIG. 1 as an example, the data processing unit 180 receives sensor pixel signals of each sensor pixel column in the pixel array unit 110 from the column processing unit 140 .

[0052] Then, the data processing unit 180 selects sensor pixel signals of a plurality of pixel columns from the received sensor pixel signals of the sensor pixel columns for generating a designated image pixel column of the output image. Figure 5 As shown, the data processing unit 180 may select sensor pixel signals of two adjacent sensor pixel columns corresponding to gain 0 and gain 1, respectively, to generate a designated image pixel column of an output image.

[0053] Then, data processing unit 180 determines a sensor pixel signal corresponding to a designated image pixel of a designated image pixel column from among the selected sensor pixel signals.

[0054] refer to Figure 5 As shown, when the data processing unit 180 generates a designated image pixel, the sensor pixel signal corresponding to the designated image pixel is determined from the selected sensor pixel signals. For example, when the designated image pixel is image pixel 0, the corresponding sensor pixel signals are sensor pixel signal 0 with a gain of 0 and sensor pixel signal 0 with a gain of 1. When the designated image pixel is image pixel 1, the corresponding sensor pixel signals are sensor pixel signal 1 with a gain of 0 and sensor pixel signal 1 with a gain of 1. By analogy, when the designated image pixel is image pixel 19, the corresponding sensor pixel signals are sensor pixel signal 19 with a gain of 0 and sensor pixel signal 19 with a gain of 1.

[0055] Then, the data processing unit 180 determines the pixel value of the designated image pixel according to the determined sensor pixel signal. For example, the data processing unit determines the image pixel signal 0 of the designated image pixel column according to the sensor pixel signal 0 with a gain of 0 and the sensor pixel signal 0 with a gain of 1; determines the image pixel signal 1 of the designated image pixel column according to the sensor pixel signal 1 with a gain of 0 and the sensor pixel signal 1 with a gain of 1; ...; and so on, determines the image pixel signal 19 of the designated image pixel column according to the sensor pixel signal 19 with a gain of 0 and the sensor pixel signal 19 with a gain of 1.

[0056] Thus, in this way, the image sensor 100 of the present disclosure can generate an image with a high dynamic range by using the sensor pixel signals of the pixel columns corresponding to the gain amplifiers with different gains in the pixel array unit 100. Thus, the image sensor 100 can quickly generate an image with a high dynamic range.

[0057] Optionally, the operation of determining the pixel value of a specified image pixel based on the determined sensor pixel signal includes: obtaining brightness information related to the specified image pixel; determining a gain value of a gain amplifier corresponding to the brightness information; obtaining a sensor pixel signal corresponding to the determined gain value from the determined sensor pixel signal; and determining the pixel value of the specified image pixel based on the sensor pixel signal corresponding to the determined gain value.

[0058] Specifically, refer to Figure 5 As shown, for example, when the designated image pixel generated by the data processing unit 180 is image pixel 1, it selects the sensor pixel signal 1 with a gain of 0 and the sensor pixel signal 1 with a gain of 1 to generate image pixel 1.

[0059] On this basis, the data processing unit 180 obtains the brightness information related to the image pixel 1, and determines the gain value of the gain amplifier corresponding to the brightness information. For example, when the image pixel 1 is a pixel displaying high brightness, the corresponding gain amplifier is a gain amplifier with a high gain value; when the image pixel 1 is a pixel displaying low brightness (or a darker pixel), the threshold value corresponds to a gain amplifier with a low gain value.

[0060] Thus, when image pixel 1 is a pixel displaying high brightness, the pixel value of image pixel 1 is determined according to sensor pixel signal 1 corresponding to a high gain value (e.g., gain 1) (e.g., the signal value of sensor pixel signal 1 corresponding to gain 1 may be used as the pixel value of image pixel 1). Conversely, when image pixel 1 is a pixel displaying low brightness, the pixel value of image pixel 1 is determined according to sensor pixel signal 0 corresponding to a low gain (e.g., gain 0) (e.g., the signal value of sensor pixel signal 1 corresponding to gain 0 may be used as the pixel value of image pixel 1).

[0061] The pixel values ​​of other pixels in the specified image pixel column are also determined by referring to the above-described method. Thus, in this embodiment, the data processing unit 180 can use the pixel signals of the sensor pixels in the plurality of sensor pixel columns corresponding to the different gain values ​​in the pixel array unit 100 to generate the image pixels in one image pixel column of the output image.

[0062] In addition, for example, reference Figure 2 As shown, two sensor pixel columns in one gain value cycle (including gain 0 and gain 1) in the pixel array unit 110 correspond to one image pixel column of the output image. Thus, one image pixel column of the output image can be generated by splicing the sensor pixel signals given to the two sensor pixel columns in one gain value cycle. As for the number of sensor pixel columns in one gain value cycle, it can be more. For example, it can be 3 (three gain amplifiers with different gain values ​​are included in one cycle) or 4 (four gain amplifiers with different gain values ​​are included in one cycle), or even more.

[0063] Thus, in this way, when the image pixel to be generated is a high-brightness pixel, a high-gain sensor pixel signal is selected to determine the pixel value of the image pixel. When the image pixel to be generated is a low-brightness pixel, a low-gain sensor pixel signal is selected to determine the pixel value of the image pixel.

[0064] In this way, since the sensor pixel signals with different gain values ​​are selected according to the brightness information of the image pixel to be generated to determine the pixel value of the image pixel, the dynamic range of the output image can be increased, thereby generating an output image with a high dynamic range.

[0065] In addition, optionally, the operation of the data processing unit 180 obtaining brightness information related to the specified image pixel includes: obtaining a reference image related to the output image; and determining the brightness information related to the specified image pixel based on the brightness information of the reference image pixel corresponding to the specified image pixel in the reference image.

[0066] Specifically, for example, the data processing unit 180 may obtain a reference image related to the output image from the storage unit 190. The reference image may be, for example, a previous frame of image output by the data processing unit 180. Then, the data processing unit 180 obtains image pixels corresponding to the designated image pixels to be generated from the reference image. Then, the brightness information related to the designated image pixels to be generated is determined based on the brightness information of the corresponding image pixels in the reference image.

[0067] Thus, in this way, the data processing unit 180 can accurately determine the brightness information of the specified image pixel, and thus can select the sensor pixel signal corresponding to the correct gain value to determine the pixel value of the specified image pixel.

[0068] Optionally, the operation of determining the pixel value of the designated image pixel according to the determined sensor pixel signal includes: acquiring multiple reference images related to the output image; determining gain values ​​of gain amplifiers corresponding to pixels of the multiple reference images respectively; determining gain values ​​whose proportion is higher than a predetermined value from the gain values ​​corresponding to pixels of the multiple reference images respectively; acquiring a sensor pixel signal corresponding to the determined gain value from the determined sensor pixel signal; and determining the pixel value of the designated image pixel according to the sensor pixel signal corresponding to the determined gain value.

[0069] Specifically, the data processing unit 180 may obtain a plurality of reference images related to the output image from the storage unit 190. Then, the data processing unit 180 determines the gain value corresponding to each image pixel in the plurality of reference images.

[0070] The data processing unit 180 can then collect statistics on the distribution of different gain values ​​in the image pixels of multiple reference images to determine the proportion of each gain value. The data processing unit 180 then selects a gain value with a proportion higher than a predetermined value (e.g., higher than 90%) as the gain value corresponding to the specified image pixel.

[0071] Then, the data processing unit 180 determines the pixel value of the designated image pixel according to the sensor pixel signal corresponding to the gain value.

[0072] Thus, in this way, the data processing unit 180 can determine the gain value of the designated image pixel by a fast detection method, and quickly determine the pixel value of the designated image pixel, thereby increasing the processing speed of the data processing unit 180.

[0073] Example 2

[0074] Figure 6 A schematic perspective view of an image sensor 100 according to Embodiment 2 of the present disclosure is shown. In order to reduce unnecessary description, only the differences between the technical solution of Embodiment 2 and the technical solution of Embodiment 1 are introduced below. For the same technical features as those in the technical solution of Embodiment 1, the same reference numerals are still used.

[0075] refer to Figure 6As shown, compared with Embodiment 1, Embodiment 2 of the present disclosure is different in that the gain amplifier 170 in Embodiment 2 is a gain amplifier with adjustable gain. For example, the gain amplifier 170 may have two different gain values, a higher first gain and a lower second gain.

[0076] Each gain amplifier 170 is provided with a corresponding comparator 173. The first input terminal of the comparator 173 receives the reference voltage REF, the second input terminal of the comparator 173 is connected to the vertical signal line 152, and the output terminal of the comparator 173 is connected to the gain amplifier 170 for adjusting the gain of the gain amplifier 170.

[0077] For example, when the level of the vertical signal line 152 is lower than the reference voltage REF, it means that the brightness of the corresponding sensor pixel signal is lower than the required brightness (that is, the pixel signal is not bright enough), so in order to increase the brightness of the pixel signal, the comparator 173 outputs a high level to adjust the gain of the gain amplifier 170 to a higher first gain, thereby outputting a pixel signal with higher brightness.

[0078] Alternatively, when the level of the vertical signal line 152 is higher than the reference voltage REF, it means that the brightness of the corresponding sensor pixel signal is higher than the required brightness (i.e., the pixel signal is overexposed), so in order to reduce the brightness of the pixel signal, the comparator 173 outputs a high level to adjust the gain of the gain amplifier 170 to a lower second gain, thereby outputting a pixel signal with lower brightness.

[0079] Therefore, the pixel array unit 110 can output sensor pixel signals with different amplification gain factors through each gain amplifier 170, thereby achieving the characteristics of a high dynamic range image.

[0080] In summary, in the present disclosure, multiple gain amplifiers with different gains are used to amplify the pixel signals of each pixel column respectively, replacing the operation of generating multiple frames of images with different exposure times in the prior art. Therefore, the image sensor described in the present disclosure can complete the capture of high dynamic range images within the shortest exposure time. This solves the technical problem that the method of generating high dynamic range images in the prior art will produce a tailing phenomenon when capturing high-speed moving objects.

[0081] The above is only a preferred specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An image sensor (100), comprising: A pixel array unit (110), the pixel array unit (110) comprising a plurality of sensor pixels; A plurality of vertical signal lines (152) respectively connected to each sensor pixel column of the pixel array unit (110); and A column processing unit (140) connected to the plurality of vertical signal lines (152), configured to receive sensor pixel signals generated by sensor pixels of each sensor pixel column through the plurality of vertical signal lines (152), and output the received sensor pixel signals, characterized in that it further comprises: a plurality of gain amplifiers (170), respectively arranged on each of the vertical signal lines (152), for amplifying the sensor pixel signals on the vertical signal lines (152), and the plurality of gain amplifiers (170) are configured to enable the sensor pixel signals amplified by the plurality of gain amplifiers (170) to have different gain multiples; The image sensor (100) further comprises a vertical driving unit (121), wherein the vertical driving unit (121) is connected to each pixel row of the pixel array unit (110) via a plurality of horizontal signal lines (151); The image sensor (100) further comprises a horizontal driving unit (122), wherein the horizontal driving unit (122) is connected to each pixel column of the pixel array unit (110) via a plurality of vertical signal lines (152); The image sensor (100) further comprises a driving control unit (130), wherein the driving control unit (130) is connected to the vertical driving unit (121), the horizontal driving unit (122) and the column processing unit (140), and is used to control the operations of the vertical driving unit (121), the horizontal driving unit (122) and the column processing unit (140); The image sensor (100) further comprises an analog-to-digital conversion unit (160) respectively arranged on each of the vertical signal lines (152); the analog-to-digital conversion unit (160) is arranged between the pixel array unit (110) and the gain amplifier (170).

2. The image sensor (100) according to claim 1, characterized in that The gain values ​​of the plurality of gain amplifiers (170) are different.

3. The image sensor (100) according to claim 2, characterized in that The gain values ​​of the plurality of gain amplifiers (170) are repeatedly arranged at a predetermined period according to the arrangement of the plurality of gain amplifiers (170).

4. The image sensor (100) according to claim 2, characterized in that It also includes a data processing unit (180) connected to the column processing unit (140) and configured to receive the sensor pixel signal from the processing unit (140) and output an image signal.

5. The image sensor (100) according to claim 4, characterized in that It also includes a storage unit (190) connected to the data processing unit (180).

6. The image sensor (100) according to claim 4, characterized in that The data processing unit (180) is configured to perform the following operations: receiving a sensor pixel signal of a pixel array unit (100) from the column processing unit (140); selecting sensor pixel signals of a plurality of sensor pixel columns from the received sensor pixel signals for use in generating a designated image pixel column of an output image; determining a sensor pixel signal corresponding to a specified image pixel of the specified image pixel column from the selected sensor pixel signals; as well as A pixel value of the designated image pixel is determined based on the determined sensor pixel signal.

7. The image sensor (100) according to claim 6, characterized in that The operation of determining the pixel value of the specified image pixel according to the determined sensor pixel signal comprises: Acquire brightness information related to the specified image pixel; Determining a gain value of a gain amplifier corresponding to the brightness information; acquiring a sensor pixel signal corresponding to the determined gain value from the determined sensor pixel signals; and A pixel value of the designated image pixel is determined based on the sensor pixel signal corresponding to the determined gain value.

8. The image sensor (100) according to claim 7, characterized in that The operation of obtaining brightness information related to the specified image pixel includes: Acquiring a reference image related to the output image; and The brightness information related to the designated image pixel is determined according to the brightness information of the reference image pixel corresponding to the designated image pixel in the reference image.

9. The image sensor (100) according to claim 6, characterized in that The operation of determining the pixel value of the specified image pixel according to the determined sensor pixel signal comprises: Acquire a plurality of reference images related to the output image; Determining gain values ​​of gain amplifiers corresponding to pixels of the plurality of reference images respectively; Determining, from the gain values ​​respectively corresponding to the pixels of the plurality of reference images, gain values ​​of which the proportion is higher than a predetermined value; acquiring a sensor pixel signal corresponding to the determined gain value from the determined sensor pixel signals; and A pixel value of the designated image pixel is determined based on the sensor pixel signal corresponding to the determined gain value.

10. The image sensor (100) according to claim 1, characterized in that It also includes a plurality of comparators (173) respectively corresponding to the plurality of gain amplifiers (170), wherein a first input terminal of the comparator (173) receives a reference voltage, a second input terminal of the comparator (173) is connected to the vertical signal line (152), and an output terminal of the comparator (173) is connected to the gain amplifier (170) for adjusting the gain of the gain amplifier (170).