An image acquisition device, a data reading method, a control component, and a storage medium

Abstract

The present application discloses an image acquisition device, a data reading method, a control component and a storage medium, which relate to the technical field of image sensors. It is used for efficiently reading and transmitting pixel data. The image acquisition device includes: a photosensitive pixel array unit for performing exposure according to an exposure control signal; the photosensitive pixel array unit includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; a data reading unit for reading the pixel data generated by the exposure of the photosensitive pixel array unit; the data reading unit includes N groups of readout lines, and the N groups of readout lines are used for reading the pixel data generated by the N pixel groups; one group of readout lines is connected to one pixel group; a data transmission unit for transmitting the pixel data collected by the data reading unit through the transmission interface of the data transmission unit.

Description

Technical Field

[0001] The present application relates to the technical field of image sensors, and in particular, to an image acquisition device, a data reading method, a control component, and a storage medium. Background Art

[0002] An image sensor uses a photosensitive pixel array to collect image signals. During the process of collecting image signals, the photosensitive element of each pixel responds to incident light under the corresponding exposure duration, and then converts the optical signal sensed at that point into an electrical signal. Then, after being collected and amplified by a readout circuit, it is converted into a digital signal by an analog-to-digital converter (ADC).

[0003] In related technologies, the exposure modes of image sensors include long exposure and short exposure, etc. If all pixels in the pixel array of the image sensor adopt the form of long exposure, the obtained image has a high signal-to-noise ratio, but there may be situations of blurring or overexposure; if all pixels in the pixel array of the image sensor adopt the form of short exposure, the obtained image does not have blurred signals, but the signal-to-noise ratio of this image is low.

[0004] It can be understood that for the same pixel, the amplitude of the optical signal it senses also changes with the change of the ambient light intensity. Therefore, if all pixels adopt a unified and fixed exposure time, it is difficult to ensure that each pixel in the pixel matrix will not be overexposed due to too long exposure time at every moment; or, be underexposed due to too short exposure time, which is not conducive to the subsequent image processing effect. If the exposure time of each pixel is not unified, then during readout, it is difficult to avoid the transmission of invalid data bits of pixels that have not completed exposure, resulting in redundant data bits and reducing the data transmission efficiency. Summary of the Invention

[0005] The present application provides an image acquisition device, a data reading method, a control component, and a storage medium for efficiently reading and transmitting pixel data.

[0006] In a first aspect, the present application provides an image acquisition device, comprising: a photosensitive pixel array unit, a data reading unit, and a data transmission unit; wherein, the photosensitive pixel array unit is configured to perform exposure according to an exposure control signal; the photosensitive pixel array unit includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the data reading unit is configured to read pixel data generated by the photosensitive pixel array unit during exposure; the data reading unit includes N groups of readout lines, and the N groups of readout lines are used to read pixel data generated by the N pixel groups; one group of readout lines is connected to one pixel group; the data transmission unit is configured to transmit the pixel data collected by the data reading unit through a transmission interface of the data transmission unit.

[0007] It can be understood that in the image acquisition device provided by the present application, the photosensitive pixel array unit includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the data reading unit is configured to collect pixel data generated by the photosensitive pixel array unit; the data reading unit includes N groups of readout lines, and the N groups of readout lines correspond one-to-one to the N pixel groups; the data transmission unit is configured to transmit the pixel data collected by the data reading unit through a transmission interface of the data transmission unit. In this way, when the exposure modes of the pixels in the photosensitive pixel array are different, the corresponding pixel data can be read out through the readout lines corresponding to each pixel group. Thus, on the one hand, the pixel data generated by each pixel group can be read out in a timely manner, without caching the pixel data generated by the pixel group, nor waiting for other pixel groups to complete exposure, improving the efficiency of data reading; on the other hand, one group of readout lines corresponds to one pixel group (the exposure duration of the pixels within one pixel group is the same), which can avoid reading redundant data, reducing the amount of data entering the data transmission channel per unit time, lowering the bandwidth requirement for data transmission, and effectively improving the efficiency of data transmission.

[0008] In a possible implementation manner, the data reading unit is specifically configured to read first pixel data generated by a first pixel group through a first group of readout lines; read second pixel data generated by a second pixel group through a second group of readout lines; wherein, the first group of readout lines and the second group of readout lines are any two groups of readout lines among the N groups of readout lines; the first pixel group and the second pixel group are any two pixel groups among the N pixel groups.

[0009] In another possible implementation, the image acquisition device further includes: a bit-width conversion unit; the bit-width conversion unit is configured to obtain first pixel data, convert the original bit-width of the first pixel data into a first bit-width, and then transmit it through the data transmission unit; the first pixel data is the pixel data generated by the exposure of the first pixel group in N pixel groups; obtain second pixel data, convert the original bit-width of the second pixel data into a second bit-width, and then transmit it through the data transmission unit; the second pixel data is the pixel data generated by the exposure of the second pixel group in N pixel groups; the N pixel groups correspond to N groups of bit-widths; the first bit-width and the second bit-width are any two groups of bit-widths among the N bit-widths.

[0010] In another possible implementation, the N groups of bit-widths are independent of each other; wherein, the first bit-width is determined by the exposure duration of the first pixel group and / or the bandwidth of the data transmission unit; the second bit-width is determined by the exposure duration of the second pixel group and / or the bandwidth of the data transmission unit.

[0011] In another possible implementation, the data transmission unit includes one or more transmission channels; the data transmission unit is specifically configured to transmit the pixel data collected by the data reading unit to the transmission interface through one or more transmission channels, and then the transmission interface performs the transmission.

[0012] In another possible implementation, the image acquisition device further includes: a data processing unit; the data processing unit is configured to obtain the pixel data collected by the data reading unit through the transmission interface, restore the pixel data into a signal to be processed, and perform image processing on the signal to be processed.

[0013] In another possible implementation, the data processing unit is specifically configured to reorganize the pixel data according to one or more of the exposure duration of the pixel data, the read time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data to obtain a signal to be processed, and perform image processing on the signal to be processed.

[0014] In another possible implementation, the data processing unit is specifically configured to perform image processing on the signal to be processed by using a neural network.

[0015] In another possible implementation, the image acquisition device further includes: an exposure control unit; the exposure control unit includes N groups of control lines, and the N groups of control lines are used to transmit exposure control signals to N pixel groups; one group of control lines is connected to one pixel group; the exposure control unit is configured to send a first exposure control signal to the first pixel group through the first group of control lines, so that the first pixel group performs exposure based on the first exposure control signal; send a second exposure control signal to the second pixel group through the second group of control lines, so that the second pixel group performs exposure based on the second exposure control signal; the first group of control lines and the second group of control lines are any two groups of readout lines among the N groups of control lines; the first pixel group and the second pixel group are any two pixel groups among the N pixel groups.

[0016] In another possible implementation, the first exposure control signal is used to control the first exposure start time and the first exposure end time of the first pixel group; the second exposure control signal is used to control the second exposure start time and the second exposure end time of the second pixel group; and / or, the first exposure control signal is used to control the number of exposure operations and the exposure duration of the first pixel group during the exposure period; the second exposure control signal is used to control the number of exposure operations and the exposure duration of the second pixel group during the exposure period.

[0017] In another possible implementation, the image acquisition device further includes: a gain control unit; the gain control unit includes N groups of signal lines; the N groups of signal lines are used to transmit gain control signals to N pixel groups; one group of signal lines is connected to one pixel group; the gain control unit is configured to send a first gain control signal to the first pixel group through the first group of signal lines, so that the first pixel group adjusts the brightness value in the first pixel data based on the first gain control signal; the first pixel data is the pixel data generated by the first pixel group during exposure; send a second gain control signal to the second pixel group through the second group of signal lines, so that the second pixel group adjusts the brightness value in the second pixel data based on the second gain control signal; the second pixel data is the pixel data generated by the second pixel group during exposure; the first group of signal lines and the second group of signal lines are any two groups of signal lines among the N groups of signal lines; the first pixel group and the second pixel group are any two pixel groups among the N pixel groups.

[0018] Second aspect, the present application provides a data reading method, which is applied to an image acquisition device. The image acquisition device includes: a photosensitive pixel array unit, a data reading unit, a data transmission unit, a data processing unit, and a control component. The photosensitive pixel array unit includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the data reading unit includes N groups of readout lines, and the N groups of readout lines are used to read the pixel data generated by the N pixel groups; one group of readout lines is connected to one pixel group; the method is applied to the control component; the method includes: controlling the data reading unit to respectively read the pixel data generated by the N pixel groups performing exposure operations through the N groups of readout lines; controlling the pixel data to be transmitted through the data transmission unit.

[0019] In a possible implementation manner, the above controlling the data reading unit to respectively read the pixel data generated by the N pixel groups performing exposure operations through the N groups of readout lines includes: controlling the data reading unit to read the first pixel data generated by the first pixel group through the first group of readout lines; controlling the data reading unit to read the second pixel data generated by the second pixel group through the second group of readout lines; where the first group of readout lines and the second group of readout lines are any two groups of readout lines among the N groups of readout lines; the first pixel group and the second pixel group are any two pixel groups among the N pixel groups.

[0020] In another possible implementation manner, before the above controlling the pixel data to be transmitted through the data transmission unit, the method further includes: acquiring the first pixel data and converting the original bit width of the first pixel data into the first bit width; the first pixel data is the pixel data generated by the first pixel group among the N pixel groups performing exposure; acquiring the second pixel data and converting the original bit width of the second pixel data into the second bit width; the second pixel data is the pixel data generated by the second pixel group among the N pixel groups performing exposure; the N pixel groups correspond to N groups of bit widths; the first bit width and the second bit width are any two groups of bit widths among the N bit widths; the above controlling the pixel data to be transmitted through the data transmission unit includes: after converting the original bit width of the first pixel data into the first bit width, transmitting it through the data transmission unit; after converting the original bit width of the second pixel data into the second bit width, transmitting it through the data transmission unit.

[0021] In another possible implementation manner, the N groups of bit widths are independent of each other; where the first bit width is determined by the exposure duration of the first pixel group and / or the bandwidth of the data transmission unit; the second bit width is determined by the exposure duration of the second pixel group and / or the bandwidth of the data transmission unit.

[0022] In another possible implementation manner, the above method further includes: controlling a data transmission unit to transmit the pixel data collected by a data reading unit to a data processing unit, so that the data processing unit restores the pixel data into a signal to be processed and performs image processing on the signal to be processed.

[0023] In another possible implementation manner, the above signal to be processed is obtained by the data processing unit reorganizing the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data.

[0024] In another possible implementation manner, the above control component includes N groups of control lines; the N groups of control lines are used to transmit exposure control signals to N pixel groups; one group of control lines is connected to one pixel group; before controlling the data reading unit to respectively read out the pixel data generated by the N pixel groups during exposure operations through N groups of readout lines, the above method further includes: sending a first exposure control signal to a first pixel group through a first group of control lines, so that the first pixel group performs exposure based on the first exposure control signal; sending a second exposure control signal to a second pixel group through a second group of control lines, so that the second pixel group performs exposure based on the second exposure control signal; the first group of control lines and the second group of control lines are any two groups of the N groups of control lines; the first pixel group and the second pixel group are any two of the N pixel groups.

[0025] In another possible implementation manner, the first exposure control signal is used to control the first exposure start time and the first exposure end time of the first pixel group; the second exposure control signal is used to control the second exposure start time and the second exposure end time of the second pixel group; and / or, the first exposure control signal is used to control the number of exposure operations and the exposure duration of the first pixel group during an exposure period; the second exposure control signal is used to control the number of exposure operations and the exposure duration of the second pixel group during an exposure period.

[0026] In another possible implementation, the above control component further includes N groups of signal lines; the N groups of signal lines are used to transmit gain control signals to N pixel groups; one group of signal lines is connected to one pixel group; the above method further includes: sending a first gain control signal to the first pixel group through the first group of signal lines, so that the first pixel group adjusts the brightness value in the first pixel data based on the first gain control signal; the first pixel data is the pixel data generated by the exposure of the first pixel group; sending a second gain control signal to the second pixel group through the second group of signal lines, so that the second pixel group adjusts the brightness value in the second pixel data based on the second gain control signal; the second pixel data is the pixel data generated by the exposure of the second pixel group; the first group of signal lines and the second group of signal lines are any two groups of the N groups of signal lines; the first pixel group and the second pixel group are any two of the N pixel groups.

[0027] In a third aspect, the present application provides a control component, including: one or more processors; one or more memories; wherein, the one or more memories are used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the control component executes the data reading method provided in any possible implementation manner of the second aspect above.

[0028] In a fourth aspect, the present application provides a computer-readable storage medium, which stores computer execution instructions. When the computer execution instructions run on a computer, the computer is enabled to execute the data reading method provided in any possible implementation manner of the second aspect above.

[0029] The descriptions of the second to fourth aspects in the present application can refer to the detailed description of the first aspect; and, for the beneficial effects of the descriptions of the second to fourth aspects, reference can be made to the analysis of the beneficial effects of the first aspect, which will not be elaborated here. Description of the Drawings

[0030] Figure 1 It is a schematic structural diagram of an image acquisition device provided by an embodiment of the present application;

[0031] Figure 2 It is a schematic diagram of a photosensitive pixel array provided by an embodiment of the present application;

[0032] Figure 3 It is a schematic diagram of an exposure operation provided by an embodiment of the present application Figure 1 ;

[0033] Figure 4 It is a schematic diagram of an exposure operation provided by an embodiment of the present application Figure 2 ;

[0034] Figure 5A schematic diagram of an exposure operation provided by an embodiment of the present application Figure 3 ;

[0035] Figure 6 A schematic diagram of an exposure operation provided by an embodiment of the present application Figure 4 ;

[0036] Figure 7 A schematic diagram of an exposure mode provided by an embodiment of the present application;

[0037] Figure 8 A schematic diagram of pixel data provided by an embodiment of the present application Figure 1 ;

[0038] Figure 9 A schematic diagram of pixel data provided by an embodiment of the present application Figure 2 ;

[0039] Figure 10 A schematic diagram of recombined pixel data provided by an embodiment of the present application Figure 1 ;

[0040] Figure 11 A schematic diagram of recombined pixel data provided by an embodiment of the present application Figure 2 ;

[0041] Figure 12 A schematic diagram of data bit width conversion provided by an embodiment of the present application Figure 1 ;

[0042] Figure 13 A schematic diagram of data bit width conversion provided by an embodiment of the present application Figure 2 ;

[0043] Figure 14 A flowchart of a data reading method provided by an embodiment of the present application Figure 1 ;

[0044] Figure 15 A flowchart of a data reading method provided by an embodiment of the present application Figure 2 ;

[0045] Figure 16 A structural schematic diagram of a control component provided by an embodiment of the present application. Detailed implementation manners

[0046] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. These three situations.

[0047] In the description of the present application and the accompanying drawings, terms such as "first" and "second" are used to distinguish different objects or different processes for the same object, rather than to describe a specific order of the objects.

[0048] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of the present application are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally further include other steps or units not listed, or may optionally further include other steps or units inherent to these processes, methods, products or devices.

[0049] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0050] In the description of the present application, unless otherwise specified, the meaning of "a plurality" refers to two or more.

[0051] As described in the background art, in the related art, the exposure modes of an image sensor include long exposure and short exposure, etc. If all the pixels in the pixel array of the image sensor adopt the form of long exposure, the obtained image has a high signal-to-noise ratio, but there may be blurring or overexposure; if all the pixels in the pixel array of the image sensor adopt the form of short exposure, the obtained image has no blurred signal, but the signal-to-noise ratio of this image is low.

[0052] It can be understood that for the same pixel, the amplitude of the optical signal it senses will also change with the change of the ambient light intensity. Therefore, if all pixels adopt a unified and fixed exposure time, it is difficult to ensure that each pixel in the pixel matrix will not be overexposed due to too long exposure time at every moment; or, be underexposed due to too short exposure time, which is not conducive to the subsequent image processing effect. If the exposure time of each pixel is not unified, then when reading out, it is difficult to avoid the transmission of invalid data bits of the pixels that have not completed exposure, resulting in redundant data bits and reducing the data transmission efficiency.

[0053] In view of the above technical problems, an embodiment of the present application provides an image acquisition device, including: a photosensitive pixel array unit, a data reading unit, and a data transmission unit; wherein, the photosensitive pixel array unit includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the data reading unit is used to collect pixel data generated by the photosensitive pixel array unit; the data reading unit includes N groups of readout lines, and the N groups of readout lines correspond to the N pixel groups one by one; the data transmission unit is used to transmit the pixel data collected by the data reading unit through the transmission interface of the data transmission unit. In this way, in the case where the exposure modes of the pixels in the photosensitive pixel array are different, the corresponding pixel data can be read out through the readout lines corresponding to each pixel group. Thus, on the one hand, the pixel data generated by each pixel group can be read out in time, without caching the pixel data generated by the pixel group and without waiting for other pixel groups to complete exposure, improving the data reading efficiency; on the other hand, one group of readout lines corresponds to one pixel group (the exposure duration of the pixels in one pixel group is the same), which can avoid reading redundant data, reduce the amount of data entering the data transmission channel per unit time, reduce the bandwidth requirement of data transmission, and effectively improve the data transmission efficiency.

[0054] In addition, the above-mentioned N pixel groups are respectively controlled by different exposure control signals, so that the pixels in the photosensitive pixel array unit can be exposed according to different exposure modes. By combining short exposure signals and long exposure signals, high-quality images with high signal-to-noise ratio and no blurred signals can be obtained.

[0055] The following specifically introduces the embodiments provided by the present application in conjunction with the accompanying drawings of the specification.

[0056] Please refer to Figure 1 , which shows a schematic structural diagram of an image acquisition device provided by an embodiment of the present application. As Figure 1 shown, the image acquisition device may include: a photosensitive pixel array unit 110, an exposure control unit 120, a data reading unit 130, and a data transmission unit 140.

[0057] In some embodiments, as Figure 1 shown, the photosensitive pixel array unit 110 is connected to the exposure control unit 120 through a control line, the photosensitive pixel array unit 110 is connected to the data reading unit 130 through a readout line, the data transmission unit 140 includes a transmission channel, and the data reading unit 130 is connected to the data transmission unit 140 through the transmission channel.

[0058] The photosensitive pixel array unit 110 is used to perform exposure according to the exposure control signal.

[0059] Among them, the above pixel data includes the pixel values of the pixels in the photosensitive pixel array unit 110.

[0060] In some embodiments, the photosensitive pixel array unit 110 includes a plurality of pixels, and the plurality of pixels are arranged in a pixel matrix of X*Y; where X and Y are both integers greater than 1.

[0061] In some embodiments, each pixel in the photosensitive pixel array unit 110 includes a photosensitive component, and the photosensitive component is used to sense the optical signal. The exposure of the photosensitive pixel array unit 110 means that the photosensitive components of the pixels in the photosensitive pixel array unit 110 respond to the incident light under the corresponding exposure duration and generate an electrical signal according to the photoelectric effect. Generally, the longer the exposure time of a pixel, the more electrical signal (such as charge) generated by the pixel according to the photoelectric effect, and the larger the pixel value corresponding to the pixel.

[0062] In some embodiments, the photosensitive pixel array unit 110 includes N pixel groups; where the N pixel groups are independent of each other and are respectively controlled by different exposure control signals. Where N is an integer greater than or equal to 2.

[0063] It should be noted that for the sake of understanding, Figure 1 only the first pixel group and the second pixel group among the N pixel groups are shown (the first pixel group and the second pixel group are any two pixel groups among the N pixel groups), but it does not mean that the photosensitive pixel array unit 110 only includes the first pixel group and the second pixel group. In some other embodiments, the photosensitive pixel array unit 110 may further include a third pixel group, a fourth pixel group, etc., and the embodiments of the present application do not limit this.

[0064] In some embodiments, the division of the pixel groups in the photosensitive pixel array unit 110 has diversity, and the pixels in each pixel group can be discretely distributed at different positions of the photosensitive pixel array unit 110. Exemplarily, assuming that the pixels in the photosensitive pixel array unit 110 can be divided into four pixel groups A, B, C, and D, the positions of the pixels in the four pixel groups in the photosensitive pixel array unit 110 can be in the form as Figure 2 shown.

[0065] Exemplarily, pixel groups can be divided according to the light input amounts of the pixels corresponding to the color channels in the photosensitive pixel array unit 110 in different brightness environments. For example, according to the color distribution of a preset color image, a color filter array is deployed on the light input surface during the exposure of the photosensitive pixel array unit 110, so that ambient light can be filtered by the color filter array and converted into monochromatic light of different color channels, and is respectively projected onto the corresponding pixels in the photosensitive pixel array unit 110. Thus, different pixels in the photosensitive pixel array unit 110 can respectively sense monochromatic light of different color channels, so that the exposure data output by the photosensitive pixel array unit 110 can contain color information. Exemplarily, in the above case, the pixels in the photosensitive pixel array unit 110 can be divided into multiple pixel groups according to the light amount, and independently controlled for exposure, so as to achieve differential exposure for different ambient brightnesses and different viewing ranges. For example, if the ambient brightness of the viewing range corresponding to a region of the photosensitive pixel array unit 110 is higher, the exposure duration of the pixel groups included in this region can be shorter; conversely, if the ambient brightness of the viewing range corresponding to a region of the photosensitive pixel array unit 110 is lower, the exposure duration of the pixel groups included in this region can be longer.

[0066] An exposure control unit 120, configured to send an exposure control signal to the photosensitive pixel array unit 110.

[0067] In some embodiments, the exposure control unit 120 sends an exposure control signal to the photosensitive pixel array unit 110 through a control line. Specifically, the pixels on each row in the horizontal direction of the photosensitive pixel array unit 110 share the same set of control lines, that is, the exposure control is performed row by row. Thus, the exposure control unit 120 sends an exposure control signal to the pixels on each row through the control lines of each row.

[0068] In some embodiments, the exposure control unit 120 includes N sets of control lines, and the N sets of control lines are used to transmit exposure control signals to N pixel groups; one set of control lines is connected to one pixel group. Specifically, taking the N sets of control lines including a first set of control lines and a second set of control lines as an example, the exposure control unit 120 is specifically configured to send a first exposure control signal to the first pixel group through the first set of control lines, so that the first pixel group performs exposure based on the first exposure control signal to obtain first pixel data; send a second exposure control signal to the second pixel group among the N pixel groups through the second set of control lines in the N sets of control lines, so that the second pixel group performs exposure based on the second exposure control signal to obtain second pixel data.

[0069] Exemplarily, such as Figure 1As shown, two sets of control lines are set for each row in the horizontal direction of the photosensitive pixel array unit 110, where the first set of control lines is used to send a first exposure control signal to the first pixel group; the second set of control lines is used to send an exposure control signal to the second pixel group. For example, the first set of control lines R of the first row 1_0 is used to send an exposure control signal to the pixels R1C2 and R1C4 in the first row, where the pixels R1C2 and R1C4 are both pixels in the first pixel group; the second set of control lines R of the first row 1_1 is used to send an exposure control signal to the pixels R1C1 and R1C3 in the first row, where the pixels R1C1 and R1C3 are both pixels in the second pixel group. Among them, R x represents the row, and C y represents the column, R x_0 represents the first set of control lines for each row, and R x_1 represents the second set of control lines for each row.

[0070] It should be noted that for ease of understanding, Figure 1 only the first set of control lines and the second set of control lines in the N sets of control lines are shown, but it does not mean that the exposure control unit 120 only includes the first set of control lines and the second set of control lines. In some other embodiments, the exposure control unit 120 may further include a third set of control lines, a fourth set of control lines, etc., and the embodiments of the present application do not limit this.

[0071] In some embodiments, the first exposure control signal is used to control the first exposure start time and the first exposure end time of the first pixel group; the second exposure control signal is used to control the second exposure start time and the second exposure end time of the second pixel group; where the first exposure start time is different from the second exposure start time; and / or, the first exposure end time is different from the second exposure end time.

[0072] Among them, the first exposure start time and the first exposure end time determine the exposure duration of the first pixel group; the second exposure start time and the second exposure end time determine the exposure duration of the second pixel group.

[0073] In some embodiments, the first exposure control signal is used to control the number of exposure operations and the exposure duration of the first pixel group within the exposure period; the second exposure control signal is used to control the number of exposure operations and the exposure duration of the second pixel group within the exposure period.

[0074] As a possible implementation manner, the first exposure control signal is used to control the first pixel group to perform one exposure operation according to the first exposure duration within the exposure period; the second exposure control signal is used to control the second pixel group to perform one exposure operation according to the second exposure duration within the exposure period.

[0075] Among them, the first exposure duration and the second exposure duration are different.

[0076] Exemplarily, assume that the first exposure duration is S and the second exposure duration is L. As Figure 3 shown, within one exposure period, the pixels in the first pixel group all perform an exposure operation with the first exposure duration S once, and the pixels in the second pixel group all perform an exposure operation with the second exposure duration L once.

[0077] As another possible implementation, the first exposure control signal is used to control the first pixel group to perform multiple exposure operations according to the first exposure duration within the exposure period; the second exposure control signal is used to control the second pixel group to perform multiple exposure operations according to the second exposure duration within the exposure period.

[0078] Among them, the first exposure duration and the second exposure duration are different.

[0079] Exemplarily, assume that the first exposure duration is S and the second exposure duration is L. As Figure 4 shown, within one exposure period, the pixels in the first pixel group all perform multiple exposure operations with the first exposure duration S, and the pixels in the second pixel group all perform multiple exposure operations with the second exposure duration L.

[0080] As another possible implementation, the first exposure control signal is used to control the first pixel group to perform multiple exposure operations according to the combination of the first exposure duration within the exposure period; the second exposure control signal is used to control the second pixel group to perform multiple exposure operations according to the combination of the second exposure duration within the exposure period.

[0081] Among them, both the first exposure duration combination and the second exposure duration combination include multiple exposure durations, and the first exposure duration combination is different from the second exposure duration combination. It can be understood that the above exposure mode is that a group of pixels in the photosensitive pixel array unit 110 are exposed according to the exposure duration combination in the time domain, which means that within one exposure period, the pixels on the photosensitive pixel array unit 110 use multiple exposure durations within the exposure duration combination and perform exposure alternately. That is, the exposure strategy for each exposure within the exposure period changes periodically.

[0082] Exemplarily, assume that the first exposure duration combination includes: exposure duration S, exposure duration M, and exposure duration M, and the second exposure duration combination includes: exposure duration L, exposure duration L, and exposure duration S; then as Figure 5As shown, the exposure strategy for the first exposure within the exposure period is that the first pixel group uses the exposure duration S, and the second pixel group uses the exposure duration L; the exposure strategy for the second exposure within the exposure period is that the first pixel group uses the exposure duration M, and the second pixel group uses the exposure duration L; the exposure strategy for the third exposure within the exposure period is that the first pixel group uses the exposure duration M, and the second pixel group uses the exposure duration S; the exposure strategy for the fourth exposure within the exposure period is the same as that of the first exposure.

[0083] As another possible implementation, the first exposure control signal is used to control the first pixel group to perform multiple exposure operations according to the first exposure duration combination within the exposure period; the second exposure control signal is used to control the second pixel group to perform multiple exposure operations according to the second exposure duration within the exposure period.

[0084] Among them, the first exposure duration combination includes multiple exposure durations. It can be understood that the above implementation is: the first pixel group alternately exposes according to the exposure durations within the first exposure duration combination for each frame image within the exposure period; the exposure duration of the second pixel group is the same for each exposure within the exposure period.

[0085] Exemplarily, assume that the first exposure duration combination includes: exposure duration S, exposure duration M, and exposure duration M, and the second exposure duration is L; then as Figure 6 shown, the exposure strategy for the first exposure within the exposure period is that the first pixel group uses the exposure duration S, and the second pixel group uses the exposure duration L; the exposure strategy for the second exposure within the exposure period is that the first pixel group uses the exposure duration M, and the second pixel group uses the exposure duration L; the exposure strategy for the third exposure within the exposure period is that the first pixel group uses the exposure duration M, and the second pixel group uses the exposure duration L; the exposure strategy for the fourth exposure within the exposure period is the same as that of the first exposure.

[0086] It can be understood that for the pixels in the photosensitive pixel array unit 110, the amplitude of the optical signal they sense will also change with the change of the ambient light intensity. Therefore, if the pixels in the photosensitive pixel array unit 110 all use a unified and fixed exposure time, it is very difficult to ensure that each pixel in the pixel matrix will not cause overexposure of the photosensitive element due to too long exposure time at each moment; or, due to too short exposure time, the photosensitive element is underexposed, which is not conducive to the subsequent image processing effect. Therefore, the method provided in the embodiments of the present application can control the pixels in the photosensitive pixel array unit 110 to expose according to different exposure modes through multiple groups of independent control lines. By combining short exposure signals and long exposure signals, high-quality images with high signal-to-noise ratio and no blurred signals can be obtained.

[0087] The data reading unit 130 is configured to read the pixel data generated by the photosensitive pixel array unit 110 through exposure.

[0088] In some embodiments, the data reading unit 130 reads the pixel data generated by the photosensitive pixel array unit 110 through exposure via readout lines. Specifically, the pixels in each column in the vertical direction of the photosensitive pixel array unit 110 share the same set of readout lines, that is, the data reading is performed column by column. In this way, the data reading unit 130 reads the pixel data generated by the pixels in each column through the readout lines of each column.

[0089] In some embodiments, the data reading unit 130 includes N sets of readout lines, and the N sets of readout lines are used to read the pixel data generated by N pixel groups; one set of readout lines is connected to one pixel group. Specifically, taking the N sets of readout lines including the first set of readout lines and the second set of readout lines as an example (the first set of readout lines and the second set of readout lines are any two sets of readout lines among the N sets of readout lines), the data reading unit 130 is specifically configured to read the first pixel data generated by the first pixel group through the first set of readout lines; read the second pixel data generated by the second pixel group through the second set of readout lines.

[0090] Exemplarily, as Figure 1 shown, two sets of readout lines are provided for each column in the vertical direction of the photosensitive pixel array unit 110, wherein the first set of readout lines is used to read the first pixel data generated by the first pixel group; the second set of readout lines is used to read the second pixel data generated by the second pixel group. For example, the first set of readout lines C 1_0 of the first column is used to read the pixel data generated by the pixels R2C1 and R4C1 in the first column; wherein, the pixels R2C1 and R4C1 are both pixels of the first pixel group; the second set of readout lines C 1_1 of the first column is used to read the pixel data generated by the pixels R1C1 and R3C1 in the first column; wherein, the pixels R1C1 and R3C1 are both pixels of the second pixel group. Wherein, R x represents the row, C y represents the column, C y_0 represents the first set of readout lines for each column, and C y_1 represents the second set of readout lines for each column.

[0091] It can be understood that since the exposure durations corresponding to different exposure modes are different, there may be a situation where a group of pixels has completed exposure while another group of pixels has not, which may cause confusion in the readout timing sequence and the readout data to have gaps or redundancies. Therefore, the data readout unit 130 provided in the embodiments of the present application is configured with multiple groups of independent readout lines, which are respectively used to read out the pixel data generated by pixels in different exposure modes (i.e., different exposure durations). In this way, on the one hand, the pixel data generated by each pixel group can be read out in a timely manner without caching the pixel data generated by the pixel group and without waiting for other pixel groups to complete exposure, improving the efficiency of data readout; on the other hand, one group of readout lines corresponds to one pixel group (the exposure durations of the pixels in one pixel group are the same), which can avoid reading redundant data, reducing the amount of data entering the data transmission channel per unit time and lowering the bandwidth requirement for data transmission, effectively improving the efficiency of data transmission.

[0092] For example, assume that the exposure duration corresponding to the first exposure mode is 3 s and the exposure duration corresponding to the second exposure mode is 5 s. Since the exposure durations of the two groups are different, after the first pixel group completes exposure, it can directly read out the exposure data through the first readout line and then transmit it through the first transmission channel without waiting for the second pixel group to complete exposure, ensuring that the pixel data can be read out in a timely manner and effectively improving the readout and transmission efficiency of the pixel data; furthermore, after the second pixel group completes exposure, it can directly read out the second pixel data through the second readout line and then transmit it through the second transmission channel. There will be no gaps in the transmitted pixel data, reducing the bandwidth requirements for data readout and data transmission.

[0093] It should be noted that for the sake of understanding, Figure 1 only the first group of readout lines and the second group of readout lines among the N groups of readout lines are shown, but it does not mean that the data readout unit 130 only includes the first group of readout lines and the second group of readout lines. In some other embodiments, the data readout unit 130 may further include a third group of readout lines, a fourth group of readout lines, etc., and the embodiments of the present application do not limit this.

[0094] A data transmission unit 140, which is used to obtain the pixel data read out by the data readout unit 130 and transmit the pixel data through the transmission interface of the data transmission unit 140.

[0095] In some embodiments, the data transmission unit 140 receives and transmits the pixel data read out by the data readout unit 130 through a transmission channel and then transmits the pixel data through the transmission interface. Optionally, the transmission channel may be one or more transmission channels.

[0096] It should be noted that the embodiments of the present application do not limit the correspondence between the N groups of readout lines of the data readout unit 130 and one or more transmission channels of the data transmission unit 140. For ease of understanding, Figure 1 as shown in Figure 1 , the first group of readout lines is correspondingly connected to the first transmission channel, and the second group of readout lines is correspondingly connected to the second transmission channel. However, this does not mean that the correspondence between the N groups of readout lines of the data readout unit 130 and one or more transmission channels of the data transmission unit 140 can only be a one-to-one correspondence.

[0097] Optionally, the correspondence between the N groups of readout lines of the data readout unit 130 and one or more transmission channels of the data transmission unit 140 includes: one group of readout lines corresponding to multiple transmission channels; or, one group of readout lines corresponding to one transmission channel; or, N groups of readout lines corresponding to one transmission channel.

[0098] In some embodiments, the above-mentioned transmission channels can be physical transmission channels or virtual transmission channels, etc.

[0099] Exemplarily, assume that the first exposure control signal is to control the first pixel group to perform an exposure operation once with a first exposure duration during the exposure period; the second exposure control signal is to control the second pixel group to perform multiple exposure operations with a second exposure duration during the exposure period, where, as Figure 7 shown, the first exposure duration is L (Long), the second exposure duration is S (Short), and L > S; then as Figure 8 shown in (a) of Figure 8 , the pixel data obtained by the data transmission unit 140 at time t1 is the second pixel data generated by the second pixel group (because the first pixel group has not completed exposure at time t1); as Figure 8 shown in (b) of Figure 8 , the pixel data obtained by the data transmission unit 140 at time t2 is the first pixel data and the second pixel data.

[0100] Exemplarily, based on the above Figure 7 and Figure 8 , as Figure 9 shown, at time t1, the first pixel data generated by the first pixel group read out by the first group of readout lines is as Figure 9 shown in (a) of Figure 9 ; at time t2, the first pixel data generated by the first pixel group read out by the first group of readout lines, and the second pixel data generated by the second pixel group read out by the second group of readout lines are as Figure 9 shown in (b) of Figure 9 .

[0101] As can be seen from the above examples, since the image acquisition device provided in the embodiments of the present application uses multiple independent readout lines, even when the exposure modes of the pixels in the photosensitive pixel array 110 are different, the pixel data generated by each pixel group can be timely read out through the readout lines corresponding to each pixel group, and then transmitted to the data transmission unit 140 through the transmission channel, so that the transmission interface of the data transmission unit 140 can timely transmit the pixel data. In this way, there is no need to cache the pixel data generated by the pixel group, nor to wait for other pixel groups to complete exposure, and there is no extra redundant data generated, so there is no need to eliminate redundant data, which reduces the amount of data entering the data transmission channel per unit time, reduces the bandwidth requirement for data transmission, and can effectively improve the data transmission efficiency.

[0102] In some embodiments, the transmission interface is used to pack the received pixel data and then transmit it. For example, the transmission interface can pack the pixel data into the form of byte data or data blocks and then transmit it. Exemplarily, the transmission interface can be a mobile industry processor interface (MIPI). MIPI is a standardized interface protocol used to define the internal interface standard of electronic devices. For example, the MIPI data transmission unit receives the pixel data and the clock synchronization signal of the pixel data, and then divides the 8-bit pixel data according to the MIPI protocol and outputs it through the output channel.

[0103] Optionally, the data transmission unit 140 can simultaneously support multiple data type inputs such as RAW6, RAW7, RAW8, RAW10, RAW12, RAW14, YUV422 8bit, and YUV422 10bit.

[0104] In some embodiments, the image acquisition device further includes: a data processing unit ( Figure 1 not shown in the figure), which is used to obtain the pixel data collected by the data readout unit 130 through the transmission interface of the data transmission unit 140, restore the pixel data into a signal to be processed, and perform image processing on the signal to be processed.

[0105] The embodiments of the present application do not limit the form of the signal to be processed. For example, the above signal to be processed can be an image signal or a data stream signal, etc. Among them, the above image signal can be an image signal sorted according to the exposure duration; or, the image signal can be an image of different channels, where the different channels include but are not limited to the following channels: a luminance channel or a chrominance channel.

[0106] In some embodiments, the data processing unit is specifically configured to recombine pixel data based on one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data, to obtain a signal to be processed, and perform image processing on the signal to be processed. Among them, the image channels include: luminance channel, color channel, etc.

[0107] For example, the data processing unit may respectively construct image sequences corresponding to time instants t0, t1, and t2 according to the readout time order of the pixel data; alternatively, the data processing unit may respectively construct image sequences of a first pixel group, a second pixel group, and a third pixel group according to the pixel data of different pixel groups corresponding to different exposure control signals; alternatively, the data processing unit may respectively construct image sequences of a luminance channel and a color channel according to the image channel where the pixel data is located. Among them, the color channels are different in different image formats. For example, in an image in Bayer format, they may be an R (Red) channel, a G1 (Green) channel, a G2 (Green) channel, a B (Blue) channel, etc.

[0108] Exemplarily, as Figure 10 shown, the data processing unit obtains first pixel data and second pixel data through the output interface of the data transmission unit 140; furthermore, the data processing unit may recombine the first pixel data and the second pixel data based on the exposure duration and position information of the first pixel data and the second pixel data to obtain a signal to be processed, and perform image processing on the signal to be processed.

[0109] Exemplarily, as Figure 11 shown, the data processing unit obtains first pixel data and second pixel data through the output interface of the data transmission unit 140; furthermore, the data processing unit may recombine the first pixel data and the second pixel data based on the position information of the first pixel data and the second pixel data in different channels to obtain a signal to be processed, and perform image processing on the signal to be processed.

[0110] In some embodiments, the above data processing unit is specifically configured to perform image processing on the signal to be processed using a neural network.

[0111] Among them, image processing includes but is not limited to: Image Signal Processor (ISP) operations, intelligent processing, staining processing, or enhancement processing, etc.

[0112] Among them, ISP operations include: bad pixel correction, color interpolation, Gamma correction, color correction, RGB to YUV conversion, noise reduction, sharpening, etc.; intelligent processing includes: target recognition, target segmentation, target detection, etc.; staining processing includes: fluorescence staining, spectral staining, electron staining, etc.; enhancement processing includes: sharpness enhancement, brightness enhancement.

[0113] In some embodiments, the image acquisition device further includes: a bit width conversion unit ( Figure 1 not shown in the figure), which is located between the data readout unit 130 and the data transmission unit 140, and is used to perform bit width conversion on the pixel data read out by the data readout unit 130, for example, compress the bit width of the pixel data read out by the data readout unit 130.

[0114] In some embodiments, the bit width conversion unit is specifically configured to obtain first pixel data, convert the original bit width of the first pixel data into a first bit width, and then transmit it through the data transmission unit 140.

[0115] Among them, the first pixel data is the pixel data generated by the exposure of the first pixel group among N pixel groups.

[0116] In some embodiments, N pixel groups correspond to N groups of bit widths, and the N groups of bit widths are independent of each other. The first bit width is any one of the N bit widths. The first bit width is determined by the exposure duration of the first pixel group and / or the bandwidth of the data transmission unit 140.

[0117] Exemplarily, the first bit width is positively correlated with the exposure duration of the first pixel group. For example, if the exposure duration of the first pixel group is short, the first bit width corresponding to the first pixel data is small; the first bit width is positively correlated with the bandwidth of the data transmission unit 140. If the bandwidth of the data transmission unit 140 is small, the first bit width corresponding to the first pixel data is small.

[0118] In some embodiments, the bit width conversion unit is specifically configured to obtain second pixel data, convert the original bit width of the second pixel data into a second bit width, and then transmit it through the data transmission unit 140.

[0119] Among them, the second pixel data is the pixel data generated by the exposure of the second pixel group among N pixel groups.

[0120] In some embodiments, the second bit width is any one of the N bit widths. The second bit width is determined by the exposure duration of the second pixel group and / or the bandwidth of the data transmission unit 140.

[0121] Exemplarily, the second bit width is positively correlated with the exposure duration of the second pixel group. For example, if the exposure duration of the second pixel group is short, the second bit width corresponding to the second pixel data is small; the second bit width is positively correlated with the bandwidth of the data transmission unit 140. If the bandwidth of the data transmission unit 140 is small, the second bit width corresponding to the second pixel data is small.

[0122] Exemplarily, assume that the original bit widths of the first pixel data and the second pixel data obtained by the bit width conversion unit are both 12 bits, where the exposure duration of the first pixel data is greater than that of the second pixel data. Then, as Figure 12 shown, the data bit width conversion unit is used to adjust the bit widths of the first pixel data and the second pixel data respectively, that is, the pixels in one frame of image can have different bit widths. For example, the bit width of the second pixel data can be converted to 10 bits, and the bit width of the first pixel data remains 12 bits.

[0123] In some embodiments, the bit width conversion unit is further configured to perform bit width compression on data points that do not require a high bit width to reduce the data transmission pressure.

[0124] Exemplarily, as Figure 13 shown, assume that the original bit widths of the first pixel data and the second pixel data obtained by the bit width conversion unit are both 12 bits; after the bit width conversion unit performs bit width conversion, the first bit width corresponding to the first pixel data is 12 bits, and the second bit width corresponding to the second pixel data is 10 bits. Then, in the case where some pixels in the first pixel data and the second pixel data do not require a high bit width, the bit width conversion unit can perform data compression on this data point. For example, as Figure 13 shown, assume that the pixel data in the second column and the fourth column do not require a high bit width, then the bit width conversion unit can compress the bit widths of the pixel data in the second column and the fourth column to 8 bits.

[0125] It can be understood that, compared with the method of directly using a unified data bit width (such as unified to 8 bits, 10 bits, or 12 bits, etc.) for data transmission in the related art, the bit width conversion unit provided in the embodiments of the present application can adopt multiple data bit widths for pixels in different exposure modes and different photosensitive pixels, and convert the pixel data obtained according to different exposure modes into different data bit widths and then transmit them, which can effectively reduce the data transmission pressure.

[0126] In some embodiments, the image acquisition device further includes: a gain control unit ( Figure 1 not shown in the figure), configured to send a gain control signal to the pixels in the photosensitive pixel array unit 110, so that the pixels in the photosensitive pixel array unit 110 adjust the brightness value in the pixel data based on the gain control signal.

[0127] In some embodiments, the gain control unit sends a gain control signal to the pixels in the photosensitive pixel array unit 110 via a signal line.

[0128] The embodiments of the present application do not limit the setting form of the signal line. For example, the signal line may depend on the design type of a Complementary Metal-Oxide-Semiconductor (CMOS) sensor. In a possible implementation, the signal line is connected to the column amplifier of the photosensitive pixel array unit 110, and each column corresponds to a column amplifier (such as an analog programmable amplifier). The analog amplifiers with the same gain are connected using the same signal line.

[0129] Optionally, the gain control unit includes N groups of signal lines; the N groups of signal lines are used to send gain control signals to N pixel groups; one group of signal lines is connected to one pixel group.

[0130] Exemplarily, taking the N groups of signal lines including a first group of signal lines and a second group of signal lines as an example (the first group of signal lines and the second group of signal lines are any two groups of the N groups of signal lines), the gain control unit is specifically configured to send a first gain control signal to the first pixel group among the N pixel groups via the first group of signal lines, so that the first pixel group adjusts the brightness value in the first pixel data based on the first gain control signal; and send a second gain control signal to the second pixel group among the N pixel groups via the second group of signal lines, so that the second pixel group adjusts the brightness value in the second pixel data based on the second gain control signal.

[0131] Wherein, the second pixel data is the pixel data generated by the exposure of the second pixel group; the first pixel data is the pixel data generated by the exposure of the first pixel group.

[0132] In some embodiments, the gain value corresponding to the first gain control signal is determined by the photosensitivity of the first pixel group; the gain value corresponding to the second gain control signal is determined by the photosensitivity of the second pixel group.

[0133] It can be understood that during actual use, due to the spectral response characteristics of different channels, the photosensitivity of each channel may vary greatly; in addition, the exposure time between different channels may be different. If the sensor can only be configured with a gain suitable for the photosensitivity of a certain channel, then the images of other channels may be underexposed or overexposed, which is not conducive to the subsequent image processing effect. Therefore, the embodiments of the present application configure a gain control unit for the image acquisition device, and output different gain control signals to different pixel groups, so that pixels with different channels and different photosensitive characteristics can all achieve appropriate exposure.

[0134] The following provides a detailed description of a data reading method provided by an embodiment of the present application.

[0135] A data reading method provided by an embodiment of the present application is applied to an image acquisition device (such as Figure 1 the image acquisition device shown). The image acquisition device includes: a photosensitive pixel array unit, a data reading unit, a data transmission unit, a data processing unit, and a control component. The photosensitive pixel array unit includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the data reading unit includes N groups of readout lines, and the N groups of readout lines are used to read out the pixel data generated by the N pixel groups; one group of readout lines is connected to one pixel group.

[0136] Optionally, the method provided by an embodiment of the present application can be executed by the above control component. Exemplarily, the control component can be a server; or, the control component can be a central processing unit (CPU), a graphics processing unit (GPU), a general-purpose processor network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The control component can also be other devices with processing functions, such as circuits, devices, or software modules, and the present application does not make any restrictions on this.

[0137] Another exemplary, the control component can include one or more of an exposure control unit, a bit width conversion unit, or a gain control unit as shown in Figure 1 ...

[0138] As Figure 14 shown, the data reading method provided by an embodiment of the present application includes the following steps:

[0139] S301. Control the data reading unit to respectively read out the pixel data generated by the N pixel groups performing exposure operations through the N groups of readout lines.

[0140] Among them, the pixel data is the pixel value of the pixels in the photosensitive pixel array unit.

[0141] It should be noted that, for the convenience of description, the following takes N groups of readout lines including: the first group of readout lines and the second group of readout lines (the first group of readout lines and the second group of readout lines are any two groups of readout lines in the N groups of readout lines), and N pixel groups including: the first pixel group and the second pixel group (the first pixel group and the second pixel group are any two pixel groups in the N pixel groups) as an example for illustration, but it does not mean that the N groups of readout lines only include the first group of readout lines and the second group of readout lines; nor does it mean that the N pixel groups only include the first pixel group and the second pixel group. In some other embodiments, the N groups of readout lines may further include the third group of readout lines or the fourth group of readout lines, etc.; the N pixel groups may further include the third pixel group or the fourth pixel group, etc., and the embodiments of the present application do not limit this.

[0142] Exemplarily, the above step S301 can be implemented as: controlling the data readout unit to read out the first pixel data generated by the exposure of the first pixel group through the first group of readout lines; controlling the data readout unit to read out the second pixel data generated by the exposure of the second pixel group through the second group of readout lines.

[0143] For example, as Figure 1 shown, the first group of readout lines C in the first column 1_0 is used to read out the pixel data generated by the pixels R2C1 and R4C1 in the first column; among them, both the pixels R2C1 and R4C1 are pixels of the first pixel group; the second group of readout lines C in the first column 1_1 is used to read out the pixel data generated by the pixels R1C1 and R3C1 in the first column; among them, both the pixels R1C1 and R3C1 are pixels of the second pixel group. Among them, R x represents the row, C y represents the column, C y_0 represents the first group of readout lines in each column, and C y_1 represents the second group of readout lines in each column.

[0144] It can be understood that since the exposure durations corresponding to different exposure modes are different, there may be a situation where one group of pixels has completed exposure while the other group of pixels has not completed exposure, which will cause confusion in the readout timing and the situation of empty or redundant readout data. Therefore, the data readout unit 130 provided in the embodiments of the present application is configured with multiple groups of independent readout lines, which are respectively used to read out the pixel data generated by pixels in different exposure modes (i.e., different exposure durations), and can effectively avoid readout timing conflicts.

[0145] S302. Control the pixel data to be transmitted through the data transmission unit.

[0146] In some embodiments, before performing step S302, the above method further includes: converting the original bit width of the first pixel data into the first bit width, and converting the original bit width of the second pixel data into the second bit width.

[0147] Among them, the first pixel data is the pixel data generated by exposing the first pixel group among N pixel groups; the second pixel data is the pixel data generated by exposing the second pixel group among N pixel groups.

[0148] Optionally, the N pixel groups correspond to N groups of bit widths; the first bit width and the second bit width are any two groups of bit widths among the N bit widths.

[0149] Among them, the first bit width is determined by the exposure duration of the first pixel group and / or the bandwidth of the data transmission unit. Exemplarily, the first bit width is positively correlated with the exposure time of the first pixel data. For example, if the exposure time of the first pixel data is short, the first bit width corresponding to the first pixel data is small; the first bit width is positively correlated with the bandwidth of the first transmission channel. If the bandwidth of the first transmission channel is small, the first bit width corresponding to the first pixel data is small.

[0150] The second bit width is determined by the exposure duration of the second pixel group and / or the bandwidth of the data transmission unit; Exemplarily, the second bit width is positively correlated with the exposure time of the second pixel data. For example, if the exposure time of the second pixel data is short, the second bit width corresponding to the second pixel data is small; the second bit width is positively correlated with the bandwidth of the second transmission channel. If the bandwidth of the second transmission channel is small, the second bit width corresponding to the second pixel data is small.

[0151] In this way, the above step S302 can be implemented as: after converting the original bit width of the first pixel data to the first bit width, it is transmitted through the data transmission unit; after converting the original bit width of the second pixel data to the second bit width, it is transmitted through the data transmission unit.

[0152] It can be understood that compared with the method of directly using a unified data bit width (such as unified to 8 bits, 10 bits or 12 bits, etc.) for data transmission in the related art, the method provided by the embodiments of the present application can adopt multiple data bit widths for pixels in different exposure modes and different photosensitive pixels, and convert the pixel data obtained according to different exposure modes into different data bit widths and then transmit them, which can effectively reduce the data transmission pressure.

[0153] In some embodiments, the data transmission unit includes: one or more transmission channels and a transmission interface. Then, the above step S302 can be implemented as: receiving pixel data through one or more transmission channels, transmitting the pixel data to the transmission interface, and then transmitting it by the transmission interface.

[0154] Among them, the transmission channel can be a physical transmission channel or a virtual transmission channel, etc.

[0155] The transmission interface is used to pack the received pixel data and then transmit it. For example, the transmission interface can pack the pixel data into the form of byte data or data block and then transmit it.

[0156] In some embodiments, the above method further includes: transmitting the pixel data to the data processing unit through the data transmission unit, so that the data processing unit restores the pixel data into a signal to be processed and performs image processing on the signal to be processed.

[0157] Exemplarily, the above signal to be processed is obtained by the data processing unit reorganizing the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data.

[0158] Exemplarily, the above image processing on the signal to be processed includes: using a neural network to perform image processing on the signal to be processed.

[0159] It can be understood that based on the method provided in the embodiments of the present application, when the exposure modes of the pixels in the photosensitive pixel array are different, the corresponding pixel data can be read out through the readout lines corresponding to each pixel group. In this way, on the one hand, the pixel data generated by each pixel group can be read out in time, without caching the pixel data generated by the pixel group and without waiting for other pixel groups to complete exposure, improving the data readout efficiency; on the other hand, one set of readout lines corresponds to one pixel group (the exposure durations of the pixels in one pixel group are the same), which can avoid reading redundant data, reduce the amount of data entering the data transmission channel per unit time, reduce the bandwidth requirement of data transmission, and effectively improve the data transmission efficiency.

[0160] In some embodiments, the above control component includes N sets of control lines, and the N sets of control lines are used to send exposure control signals to N pixel groups; one set of control lines is connected to one pixel group. Exemplarily, the first set of control lines in the N sets of control lines is correspondingly connected to the first pixel group among the N pixel groups, and the second set of control lines in the N sets of control lines is correspondingly connected to the second pixel group among the N pixel groups.

[0161] Thus, before step S301, as Figure 15 shown, the above method further includes: the following steps S201-S202.

[0162] S201. Send a first exposure control signal to the first pixel group through the first control group of lines, so that the first pixel group performs exposure based on the first exposure control signal to obtain first pixel data.

[0163] In some embodiments, the first exposure control signal is used to control the first exposure start time and the first exposure end time of the first pixel group.

[0164] In some embodiments, the first exposure control signal is used to control the number of times and the exposure duration for the first pixel group to perform an exposure operation during an exposure period.

[0165] Exemplarily, the first exposure control signal is used to control the pixels in the first pixel group to perform exposure in a mode of using a first exposure duration or a combination of first exposure durations. When the pixels in the first pixel group use the first exposure duration, it indicates that the exposure strategies of the pixels in the first pixel group are the same during the exposure period, and each exposure uses the first exposure duration. The combination of first exposure durations may include multiple exposure durations. When the pixels in the first pixel group use the combination of first exposure durations, it indicates that the exposure strategies of the pixels in the first pixel group change periodically during the exposure period, that is, the pixels in the first pixel group can sequentially use the exposure durations in the combination of first exposure durations for exposure. For example, if the combination of first exposure durations includes: exposure duration S, exposure duration L, and exposure duration M, then when the pixels in the first pixel group perform exposure, the exposure duration of the first exposure is S, the exposure duration of the second exposure is L, the exposure duration of the third exposure is M, and then the exposure duration of the fourth exposure is S, and the exposure durations of the fifth and sixth exposures cycle through the exposure durations of the second and third exposures in sequence.

[0166] Exemplarily, as Figure 1 shown, the first set of control lines R in the first row 1_0 is used to send an exposure control signal to the pixels R1C2 and R1C4 in the first row, where the pixels R1C2 and R1C4 are both pixels in the first pixel group. Among them, R x represents a row, C y represents a column, and R x_0 represents the first set of control lines for each row.

[0167] In some embodiments, the control component further includes N sets of signal lines; the N sets of signal lines are used to send a gain control signal to N pixel groups, and one set of signal lines is connected to one pixel group. Based on this, the above method further includes: sending a first gain control signal to the first pixel group among the N pixel groups through the first set of signal lines among the N sets of signal lines, so that the first pixel group adjusts the brightness value in the first pixel data based on the first gain control signal.

[0168] Wherein, the first pixel data is the pixel data generated by the first pixel group during exposure.

[0169] S202. Send a second exposure control signal to the second pixel group through the second set of control lines, so that the second pixel group performs exposure based on the second exposure control signal to obtain second pixel data.

[0170] In some embodiments, the second exposure control signal is used to control the second exposure start time and the second exposure end time of the second pixel group; wherein, the first exposure start time is different from the second exposure start time; and / or, the first exposure end time is different from the second exposure end time.

[0171] In some embodiments, the second exposure control signal is used to control the number of exposure operations and the exposure duration of the second pixel group during the exposure period.

[0172] Exemplarily, the above second exposure control signal is used to control the pixels in the second pixel group to perform exposure in a mode of using a second exposure duration or a combination of second exposure durations. When the pixels in the second pixel group use the second exposure duration, it indicates that the exposure strategies of the pixels in the second pixel group are the same during the exposure period, and each exposure uses the second exposure duration. The combination of second exposure durations may include multiple exposure durations. When the pixels in the second pixel group use the combination of second exposure durations, it indicates that the exposure strategies of the pixels in the second pixel group are periodically changed during the exposure period, that is, the pixels in the second pixel group can sequentially use the exposure durations in the combination of second exposure durations for exposure. For example, if the combination of second exposure durations includes: exposure duration L, exposure duration L, and exposure duration M, then when the pixels in the second pixel group perform exposure, the exposure duration of the first exposure is L, the exposure duration of the second exposure is L, the exposure duration of the third exposure is M, and then the exposure duration of the fourth exposure is L, and the exposure durations of the fifth and sixth exposures cycle through the exposure durations of the second and third exposures in sequence.

[0173] Exemplarily, as Figure 1 shown, the second set of control lines R 1_1 in the first row is used to send an exposure control signal to the pixel R1C1 and the pixel R1C3 in the first row, wherein both the pixel R1C1 and the pixel R1C3 are pixels in the second pixel group. R x_1 represents the second set of control lines for each row

[0174] In some embodiments, the above method further includes: sending a second gain control signal to the second pixel group in the N pixel groups through the second set of signal lines in the N sets of signal lines, so that the second pixel group adjusts the brightness value in the second pixel data based on the second gain control signal.

[0175] Wherein, the second pixel data is the pixel data generated by the second pixel group during exposure.

[0176] It can be understood that, during actual use, due to the spectral response characteristics of different channels, the photosensitivity of each channel may vary significantly; in addition, the exposure times between different channels may be different. If the sensor can only be configured with a gain suitable for the photosensitivity of a certain channel, then the images of other channels will be underexposed or overexposed, which is not conducive to subsequent image processing effects. Therefore, in the embodiments of the present application, different gain control signals are output to different pixel groups to enable pixels with different channels and different photosensitivity characteristics to achieve appropriate exposure.

[0177] It can be understood that, for the pixels in the pixel array, the amplitude of the optical signal they perceive will also change with the change of the ambient light intensity. Therefore, if all the pixels in the pixel array use a unified and fixed exposure time, it is difficult to ensure that each pixel in the pixel matrix will not be overexposed due to too long exposure time at each moment; or underexposed due to too short exposure time, which is not conducive to subsequent image processing effects. Therefore, the method provided in the embodiments of the present application can control the pixels in the pixel array to be exposed according to different exposure modes through multiple groups of independent control lines. By combining short exposure signals and long exposure signals, a high-quality image with a high signal-to-noise ratio and no blurred signals can be obtained.

[0178] The embodiments of the present application provide a schematic structural diagram of the control component involved in the above embodiments. As Figure 16 shown, the control component 400 includes: a processor 402, a communication interface 403, and a bus 404. Optionally, the control component 400 may further include a memory 401.

[0179] The processor 402 may be used to implement or execute various exemplary logic blocks, modules, and circuits described in connection with the disclosure of the present application. The processor 402 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in connection with the disclosure of the present application. The processor 402 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0180] The communication interface 403 is used to connect to other devices through a communication network. The communication network may be an Ethernet, a wireless access network, a wireless local area network (WLAN), etc.

[0181] The memory 401 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or can also be an electrically erasable programmable read-only memory (EEPROM), a magnetic disk storage medium or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0182] As a possible implementation, the memory 401 can exist independently of the processor 402. The memory 401 can be connected to the processor 402 through the bus 404 for storing instructions or program codes. When the processor 402 calls and executes the instructions or program codes stored in the memory 401, the data reading method provided by the embodiments of the present application can be implemented.

[0183] In another possible implementation, the memory 401 can also be integrated with the processor 402.

[0184] The bus 404 can be an extended industry standard architecture (EISA) bus, etc. The bus 404 can be divided into an address bus, a data bus, a control bus, etc. For the sake of convenience of representation, Figure 16 only a thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.

[0185] Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and conciseness of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the control component is divided into different functional modules to complete all or part of the functions described above.

[0186] The embodiments of the present application also provide a computer-readable storage medium. All or part of the processes in the above method embodiments can be completed by computer instructions instructing relevant hardware. The program can be stored in the above computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The computer-readable storage medium can be the memory in any of the foregoing embodiments. The above computer-readable storage medium can also be an external storage device of the above control component, such as a plug-in hard disk equipped on the above control component, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. Further, the above computer-readable storage medium can also include both the internal storage unit of the above control component and the external storage device. The above computer-readable storage medium is used to store the above computer program and other programs and data required by the above control component. The above computer-readable storage medium can also be used to temporarily store the data that has been output or will be output.

[0187] The embodiments of the present application also provide a computer program product. The computer product includes a computer program. When the computer program product runs on a computer, it causes the computer to execute any one of the data reading methods provided in the above embodiments.

[0188] Although the present application is described in combination with various embodiments herein, however, in the process of implementing the claimed present application, those skilled in the art can understand and achieve other variations of the disclosed embodiments by viewing the drawings, the disclosed content, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "one" does not exclude a plurality. A single processor or other unit can implement several functions recited in the claims. Certain measures are recited in mutually different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0189] Although the present application is described in combination with specific features and their embodiments, obviously, various modifications and combinations can be made without departing from the spirit and scope of the present application. Accordingly, the present specification and the drawings are only exemplary descriptions of the present application defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of the present application. Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these changes and modifications.

[0190] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An image acquisition device, characterized in that, Comprising: A photosensitive pixel array unit, an exposure control unit, a data readout unit, and a data transmission unit; The photosensitive pixel array unit is configured to perform exposure according to an exposure control signal; The photosensitive pixel array unit includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; The exposure control unit includes N groups of control lines, and the N groups of control lines are used to transmit exposure control signals to the N pixel groups; one group of control lines is connected to one pixel group; The data readout unit is configured to read out pixel data generated by the exposure of the photosensitive pixel array unit; the data readout unit includes N groups of readout lines, and the N groups of readout lines are used to read out pixel data generated by the N pixel groups; one group of readout lines is connected to one pixel group; The control line group and the readout line group connected to the same pixel group correspond to each other; The data transmission unit is configured to transmit the pixel data collected by the data readout unit through a transmission interface of the data transmission unit.

2. The device according to claim 1, wherein The data readout unit is specifically configured to read out first pixel data generated by a first pixel group through a first group of readout lines; read out second pixel data generated by a second pixel group through a second group of readout lines; wherein, the first group of readout lines and the second group of readout lines are any two groups of readout lines among the N groups of readout lines; the first pixel group and the second pixel group are any two pixel groups among the N pixel groups.

3. The device according to claim 1, characterized in that, The image acquisition device further includes: a bit-width conversion unit; The bit-width conversion unit is configured to acquire first pixel data, convert an original bit-width of the first pixel data into a first bit-width, and then transmit it through the data transmission unit; the first pixel data is pixel data generated by the exposure of the first pixel group among the N pixel groups; Acquire second pixel data, convert an original bit-width of the second pixel data into a second bit-width, and then transmit it through the data transmission unit; the second pixel data is pixel data generated by the exposure of the second pixel group among the N pixel groups; the N pixel groups correspond to N groups of bit-widths; the first bit-width and the second bit-width are any two groups of bit-widths among the N groups of bit-widths; wherein, the converted bit-width is less than or equal to the original bit-width.

4. The device according to claim 3, wherein The N groups of bit-widths are independent of each other; wherein, the first bit-width is determined by an exposure duration of the first pixel group and / or a bandwidth of the data transmission unit; the second bit-width is determined by an exposure duration of the second pixel group and / or a bandwidth of the data transmission unit.

5. The device according to claim 1, wherein The data transmission unit includes one or more transmission channels; the data transmission unit is specifically configured to transmit the pixel data collected by the data readout unit to the transmission interface through the one or more transmission channels, and then the transmission interface performs the transmission.

6. The device according to claim 1, wherein The image acquisition device further includes: a data processing unit; The data processing unit is configured to acquire the pixel data collected by the data readout unit through the transmission interface, restore the pixel data into a signal to be processed, and perform image processing on the signal to be processed.

7. The device according to claim 6, characterized in that, The data processing unit is specifically configured to recombine the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data, to obtain a signal to be processed, and perform image processing on the signal to be processed.

8. The device according to claim 6, characterized in that The data processing unit is specifically configured to perform image processing on the signal to be processed by using a neural network.

9. The device according to claim 1, wherein The exposure control unit is configured to send a first exposure control signal to the first pixel group through a first set of control lines, so that the first pixel group performs exposure based on the first exposure control signal; send a second exposure control signal to the second pixel group through a second set of control lines, so that the second pixel group performs exposure based on the second exposure control signal; the first set of control lines and the second set of control lines are any two sets of control lines among the N sets of control lines; the first pixel group and the second pixel group are any two pixel groups among the N pixel groups.

10. The device according to claim 9, characterized in that, The first exposure control signal is used to control the first exposure start time and the first exposure end time of the first pixel group; the second exposure control signal is used to control the second exposure start time and the second exposure end time of the second pixel group; and / or, the first exposure control signal is used to control the number of exposure operations and the exposure duration of the first pixel group within an exposure period; the second exposure control signal is used to control the number of exposure operations and the exposure duration of the second pixel group within an exposure period.

11. The device according to claim 1, wherein The image acquisition device further includes: a gain control unit; the gain control unit includes N sets of signal lines; the N sets of signal lines are used to transmit gain control signals to the N pixel groups; one set of signal lines is connected to one pixel group; The gain control unit is configured to send a first gain control signal to the first pixel group through a first set of signal lines, so that the first pixel group adjusts the brightness value in the first pixel data based on the first gain control signal; the first pixel data is the pixel data generated by the first pixel group during exposure; send a second gain control signal to the second pixel group through a second set of signal lines, so that the second pixel group adjusts the brightness value in the second pixel data based on the second gain control signal; the second pixel data is the pixel data generated by the second pixel group during exposure; the first set of signal lines and the second set of signal lines are any two sets of signal lines among the N sets of signal lines; the first pixel group and the second pixel group are any two pixel groups among the N pixel groups.

12. A data reading method, characterized in that, Applied to an image acquisition device, the image acquisition device includes: a photosensitive pixel array unit, an exposure control unit, a data readout unit, a data transmission unit, a data processing unit, and a control component. The photosensitive pixel array unit includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the exposure control unit includes N groups of control lines, and the N groups of control lines are used to transmit exposure control signals to the N pixel groups; one group of control lines is connected to one pixel group; the data readout unit includes N groups of readout lines, and the N groups of readout lines are used to read out pixel data generated by the N pixel groups; one group of readout lines is connected to one pixel group; the control line group and the readout line group connected to the same pixel group correspond to each other; the method is applied to the control component; the method includes: Controlling the data readout unit to respectively read out pixel data generated by the N pixel groups performing exposure operations through the N groups of readout lines; Controlling the pixel data to be transmitted through the data transmission unit.

13. The method according to claim 12, characterized in that, The controlling the data readout unit to respectively read out pixel data generated by the N pixel groups performing exposure operations through the N groups of readout lines includes: Controlling the data readout unit to read out first pixel data generated by a first pixel group through a first group of readout lines; Controlling the data readout unit to read out second pixel data generated by a second pixel group through a second group of readout lines; wherein, the first group of readout lines and the second group of readout lines are any two groups of readout lines among the N groups of readout lines; the first pixel group and the second pixel group are any two pixel groups among the N pixel groups.

14. The method according to claim 12, wherein Before the controlling the pixel data to be transmitted through the data transmission unit, the method further includes: Obtaining first pixel data and converting the original bit width of the first pixel data to a first bit width; the first pixel data is pixel data generated by the first pixel group among the N pixel groups performing exposure; Obtaining second pixel data and converting the original bit width of the second pixel data to a second bit width; the second pixel data is pixel data generated by the second pixel group among the N pixel groups performing exposure; the N pixel groups correspond to N groups of bit widths; the first bit width and the second bit width are any two groups of bit widths among the N groups of bit widths; The controlling the pixel data to be transmitted through the data transmission unit includes: After converting the original bit width of the first pixel data to the first bit width, transmitting it through the data transmission unit; After converting the original bit width of the second pixel data to the second bit width, transmitting it through the data transmission unit; Wherein, the converted bit width is less than or equal to the original bit width.

15. The method according to claim 14, wherein The N groups of bit widths are independent of each other; wherein, the first bit width is determined by the exposure duration of the first pixel group and / or the bandwidth of the data transmission unit; the second bit width is determined by the exposure duration of the second pixel group and / or the bandwidth of the data transmission unit.

16. The method according to claim 12, wherein The method further includes: Control the data transmission unit to transmit the pixel data collected by the data reading unit to the data processing unit, so that the data processing unit restores the pixel data into a signal to be processed and performs image processing on the signal to be processed.

17. The method according to claim 16, characterized in that The signal to be processed is obtained by the data processing unit reorganizing the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data.

18. The method according to claim 12, wherein The control component includes N groups of control lines; the N groups of control lines are used to transmit exposure control signals to the N pixel groups; one group of control lines is connected to one pixel group; Before controlling the data reading unit to read out the pixel data generated by the N pixel groups performing exposure operations through the N groups of readout lines, the method further includes: Send a first exposure control signal to the first pixel group through the first group of control lines, so that the first pixel group performs exposure based on the first exposure control signal; Send a second exposure control signal to the second pixel group through the second group of control lines, so that the second pixel group performs exposure based on the second exposure control signal; the first group of control lines and the second group of control lines are any two groups of the N groups of control lines; the first pixel group and the second pixel group are any two pixel groups of the N pixel groups.

19. The method according to claim 18, characterized in that, The first exposure control signal is used to control the first exposure start time and the first exposure end time of the first pixel group; the second exposure control signal is used to control the second exposure start time and the second exposure end time of the second pixel group; And / or, the first exposure control signal is used to control the number of exposure operations and the exposure duration of the first pixel group during the exposure period; the second exposure control signal is used to control the number of exposure operations and the exposure duration of the second pixel group during the exposure period.

20. The method according to claim 12, wherein The control component further includes N groups of signal lines; the N groups of signal lines are used to transmit gain control signals to the N pixel groups; one group of signal lines is connected to one pixel group; the method further includes: Send a first gain control signal to the first pixel group through the first group of signal lines, so that the first pixel group adjusts the brightness value in the first pixel data based on the first gain control signal; the first pixel data is the pixel data generated by the first pixel group performing exposure; Send a second gain control signal to the second pixel group through the second group of signal lines, so that the second pixel group adjusts the brightness value in the second pixel data based on the second gain control signal; the second pixel data is the pixel data generated by the second pixel group performing exposure; the first group of signal lines and the second group of signal lines are any two groups of the N groups of signal lines; the first pixel group and the second pixel group are any two pixel groups of the N pixel groups.

21. A control component, characterized in that, Including: One or more processors; One or more memories; Wherein, the one or more memories are used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the control component executes the data reading method according to any one of claims 12 to 20.

22. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions run on a computer, the computer is caused to execute the data reading method according to any one of claims 12 to 20.

Images