An image acquisition device, a data transmission method, a control component, and a storage medium

Abstract

The present application discloses an image acquisition device, a data transmission method, a control component, and a storage medium, relating to the technical field of image sensors. It is used for efficiently transmitting pixel data. The image acquisition device includes: a data acquisition unit for acquiring pixel data generated by the exposure of a photosensitive pixel array; wherein, the photosensitive pixel array includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; a bit-width conversion unit for dividing the pixel data acquired by the data acquisition unit into Q groups and respectively performing bit-width conversion on the Q groups of pixel data; Q is an integer greater than or equal to 2; a data transmission unit including P transmission channels for transmitting the Q groups of pixel data that have undergone bit-width conversion through the P transmission channels; P is an integer greater than or equal to 2.

Description

Technical Field

[0001] This application relates to the technical field of image sensors, and particularly to an image acquisition device, a data transmission method, a control component, and a storage medium. Background Art

[0002] An image sensor uses a photosensitive pixel array to collect image signals. During the process of collecting image signals, the photosensitive element of each pixel responds to incident light under the corresponding exposure duration, and then converts the optical signal sensed at that point into an electrical signal. After being collected and amplified by a readout circuit, it is converted into a digital signal by an analog-to-digital converter (ADC).

[0003] In related technologies, the exposure modes of image sensors include long exposure and short exposure, etc. If all the pixels in the pixel array of the image sensor adopt the form of long exposure, the obtained image has a high signal-to-noise ratio, but there may be blurring or overexposure; if all the pixels in the pixel array of the image sensor adopt the form of short exposure, the obtained image does not have blurred signals, but the signal-to-noise ratio of this image is low.

[0004] It can be understood that for the same pixel, the amplitude of the optical signal it senses will also change with the change of the ambient light intensity. Therefore, if all pixels adopt a unified and fixed exposure time, it is very difficult to ensure that each pixel in the pixel matrix will not be overexposed due to too long exposure time at each moment; or underexposed due to too short exposure time, which is not conducive to subsequent image processing effects. If the exposure time of each pixel is not unified, then when reading out, if only a single data readout line is used, it is easy to cause confusion in the readout timing and reduce the data readout and transmission efficiency. Summary of the Invention

[0005] This application provides an image acquisition device, a data transmission method, a control component, and a storage medium for efficiently transmitting pixel data.

[0006] In a first aspect, this application provides an image acquisition device, including: a data acquisition unit, a bit-width conversion unit, and a data transmission unit; the data acquisition unit is used to acquire pixel data generated by the exposure of a photosensitive pixel array; wherein, the photosensitive pixel array includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the bit-width conversion unit is used to divide the pixel data acquired by the data acquisition unit into Q groups, and respectively perform bit-width conversion on the Q groups of pixel data; Q is an integer greater than or equal to 2; the data transmission unit includes P transmission channels and is used to transmit the Q groups of pixel data after bit-width conversion through the P transmission channels; P is an integer greater than or equal to 2.

[0007] It can be understood that in the image acquisition device provided in this application, the photosensitive pixel array includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; a readout circuit for collecting pixel data generated by the photosensitive pixel array; a bit-width conversion unit for dividing the pixel data collected by the readout circuit into Q groups and performing bit-width conversion on the Q groups of pixel data respectively; Q is an integer greater than or equal to 2; a data transmission unit for transmitting the Q groups of pixel data after bit-width conversion through P transmission channels; P is an integer greater than or equal to 2. In this way, when the pixels in the photosensitive pixel array execute different exposure modes respectively under the control of different exposure control signals and generate a large amount of pixel data, the bit-width conversion unit can perform bit-width compression on different groups of pixel data respectively to reduce the data volume and improve the transmission efficiency; at the same time, the data transmission unit can transmit data through multiple transmission paths to avoid bandwidth limitation and improve the data transmission efficiency.

[0008] Since in the case where there are many pixel exposure modes in the photosensitive pixel array, the pixel data generated by multiple groups of pixels during exposure is also large. If a single bit-width is used to transmit all the pixel data, the transmission efficiency is low. Therefore, the image acquisition device provided in the embodiments of this application adopts multiple bit-widths, divides the pixel data generated by the pixels in the photosensitive pixel array into Q groups, and performs bit-width conversion on each group of pixel data independently to compress the bit-width of each group of pixel data. In this way, the data volume can be reduced, the data volume entering the transmission channels of the data transmission unit per unit time can be reduced, and the data transmission efficiency can be improved.

[0009] In a possible implementation manner, the bit-width conversion unit is specifically configured to convert the original bit-width of the first pixel data to be converted into a first bit-width and then transmit it through the data transmission unit; the first bit-width is less than or equal to the original bit-width of the first pixel data to be converted; the first pixel data to be converted is any one of the Q groups of pixel data; convert the original bit-width of the second pixel data to be converted into a second bit-width and then transmit it through the data transmission unit; the second bit-width is less than or equal to the original bit-width of the second pixel data to be converted; the second pixel data to be converted is any one of the Q groups of pixel data; the Q groups of pixel data correspond to Q bit-widths; the first bit-width and the second bit-width are any two of the Q bit-widths.

[0010] In another possible implementation manner, the above Q bit-widths are independent of each other; wherein, the first bit-width is determined by the exposure duration of the first pixel data to be converted and / or the bandwidth of the data transmission unit; the second bit-width is determined by the exposure duration of the second pixel data to be converted and / or the bandwidth of the data transmission unit.

[0011] In another possible implementation, the data acquisition unit includes: a readout circuit; the readout circuit includes M groups of readout lines, and the M groups of readout lines are used to read the pixel data generated by M groups of target rows; one group of readout lines is connected to the pixels in one group of target rows; the arrangement of the pixel exposure patterns among the pixels in the same group of target rows is the same; M is an integer greater than or equal to 2 and less than or equal to N.

[0012] In another possible implementation, the corresponding relationship between the above-mentioned P transmission channels and the above-mentioned M groups of readout lines includes: one group of readout lines corresponds to one transmission channel; or, one group of readout lines corresponds to multiple transmission channels; or, multiple groups of readout lines correspond to one transmission channel.

[0013] In another possible implementation, the image acquisition device further includes: a data processing unit; the data processing unit is configured to obtain pixel data through the data transmission unit, restore the pixel data into a signal to be processed, and perform image processing on the signal to be processed.

[0014] In another possible implementation, the data processing unit is specifically configured to reorganize the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data, to obtain a signal to be processed, and perform image processing on the signal to be processed.

[0015] In another possible implementation, the data processing unit is specifically configured to perform image processing on the signal to be processed by using a neural network.

[0016] In a second aspect, the present application provides a data transmission method, which is applied to an image acquisition device. The image acquisition device includes: a data acquisition unit, a bit-width conversion unit, a data transmission unit, a data processing unit, and a control component. The data acquisition unit is used to acquire pixel data generated by the exposure of a photosensitive pixel array; wherein, the photosensitive pixel array includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the bit-width conversion unit is used to perform bit-width conversion; the data transmission unit includes P transmission channels, and P is an integer greater than or equal to 2; the method is applied to the control component; the method includes: controlling the bit-width conversion unit to divide the pixel data acquired by the data acquisition unit into Q groups, and respectively perform bit-width conversion on the Q groups of pixel data; Q is an integer greater than or equal to 2; controlling the Q groups of pixel data after bit-width conversion to be transmitted through the P transmission channels.

[0017] In a possible implementation, the above control bit-width conversion unit divides the pixel data acquired by the data acquisition unit into Q groups, and performs bit-width conversion on the Q groups of pixel data respectively, including: converting the original bit-width of the first pixel data to be converted to the first bit-width; the first bit-width is less than or equal to the original bit-width of the first pixel data to be converted; the first pixel data to be converted is any one of the Q groups of pixel data; converting the original bit-width of the second pixel data to be converted to the second bit-width; the second bit-width is less than or equal to the original bit-width of the second pixel data to be converted; the second pixel data to be converted is any one of the Q groups of pixel data; the Q groups of pixel data correspond to Q groups of bit-widths; the first bit-width and the second bit-width are any two groups of bit-widths among the Q bit-widths; the above control passes the Q groups of pixel data after bit-width conversion through P transmission channels for transmission, including: after converting the original bit-width of the first pixel data to be converted to the first bit-width, transmitting it through P transmission channels; after converting the original bit-width of the second pixel data to be converted to the second bit-width, transmitting it through P transmission channels.

[0018] In another possible implementation, the above Q groups of bit-widths are independent of each other; wherein, the first bit-width is determined by the exposure duration of the first pixel data to be converted and / or the bandwidth of the data transmission unit; the second bit-width is determined by the exposure duration of the second pixel data to be converted and / or the bandwidth of the data transmission unit.

[0019] In another possible implementation, the above data acquisition unit includes: a readout circuit; the readout circuit includes M groups of readout lines, and the M groups of readout lines are used to read the pixel data generated by the exposure of M groups of target rows; one group of readout lines is connected to the pixels in one group of target rows; the arrangement mode of the pixel exposure modes between the same group of target rows is the same; M is an integer greater than or equal to 2 and less than or equal to N.

[0020] In another possible implementation, the corresponding relationship between the above P transmission channels and the above M groups of readout lines includes: one group of readout lines corresponds to one transmission channel; or, one group of readout lines corresponds to multiple transmission channels; or, multiple groups of readout lines correspond to one transmission channel.

[0021] In another possible implementation, the above method further includes: controlling the data transmission unit to transmit the pixel data acquired by the data transmission unit to the data processing unit, so that the data processing unit restores the pixel data into a signal to be processed and performs image processing on the signal to be processed.

[0022] In another possible implementation, the above signal to be processed is obtained by the data processing unit reorganizing the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data.

[0023] In a third aspect, the present application provides a control component, including: one or more processors; one or more memories; wherein, the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the control component executes the data transmission method provided in any possible implementation manner of the second aspect above.

[0024] In a fourth aspect, the present application provides a computer-readable storage medium storing computer-executable instructions. When the computer-executable instructions run on a computer, the computer is caused to execute the data transmission method provided in any possible implementation manner of the second aspect above.

[0025] The descriptions of the second to fourth aspects in the present application may refer to the detailed description of the first aspect; and, for the beneficial effects of the descriptions of the second to fourth aspects, reference may be made to the analysis of the beneficial effects of the first aspect, which will not be elaborated here. Description of the Drawings

[0026] Figure 1 is a schematic structural diagram of an image acquisition device provided by an embodiment of the present application Figure 1 ;

[0027] Figure 2 is a schematic diagram of a photosensitive pixel array provided by an embodiment of the present application;

[0028] Figure 3 is a schematic diagram of an exposure operation provided by an embodiment of the present application Figure 1 ;

[0029] Figure 4 is a schematic diagram of an exposure operation provided by an embodiment of the present application Figure 2 ;

[0030] Figure 5 is a schematic diagram of an exposure operation provided by an embodiment of the present application Figure 3 ;

[0031] Figure 6 is a schematic diagram of an exposure operation provided by an embodiment of the present application Figure 4 ;

[0032] Figure 7 is a schematic structural diagram of an image acquisition device provided by an embodiment of the present application Figure 2 ;

[0033] Figure 8 is a schematic structural diagram of an image acquisition device provided by an embodiment of the present application Figure 3 ;

[0034] Figure 9Schematic diagram of an exposure mode provided by an embodiment of the present application;

[0035] Figure 10 Schematic illustration of pixel data provided by an embodiment of the present application Figure 1 ;

[0036] Figure 11 Schematic illustration of pixel data provided by an embodiment of the present application Figure 2 ;

[0037] Figure 12 Schematic illustration of recombined pixel data provided by an embodiment of the present application Figure 1 ;

[0038] Figure 13 Schematic illustration of recombined pixel data provided by an embodiment of the present application Figure 2 ;

[0039] Figure 14 Schematic illustration of data bit width conversion provided by an embodiment of the present application Figure 1 ;

[0040] Figure 15 Schematic illustration of data bit width conversion provided by an embodiment of the present application Figure 2 ;

[0041] Figure 16 Flow chart of a data transmission method provided by an embodiment of the present application Figure 1 ;

[0042] Figure 17 Flow chart of a data transmission method provided by an embodiment of the present application Figure 2 ;

[0043] Figure 18 Schematic diagram of the structure of a control component provided by an embodiment of the present application. Detailed implementation manners

[0044] In this article, the term "and / or" only describes the associated relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone.

[0045] Terms such as "first" and "second" in the specification and drawings of the present application are used to distinguish different objects or different processes for the same object, rather than to describe the specific order of the objects.

[0046] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally further include other steps or units not listed, or may optionally further include other steps or units inherent to these processes, methods, products, or devices.

[0047] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0048] In the description of this application, unless otherwise specified, the meaning of "a plurality of" refers to two or more.

[0049] As in the background art, in the related art, the exposure modes of an image sensor include long exposure and short exposure, etc. If all the pixels in the pixel array of the image sensor adopt the form of long exposure, the obtained image has a high signal-to-noise ratio, but there may be situations of blurring or overexposure; if all the pixels in the pixel array of the image sensor adopt the form of short exposure, the obtained image has no blurred signal, but the signal-to-noise ratio of this image is low.

[0050] It can be understood that for the same pixel, the amplitude of the optical signal it senses will also change with the change of the ambient light intensity. Therefore, if all pixels adopt a unified and fixed exposure time, it is very difficult to ensure that each pixel in the pixel matrix will not be overexposed due to too long exposure time at every moment; or, due to too short exposure time, the photosensitive element is underexposed, which is not conducive to the subsequent image processing effect. If the exposure time of each pixel is not unified, then when reading out, if only a single data readout line is used, it is easy to cause confusion in the readout timing and reduce the data readout and transmission efficiency.

[0051] In view of the above technical problems, an embodiment of the present application provides an image acquisition device, including: a data acquisition unit, a bit width conversion unit, and a data transmission unit; wherein, the photosensitive pixel array includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; a readout circuit for acquiring pixel data generated by the photosensitive pixel array; the bit width conversion unit is used to divide the pixel data acquired by the readout circuit into Q groups and perform bit width conversion on the Q groups of pixel data respectively; Q is an integer greater than or equal to 2; a data transmission unit for transmitting the Q groups of pixel data after bit width conversion through P transmission channels; P is an integer greater than or equal to 2. In this way, when the pixels in the photosensitive pixel array execute different exposure modes respectively under the control of different exposure control signals and generate a large amount of pixel data, the bit width conversion unit can perform bit width compression on different groups of pixel data respectively to reduce the data volume and improve the transmission efficiency; at the same time, the data transmission unit can transmit data through multiple transmission paths to avoid bandwidth limitations and improve the data transmission efficiency.

[0052] It can be understood that, when there are many pixel exposure modes in the photosensitive pixel array, the pixel data generated by the exposure of multiple pixel groups is also large. If a single bit width is used to transmit all the pixel data, the transmission efficiency is low. Therefore, the image acquisition device provided by the embodiment of the present application adopts multiple bit widths, divides the pixel data generated by the pixels in the photosensitive pixel array into Q groups, and performs bit width conversion on each group of pixel data independently to compress the bit width of each group of pixel data. In this way, the data volume can be reduced, the data volume entering the transmission channels of the data transmission unit per unit time can be reduced, and the data transmission efficiency can be improved.

[0053] At the same time, the data transmission unit in the image acquisition device provided by the embodiment of the present application uses at least two transmission paths to transmit the pixel data acquired by the data acquisition unit, which can share the pressure of data transmission, solve the problem of low transmission efficiency caused by the limitation of the transmission path bandwidth, and effectively improve the data transmission efficiency.

[0054] In addition, the above N pixel groups are respectively controlled by different exposure control signals, so that the pixels in the photosensitive pixel array can be exposed according to different exposure modes. By combining short exposure signals and long exposure signals, a high-quality image with a high signal-to-noise ratio and no blurred signal can be obtained.

[0055] Next, specific introduction to the embodiments provided by the present application will be given in conjunction with the accompanying drawings of the specification.

[0056] Please refer to Figure 1 which shows a schematic structural diagram of an image acquisition device provided by an embodiment of the present application. As Figure 1As shown, the image acquisition device may include: a data acquisition unit 110, an exposure control unit 120, and a data transmission unit 130.

[0057] In some embodiments, as Figure 1 shown, the data acquisition unit 110 is connected to the exposure control unit 120 through a control line, and the data transmission unit 130 includes a transmission channel. The data acquisition unit 110 is connected to the data transmission unit 130 through the transmission channel.

[0058] The data acquisition unit 110 is configured to acquire pixel data generated by the exposure of the photosensitive pixel array.

[0059] In some embodiments, the data acquisition unit 110 includes: a photosensitive pixel array 111 and a readout circuit 112. Among them, the photosensitive pixel array 111 is configured to perform exposure according to an exposure control signal; the readout circuit 112 is configured to read out the pixel data generated by the exposure of the photosensitive pixel array 111.

[0060] Among them, the above pixel data includes the pixel values of the pixels in the photosensitive pixel array 111.

[0061] In some embodiments, the photosensitive pixel array 111 includes a plurality of pixels, and the plurality of pixels are arranged in a pixel matrix of X*Y; where X and Y are both integers greater than 1.

[0062] In some embodiments, each pixel in the photosensitive pixel array 111 includes a photosensitive component, and the photosensitive component is configured to sense an optical signal. The exposure of the photosensitive pixel array 111 means that the photosensitive components of the pixels in the photosensitive pixel array 1111 respond to incident light during the corresponding exposure duration and generate an electrical signal according to the photoelectric effect. Generally, the longer the exposure time of a pixel, the more electrical signal (such as charge) generated by the pixel according to the photoelectric effect, and the larger the pixel value corresponding to the pixel.

[0063] In some embodiments, the photosensitive pixel array 111 includes N pixel groups; where the N pixel groups are independent of each other and are respectively controlled by different exposure control signals. Among them, N is an integer greater than or equal to 2.

[0064] It should be noted that for ease of understanding, Figure 1 only the first pixel group and the second pixel group among the N pixel groups are shown (the first pixel group and the second pixel group are any two pixel groups among the N pixel groups), but it does not mean that the photosensitive pixel array 111 only includes the first pixel group and the second pixel group. In some other embodiments, the photosensitive pixel array 111 may further include a third pixel group, a fourth pixel group, etc., and the embodiments of the present application do not limit this.

[0065] In some embodiments, the division of pixel groups in the photosensitive pixel array 111 has diversity, and the pixels in each pixel group can be discretely distributed at different positions in the photosensitive pixel array 111. Exemplarily, assuming that the pixels in the photosensitive pixel array 111 can be divided into four pixel groups A, B, C, and D, the positions of the pixels in the four pixel groups in the photosensitive pixel array 111 can be in the form as Figure 2 shown.

[0066] Exemplarily, the pixel groups can be divided according to the incident light amount of the color channels corresponding to the pixels in the photosensitive pixel array 111 in different brightness environments. For example, according to the preset color distribution of the color image, a color filter array is deployed on the incident light surface when the photosensitive pixel array 111 is exposed, so that the ambient light can be filtered by the color filter array and converted into monochromatic light of different color channels, and respectively projected onto the corresponding pixels in the photosensitive pixel array 111. Thus, different pixels in the photosensitive pixel array 111 can respectively sense the monochromatic light of different color channels, so that the exposure data output by the photosensitive pixel array 111 can contain color information. Exemplarily, in the above case, the pixels in the photosensitive pixel array 111 can be divided into multiple pixel groups according to, for example, the light amount, and independently controlled for exposure, so as to achieve differential exposure for different ambient brightnesses and different field of view ranges. For example, if the ambient brightness of the field of view corresponding to a region of the photosensitive pixel array 111 is higher, the exposure duration of the pixel groups included in that region can be shorter; conversely, if the ambient brightness of the field of view corresponding to a region of the photosensitive pixel array 111 is lower, the exposure duration of the pixel groups included in that region can be longer.

[0067] In some embodiments, the readout circuit 112 reads out the pixel data generated by the exposure of the photosensitive pixel array 111 through readout lines. Specifically, the pixels on each column in the vertical direction of the photosensitive pixel array 111 share the same set of readout lines, that is, the data readout is performed column by column. In this way, the readout circuit 112 reads out the pixel data generated by the pixels on each column through the readout lines of each column.

[0068] In some embodiments, the readout circuit 112 includes M groups of readout lines, and the M groups of readout lines are used to read out the pixel data generated by the pixels in M groups of target rows; one group of readout lines is connected to the pixels in one group of target rows; wherein, the arrangement mode of the pixel exposure modes between the same group of target rows is the same; M is an integer greater than or equal to 2 and less than or equal to N.

[0069] Among them, the number of groups M of target rows is determined according to the arrangement mode of the pixel exposure patterns of each row in the photosensitive pixel array 111. Exemplarily, if the photosensitive pixel array 111 includes: the first row, the second row, the third row, and the fourth row, where the arrangement modes of the pixel exposure patterns of the first row, the second row, and the third row are the same, and the arrangement mode of the pixel exposure pattern of the fourth row is different from that of the first row, the second row, and the third row, then the photosensitive pixel array 111 includes two groups of target rows; among them, the first group of target rows includes: the first row, the second row, and the third row; the second group of target rows includes: the fourth row.

[0070] The pixel exposure pattern can be understood as the exposure duration adopted by the pixel during exposure. The arrangement mode of the pixel exposure patterns can be understood as the types of exposure patterns adopted by the pixels at different positions in any row of the photosensitive pixel array 111. For example, the first pixel in this row adopts the first exposure mode, the second pixel in this row adopts the second exposure mode, the third pixel in this row adopts the first exposure mode, and the fourth pixel in this row adopts the second exposure mode; the arrangement mode of the pixel exposure patterns in this row is: the first exposure mode, the second exposure mode, the first exposure mode, the second exposure mode.

[0071] Exemplarily, as Figure 1 shown, white pixels represent the first pixel group that is exposed according to the first exposure control signal, and black pixels represent the second pixel group that is exposed according to the second exposure control signal, that is, the exposure patterns of white pixels and black pixels are different. Assume that the first group of target rows includes: the first row and the third row in the photosensitive pixel array 111; the second group of target rows includes: the second row and the fourth row in the photosensitive pixel array 111. In this way, it can be seen that the arrangement mode of the exposure patterns of the pixels in the first group of target rows is: black, white, black, white; the arrangement mode of the exposure patterns of the pixels in the second group of target rows is: white, black, white, black. That is, the arrangement modes of the exposure patterns of the pixels in the first group of target rows and the second group of target rows are different. At the same time, as Figure 1 shown, the arrangement modes of the pixels in the same group of target rows are the same. For example, the first row and the third row of the photosensitive pixel array 111 are both the first group of target rows, and the arrangement modes of the exposure patterns of the pixels in the first row and the third row are the same.

[0072] It should be noted that for the sake of easy understanding, in the embodiments of the present application, the first group of target rows and the second group of target rows in the M groups of target rows are taken as examples for description, but it does not mean that the photosensitive pixel array 111 only includes the first group of target rows and the second group of target rows. In some other embodiments, the photosensitive pixel array 111 may further include a third group of target rows, a fourth group of target rows, etc., and the embodiments of the present application do not limit this.

[0073] Specifically, taking the M groups of readout lines including a first group of readout lines and a second group of readout lines (the first group of readout lines and the second group of readout lines are any two groups of readout lines among the M groups of readout lines), and the M groups of target rows including a first group of target rows and a second group of target rows (the first group of target rows and the second group of target rows are any two groups of target rows among the M groups of target rows) as an example, the readout circuit 112 is specifically configured to read out a first data set generated by exposing the first group of target rows through the first group of readout lines; and read out a second data set generated by exposing the second group of target rows through the second group of readout lines.

[0074] It should be noted that in the embodiments of the present application, the first data set mentioned is a set of pixel data generated by pixels in the first group of target rows; the second data set is a set of pixel data generated by pixels in the second group of target rows; the first pixel data is pixel data generated by pixels in the first pixel group; and the second pixel data is pixel data generated by pixels in the second pixel group. Optionally, the first group of target rows may include pixels in the first pixel group and / or pixels in the second pixel group; the second group of target rows may include pixels in the first pixel group and / or pixels in the second pixel group.

[0075] Exemplarily, as Figure 1 shown, assuming that the first group of target rows includes: the first row and the third row in the photosensitive pixel array 111; and the second group of target rows includes: the second row and the fourth row in the photosensitive pixel array 111. Then, two groups of readout lines are provided for each column in the vertical direction of the photosensitive pixel array 111, where the first group of readout lines is used to read out the first data set generated by the first group of target rows; and the second group of readout lines is used to read out the second data set generated by the second group of target rows. For example, the first group of readout lines C 1_0 in the first column is used to read out the pixel data generated by the pixel R 1 C 1 in the first column; the first group of readout lines C 2_0 in the second column is used to read out the pixel data generated by the pixel R 1 C 2 in the second column; the first group of readout lines C 3_0 in the third column is used to read out the pixel data generated by the pixel R 1 C 3 in the third column; the first group of readout lines C 4_0 in the fourth column is used to read out the pixel data generated by the pixel R 1 C 4 in the fourth column; where the pixel R 1 C 1 , the pixel R 1 C 2 , the pixel R 1 C 3 , the pixel R 1 C 4All are pixels in the first group of target rows; the second group of readout lines C in the first column 1_1 For reading out the pixels R in the first column 2 C 1 The generated pixel data; the second group of readout lines C in the second column 2_1 For reading out the pixels R in the second column 2 C 2 The generated pixel data; the second group of readout lines C in the third column 3_1 For reading out the pixels R in the third column 2 C 3 The generated pixel data; the second group of readout lines C in the fourth column 4_1 For reading out the pixels R in the fourth column 2 C 4 The generated pixel data; wherein, the pixel R 2 C 1 The pixel R 2 C 2 The pixel R 2 C 3 The pixel R 2 C 4 All are pixels in the second group of target rows. Wherein, R x Represents a row, C y Represents a column, C y_0 Represents the first group of readout lines for each column, C y_1 Represents the second group of readout lines for each column.

[0076] It can be understood that in the case where there are many pixel exposure modes in the photosensitive pixel array 111, more pixel data is generated through exposure. If only read through a single readout line, it is easy to cause confusion in the readout timing. Therefore, the readout circuit 112 in the image acquisition device provided in the embodiments of the present application uses M groups of readout lines, which are respectively connected to M groups of target rows in the photosensitive pixel array 111. In this way, the pixel data generated by exposing the pixels in the target row can be read out in time, and the readout timing confusion can be avoided.

[0077] It should be noted that for the sake of understanding, Figure 1 Only the first group of readout lines and the second group of readout lines in the M groups of readout lines are shown, but it does not mean that the readout circuit 112 only includes the first group of readout lines and the second group of readout lines. In some other embodiments, the readout circuit 112 may further include a third group of readout lines and a fourth group of readout lines, etc. The embodiments of the present application do not limit this.

[0078] The exposure control unit 120 is configured to send an exposure control signal to the photosensitive pixel array 111.

[0079] In some embodiments, the exposure control unit 120 sends an exposure control signal to the photosensitive pixel array 111 via a control line. Specifically, pixels on each row in the horizontal direction of the photosensitive pixel array 111 share the same set of control lines, that is, exposure control is performed row by row. Thus, the exposure control unit 120 sends an exposure control signal to the pixels on each row via the control lines of each row.

[0080] In some embodiments, the exposure control unit 120 includes N sets of control lines, and the N sets of control lines are used to transmit an exposure control signal to N pixel groups; one set of control lines is connected to one pixel group. Specifically, taking the N sets of control lines including the first set of control lines and the second set of control lines as an example, the exposure control unit 120 is specifically configured to send a first exposure control signal to the first pixel group via the first set of control lines, so that the first pixel group performs exposure based on the first exposure control signal to obtain first pixel data; send a second exposure control signal to the second pixel group among the N pixel groups via the second set of control lines in the N sets of control lines, so that the second pixel group performs exposure based on the second exposure control signal to obtain second pixel data.

[0081] Exemplarily, as Figure 1 shown, two sets of control lines are arranged on each row in the horizontal direction of the photosensitive pixel array 111, wherein the first set of control lines is used to send a first exposure control signal to the first pixel group; the second set of control lines is used to send an exposure control signal to the second pixel group. For example, the first set of control lines R 1_0 of the first row is used to send an exposure control signal to the pixels R 1 C 2 and the pixel R 1 C 4 in the first row, wherein the pixels R 1 C 2 and the pixel R 1 C 4 are both pixels in the first pixel group; the second set of control lines R 1_1 of the first row is used to send an exposure control signal to the pixels R 1 C 1 and the pixel R 1 C 3 in the first row, wherein the pixels R 1 C 1 and the pixel R 1 C 3 are both pixels in the second pixel group. Among them, R x represents a row, C y represents a column, R x_0 represents the first set of control lines of each row, and R x_1 represents the second set of control lines of each row.

[0082] It should be noted that for the convenience of understanding, Figure 1 only the first set of control lines and the second set of control lines among the N sets of control lines are shown, but this does not mean that the exposure control unit 120 only includes the first set of control lines and the second set of control lines. In some other embodiments, the exposure control unit 120 may further include a third set of control lines, a fourth set of control lines, etc., and the embodiments of the present application do not limit this.

[0083] In some embodiments, the first exposure control signal is used to control the first exposure start time and the first exposure end time of the first pixel group; the second exposure control signal is used to control the second exposure start time and the second exposure end time of the second pixel group; wherein, the first exposure start time is different from the second exposure start time; and / or, the first exposure end time is different from the second exposure end time.

[0084] Wherein, the first exposure start time and the first exposure end time determine the exposure duration of the first pixel group; the second exposure start time and the second exposure end time determine the exposure duration of the second pixel group.

[0085] In some embodiments, the first exposure control signal is used to control the number of exposure operations and the exposure duration of the first pixel group during the exposure period; the second exposure control signal is used to control the number of exposure operations and the exposure duration of the second pixel group during the exposure period.

[0086] As a possible implementation manner, the first exposure control signal is used to control the first pixel group to perform one exposure operation according to the first exposure duration during the exposure period; the second exposure control signal is used to control the second pixel group to perform one exposure operation according to the second exposure duration during the exposure period.

[0087] Wherein, the first exposure duration is different from the second exposure duration.

[0088] Exemplarily, assuming that the first exposure duration is S and the second exposure duration is L, as Figure 3 shown, then within one exposure period, the pixels in the first pixel group all perform one exposure operation with the first exposure duration S, and the pixels in the second pixel group all perform one exposure operation with the second exposure duration L.

[0089] As another possible implementation manner, the first exposure control signal is used to control the first pixel group to perform multiple exposure operations according to the first exposure duration during the exposure period; the second exposure control signal is used to control the second pixel group to perform multiple exposure operations according to the second exposure duration during the exposure period.

[0090] Wherein, the first exposure duration is different from the second exposure duration.

[0091] Exemplarily, assuming that the first exposure duration is S and the second exposure duration is L, asFigure 4 As shown in the figure, within one exposure period, the pixels in the first pixel group all perform multiple exposure operations with the first exposure duration S, and the pixels in the second pixel group all perform multiple exposure operations with the second exposure duration L.

[0092] As another possible implementation, the first exposure control signal is used to control the first pixel group to perform multiple exposure operations in accordance with the first exposure duration combination within the exposure period; the second exposure control signal is used to control the second pixel group to perform multiple exposure operations in accordance with the second exposure duration combination within the exposure period.

[0093] Among them, both the first exposure duration combination and the second exposure duration combination include multiple exposure durations, and the first exposure duration combination is different from the second exposure duration combination. It can be understood that the above exposure mode is that a group of pixels in the photosensitive pixel array 111 are exposed in accordance with the exposure duration combination in the time domain, which means that within one exposure period, the pixels on the photosensitive pixel array 111 adopt multiple exposure durations within the exposure duration combination and perform exposure alternately. That is, the exposure strategy for each exposure within the exposure period changes periodically.

[0094] Exemplarily, assume that the first exposure duration combination includes: exposure duration S, exposure duration M, and exposure duration M, and the second exposure duration combination includes: exposure duration L, exposure duration L, and exposure duration S; then as Figure 5 shown, the exposure strategy for the first exposure within the exposure period is that the first pixel group adopts the exposure duration S and the second pixel group adopts the exposure duration L; the exposure strategy for the second exposure within the exposure period is that the first pixel group adopts the exposure duration M and the second pixel group adopts the exposure duration L; the exposure strategy for the third exposure within the exposure period is that the first pixel group adopts the exposure duration M and the second pixel group adopts the exposure duration S; the exposure strategy for the fourth exposure within the exposure period is the same as that for the first exposure.

[0095] As yet another possible implementation, the first exposure control signal is used to control the first pixel group to perform multiple exposure operations in accordance with the first exposure duration combination within the exposure period; the second exposure control signal is used to control the second pixel group to perform multiple exposure operations with the second exposure duration within the exposure period.

[0096] Among them, the first exposure duration combination includes multiple exposure durations. It can be understood that the above implementation is as follows: the first pixel group alternately exposes in accordance with the exposure durations within the first exposure duration combination for each frame of image within the exposure period; the exposure duration for each exposure of the second pixel group is the same.

[0097] Exemplarily, assume that the first exposure duration combination includes: exposure duration S, exposure duration M, and exposure duration M, and the second exposure duration is L; then as Figure 6As shown, the exposure strategy for the first exposure within the exposure period is that the first pixel group uses an exposure duration of S, and the second pixel group uses an exposure duration of L; the exposure strategy for the second exposure within the exposure period is that the first pixel group uses an exposure duration of M, and the second pixel group uses an exposure duration of L; the exposure strategy for the third exposure within the exposure period is that the first pixel group uses an exposure duration of M, and the second pixel group uses an exposure duration of L; the exposure strategy for the fourth exposure within the exposure period is the same as that for the first exposure.

[0098] It can be understood that for the pixels in the photosensitive pixel array 111, the amplitude of the optical signal they perceive will also change with the change of the ambient light intensity. Therefore, if all the pixels in the photosensitive pixel array 111 use a unified and fixed exposure time, it is very difficult to ensure that each pixel in the pixel matrix will not cause overexposure of the photosensitive element due to too long exposure time at every moment; or, due to too short exposure time, it will cause underexposure of the photosensitive element, which is not conducive to the subsequent image processing effect. Therefore, the method provided in the embodiments of the present application can control the pixels in the photosensitive pixel array 111 to perform exposure according to different exposure modes through multiple groups of independent control lines. By combining short exposure signals and long exposure signals, a high-quality image with a high signal-to-noise ratio and no blurred signals can be obtained.

[0099] The data transmission unit 130 is used to acquire the pixel data acquired by the data acquisition unit 110 and transmit the pixel data through the transmission channel of the data transmission unit 130.

[0100] In some embodiments, the data transmission unit 130 further includes a transmission interface. Then, the data transmission unit 130 receives and transmits the pixel data read out by the readout circuit 112 through the transmission channel, and then transmits the pixel data through the transmission interface.

[0101] Optionally, the data transmission unit 130 includes P transmission channels, where P is an integer greater than or equal to 2. Then, the data transmission unit 130 is specifically used to transmit the pixel data through P transmission channels.

[0102] It can be understood that the data transmission unit 130 uses at least two transmission paths to transmit the pixel data acquired by the readout circuit, which can share the pressure of data transmission, solve the problem of low transmission efficiency caused by the limitation of the transmission path bandwidth, and can effectively improve the data transmission efficiency.

[0103] It should be noted that the embodiments of the present application do not limit the correspondence between the M groups of readout lines of the readout circuit 112 and the P transmission channels of the data transmission unit 130.

[0104] Exemplarily, such as Figure 1As shown, the correspondence between the M groups of readout lines of the readout circuit 112 and the P transmission channels of the data transmission unit 130 can be a one-to-one correspondence. For example, the first group of readout lines is correspondingly connected to the first transmission channel, and the second group of readout lines is correspondingly connected to the second transmission channel.

[0105] In another example, as Figure 7 shown, the correspondence between the M groups of readout lines of the readout circuit 112 and the P transmission channels of the data transmission unit 130 can be that one group of readout lines corresponds to multiple transmission channels; for example, the first group of readout lines corresponds to the first transmission channel and the second transmission channel.

[0106] In another example, as Figure 8 shown, the correspondence between the M groups of readout lines of the readout circuit 112 and the P transmission channels of the data transmission unit 130 can be that multiple groups of readout lines correspond to one transmission channel; for example, the first group of readout lines and the second group of readout lines correspond to the first transmission channel.

[0107] In some embodiments, the above-mentioned transmission channels can be physical transmission channels, virtual transmission channels, etc.

[0108] Exemplarily, assume that the first exposure control signal is to control the first pixel group to perform an exposure operation once with a first exposure duration within the exposure period; the second exposure control signal is to control the second pixel group to perform multiple exposure operations with a second exposure duration within the exposure period, where, as Figure 9 shown, the first exposure duration is L (Long), the second exposure duration is S (Short), and L > S; then as Figure 10 shown in (a) of Figure 10 , the pixel data obtained by the data transmission unit 130 at time t1 is the pixel data generated by the second pixel group in the first group of target rows and the second group of target rows (because the first pixel group has not completed exposure at time t1); as

[0109] shown in (b) of Figure 9 and Figure 10 , the pixel data obtained by the data transmission unit 130 at time t2 is the pixel data generated by the first pixel group and the second pixel group in the first group of target rows and the second group of target rows.

[0109] Exemplarily, based on the above Figure 9 and Figure 10 , as Figure 11 shown, at time t1, the first data set of the first group of target rows read out by the first group of readout lines, and the second data set of the second group of target rows read out by the second group of readout lines are as Figure 11As shown in (a) therein, it can be seen that at time t1, both the first data set and the second data set only include pixel data generated by the exposure of the pixels in the second pixel group; at time t2, the first data set of the first set of target rows read out by the first set of readout lines and the second data set of the second set of target rows read out by the second set of readout lines are as shown in Figure 11 As shown in (b) therein, it can be seen that at time t2, both the first data set and the second data set include pixel data generated by the exposure of the pixels in the first pixel group and the second pixel group.

[0110] As can be seen from the above example, since the image acquisition device provided by the embodiments of the present application uses multiple groups of mutually independent readout lines, therefore, in the case where the exposure modes of the pixels in the photosensitive pixel array 111 are different, the pixel data generated by the target row can also be timely read out through the readout lines corresponding to each group of target rows, and then transmitted to the data transmission unit 130 through the transmission channel, so that the transmission interface of the data transmission unit 130 timely transmits the pixel data.

[0111] It can be understood that in the case where there are many pixel exposure modes in the photosensitive pixel array 111, the pixel data generated by the exposure is also more. If only a single readout line is used for reading, it is easy to cause confusion in the readout timing. Therefore, the readout circuit 112 in the image acquisition device provided by the embodiments of the present application uses M groups of readout lines, which are respectively connected to M groups of target rows in the photosensitive pixel array 111. In this way, the pixel data generated by the exposure of the pixels in the target row can be timely read out, and the readout timing confusion can be avoided, and the accuracy and efficiency of data readout can be improved.

[0112] In some embodiments, the transmission interface is used to pack the received pixel data and then transmit it. For example, the transmission interface can pack the pixel data into the form of byte data or data block and then transmit it. Exemplarily, the transmission interface can be a mobile industry processor interface (MIPI). MIPI is a standardized interface protocol for defining the internal interface standard of electronic devices. For example, the MIPI data data transmission unit receives the pixel data and the clock synchronization signal of the pixel data, and then divides the 8bit pixel data according to the MIPI protocol and outputs it through the output channel.

[0113] Optionally, the data transmission unit 130 can simultaneously support the input of multiple data types such as RAW6, RAW7, RAW8, RAW10, RAW12, RAW14, YUV422 8bit, and YUV422 10bit.

[0114] In some embodiments, the image acquisition device further includes: a data processing unit ( Figure 1 not shown in the figure) configured to obtain pixel data acquired by the data acquisition unit 110 through the data transmission unit 130, restore the pixel data into a signal to be processed, and perform image processing on the signal to be processed.

[0115] The embodiments of the present application do not limit the form of the signal to be processed. For example, the signal to be processed may be an image signal or a data stream signal, etc. Among them, the above-mentioned image signal may be an image signal sorted according to the exposure duration; or, the image signal may be images of different channels, where the different channels include but are not limited to the following channels: a luminance channel or a chrominance channel.

[0116] In some embodiments, the data processing unit is specifically configured to reorganize the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data, to obtain a signal to be processed, and perform image processing on the signal to be processed. Among them, the image channels include: a luminance channel, a color channel, etc.

[0117] For example, the data processing unit may respectively construct image sequences corresponding to time instants t0, t1, and t2 according to the readout time sequence of the pixel data; or, the data processing unit may respectively construct image sequences of a first pixel group, a second pixel group, and a third pixel group according to the pixel data of different pixel groups corresponding to different exposure control signals; or, the data processing unit may respectively construct image sequences of a luminance channel and a color channel according to the image channel where the pixel data is located. Among them, the color channels are different in different image formats. For example, in an image in the Bayer format, they may be an R (Red) channel, a G1 (Green) channel, a G2 (Green) channel, a B (Blue) channel, etc.

[0118] Exemplarily, as Figure 12 shown, the data processing unit obtains a first data set and a second data set through the output interface of the data transmission unit 130; furthermore, the data processing unit may reorganize the pixel data in the first data set and the second data set according to the exposure duration and position information of the pixel data in the first data set and the second data set, to obtain a signal to be processed, and perform image processing on the signal to be processed.

[0119] Exemplarily, as Figure 13As shown, the data processing unit obtains the first data set and the second data set through the output interface of the data transmission unit 130; further, the data processing unit can recombine the pixel data in the first data set and the second data set according to the position information of the pixel data in different channels in the first data set and the second data set to obtain a signal to be processed, and perform image processing on the signal to be processed.

[0120] In some embodiments, the above data processing unit is specifically configured to perform image processing on the signal to be processed using a neural network.

[0121] Among them, image processing includes but is not limited to: Image Signal Processor (ISP) operations, intelligent processing, staining processing, or enhancement processing, etc.

[0122] Among them, ISP operations include: dead pixel correction, color interpolation, Gamma correction, color correction, RGB to YUV conversion, noise reduction, sharpening, etc.; intelligent processing includes: target recognition, target segmentation, target detection, etc.; staining processing includes: fluorescence staining, spectral staining, electron staining, etc.; enhancement processing includes: sharpness enhancement, brightness enhancement.

[0123] In some embodiments, the image acquisition device further includes: a bit width conversion unit ( Figure 1 not shown in the figure), which is located between the readout circuit 112 and the data transmission unit 130, and is used to perform bit width conversion on the pixel data read out by the readout circuit 112. For example, compress the bit width of the pixel data read out by the readout circuit 112.

[0124] In some embodiments, the bit width conversion unit is specifically configured to divide the pixel data collected by the readout circuit into Q groups, and perform bit width conversion on the Q groups of pixel data respectively. Wherein, Q is an integer greater than or equal to 2.

[0125] Optionally, the number of N pixel groups is the same as the number of Q groups of pixel data; or, the number of N pixel groups is different from the number of Q groups of pixel data. For example, if each pixel group in the N pixel groups can respectively correspond to a different bit width, and the bits corresponding to the pixels within each pixel group are the same, then the number of N pixel groups is the same as the number of Q groups of pixel data; if some pixel groups in the N pixel groups can correspond to the same bit width, and the other part of the pixel groups need to respectively correspond to different bit widths, then the number of N pixel groups is different from the number of Q groups of pixel data.

[0126] Optionally, the number of P transmission channels is the same as the number of Q groups of pixel data; or, the number of P transmission channels is different from the number of Q groups of pixel data.

[0127] In some embodiments, the data transmission unit 130 is further configured to transmit the Q groups of pixel data after bit-width conversion through P transmission channels.

[0128] In some embodiments, the bit-width conversion unit is specifically configured to convert the original bit-width of the first pixel data to be converted to the first bit-width and then transmit it through the data transmission unit; convert the original bit-width of the second pixel data to be converted to the second bit-width and then transmit it through the data transmission unit.

[0129] Wherein, the first pixel data to be converted is any group of pixel data in the Q groups of pixel data; the second pixel data to be converted is any group of pixel data in the Q groups of pixel data; the Q groups of pixel data correspond to Q bit-widths; the first bit-width and the second bit-width are any two groups of bit-widths in the Q bit-widths.

[0130] Optionally, the first pixel data to be converted may be the first pixel data generated by the first pixel group; or, the first pixel data to be converted may be the second pixel data generated by the second pixel group; or, the first pixel data to be converted may be the pixel data generated by any one of the N pixel groups. The second pixel data to be converted may be the first pixel data generated by the first pixel group; or, the second pixel data to be converted may be the second pixel data generated by the second pixel group; or, the second pixel data to be converted may be the pixel data generated by any one of the N pixel groups.

[0131] In some embodiments, the first bit-width is less than or equal to the original bit-width of the first pixel data to be converted; the first bit-width is determined by the exposure duration of the first pixel data to be converted and / or the bandwidth of the data transmission unit 130.

[0132] Exemplarily, the first bit-width is positively correlated with the exposure duration of the first pixel data to be converted. For example, if the exposure duration of the first pixel data to be converted is short, the corresponding first bit-width of the first pixel data to be converted is small; the first bit-width is positively correlated with the bandwidth of the data transmission unit 130. If the bandwidth of the data transmission unit 130 is small, the corresponding first bit-width of the first pixel data to be converted is small.

[0133] In some embodiments, the second bit-width is less than or equal to the original bit-width of the second pixel data to be converted; the second bit-width is determined by the exposure duration of the second pixel data to be converted and / or the bandwidth of the data transmission unit 130.

[0134] Exemplarily, the second bit-width is positively correlated with the exposure duration of the second pixel data to be converted. For example, if the exposure duration of the second pixel data to be converted is short, the corresponding second bit-width of the second pixel data to be converted is small; the second bit-width is positively correlated with the bandwidth of the data transmission unit 130. If the bandwidth of the data transmission unit 130 is small, the corresponding second bit-width of the second pixel data to be converted is small.

[0135] Exemplarily, it is assumed that the original bit widths of the first pixel data to be converted and the second pixel data to be converted obtained by the bit width conversion unit are both 12 bits, where the exposure duration of the first pixel data to be converted is greater than that of the second pixel data to be converted. Then, as Figure 14 shown, the data bit width conversion unit is used to adjust the bit widths of the first pixel data to be converted and the second pixel data to be converted respectively, that is, the pixels in one frame of image can have different bit widths. For example, the bit width of the second pixel data to be converted can be converted to 10 bits, and the bit width of the first pixel data to be converted remains 12 bits.

[0136] In some embodiments, the bit width conversion unit is further configured to perform bit width compression on data points that do not require a high bit width, so as to reduce the data transmission pressure.

[0137] Exemplarily, as Figure 15 shown, it is assumed that the original bit widths of the first pixel data to be converted and the second pixel data to be converted obtained by the bit width conversion unit are both 12 bits; after the bit width conversion unit performs bit width conversion, the bit width of the first pixel data to be converted is converted to the first bit width of 12 bits, and the bit width of the second pixel data to be converted is converted to the second bit width of 10 bits. Then, in the case where some pixels do not require a high bit width, the bit width conversion unit can perform data compression on this data point. For example, as Figure 15 shown, it is assumed that the pixel data in the second column and the fourth column do not require a high bit width, then the bit width conversion unit can compress the bit widths of the pixel data in the second column and the fourth column to 8 bits.

[0138] It can be understood that, compared with the method of directly using a unified data bit width (such as unified to 8 bits, 10 bits or 12 bits, etc.) for data transmission in the related art, the bit width conversion unit provided in the embodiments of the present application can adopt multiple data bit widths for pixels in different exposure modes and different photosensitive pixels, and convert the pixel data obtained according to different exposure modes into different data bit widths and then perform transmission, which can effectively reduce the data transmission pressure.

[0139] In some embodiments, the image acquisition device further includes: a gain control unit ( Figure 1 not shown in the figure), configured to send a gain control signal to the pixels in the photosensitive pixel array 111, so that the pixels in the photosensitive pixel array 111 adjust the brightness value in the pixel data based on the gain control signal.

[0140] In some embodiments, the gain control unit sends a gain control signal to the pixels in the photosensitive pixel array 111 through a signal line.

[0141] The embodiments of the present application do not limit the setting form of the signal line. For example, the signal line can depend on the design type of a Complementary Metal-Oxide-Semiconductor (CMOS) sensor. In one possible implementation, the signal line is connected to the column amplifier of the photosensitive pixel array 111, and each column corresponds to a column amplifier (such as an analog programmable amplifier). The analog amplifiers with the same gain are connected by the same signal line.

[0142] Optionally, the gain control unit includes N groups of signal lines; the N groups of signal lines are used to send gain control signals to N pixel groups; one group of signal lines is connected to one pixel group.

[0143] Exemplarily, the gain control unit is specifically configured to send a first gain control signal to the first pixel group among the N pixel groups through the first group of signal lines in the N groups of signal lines, so that the first pixel group adjusts the brightness value in the first pixel data based on the first gain control signal; the first pixel data is the pixel data generated by the exposure of the first pixel group.

[0144] Wherein, the gain value corresponding to the first gain control signal is determined by the photosensitive amount of the first pixel group.

[0145] The gain control unit is specifically configured to send a second gain control signal to the second pixel group among the N pixel groups through the second group of signal lines in the N groups of signal lines, so that the second pixel group adjusts the brightness value in the second pixel data based on the second gain control signal; the second pixel data is the pixel data generated by the exposure of the second pixel group.

[0146] Wherein, the gain value corresponding to the second gain control signal is determined by the photosensitive amount of the second pixel group.

[0147] It can be understood that during the actual use process, due to the spectral response characteristics of different channels, the photosensitive amounts of each channel may vary greatly; in addition, the exposure times between different channels may be different. If the sensor can only be configured with a gain suitable for the photosensitive amount of a certain channel, then the images of other channels may be underexposed or overexposed, which is not conducive to the subsequent image processing effect. Therefore, the embodiments of the present application configure a gain control unit for the image acquisition device, and output different gain control signals to different pixel groups, so that pixels with different channels and different photosensitive characteristics can all achieve appropriate exposure.

[0148] A data transmission method provided by the embodiments of the present application will be described in detail below.

[0149] A data transmission method provided by the embodiments of the present application is applied to an image acquisition device (such as Figure 1The image acquisition device shown), the image acquisition device includes: a data acquisition unit, a bit width conversion unit, a data transmission unit, a data processing unit, and a control component. The data acquisition unit is used to acquire pixel data generated by the exposure of the photosensitive pixel array; wherein, the photosensitive pixel array includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the bit width conversion unit is used to perform bit width conversion; the data transmission unit includes P transmission channels, and P is an integer greater than or equal to 2.

[0150] Optionally, the method provided in the embodiments of the present application can be executed by the above control component. Exemplarily, the control component can be a server; or, the control component can be a central processing unit (CPU), a graphics processing unit (GPU), a general-purpose processor network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The control component can also be other devices with processing functions, such as circuits, devices, or software modules, and the present application does not make any restrictions on this.

[0151] Another exemplary, the control component can include one or more of the exposure control unit, the bit width conversion unit, or the gain control unit as shown in Figure 1 the figure.

[0152] As Figure 16 shown, the data transmission method provided in the embodiments of the present application includes the following steps:

[0153] S301. Control the bit width conversion unit to divide the pixel data acquired by the data acquisition unit into Q groups, and perform bit width conversion on the Q groups of pixel data respectively.

[0154] Wherein, Q is an integer greater than or equal to 2.

[0155] Wherein, the pixel data is the pixel value of the pixels in the photosensitive pixel array.

[0156] Optionally, the number of N pixel groups is the same as the number of Q groups of pixel data; or, the number of N pixel groups is different from the number of Q groups of pixel data. For example, if each pixel group in the N pixel groups can respectively correspond to a different bit width, and the bit widths corresponding to the pixels within each pixel group are the same, then the number of N pixel groups is the same as the number of Q groups of pixel data; if some pixel groups in the N pixel groups can correspond to the same bit width, and some other pixel groups need to respectively correspond to different bit widths, then the number of N pixel groups is different from the number of Q groups of pixel data.

[0157] In some embodiments, step S301 above may be specifically implemented as the following steps:

[0158] Step 1: Convert the original bit width of the first pixel data to be converted into a first bit width.

[0159] Wherein, the first pixel data to be converted is any group of pixel data in the Q groups of pixel data.

[0160] In some embodiments, the Q groups of pixel data correspond to Q groups of bit widths; the first bit width is any one of the Q bit widths. The first bit width is less than or equal to the original bit width of the first pixel data to be converted. The first bit width is determined by the exposure duration of the first pixel data to be converted and / or the bandwidth of the data transmission unit 130.

[0161] Exemplarily, the first bit width is positively correlated with the exposure duration of the first pixel data to be converted. For example, if the exposure duration of the first pixel data to be converted is short, then the first bit width corresponding to the first pixel data to be converted is small; the first bit width is positively correlated with the bandwidth of the data transmission unit 130. If the bandwidth of the data transmission unit 130 is small, then the first bit width corresponding to the first pixel data to be converted is small.

[0162] Step 2: Convert the original bit width of the second pixel data to be converted into a second bit width.

[0163] Wherein, the second pixel data to be converted is any group of pixel data in the Q groups of pixel data.

[0164] In some embodiments, the second bit width is any one of the Q bit widths. The second bit width is less than or equal to the original bit width of the second pixel data to be converted. The second bit width is determined by the exposure duration of the second pixel data to be converted and / or the bandwidth of the data transmission unit 130.

[0165] Exemplarily, the second bit width is positively correlated with the exposure duration of the second pixel data to be converted. For example, if the exposure duration of the second pixel data to be converted is short, then the second bit width corresponding to the second pixel data to be converted is small; the second bit width is positively correlated with the bandwidth of the data transmission unit 130. If the bandwidth of the data transmission unit 130 is small, then the second bit width corresponding to the second pixel data to be converted is small.

[0166] In some embodiments, the bit-width conversion unit is further configured to perform bit-width compression on data points that do not require a high bit-width, so as to reduce the data transmission pressure.

[0167] It can be understood that, compared with the method of directly using a unified data bit-width (such as unified to 8 bits, 10 bits, or 12 bits, etc.) for data transmission in the related art, the bit-width conversion unit provided in the embodiments of the present application can adopt multiple data bit-widths for pixels of different exposure modes and different photosensitive pixels, convert the pixel data obtained according to different exposure modes into different data bit-widths respectively and then perform transmission, which can effectively reduce the data transmission pressure.

[0168] In some embodiments, the data acquisition unit includes a readout circuit; the readout circuit includes M groups of readout lines, and the M groups of readout lines are used to read the pixel data generated by M groups of target rows; one group of readout lines is connected to the pixels in one group of target rows; the arrangement of the pixel exposure modes between the same group of target rows is the same; M is an integer greater than or equal to 2 and less than or equal to N.

[0169] It should be noted that, for the convenience of description, the following takes that the M groups of readout lines include: the first group of readout lines and the second group of readout lines, and the M groups of target rows include: the first group of target rows and the second group of target rows as an example for illustration, but it does not mean that the M groups of readout lines only include the first group of readout lines and the second group of readout lines; nor does it mean that the M groups of target rows only include the first group of target rows and the second group of target rows. In some other embodiments, the M groups of readout lines may further include the third group of readout lines or the fourth group of readout lines, etc.; the M groups of target rows may further include the third group of target rows or the fourth group of target rows, etc., and the embodiments of the present application do not limit this.

[0170] Exemplarily, the above-mentioned M groups of readout lines being used to read the pixel data generated by M groups of target rows specifically includes: controlling the readout circuit to read the first data set generated by the pixels in the first group of target rows being exposed through the first group of readout lines; controlling the readout circuit to read the second set of data generated by the pixels in the second group of target rows being exposed through the second group of readout lines.

[0171] For example, as Figure 1 shown, the first group of readout lines C in the first column 1_0 is used to read the pixel data generated by the pixels R in the first column 1 C 1 The first group of readout lines C in the second column 2_0 is used to read the pixel data generated by the pixels R in the second column 1 C 2 The first group of readout lines C in the third column 3_0 is used to read the pixel data generated by the pixels R in the third column 1 C 3Generated pixel data; the first set of readout lines C in the fourth column 4_0 For reading out pixels R in the fourth column 1 C 4 Generated pixel data; wherein, pixel R 1 C 1 、Pixel R 1 C 2 、Pixel R 1 C 3 、Pixel R 1 C 4 Are all pixels in the first set of target rows; the second set of readout lines C in the first column 1_1 For reading out pixels R in the first column 2 C 1 Generated pixel data; the second set of readout lines C in the second column 2_1 For reading out pixels R in the second column 2 C 2 Generated pixel data; the second set of readout lines C in the third column 3_1 For reading out pixels R in the third column 2 C 3 Generated pixel data; the second set of readout lines C in the fourth column 4_1 For reading out pixels R in the fourth column 2 C 4 Generated pixel data; wherein, pixel R 2 C 1 、Pixel R 2 C 2 、Pixel R 2 C 3 、Pixel R 2 C 4 Are all pixels in the second set of target rows. Wherein, R x Represents a row, C y Represents a column, C y_0 Represents the first set of readout lines for each column, C y_1 Represents the second set of readout lines for each column.

[0172] It can be understood that in the case where there are many pixel exposure modes in the photosensitive pixel array, the pixel data generated by the exposure of pixels in different exposure modes is also more. If only read through a single readout line, it is very easy to cause confusion in the readout timing. Therefore, the readout circuit in the image acquisition device provided in the embodiments of the present application uses M sets of readout lines, which are respectively connected to M sets of target rows in the photosensitive pixel array. In this way, the pixel data generated by the exposure of the pixels in the target row can be read out in time, and the confusion in the readout timing can be avoided.

[0173] S302. Control the Q groups of pixel data after bit width conversion to be transmitted through P transmission channels.

[0174] In some embodiments, when the above step S302 includes converting the original bit width of the first pixel data to be converted into the first bit width and converting the original bit width of the second pixel data to be converted into the second bit width, step 302 can be implemented as follows: after converting the original bit width of the first pixel data to be converted into the first bit width, it is transmitted through P transmission channels; after converting the original bit width of the second pixel data to be converted into the second bit width, it is transmitted through P transmission channels.

[0175] In some embodiments, the correspondence between the P transmission channels and the M groups of readout lines includes: one group of readout lines corresponds to one transmission channel; or, one group of readout lines corresponds to multiple transmission channels; or, multiple groups of readout lines correspond to one transmission channel.

[0176] In some embodiments, the data transmission unit further includes a transmission interface, and the above step S302 can be implemented as follows: receiving pixel data through P transmission channels, transmitting the pixel data to the transmission interface, and then the transmission interface performs the transmission.

[0177] Among them, the transmission channel can be a physical transmission channel or a virtual transmission channel, etc.

[0178] The transmission interface is used to pack the received pixel data and then transmit it. For example, the transmission interface can pack the pixel data into the form of byte data or the form of data blocks and then transmit it.

[0179] It can be understood that the method provided by the embodiments of the present application uses at least two transmission paths to transmit the pixel data collected by the readout circuit, which can share the pressure of data transmission, solve the problem of low transmission efficiency caused by the limitation of the transmission path bandwidth, and can effectively improve the data transmission efficiency.

[0180] In some embodiments, the above method further includes: transmitting the pixel data to the data processing unit through the data transmission unit, so that the data processing unit restores the pixel data into a signal to be processed and performs image processing on the signal to be processed.

[0181] Exemplarily, the above signal to be processed is obtained by the data processing unit reorganizing the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data.

[0182] Exemplarily, the above image processing on the signal to be processed includes: performing image processing on the signal to be processed using a neural network.

[0183] It can be understood that, based on the method provided in the embodiments of the present application, in the case where there are many pixel exposure patterns in the photosensitive pixel array, more pixel data is generated through exposure. If a single bit width is used to transmit all the pixel data, the transmission efficiency is low. Therefore, the image acquisition device provided in the embodiments of the present application uses multiple bit widths to divide the pixel data generated by the pixels in the photosensitive pixel array into Q groups, and independently performs bit width conversion on each group of pixel data to compress the bit width of each group of pixel data. In this way, the data volume can be reduced, the amount of data entering the transmission channel of the data transmission unit per unit time can be reduced, and the transmission efficiency of the transmitted data can be improved.

[0184] In some embodiments, the above control component includes N groups of control lines, and the N groups of control lines correspond to N pixel groups one by one. Exemplarily, the first group of control lines in the N groups of control lines is correspondingly connected to the first pixel group in the N pixel groups, and the second group of control lines in the N groups of control lines is correspondingly connected to the second pixel group in the N pixel groups.

[0185] Thus, before step S301, as Figure 17 shown, the above method further includes: the following steps S201-S202.

[0186] S201. Send a first exposure control signal to the first pixel group through the first control group of lines, so that the first pixel group performs exposure based on the first exposure control signal to obtain first pixel data.

[0187] In some embodiments, the first exposure control signal is used to control the first exposure start time and the first exposure end time of the first pixel group.

[0188] In some embodiments, the first exposure control signal is used to control the number of exposure operations and the exposure duration of the first pixel group during the exposure period.

[0189] Exemplarily, the above first exposure control signal is used to control the pixels in the first pixel group to perform exposure in a mode of using a first exposure duration or a combination of first exposure durations. When the pixels in the first pixel group use the first exposure duration, it indicates that the exposure strategies of the pixels in the first pixel group are the same during the exposure period, and each exposure uses the first exposure duration. The combination of first exposure durations may include multiple exposure durations. When the pixels in the first pixel group use the combination of first exposure durations, it indicates that the exposure strategies of the pixels in the first pixel group change periodically during the exposure period, that is, the pixels in the first pixel group can sequentially use the exposure durations in the combination of first exposure durations for exposure. For example, if the combination of first exposure durations includes: exposure duration S, exposure duration L, and exposure duration M, then when the pixels in the first pixel group perform exposure, the exposure duration of the first exposure is S, the exposure duration of the second exposure is L, the exposure duration of the third exposure is M, and then the exposure duration of the fourth exposure is S, and the exposure durations of the fifth and sixth exposures sequentially cycle through the exposure durations of the second and third exposures.

[0190] Exemplarily, as Figure 1 shown, the first set of control lines R in the first row 1_0 is used to send an exposure control signal to the pixels R 1 C 2 and pixel R 1 C 4 in the first row, where the pixels R 1 C 2 and pixel R 1 C 4 are both pixels in the first pixel group. Among them, R x represents the row, C y represents the column, and R x_0 represents the first set of control lines for each row.

[0191] In some embodiments, the control component further includes N groups of signal lines; the N groups of signal lines correspond to N pixel groups one by one; the N pixel groups are respectively controlled by different gain control signals. Based on this, the above method further includes: sending a first gain control signal to the first pixel group among the N pixel groups through the first group of signal lines among the N groups of signal lines, so that the first pixel group adjusts the brightness value in the first pixel data based on the first gain control signal.

[0192] Wherein, the first pixel data is the pixel data generated by the first pixel group during exposure.

[0193] S202. Send a second exposure control signal to the second pixel group through the second set of control lines, so that the second pixel group performs exposure based on the second exposure control signal to obtain second pixel data.

[0194] In some embodiments, the second exposure control signal is used to control the second exposure start time and the second exposure end time of the second pixel group; wherein, the first exposure start time is different from the second exposure start time; and / or, the first exposure end time is different from the second exposure end time.

[0195] In some embodiments, the second exposure control signal is used to control the number of exposure operations and the exposure duration of the second pixel group during the exposure period.

[0196] Exemplarily, the above-mentioned second exposure control signal is used to control the pixels in the second pixel group to perform exposure in a mode of using a second exposure duration or a combination of second exposure durations. When the pixels in the second pixel group use the second exposure duration, it indicates that the exposure strategies of the pixels in the second pixel group are the same during the exposure period, and each exposure uses the second exposure duration. The combination of second exposure durations may include multiple exposure durations. When the pixels in the second pixel group use the combination of second exposure durations, it indicates that the exposure strategies of the pixels in the second pixel group change periodically during the exposure period, that is, the pixels in the second pixel group can sequentially use the exposure durations in the combination of second exposure durations for exposure. For example, if the combination of second exposure durations includes: exposure duration L, exposure duration L, and exposure duration M, then when the pixels in the second pixel group perform exposure, the exposure duration of the first exposure is L, the exposure duration of the second exposure is L, the exposure duration of the third exposure is M, and then the exposure duration of the fourth exposure is L, and the exposure durations of the fifth and sixth exposures cycle through the exposure durations of the second and third exposures in sequence.

[0197] Exemplarily, as Figure 1 shown, the second set of control lines R in the first row 1_1 is used to send an exposure control signal to the pixels R 1 C 1 and the pixel R 1 C 3 in the first row, where the pixels R 1 C 1 and the pixel R 1 C 3 are both pixels in the second pixel group. R x_1 represents the second set of control lines for each row

[0198] In some embodiments, the above method further includes: sending a second gain control signal to the second pixel group in the N pixel groups through the second set of signal lines in the N sets of signal lines, so that the second pixel group adjusts the brightness value in the second pixel data based on the second gain control signal.

[0199] Wherein, the second pixel data is the pixel data generated by the second pixel group during exposure.

[0200] It can be understood that, during actual use, due to the spectral response characteristics of different channels, the photosensitive amounts of each channel may vary greatly; in addition, the exposure times between different channels may be different. If the sensor can only be configured with a gain suitable for the photosensitive amount of a certain channel, the images of other channels will be underexposed or overexposed, which is not conducive to subsequent image processing effects. Therefore, in the embodiments of the present application, different gain control signals are output to different pixel groups so that pixels with different channels and different photosensitive characteristics can achieve appropriate exposure.

[0201] It can be understood that, for the pixels in the photosensitive pixel array, the amplitude of the optical signal they perceive will also change with the change of the ambient light intensity. Therefore, if all the pixels in the photosensitive pixel array adopt a unified and fixed exposure time, it is difficult to ensure that each pixel in the pixel matrix will not be overexposed due to too long exposure time at each moment; or, be underexposed due to too short exposure time, which is not conducive to subsequent image processing effects. Therefore, the method provided in the embodiments of the present application can control the pixels in the photosensitive pixel array to be exposed according to different exposure modes through multiple groups of independent control lines. By combining short exposure signals and long exposure signals, a high-quality image with a high signal-to-noise ratio and no blurred signals can be obtained.

[0202] Embodiments of the present application provide a schematic structural diagram of the control component involved in the above embodiments. As Figure 18 shown, the control component 400 includes: a processor 402, a communication interface 403, and a bus 404. Optionally, the control component 400 may further include a memory 401.

[0203] The processor 402 may be a device that implements or executes various exemplary logical blocks, modules, and circuits described in connection with the disclosure of the present application. The processor 402 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in connection with the disclosure of the present application. The processor 402 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0204] The communication interface 403 is used to connect to other devices through a communication network. The communication network may be an Ethernet, a wireless access network, a wireless local area network (WLAN), etc.

[0205] The memory 401 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or can also be an electrically erasable programmable read-only memory (EEPROM), a magnetic disk storage medium or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0206] As a possible implementation, the memory 401 can exist independently of the processor 402. The memory 401 can be connected to the processor 402 through the bus 404 for storing instructions or program codes. When the processor 402 calls and executes the instructions or program codes stored in the memory 401, the data transmission method provided by the embodiments of the present application can be implemented.

[0207] In another possible implementation, the memory 401 can also be integrated with the processor 402.

[0208] The bus 404 can be an extended industry standard architecture (EISA) bus, etc. The bus 404 can be divided into an address bus, a data bus, a control bus, etc. For the sake of convenience of representation, Figure 18 only a thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.

[0209] Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the above division of each functional module is used for illustration. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the control component is divided into different functional modules to complete all or part of the functions described above.

[0210] The embodiments of the present application also provide a computer-readable storage medium. All or part of the processes in the above method embodiments can be completed by computer instructions instructing relevant hardware. This program can be stored in the above computer-readable storage medium. When this program is executed, it can include the processes of the above method embodiments. The computer-readable storage medium can be the memory in any of the foregoing embodiments. The above computer-readable storage medium can also be an external storage device of the above control component, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the above control component. Further, the above computer-readable storage medium can also include both the internal storage unit of the above control component and the external storage device. The above computer-readable storage medium is used to store the above computer program and other programs and data required by the above control component. The above computer-readable storage medium can also be used to temporarily store the data that has been output or will be output.

[0211] The embodiments of the present application also provide a computer program product. This computer product includes a computer program. When this computer program product runs on a computer, it causes the computer to execute any one of the data transmission generation methods provided in the above embodiments.

[0212] Although the present application has been described in conjunction with various embodiments herein, however, in the process of implementing the claimed present application, those skilled in the art can understand and achieve other variations of the disclosed embodiments by viewing the drawings, the disclosure content, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "one" does not exclude a plurality of cases. A single processor or other unit can implement several functions recited in the claims. Certain measures are recited in mutually different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0213] Although the present application has been described in conjunction with specific features and their embodiments, obviously, various modifications and combinations can be made without departing from the spirit and scope of the present application. Accordingly, the present specification and the drawings are only exemplary descriptions of the present application defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of the present application. Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these changes and modifications.

[0214] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An image acquisition device, characterized in that, it includes: a data acquisition unit, a bit-width conversion unit, and a data transmission unit; The data acquisition unit is used to acquire pixel data generated by the exposure of a photosensitive pixel array; wherein, the photosensitive pixel array includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; The bit-width conversion unit is used to divide the pixel data acquired by the data acquisition unit into Q groups, and perform bit-width conversion on the Q groups of pixel data respectively; Q is an integer greater than or equal to 2; the bit-width after conversion of each group of pixel data in the Q groups of pixel data is determined based on the exposure duration of each group of pixel data; The data transmission unit includes P transmission channels and is used to transmit the Q groups of pixel data after bit-width conversion through the P transmission channels; P is an integer greater than or equal to 2.

2. The device according to claim 1, characterized in that, The bit-width conversion unit is specifically used to convert the original bit-width of the first pixel data to be converted into a first bit-width and then transmit it through the data transmission unit; the first bit-width is less than or equal to the original bit-width of the first pixel data to be converted; the first pixel data to be converted is any group of pixel data in the Q groups of pixel data; Convert the original bit-width of the second pixel data to be converted into a second bit-width and then transmit it through the data transmission unit; the second bit-width is less than or equal to the original bit-width of the second pixel data to be converted; the second pixel data to be converted is any group of pixel data in the Q groups of pixel data; the Q groups of pixel data correspond to Q bit-widths; the first bit-width and the second bit-width are any two groups of bit-widths among the Q bit-widths.

3. The device according to claim 2, characterized in that, The Q bit-widths are independent of each other; wherein, the first bit-width is determined by the exposure duration of the first pixel data to be converted and / or the bandwidth of the data transmission unit; the second bit-width is determined by the exposure duration of the second pixel data to be converted and / or the bandwidth of the data transmission unit.

4. The device according to claim 1, characterized in that, The data acquisition unit includes: a readout circuit; the readout circuit includes M groups of readout lines, and the M groups of readout lines are used to read pixel data generated by the exposure of M groups of target rows; one group of readout lines is connected to the pixels in one group of target rows; the arrangement of the pixel exposure modes among the same group of target rows is the same; M is an integer greater than or equal to 2 and less than or equal to N.

5. The device according to claim 4, characterized in that, The corresponding relationship between the P transmission channels and the M groups of readout lines includes: One group of readout lines corresponds to one transmission channel; Or, one group of readout lines corresponds to multiple transmission channels; Or, multiple groups of readout lines correspond to one transmission channel.

6. The device according to claim 1, characterized in that, The image acquisition device further includes: a data processing unit; The data processing unit is configured to obtain the pixel data through the data transmission unit, restore the pixel data into a signal to be processed, and perform image processing on the signal to be processed.

7. The apparatus according to claim 6, wherein, the data processing unit is specifically configured to reorganize the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data, to obtain a signal to be processed, and perform image processing on the signal to be processed.

8. The apparatus according to claim 6, wherein, the data processing unit is specifically configured to perform image processing on the signal to be processed by using a neural network.

9. A data transmission method, wherein, it is applied to an image acquisition device, the image acquisition device includes: a data acquisition unit, a bit width conversion unit, a data transmission unit, a data processing unit, and a control component, the data acquisition unit is configured to obtain pixel data generated by exposing a photosensitive pixel array; wherein, the photosensitive pixel array includes N pixel groups; the N pixel groups are independent of each other and are respectively controlled by different exposure control signals; N is an integer greater than or equal to 2; the bit width conversion unit is configured to perform bit width conversion; the data transmission unit includes P transmission channels, P is an integer greater than or equal to 2; the method is applied to the control component; the method includes: controlling the bit width conversion unit to divide the pixel data acquired by the data acquisition unit into Q groups, and respectively perform bit width conversion on the Q groups of pixel data; Q is an integer greater than or equal to 2; the bit width after conversion of each group of pixel data in the Q groups of pixel data is determined based on the exposure duration of each group of pixel data; controlling the Q groups of pixel data after bit width conversion to be transmitted through the P transmission channels.

10. The method according to claim 9, wherein, the controlling the bit width conversion unit to divide the pixel data acquired by the data acquisition unit into Q groups, and respectively perform bit width conversion on the Q groups of pixel data; Q is an integer greater than or equal to 2, includes: converting the original bit width of the first pixel data to be converted into a first bit width; the first bit width is less than or equal to the original bit width of the first pixel data to be converted; the first pixel data to be converted is any group of pixel data in the Q groups of pixel data; converting the original bit width of the second pixel data to be converted into a second bit width; the second bit width is less than or equal to the original bit width of the second pixel data to be converted; the second pixel data to be converted is any group of pixel data in the Q groups of pixel data; the Q groups of pixel data correspond to Q bit widths; the first bit width and the second bit width are any two groups of bit widths in the Q bit widths; the controlling the Q groups of pixel data after bit width conversion to be transmitted through the P transmission channels, includes: after converting the original bit width of the first pixel data to be converted into a first bit width, transmitting it through the P transmission channels; After converting the original bit width of the second pixel data to be converted into the second bit width, it is transmitted through the P transmission channels.

11. The method according to claim 10, wherein, the Q sets of bit widths are independent of each other; wherein, the first bit width is determined by the exposure duration of the first pixel data to be converted and / or the bandwidth of the data transmission unit; the second bit width is determined by the exposure duration of the second pixel data to be converted and / or the bandwidth of the data transmission unit.

12. The method according to claim 9, wherein, the data acquisition unit includes: a readout circuit; the readout circuit includes M groups of readout lines, and the M groups of readout lines are used to read the pixel data generated by the exposure of M groups of target rows; one group of readout lines is connected to the pixels in one group of target rows; the arrangement of the pixel exposure modes among the same group of target rows is the same; M is an integer greater than or equal to 2 and less than or equal to N.

13. The method according to claim 12, wherein, the corresponding relationship between the P transmission channels and the M groups of readout lines includes: one group of readout lines corresponds to one transmission channel; alternatively, one group of readout lines corresponds to multiple transmission channels; alternatively, multiple groups of readout lines correspond to one transmission channel.

14. The method according to claim 9, wherein, the method further includes: controlling the data transmission unit to transmit the pixel data acquired by the data transmission unit to the data processing unit, so that the data processing unit restores the pixel data into a signal to be processed and performs image processing on the signal to be processed.

15. The method according to claim 14, wherein, the signal to be processed is obtained by the data processing unit reorganizing the pixel data according to one or more of the exposure duration of the pixel data, the readout time of the pixel data, the image channel where the pixel data is located, or the position information of the pixel data.

16. A control component, wherein, comprising: one or more processors; one or more memories; wherein, the one or more memories are used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the control component executes the data transmission method according to any one of claims 9 to 15.

17. A computer-readable storage medium, wherein, the computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions run on a computer, the computer executes the data transmission method according to any one of claims 9 to 15.

Images