Pixel Arrangement Method for a Linear Image Sensor with Improved Resolution

Abstract

The present application provides a pixel arrangement method for a linear image sensor capable of improving resolution, constructs a pixel array of the linear image sensor, the pixel array includes at least one group of pixel units, a first pixel group and a second pixel group that are closely arranged in a first direction among multiple groups of pixel units, the first pixel group and the second pixel group are pixel queues formed by arranging the same number of rectangular pixels in a second direction, the second direction is perpendicular to the first direction; the first pixel group and the second pixel group are arranged staggered in the second direction; the first pixel groups in any two pixel units are arranged aligned in the second direction; the working mode of the linear image sensor responds to a mode instruction input by a user, and the mode instruction includes one of a standard single-line mode, a standard TDI mode, a standard HDR mode, a high-resolution single-line mode, a high-resolution TDI mode, and a high-resolution HDR mode, so as to solve the problem that the linear image sensor cannot take into account multiple resolutions.

Description

Technical Field

[0001] The present application relates to the field of image processing, and in particular to a pixel arrangement method of a linear array image sensor capable of improving resolution. Background Art

[0002] Linear array image sensor is a solid-state device that can convert electrical signals into digital signals line by line. Image sensor is the core device of the camera and can obtain image information. Time Delay Integration (TDI) image sensor is an evolution of linear array image sensor. The imaging mechanism of time delay integration image sensor is to expose the pixels passed by the object line by line, and accumulate the exposure structure, so as to solve the problem of weak imaging signal caused by insufficient exposure time of high-speed moving objects. Time delay integration image sensor can increase the effective exposure time and improve the image signal-to-noise ratio.

[0003] The pixels of a linear array image sensor are arranged in a single row array. The number of pixels in the single row array is the resolution of the sensor. For applications, higher resolution can obtain more delicate images and higher detection accuracy. Therefore, a linear array image sensor with a time delay integration function is used. Its pixels are arranged in parallel with multiple linear arrays, and its TDI level is the sum of multiple single-row pixels.

[0004] However, regardless of whether or not the linear array image sensor has a time delay integration function, it only has one resolution and cannot take into account multiple resolutions. Summary of the invention

[0005] The present application provides a pixel arrangement method of a linear array image sensor capable of improving resolution, so as to solve the problem that the linear array image sensor has only one resolution and cannot take into account multiple resolutions.

[0006] In order to solve the above problems, the present application provides a pixel arrangement method of a linear array image sensor capable of improving resolution, the method comprising:

[0007] Construct the pixel array of the linear image sensor. The pixel array includes at least one group of pixel units, a first pixel group and a second pixel group that are closely arranged in a first direction among multiple groups of pixel units. The first pixel group and the second pixel group are pixel queues formed by arranging the same number of rectangular pixels in a second direction perpendicular to the first direction. The length of the pixel queue in the second direction corresponds to the resolution of the second direction of the linear image sensor, and the length of the pixel queue in the first direction corresponds to the resolution of the first direction of the linear image sensor. The first pixel group and the second pixel group are staggered in the second direction. The first pixel groups in any two pixel units are aligned in the second direction, and the second pixel groups in any two pixel units are aligned in the second direction.

[0008] The working mode of the linear image sensor responds to the mode instruction input by the user, and uses the constructed pixel array to perform corresponding image processing on the image to be processed to generate a target image. The mode instructions include: standard single-line mode, standard TDI mode, standard HDR mode, high-resolution single-line mode, high-resolution TDI mode, high-resolution HDR mode.

[0009] Optionally, the staggering distance between the first pixel group and the second pixel group in the second direction is 1 / 2 of the long side distance of a rectangular pixel.

[0010] Optionally, when the mode instruction is the standard single-line mode, the steps of using the constructed pixel array to perform corresponding image processing on the image to be processed include:

[0011] Generate a target image according to the standard image output by the first pixel group or the second pixel group. The resolution of the standard image is the standard image resolution, and the pixel size of the image is the standard size.

[0012] Optionally, when the mode instruction is the standard TDI mode, the steps of using the constructed pixel array to perform corresponding image processing on the image to be processed include:

[0013] Perform time delay integration (TDI) processing on the first pixel group and / or the second pixel group in at least one group of pixel units, and generate a target image according to the output standard TDI image. The resolution of the standard TDI image is the standard image resolution, and the pixel size of the image is the standard size.

[0014] Optionally, when the mode instruction is the standard HDR mode, the steps of using the constructed pixel array to perform corresponding image processing on the image to be processed include:

[0015] Process the first pixel group and / or the second pixel group in at least one set of pixel units at different times, output images with different brightnesses, fuse the images with different brightnesses, and generate a target image according to the output high-dynamic range image. The resolution of the high-dynamic range image is the standard image resolution, and the pixel size of the high-dynamic range image is the standard size.

[0016] Optionally, when the mode instruction is the high-resolution single-line mode, the steps of performing corresponding image processing on the image to be processed using the constructed pixel array include:

[0017] Run the camera equipped with the line array image sensor at 2 times the line frequency. The first pixel group and the second pixel group respectively generate a first standard image and a second standard image that differ by 1 / 2 rectangular pixels in the second direction and the first direction. The first standard image and the second standard image are resolved or cross-arranged to obtain a high-resolution image, and a target image is generated according to the high-resolution image. The resolution of the high-resolution image is 2 times the standard resolution. When the target image obtained by resolution has a pixel size of 1 / 2 of the standard size, and when the target image obtained by cross-arrangement has a pixel size of the standard size.

[0018] Optionally, when the mode instruction is the high-resolution TDI mode, the steps of performing corresponding image processing on the image to be processed using the constructed pixel array include:

[0019] Perform time delay integration (TDI) processing on the at least two groups of high-resolution images, and generate a target image according to the output high-resolution TDI image.

[0020] Optionally, when the mode instruction is the high-resolution HDR mode, the steps of performing corresponding image processing on the image to be processed using the constructed pixel array include:

[0021] Expose the at least two groups of high-resolution images at different times, output images with different brightnesses, fuse the images with different brightnesses, and generate a target image according to the output high-resolution high-dynamic range image.

[0022] Optionally, the image to be processed includes three pixel arrays, the starting positions of the three pixel arrays are aligned, and the three pixel arrays respectively correspond to the R, G, and B channels.

[0023] Optionally, the image to be processed includes two pixel arrays, the starting positions of the two pixel arrays are aligned, one pixel array corresponds to two of the R, G, and B channels, and the other pixel array corresponds to the other channel among the R, G, and B channels except the channels of the first pixel array.

[0024] As can be seen from the above solution, the present application provides a pixel arrangement method for a linear image sensor capable of improving resolution. The method includes: constructing a pixel array of the linear image sensor, the pixel array including at least one group of pixel units, a first pixel group and a second pixel group closely arranged along a first direction in multiple groups of pixel units. The first pixel group and the second pixel group are pixel queues formed by arranging the same number of rectangular pixels along a second direction perpendicular to the first direction; the length of the pixel queue along the second direction corresponds to the resolution of the second direction of the linear image sensor, and the length of the pixel queue along the first direction corresponds to the resolution of the first direction of the linear image sensor. The first pixel group and the second pixel group are staggered in the second direction; the first pixel groups in any two pixel units are aligned in the second direction, and the second pixel groups in any two pixel units are aligned in the second direction; the working mode of the linear image sensor responds to a mode instruction input by the user, and uses the constructed pixel array to perform corresponding image processing on the image to be processed to generate a target image; the mode instruction includes: standard single-line mode, standard TDI mode, standard HDR mode, high-resolution single-line mode, high-resolution TDI mode, high-resolution HDR mode. To solve the problem that linear image sensors all have only one resolution and cannot take into account multiple resolutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] To more clearly illustrate the technical solutions of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

[0026] Figure 1 Schematic diagram of a pixel array for a pixel arrangement method of a linear image sensor capable of improving resolution;

[0027] Figure 2 Schematic diagram of a standard single-line pixel array;

[0028] Figure 3 Schematic diagram of a high-resolution single-line mode pixel array;

[0029] Figure 4 Schematic diagram of a high-resolution single-line mode pixel alignment array;

[0030] Figure 5 Schematic diagram of a true three-color pixel array;

[0031] Figure 6 Schematic diagram of a color double-line pixel array.

[0032] Illustration:

[0033] 100 - pixel unit, 101 - first pixel group, 102 - second pixel group, 103 - rectangular pixel, 200 - pixel array, 201 - first pixel array, 202 - second pixel array, 203 - third pixel array. Detailed implementation manners

[0034] The embodiments will be described in detail below, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all the implementation manners consistent with the present application. They are only examples of the systems and methods consistent with some aspects of the present application detailed in the claims.

[0035] For ease of explanation, refer to Figure 1 In, the X - direction represents the first direction of the present application, and the Y - direction represents the second direction of the present application. Herein, the first direction and the second direction are definitions given for ease of understanding and do not specifically limit the directions.

[0036] The linear image sensor is essentially a chip, mainly including: a pixel array (Bayer array, or photosensitive area array), timing control, analog signal processing, and analog - to - digital conversion modules. Among them, the pixel array occupies the largest area of the entire chip. The pixel array is composed of individual pixels, which correspond to each pixel in each picture we see. The main function of the pixel array is to complete photoelectric conversion, converting photons into electrons. Each pixel includes a photosensitive area and a read - out circuit. After the signal of each pixel is processed by the analog signal processing, it is handed over to the ADC for analog - to - digital conversion and then output to the digital processing module, and is converted into a digital signal through the read - out circuit, thus completing the process of digitizing the real - world scene.

[0037] For applications, the pursuit of higher resolution is the future development trend. Higher resolution can obtain a more delicate picture and higher detection accuracy. According to the current pixel arrangement method of image sensors, most image sensors have only one resolution and cannot balance two resolutions.

[0038] To solve the above problems, the present application provides a pixel arrangement method for a linear image sensor that can improve the resolution. Refer to Figure 1 , which is a schematic diagram of the pixel array of a pixel arrangement method for a linear image sensor that can improve the resolution. The method includes:

[0039] Construct a pixel array of a linear image sensor. The pixel array 200 includes at least one group of pixel units, a first pixel group 101 and a second pixel group 102 that are closely arranged in a first direction among multiple groups of pixel units. The first pixel group 101 and the second pixel group 102 are pixel queues formed by arranging the same number of rectangular pixels 103 in a second direction, and the second direction is perpendicular to the first direction; the length of the pixel queue in the second direction corresponds to the resolution of the second direction of the linear image sensor, and the length of the pixel queue in the first direction corresponds to the resolution of the first direction of the linear image sensor. The first pixel group and the second pixel group are staggered in the second direction; the first pixel groups in any two pixel units are aligned in the second direction, and the second pixel groups in any two pixel units are aligned in the second direction.

[0040] The working mode of the linear image sensor responds to the mode instruction input by the user, and uses the constructed pixel array 200 to perform corresponding image processing on the image to be processed, and generates a target image; the mode instructions include: standard single-line mode, standard TDI mode, standard HDR mode, high-resolution single-line mode, high-resolution TDI mode, high-resolution HDR mode.

[0041] It should be noted that all mode instructions are applicable to black-and-white linear image sensors, true three-color linear image sensors, and color double-line linear image sensors.

[0042] It can be understood that the higher the resolution of the image, the more the number of rectangular pixels 103 it contains, and the clearer the image. Therefore, in this embodiment, the high-resolution single-line mode, high-resolution TDI mode, and high-resolution HDR mode are proposed to improve the resolution of the image. Also, the true three-color mode and color double-line mode can be combined with the high-resolution single-line mode, high-resolution TDI mode, and high-resolution HDR mode, which is carried out according to the arrangement mode of the pixel array 200. This application can use the same array to perform multiple different operations successively, without constructing a specific array in response to different operations.

[0043] In some embodiments, the staggering distance between the first pixel group 101 and the second pixel group 102 in the second direction is 1 / 2 of the long side distance of the rectangular pixel 103.

[0044] Specifically, for example: the physical size of the rectangular pixel 103 of the image sensor is Pixel, and the staggering distance between the first pixel group 101 and the second pixel group 102 in the second direction is 1 / 2 Pixel (see Figure 1at point A in the figure, so that the resolution can be doubled according to the high-resolution single-line mode; in some embodiments, the staggered distance between the first pixel group 101 and the second pixel group 102 in the second direction is 1 / 3 of the long side distance of the rectangular pixel 103, and the staggered distance is 1 / 3 Pixel, so that the resolution can be tripled according to the high-resolution single-line mode. Other values of the staggered distance can also be set, that is, the more the number of rectangular pixels 103 that can be arranged in the pixel queue, the higher the resolution. For example, 1 / 4, 1 / 5, etc., and the corresponding resolution can be increased by 4 times, 5 times, etc. However, in the high-resolution single-line mode, the data calculation will be more complex, the requirements for the analog-to-digital conversion module are higher, the calculation is more complex, which affects the conversion efficiency, and the increase in the sensor pixels of the same size will cause the photosensitive area of a single rectangular pixel 300 to shrink, there is a possibility of insufficient exposure, which will lead to poor imaging quality and increased noise under low illumination.

[0045] See Figure 2 , which is a schematic diagram of a standard single-line pixel array. In some embodiments, when the mode instruction is the standard single-line mode, the steps of performing corresponding image processing on the image to be processed by using the constructed pixel array 200 include:

[0046] Generate a target image according to the standard image output by the first pixel group 101 or the second pixel group 102. The resolution of the standard image is the standard image resolution, that is, Resolution, and the pixel size of the image is the standard size.

[0047] In some embodiments, when the mode instruction is the standard TDI mode, the steps of performing corresponding image processing on the image to be processed by using the constructed pixel array 200 include:

[0048] Perform time delay integration (TDI) processing on the first pixel group 101 and / or the second pixel group 102 in at least one group of pixel units 100, and generate a target image according to the output standard TDI image. The resolution of the standard TDI image is the standard image resolution, that is, Resolution, and the pixel size of the image is the standard size.

[0049] It should be noted that the time delay integration (Time Delay Integration TDI) image sensor is an evolution of the line array image sensor. The imaging mechanism of the time delay integration image sensor is to expose the pixels passed by the photographed object row by row and accumulate the exposure structure, so as to solve the problem of weak imaging signal caused by insufficient exposure time of high-speed moving objects. The time delay integration image sensor can increase the effective exposure time and improve the signal-to-noise ratio of the image.

[0050] Specifically, an odd-row pixel group or an even-row pixel group is selected. For example, time delay integration processing is performed on all odd-row pixel groups in the pixel array 200. After processing, the imaging results of the odd-row pixel groups and the even-row pixel groups can be aligned or not. When the imaging results are aligned, the main purpose is to eliminate the visual difference of the 1 / 2 rectangular pixels 103, so as to achieve the maximum number of pixel groups. When the imaging results are not aligned, the visual difference of the 1 / 2 rectangular pixels 103 cannot be eliminated, and the number of pixel groups is 1 / 2 of that when aligned. It can be understood that regardless of whether the imaging results of the odd-row pixel groups and the even-row pixel groups are aligned, the resolution is not affected, that is, the length of the second direction of the selected pixel group.

[0051] In some embodiments, when the mode instruction is the standard HDR mode, the steps of performing corresponding image processing on the image to be processed by using the constructed pixel array 200 include:

[0052] Performing exposure processing on the first pixel group 101 and / or the second pixel group 102 in at least one group of pixel units 100 at different times, outputting images with different brightnesses, fusing the images with different brightnesses, and generating a target image according to the output high-dynamic range image. The resolution of the high-dynamic range image is the standard image resolution, and the pixel size of the high-dynamic range image is the standard size.

[0053] It should be noted that the literal meaning of HDR is High Dynamic Range (HDR), and the dynamic range is one of the five elements of high image quality, and the image quality is directly related to the subjective viewing experience. If the dynamic range is understood as the quantization order, the higher the order, the larger the dynamic range.

[0054] Specifically, performing exposure on the first pixel group 101 and the second pixel group 102 at different times, that is, controlling the shutter speed. The shutter speed and the aperture size are complementary. For example, in order to let more light in, so as to output images with different brightnesses, fusing at least two images with different brightnesses. It can be understood that image fusion is to synthesize two or more images into a new image by using a specific algorithm. Since the fusion result can utilize the spatio-temporal correlation and information complementarity of two (or more) images, and makes the fused image have a more comprehensive and clear description of the scene, it is more conducive to human eye recognition and automatic detection by machines. The method of image fusion can adopt the spatial domain fusion method or the transform domain fusion method, and there are more other methods based on these two methods, which will not be exemplified here and can be selected according to the usage requirements.

[0055] See Figure 3 、 Figure 4 , Figure 3Schematic diagram of a high-resolution single-line mode pixel array; Figure 4 Schematic diagram of a high-resolution single-line mode pixel alignment array; In some embodiments, when the mode instruction is the high-resolution single-line mode, the steps of performing corresponding image processing on the to-be-processed image by using the constructed pixel array 200 include:

[0056] The camera equipped with a linear image sensor runs at 2 times the line frequency. The first pixel group and the second pixel group respectively generate a first standard image and a second standard image that differ by 1 / 2 rectangular pixels in the second direction and the first direction. The first standard image and the second standard image are resolved or cross-arranged to obtain a high-resolution image, and a target image is generated according to the high-resolution image. The resolution of the high-resolution image is 2 times the standard resolution. When the target image obtained by resolution has a pixel size of 1 / 2 of the standard size, and when the target image obtained by cross-arrangement has a pixel size of the standard size.

[0057] Specifically, at least two adjacent groups of pixel units 100 can be used, and the linear image sensor carried is set to run at 2 times the line frequency. It should be noted that there is a certain relationship between the line frequency and the resolution: Hf = Vr × Rr × K, where: Hr represents the horizontal resolution, Vr represents the vertical resolution, Re represents the automatic refresh rate, Hf represents the line frequency, and K is a constant value. The higher the line frequency, the larger the variable range of the display resolution allowed.

[0058] After the operation ends, image data that differ by 1 / 2 Pixel in both the first direction and the second direction can be obtained. Through resolution, the core of the resolution is to solve a system of linear equations. For example: d(1,1) + d(1,2) + d(2,1) + d(2,2) = L2(1,1), d(2,2) + d(2,3) + d(3,2) + d(3,3) - L1(2,2), where: the pixel values of L1 and L2 are both known, and d can be solved.

[0059] See Figure 3 , Figure 3 The left side in represents two adjacent groups of pixel units 100, and also represents the grayscale values of the actually captured image. Each rectangular pixel 103 represents a grayscale value, where: L1 represents the coordinates of the first pixel group 101 in the first group of pixel units, L1(1,1) represents the coordinates of the first rectangular pixel in the first pixel group 101, L2(2,1) represents the coordinates of the first rectangular pixel in the second pixel group 102, L2 represents the coordinates of the first pixel group 101 in the second group of pixel units, L2(1,1) represents the coordinates of the first rectangular pixel of the first pixel group 101 in the second group of pixel units, L2(2,1) represents the coordinates of the first rectangular pixel of the second pixel group 102 in the second group of pixel units, and R represents the number of rectangular pixels 103 in the pixel group; Figure 3The right side shows the resolved pixel units. Among them, d represents the first resolved pixel unit, d(1, 1) represents the first rectangular pixel coordinate in the first pixel group 101, d(2, 1) represents the first rectangular pixel coordinate in the second pixel group 102, and d(1, 2R - 1) represents the penultimate rectangular pixel coordinate in the first pixel group 101. It can be seen from the figure that since both the first direction and the second direction differ by 1 / 2 Pixel, the size of the resolved rectangular pixel is 1 / 2 of the original rectangular pixel, that is, the pixel size is 1 / 2 of the original image. At this time, the resolution of the image is Resolution * 2.

[0060] See Figure 4 , Figure 4 The left side represents two adjacent pixel units 100, and the right side represents the resolved pixel units 100. Different from Figure 3 , after passing through the grayscale values of the images captured on the left side, the two pixel units 100 are aligned in the second direction. That is to say, the shooting positions on both sides are the same, and there is no situation of a difference of 1 / 2 Pixel. After re - arranging, we get Figure 4 The pixel units 100 on the right side. Among them, since the two pixel units 100 are aligned in the second direction, the first rectangular pixel coordinates of the first pixel group are d(1, 1) and L1(1, 1) at this time. Since it does not involve the data resolution process and only performs cross - arrangement, the pixel size remains unchanged, and the resolution is increased to Resolution * 2.

[0061] In some embodiments, when the mode instruction is the high - resolution TDI mode, the steps of performing corresponding image processing on the image to be processed by using the constructed pixel array 200 include:

[0062] Performing time - delay integration (TDI) processing on at least two groups of high - resolution images, and generating a target image according to the output high - resolution TDI image.

[0063] In some embodiments, when the mode instruction is the high - resolution HDR mode, the steps of performing corresponding image processing on the image to be processed by using the constructed pixel array 200 include:

[0064] Exposing at least two groups of high - resolution images at different times, outputting images with different brightnesses, fusing the images with different brightnesses, and generating a target image according to the output high - resolution high - dynamic - range image.

[0065] It should be noted that for a color line array image sensor, the color line array image sensor has three channels, namely R, G, and B. RGB represents the colors of the three channels of red, green, and blue. For a black-and-white line array image sensor, there is only one channel. Grayscale means no color, and the RGB color components are all equal. A 2D image that records brightness information becomes a grayscale image. If it is a grayscale image itself, its pixel value is its grayscale value. If it is a color image, its grayscale value needs to be obtained through function mapping. A grayscale image is obtained by transitioning from pure black to pure white. Adding white to black results in gray, and different grayscale values are obtained by mixing pure black and pure white in different proportions.

[0066] Optionally, the image to be processed includes three pixel arrays 200. The starting positions of the three pixel arrays 200 are aligned, and the three pixel arrays 200 respectively correspond to the three channels of R, G, and B.

[0067] Specifically, refer to Figure 5 , Figure 5 which is a schematic diagram of a true three-color pixel array. For example: the first pixel array 201 is the R channel, that is, the color of the rectangular pixel 103 is red, the second pixel array 202 is the G channel, that is, the color of the rectangular pixel 103 is green, and the third pixel array 203 is the B channel, that is, the color of the rectangular pixel 103 is blue. It only needs to ensure that the three pixel arrays 200 include all three channels of RGB.

[0068] Optionally, the image to be processed includes two pixel arrays 200. The starting positions of the two pixel arrays 200 are aligned. One pixel array 200 corresponds to two of the channels among R, G, and B, and the other pixel array 200 corresponds to the other channel among the R, G, and B channels except the channel of the first pixel array.

[0069] Specifically, refer to Figure 6 , Figure 6 which is a schematic diagram of a color two-line pixel array. For example: if the first pixel array includes two channels of R and B, then the color of the first rectangular pixel in the first pixel array is red and the second rectangular pixel is blue. That is to say, the colors of the rectangular pixels 103 in the first pixel array alternate between red and blue. If the second pixel array includes the G channel, then the color of the rectangular pixel 103 in the second pixel array is green. If the color of the first rectangular pixel in the first pixel array alternates between blue and green, then the color of the rectangular pixel 103 in the second pixel array is red.

[0070] In this embodiment, if the user instruction of the color linear array image sensor is a high-resolution single-line mode, a high-resolution TDI mode, and a high-resolution HDR mode, in addition to the same processing of the pixel array 200 as the black and white linear array image sensor, the colors of the three channels (R\G\B) need to be aligned, and the photographed target is ensured to be in the same position, so as to ensure that the first high-resolution image, the second high-resolution image, and the high-resolution high dynamic range image can be output in color to generate the corresponding target image. Regarding the generation of color images, compared with grayscale images, color images must obtain wavelengths. There are many ways to collect wavelength information, such as: a single-sensor color imaging system, and other methods are all possible, which will not be elaborated here.

[0071] It can be seen from the above scheme that this embodiment provides a pixel arrangement method for a linear array image sensor that can improve the resolution, the method comprising: constructing a pixel array of the linear array image sensor, the pixel array comprising at least one group of pixel units, a first pixel group and a second pixel group closely arranged along a first direction in a plurality of groups of the pixel units, the first pixel group and the second pixel group being pixel queues composed of the same number of rectangular pixels arranged along a second direction, the second direction being perpendicular to the first direction; the length of the pixel queue along the second direction corresponds to the resolution of the linear array image sensor in the second direction, the length of the pixel queue along the first direction corresponds to the resolution of the linear array image sensor in the first direction, the first pixel group and the second pixel group are staggered in the second direction; the first pixel groups in any two pixel units are aligned in the second direction, and the second pixel groups in any two pixel units are aligned in the second direction; the working mode of the linear array image sensor responds to a mode instruction input by a user, and uses the constructed pixel array to perform corresponding image processing on an image to be processed to generate a target image; the mode instruction comprises: a standard single-line mode, a standard TDI mode, a standard HDR mode, a high-resolution single-line mode, a high-resolution TDI mode, and a high-resolution HDR mode. This is to solve the problem that linear array image sensors have only one resolution and cannot take into account multiple resolutions.

[0072] Similar parts between the embodiments provided in this application can be referenced to each other. The specific implementation methods provided above are only a few examples under the general concept of this application and do not constitute a limitation on the protection scope of this application. For those skilled in the art, any other implementation methods expanded based on the scheme of this application without creative work belong to the protection scope of this application.

Claims

1. A pixel arrangement method for a linear image sensor capable of improving resolution, characterized in that, The method includes: Constructing a pixel array of the linear image sensor, the pixel array including at least one set of pixel units, a first pixel group and a second pixel group that are closely arranged in a first direction among multiple sets of pixel units. The first pixel group and the second pixel group are pixel queues formed by arranging the same number of rectangular pixels in a second direction perpendicular to the first direction. The length of the pixel queue in the second direction corresponds to the resolution of the second direction of the linear image sensor, and the length of the pixel queue in the first direction corresponds to the resolution of the first direction of the linear image sensor. The first pixel group and the second pixel group are staggered in the second direction. The first pixel groups in any two pixel units are aligned in the second direction, and the second pixel groups in any two pixel units are aligned in the second direction. The working mode of the linear image sensor responds to a mode instruction input by the user, and uses the constructed pixel array to perform corresponding image processing on the image to be processed to generate a target image. The mode instruction includes: standard single-line mode, standard TDI mode, standard HDR mode, high-resolution single-line mode, high-resolution TDI mode, high-resolution HDR mode.

2. The pixel arrangement method of the linear image sensor capable of improving resolution according to claim 1, characterized in that, The staggering distance between the first pixel group and the second pixel group in the second direction is 1 / 2 of the long side distance of a rectangular pixel.

3. The pixel arrangement method of the linear image sensor capable of improving resolution according to claim 2, wherein When the mode instruction is the standard single-line mode, the steps of using the constructed pixel array to perform corresponding image processing on the image to be processed include: Generating a target image according to the standard image output by the first pixel group or the second pixel group. The resolution of the standard image is the standard image resolution, and the pixel size of the image is the standard size.

4. The pixel arrangement method of the linear image sensor capable of improving resolution according to claim 3, wherein, When the mode instruction is the standard TDI mode, the steps of using the constructed pixel array to perform corresponding image processing on the image to be processed include: Performing time delay integration (TDI) processing on the first pixel group and / or the second pixel group in at least one set of pixel units, and generating a target image according to the output standard TDI image. The resolution of the standard TDI image is the standard image resolution, and the pixel size of the image is the standard size.

5. The pixel arrangement method of the linear image sensor capable of improving resolution according to claim 4, characterized in that, When the mode instruction is the standard HDR mode, the steps of using the constructed pixel array to perform corresponding image processing on the image to be processed include: Exposing the first pixel group and / or the second pixel group in at least one set of pixel units at different times, outputting images with different brightnesses, fusing the images with different brightnesses, and generating a target image according to the output high-dynamic range image. The resolution of the high-dynamic range image is the standard image resolution, and the pixel size of the high-dynamic range image is the standard size.

6. The pixel arrangement method of the linear image sensor capable of improving resolution according to claim 2, wherein, When the mode instruction is the high-resolution single-line mode, the steps of using the constructed pixel array to perform corresponding image processing on the image to be processed include: The camera equipped with the linear image sensor operates at 2 times the line frequency. The first pixel group and the second pixel group respectively generate a first standard image and a second standard image that differ by 1 / 2 rectangular pixel in the second direction from the first direction. The first standard image and the second standard image are processed through resolution calculation or cross-arrangement to obtain a high-resolution image, and a target image is generated based on the high-resolution image. The resolution of the high-resolution image is 2 times the standard resolution. When the target image obtained through resolution calculation has a pixel size of 1 / 2 of the standard size, and when the target image obtained through cross-arrangement has a pixel size of the standard size.

7. The pixel arrangement method of the linear image sensor capable of improving resolution according to claim 6, characterized in that, When the mode instruction is the high-resolution TDI mode, the steps of performing corresponding image processing on the image to be processed using the constructed pixel array include: Performing time delay integration (TDI) processing on the at least two groups of high-resolution images, and generating a target image based on the output high-resolution TDI image.

8. The pixel arrangement method of the linear image sensor capable of improving resolution according to claim 7, wherein When the mode instruction is the high-resolution HDR mode, the steps of performing corresponding image processing on the image to be processed using the constructed pixel array include: Exposing the at least two groups of high-resolution images at different times, outputting images with different brightness levels, fusing the images with different brightness levels, and generating a target image based on the output high-resolution high-dynamic range image.

9. The pixel arrangement method of the linear image sensor capable of improving resolution according to any one of claims 1-8, characterized in that, The image to be processed includes three pixel arrays, the starting positions of the three pixel arrays are aligned, and the three pixel arrays respectively correspond to the R, G, and B channels.

10. The pixel arrangement method of the linear image sensor capable of improving resolution according to any one of claims 1-8, characterized in that, The image to be processed includes two pixel arrays, the starting positions of the two pixel arrays are aligned, the first pixel array corresponds to two of the R, G, and B channels, and the second pixel array corresponds to the other channel among the R, G, and B channels except the channels of the first pixel array.

Images