Cmos sensor device, image processing system and working method

By designing a cmos sensor device, using multiple photosensitive units and lens arrays arranged side by side, combined with the image overlap technology of the control module, the problem that the image acquisition module in the prior art cannot accurately reflect actual color and data interference is solved, and high-precision and high-quality image acquisition are achieved.

CN119767167AActive Publication Date: 2025-04-04INSTITUTE OF GRASSLAND RESEARCH OF CAAS
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN202411903550.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-23
Publication Date
2025-04-04
Estimated Expiration
2044-12-23

AI Technical Summary

Technical Problem

In the prior art, the image acquisition module consists of a single lens array and a photosensitive unit, which makes it impossible to accurately reflect the actual color of the environment on the image, and multiple photosensitive units are prone to data interference during the imaging process.

Method used

A cmos sensor device is designed, including at least four photosensitive units arranged side by side on a silicon substrate, each photosensitive unit is provided with a lens array, and light rays pass through the lens array and then irradiate them on the photosensitive unit to form an image. The images formed by the multiple photosensitive units are overlapped by the control module to form the final image, and data interference is avoided through a specific gold line arrangement.

Benefits of technology

This enables the final image to reflect the actual color clearly and accurately, avoid data interference, and improves the accuracy and quality of image acquisition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119767167A_ABST
    Figure CN119767167A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of electrical elements, and particularly relates to a semiconductor device, in particular to a cmos sensor device, an image processing system and a working method.The cmos sensor device comprises a silicon substrate and at least four light sensing units arranged on the silicon substrate; the photosensitive units are arranged side by side along the length direction of the silicon substrate; a lens array is arranged on the photosensitive unit; the light passes through the lens array and then irradiates on the photosensitive unit to form an image; a plurality of groups of gold threads are arranged on the silicon substrate along the width direction of the silicon substrate, four gold threads are arranged in each group of gold threads to respectively correspond to four photosensitive units, and the lengths of the gold threads in each group of gold threads are gradually increased from top to bottom, so that a final image is obtained after images formed by the plurality of photosensitive units are overlapped. The final image can clearly and accurately reflect the actual color, and the arrangement mode of the gold threads can avoid interference.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of electrical components, and specifically relates to semiconductor devices, and in particular to a CMOS sensor device, an image processing system and a working method. Background Art

[0002] In the agricultural planting process, it is necessary to obtain images of the planting area through image acquisition, and then obtain crop parameters from the images, such as parameters including: vegetation coverage, number of missing seedlings, biomass, and nutrient status. In the related technology, image acquisition is performed through a single acquisition module. The single acquisition module is composed of a lens array and a photosensitive unit. After the light passes through the lens array, it is irradiated on the photosensitive unit to form an image. The lens array is composed of three lenses: red, green, and blue. A single lens can only transmit light of one color. At this time, the other colors of the corresponding part of the lens on the image are synthesized and supplemented by the algorithm. The algorithm cannot perfectly restore the actual color, which will result in the image being unable to accurately reflect the actual color of the environment; because when multiple photosensitive units are set, data interference is prone to occur during the imaging process.

[0003] Therefore, since there are parts on the image that cannot accurately reflect the actual color, it is necessary to design a CMOS sensor device, an image processing system and a working method.

[0004] It should be noted that the above information disclosed in this background technology section is only used to understand the background technology of the present application concept, and therefore, the above description is not considered to constitute information of the prior art. Summary of the invention

[0005] The embodiments of the present disclosure at least provide a CMOS sensor device, an image processing system and a working method.

[0006] In a first aspect, an embodiment of the present disclosure provides a CMOS sensor device, including: A silicon substrate, and at least four photosensitive units disposed on the silicon substrate; The photosensitive units are arranged side by side along the length direction of the silicon substrate; A lens array is provided on the photosensitive unit; After passing through the lens array, the light is irradiated onto the photosensitive unit to form an image; A plurality of groups of gold wires are arranged on the silicon substrate along the width direction of the silicon substrate, each group of gold wires has four gold wires corresponding to four photosensitive units respectively, and the length of the gold wires in each group of gold wires increases gradually from top to bottom.

[0007] In an optional embodiment, the control module is electrically connected to the photosensitive unit, and the control module is configured to overlap the images formed by the corresponding photosensitive units to form a final image; The lens array includes at least four lenses, and the side walls of adjacent lenses are in contact, and the lenses form at least a four-grid lens array on the photosensitive unit; The lens arranged on one of the photosensitive units is an IR lens, and the lenses arranged on the other three photosensitive units are color lenses; The color lens can transmit light of one of red, blue and green colors; In a lens array composed of color lenses, adjacent lenses can transmit different colors; In the lens array composed of color lenses, at least one lens of each color is provided; The three lens arrays composed of color lenses can transmit light with different primary colors; Among the three lens arrays composed of color lenses, the color lenses at the same position can transmit different colors.

[0008] In an optional embodiment, the silicon substrate is disposed on a moving mechanism, and the moving mechanism is electrically connected to the control module; The moving mechanism is suitable for driving the silicon substrate to move and then driving the photosensitive units to move, so that the photosensitive units are moved to the lens modules respectively, and the light passes through the lens module and then through the lens array to irradiate the photosensitive units.

[0009] In an optional embodiment, the moving mechanism includes: a housing and a linear motor; The linear motor is electrically connected to the control module; The linear motor is arranged in the housing; The silicon substrate is arranged on the linear motor, the silicon substrate and the photosensitive unit are arranged in the housing, and the control module controls the linear motor to drive the photosensitive unit to move, thereby driving the lens array on the photosensitive unit to move synchronously; The lens module is arranged on the housing, and the light passes through the lens module and then irradiates the photosensitive unit through the lens array; The cross-sectional area of ​​the lens module through which light passes is smaller than the area of ​​the lens array.

[0010] In an optional embodiment, when the number of color lenses that can transmit green light is the largest in the lens array composed of color lenses, the main color of the light that can be transmitted by the lens array is green; When the number of color lenses that can transmit red light in the lens array composed of color lenses is the largest, the main color of the light that can be transmitted by the lens array is red; When the number of color lenses that can transmit blue light is the largest in a lens array composed of color lenses, the main color of the light that can be transmitted by the lens array is blue.

[0011] In an optional embodiment, the control module is configured to first control the moving mechanism to drive the lens array and the photosensitive unit corresponding to the main color of the area to be photographed to move to the lens module during the day, and transmit the image acquired at this time to the control module through the photosensitive unit. Then the control module controls the moving mechanism to drive the other two lens arrays composed of color lenses and the corresponding photosensitive units to move to the lens module respectively, and transmit the acquired image to the control module through the photosensitive unit. The control module overlaps the three images, and the image acquired by the photosensitive unit corresponding to the main color is at the top to form the final image.

[0012] In an optional embodiment, the control module is configured to first control the moving mechanism to drive the lens array composed of IR lenses and the corresponding photosensitive units to move to the lens module at night, and transmit the image acquired at this time to the control module through the photosensitive units. Then the control module controls the moving mechanism to drive the other three lens arrays composed of color lenses and the corresponding photosensitive units to move to the lens module respectively, and transmit the acquired images to the control module through the photosensitive units. The control module overlaps the four images, and sets the image acquired by the lens array composed of IR lenses and the corresponding photosensitive units at the top to form a final image.

[0013] In a second aspect, the present disclosure also provides an image processing system using the above-mentioned CMOS sensor device, including: UAV and host computer; The drone is provided with a CMOS sensor device, through which the final image of the area to be photographed is collected, and the drone sends the final image to the host computer; The host computer collects the required parameters according to the final image.

[0014] In an optional implementation, the host computer creates an index according to the attributes of the final image and stores the index in a classified manner. The attributes of the final image include: image resolution, image size, image clarity and location information; The created index information is saved in ES, and the final image is stored in the ceph object to establish a large agricultural database; The host computer is suitable for obtaining crop parameters from the final image, wherein the crop parameters include: vegetation coverage, number of missing seedlings, biomass and nutrient status; The crop parameters to be extracted are triggered, and the host computer calls Spark and Flink big data parallel computing according to the crop parameters to be extracted.

[0015] In a third aspect, the present disclosure also provides a working method using the above CMOS sensor device, including: After passing through the lens array, the light is irradiated onto the photosensitive units to form an image. The control module is configured to overlap the images formed by the corresponding photosensitive units to form a final image.

[0016] The beneficial effects of the present invention are as follows: the CMOS sensor device comprises: a silicon substrate, and at least four photosensitive units arranged on the silicon substrate; the photosensitive units are arranged side by side along the length direction of the silicon substrate; a lens array is arranged on the photosensitive unit; light passes through the lens array and is irradiated on the photosensitive unit to form an image; a plurality of groups of gold wires are arranged on the silicon substrate along the width direction of the silicon substrate, each group of gold wires has four gold wires corresponding to four photosensitive units respectively, and the length of the gold wires in each group of gold wires gradually increases from top to bottom, thereby achieving the final image obtained after the images formed by the plurality of photosensitive units are overlapped, the final image can clearly and accurately reflect the actual color, and the arrangement of the gold wires can avoid interference.

[0017] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0018] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, this article specifically cites preferred embodiments and provides detailed descriptions as follows in conjunction with the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0020] Figure 1 A schematic diagram of the structure of a CMOS sensor device provided in an embodiment of the present disclosure; Figure 2 A cross-sectional view of a CMOS sensor device provided in an embodiment of the present disclosure; Figure 3 A schematic diagram of a lens array composed of IR lenses provided in an embodiment of the present disclosure; Figure 4 A lens array of green light that can pass through provided by an embodiment of the present disclosure; Figure 5 A lens array that can transmit light with a main color of blue provided in an embodiment of the present disclosure; Figure 6 A lens array of red light that can pass through provided by an embodiment of the present disclosure; Figure 7A principle block diagram of a CMOS sensor device provided in an embodiment of the present disclosure; Figure 8 A schematic diagram of the principle of an image processing system provided by an embodiment of the present disclosure; Fig. 9 A flowchart of an image processing system provided by an embodiment of the present disclosure; Fig.10 A schematic diagram of gold wire arrangement provided in an embodiment of the present disclosure.

[0021] In the figure: 1 photosensitive unit, 11 lens array, 12 IR lens, 13 color lens; 2 moving mechanism, 21 housing, 22 linear motor; 3-lens module; 4 silicon substrates, 41 gold wires. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] In this article, when it is mentioned that the first component is located on the second component, this may mean that the first component may be directly formed on the second component, or the third component may be interposed between the first component and the second component. In addition, in the drawings, in order to effectively describe the technical content, the thickness of the components may be exaggerated or reduced.

[0024] As used herein, the phrases "in one embodiment," "according to one embodiment," "in some embodiments," and the like generally refer to the fact that the particular feature, structure, or characteristic following the phrase may be included in at least one embodiment of the present disclosure. Therefore, a particular feature, structure, or characteristic may be included in more than one embodiment of the present disclosure, so that these phrases do not necessarily refer to the same embodiment. As used herein, the terms "example," "exemplary," and the like are used to "serve as an example, instance, or illustration." Any implementation, aspect, or design described herein as "example" or "exemplary" is not necessarily to be construed as preferred or superior to other implementations, aspects, or designs. On the contrary, the use of the terms "example," "exemplary," and the like is intended to present concepts in a concrete manner.

[0025] Some embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0026] like Fig.10 As shown, at least one disclosed embodiment provides a CMOS sensor device, comprising: a silicon substrate 4, and at least four photosensitive units 1 arranged on the silicon substrate 4; the photosensitive units 1 are arranged side by side along the length direction of the silicon substrate 4; a lens array 11 is arranged on the photosensitive unit; after light passes through the lens array 11, it is irradiated on the photosensitive unit 1 to form an image; a plurality of groups of gold wires 41 are arranged on the silicon substrate 4 along the width direction of the silicon substrate 4, and each group of gold wires 41 is provided with four gold wires 41 to correspond to the four photosensitive units 1 respectively, and each group of gold wires 41 The length of the gold wire 41 increases gradually from top to bottom; the relevant image is collected by a single collection module, and only one photosensitive unit 1 is provided on the silicon substrate 4. The gold wires 41 corresponding to the photosensitive unit 1 on the silicon substrate 4 can be arranged relatively sparsely, and there will be no interference between adjacent gold wires 41. However, only one photosensitive unit 1 cannot meet the requirement of accurately reflecting the actual color of the environment, and thus at least four photosensitive units 1 are used in this embodiment. However, the four photosensitive units 1 will cause the corresponding gold wires 41 to be arranged relatively closely on the silicon substrate 4, for example, one The photosensitive unit 1 needs to have four corresponding gold wires 41. If the four gold wires 41 corresponding to one photosensitive unit 1 are arranged from top to bottom, and the gold wires 41 of other photosensitive units 1 continue to be arranged downward, the gaps between adjacent gold wires 41 are small. When one photosensitive unit 1 is working, the four corresponding gold wires 41 are easily interfered due to the small gaps, resulting in the inability of the photosensitive unit 1 to accurately form an image. Therefore, the arrangement method of the gold wires 41 is modified during the arrangement process to avoid interference. The specific arrangement method can be that the top gold wire 41 in a group of gold wires 41 is the shortest, and the bottom gold wires 41 are the shortest. The wire 41 has the longest length. The shortest gold wire 41 can be connected to the leftmost photosensitive unit 1 on the silicon substrate 4, and the longest gold wire 41 can be connected to the rightmost photosensitive unit 1 on the silicon substrate 4. When a photosensitive unit 1 is working, there are gold wires 41 corresponding to other photosensitive units 1 between two adjacent gold wires 41 of the gold wires 41 corresponding to the photosensitive unit 1. At this time, other photosensitive units 1 are not working. The gold wires 41 of other photosensitive units 1 can block clutter signals, so that the corresponding adjacent gold wires 41 in the working photosensitive unit 1 will not interfere with each other.

[0027] like Figure 1 , Figure 2 and Figure 7 As shown, the control module is electrically connected to the photosensitive unit 1, and the control module is configured to overlap the images formed by the corresponding photosensitive units 1 to form a final image, thereby achieving that the final image can clearly and accurately reflect the actual color.

[0028] like Figure 3As shown, in an optional embodiment, the lens array 11 includes at least four lenses, and the side walls of adjacent lenses are in contact, and the lenses form at least a four-grid lens array 11 on the photosensitive unit 1; the lens arranged on one of the photosensitive units 1 is an IR lens 12, and the lenses arranged on the other three photosensitive units 1 are color lenses 13; the IR lens 12 is used to obtain images at night; the number of lenses in each lens array 11 is the same; the color of light that can be transmitted by the color lens 13 is one of red, blue and green; in the lens array 11 composed of color lenses 13, the colors that can be transmitted by adjacent lenses are different; in the lens array 11 composed of color lenses 13, at least one lens 13 of each color is provided; the main colors of light that can be transmitted by the three lens arrays 11 composed of color lenses 13 are different; the three lens arrays 11 composed of color lenses 13 have different main colors; Between the lens arrays 11, the color lenses 13 at the same position of the lens array 11 can transmit different colors. For the upper left corner position of an array, the first color lens 13 in the lens array 11 is a color lens 13 that can transmit blue light, the second color lens 13 in the lens array 11 is a color lens 13 that can transmit red light, and the third color lens 13 in the lens array 11 is a color lens 13 that can transmit green light. When multiple images are subsequently overlapped to obtain a final image, each position of the final image can ensure that its color is obtained by the color of the transmitted light reflected on the photosensitive unit 1, ensuring that the actual color of the actual environment can be accurately reflected in the final image, ensuring the accuracy of the final image, and then ensuring that accurate identification can be performed when identifying required parameters from the final image.

[0029] In an optional embodiment, the silicon substrate 4 is arranged on the moving mechanism 2, and the moving mechanism 2 is electrically connected to the control module; the moving mechanism 2 is suitable for driving the silicon substrate 4 to move and then driving the photosensitive unit 1 to move, so that the photosensitive unit 1 moves to the lens module 3 respectively, and the light passes through the lens module 3 and then passes through the lens array 11 to irradiate the photosensitive unit 1; the lens module 3 can be electrically connected to the control module, and the light will first pass through the lens module 3 and then pass through the lens array 11 to irradiate the photosensitive unit 1, and the photosensitive unit 1 can output an image to the control module; the moving mechanism 2 can drive the photosensitive unit 1 to move, so that the photosensitive unit 1 and the lens array 11 set on the photosensitive unit 1 pass through the lens module 3 respectively.

[0030] In an optional embodiment, the moving mechanism 2 includes: a shell 21 and a linear motor 22; the linear motor 22 is electrically connected to the control module; the linear motor 22 is arranged in the shell 21; the silicon substrate 4 is arranged on the linear motor 22, the photosensitive unit 1 and the silicon substrate 4 are arranged in the shell 21, the control module controls the linear motor 22 to drive the silicon substrate 4 to move and then drive the photosensitive unit 1 to move, and then drive the lens array 11 on the photosensitive unit 1 to move synchronously; the lens module 3 is arranged on the shell 21, and the light passes through the lens module 3 and then passes through the lens array 11 to irradiate the photosensitive unit 1; the cross-section area of ​​the lens module 3 through which the light passes is smaller than the area of ​​the lens array 11; the shell 21 is hollow inside, which is convenient for setting the linear motor 22 in the shell 2 1, and the hollow space is convenient for the linear motor 22 to drive the photosensitive unit 1 to move; the lens module 3 is arranged outside the shell 21 and partially extends into the shell 21, so that the light can enter the shell 21 after passing through the lens module 3; the photosensitive units 1 can be arranged side by side on the linear motor 22 along the moving direction of the linear motor 22, ensuring that the photosensitive units 1 can pass through the lens modules 3 respectively; the channel cross-section through which the lens module 3 can pass the light can be circular, the area of ​​the circle is smaller than the area of ​​the lens array 11, and the projection of the circle on the lens array 11 is completely on the lens array 11, so that the light passing through the lens module 3 can completely pass through the lens array 11, so that the light can completely pass through the lens array 11 to irradiate the photosensitive unit 1, ensuring that the color of the edge of the image can also accurately reflect the actual color.

[0031] like Figure 4 , Figure 5 and Figure 6 As shown, in an optional embodiment, when the number of color lenses 13 that can transmit green light in the lens array 11 composed of color lenses 13 is the largest, the main color of the light that can be transmitted by the lens array 11 is green; when the number of color lenses 13 that can transmit red light in the lens array 11 composed of color lenses 13 is the largest, the main color of the light that can be transmitted by the lens array 11 is red; when the number of color lenses 13 that can transmit blue light in the lens array 11 composed of color lenses 13 is the largest, the main color of the light that can be transmitted by the lens array 11 is blue.

[0032] In an optional embodiment, the control module is configured to first control the moving mechanism 2 to drive the lens array 11 and the photosensitive unit 1 corresponding to the main color of the area to be photographed to move to the lens module 3 during the day, and transmit the image obtained at this time to the control module through the photosensitive unit 1, and then the control module controls the moving mechanism 2 to drive the other two lens arrays 11 composed of color lenses 13 and the corresponding photosensitive units 1 to move to the lens module 3 respectively, and transmit the obtained image to the control module through the photosensitive unit 1. The control module overlaps the three images, and the image obtained by the photosensitive unit 1 corresponding to the main color is at the top to form a final image; the CMOS sensor device can be set On the drone, the drone is manually controlled. When it is necessary to take images, the CMOS sensor device can be manually controlled by a remote control. The type of the main color of the area to be photographed can be manually determined. For example, if the area to be photographed is a forest and its main color is green, the green color lens 13 is manually controlled by a remote control. The lens array 11 is first moved to the lens module 3. After the photosensitive unit 1 corresponding to the lens array 11 outputs the image to the control module, the remaining two lens arrays 11 corresponding to the photosensitive units 1 composed of the color lenses 13 are manually controlled by the remote control to move to the lens module 3. The control module overlaps and combines the three acquired images into a final image.

[0033] In an optional embodiment, the control module is configured to first control the moving mechanism 2 to drive the lens array 11 composed of IR lenses 12 and the corresponding photosensitive units 1 to move to the lens module 3 at night, and transmit the image acquired at this time to the control module through the photosensitive unit 1, and then the control module controls the moving mechanism 2 to drive the other three lens arrays 11 composed of color lenses 13 and the corresponding photosensitive units 1 to move to the lens module 3 respectively, and transmit the acquired image to the control module through the photosensitive unit 1, and the control module overlaps the four images, and sets the image acquired by the lens array 11 composed of IR lenses 12 and the corresponding photosensitive units 1 at the top to form a final image; when shooting images at night, the image is first output through the lens array 11 composed of IR lenses 12 and the corresponding photosensitive units 1, so that the final image acquired at night is clearer.

[0034] like Figure 8 and Fig. 9 As shown, at least one other disclosed embodiment also provides an image processing system using the above-mentioned CMOS sensor device, including: a drone and a host computer; the drone is provided with a CMOS sensor device, and a final image of the area to be photographed is collected by the CMOS sensor device, and the drone sends the final image to the host computer; the host computer collects the required parameters according to the final image; the drone can be integrated and developed through DJI UAV MSDK.

[0035] In an optional embodiment, the host computer establishes an index according to the attributes of the final image and saves it in a classified manner. The attributes of the final image include: image resolution, image size, image clarity and location information; after collecting the final image, the drone can trigger a data return instruction through a mobile phone app, and the drone sends the final image to the host computer; the remote control can be connected to the mobile phone app; the instruction is triggered by the remote control, and the app sends the instruction to the host computer, and the host computer processes the final image, and performs scheduling data preprocessing such as RGB image stitching, DEM, and multi-spectral stitching images to obtain the required crop parameters; the scheduling data preprocessing such as RGB image stitching, DEM, and multi-spectral stitching images can be integrated in the parameter extraction module of the host computer; the established index information is saved in ES (Elasticsearch), and the final image is stored in a ceph object to establish an agricultural big database; the host computer is suitable for obtaining crop parameters from the final image , the crop parameters include: vegetation coverage, number of missing seedlings, biomass and nutrient status; the drone is controlled by a remote control, and the drone can also be controlled by an app on a mobile phone; the mobile phone APP triggers the crop parameters to be extracted, such as vegetation coverage, number of missing seedlings, biomass and nutrient status, and can also calculate plant height, etc.; the host computer calls Spark and Flink big data in parallel to calculate and process the final image to obtain the required crop parameters, etc., and the calculation results are saved in the MySQL database and transmitted back to the APP for display, so that the user can obtain the required crop parameters in the first time; an image stitching module can be set in the host computer to stitch the final images together to obtain the overall image of the complete area, and the crop parameters to be extracted and the area range corresponding to the crop parameters to be extracted are sent to the host computer through the app. The host computer stitches the images of the area together through the image stitching module and then extracts the crop parameters.

[0036] At least one other disclosed embodiment also provides a working method using the above-mentioned CMOS sensor device, including: light passes through the lens array 11 and is irradiated on the photosensitive unit 1 to form an image, and the control module is configured to overlap the images formed by the corresponding photosensitive units 1 to form a final image.

[0037] In summary, the CMOS sensor device includes: a control module, and four photosensitive units 1 electrically connected to the control module; a lens array 11 is provided on the photosensitive unit 1; light passes through the lens array 11 and is irradiated on the photosensitive unit 1 to form an image, and the control module is configured to overlap the images formed by the corresponding photosensitive units 1 to form a final image, thereby achieving that the final graphic can clearly and accurately reflect the actual color.

[0038] In the description of the embodiments of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0039] In the description of the present invention, it should be noted that the orientation or positional relationship indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inside", "outside", etc. is based on the orientation or positional relationship shown in the drawings, which is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, terms such as "first", "second" and other numerical terms do not imply an order or sequence when used in this document unless explicitly indicated above. Therefore, without departing from the teachings of the example embodiments, the first element, component, region, layer or section discussed above may be referred to as a second element, component, region, layer or section.

[0040] Spatially relative terms, such as "inside", "outside", "below", "below", "down", "above", "on", etc., may be used herein to facilitate description of the relationship of one element or feature to another element or feature as illustrated in the figure. In addition to the orientation depicted in the figure, spatially relative terms may be intended to cover different orientations of the device in use or operation. For example, if the device in the figure is turned over, the elements described as "below" or "below" other elements or features will be oriented to be "above" other elements or features. Therefore, the example term "below" can cover the orientation above and below. The device can be oriented in other ways (rotated 90 degrees or in other orientations), and the spatially relative descriptors used herein are interpreted accordingly.

[0041] Based on the above ideal embodiments of the present invention, the relevant staff can make various changes and modifications without departing from the technical concept of the present invention through the above description. The technical scope of the present invention is not limited to the contents of the specification, and its technical scope must be determined according to the scope of the claims.

Claims

1. A CMOS sensor device, characterized in that: include: A silicon substrate (4), and at least four photosensitive units (1) arranged on the silicon substrate (4); The photosensitive units (1) are arranged side by side along the length direction of the silicon substrate (4); A lens array (11) is provided on the photosensitive unit; The light passes through the lens array (11) and is irradiated onto the photosensitive unit (1) to form an image; A plurality of groups of gold wires (41) are arranged on the silicon substrate (4) along the width direction of the silicon substrate (4), each group of gold wires (41) comprises four gold wires (41) corresponding to four photosensitive units (1) respectively, and the length of the gold wires (41) in each group of gold wires (41) gradually increases from top to bottom.

2. The CMOS sensor device according to claim 1, characterized in that: The control module is electrically connected to the photosensitive unit (1), and the control module is configured to overlap the images formed by the corresponding photosensitive units (1) to form a final image; The lens array (11) comprises at least four lenses, and the side walls of adjacent lenses are in contact, so that the lenses form at least a four-grid lens array (11) on the photosensitive unit (1); The lens arranged on one of the photosensitive units (1) is an IR lens (12), and the lenses arranged on the other three photosensitive units (1) are color lenses (13); The color lens (13) can transmit light of a color selected from red, blue and green; In a lens array (11) composed of color lenses (13), adjacent lenses can transmit different colors; In a lens array (11) composed of color lenses (13), at least one lens (13) of each color is provided; The three lens arrays (11) composed of color lenses (13) can transmit light rays of different primary colors; Among three lens arrays (11) composed of color lenses (13), the color lenses (13) at the same position of the lens array (11) can transmit different colors.

3. The CMOS sensor device according to claim 2, characterized in that: The silicon substrate (4) is arranged on the moving mechanism (2), and the moving mechanism (2) is electrically connected to the control module; The moving mechanism (2) is suitable for driving the silicon substrate (4) to move and further driving the photosensitive unit (1) to move, so that the photosensitive unit (1) is moved to the lens module (3) respectively, and the light passes through the lens module (3) and then passes through the lens array (11) to irradiate the photosensitive unit (1).

4. The CMOS sensor device according to claim 3, characterized in that: The moving mechanism (2) comprises: a housing (21) and a linear motor (22); The linear motor (22) is electrically connected to the control module; The linear motor (22) is arranged in the housing (21); The silicon substrate (4) is arranged on the linear motor (22), the silicon substrate (4) and the photosensitive unit (1) are arranged in the housing (21), and the control module controls the linear motor (22) to drive the photosensitive unit (1) to move, thereby driving the lens array (11) on the photosensitive unit (1) to move synchronously; The lens module (3) is arranged on the housing (21), and light passes through the lens module (3) and then through the lens array (11) to irradiate the photosensitive unit (1); The area of ​​the cross section through which light passes through the lens module (3) is smaller than the area of ​​the lens array (11).

5. The CMOS sensor device according to claim 4, characterized in that: When the number of color lenses (13) capable of transmitting green light in the lens array (11) composed of color lenses (13) is the largest, the main color of the light that can be transmitted by the lens array (11) is green; When the number of color lenses (13) capable of transmitting red light in the lens array (11) composed of color lenses (13) is the largest, the main color of the light that can be transmitted by the lens array (11) is red; When the number of color lenses (13) capable of transmitting blue light in the lens array (11) composed of color lenses (13) is the largest, the main color of the light that can be transmitted by the lens array (11) is blue.

6. The CMOS sensor device according to claim 5, characterized in that: The control module is configured to first control the moving mechanism (2) to drive the lens array (11) and the photosensitive unit (1) corresponding to the main color of the area to be photographed to move to the lens module (3) during the day, and transmit the image obtained at this time to the control module through the photosensitive unit (1). Then, the control module controls the moving mechanism (2) to drive the other two lens arrays (11) composed of color lenses (13) and the corresponding photosensitive units (1) to move to the lens module (3) respectively, and transmit the obtained image to the control module through the photosensitive unit (1). The control module overlaps the three images, and the image obtained by the photosensitive unit (1) corresponding to the main color is at the top, so as to form a final image.

7. The CMOS sensor device according to claim 5, characterized in that: The control module is configured to first control the moving mechanism (2) to drive the lens array (11) composed of IR lenses (12) and the corresponding photosensitive units (1) to move to the lens module (3) at night, and transmit the image obtained at this time to the control module through the photosensitive units (1). Then, the control module controls the moving mechanism (2) to drive the other three lens arrays (11) composed of color lenses (13) and the corresponding photosensitive units (1) to move to the lens module (3) respectively, and transmit the obtained images to the control module through the photosensitive units (1). The control module overlaps the four images, and sets the image obtained by the lens array (11) composed of the IR lenses (12) and the corresponding photosensitive units (1) at the top to form a final image.

8. An image processing system using the CMOS sensor device as claimed in claim 1, characterized in that: include: UAV and host computer; The drone is provided with a CMOS sensor device, through which the final image of the area to be photographed is collected, and the drone sends the final image to the host computer; The host computer collects the required parameters according to the final image.

9. The image processing system according to claim 8, characterized in that: The host computer creates an index according to the attributes of the final image and stores the index in a classified manner. The attributes of the final image include: image resolution, image size, image clarity and location information; The created index information is saved in ES, and the final image is stored in the ceph object to establish a large agricultural database; The host computer is suitable for obtaining crop parameters from the final image, wherein the crop parameters include: vegetation coverage, number of missing seedlings, biomass and nutrient status; The crop parameters to be extracted are triggered, and the host computer calls Spark and Flink big data parallel computing according to the crop parameters to be extracted.

10. A working method using the CMOS sensor device as claimed in claim 1, characterized in that: include: After passing through the lens array (11), the light is irradiated onto the photosensitive unit (1) to form an image, and the control module is configured to overlap the images formed by the corresponding photosensitive units (1) to form a final image.

Citation Information

Patent Citations

  • Color image synthesis method and device

    CN107203966A

  • Camera module and mobile terminal

    CN109618080A

  • Camera module and terminal

    CN111866310A

  • Image acquisition method and device and optical path conversion element

    CN112004011A

  • Image sensor, camera and electronic device

    CN115278127A