Cmos sensor device, image processing system and method of operation

Abstract

The application belongs to the technical field of electrical elements, and particularly relates to a semiconductor device, and especially relates to a cmos sensor device, an image processing system and a working method, which comprises a silicon substrate, and at least four photosensitive units arranged on the silicon substrate; the photosensitive units are arranged side by side along the length direction of the silicon substrate; a lens array is arranged on the photosensitive units; light irradiates on the photosensitive units to form an image after passing through the lens array; a plurality of groups of gold wires are arranged along the width direction of the silicon substrate on the silicon substrate, four gold wires are arranged in each group of gold wires to correspond to the four photosensitive units respectively, and the length of the gold wires gradually increases from top to bottom in each group of gold wires, so that the final image is obtained after the images formed by the plurality of photosensitive units are overlapped, the final image can clearly and accurately reflect the actual color, and the arrangement mode of the gold wires can avoid the interference.

Description

Technical Field

[0001] This invention belongs to the field of electrical component technology, specifically relating to semiconductor devices, and more particularly to a CMOS sensor device, an image processing system, and a working method. Background Technology

[0002] In agricultural planting, it is necessary to acquire images of the planting area through image acquisition, and then extract crop parameters from the images, such as vegetation coverage, number of missing seedlings, biomass, and nutrient status. In related technologies, image acquisition is carried out by a single acquisition module, which consists of a lens array and a photosensitive unit. After light passes through the lens array, it shines on the photosensitive unit to form an image. The lens array is composed of red, green, and blue lenses. A single lens can only transmit one color of light. At this time, the other colors of the corresponding part of the image are synthesized and supplemented by the algorithm. The algorithm cannot perfectly reproduce the actual colors, which leads to the inaccurate reflection of the actual colors of the environment in the image. Furthermore, when multiple photosensitive units are set, data interference is prone to occur during the imaging process.

[0003] Therefore, since there are parts in the image that cannot accurately reflect the actual colors, it is necessary to design a CMOS sensor device, an image processing system, and a working method.

[0004] It should be noted that the information disclosed in this background section is only for understanding the background technology of the present application concept, and therefore, the above description is not considered to constitute prior art information. Summary of the Invention

[0005] This disclosure provides at least one CMOS sensor device, an image processing system, and a method of operation.

[0006] In a first aspect, embodiments of this disclosure provide a CMOS sensor device, comprising:

[0007] A silicon substrate, and at least four photosensitive units disposed on the silicon substrate;

[0008] The photosensitive units are arranged side by side along the length of the silicon substrate;

[0009] The photosensitive unit is provided with a lens array;

[0010] Light passes through a lens array and illuminates the photosensitive unit to form an image;

[0011] Several groups of gold wires are arranged on the silicon substrate along the width direction of the silicon substrate. Each group of gold wires has four gold wires to correspond to four photosensitive units respectively, and the length of the gold wires in each group gradually increases from top to bottom.

[0012] In one optional implementation, the control module is electrically connected to the photosensitive unit, and the control module is configured to overlay images formed by corresponding photosensitive units to form a final image;

[0013] The lens array includes at least four lenses, and the sidewalls of adjacent lenses are in contact. The lenses form at least a four-grid lens array on the photosensitive unit.

[0014] One of the photosensitive units has an IR lens, while the other three photosensitive units have color lenses.

[0015] The color lens can transmit light in one of the colors of red, blue, and green;

[0016] In a lens array composed of colored lenses, adjacent lenses can transmit different colors;

[0017] In a lens array composed of colored lenses, at least one lens of each color is provided;

[0018] Three lens arrays composed of colored lenses can transmit light of different dominant colors;

[0019] Among three lens arrays consisting of colored lenses, the colored lenses at the same position can transmit different colors.

[0020] In one alternative embodiment, the silicon substrate is disposed on a moving mechanism, and the moving mechanism is electrically connected to the control module;

[0021] The moving mechanism is adapted to move the silicon substrate and thus move the photosensitive units, so that the photosensitive units are moved to the lens module, and the light passes through the lens module and then through the lens array to illuminate the photosensitive units.

[0022] In one alternative implementation, the moving mechanism includes: a housing and a linear motor;

[0023] The linear motor is electrically connected to the control module;

[0024] The linear motor is housed within the housing;

[0025] The silicon substrate is mounted on the linear motor, and the silicon substrate and the photosensitive unit are mounted inside the housing. The control module controls the linear motor to drive the photosensitive unit to move, thereby driving the lens array on the photosensitive unit to move synchronously.

[0026] The lens module is mounted on the housing, and light passes through the lens module and then through the lens array to illuminate the photosensitive unit.

[0027] The area of ​​the cross-section through which light passes through the lens module is smaller than the area of ​​the lens array.

[0028] In one alternative implementation, when the lens array composed of colored lenses has the most colored lenses that can transmit green light, the main color of the light transmitted by the lens array is green.

[0029] When the lens array composed of colored lenses has the most lenses that can transmit red light, the main color of the light transmitted by the lens array is red.

[0030] When the lens array composed of colored lenses has the most lenses that can transmit blue light, the main color of the light transmitted by the lens array is blue.

[0031] In one optional implementation, the control module is configured to first control the moving mechanism to move the lens array and photosensitive unit corresponding to the main color of the area to be photographed to the lens module during the daytime, and transmit the image acquired at this time to the control module through the photosensitive unit. Then, the control module controls the moving mechanism to move the other two lens arrays composed of color lenses and their corresponding photosensitive units to the lens module, and transmit the acquired images to the control module through the photosensitive units. The control module then overlays the three images, with the image acquired by the photosensitive unit corresponding to the main color on top, to form the final image.

[0032] In one optional implementation, the control module is configured to first control the moving mechanism to move the lens array composed of IR lenses and the corresponding photosensitive units to the lens module at night, and transmit the acquired image to the control module through the photosensitive units. Then, the control module controls the moving mechanism to move the other three lens arrays composed of color lenses and the corresponding photosensitive units to the lens module, and transmit the acquired images to the control module through the photosensitive units. The control module then overlays the four images, with the image acquired by the photosensitive units of the lens array composed of IR lenses placed on top to form the final image.

[0033] Secondly, embodiments of this disclosure also provide an image processing system employing the above-described CMOS sensor device, comprising:

[0034] Drones and host computers;

[0035] The drone is equipped with a CMOS sensor device, which collects the final image of the area to be photographed and then sends the final image to the host computer.

[0036] The host computer acquires the required parameters based on the final image.

[0037] In one optional implementation, the host computer establishes an index and classifies and saves the final image based on its attributes, including: image resolution, image size, image clarity, and location information.

[0038] The established index information is saved to Elasticsearch, and the final images are stored in Ceph objects to build an agricultural big data database.

[0039] The host computer is adapted to obtain crop parameters from the final image, including: vegetation coverage, number of missing seedlings, biomass, and nutrient status;

[0040] The system triggers the extraction of crop parameters, and the host computer calls Spark and Flink for big data parallel computing based on the extracted crop parameters.

[0041] Thirdly, this disclosure also provides a method for operating the above-described CMOS sensor device, comprising:

[0042] Light passes through a lens array and illuminates the photosensitive unit to form an image. The control module is configured to overlap the images formed by the corresponding photosensitive units to form the final image.

[0043] The beneficial effects of this invention are as follows: This CMOS sensor device includes: a silicon substrate, and at least four photosensitive units disposed on the silicon substrate; the photosensitive units are arranged side by side along the length direction of the silicon substrate; a lens array is disposed on the photosensitive unit; light passes through the lens array and illuminates the photosensitive unit to form an image; several groups of gold wires are disposed on the silicon substrate along the width direction of the silicon substrate, each group of gold wires has four gold wires corresponding to the four photosensitive units respectively, and the length of the gold wires in each group gradually increases from top to bottom, thereby realizing the acquisition of a final image by overlapping the images formed by multiple photosensitive units. The final image can clearly and accurately reflect the actual color, and the arrangement of the gold wires can avoid interference.

[0044] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention are realized and obtained in accordance with the structures particularly pointed out in the description, claims and drawings.

[0045] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, preferred embodiments are described in detail below with reference to the accompanying drawings. Attached Figure Description

[0046] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0047] Figure 1 This is a schematic diagram of the structure of a CMOS sensor device provided in an embodiment of the present disclosure;

[0048] Figure 2 A cross-sectional view of a CMOS sensor device provided in an embodiment of this disclosure;

[0049] Figure 3 This is a schematic diagram of an IR lens array provided in an embodiment of the present disclosure;

[0050] Figure 4 A lens array whose primary light color is green is provided for embodiments of this disclosure;

[0051] Figure 5 An embodiment of this disclosure provides a lens array in which the primary color of light that can be transmitted is blue;

[0052] Figure 6 An embodiment of this disclosure provides a lens array in which the primary color of light that can be transmitted is red;

[0053] Figure 7 A schematic block diagram of a CMOS sensor device provided in this disclosure embodiment;

[0054] Figure 8 This is a schematic diagram of the principle of an image processing system provided in an embodiment of the present disclosure;

[0055] Figure 9 This is a schematic flowchart of an image processing system provided in an embodiment of the present disclosure;

[0056] Figure 10 This is a schematic diagram of a gold wire arrangement provided in an embodiment of the present disclosure.

[0057] In the picture:

[0058] 1 photosensitive unit, 11 lens arrays, 12 IR lenses, 13 color lenses;

[0059] 2. Moving mechanism; 21. Housing; 22. Linear motor;

[0060] 3-lens module;

[0061] 4 silicon substrate, 41 gold wires. Detailed Implementation

[0062] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0063] In this document, when it is mentioned that a first component is located on a second component, this can mean that the first component can be directly formed on the second component, or that a third component can be inserted between the first and second components. Furthermore, in the accompanying drawings, the thickness of the components may be exaggerated or reduced for the purpose of effectively describing the technical content.

[0064] As used herein, the phrases “in one embodiment,” “according to one embodiment,” “in some embodiments,” etc., generally refer to the fact that a particular feature, structure, or characteristic following the phrase can be included in at least one embodiment of this disclosure. Therefore, a particular feature, structure, or characteristic can be included in more than one embodiment of this disclosure, such that these phrases do not necessarily refer to the same embodiment. As used herein, the terms “example,” “exemplary,” etc., are used to “serve as an example, instance, or illustration.” Any implementation, aspect, or design described herein as “example” or “exemplary” is not necessarily to be construed as preferred or superior to other implementations, aspects, or designs. Rather, the use of the terms “example,” “exemplary,” etc., is intended to present concepts in a specific manner.

[0065] The following detailed description of some embodiments of the present invention is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0066] like Figure 10As shown, at least one disclosed embodiment provides a CMOS sensor device, including: a silicon substrate 4, and at least four photosensitive units 1 disposed on the silicon substrate 4; the photosensitive units 1 are arranged side by side along the length direction of the silicon substrate 4; a lens array 11 is disposed on the photosensitive unit; light passes through the lens array 11 and illuminates the photosensitive unit 1 to form an image; a plurality of groups of gold wires 41 are disposed on the silicon substrate 4 along the width direction of the silicon substrate 4, each group of gold wires 41 having four gold wires 41 respectively corresponding to the four photosensitive units 1, and each group of gold wires 41 The length of the gold wires 41 gradually increases from top to bottom. The relevant images are acquired through a single acquisition module. Only one photosensitive unit 1 needs to be set on the silicon substrate 4. The gold wires 41 corresponding to this photosensitive unit 1 on the silicon substrate 4 can be arranged relatively sparsely, and there will be no interference between adjacent gold wires 41. However, only one photosensitive unit 1 cannot meet the requirement of accurately reflecting the actual color of the environment. Therefore, at least four photosensitive units 1 are used in this embodiment. However, four photosensitive units 1 will cause the corresponding gold wires 41 to be arranged more densely on the silicon substrate 4. For example, one... Photosensitive unit 1 requires four corresponding gold wires 41. If the four gold wires 41 corresponding to one photosensitive unit 1 are arranged from top to bottom, and the gold wires 41 of other photosensitive units 1 continue to be arranged downwards, the gaps between adjacent gold wires 41 will be small. When a photosensitive unit 1 is working, the small gaps between its four corresponding gold wires 41 are prone to interference, causing the photosensitive unit 1 to fail to form an accurate image. Therefore, the arrangement of the gold wires 41 needs to be modified to avoid interference. Specifically, the arrangement can be such that the uppermost gold wire 41 in a group of gold wires 41 is the shortest, and the lowermost gold wire 41 is the shortest. The longest gold wire 41 can be connected to the leftmost photosensitive unit 1 on the silicon substrate 4, and the shortest gold wire 41 can be connected to the rightmost photosensitive unit 1 on the silicon substrate 4. When a photosensitive unit 1 is working, there are other photosensitive units 1 corresponding to gold wires 41 between two adjacent gold wires 41 of the corresponding photosensitive unit 1. At this time, the other photosensitive units 1 are not working, and the gold wires 41 of the other photosensitive units 1 can play the role of blocking noise signals, so that the adjacent gold wires 41 of the working photosensitive unit 1 will not interfere with each other.

[0067] like Figure 1 , Figure 2 and Figure 7 As shown, the control module is electrically connected to the photosensitive unit 1. The control module is configured to overlay the images formed by the corresponding photosensitive unit 1 to form the final image, thereby enabling the final image to clearly and accurately reflect the actual color.

[0068] like Figure 3As shown, in an optional embodiment, the lens array 11 includes at least four lenses, and the sidewalls of adjacent lenses are in contact. The lenses form at least a four-grid lens array 11 on the photosensitive unit 1. One of the lenses on the photosensitive unit 1 is an IR lens 12, and the lenses on the other three photosensitive units 1 are color lenses 13. The IR lens 12 is used to acquire images at night. Each lens array 11 has the same number of lenses. The color of light transmitted by the color lens 13 is one of red, blue, and green. In the lens array 11 composed of color lenses 13, adjacent lenses transmit different colors. In the lens array 11 composed of color lenses 13, at least one of each color lens 13 is provided. The main colors of light transmitted by three lens arrays 11 composed of color lenses 13 are different. Between lens arrays 11, the colors that the color lenses 13 at the same position in the lens array 11 can transmit are different. For the upper left corner position of an array, the first color lens 13 in the lens array 11 can transmit blue light, the second color lens 13 in the lens array 11 can transmit red light, and the third color lens 13 in the lens array 11 can transmit green light. This ensures that when multiple images are superimposed to obtain the final image, the color of each position in the final image can be obtained by the color of the transmitted light reflected on the photosensitive unit 1. This ensures that the actual color of the actual environment can be accurately reflected in the final image, ensuring the accuracy of the final image, and thus ensuring accurate identification when identifying the required parameters from the final image.

[0069] In one optional embodiment, the silicon substrate 4 is disposed on the moving mechanism 2, and the moving mechanism 2 is electrically connected to the control module; the moving mechanism 2 is adapted to drive the silicon substrate 4 to move, thereby driving the photosensitive unit 1 to move, so that the photosensitive unit 1 moves to the lens module 3 respectively, and the light passes through the lens module 3 and then through the lens array 11 to illuminate the photosensitive unit 1; the lens module 3 can be electrically connected to the control module, and the light will first pass through the lens module 3 and then through the lens array 11 to illuminate the photosensitive unit 1, and the photosensitive unit 1 can output an image to the control module; the moving mechanism 2 can drive the photosensitive unit 1 to move, so that the photosensitive unit 1 and the lens array 11 disposed on the photosensitive unit 1 respectively pass through the lens module 3.

[0070] In one optional embodiment, the moving mechanism 2 includes: a housing 21 and a linear motor 22; the linear motor 22 is electrically connected to the control module; the linear motor 22 is disposed within the housing 21; the silicon substrate 4 is disposed on the linear motor 22, the photosensitive unit 1 and the silicon substrate 4 are disposed within the housing 21, the control module controls the linear motor 22 to move the silicon substrate 4, thereby moving the photosensitive unit 1, and thus moving the lens array 11 on the photosensitive unit 1 synchronously; the lens module 3 is disposed on the housing 21, and light passes through the lens module 3 and then through the lens array 11 to illuminate the photosensitive unit 1; the cross-sectional area of ​​the lens module 3 that transmits light is smaller than the area of ​​the lens array 11; the housing 21 is hollow inside to facilitate the placement of the linear motor 22 within the housing 21. The interior of the housing 21 is hollow, which facilitates the movement of the photosensitive unit 1 by the linear motor 22. The lens module 3 is located outside the housing 21 and extends partially into the housing 21 so that light can enter the interior of the housing 21 after passing through the lens module 3. The photosensitive units 1 can be arranged side by side on the linear motor 22 along the moving direction of the linear motor 22, ensuring that the photosensitive units 1 can pass through the lens module 3 respectively. The cross-section of the light-transmitting channel of the lens module 3 can be circular, and the area of ​​the circle is smaller than the area of ​​the lens array 11. The projection of the circle on the lens array 11 is completely on the lens array 11, so that the light passing through the lens module 3 can completely pass through the lens array 11 and illuminate the photosensitive unit 1, ensuring that the color of the image edge can also accurately reflect the actual color.

[0071] like Figure 4 , Figure 5 and Figure 6 As shown, in an optional embodiment, when the lens array 11 composed of color lenses 13 has the most color lenses 13 that can transmit green light, the main color of the light transmitted by the lens array 11 is green; when the lens array 11 composed of color lenses 13 has the most color lenses 13 that can transmit red light, the main color of the light transmitted by the lens array 11 is red; when the lens array 11 composed of color lenses 13 has the most color lenses 13 that can transmit blue light, the main color of the light transmitted by the lens array 11 is blue.

[0072] In one optional implementation, the control module is configured to first control the moving mechanism 2 to move the lens array 11 and photosensitive unit 1 corresponding to the main color of the area to be photographed to the lens module 3 during the daytime, and transmit the image acquired at this time to the control module through the photosensitive unit 1. Then, the control module controls the moving mechanism 2 to move the other two lens arrays 11 composed of color lenses 13 and their corresponding photosensitive units 1 to the lens module 3 respectively, and transmit the acquired images to the control module through the photosensitive units 1. The control module overlays the three images, with the image acquired by the photosensitive unit 1 corresponding to the main color on top, forming the final image; the CMOS sensor device can be set in... On the drone, the drone is manually controlled. When it is necessary to take pictures, the CMOS sensor device can be controlled manually via remote control. The operator can determine the type of the main color of the area to be photographed. For example, if the area to be photographed is a forest and its main color is green, the operator can control the green color lens 13 and the lens array 11 to move to the lens module 3 first via remote control. After the photosensitive unit 1 corresponding to the lens array 11 outputs the image to the control module, the operator can then control the other two lens arrays 11 composed of color lenses 13 to move to the lens module 3 via remote control. The control module will then overlap and combine the three images to form the final image.

[0073] In one optional implementation, the control module is configured to first control the moving mechanism 2 to move the lens array 11 composed of IR lenses 12 and the corresponding photosensitive unit 1 to the lens module 3 at night, and transmit the image acquired at this time to the control module through the photosensitive unit 1. Then, the control module controls the moving mechanism 2 to move the other three lens arrays 11 composed of color lenses 13 and the corresponding photosensitive units 1 to the lens module 3 respectively, and transmit the acquired images to the control module through the photosensitive units 1. The control module overlays the four images, with the image acquired by the photosensitive unit 1 of the lens array 11 composed of IR lenses 12 placed on top to form the final image. When taking images at night, the image is first output through the lens array 11 composed of IR lenses 12 and the corresponding photosensitive unit 1, making the final image acquired at night clearer.

[0074] like Figure 8 and Figure 9 As shown, at least one other disclosed embodiment also provides an image processing system employing the above-described CMOS sensor device, comprising: a drone and a host computer; the drone is equipped with a CMOS sensor device, which acquires the final image of the area to be photographed, and the drone sends the final image to the host computer; the host computer acquires the required parameters based on the final image; the drone can be integrated and developed using DJI drone MSDK.

[0075] In one optional implementation, the host computer establishes an index and categorizes and saves the data based on the attributes of the final image. These attributes include image resolution, image size, image clarity, and location information. After acquiring the final image, the drone can trigger a data transmission command via a mobile app, sending the final image to the host computer. The remote controller can connect to the mobile app. The remote controller triggers a command, which is then sent to the host computer. The host computer processes the final image, performing preprocessing such as RGB image stitching, DEM, and multispectral image stitching to obtain the required crop parameters. This preprocessing can be integrated into the host computer's parameter extraction module. The established index information is saved in Elasticsearch, and the final image is stored in a Ceph object, creating an agricultural big data database. The host computer is adapted to extract crop parameters from the final image. The crop parameters include: vegetation coverage, number of missing seedlings, biomass, and nutrient status. The drone is controlled by a remote controller, or it can be controlled by a mobile app. The mobile app triggers the extraction of crop parameters, such as vegetation coverage, number of missing seedlings, biomass, and nutrient status, and can also calculate plant height. The host computer calls Spark and Flink big data parallel processing to perform calculations on the final image to obtain the required crop parameters. The calculation results are saved to a MySQL database and sent back to the app for display, allowing users to obtain the required crop parameters immediately. The host computer can be equipped with an image stitching module to stitch the final images together to obtain a complete image of the region. The app sends the crop parameters to be extracted, as well as the corresponding area range, to the host computer. The host computer stitches the images of the region together using the image stitching module before extracting the crop parameters.

[0076] At least one other disclosed embodiment also provides a method of operating the above-described CMOS sensor device, comprising: light passing through a lens array 11 and illuminating a photosensitive unit 1 to form an image, and a control module being configured to overlap the images formed by the corresponding photosensitive units 1 to form a final image.

[0077] In summary, this CMOS sensor device includes: a control module and four photosensitive units 1 electrically connected to the control module; each photosensitive unit 1 is provided with a lens array 11; light passes through the lens array 11 and illuminates the photosensitive unit 1 to form an image; the control module is configured to superimpose the images formed by the corresponding photosensitive units 1 to form a final image, thereby enabling the final image to clearly and accurately reflect the actual color.

[0078] In the description of the embodiments of the present invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in the present invention based on the specific circumstances.

[0079] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicating orientation or positional relationships, are based on the orientation or positional relationships shown in the accompanying drawings and are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, terms such as "first," "second," and other numerical terms used herein do not imply order or sequence unless expressly indicated herein. Therefore, without departing from the teachings of the exemplary embodiments, the first element, component, region, layer, or segment discussed above may be referred to as a second element, component, region, layer, or segment.

[0080] Spatially relative terms, such as “inside,” “outside,” “below,” “below,” “down,” “above,” “up,” etc., may be used herein to describe the relationship between one element or feature illustrated in the figures and another element or feature. In addition to the orientations depicted in the figures, spatially relative terms may be intended to cover different orientations of the device in use or operation. For example, if the device in the figure is flipped, an element described as “below” or “below” other elements or features would be oriented as “above” other elements or features. Thus, the example term “below” can cover both above and below orientations. The device may be oriented in other ways (rotated 90 degrees or in other orientations), and the spatially relative descriptors used herein are interpreted accordingly.

[0081] Based on the above-described preferred embodiments of the present invention, and through the foregoing description, those skilled in the art can make various changes and modifications without departing from the inventive concept. The technical scope of this invention is not limited to the contents of the specification, but must be determined according to the scope of the claims.

Claims

1. A CMOS sensor device, characterized in that, include: A silicon substrate (4), and four photosensitive units (1) disposed on the silicon substrate (4); The photosensitive units (1) are arranged side by side along the length of the silicon substrate (4); The photosensitive unit is provided with a lens array (11). After passing through the lens array (11), light shines on the photosensitive unit (1) to form an image; Several sets of gold wires (41) are provided on the silicon substrate (4) along the width direction of the silicon substrate (4). The gold wires (41) extend along the length direction of the silicon substrate (4). Each set of gold wires (41) has four gold wires (41) to correspond to four photosensitive units (1) respectively. The length of the gold wires (41) in each set of gold wires (41) gradually increases from top to bottom. The control module is electrically connected to the photosensitive unit (1), and the control module is configured to superimpose the images formed by the corresponding photosensitive unit (1) to form the final image; The lens array (11) includes at least four lenses, and the sidewalls of adjacent lenses are in contact. The lenses form at least a four-grid lens array (11) on the photosensitive unit (1). One of the photosensitive units (1) has an IR lens (12) and the other three photosensitive units (1) have color lenses (13). The color lens (13) can transmit light in one of the colors of red, blue and green; In the lens array (11) composed of colored lenses (13), adjacent lenses can transmit different colors; In the lens array (11) composed of colored lenses (13), at least one of each type of colored lens (13) is provided; The three lens arrays (11) composed of colored lenses (13) can transmit light of different primary colors; Between the three lens arrays (11) consisting of color lenses (13), the colors that can be transmitted by the color lenses (13) at the same position in the lens array (11) are different.

2. The CMOS sensor device as described in claim 1, characterized in that, The silicon substrate (4) is disposed on the moving mechanism (2), and the moving mechanism (2) is electrically connected to the control module; The moving mechanism (2) is adapted to move the silicon substrate (4) and thus move the photosensitive unit (1) so that the photosensitive unit (1) moves to the lens module (3) respectively, and the light passes through the lens module (3) and then shines on the photosensitive unit (1) after passing through the lens array (11).

3. The CMOS sensor device as described in claim 2, characterized in that, The moving mechanism (2) includes: a housing (21) and a linear motor (22); The linear motor (22) is electrically connected to the control module; The linear motor (22) is disposed inside the housing (21); The silicon substrate (4) is disposed on the linear motor (22), and the silicon substrate (4) and the photosensitive unit (1) are disposed inside the housing (21). The control module controls the linear motor (22) to drive the photosensitive unit (1) to move, thereby driving the lens array (11) on the photosensitive unit (1) to move synchronously. The lens module (3) is disposed on the housing (21), and light passes through the lens module (3) and then through the lens array (11) to illuminate the photosensitive unit (1); The area of ​​the cross section through which the light passes through the lens module (3) is smaller than the area of ​​the lens array (11).

4. The CMOS sensor device as described in claim 3, characterized in that, When the lens array (11) composed of colored lenses (13) has the most colored lenses (13) that can transmit green light, the main color of the light that the lens array (11) can transmit is green. When the lens array (11) composed of colored lenses (13) has the most colored lenses (13) that can transmit red light, the main color of the light that the lens array (11) can transmit is red. When the lens array (11) composed of colored lenses (13) has the most colored lenses (13) that can transmit blue light, the main color of the light that the lens array (11) can transmit is blue.

5. The CMOS sensor device as described in claim 4, characterized in that, The control module is configured to first control the moving mechanism (2) during the day to move the lens array (11) and photosensitive unit (1) corresponding to the main color of the area to be photographed to the lens module (3), and transmit the image acquired at this time to the control module through the photosensitive unit (1). Then, the control module controls the moving mechanism (2) to move the other two lens arrays (11) composed of color lenses (13) and the corresponding photosensitive units (1) to the lens module (3) respectively, and transmit the acquired image to the control module through the photosensitive unit (1). The control module overlays the three images, with the image acquired by the photosensitive unit (1) corresponding to the main color at the top, forming the final image.

6. The CMOS sensor device as described in claim 4, characterized in that, The control module is configured to first control the moving mechanism (2) to move the lens array (11) composed of IR lenses (12) and the corresponding photosensitive unit (1) to the lens module (3) at night, and transmit the image acquired at this time to the control module through the photosensitive unit (1). Then, the control module controls the moving mechanism (2) to move the other three lens arrays (11) composed of color lenses (13) and the corresponding photosensitive units (1) to the lens module (3) respectively, and transmit the acquired image to the control module through the photosensitive unit (1). The control module overlays the four images, and sets the image acquired by the corresponding photosensitive unit (1) of the lens array (11) composed of IR lenses (12) at the top to form the final image.

7. An image processing system employing the CMOS sensor device as described in claim 1, characterized in that, include: Drones and host computers; The drone is equipped with a CMOS sensor device, which collects the final image of the area to be photographed and then sends the final image to the host computer. The host computer acquires the required parameters based on the final image.

8. The image processing system as described in claim 7, characterized in that, The host computer establishes an index and categorizes and saves the final image based on its attributes. The attributes of the final image include: image resolution, image size, image clarity, and position information. The established index information is saved to Elasticsearch, and the final images are stored in Ceph objects to build an agricultural big data database. The host computer is adapted to obtain crop parameters from the final image, including: vegetation coverage, number of missing seedlings, biomass, and nutrient status; The system triggers the extraction of crop parameters, and the host computer calls Spark and Flink for big data parallel computing based on the extracted crop parameters.

9. A method for operating the CMOS sensor device as described in claim 1, characterized in that, include: After passing through the lens array (11), light shines on the photosensitive unit (1) to form an image. The control module is configured to overlap the images formed by the corresponding photosensitive unit (1) to form the final image.

Images