A grain impurity and broken information monitoring device and harvester

Abstract

The present application provides a kind of grain impurity and broken information monitoring device and harvester, including conveying device, monitoring box, optical illumination system, image acquisition mechanism, image processing system and control unit;The one end of the conveying device is used to be connected with the cleaning device, the other end is used to be connected with the grain box;The monitoring box is used to be installed in the outside of harvester, and monitoring box is connected with the image acquisition window arranged on conveying device;The optical illumination system and image acquisition mechanism are installed in monitoring box, and the image acquisition mechanism is used to acquire the image of the harvested material in conveying device, and is transmitted to image processing system;The control unit is connected with optical illumination system and image acquisition mechanism respectively.The monitoring box of the present application is installed in the outside of harvester, and the image acquisition mechanism acquires the image of the harvested material in conveying device, and is transmitted to image processing system for image processing, real-time monitoring of harvester impurity and broken information, for evaluating the real-time operation performance of harvester.

Description

Technical Field

[0001] This invention belongs to the field of agricultural machinery technology, and in particular relates to a grain impurity and breakage information monitoring device and a harvester. Background Technology

[0002] The impurity content and breakage rate of grains are important indicators of the harvesting performance of combine harvesters. For a long time, people have mostly used manual screening or visual identification methods to detect the impurity content and breakage rate of grains such as rice, wheat, and rapeseed. This method is highly subjective and does not yield accurate data or real-time access to the relevant data.

[0003] In recent years, some methods for detecting impurity content and breakage rate have emerged. These methods obtain images of grains inside the grain bin and process the images to obtain the real-time impurity content. However, dust and impurities inside the grain bin can seriously affect the camera and image quality, ultimately impacting accuracy.

[0004] Existing technology also discloses a method for monitoring the impurity content of grains inside a grain bin, which mainly involves automated monitoring of the impurity content of grains inside the grain bin. However, since it is set inside the grain bin, dust inside the grain bin may affect the test results. In addition, a special sampling box is required, which occupies the space inside the grain bin. Summary of the Invention

[0005] To address the aforementioned technical problems, this invention provides a grain impurity and breakage information monitoring device. The monitoring box is installed on the outside of the harvester, and the image acquisition mechanism collects images of the harvested material inside the conveying device and transmits them to the image processing system for image processing. This device monitors the impurity and breakage information of the harvester in real time, and is used to evaluate the real-time operating performance of the harvester.

[0006] Therefore, the present invention proposes a harvester including the aforementioned grain impurity and breakage information monitoring device.

[0007] The technical solution of the present invention is: a device for monitoring information on impurities and breakage, comprising a conveying device, a monitoring box, an optical illumination system, an image acquisition mechanism, an image processing system, and a control unit;

[0008] One end of the conveying device is used to connect to the cleaning device, and the other end is used to connect to the grain tank;

[0009] The monitoring box is used to be installed on the outside of the harvester, and the monitoring box is connected to the image acquisition window set on the conveying device;

[0010] The optical illumination system and image acquisition mechanism are installed inside the monitoring box. The image acquisition mechanism is used to acquire images of the harvested items inside the conveying device and transmit them to the image processing system.

[0011] The control unit is connected to both the optical illumination system and the image acquisition mechanism.

[0012] In the above scheme, the conveying device includes a conveying auger and a conveying auger drum;

[0013] The conveying auger and the conveying auger cylinder are connected by an auger shaft. One end of the conveying auger cylinder is used to connect to the cleaning device, and the other end is used to connect to the grain bin. The image acquisition window is set on the side of the conveying auger cylinder.

[0014] In the above scheme, the monitoring box includes a monitoring box body, a monitoring box cover, and a transparent baffle;

[0015] The upper part of the monitoring box is provided with a monitoring box cover; the optical lighting system and image acquisition mechanism are installed inside the monitoring box.

[0016] The transparent block is installed at the connection between the monitoring box and the image acquisition window.

[0017] In the above scheme, the optical lighting system includes a light source and a light source controller;

[0018] The light source is placed in the monitoring box and is located in front of the image acquisition mechanism;

[0019] The light source controller is connected to the light source.

[0020] Furthermore, it also includes a light source mounting bracket;

[0021] The light source is mounted in the monitoring box via a light source mounting bracket.

[0022] Furthermore, the brightness and color type of the light source are adjusted by a light source controller.

[0023] In the above scheme, the image acquisition mechanism is an industrial area scan camera.

[0024] Furthermore, it also includes camera mounts;

[0025] The industrial area array camera is mounted in the monitoring box using a camera mount.

[0026] The above solution also includes vibration damping devices;

[0027] The vibration damping device includes multiple vibration dampers;

[0028] The vibration dampers are respectively installed at the connection between the optical lighting system and the monitoring box, the connection between the image acquisition mechanism and the monitoring box, and the connection between the monitoring box and the conveying auger.

[0029] A harvester includes the aforementioned monitoring device for impurity and breakage information.

[0030] Compared with the prior art, the beneficial effects of the present invention are:

[0031] 1. The monitoring box of this invention is set on the outside of the grain bin, which avoids the serious impact of dust inside the grain bin on the camera and image quality, and also reduces the volume occupied inside the grain bin, thus improving the space utilization rate inside the grain bin.

[0032] 2. The synchronization time, brightness, and color type of the light source and image acquisition mechanism described in this invention are adjustable, which can acquire high-quality images of harvested materials input into the grain bin in a flowing state, such as rice, wheat, rapeseed grains, and miscellaneous materials, avoiding problems such as wasting energy and reducing the lifespan of the light source by keeping it constantly on.

[0033] 3. This invention allows drivers to understand the operating performance of the combine harvester in real time, and enables rapid optimization of the machine's operating parameters to maintain high-quality operation over a long period. Attached Figure Description

[0034] Figure 1 This is a schematic diagram of the structure of a grain impurity and breakage information monitoring device according to an embodiment of the present invention.

[0035] Figure 2 for Figure 1 Side view.

[0036] Figure 3 for Figure 1 Top view.

[0037] Figure 4 This is a schematic diagram of the monitoring box according to one embodiment of the present invention.

[0038] Figure 5 This is a bottom view of the monitoring box according to one embodiment of the present invention.

[0039] Figure 6 This is a side view of the monitoring box according to one embodiment of the present invention.

[0040] Figure 7 This is a schematic diagram of the vibration reduction device according to one embodiment of the present invention.

[0041] Figure 8 This is a simulation diagram of an image acquisition window according to an embodiment of the present invention.

[0042] Figure 9 This is an original diagram of a rice experiment according to one embodiment of the present invention.

[0043] Figure 10 This is a diagram illustrating the recognition effect of an image processing system according to an embodiment of the present invention.

[0044] In the diagram: 1-Frame, 2-Conveying auger, 3-Conveying auger, 4-Image acquisition window, 5-Grain, 6-Monitoring box, 7-Grain auger shaft, 8-Monitoring box body, 9-Monitoring box cover, 10-Light source mounting bracket, 11-Cable tray, 12-Lens, 13-Camera mounting bracket, 14-Industrial area array camera, 15-Transparent baffle, 16-Cable outlet, 17-Object distance adjustment slot, 18-Glass fitting slot, 19-LED light source, 20-Camera connection port, 21-Vibration damper, 22-Impurities in the grain. Detailed Implementation

[0045] Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain the present invention, and should not be construed as limiting the present invention.

[0046] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "axial," "radial," "vertical," "horizontal," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined with "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0047] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0048] Example 1

[0049] Figure 1-3The diagram shows a preferred embodiment of the grain impurity and breakage information monitoring device of the present invention. The grain impurity and breakage information monitoring device includes a conveying device, a monitoring box 6, an optical illumination system, an image acquisition mechanism, an image processing system, and a control unit. One end of the conveying device is connected to a cleaning device, and the other end is connected to a grain bin. The monitoring box 6 is installed on the outside of the harvester and is connected to an image acquisition window provided on the conveying device. The optical illumination system and the image acquisition mechanism are installed inside the monitoring box 6. The image acquisition mechanism is used to acquire images of the harvested material inside the conveying device and transmit them to the image processing system. The control unit is connected to both the optical illumination system and the image acquisition mechanism.

[0050] According to a preferred embodiment, the conveying device includes a conveying auger 3 and a conveying auger drum 2; the conveying auger 3 and the conveying auger drum 2 are connected by an auger shaft 7, one end of the conveying auger drum 2 is used to connect to a cleaning device, and the other end is used to connect to a grain bin; the image acquisition window is set on the side of the conveying auger drum 2.

[0051] like Figure 2-4 As shown, according to a preferred embodiment, the monitoring box 6 includes a monitoring box body 8, a monitoring box cover 9, and a transparent baffle 15; the monitoring box cover 9 is located on the upper part of the monitoring box body 8; the optical illumination system and the image acquisition mechanism are installed inside the monitoring box body 8; the transparent baffle 15 is installed at the connection between the monitoring box body 8 and the image acquisition window. Preferably, the transparent baffle 15 is made of glass.

[0052] In a preferred embodiment, the optical illumination system includes a light source 19 and a light source controller; the light source 19 is placed in the monitoring box 6 and located in front of the image acquisition mechanism; preferably, the light source 19 is an LED light source. The light source controller is connected to the light source 19.

[0053] According to a preferred embodiment, it also includes a light source mounting bracket 10; the light source 19 is mounted in the monitoring box 6 through the light source mounting bracket 10 and is placed parallel to the shooting surface.

[0054] In this preferred embodiment, the light source 19 is synchronized with the industrial area scan camera 14 for taking pictures, and the shooting frequency is consistent with the flashing frequency of the light source 19 controlled by the light source controller. The brightness and color types of the light source 19 are adjusted by the light source controller. Preferably, the brightness levels of the light source controlled by the light source controller can be divided into 21 types, and the light source colors can be divided into 256 types. Depending on the actual situation, different working environments and grain types can be compared. Different colors used by the light source 19 will result in slight differences in the pictures taken, and because the working environment and light intensity are different, the brightness of the light source 19 will also be different.

[0055] In a preferred embodiment, the image acquisition mechanism is an industrial area scan camera 14.

[0056] like Figure 4 As shown, according to a preferred embodiment, it also includes a camera mounting bracket 13; the industrial area array camera 14 is mounted in the monitoring box 6 through the camera mounting bracket 13, the industrial area array camera 14 has a lens 12 in front of it, and a light source 19 is provided in front of the lens 12, the central axis of the light source 19 and the central axis of the industrial area array camera 14 are on the same straight line.

[0057] like Figure 5 As shown, according to a preferred embodiment, it also includes a cable outlet 16, which is used to standardize and organize the power cord and data cable to prevent the industrial area array camera 14, lens 12, etc. in the monitoring box 6 from getting tangled with the data cable; the object distance adjustment slot 17 is used to adjust the object distance of the industrial area array camera 14 in a timely manner to obtain a clearer image.

[0058] like Figure 6 As shown, according to a preferred embodiment, it further includes a glass fitting groove 18, which is used to fit the transparent baffle 15 between the monitoring box 6 and the conveying auger 2 to prevent the transparent baffle 15 from slipping off.

[0059] like Figure 7 As shown, according to a preferred embodiment, a vibration damping device is also included; the vibration damping device includes multiple vibration dampers 21; the vibration dampers 21 are respectively installed at the connection between the optical illumination system and the monitoring box 6, the connection between the image acquisition mechanism and the monitoring box 6, and the connection between the monitoring box 6 and the conveying auger 2. Specifically, the vibration dampers 21 are placed at the connection between the light source mounting bracket 10 and the monitoring box 8, the connection between the camera mounting bracket 13 and the monitoring box 8, and the connection between the monitoring box 8 and the conveying auger 2. This can reduce errors caused by the vibration of the harvester body and prevent bolt breakage and detachment of the monitoring box 8 due to excessive vibration. It can also prevent the industrial area array camera 14 and lens 12 from shaking due to vibration, thereby causing large errors in shooting; the camera connection port 20 is used to connect the industrial area array camera 14 to the data cable.

[0060] The conveying auger 2 can be fixed on the frame 1 of the harvester. The inlet of the conveying auger 2 is connected to the cleaning device of the harvester, and the outlet of the conveying auger 2 is connected to the grain bin. The harvested material, such as rice, wheat, rapeseed grains 5 and some impurities, passes through the image acquisition window 4 of the conveying auger 2. After the industrial area array camera 14 captures the image, the harvested material is conveyed to the grain bin.

[0061] The image acquisition mechanism is used to acquire the harvested material in a flowing state within the conveying device, such as rice, wheat, rapeseed, and other crop grains 5 and impurities 22 within the grains. Figure 8 The image shown is a diagram illustrating the data collection location. Figure 9 This is the original image of a rice experiment.

[0062] The image processing system extracts grain 5 and extraneous features, for example, by utilizing the differences in texture and shape features between rice and wheat and extraneous features such as short stems, glumes, and horn peels, as well as the color differences between rapeseed and extraneous features such as short stems, glumes, and horn peels. Figure 10 The image processing system is shown. Figure 9 The recognition effect image can identify impurities 22 in the grains. The image processing system performs binarization and other processing on the captured image to obtain the total pixel area of ​​complete grains, the pixel area occupied by impurities, and the pixel area of ​​broken grains in the image. Based on the calculation formulas for the impurity content and breakage rate of harvested crops such as rice, wheat, and rapeseed obtained through prior experiments, the impurity content and breakage rate are calculated.

[0063] According to a preferred embodiment of this invention, the method for real-time detection of grain impurity rate and breakage rate using the grain impurity and breakage information monitoring device of the present invention is as follows:

[0064] S1. Conduct extensive preliminary experiments and pre-calibration. Statistically analyze the pixel area of ​​connected regions in each image identified by the image processing system during the preliminary experiments to obtain the total pixel area in the image. Use an Excel spreadsheet to record the pixel area of ​​intact grains, impurities, and broken grains in each image along with their corresponding masses. After completing each type of data, plot a scatter plot of mass and pixel area. Then, use the least squares method to fit a straight line and obtain a linear regression equation to obtain the total pixel area C of intact grains and the total grain mass m. C The functional relationship between them is m C =h(C), where the impurity pixel area B and the impurity mass m B The functional relationship between them is m B =g(B), where the pixel area D of the broken seed and the mass m of the broken seed are related. D The functional relationship between m D =i(D)

[0065] S2. Adjust the object distance of the industrial area scan camera 14 so that the initial field of view area of ​​the industrial area scan camera 14 is S;

[0066] S3, an industrial area array camera 14 takes a picture, and the image processing system performs binarization and other processing on the captured image to obtain the total area of ​​complete seed pixels in the field of view S at time t as C. t The pixel area occupied by impurities is B. t The pixel area of ​​the broken seed is D t ;

[0067] S4, Calculation

[0068]

[0069] S5. Return to S3 to obtain multiple material photos over a period of time, and calculate the average value of the impurity rate and breakage rate of the grains.

[0070] Example 2

[0071] A harvester includes the grain impurity and breakage information monitoring device described in Example 1, and therefore has the beneficial effects of Example 1, which will not be repeated here.

[0072] It should be understood that although this specification is described according to various embodiments, not every embodiment contains only one independent technical solution. This way of describing the specification is only for clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment can also be appropriately combined to form other implementation methods that can be understood by those skilled in the art.

[0073] The detailed descriptions listed above are merely specific illustrations of feasible embodiments of the present invention and are not intended to limit the scope of protection of the present invention. All equivalent embodiments or modifications made without departing from the spirit of the present invention should be included within the scope of protection of the present invention.

Claims

1. A harvester, characterized in that, It includes a grain impurity and breakage information monitoring device; the grain impurity and breakage information monitoring device includes a conveying device, a monitoring box (6), an optical illumination system, an image acquisition mechanism, an image processing system and a control unit; One end of the conveying device is used to connect to the cleaning device, and the other end is used to connect to the grain tank; The monitoring box (6) is used to be installed on the outside of the grain box, and the monitoring box (6) is connected to the image acquisition window set on the conveying device; The optical illumination system and image acquisition mechanism are installed inside the monitoring box (6). The image acquisition mechanism is used to acquire images of the harvested material in the flow state inside the conveying device and transmit them to the image processing system. The control unit is connected to the optical illumination system and the image acquisition mechanism, respectively. The conveying device includes a conveying auger (3) and a conveying auger cylinder (2); the conveying auger (3) and the conveying auger cylinder (2) are connected by an auger shaft (7), one end of the conveying auger cylinder (2) is used to connect to the cleaning device, and the other end is used to connect to the grain bin; the image acquisition window is set on the side of the conveying auger cylinder (2); The image processing system extracts the features of grains and impurities. The image processing system performs binarization and other processing on the captured image to obtain the total area of ​​pixels of complete grains, the area of ​​pixels occupied by impurities and the area of ​​pixels of broken grains in the image. The impurity rate and breakage rate of the harvested grains are calculated by using the calculation formulas for the impurity rate and breakage rate of the harvested grains obtained through prior experiments. The optical lighting system includes a light source (19) and a light source controller; the light source (19) is placed in the monitoring box (6) and located in front of the image acquisition mechanism; the light source controller is connected to the light source (19); the brightness and color type of the light source (19) are adjusted by the light source controller; the light source (19) is synchronized with the industrial area array camera (14) for taking pictures, and the picture frequency is consistent with the flashing frequency of the light source (19) controlled by the light source controller; The monitoring box (6) includes a monitoring box body (8), a monitoring box cover (9), and a transparent baffle (15); the monitoring box body (8) is provided with a monitoring box cover (9) on its upper part; the optical illumination system and the image acquisition mechanism are installed inside the monitoring box body (8); the transparent baffle (15) is installed at the connection between the monitoring box body (8) and the image acquisition window; the transparent baffle (15) is made of glass. The image acquisition mechanism is an industrial area array camera (14), which is installed in the monitoring box (6) by a camera mounting bracket (13). The industrial area array camera (14) has a lens (12) in front of it, and a light source (19) in front of the lens (12). The central axis of the light source (19) is on the same straight line as the central axis of the industrial area array camera (14). The monitoring box (8) has an object distance adjustment slot (17) at the back. The object distance adjustment slot (17) is used to adjust the object distance of the industrial area array camera (14) to obtain a clearer image. It also includes a vibration damping device; the vibration damping device includes multiple vibration dampers (21); the vibration dampers (21) are respectively installed at the connection between the optical lighting system and the monitoring box (6), the connection between the image acquisition mechanism and the monitoring box (6), and the connection between the monitoring box (6) and the conveying auger (2); The conveying auger (2) is fixed on the frame (1) of the harvester. The inlet of the conveying auger (2) is connected to the cleaning device of the harvester, and the outlet of the conveying auger (2) is connected to the grain bin. The harvested material and some impurities pass through the image acquisition window (4) of the conveying auger (2). After the industrial area array camera (14) set outside the grain bin captures the image of the harvested material in the flow state, the harvested material is conveyed to the grain bin through the outlet of the conveying auger (2). The real-time detection of grain impurity rate and breakage rate includes the following steps: S1. Conduct extensive preliminary experiments and pre-calibration. Statistically analyze the pixel area of ​​connected regions in each image identified by the image processing system during the preliminary experiments to obtain the total pixel area in the image. Record the pixel area of ​​intact grains, impurities, and broken grains in each image along with their corresponding masses. After completing each type of data, plot a scatter plot of mass and pixel area. Then, use the least squares method to fit a straight line and obtain a linear regression equation to obtain the total pixel area C of intact grains and the total grain mass m. C The functional relationship between them is m C =h(C), where the impurity pixel area B and the impurity mass m B The functional relationship between them is m B =g(B), where the pixel area D of the broken seed and the mass m of the broken seed are related. D The functional relationship between m D =i(D); S2. Adjust the object distance of the industrial area array camera (14) so ​​that the initial field of view area of ​​the industrial area array camera (14) is S; S3. An industrial area array camera (14) takes a picture, and the image processing system performs binarization and other processing on the captured image to obtain the total area of ​​complete seed pixels in the field of view S at time t as C. t The pixel area occupied by impurities is B. t The pixel area of ​​the broken seed is D t ; S4、 S5. Return to S3 to obtain multiple material photos over a period of time, and calculate the average value of the impurity rate and breakage rate of the grains.

2. The harvester according to claim 1, characterized in that, It also includes a light source mounting bracket (10); The light source (19) is installed in the monitoring box (6) via a light source mounting bracket (10).

Images