White radish harvester row-control identification system and method based on machine vision and harvester
Through the white radish harvester row recognition system based on machine vision, the center line of the plant row is automatically identified and the harvesting components are adjusted, the problems of frequent manual operations and high labor intensity are solved, the efficiency and quality of white radish harvesting are improved, and the intelligence is realized Reap and efficiently.
Patent Information
- Application Number
- CN202410979597.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-22
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-07-22
AI Technical Summary
The existing white radish harvesting technology relies on manual operation, has high labor intensity and low efficiency, and the harvest quality depends on the driver's experience, which poses safety hazards and operational complexity.
The row recognition system of the white radish harvester based on machine vision is adopted to obtain depth images and color images through the image acquisition mechanism, and the image processing algorithm is used to extract the ridge boundary lines and the white radish ridge lines, and the harvesting components are automatically adjusted for row harvesting, reducing the Manual operation reduces the driver's labor intensity.
It realizes automatic harvesting of white radish planting rows, improves harvesting efficiency and quality, reduces labor intensity, improves the intelligence and efficiency of the harvester, and supports long-term continuous operation.
Smart Images

Figure CN118941434A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of root vegetable harvesting equipment, and in particular relates to a machine vision-based white radish harvester row recognition system and method and a harvester, which are mainly used for automatic row harvesting of white radish. Background Art
[0002] White radish is a common root vegetable with rich nutrients. It is widely planted in North China, Northeast my country, Northwest China and Southwest China. The production of white radish is highly seasonal and is a labor-intensive crop. At present, the harvesting of white radish in my country mainly relies on manual labor, with a small amount of mechanical harvesting. Manual harvesting has high labor intensity and low operating efficiency; mechanical harvesting is mostly single-row pulling harvesting, which requires the driver to drive while checking the rows.
[0003] The pull-and-pull combined harvester is an efficient way to harvest white radish. It can complete multiple processes such as loosening, clamping, transporting, cutting, and collecting at one time. In the actual operation process, due to the growth posture and planting row spacing of white radish, manual adjustment of rows is required frequently during the operation, which is an important guarantee for the harvest quality. However, this work requires long-term manual operation, which is labor-intensive, complicated, and dangerous for the driver. In addition, the harvest quality depends on the driver's experience level.
[0004] Therefore, the automatic row-aligning harvesting technology of the pull-out white radish harvester is studied to realize the integrated operation of automatic row-aligning and adjustment, which can reduce the workload of the driver and the cost of white radish planting, and improve the intelligent and efficient harvesting level of white radish. Therefore, the automatic row-aligning harvesting of white radish is an important technology to ensure the long-term operation performance of the white radish harvester, reduce the intensity of manual driving operations, and improve the intelligent and efficient harvesting level of white radish. Summary of the invention
[0005] In response to the above technical problems, the present invention provides a white radish harvester row recognition system and method and a harvester based on machine vision, which can automatically identify the center line of the white radish planting row, obtain the position information of the center line of the planting row and adjust the harvesting components for row harvesting, thereby avoiding manual row operation, reducing the labor intensity of the driver, helping to ensure the harvesting quality of white radish under long-term operation conditions, and improving the intelligent and efficient harvesting level of the white radish harvester.
[0006] Note that the description of these objectives does not prevent the existence of other objectives. One embodiment of the present invention does not need to achieve all of the above objectives. Objectives other than the above objectives can be extracted from the description of the specification, drawings, and claims.
[0007] The present invention achieves the above technical objectives through the following technical means.
[0008] A machine vision-based row recognition system for a white radish harvester comprises a control mechanism, an image acquisition mechanism, a pulling and harvesting device, a vehicle chassis and a row adjustment device; the pulling and harvesting device and the row adjustment device are installed on the vehicle chassis, the pulling and harvesting device is used for pulling and harvesting white radishes, and the adjustment devices are located on both sides of the pulling and harvesting device and are used for adjusting the left and right horizontal translation of the pulling and harvesting device; the control mechanism is respectively connected to the image acquisition mechanism and the row adjustment device, the image acquisition mechanism is used for acquiring images of a white radish planting field in front of the harvester to obtain depth images and color images, and transmit them to a control unit; the control mechanism performs image processing, extracts ridge boundary lines and white radish ridge and row lines, uses the extracted ridge boundary lines and ridge and row lines for verification, obtains a target navigation line, and controls the row adjustment device according to the target navigation line to adjust the left and right horizontal translation of the pulling and harvesting device for row alignment.
[0009] In the above scheme, the row adjustment device includes a first heavy-loaded screw guide, a first displacement sensor, a stepper motor, a second heavy-loaded screw guide and a second displacement sensor; the stepper motor includes a first stepper motor and a second stepper motor; the first heavy-loaded screw guide and the first displacement sensor are installed in parallel at the front end of one side of the vehicle chassis, the first guide rail slide is installed on the first heavy-loaded screw guide, the heavy-loaded screw guide is connected to the first stepper motor, and the side end face of the first guide rail slide is connected to the measuring end of the first displacement sensor; the second heavy-loaded screw guide and the second displacement sensor are installed in parallel on the upper end face of the mounting frame on the vehicle chassis, the second guide rail slide is installed on the second heavy-loaded screw guide, and the second heavy-loaded screw guide is connected to the second stepper motor The upper end of the second guide rail slide is hinged to the frame of the clamping and conveying mechanism of the harvesting device, and the side end surface of the second guide rail slide is connected to the measuring end of the second displacement sensor; the first stepper motor, the first displacement sensor, the second displacement sensor and the second stepper motor are respectively connected to the control mechanism, the control mechanism controls the first stepper motor to drive the first heavy-loaded screw guide to slide on the first guide rail slide, and controls the second stepper motor to drive the second heavy-loaded screw guide to slide on the second guide rail slide, the first displacement sensor is used to measure the position of the first guide rail slide and feed it back to the control mechanism, the second displacement sensor is used to measure the position of the second guide rail slide and feed it back to the control mechanism, so as to drive the overall horizontal translation of the harvesting device to realize the horizontal row adjustment of the harvesting device.
[0010] In the above scheme, the control mechanism includes an upper computer and a lower computer; the upper computer is connected to the image acquisition mechanism, and is used to receive the images acquired by the image acquisition mechanism and perform image processing, extract the ridge boundary lines and the white radish ridge lines, and use the extracted ridge boundary lines and ridge lines for verification to obtain the navigation tracking point navigation line; the lower computer controls the row adjustment device to adjust the harvesting device according to the navigation line of the upper computer to perform row adjustment.
[0011] In the above scheme, the control mechanism extracts the ridge boundary line based on the outermost ridge boundary line extraction algorithm of the depth image:
[0012] The control mechanism intercepts the target area and performs interception processing on the depth image:
[0013]
[0014] Among them, B (i,j) is the coordinate of the target area point in the intercepted depth image, I (i,j) is the coordinate of the corresponding pixel in the input original depth image, x, y are the coordinates of the upper left corner of the target area, W, H are the width and height of the target area respectively;
[0015] The fixed threshold binarization method is used to segment the intercepted depth image to obtain the outermost ridge boundary line and obtain a binary image:
[0016]
[0017] Among them, 0 represents a black background and 255 represents a white foreground;
[0018] Perform area filtering and morphological processing on the processed binary image to eliminate noise and edge hole interference, then read the coordinates of the first non-zero point from right to left in each row in the intercepted area and store them in the matrix P:
[0019]
[0020] Where (i k , j k ) are the coordinates of points that are not 0;
[0021] The least squares method is used to fit the extracted points to obtain the ridge boundary line:
[0022] y=ax+b
[0023] Among them, a and b are the slope and intercept of the ridge boundary line extracted from the depth map, respectively.
[0024] In the above scheme, the control mechanism extracts the white radish planting line in the color picture based on the straight line clustering method:
[0025] The super green feature grayscale method is used to enhance the green area features. First, the target interest area of the color image is intercepted, and the remaining areas are set to 0. The super green feature method is used for grayscale conversion. The calculation method is:
[0026]
[0027] Among them, 2 means expanding the green channel pixels by 2 times, G means green channel, R means red channel, and B means blue channel;
[0028] Use Otsu method to perform image binarization;
[0029] The binary image is first dilated and then corroded to obtain the area of each connected domain, and then the connected domain area is filtered;
[0030] Perform straight line clustering to extract planting row lines: select ridge lines in the intercepted area, distribute them evenly, calculate the distance from each white point in the binary image to the straight line, i.e., the ridge line, and compare them. The ones with the closest distance are classified into the same category as the straight line, and the clustered straight lines are obtained by fitting:
[0031]
[0032] In the above solution, the navigation tracking point navigation line is obtained by the tracking point fusion extraction algorithm:
[0033] First, the ridge boundary navigation line extracted from the depth image is converted according to the coordinate system, translated by half the standard ridge width distance L in the real coordinate system, and the translated straight line is recorded in the pixel coordinate system;
[0034] Then, the translated ridge boundary navigation line and the ridge line extracted from the color image are calculated according to the coefficient of determination R. 2 And the comparison coefficient g, according to the normalization method, fusion is performed, and weight coefficients r1 and r2 are assigned. R1 is the weight coefficient assigned to the depth map ridge line, and r2 is the weight coefficient assigned to the color map ridge line:
[0035]
[0036] According to the weight coefficient fusion, the final target navigation line is obtained:
[0037] y=(k1r1+k2r2)x+(r1b1+r2b2)
[0038] Among them, k1 and b1 are the slope and intercept of the ridge line in the depth map, and k2 and b2 are the slope and intercept of the ridge line extracted from the color map.
[0039] A harvester comprises the white radish harvester row recognition system based on machine vision.
[0040] A control method for a row recognition system of a white radish harvester based on machine vision comprises the following steps:
[0041] The image acquisition mechanism acquires the image of the white radish planting field in front of the harvester to obtain a depth image and a color image, and transmits the image to the control unit; the control mechanism processes the image, extracts the ridge boundary line and the white radish ridge line, uses the extracted ridge boundary line and ridge line for verification, obtains the target navigation line, and controls the row adjustment device to adjust the harvesting device to move horizontally left and right according to the target navigation line to harvest the row.
[0042] In the above scheme, the row harvesting specifically includes the following steps:
[0043] S1. Start the equipment, reset the pulling and harvesting device to the set initial starting point through the row adjustment device, check the working status of the equipment, and confirm whether the safety function can work;
[0044] S2, adjusting the pulling height at the end of the pulling and harvesting device through the hydraulic cylinder to prepare for harvesting;
[0045] S3, adjusting the field of view of the image acquisition mechanism, capturing the image of the white radish planting field in front of the harvester to obtain a depth image and a color image;
[0046] S4, respectively performing interception, filtering, expansion and corrosion processing on the depth image and color image obtained by shooting;
[0047] S5, extracting ridge boundary lines and ridge planting row lines from the preprocessed depth image and color image respectively;
[0048] S6, fusing the extracted ridge boundary line and ridge line to obtain a target navigation line, thereby obtaining a navigation tracking point;
[0049] S7, converting the navigation tracking point in the image coordinate system into a point in the real coordinate system, and calculating the position error of the harvesting device relative to the point;
[0050] S8, the lower computer uses the position error as input, and uses the fuzzy control algorithm to control the row adjustment device to move to complete the row adjustment. After the adjustment is completed, the above process is repeated to refresh, so as to realize real-time row adjustment;
[0051] S9. After the target row is harvested, proceed to the next row for harvesting.
[0052] In the above scheme, the control mechanism uses a fuzzy control algorithm to control the row adjustment device to adjust the row, including the following steps:
[0053] The position error between the current position and the target position is set as the input, and the pulse frequency of the stepper motor is set as the output. The position error is fuzzified and divided into fuzzy sets. A set of fuzzy rule tables is established to map the fuzzified input to the fuzzified output. Fuzzy reasoning is performed based on the input fuzzy variables and fuzzy rules to obtain fuzzy output, which is then converted into a specific pulse frequency. By adjusting the pulse frequency, the line adjustment speed can be controlled.
[0054] Compared with the prior art, the present invention has the following beneficial effects:
[0055] 1. Improve harvesting efficiency: Through machine vision technology, automatic row-by-row harvesting of white radish planting rows is achieved, reducing manual operations and greatly improving harvesting efficiency.
[0056] 2. Reduce labor intensity: Reduce the labor intensity of the driver, and no longer need the driver to perform frequent manual adjustment operations, thereby reducing operational risks and the driver's workload.
[0057] 3. Improve harvest quality: Automatic row harvesting can ensure the accuracy and consistency of harvesting, avoid errors caused by human operation, and thus improve the harvest quality of white radish.
[0058] 4. Intelligent operation: It adopts a combination of upper and lower computers, combines image processing algorithms to identify planting rows in real time, and adjusts rows through fuzzy control algorithms, making the harvesting process more intelligent and automated.
[0059] 5. Realize long-term continuous operation: Through automatic row harvesting technology, the white radish harvester can realize long-term continuous operation, improving the continuity and stability of the operation.
[0060] In summary, the present invention can automatically identify the center line of the white radish planting row, obtain the position information of the center line of the planting row and adjust the harvesting components to harvest the row, thereby improving the harvesting efficiency, reducing labor intensity, improving the harvesting quality, intelligent operation and realizing the advantages of long-term continuous operation.
[0061] Note that the description of these effects does not prevent the existence of other effects. One embodiment of the present invention does not necessarily have all of the above effects. Effects other than the above can be clearly seen and extracted from the description of the specification, drawings, claims, etc. BRIEF DESCRIPTION OF THE DRAWINGS
[0062] Figure 1 It is a schematic diagram of coordinate system conversion according to one embodiment of the present invention.
[0063] Figure 2 It is a schematic axial view of the whole machine according to one embodiment of the present invention.
[0064] Figure 3 It is a schematic diagram of the process of extracting ridge boundaries based on depth images according to one embodiment of the present invention.
[0065] Figure 4 It is a schematic diagram of the process of extracting planting rows based on straight line clustering according to one embodiment of the present invention.
[0066] Figure 5 It is a schematic diagram of the principle of selecting navigation line tracking points according to one embodiment of the present invention.
[0067] Figure 6 It is a fuzzy control rule table according to one embodiment of the present invention.
[0068] Figure 7 It is a system hardware diagram of one embodiment of the present invention.
[0069] Figure 8 It is a workflow diagram for row harvesting according to one embodiment of the present invention.
[0070] In the figure: 1. pulling harvesting device, 2. vehicle-mounted chassis, 3. row adjustment device, 4. mounting frame, 5. motor, 6. gantry, 7. camera, 10. clamping conveyor belt, 11. tassel supporting mechanism, 12. clamping conveying mechanism, 13. hydraulic cylinder, 14. first guide rail slide, 15. first heavy-loaded screw guide, 16. first stepping motor, 17. first displacement sensor, 18. collecting bucket, 19. tassel cutting mechanism, 20. frame, 21. transmission mechanism, 22. motor, 23. second displacement sensor, 24. second stepping motor, 25. second heavy-loaded screw guide, 26. second guide rail slide. DETAILED DESCRIPTION
[0071] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.
[0072] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "front", "back", "left", "right", "up", "down", "axial", "radial", "vertical", "horizontal", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0073] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0074] Figure 1 and Figure 2 The figure shows a preferred implementation of the white radish harvester row recognition system based on machine vision, which includes a control mechanism, an image acquisition mechanism, a pulling and harvesting device 1, a vehicle-mounted chassis 2, a row adjustment device 3 and a mounting frame 4.
[0075] In a specific embodiment of the present invention, the mounting frame 4 is located at the right rear end of the vehicle chassis 2, the row adjustment device 3 is installed on the chassis 2 and the mounting frame 4, the pulling and harvesting device 1 is installed on the vehicle chassis 2, the pulling and harvesting device 1 is used to pull and harvest white radish, and the adjustment device 3 is located on both sides of the pulling and harvesting device 1, and is used to adjust the horizontal translation of the pulling and harvesting device 1 to the left and right.
[0076] The control mechanism is connected to the image acquisition mechanism and the row adjustment device 3 respectively. The image acquisition mechanism is used to collect the image of the white radish planting field in front of the harvester to obtain a depth image and a color image, and transmit them to the control unit; the control mechanism performs image processing, extracts the ridge boundary line and the white radish ridge line, uses the extracted ridge boundary line and ridge line for verification, obtains the navigation line of the navigation tracking point, and controls the row adjustment device 3 according to the navigation line to adjust the horizontal translation of the extraction harvesting device 1 to perform row alignment.
[0077] The harvesting device 1 includes a clamping conveyor belt 10, a tassel-supporting mechanism 11, a clamping conveying mechanism 12, a tassel-cutting mechanism 19, a transmission mechanism 21 and a motor 22; the tassel-supporting mechanism 11 is located at the front end of the clamping conveying mechanism 12, and the transmission mechanism 21 is located at the rear end of the clamping conveying mechanism 12; the tassel-cutting mechanism 19 is located at the lower end of the clamping conveying mechanism 12 close to the transmission mechanism 21, and the motor 22 is located on one side of the transmission mechanism 21, and is used to drive the transmission mechanism 21 to drive the clamping conveyor belt 10 to rotate.
[0078] The row adjustment device 3 includes a first heavy-loaded lead screw guide 15, a first displacement sensor 17, a stepper motor, a second heavy-loaded lead screw guide 25 and a second displacement sensor 23; the stepper motor includes a first stepper motor 16 and a second stepper motor 24; the first heavy-loaded lead screw guide 15 and the first displacement sensor 17 are installed in parallel at the front end of one side of the vehicle chassis 2, the first guide rail slide 14 is installed on the first heavy-loaded lead screw guide 15, the heavy-loaded lead screw guide 15 is connected to the first stepper motor 16, the upper end surface of the first guide rail slide 14 is connected to the base end of the hydraulic cylinder 13, and the side end surface of the first guide rail slide 14 is connected to the measuring end of the first displacement sensor 17; the second heavy-loaded lead screw guide 25 and the second displacement sensor 23 are installed in parallel on the upper end surface of the mounting frame 4 on the vehicle chassis 2, the second guide rail slide 26 is installed on the second heavy-loaded lead screw guide 25, the second heavy-loaded lead screw guide 25 It is connected to the second stepper motor 24, the upper end of the second guide rail slide 26 is hinged to the frame 20 of the clamping and conveying mechanism 12 of the pulling and harvesting device 1, and the side end surface of the second guide rail slide 26 is connected to the measuring end of the second displacement sensor 23; the first stepper motor 16, the first displacement sensor 17, the second displacement sensor 23 and the second stepper motor 24 are respectively connected to the control mechanism, the control mechanism controls the first stepper motor 16 to drive the first heavy-loaded screw guide 15 to slide on the first guide rail slide 14, and controls the second stepper motor 24 to drive the second heavy-loaded screw guide 25 to slide on the second guide rail slide 26, the first displacement sensor 17 is used to measure the position of the first guide rail slide 14 and feed it back to the control mechanism, the second displacement sensor 23 is used to measure the position of the second guide rail slide 26 and feed it back to the control mechanism, so as to drive the overall horizontal translation of the pulling and harvesting device 1 to realize the horizontal row adjustment of the pulling and harvesting device 1.
[0079] The telescopic end of the hydraulic cylinder 13 is connected to the lower end of the frame 20 of the clamping and conveying mechanism 12, and is used to adjust the harvesting height of the harvesting device 1.
[0080] The second heavy-loaded screw guide rail 25 and the second displacement sensor 23 are installed in parallel on the upper end surface of the mounting frame 4. The upper end of the second guide rail slide 26 is hinged to the frame 20 of the clamping and conveying mechanism 12, so that the harvesting device 1 can rotate around the hinge axis. The side end surface of the second guide rail slide 26 is connected to the measuring end of the second displacement sensor 23.
[0081] When the whole machine is harvesting rows, the transmission mechanism 21 is used to drive the clamping conveyor belt 10 to rotate, and the radish leaves supporting mechanism 11 lifts up the radish leaves and sends them to the clamping conveying mechanism 12. Then the white radish is picked and transported backward to the radish leaves cutting mechanism 19 for cutting. After cutting, the white radish leaves fall into the collecting bucket 18, and the radish leaves continue to move backward and are discharged.
[0082] When row adjustment is required, the first stepper motor 16 and the second stepper motor 24 respectively drive the first heavy-loaded screw guide 15 and the second heavy-loaded screw guide 25 to move synchronously, thereby driving the overall horizontal translation of the harvesting device 1, so that the horizontal row adjustment of the harvesting device 1 can be achieved by the first heavy-loaded screw guide 15 and the second heavy-loaded screw guide 25 moving in the same direction at the same time.
[0083] The present invention uses an image acquisition mechanism binocular vision camera to obtain the working environment in front of the pull-out combine harvester, and obtains a depth image and a color image under the same field of view; selects the depth image and the color image target interest domain according to the actual situation, processes the depth image to extract the outer boundary line of the white radish ridge, uses a straight line clustering algorithm to extract the white radish planting ridge line of the color image, and verifies the white radish planting line extracted from the color image according to the outer boundary line of the ridge extracted from the depth image. Select pixel tracking points for the verified white radish planting line as a navigation line, convert it into a real tracking point through coordinate system mapping, read the current position point of the harvesting device and calculate the relative distance deviation from the real starting tracking point, use the fuzzy control algorithm to adjust the harvesting device to reach the specified position, and realize the row harvesting, then the algorithm is refreshed, and the above process is repeated, thereby realizing the automatic row and adjustment integrated operation.
[0084] Preferably, the image acquisition mechanism is a camera 7 .
[0085] Camera 7 installation position and coordinate system mapping conversion:
[0086] like Figure 1As shown; when the camera 7 is actually used, the camera field of view direction forms a certain angle with the planting ground, so it is necessary to convert the pixel coordinate system to the real coordinate system through coordinate system mapping conversion. The camera 7 is fixedly installed on the gantry 6 at the front end above the pulling and harvesting device 1, and is in the same vertical plane as the reset state of the pulling and harvesting device 1. The angle of the camera 7 is tilted downward, while ensuring that there are no obstacles blocking the front field of view.
[0087] In the picture acquired by the field of view of the camera 7, the midpoint of the bottom of the photo is taken as the origin O of the coordinate system, the horizontal direction of the bottom is the U axis, and the vertical direction is the V axis, and the photo pixel coordinate system UOV is established.
[0088] The world coordinate system is established on the horizontal plane at the average height h of the white radish above the ground, with the machine's forward direction as Y. w Axis, perpendicular to Y in the plane w The axis direction is X w Axis, vertical projection of camera 7 installation position along the Y w The distance c in the axial direction is set as the origin of the world coordinate system O w , establish the world coordinate system X w O w Y w .
[0089] Method for determining the translation distance c; when the machine is in normal working condition, the distance from the midpoint of the width of the end of the supporting mechanism 11 to the vertical projection point of the camera 7 is c;
[0090] According to Zhang Zhengyou's calibration method, the pixel coordinate system and the world coordinate system satisfy the mapping relationship: A is the camera's intrinsic parameter matrix, and R*T is the extrinsic parameter matrix.
[0091]
[0092] The method for extracting the boundary line of white radish planting ridge based on depth image is as follows: Figure 3 As shown;
[0093] Preferably, the camera 7 uses a binocular camera to collect images of the white radish planting field in front of the harvester. Figure 3 As shown in the figure, the binocular ranging principle is adopted, and the left and right infrared cameras are used to obtain the disparity of the pixel coordinates at the same position in the photo. The depth distance of each pixel is obtained according to the binocular triangulation method and a depth image is formed. By extracting the planting row boundary through the depth image, the planting characteristics of the height difference can be fully utilized, which is not affected by the changes in light and color, and is more stable and reliable, but it is easily disturbed by the entity of terrain obstacles.
[0094] The distance measurement calculation formula is as follows; Z is the distance, d is the parallax of the photo at the same point, D is the binocular center distance, and f is the focal length of the camera.
[0095]
[0096] Since the outer ridge boundary of the white radish planting area grows higher than the ground, there will be an obvious height difference at the outer ridge boundary, which makes the outer ridge boundary line form an obvious gradient dividing line on the depth map, so it can be used as a basis for feature line extraction.
[0097] The control mechanism extracts the ridge boundary line based on the outermost ridge boundary line extraction algorithm of the depth image, specifically including the following steps:
[0098] Step 1: The control mechanism intercepts the target area and intercepts the depth image to eliminate the interference of unnecessary radish ridges in the field of view. The interception principle is as follows;
[0099]
[0100] Among them, B (i,j) is the coordinate of the target area point in the intercepted depth image, I (i,j) is the coordinate of the corresponding pixel in the input original depth image, x, y is the coordinate of the upper left corner of the target area, W, H are the width and height of the target area respectively, the effect is as follows Figure 3 As shown;
[0101] Step 2: Considering that the camera field of view is not perpendicular to the planting ground, the intercepted depth map is pre-processed to make the camera coordinate plane parallel to the planting ground. Since the depth map is a single-channel grayscale image, the grayscale of a single pixel represents the distance from the real point to the camera coordinate plane. The farther the distance, the lower the grayscale. For points that cannot be measured, the default is infinity and the grayscale is set to 0. Since the ridge height of the radish planting plot is significantly higher than the ground, a fixed threshold binarization method is used to segment the intercepted depth image to obtain the outermost ridge boundary line and obtain a binary image:
[0102]
[0103] Among them, 0 represents black (background) and 255 represents white (foreground), as shown in Figure 3 As shown, where T is a selected fixed threshold;
[0104] Step 3: Perform area filtering and morphological processing on the processed binary image to eliminate noise and edge hole interference, then read the coordinates of the first non-zero point from right to left in each row in the intercepted area and store them in the matrix P, where (i k , j k ) are the coordinates of points that are not 0:
[0105]
[0106] Step 4: Use the least squares method to fit the extracted points to obtain the ridge boundary line, as shown in Figure 3 As shown; Figure 3 This is the position of the extracted ridge boundary line in the image:
[0107] y=ax+b
[0108] Among them, a and b are the slope and intercept of the ridge boundary line extracted from the depth map, respectively.
[0109] Method for extracting white radish planting lines from color images based on line clustering
[0110] like Figure 4 As shown; the selected binocular vision camera is also equipped with a color camera, through which a color picture with rich color information can be obtained. Figure 4 ①, extract the radish ridge lines based on the color features of the obtained pictures.
[0111] The control mechanism is based on the method for extracting the planting line of white radish in the color picture based on straight line clustering, which specifically includes the following steps:
[0112] Step 1: Use the super green feature grayscale method to enhance the green area features.
[0113] The super green feature grayscale method is an image processing method for vegetation areas. It extracts the super green area in the image and converts it into a grayscale image, thereby highlighting the characteristics of the vegetation. The super green feature grayscale method selected by the present invention is 2G-RB (Two Green-Red-Blue). First, the color image target interest area is intercepted to ensure that there are three clear ridges in the field of view, and the rest of the area is set to 0. Figure 4 ② As shown, the super green feature method is then used for grayscale conversion, such as Figure 4 As shown in ③, the calculation method is:
[0114]
[0115] Among them, 2 means expanding the green channel pixels by 2 times, G means green channel, R means red channel, and B means blue channel;
[0116] Step 2: Use Otsu method to perform image binarization processing, such as Figure 4 As shown in ④, the Otsu method is an algorithm that automatically determines the image threshold and is used for binarization processing in image segmentation. By analyzing the grayscale histogram of the image, a threshold is found to maximize the inter-class variance of dividing the image into two classes (foreground and background); the mask effect of the color image after binarization is shown in the figure below. Figure 4⑩As shown;
[0117] Step 3: The binary image is first dilated and then eroded to reduce the impact of noise. The dilation operation can expand the area of the image with higher brightness, and it may also connect gaps or fill small holes. Preferably, the convolution kernel size used for dilation is 5×5, and then the erosion operation is performed to reduce the area of the image with higher brightness, and it may also disconnect or weaken small protruding parts to restore the original image outline size. Preferably, the convolution kernel size is still 5×5;
[0118] Step 4: Perform area filtering on the binary image to obtain the area of each connected domain, perform area filtering on the connected domain, and remove interference points in small areas. Figure 4 ⑤As shown;
[0119] Step 5: Line clustering to extract planting row lines. In the processed binary image, since there are furrows between the radish planting ridges and the leaves between the furrows overlap, the traditional clustering method cannot effectively separate the clusters between different furrows, and subsequent navigation line fitting extraction cannot be performed; however, the radish rows on the same ridge are clustered on the same straight line and their row planting lines are straight lines. The number of radish rows in the field of view of the photo is known, so a new clustering method is proposed using this feature:
[0120] First, select three ridge lines in the interception area and distribute them evenly. Figure 4 As shown in ⑥, the number of clusters is 3, which is consistent with the number of ridges in the target interest threshold. Then, the distance from each white point in the binary image to the three straight lines, i.e., the ridge lines, is calculated and compared. The ones with the closest distance are classified into the same category as the straight lines, and the clustering straight lines are obtained by fitting:
[0121]
[0122] The first clustering effect Figure 4 ⑦As shown;
[0123] Then, after the white coordinate points are classified, the least squares fitting straight lines of each type of coordinate points are calculated, and the straight lines roughly consistent with the direction of the navigation line can be extracted. Then the straight lines fitted for the first time are used as new clustering straight lines for clustering again. Repeating the above steps can further subdivide the rough classification last time and extract more accurate clustering straight lines. The second clustering effect is Figure 4 ⑧As shown.
[0124] Finally, in the third clustering, distance judgment is added. According to practical experience, when the distance is greater than d, it can be considered that the point is far from the center line of the row and is an unreliable point, so it is removed. Finally, the straight line extracted by the fourth clustering is the planting row line. Figure 4 ⑨As shown.
[0125]
[0126] Navigation line tracking point selection:
[0127] like Figure 5 As shown in the figure, it is a schematic diagram of the principle of selecting the navigation line tracking point; in the actual operation process, the machine moves forward at a uniform speed v, and the algorithm refresh frequency is f. Therefore, within one algorithm refresh time, the actual machine forward distance z = v / f, and the pixel width used in the picture is h. Since the machine forward speed is 0.2-0.3m / s, the algorithm refresh frequency is 2-5hz, so the distance z is 0.06-0.15m, but within the field of view length of 4-5m, its pixel width can be regarded as a point in the photo. Therefore, the tracking point is the starting point of the extracted line each time the picture is refreshed.
[0128] Since color images are easily affected by outdoor lighting, and depth images are not easily affected by lighting due to binocular infrared light measurement, but can only extract the outer ridge boundary line; therefore, the depth image is used to extract the navigation line to assist in the verification of the color image extraction navigation line, so that the two navigation lines can be fused to obtain the final target navigation line.
[0129] In order to facilitate the fusion of two navigation lines, it is necessary to refer to relevant evaluation indicators to judge the reliability of the navigation line extraction effect and to allocate weight ratios in subsequent fusion.
[0130] For the ridge navigation line extracted from the color map, the outermost ridge line is selected and the goodness of fit is used as the evaluation index. The goodness of fit refers to the degree of fit of the regression line to the observed value. The statistic measuring the goodness of fit is the coefficient of determination R. 2 . R 2 The maximum value is 1, R 2 The closer the value of is to 1, the better the regression line fits the observed value; on the contrary, R 2 The smaller the value of , the worse the regression line fits the observed value. i is the ith observation value, The mean of all observations, The i-th predicted value;
[0131]
[0132] For the ridge boundary navigation line extracted from the depth map, the height difference between the planting ridge and the ground is used to perform boundary segmentation to obtain the ridge boundary line, and then the obtained boundary line is fitted to obtain the ridge boundary navigation line; therefore, the accuracy of the ridge boundary line segmentation becomes an important indicator for evaluating the reliability of the ridge boundary navigation line. For the boundary line, calculate the average height difference between the upper pixel points of the boundary line in the depth map and the ground, and compare this average height difference with the standard height difference to obtain a comparison coefficient g as an evaluation indicator of the reliability level. The larger the comparison coefficient, the greater the height difference between the ridge boundary line and the ground. If it is greater than the standard height difference, it is considered reliable and the reliability coefficient is set to 1. The formula is as follows;
[0133]
[0134] The navigation tracking point navigation line is obtained through the tracking point fusion extraction algorithm, which specifically includes the following steps:
[0135] First, convert the ridge boundary navigation line extracted from the depth image according to the coordinate system, translate it by a distance of half of the standard ridge width L in the real coordinate system, and record the translated straight line in the pixel coordinate system.
[0136] Subsequently, for the translated ridge boundary navigation line and the ridge line extracted from the color image, according to the coefficient of determination R 2 and the comparison coefficient g, perform fusion according to the normalization method, and assign weight coefficients r1 and r2. r1 is the weight coefficient assigned to the ridge line in the depth map, and r2 is the weight coefficient assigned to the ridge line in the color map:
[0137]
[0138] According to the fusion of the weight coefficients, the final target navigation line is obtained. Assume that k1 and b1 are the slope and intercept of the ridge line in the depth map, and assume that k2 and b2 are the slope and intercept of the ridge line extracted from the color map. The fusion formula using the weight coefficients is:
[0139] y=(k1r1 + k2r2)x+(r1b1 + r2b2)
[0140] Finally, the intersection point of the target navigation line at the pixel h / 2 at the bottom end of the color image is the target navigation line tracking point, which is converted into a point in the real coordinate system through the coordinate system. This point is the horizontal target position adjustment point required for the row alignment adjustment device. Specifically, obtain the X-axis coordinates of the intersection points of all navigation lines, which are X1, X2, X3, X4, and X5 from right to left (X5 < X4 < X3 < X2 < X1) in turn. Obtain the intersection point Z of the target navigation line at h / 2 as the target navigation line tracking point, which is converted into a point in the real coordinate system through the coordinate system. This point is the horizontal position adjustment point required for the row alignment adjustment device 3.
[0141] Fuzzy control row alignment adjustment method
[0142] like Figure 6 As shown in the figure, it is a fuzzy control rule table for controlling row adjustment; according to the pixel position of the tracking point obtained, it is converted into a coordinate point of the real coordinate system through the coordinate system, and the position of the harvesting device is measured by the displacement sensor, and then the difference is calculated according to the distance, which is the relative distance that needs to be moved to achieve row tracking.
[0143] The relative distance is obtained, and the fuzzy control algorithm is used to control the movement of the heavy-duty screw guide rail in the row adjustment mechanism to drive the extraction and harvesting device 1 to adjust the row.
[0144] The input is defined as the position error, that is, the distance difference between the current position and the target position; the output is the pulse frequency, that is, the pulse frequency of the lower computer PLC controlling the stepper motor.
[0145] The position error is fuzzified and divided into fuzzy sets, such as "far, farther, moderate, closer, closer". A set of fuzzy rules is established to map the fuzzified input to the fuzzified output.
[0146] Speed fuzzy control: the stepper motor controls the speed of the motor by adjusting the pulse frequency;
[0147] If the position error is far, then the pulse frequency of the stepper motor is the highest;
[0148] If the position error is far, then the pulse frequency of the stepper motor is medium;
[0149] If the position error is moderate, keep the stepper motor pulse frequency in the middle;
[0150] If the position error is close, then the pulse frequency of the stepper motor is slightly lower;
[0151] If the position error is small, the pulse frequency of the stepper motor is minimum.
[0152] According to the input fuzzy variables and fuzzy rules, fuzzy reasoning is performed to obtain fuzzy output, which is then converted into a specific pulse frequency. The pulse frequency is adjusted by PLC to achieve control of the row adjustment speed.
[0153] System hardware structure design:
[0154] Preferably, the control mechanism includes a host computer and a slave computer; the host computer is connected to the image acquisition mechanism, and is used to receive images acquired by the image acquisition mechanism and perform image processing, extract ridge boundary lines and white radish ridge lines, and use the extracted ridge boundary lines and ridge lines for verification to obtain navigation tracking point navigation lines; the slave computer controls the row adjustment device 3 to adjust the harvesting device 1 for row adjustment according to the navigation lines of the host computer.
[0155] like Figure 7 As shown in the figure, the system hardware selects the distributed processing combining the upper computer and the lower computer, and the two transmit data through the 485 communication protocol, which can effectively ensure the real-time performance and efficiency of the system;
[0156] The host computer selects an embedded control terminal with a Linux system as the processor for running the image processing algorithm, and the lower computer selects a high-reliability PLC for terminal drive control;
[0157] The human-computer interaction display terminal of the system is connected to the host computer through the USB port to perform human-computer interaction and terminal operation display;
[0158] The embedded control terminal collects the image signal output by the camera 7 through the USB port, and completes the calculation work such as image processing, interface interaction, distance calculation, and lower computer communication.
[0159] The lower computer PLC transmits the data read from the two displacement sensors to the upper computer to calculate the position distance, and controls the two heavy-loaded screw guides to run to the specified position according to the moving distance calculated by the upper computer, thereby driving the pulling and harvesting device 1 to adjust the row.
[0160] A control method for a row recognition system of a white radish harvester based on machine vision comprises the following steps:
[0161] The image acquisition mechanism collects images of the white radish planting field in front of the harvester to obtain depth images and color images, and transmits them to the control unit; the control mechanism performs image processing, extracts ridge boundary lines and white radish ridge row lines, uses the extracted ridge boundary lines and ridge row lines for verification, obtains the target navigation line, and controls the row adjustment device 3 to adjust the horizontal translation of the extraction and harvesting device 1 to harvest the rows according to the target navigation line.
[0162] like Figure 8 As shown, the row harvesting specifically includes the following steps:
[0163] S1. The equipment is turned on and the harvesting device 1 is reset to the set initial starting point through the row adjustment device 3. The working state of the equipment is checked to confirm whether the safety function can work;
[0164] S2, adjusting the pulling height at the end of the pulling and harvesting device 1 by the hydraulic cylinder 13, preparing for harvesting;
[0165] S3, adjusting the field of view of the image acquisition mechanism, capturing the image of the white radish planting field in front of the harvester to obtain a depth image and a color image;
[0166] S4, performing pre-processing such as interception, filtering, expansion and corrosion on the depth image and color image obtained by shooting;
[0167] S5, extracting ridge boundary lines and ridge planting row lines from the preprocessed depth image and color image respectively;
[0168] S6, fusing the extracted ridge boundary line and ridge line to obtain a target navigation line, thereby obtaining a navigation tracking point;
[0169] S7, converting the navigation tracking point in the image coordinate system into a point in the real coordinate system, and calculating the position error of the harvesting device 1 relative to the point;
[0170] S8, the lower computer uses the position error as input and adopts the fuzzy control algorithm to control the row adjustment device 3 to move and complete the row adjustment. After the adjustment is completed, the above process is repeated and refreshed to achieve real-time row adjustment;
[0171] S9, after the target row is harvested, proceed to the next row for harvesting;
[0172] S10. All harvesting is completed and the machine is turned off.
[0173] The control mechanism adopts fuzzy control algorithm to control the row adjustment device 3 to adjust the row, including the following steps:
[0174] The position error between the current position and the target position is set as input, and the pulse frequency of the stepper motor is set as output. The position error is fuzzified and divided into fuzzy sets, "far, relatively far, moderate, relatively close, and near". A set of fuzzy rule tables is established to map the fuzzified input to the fuzzified output. Fuzzy reasoning is performed based on the input fuzzy variables and fuzzy rules to obtain fuzzy output, and then the fuzzy output is converted into a specific pulse frequency. By adjusting the pulse frequency, the line adjustment speed can be controlled.
[0175] The control mechanism of the present invention includes an algorithm module for obtaining the position of the radish ridge row, and the algorithm module includes an algorithm for extracting the outermost ridge boundary line based on a depth image, an algorithm for extracting the radish ridge row line based on straight line clustering, a tracking point fusion extraction algorithm, and a fuzzy control algorithm for the row adjustment device; when the driver drives along the outer side of the ridge to harvest, the image acquisition mechanism takes real-time photos to obtain the depth image and the color image; the ridge boundary line and the ridge planting row line are obtained through algorithm processing, and the tracking point is obtained through the tracking point verification extraction algorithm, and then the row adjustment device is controlled by the fuzzy control algorithm to adjust the extraction and harvesting device to move to the tracking point position for row harvesting; the extraction and harvesting device is realized while harvesting the row. The present invention solves the problems of frequent manual row operation and high labor intensity in the traditional white radish harvesting process, realizes the automatic row adjustment of the harvesting components, and improves the intelligent level of the white radish combined harvesting.
[0176] A harvester includes the white radish harvester row recognition system based on machine vision, and thus has the above-mentioned beneficial effects, which will not be described in detail here.
[0177] It should be understood that although this specification is described according to various embodiments, not every embodiment contains only one independent technical solution. This narrative method of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment may also be appropriately combined to form other implementation methods that can be understood by those skilled in the art.
[0178] The series of detailed descriptions listed above are only specific descriptions of feasible embodiments of the present invention. They are not intended to limit the scope of protection of the present invention. All equivalent embodiments or changes that do not deviate from the technical spirit of the present invention should be included in the scope of protection of the present invention.
Claims
1. A white radish harvester row recognition system based on machine vision, characterized in that: It comprises a control mechanism, an image acquisition mechanism, a pulling and harvesting device (1), a vehicle chassis (2) and a row adjustment device (3); The pulling and harvesting device (1) and the row adjustment device (3) are installed on the vehicle chassis (2); the pulling and harvesting device (1) is used for pulling and harvesting white radishes; the adjustment device (3) is located on both sides of the pulling and harvesting device (1) and is used for adjusting the horizontal translation of the pulling and harvesting device (1) to the left and right; The control mechanism is connected to the image acquisition mechanism and the row adjustment device (3) respectively. The image acquisition mechanism is used to acquire images of the white radish planting field in front of the harvester to obtain a depth image and a color image, and transmit the images to the control unit. The control mechanism processes the images, extracts ridge boundary lines and white radish ridge row lines, uses the extracted ridge boundary lines and ridge row lines for verification, obtains a target navigation line, and controls the row adjustment device (3) to adjust the horizontal translation of the extraction harvesting device (1) to the left and right for row adjustment according to the target navigation line.
2. The machine vision-based white radish harvester row recognition system according to claim 1, characterized in that: The row adjustment device (3) comprises a first heavy-loaded lead screw guide rail (15), a first displacement sensor (17), a stepping motor, a second heavy-loaded lead screw guide rail (25) and a second displacement sensor (23); The stepper motor comprises a first stepper motor (16) and a second stepper motor (24); The first heavy-loaded screw guide rail (15) and the first displacement sensor (17) are installed in parallel at the front end of one side of the vehicle chassis (2); the first guide rail slide (14) is installed on the first heavy-loaded screw guide rail (15); the heavy-loaded screw guide rail (15) is connected to the first stepper motor (16); and the side end surface of the first guide rail slide (14) is connected to the measuring end of the first displacement sensor (17); The second heavy-duty screw guide rail (25) and the second displacement sensor (23) are installed in parallel on the upper end surface of the mounting frame (4) on the vehicle chassis (2); the second guide rail slide (26) is installed on the second heavy-duty screw guide rail (25); the second heavy-duty screw guide rail (25) is connected to the second stepping motor (24); the upper end of the second guide rail slide (26) is hinged to the frame (20) of the clamping and conveying mechanism (12) of the extraction and harvesting device (1); and the side end surface of the second guide rail slide (26) is connected to the measuring end of the second displacement sensor (23); The first stepper motor (16), the first displacement sensor (17), the second displacement sensor (23) and the second stepper motor (24) are respectively connected to the control mechanism. The control mechanism controls the first stepper motor (16) to drive the first heavy-loaded screw guide rail (15) to slide on the first guide rail slide (14), and controls the second stepper motor (24) to drive the second heavy-loaded screw guide rail (25) to slide on the second guide rail slide (26). The first displacement sensor (17) is used to measure the position of the first guide rail slide (14) and feed it back to the control mechanism. The second displacement sensor (23) is used to measure the position of the second guide rail slide (26) and feed it back to the control mechanism, so as to drive the overall horizontal translation of the pulling and harvesting device (1) to achieve horizontal row adjustment of the pulling and harvesting device (1).
3. The machine vision-based white radish harvester row recognition system according to claim 1, characterized in that: The control mechanism includes an upper computer and a lower computer; The upper computer is connected to the image acquisition mechanism and is used to receive images acquired by the image acquisition mechanism and perform image processing, extract ridge boundary lines and white radish ridge line, and use the extracted ridge boundary lines and ridge line to perform verification to obtain navigation tracking point navigation lines; the lower computer controls the row adjustment device (3) to adjust the pulling and harvesting device (1) to perform row adjustment according to the navigation line of the upper computer.
4. The machine vision-based white radish harvester row recognition system according to claim 1, characterized in that: The control mechanism extracts the ridge boundary line based on the outermost ridge boundary line extraction algorithm of the depth image: The control mechanism intercepts the target area and performs interception processing on the depth image: Among them, B (i,j) is the coordinate of the target area point in the intercepted depth image, I (i,j) is the coordinate of the corresponding pixel in the input original depth image, x, y are the coordinates of the upper left corner of the target area, W, H are the width and height of the target area respectively; The fixed threshold binarization method is used to segment the intercepted depth image to obtain the outermost ridge boundary line and obtain a binary image: Among them, 0 represents a black background and 255 represents a white foreground; Perform area filtering and morphological processing on the processed binary image to eliminate noise and edge hole interference, then read the coordinates of the first non-zero point from right to left in each row in the intercepted area and store them in the matrix P: Where (i k , j k ) are the coordinates of the points that are not 0; The least squares method is used to fit the extracted points to obtain the ridge boundary line: y=ax+b Among them, a and b are the slope and intercept of the ridge boundary line extracted from the depth map, respectively.
5. The machine vision-based white radish harvester row recognition system according to claim 1, characterized in that: The control mechanism extracts the white radish planting line in the color picture based on the straight line clustering: The super green feature grayscale method is used to enhance the green area features. First, the target interest area of the color image is intercepted, and the remaining areas are set to 0. The super green feature method is used for grayscale conversion. The calculation method is: Among them, 2 means expanding the green channel pixels by 2 times, G means green channel, R means red channel, and B means blue channel; Use Otsu method to perform image binarization; The binary image is first dilated and then corroded to obtain the area of each connected domain, and then the connected domain area is filtered; Perform straight line clustering to extract planting row lines: select ridge lines in the intercepted area, distribute them evenly, calculate the distance from each white point in the binary image to the straight line, i.e., the ridge line, and compare them. The ones with the closest distance are classified into the same category as the straight line, and the clustered straight lines are obtained by fitting:
6. The machine vision-based white radish harvester row recognition system according to claim 1, characterized in that: The navigation tracking point navigation line is obtained by the tracking point fusion extraction algorithm: First, the ridge boundary navigation line extracted from the depth image is converted according to the coordinate system, translated by half the standard ridge width distance L in the real coordinate system, and the translated straight line is recorded in the pixel coordinate system; Then, the translated ridge boundary navigation line and the ridge line extracted from the color image are calculated according to the coefficient of determination R. 2 And the comparison coefficient g, according to the normalization method, fusion is performed, and weight coefficients r1 and r2 are assigned. R1 is the weight coefficient assigned to the depth map ridge line, and r2 is the weight coefficient assigned to the color map ridge line: According to the weight coefficient fusion, the final target navigation line is obtained: y=(k1r1+k2r2)x+(r1b1+r2b2) Among them, k1 and b1 are the slope and intercept of the ridge line in the depth map, and k2 and b2 are the slope and intercept of the ridge line extracted from the color map.
7. A harvester, characterized in that: The invention comprises the row recognition system for a white radish harvester based on machine vision as described in any one of claims 1 to 6.
8. A control method for a row recognition system of a white radish harvester based on machine vision according to any one of claims 1 to 6, characterized in that: The following steps are involved: The image acquisition mechanism acquires images of the white radish planting field in front of the harvester to obtain a depth image and a color image, and transmits the images to the control unit; the control mechanism processes the images, extracts ridge boundary lines and white radish ridge lines, uses the extracted ridge boundary lines and ridge lines for verification, obtains a target navigation line, and controls the row adjustment device (3) to adjust the horizontal translation of the extraction and harvesting device (1) to the left and right according to the target navigation line to harvest the rows.
9. The control method of the row recognition system of the white radish harvester based on machine vision according to claim 8 is characterized in that: The specific steps for row harvesting include: S1. The equipment is started up, and the pulling and harvesting device (1) is reset to the set initial starting point through the row adjustment device (3), and the working state of the equipment is checked to confirm whether the safety function can work; S2, adjusting the pulling height at the end of the pulling and harvesting device (1) by means of a hydraulic cylinder (13) to prepare for harvesting; S3, adjusting the field of view of the image acquisition mechanism, capturing the image of the white radish planting field in front of the harvester to obtain a depth image and a color image; S4, respectively performing interception, filtering, expansion and corrosion processing on the depth image and color image obtained by shooting; S5, extracting ridge boundary lines and ridge planting row lines from the preprocessed depth image and color image respectively; S6, fusing the extracted ridge boundary line and ridge line to obtain a target navigation line, thereby obtaining a navigation tracking point; S7, converting the navigation tracking point in the image coordinate system into a point in the real coordinate system, and calculating the position error of the harvesting device (1) relative to the point; S8, the lower computer uses the position error as input and adopts the fuzzy control algorithm to control the line adjustment device (3) to move and complete the line adjustment. After the adjustment is completed, the above process is repeated and refreshed to achieve real-time line adjustment; S9. After the target row is harvested, proceed to the next row for harvesting.
10. The control method of the row recognition system of the white radish harvester based on machine vision according to claim 8, characterized in that: The control mechanism adopts a fuzzy control algorithm to control the row adjustment device (3) to adjust the row, including the following steps: The position error between the current position and the target position is set as the input, and the pulse frequency of the stepper motor is set as the output. The position error is fuzzified and divided into fuzzy sets. A set of fuzzy rule tables is established to map the fuzzified input to the fuzzified output. Fuzzy reasoning is performed based on the input fuzzy variables and fuzzy rules to obtain fuzzy output, which is then converted into a specific pulse frequency. By adjusting the pulse frequency, the line adjustment speed can be controlled.
Citation Information
Patent Citations
Stereoscopic vision navigation method based on green crop feature extraction invariance
CN110232389A
On-ridge operation machine navigation path identification method based on field ridge color features
CN113963255A
Automatic operation driving method and system of stem and leaf vegetable harvester and harvester
CN115280964A
Corn harvesting row line detection method and system in corn and soybean composite planting mode
CN115578459A
Apparatus for recognizing fruit in automatic fruit harvester
JP1996196131A
Cited By
Chinese cabbage row-control harvester based on machine vision and control method
CN119769294A
Chinese cabbage harvesting machine based on machine vision and control method
CN119769294B
Harvester control system and method supporting manual and automatic modes
CN121115576A
Sugarcane grabbing machine field automatic row control system and control method thereof
CN121541651A
Field automatic row system of cane grabber and control method thereof
CN121541651B
