Laser ablation method and device for laterally cutting off cotton plant terminal bud stalks
Through laser ablation technology, the cotton plant top buds are automatically identified and removed, which solves the problems of low efficiency, high cost and damage of the existing cotton top technology, and achieves an efficient and accurate cotton top process.
Patent Information
- Application Number
- CN202411054801.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-07-30
- Filing Date
- 2024-08-02
- Publication Date
- 2024-11-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing cotton topping technology has problems such as high labor intensity, low efficiency, high cost and poor controllability. The mechanical tool topping machine has large mechanical inertia and slow response, and cannot adapt to the disorderly growth of cotton plants, which can easily cause cotton plants. damage.
Using laser ablation method for laterally cutting the stems of the cotton plant, the cotton plant image is acquired, the target detection model is used to identify the apex bud, the removal position is determined, and the gimbal and laser output head are controlled to align the stems for laser ablation, so as to achieve Automatic and precise cotton plant top.
It improves the effectiveness and work efficiency of cotton topping, reduces R&D costs, shortens the R&D cycle, and avoids the impact of black burnt retained after the ablation of the cotton core and blades on the picking quality.
Smart Images

Figure CN118926708A_ABST
Abstract
Description
[0001] This case claims the priority of a patent application with an application date of July 30, 2024, application number 2024110306708, and invention name "Laser ablation method and device for side-cutting the terminal bud stem of cotton plants". Technical Field
[0002] The invention relates to the field of automatic control technology, and in particular to a laser ablation method and a device for side-cutting the apical bud stalk of a cotton plant. Background Art
[0003] The mechanization development of cotton sowing, pesticide application and harvesting has become relatively mature, but the development of mechanized technology for cotton topping has shown a relatively backward trend.
[0004] The existing cotton topping is done manually or with mechanical cutters. Manual work has problems such as high labor intensity, low work efficiency, high cost and poor controllability. Cotton topping machines using mechanical cutters have problems such as large mechanical inertia and slow response. They cannot be adjusted according to the disorderly growth of crops and are prone to causing additional damage to cotton plants, such as buds and bolls falling off. There is an urgent need for a method for topping the top bud stems of cotton plants. Summary of the invention
[0005] The invention provides a laser ablation method and a device for side-cutting the terminal bud stalk of a cotton plant, which are used to achieve accurate and efficient topping of the cotton plant.
[0006] The present invention provides a laser ablation method for laterally removing the terminal bud stalk of a cotton plant, comprising: Acquire an image of a cotton plant to be excised, input the image of the cotton plant to be excised into a target detection model, and determine a terminal bud recognition result of the image of the cotton plant to be excised output by the target detection model, wherein the target detection model is constructed based on a cotton plant image sample and its corresponding terminal bud label; Based on the terminal bud identification result, determining the stem position information of the terminal bud to be removed from the cotton plant; Based on the stem position information, the pan-tilt is controlled to rotate and move so that the laser output head of the laser emitting unit on the pan-tilt is aligned with the stem position of the cotton plant to be cut, the pan-tilt is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt, the laser of the laser emitting unit is placed above the cotton plant to be cut based on the stand or on the side of the cotton plant to be cut based on the stand, and is connected to the laser output head through the transmission optical fiber; The laser emitting unit is controlled to emit laser light to ablate the stalk where the terminal bud of the cotton plant to be excised is located.
[0007] According to a laser ablation method for laterally removing the terminal bud stalk of a cotton plant provided by the present invention, an image of the cotton plant to be removed is obtained, comprising: The image of the cotton plant to be cut is obtained based on a camera in a monitoring unit deployed on the pan-tilt platform, or based on a camera deployed on the platform above or on the side of the cotton plant.
[0008] According to a laser ablation method for laterally removing the terminal bud stem of a cotton plant provided by the present invention, based on the terminal bud recognition result, determining the position information of the stem where the terminal bud of the cotton plant to be removed is removed, comprising: Determine the image position coordinates of the stem excision point of the terminal bud in the image of the cotton plant to be excised based on the boundary box of the terminal bud in the terminal bud recognition result; Based on the image position coordinates of the stem excision point, the stem position information for excising the terminal bud of the cotton plant to be excised is determined.
[0009] According to a laser ablation method for laterally removing the terminal bud stem of a cotton plant provided by the present invention, based on the image position coordinates of the stem removal point, the stem position information for removing the terminal bud of the cotton plant to be removed is determined, comprising: Acquire the camera intrinsic parameters and the camera extrinsic parameters of the camera, and establish a conversion relationship between the image coordinate system and the world coordinate system based on the camera intrinsic parameters and the camera extrinsic parameters; Based on the image position coordinates and the conversion relationship, the actual coordinates of the stalk excision point of the cotton plant to be excised in the world coordinate system are determined, and the actual coordinates are used as the stalk position information.
[0010] A laser ablation method for laterally removing the terminal bud stalk of a cotton plant provided by the present invention also includes: Based on the monitoring unit deployed on the pan-tilt platform, the ablation process of the terminal buds in the cotton plant to be removed is monitored, and a monitoring image of the terminal buds is output; Based on the monitoring image, the laser emitted by the laser emitting unit is regulated.
[0011] The present invention also provides a laser ablation device for laterally removing the terminal bud stalk of a cotton plant, comprising: A terminal bud recognition module is used to obtain an image of a cotton plant to be removed, input the image of the cotton plant to be removed into a target detection model, and determine a terminal bud recognition result of the image of the cotton plant to be removed output by the target detection model, wherein the target detection model is constructed based on cotton plant image samples and their corresponding terminal bud labels; A position determination module, used for determining the position information of the stalk for removing the terminal bud of the cotton plant to be removed based on the terminal bud identification result; A control module, for controlling the pan-tilt platform to rotate and move based on the stalk position information, so that the laser output head of the laser emitting unit on the pan-tilt platform is aligned with the stalk position of the cotton plant to be cut, the pan-tilt platform is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt platform, the laser of the laser emitting unit is placed above the cotton plant to be cut based on a stand or on the side of the cotton plant to be cut based on a stand, and is connected to the laser output head through the transmission optical fiber; The cutting module is used to control the laser emitting unit to emit laser to ablate the stem where the terminal bud of the cotton plant to be cut is located.
[0012] The present invention also provides an automatic operation vehicle, comprising the laser ablation device for side-cutting the apical bud stalk of cotton plants as described above, which is used to perform laser ablation operations for apical bud cutting on multiple cotton plants at the same time.
[0013] The present invention also provides an electronic device, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the laser ablation method for laterally resecting the apical bud stalk of a cotton plant as described in any one of the above methods is implemented.
[0014] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the laser ablation method for laterally resecting the apical bud stalk of a cotton plant as described in any one of the above methods is implemented.
[0015] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the laser ablation method for laterally cutting off the apical bud stalk of a cotton plant as described in any one of the above is implemented.
[0016] The laser ablation method and device for side-cutting the apical bud stem of a cotton plant provided by the present invention can realize automatic and precise control of cotton topping by automatically identifying the apical bud of the cotton plant and directly ablating and cutting the stalk where the apical bud is located on the outside of the cotton plant with a laser, and solves the problem of a large number of tests required to judge the effectiveness of topping when ablating the cotton core and leaves at the apical bud above the cotton plant, and the problem of the black burnt materials remaining after ablating the apical core affecting the subsequent cotton picking quality. The effectiveness and work efficiency of cotton topping can be greatly improved, and the research and development cost can be effectively reduced and the research and development cycle can be shortened. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1 The present invention is a schematic flow chart of a laser ablation method for laterally removing the terminal bud stalk of a cotton plant.
[0019] Figure 2 This is the structural intention of the laser ablation device for the terminal bud stem of the cotton plant provided by the present invention.
[0020] Figure 3 The present invention is a schematic diagram of the laser ablation process of the cotton plant terminal bud stalk.
[0021] Figure 4 It is a schematic structural diagram of a laser ablation device for laterally removing the terminal bud stalk of a cotton plant provided by the present invention.
[0022] Figure 5 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION
[0023] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0024] Figure 1 The present invention provides a schematic flow chart of a laser ablation method for side-cutting the apical bud stalk of a cotton plant. Figure 1 The laser ablation method for side-cutting the cotton plant terminal bud stalk provided by the present invention may include: Step 110, obtaining an image of a cotton plant to be removed, inputting the image of the cotton plant to be removed into a target detection model, and determining a terminal bud recognition result of the image of the cotton plant to be removed output by the target detection model, wherein the target detection model is constructed based on a cotton plant image sample and its corresponding terminal bud label; Step 120, based on the terminal bud identification result, determining the stem position information for removing the terminal bud of the cotton plant to be removed; Step 130, based on the stem position information, control the pan-tilt to rotate and move, so that the laser output head of the laser emitting unit on the pan-tilt is aligned with the stem position of the cotton plant to be cut, the pan-tilt is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt, the laser of the laser emitting unit is placed above the cotton plant to be cut based on a stand or on the side of the cotton plant to be cut based on a stand, and is connected to the laser output head through the transmission optical fiber; Step 140: Control the laser emitting unit to emit laser to ablate the stalk where the terminal bud of the cotton plant to be removed is located.
[0025] The execution subject of the laser ablation method for cutting off the apical bud stalk of cotton plants provided by the present invention can be an electronic device, a component in an electronic device, an integrated circuit, or a chip. The electronic device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., and the non-mobile electronic device can be a server, a network attached storage (NAS), or a personal computer (PC), etc., which is not specifically limited by the present invention.
[0026] The technical solution of the present invention is described in detail below by taking the laser ablation method for side-cutting the apical bud stalk of a cotton plant provided by the present invention executed by a computer as an example.
[0027] In step 110, an image of a cotton plant to be removed is obtained, and the image of the cotton plant to be removed is input into a target detection model to determine a terminal bud recognition result of the image of the cotton plant to be removed output by the target detection model. The target detection model is constructed based on cotton plant image samples and their corresponding terminal bud labels.
[0028] Use a high-definition camera or other image acquisition device to obtain images of the cotton plants to be cut. These devices should have high resolution and appropriate focal length to ensure that the details of the cotton plants can be clearly captured.
[0029] Before inputting the image into the object detection model, some preprocessing operations may be required, such as cropping, scaling, denoising, contrast enhancement, etc., to improve the accuracy of model detection.
[0030] Object detection models are built based on deep learning algorithms and are used to detect and locate target objects in input images. In this case, the goal of the model is to identify the terminal buds of cotton plants. In order to build such a model, you need to prepare a sample set of cotton plant images with terminal buds labeled and use this data to train the model.
[0031] The model is trained using a sample set of cotton plant images with terminal bud labels. During the training process, the model learns how to extract features from the images and identify the terminal buds.
[0032] The image of the cotton plant to be removed is input into the trained object detection model, and the model will output the recognition result of the terminal bud.
[0033] In step 120, based on the terminal bud identification result, the stem position information for removing the terminal bud of the cotton plant to be removed is determined.
[0034] Based on the apical bud recognition results, the position of the stem where the apical bud needs to be removed can be determined by calculation or preset rules. This usually involves analyzing the relationship between the apical bud position and the stem position in the image. The stem position information in the image is converted into coordinates or angle information in real space in order to control the pan / tilt and the laser unit for precise positioning.
[0035] In step 130, based on the stem position information, the pan-tilt platform is controlled to rotate and move so that the laser output head of the laser emitting unit on the pan-tilt platform is aligned with the stem position of the cotton plant to be cut. The pan-tilt platform is deployed outside the growth area of the cotton plant to be cut. The laser emitting unit includes a laser, a transmission optical fiber and a laser output head. The laser output head of the laser emitting unit is fixedly set on the pan-tilt platform. The laser of the laser emitting unit is placed above the cotton plant to be cut based on a stand or on the side of the cotton plant to be cut based on a stand, and is connected to the laser output head through the transmission optical fiber.
[0036] Based on the determined stalk position information, the pan-tilt is controlled to rotate and move so that the laser output head of the laser emitting unit on the pan-tilt is aligned with the position of the stalk of the cotton plant to be cut. This usually involves precise control of the servo motor or other actuator of the pan-tilt.
[0037] In step 140, the laser emitting unit is controlled to emit laser light to ablate the stalk where the terminal bud of the cotton plant to be excised is located.
[0038] When the laser output head is aligned with the stem position, the laser unit is controlled to emit the laser. The laser should have sufficient energy and accuracy to ablate the stem where the apical bud of the cotton plant to be removed is located, so as to achieve the removal of the apical bud.
[0039] Optionally, the schematic diagram of the structure of the cotton plant topping device based on the laser ablation device for the cotton plant terminal bud stem can be as follows: Figure 2 The structure of the laser ablation device for the cotton plant terminal bud stem provided by the present invention is shown schematically. The structure specifically includes a laser emitting unit, a beam control unit, a pan-tilt positioning unit, a real-time monitoring unit, a leaf bud collection unit and an integrated control unit.
[0040] The schematic diagram of the laser ablation process of the cotton plant terminal bud stem based on this structure can be shown as follows: Figure 3 The schematic diagram of the laser ablation working process of the cotton plant terminal bud stalk provided by the present invention is shown in FIG.
[0041] The laser emitting unit includes a laser, a transmission optical fiber and a laser output head. The laser can be placed above or on the side of the cotton plant using a stand and connected to the laser output head through the transmission optical fiber.
[0042] A beam control unit is configured on the laser output head. According to the distance between the pan-tilt positioning unit and the cotton plant, the focusing spot characteristics at the target stem are set. For example, the spot shape can be controlled to be linear, strip or square by using a galvanometer. By setting the galvanometer parameters such as filling factor and scanning speed, the most efficient and fastest stem burning effect can be found; or a long focal depth element can be used to maintain the focusing state within a certain distance before and after the focus of the stem to prevent defocusing caused by the displacement of the stem position; or a beam shaping element can be used to control the spot shape to achieve the purpose of making the overall component lighter.
[0043] The pan-tilt positioning unit is located outside the cotton plant, and the laser output head and monitoring unit are fixed on the pan-tilt. The pan-tilt is pre-placed at a suitable position between the highest cotton plant top core and the lowest cotton plant top core to ensure that the pan-tilt can rotate so that the laser positioning range covers the target stalk area where the top core of all cotton plants is located.
[0044] According to the distance between the pan-tilt positioning unit and the cotton plant, the beam control unit is used to control the characteristics of the focused light spot at the target stem. For example, the galvanometer can be used to control the light spot shape to be linear, strip or square, etc., and the most efficient and fastest stem burning effect is found by setting the galvanometer parameters such as filling factor and scanning speed; or a long focal depth element can be used to maintain the focus state within a certain distance before and after the focus of the stem to prevent defocusing caused by the displacement of the stem position; or a beam shaping element can be used to control the light spot shape to achieve the purpose of making the overall component lighter.
[0045] The position of the camera in the real-time monitoring unit is determined according to the position of the laser output head to ensure that the position where the laser ablates the target stem is within the camera's field of view. At the same time, in order to prevent camera saturation caused by excessive intensity of the laser ablation point, a filter of the laser wavelength range can be installed outside the camera lens.
[0046] The leaf bud collection unit uses a bracket or a mechanical arm to be placed near the target stem action position to collect the cut and fallen top parts.
[0047] The integrated control unit completes various settings in advance, including laser output parameters (such as power, frequency, light emission time, etc.), beam control parameters (such as modulation method, spot shape, etc.), pan / tilt position (moved to a suitable height), etc. Then, after receiving the target action position information, the pan / tilt positioning movement, laser emission, real-time monitoring and other work collaborative control are carried out.
[0048] The integrated control and real-time monitoring signals can be transmitted remotely, realizing the long-distance control of each unit and the display of monitoring images.
[0049] Each unit of the device can be mounted on an automatic work vehicle to achieve automatic cotton topping for the entire cotton field; and multiple sets of configurations can be expanded as needed to carry out laser ablation of side terminal bud removal on multiple cotton plants at the same time to achieve a more efficient topping effect.
[0050] The laser ablation method for laterally cutting off the apical bud stem of a cotton plant provided in an embodiment of the present invention realizes automatic and precise control of cotton topping by automatically identifying the apical bud of the cotton plant and directly ablating and cutting the stalk where the apical bud is located on the outside of the cotton plant using a laser. It also solves the problem of needing a large number of tests to judge the effectiveness of topping when ablating the cotton core and leaves at the apical bud above the cotton plant, and the problem of the black burnt materials remaining after ablating the apical core affecting the subsequent cotton picking quality. It can greatly improve the effectiveness and work efficiency of cotton topping, effectively reduce R&D costs, and shorten the R&D cycle.
[0051] In one embodiment, obtaining the image of the cotton plant to be cut includes: obtaining the image of the cotton plant to be cut based on a camera in a monitoring unit deployed on the pan-tilt platform, or based on a camera deployed above or on the side of the cotton plant on a platform.
[0052] The monitoring unit is deployed in the PTZ, and the monitoring unit can include a camera and a lens. The position of the camera in the monitoring unit is determined by the position of the laser output head to ensure that the cotton plant to be removed is within the camera's field of view; at the same time, in order to prevent the camera from being saturated due to the intensity of the laser ablation point being too strong, a filter of the laser wavelength range can be installed outside the camera lens. It is also possible to use a camera deployed above or on the side of the cotton plant based on the gantry to obtain images of the cotton plant to be removed.
[0053] In one embodiment, based on the apical bud recognition result, the stem position information for removing the apical bud of the cotton plant to be removed is determined, including: based on the boundary box of the apical bud in the apical bud recognition result, determining the image position coordinates of the stem removal point of the apical bud in the image of the cotton plant to be removed; based on the image position coordinates of the stem removal point, determining the stem position information for removing the apical bud of the cotton plant to be removed.
[0054] After the object detection model identifies the terminal buds of cotton plants, it usually generates a bounding box for each detected terminal bud. This bounding box is a rectangular area that tightly surrounds the location of the terminal bud in the image. The four corners of the bounding box are usually defined by the coordinates (x, y) of its upper left corner and lower right corner.
[0055] In cotton plants, the terminal bud is usually located at the top of the stem. Therefore, the location of the stem resection point should be closely related to the location of the terminal bud. In order to determine the stem resection point, further analysis is required based on the bounding box of the terminal bud to determine the stem position information for resection of the terminal bud of the cotton plant to be resected.
[0056] In one embodiment, based on the image position coordinates of the stem resection point, the stem position information of the apical bud of the cotton plant to be resected is determined, including: obtaining the camera intrinsic parameters of the camera and the camera extrinsic parameters of the camera, and establishing a conversion relationship between the image coordinate system and the world coordinate system based on the camera intrinsic parameters and the camera extrinsic parameters; based on the image position coordinates and the conversion relationship, determining the actual coordinates of the stem resection point of the cotton plant to be resected in the world coordinate system, and using the actual coordinates as the stem position information.
[0057] Camera intrinsic parameters describe the optical properties and geometric relationships inside the camera, mainly including: Focal length: The focal length of the camera lens, which determines the degree of magnification of objects in the image. Principal point: The origin of the image coordinate system, usually the center point of the image, but it may also be offset due to camera manufacturing reasons. Distortion coefficient: Image deformation parameters caused by lens distortion, usually including radial distortion and tangential distortion.
[0058] The camera extrinsics describe the relative position and posture between the camera and the world coordinate system, mainly including: Rotation matrix: represents the rotation relationship between the camera coordinate system and the world coordinate system. Translation vector: represents the position of the origin of the camera coordinate system in the world coordinate system.
[0059] Based on the camera intrinsics and extrinsics, the transformation relationship between the image coordinate system and the world coordinate system can be established. This process usually involves the following steps: Dedistortion: First, the image needs to be dedistorted to eliminate the impact of lens distortion on the image. This usually requires the use of the distortion coefficients in the camera intrinsics for calculation. Normalization: After dedistortion, the points in the image coordinate system are transformed into the normalized image coordinate system. This step is mainly to simplify subsequent calculations. Rotation and translation: Use the rotation matrix and translation vector in the camera extrinsics to transform the points in the normalized image coordinate system into the camera coordinate system. Projection: Finally, based on the focal length and principal point information in the camera intrinsics, the points in the camera coordinate system are projected into the world coordinate system.
[0060] After establishing the conversion relationship between the image coordinate system and the world coordinate system, the image position coordinates of the stem removal point can be converted to the world coordinate system to obtain its actual coordinates. The specific steps are as follows: Extract image position coordinates: Extract the image position coordinates (x, y) of the stem removal point from the output of the target detection model. Apply the conversion relationship: Substitute the extracted image position coordinates into the previously established conversion relationship and calculate the actual coordinates (X, Y, Z) of the stem removal point in the world coordinate system.
[0061] The actual coordinates of the calculated stem cutting points are used as the stem position information. This information can be used to guide subsequent cutting operations and control the pan-tilt and laser emission unit for precise positioning and cutting.
[0062] In one embodiment, it also includes: based on the monitoring unit deployed on the pan-tilt platform, monitoring the ablation process of the terminal buds in the cotton plant to be removed, and outputting a monitoring image of the terminal buds; based on the monitoring image, regulating the laser emitted by the laser emitting unit.
[0063] The monitoring unit is deployed on a gimbal to ensure that the viewing angle and focal length can be flexibly adjusted to obtain a clear image of the apical bud. The rotation and movement functions of the gimbal enable the monitoring unit to follow the movement of the apical bud or the movement of the gimbal itself to maintain continuous monitoring of the apical bud ablation process.
[0064] The acquired monitoring images can be further analyzed and processed by image processing algorithms. For example, edge detection algorithms can be used to identify the boundaries of the terminal buds, so as to more accurately determine the degree of ablation of the terminal buds. In addition, color analysis algorithms can be used to monitor the changes in the color of the terminal buds to determine whether the ablation is uniform or whether there is over-burning.
[0065] During the laser ablation process, the monitoring unit will capture the monitoring image of the apical bud in real time and adjust the laser parameters in real time based on the image information. For example, when the monitoring image shows that the apical bud is ablated too slowly, the power or frequency of the laser can be increased. This real-time control method can ensure that the ablation process of the apical bud is more uniform and stable.
[0066] Figure 4 The schematic diagram of the structure of the laser ablation device for side-cutting the apical bud stalk of cotton plants provided by the present invention is as follows: Figure 4 As shown, the device comprises: The terminal bud recognition module 410 is used to obtain an image of a cotton plant to be removed, input the image of the cotton plant to be removed into a target detection model, and determine a terminal bud recognition result of the image of the cotton plant to be removed output by the target detection model, wherein the target detection model is constructed based on cotton plant image samples and their corresponding terminal bud labels; A position determination module 420, for determining the position information of the stalk for removing the terminal bud of the cotton plant to be removed based on the terminal bud identification result; The control module 430 is used to control the pan-tilt platform to rotate and move based on the stem position information, so that the laser output head of the laser emitting unit on the pan-tilt platform is aligned with the stem position of the cotton plant to be cut, the pan-tilt platform is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt platform, the laser of the laser emitting unit is placed above the cotton plant to be cut based on the platform or on the side of the cotton plant to be cut based on the platform, and is connected to the laser output head through the transmission optical fiber; The cutting module 440 is used to control the laser emitting unit to emit laser to ablate the stem where the terminal bud of the cotton plant to be cut is located.
[0067] The laser ablation device for laterally cutting off the apical bud stem of a cotton plant provided in an embodiment of the present invention realizes automatic and precise control of cotton topping by automatically identifying the apical bud of the cotton plant and directly ablating and cutting the stalk where the apical bud is located on the outside of the cotton plant with a laser. It also solves the problem of needing a large number of tests to judge the effectiveness of topping when ablating the cotton core and leaves at the apical bud above the cotton plant, and the problem of the black burnt materials remaining after ablating the apical core affecting the subsequent cotton picking quality. It can greatly improve the effectiveness and work efficiency of cotton topping, effectively reduce R&D costs, and shorten the R&D cycle.
[0068] In one embodiment, the terminal bud identification module 410 is specifically used for: The step of obtaining the image of the cotton plant to be cut comprises: The image of the cotton plant to be cut is obtained based on a camera in a monitoring unit deployed on the pan-tilt platform, or based on a camera deployed on the platform above or on the side of the cotton plant.
[0069] In one embodiment, the location determination module 420 is specifically configured to: The step of determining the position information of the stalk for removing the terminal bud of the cotton plant based on the terminal bud identification result includes: Determine the image position coordinates of the stem excision point of the terminal bud in the image of the cotton plant to be excised based on the boundary box of the terminal bud in the terminal bud recognition result; Based on the image position coordinates of the stem excision point, the stem position information for excising the terminal bud of the cotton plant to be excised is determined.
[0070] In one embodiment, the location determination module 420 is further specifically configured to: Based on the image position coordinates of the stem excision point, determining the stem position information for excising the terminal bud of the cotton plant to be excised includes: Acquire the camera intrinsic parameters and the camera extrinsic parameters of the camera, and establish a conversion relationship between the image coordinate system and the world coordinate system based on the camera intrinsic parameters and the camera extrinsic parameters; Based on the image position coordinates and the conversion relationship, the actual coordinates of the stalk excision point of the cotton plant to be excised in the world coordinate system are determined, and the actual coordinates are used as the stalk position information.
[0071] In one embodiment, the resection module 440 is specifically configured to: Based on the monitoring unit deployed on the pan-tilt platform, the ablation process of the terminal buds in the cotton plant to be removed is monitored, and a monitoring image of the terminal buds is output; Based on the monitoring image, the laser emitted by the laser emitting unit is regulated.
[0072] The present invention also provides an automatic operation vehicle, which includes multiple sets of the above-mentioned laser ablation devices for side-cutting the terminal bud stems of cotton plants, and can realize automatic cotton topping in the entire cotton field to achieve a more efficient topping effect.
[0073] Figure 5 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 5 As shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530 and a communication bus 540, wherein the processor 510, the communication interface 520 and the memory 530 communicate with each other through the communication bus 540. The processor 510 may call the logic instructions in the memory 530 to execute the laser ablation method for side-cutting the apical bud stalk of the cotton plant, the method comprising: Acquire an image of a cotton plant to be excised, input the image of the cotton plant to be excised into a target detection model, and determine a terminal bud recognition result of the image of the cotton plant to be excised output by the target detection model, wherein the target detection model is constructed based on a cotton plant image sample and its corresponding terminal bud label; Based on the terminal bud identification result, determining the stem position information of the terminal bud to be removed from the cotton plant; Based on the stem position information, the pan-tilt is controlled to rotate and move so that the laser output head of the laser emitting unit on the pan-tilt is aligned with the stem position of the cotton plant to be cut, the pan-tilt is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt, the laser of the laser emitting unit is placed above the cotton plant to be cut based on the stand or on the side of the cotton plant to be cut based on the stand, and is connected to the laser output head through the transmission optical fiber; The laser emitting unit is controlled to emit laser light to ablate the stalk where the terminal bud of the cotton plant to be excised is located.
[0074] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.
[0075] On the other hand, the present invention further provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, the computer can execute the laser ablation method for side-cutting the apical bud stalk of a cotton plant provided by the above methods, the method comprising: Acquire an image of a cotton plant to be excised, input the image of the cotton plant to be excised into a target detection model, and determine a terminal bud recognition result of the image of the cotton plant to be excised output by the target detection model, wherein the target detection model is constructed based on a cotton plant image sample and its corresponding terminal bud label; Based on the terminal bud identification result, determining the stem position information of the terminal bud to be removed from the cotton plant; Based on the stem position information, the pan-tilt is controlled to rotate and move so that the laser output head of the laser emitting unit on the pan-tilt is aligned with the stem position of the cotton plant to be cut, the pan-tilt is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt, the laser of the laser emitting unit is placed above the cotton plant to be cut based on the stand or on the side of the cotton plant to be cut based on the stand, and is connected to the laser output head through the transmission optical fiber; The laser emitting unit is controlled to emit laser light to ablate the stalk where the terminal bud of the cotton plant to be excised is located.
[0076] In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, which is implemented when the computer program is executed by a processor to perform the above-mentioned laser ablation method for side-cutting the terminal bud stalk of a cotton plant, the method comprising: Acquire an image of a cotton plant to be excised, input the image of the cotton plant to be excised into a target detection model, and determine a terminal bud recognition result of the image of the cotton plant to be excised output by the target detection model, wherein the target detection model is constructed based on a cotton plant image sample and its corresponding terminal bud label; Based on the terminal bud identification result, determining the stem position information of the terminal bud to be removed from the cotton plant; Based on the stem position information, the pan-tilt is controlled to rotate and move so that the laser output head of the laser emitting unit on the pan-tilt is aligned with the stem position of the cotton plant to be cut, the pan-tilt is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt, the laser of the laser emitting unit is placed above the cotton plant to be cut based on the stand or on the side of the cotton plant to be cut based on the stand, and is connected to the laser output head through the transmission optical fiber; The laser emitting unit is controlled to emit laser light to ablate the stalk where the terminal bud of the cotton plant to be excised is located.
[0077] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0078] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.
[0079] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A laser ablation method for laterally removing the terminal bud stalk of a cotton plant, characterized in that: The method comprises: Acquire an image of a cotton plant to be excised, input the image of the cotton plant to be excised into a target detection model, and determine a terminal bud recognition result of the image of the cotton plant to be excised output by the target detection model, wherein the target detection model is constructed based on a cotton plant image sample and its corresponding terminal bud label; Based on the terminal bud identification result, determining the stem position information for removing the terminal bud of the cotton plant to be removed; Based on the stem position information, the pan-tilt is controlled to rotate and move so that the laser output head of the laser emitting unit on the pan-tilt is aligned with the stem position of the cotton plant to be cut, the pan-tilt is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt, the laser of the laser emitting unit is placed above the cotton plant to be cut based on the stand or on the side of the cotton plant to be cut based on the stand, and is connected to the laser output head through the transmission optical fiber; The laser emitting unit is controlled to emit laser light to ablate the stalk where the terminal bud of the cotton plant to be excised is located.
2. The laser ablation method for side-cutting the terminal bud stalk of cotton plants according to claim 1, characterized in that: The step of obtaining the image of the cotton plant to be cut comprises: The image of the cotton plant to be cut is obtained based on a camera in a monitoring unit deployed on the pan-tilt platform, or based on a camera deployed on the platform above or on the side of the cotton plant.
3. The laser ablation method for side-cutting the terminal bud stalk of cotton plants according to claim 2, characterized in that: The step of determining the position information of the stalk for removing the terminal bud of the cotton plant based on the terminal bud identification result includes: Determine the image position coordinates of the stem excision point of the terminal bud in the image of the cotton plant to be excised based on the boundary box of the terminal bud in the terminal bud recognition result; Based on the image position coordinates of the stem excision point, the stem position information for excising the terminal bud of the cotton plant to be excised is determined.
4. The laser ablation method for side-cutting the terminal bud stalk of cotton plants according to claim 3, characterized in that: The determining, based on the image position coordinates of the stem excision point, the stem position information for excising the terminal bud of the cotton plant to be excised comprises: Acquire the camera intrinsic parameters and the camera extrinsic parameters of the camera, and establish a conversion relationship between the image coordinate system and the world coordinate system based on the camera intrinsic parameters and the camera extrinsic parameters; Based on the image position coordinates and the conversion relationship, the actual coordinates of the stalk excision point of the cotton plant to be excised in the world coordinate system are determined, and the actual coordinates are used as the stalk position information.
5. The laser ablation method for side-cutting the terminal bud stalk of cotton plants according to claim 1, characterized in that: Also includes: Based on the monitoring unit deployed on the pan-tilt platform, the ablation process of the terminal buds in the cotton plant to be removed is monitored, and a monitoring image of the terminal buds is output; Based on the monitoring image, the laser emitted by the laser emitting unit is regulated.
6. A laser ablation device for laterally removing the terminal bud stem of a cotton plant, characterized in that: include: A terminal bud recognition module is used to obtain an image of a cotton plant to be removed, input the image of the cotton plant to be removed into a target detection model, and determine a terminal bud recognition result of the image of the cotton plant to be removed output by the target detection model, wherein the target detection model is constructed based on cotton plant image samples and their corresponding terminal bud labels; A position determination module, used for determining the position information of the stalk for removing the terminal bud of the cotton plant to be removed based on the terminal bud identification result; A control module, for controlling the pan-tilt to rotate and move based on the stalk position information, so that the laser output head of the laser emitting unit on the pan-tilt is aligned with the stalk position of the cotton plant to be cut, the pan-tilt is deployed outside the growth area of the cotton plant to be cut, the laser emitting unit includes a laser, a transmission optical fiber and a laser output head, the laser output head of the laser emitting unit is fixedly arranged on the pan-tilt, the laser of the laser emitting unit is placed above the cotton plant to be cut based on a stand or on the side of the cotton plant to be cut based on a stand, and is connected to the laser output head through the transmission optical fiber; The cutting module is used to control the laser emitting unit to emit laser to ablate the stem where the terminal bud of the cotton plant to be cut is located.
7. An automatic working vehicle, characterized in that: The invention comprises a plurality of laser ablation devices for side-cutting the apical bud stems of cotton plants as described in claim 6, and is used for simultaneously performing laser ablation operations for cutting off the apical buds of a plurality of cotton plants.
8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the laser ablation method for side-cutting the apical bud stalk of a cotton plant as claimed in any one of claims 1 to 5 is implemented.
9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the laser ablation method for side-cutting the apical bud stalk of a cotton plant as claimed in any one of claims 1 to 5 is implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the laser ablation method for side-cutting the apical bud stalk of a cotton plant as claimed in any one of claims 1 to 5 is implemented.
Citation Information
Patent Citations
Laser topping method for crop
CN106508457A
Positioning method, controller and removing device for removing the top center of cotton
CN109272553A
Apical dominance removal device based on laser ablation
CN110870420A
Crop apical dominance removing device and method
CN114303686A
Citrus recognition and positioning method, device and equipment and storage medium
CN114332689A
