Webbed-foot bionic robot based on intelligent detection and feedback of crop information and its use method

By designing concave webbed bionic robots and multimodal information fusion technology, traditional equipment has solved the problems of low operating efficiency, limited scope of application and difficult operation in paddy fields, and realized intelligent crop information detection and feedback, and improved agricultural production Efficiency and work adaptability.

CN117963036BActive Publication Date: 2024-11-22NANJING AGRICULTURAL UNIVERSITY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410292402.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-03-14
Publication Date
2024-11-22
Estimated Expiration
2044-03-14

AI Technical Summary

Technical Problem

Traditional agricultural machinery and equipment have low operating efficiency, limited scope of application, high difficulty in operating in paddy fields, and lack of intelligent analysis and feedback capabilities.

Method used

A concave webbed foot bionic robot based on intelligent detection and feedback of crop information was designed, using intelligent concave webbed bionic foot, multimodal information fusion technology, deep convolutional neural network model and detachable intelligent fertilization device to realize real-time monitoring, Analysis, decision making and feedback.

Benefits of technology

It has improved the efficiency of crop information detection, adapted to different operating environments, reduced soil damage, achieved diversified operating tasks, and promoted the development of smart agriculture and smart agricultural machinery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117963036B_ABST
    Figure CN117963036B_ABST
Patent Text Reader

Abstract

The present invention provides a bionic robot with concave webbed feet based on intelligent detection and feedback of crop information and a method for using the same. The bionic robot with concave webbed feet includes a support platform, an intelligent bionic concave webbed foot is installed below the support platform, and a detachable intelligent fertilization device, a GreenSeeker detector, a hyperspectral imager, a GreenSeeker conversion control device, an intelligent identification control device, a Beidou navigation system, a wind direction sensor, a wind speed sensor, an energy supply device, an energy storage device, and a laptop are also installed on the support platform. The present invention can simultaneously realize the one-time real-time collection, processing, decision-making and feedback of multiple information such as crop image information, spectral information, distance information, and climate information, and control the corresponding feedback device to realize fertilization or spraying of crops on targets, simplifying the complexity of traditional operating machines and tools, improving the efficiency of crop information detection, and promoting the development of smart agriculture and smart agricultural machinery.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of smart agricultural technology and equipment design, and in particular relates to a webbed-foot bionic robot based on intelligent detection and feedback of crop information and a method of using the robot. Background Art

[0002] Against the backdrop of the rapid development of robotics technology, the demand for intelligent and efficient agricultural machinery and equipment is gradually increasing. Real-time monitoring and feedback of information such as crop growth status, pests and diseases are crucial for farmers' decision-making and management. Traditional monitoring methods usually rely on manual patrols or fixed sensor networks, but there are problems such as waste of resources, low monitoring efficiency, and difficulty in adjusting agricultural production strategies in real time. Although emerging drone equipment can collect crop information, it lacks the ability to intelligently judge and feedback crop information. At the same time, existing near-ground information collection equipment has certain limitations in terms of size, function, adaptability, etc., and cannot meet different operating environments. Prior art 1 (CN115530052B) discloses a movable gantry-type plant phenotyping platform, which uses a wheel structure to drive the operation, integrates a plant phenotyping monitoring module, a control box, and a precise operation management module, and can achieve real-time acquisition of growth status information and variety type information for plant populations of different types and forms. However, the platform is mainly suitable for greenhouse and dryland operations, and is difficult to operate in paddy field environments. Prior art 2 (CN218398146U) discloses a plant phenotyping detection robot. By setting a telescopic part, the telescopic part can drive the detection element to move in a longitudinal straight line when it is extended and retracted, so that phenotypic detection can be performed on plants at different heights. However, the robot adopts a wheeled drive structure, and its operating efficiency and scope of application have certain limitations.

[0003] Therefore, combined with the agricultural informatization strategy, the development of intelligent equipment based on crop information detection and feedback has become a key way to improve agricultural production efficiency and promote agricultural modernization. By utilizing advanced technologies such as information technology, sensor technology, and bionic technology, real-time monitoring and intelligent feedback of crop information can be achieved to provide farmers with a scientific basis. This is a research focus in the field of smart agriculture, which will help reduce resource waste and promote the sustainable development of the agricultural industry. It will make agricultural production more intelligent and efficient, and conform to the agricultural development trend in the digital age. Summary of the invention

[0004] In view of the shortcomings in the prior art, the present invention provides a webbed-foot bionic robot based on intelligent detection and feedback of crop information and a method of using the same, which solves the problems of low operating efficiency, limited scope of application, great difficulty in operating in paddy field environments, and lack of intelligent analysis and feedback capabilities of crop information existing in traditional equipment operations.

[0005] The present invention achieves the above technical objectives through the following technical means.

[0006] A bionic robot with concave webbed feet based on intelligent detection and feedback of crop information comprises a laptop computer installed on a supporting platform for realizing intelligent collection, analysis, decision-making and control of operation information, an intelligent bionic concave webbed foot is installed under the supporting platform, the intelligent bionic concave webbed foot is driven to walk by a bionic foot driving device on the top thereof, an ultrasonic ranging sensor and a depth camera are installed at the front of the bionic foot driving device; a detachable intelligent fertilizing device is symmetrically installed on the bottom crossbeam of the supporting platform, a GreenSeeker detector, a fill light, a hyperspectral imager and a GreenSeeker conversion control device are installed on the middle crossbeam of the supporting platform; an intelligent identification control device, a Beidou navigation system, a wind direction sensor, a wind speed sensor, an energy supply device, an energy storage device and a GreenSeeker output control device are installed on the upper crossbeam of the supporting platform.

[0007] Furthermore, the detachable intelligent fertilizing device includes a fertilizer box, and three sets of fertilizer discharge groove wheels are installed at the bottom of the fertilizer box, and the fertilizer discharge groove wheels include an external fertilizer discharge groove wheel shell and an internally installed driving groove wheel; an adjustable fertilizer discharge pipe is correspondingly installed at the fertilizer discharge port at the bottom of each fertilizer discharge groove wheel, and a fertilizer discharge pipe adjustment motor is installed at the top of the adjustable fertilizer discharge pipe, and a fertilizer discharge pipe adjustment spring wire is installed at the output end of the fertilizer discharge pipe adjustment motor, and the fertilizer discharge pipe adjustment spring wire is arranged along the fertilizer discharge pipe.

[0008] Furthermore, driving motors are symmetrically installed on the outer sides of the bottom of the support plates on both sides of the fertilizer box, an adjustment support module is installed on the output end of the driving motor, and a binocular structured light 3D camera is correspondingly installed on the front of the adjustment support module. The three are hinged to each other, and the binocular structured light 3D camera rotates in different directions under the indirect drive of the driving motor to achieve all-round identification of target crops.

[0009] Further, the four groups of the intelligent concave webbed bionic feet are respectively installed at the four corners of the supporting platform, the intelligent concave webbed bionic feet include a bionic concave web at the bottom, a plurality of bionic phalanges are installed on the upper part of the bionic concave web, and the bionic phalanges are hollow structures; the bionic phalanges are hinged to two groups of bionic tarsometatarsals, the two groups of bionic tarsometatarsals are respectively hinged to two groups of bionic tibia-fibula, and the two groups of bionic tibia-fibula are respectively connected to two groups of power output ends of the bionic foot driving device through a gear structure;

[0010] When the output shafts of the two sets of power output ends of the bionic foot driving device rotate clockwise, the bionic tibia-fibula are driven to swing backward, and then the bionic tarsometatarsus are driven to swing forward; when the output shafts of the two sets of power output ends of the bionic foot driving device rotate counterclockwise, the bionic tibia-fibula are driven to swing forward, and then the bionic tarsometatarsus are driven to swing backward.

[0011] Furthermore, the GreenSeeker detector is installed symmetrically at the front of the middle beam of the supporting platform to collect vegetation index information in real time; the hyperspectral imager is installed in the middle position of the middle beam of the supporting platform to collect spectral information of the corresponding area in real time; the fill light is centered on the vertical plane of the hyperspectral imager lens and is symmetrically installed on the middle beam of the supporting platform to meet the fill light needs in weather and time periods with insufficient light; the GreenSeeker conversion control device is installed at the rear of the middle beam of the supporting platform to realize the conversion, transmission and control of vegetation index collection information.

[0012] Furthermore, the intelligent identification control device is installed at the front middle position of the upper crossbeam of the supporting platform, realizing 360° unlimited rotation, 180° upward viewing angle without blind spots, and real-time monitoring of information collection and feedback of operation status; the Beidou navigation system is installed at the middle and rear part of the upper crossbeam of the supporting platform to detect the position information of the robot in real time; the wind direction sensor is installed at the front part of the upper crossbeam of the supporting platform to collect wind direction information in real time; the wind speed sensor is installed at the front part of the upper crossbeam of the supporting platform to collect wind speed information in real time; the energy supply device is installed at the middle and rear part of the upper crossbeam of the supporting platform, and obtains solar energy through solar panels and converts it into electricity to supply robot driving and operation, and the remaining energy is stored in the energy storage device; the energy storage device is installed at the rear part of the upper crossbeam of the supporting platform to store electricity; the GreenSeeker output control device is installed at the rear part of the upper crossbeam of the supporting platform to collect and analyze vegetation index information in real time and transmit it to the laptop computer.

[0013] Furthermore, the laptop computer is internally installed with a multi-input and multi-output deep convolutional neural network model, which integrates multimodal information including Beidou satellite information, image information, climate information, location information, distance information, and crop phenotype information to realize the robot's intelligent walking, recognition, detection, decision-making and feedback.

[0014] An operation method of the above-mentioned webbed-foot bionic robot based on intelligent detection and feedback of crop information includes the following process:

[0015] Step 1: After being powered on and preheated for a period of time, the robot collects Beidou satellite information, image information, climate information, location information, distance information, and crop phenotypic information in real time through the Beidou navigation system, intelligent recognition and control device, wind direction sensor, wind speed sensor, ultrasonic ranging sensor, depth camera, and binocular structured light 3D camera. It analyzes, identifies, and obtains perception information of the farmland environment and target crops, and collects initial data for robot operations.

[0016] Step 2: The initial data is transmitted to the laptop computer for real-time analysis and decision-making. The laptop computer uses the internally trained multi-input multi-output deep convolutional neural network model to input data from multiple sensors or information sources into the model, and obtains the optimal walking path and optimal working posture based on the output results, thereby controlling the output shafts of the two power output ends of the bionic foot drive device to rotate clockwise and counterclockwise respectively, realizing the opening and closing movement of the bionic tarsometatarsus and bionic tibia-fibula, and driving the intelligent concave webbed bionic foot to walk according to the corresponding route and work in the corresponding posture; the laptop computer controls the robot to realize autonomous navigation, path planning, precise operation, and obstacle avoidance functions through multimodal information fusion technology;

[0017] Step 3: During the walking process, the robot continues to collect relevant information about the surrounding environment and target crops in real time and update multimodal information. At the same time, the hyperspectral imager and GreenSeeker detector collect and detect farmland information including crop growth status and pest and disease conditions in real time, and transmit the corresponding data to the multi-input multi-output deep convolutional neural network model trained inside the laptop for real-time processing and analysis to make the best decision. The laptop fuses multimodal information, detects and identifies target crops, controls the robot to move to the target position, and adjusts to the best working posture to prepare for subsequent operations.

[0018] Step 4: Based on the solution results of multimodal information fusion, the laptop sends instructions to the detachable intelligent fertilization device to control the detachable intelligent fertilization device to accurately target and quantitatively apply fertilizers and pesticides; at the same time, the laptop will also feed back the collected data to relevant staff in real time.

[0019] Furthermore, the hyperspectral imager and GreenSeeker detector transmit crop detection data to a laptop computer, which processes and analyzes the data and sends instructions to the fertilizer groove wheel, the adjustable fertilizer pipe and the drive motor. The drive motor rotates to control the binocular structured light 3D camera to identify the near-root part of the target crop. The fertilizer pipe adjustment motor drives the fertilizer pipe spring wire to move, thereby driving the fertilizer pipe to the near-root part. The fertilizer groove wheel discharges fertilizer quantitatively according to the instructions, thereby realizing the quantitative fertilization and pesticide application of the fertilizer groove wheel and the adjustable fertilizer pipe to the target.

[0020] The present invention has the following beneficial effects:

[0021] (1) It can simultaneously realize the one-time real-time collection, processing, decision-making and feedback of multiple information such as crop image information, spectral information, distance information, climate information, etc., and control the corresponding feedback device to realize the fertilization or spraying of crops on the target, simplifying the complexity of traditional operating equipment and improving the efficiency of crop information detection.

[0022] (2) The design of the intelligent concave webbed bionic foot reduces soil resistance while ensuring a certain level of grip friction. It can adapt to different working environments such as paddy field crops and dryland crops. When combined with corresponding sensors, it can monitor the working conditions in real time and adjust the walking distance and support height synchronously, thus avoiding repeated crushing of the soil by wheeled and tracked working equipment, reducing soil damage and improving soil quality.

[0023] (3) The design of the detachable intelligent fertilization device allows the free replacement of feedback equipment, which can meet the diverse operational tasks such as sowing, fertilizing and spraying, pruning, and harvesting, further expanding the robot's scope of action.

[0024] (4) The robot integrates intelligent modules such as intelligent recognition control module, Beidou navigation module, spectrum acquisition module, image acquisition module, climate information acquisition module, feedback operation module, etc., realizing functions such as unmanned navigation, intelligent recognition, intelligent detection, intelligent decision-making, precise targeting, and all-weather efficient operation of the robot, which has promoted the development of smart agriculture and smart agricultural machinery to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 This is a schematic diagram of the overall structure of the concave webbed foot bionic robot of the present invention;

[0026] Figure 2 This is a front view of the concave webbed foot bionic robot of the present invention;

[0027] Figure 3 A side view of the concave webbed foot bionic robot of the present invention;

[0028] Figure 4 A top view of the concave webbed foot bionic robot of the present invention;

[0029] Figure 5 This is a schematic diagram of the detachable intelligent fertilization device of the present invention;

[0030] Figure 6 This is a schematic diagram of the structure of the fertilizer discharging groove wheel of the present invention;

[0031] Figure 7 It is a schematic diagram of the arrangement of the fertilizer discharge pipe regulating motor at the top of the adjustable fertilizer discharge pipe of the present invention;

[0032] Figure 8 This is a schematic diagram of the intelligent concave-web bionic foot of the present invention;

[0033] Fig. 9 This is a schematic diagram of the bottom of the bionic concave web of the present invention;

[0034] Fig.10 This is a front schematic diagram of the bionic concave web of the present invention.

[0035] In the figure: 1. GreenSeeker output control device, 2. Laptop computer, 3. Energy storage device, 4. Beidou navigation system, 5. Energy supply device, 6. Hyperspectral imager, 7. Intelligent identification control device, 8. Wind direction sensor, 9. Wind speed sensor, 10. GreenSeeker detector, 11. Depth camera, 12. Ultrasonic ranging sensor, 13. Intelligent concave webbed bionic foot, 14. Detachable intelligent fertilization device, 15. Support platform, 16. Fill light, 17. GreenSeeker conversion control device, 1 112. Support device, 1301. Bionic phalanges, 1302. Bionic concave webs, 1303. Bionic tarsometatarsus, 1304. Bionic tibia-fibula, 1305. Bionic foot driving device, 1401. Fertilizer box, 1402. Adjustment support module, 1403. Binocular structured light 3D camera, 1404. Adjustable fertilizer pipe, 1405. Fertilizer groove wheel, 1406. Driving motor, 14051. Fertilizer groove wheel shell, 14052. Driving groove wheel, 14041. Fertilizer pipe adjustment motor, 14042 Fertilizer pipe, 14043. Fertilizer pipe adjustment spring wire. DETAILED DESCRIPTION

[0036] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments, but the protection scope of the present invention is not limited thereto.

[0037] like Figure 1 As shown, the webbed-foot bionic robot based on intelligent detection and feedback of crop information of the present invention comprises a support platform 15 for providing working support for the robot, and an intelligent webbed-foot bionic foot 13 for providing walking drive for the robot is installed below the support platform 15.

[0038] like Figure 2 , 3As shown in Figures 8, 9, and 10, the shape of the intelligent concave webbed bionic foot 13 is similar to the leg structure of a gull. The whole is made of titanium alloy composite materials. It is equipped with corresponding sensors to monitor the robot's working conditions in real time, and can flexibly adjust the working posture to improve the universality of the equipment, reduce soil damage, and improve working efficiency. There are four groups of intelligent concave webbed bionic feet 13, which are installed at the four corners of the support platform 15. The intelligent concave webbed bionic foot 13 includes a bionic concave web 1302 at the bottom. The bionic concave web 1302 can reduce the longitudinal resistance of the soil and improve the adaptability of the equipment; a plurality of bionic phalanges 1301 are installed on the upper part of the bionic concave web 1302. The bionic phalanges 1301 adopt a hollow design, which can further reduce the weight of the machine; the bionic phalanges 1301 are hinged to two groups of bionic tarsometatarsals 1 303, two groups of bionic tarsometatarsus 1303 are respectively hinged to two groups of bionic tibia-fibula 1304, and the robot's posture height adjustment can be achieved through the opening and closing movements of the bionic tarsometatarsus 1303 and the bionic tibia-fibula 1304; the two groups of bionic tibia-fibula 1304 are respectively engaged with the two groups of power output ends of the bionic foot driving device 1305 through the gear structure, and the overall walking and supporting drive are provided by the robot energy storage device 3 and the energy supply device 5.

[0039] When the webbed foot bionic robot is walking, when the output shafts of the two groups of power output ends of the bionic foot driving device 1305 rotate clockwise, the bionic tibia-fibula 1304 is driven to swing backward, and then the bionic tarsometatarsus 1303 is driven to swing forward; when the output shafts of the two groups of power output ends of the bionic foot driving device 1305 rotate counterclockwise, the bionic tibia-fibula 1304 is driven to swing forward, and then the bionic tarsometatarsus 1303 is driven to swing backward; the clockwise and counterclockwise rotation of the output shafts of the two groups of power output ends of the bionic foot driving device 1305 realizes the opening and closing movement of the bionic tarsometatarsus 1303 and the bionic tibia-fibula 1304, and completes the corresponding walking operation.

[0040] like Figure 8 As shown, a supporting device 1112 is installed in front of the bionic foot driving device 1305, and an ultrasonic ranging sensor 12 and an Intel D455 depth camera 11 are respectively installed in front of the supporting device 1112, and the ultrasonic ranging sensor 12 is located below the Intel D455 depth camera 11. The ultrasonic ranging sensor 12, the Intel D455 depth camera 11 and the intelligent concave webbed bionic foot 13 cooperate with each other to monitor the working conditions in real time and transmit the monitoring data to the laptop computer 2 for analysis and processing, adjust the working posture, and ensure the stability and efficiency of information collection.

[0041] like Figures 1 to 5As shown, the support platform 15 is installed on the top of the intelligent concave webbed bionic foot 13 and the support device 1112; two sets of detachable intelligent fertilizer devices 14 are symmetrically installed on the bottom crossbeam of the support platform 15. The detachable intelligent fertilizer devices 14 are used as operation feedback equipment and can be freely replaced with other operation equipment to meet the diverse operation needs such as sowing, fertilizing and spraying, pruning, and harvesting. Figure 5 , 6 As shown in , 7, the detachable intelligent fertilizing device 14 includes a fertilizer box 1401, which provides fertilizer storage and structural support functions; three sets of fertilizer discharge groove wheels 1405 are installed at equal intervals at the bottom of the fertilizer box 1401, and the fertilizer discharge groove wheels 1405 include an external fertilizer discharge groove wheel shell 14051 and an internally installed driving groove wheel 14052; the fertilizer discharge port at the lower part of each fertilizer discharge groove wheel 1405 is correspondingly installed with an adjustable fertilizer discharge pipe 1404, and a fertilizer discharge pipe adjustment motor 14041 is installed on the top of the adjustable fertilizer discharge pipe 1404, and a fertilizer discharge pipe adjustment spring line 14043 is installed at the output end of the fertilizer discharge pipe adjustment motor 14041, and the fertilizer discharge pipe adjustment spring line 14043 is arranged along the fertilizer discharge pipe 14042. A driving motor 1406 is symmetrically installed on the outer side of the bottom of the support plates on both sides of the fertilizer box 1401, an adjustment support module 1402 is installed at the output end of the driving motor 1406, and a binocular structured light 3D camera 1403 is correspondingly installed on the front of the adjustment support module 1402. The three are hinged and coordinated with each other. The binocular structured light 3D camera 1403 can rotate in different directions under the indirect drive of the driving motor 1406 to achieve all-round identification of target crops.

[0042] like Figures 1 to 4As shown, two groups of GreenSeeker detectors 10, two groups of fill lights 16, a hyperspectral imager 6, and a GreenSeeker conversion control device 17 are installed on the middle crossbeam of the support platform 15, which can realize the collection of crop spectrum information and vegetation index information around the clock. The two groups of GreenSeeker detectors 10 are installed symmetrically at the front of the middle crossbeam of the support platform 15 to collect vegetation index information in real time; the hyperspectral imager 6 is installed in the middle position of the middle crossbeam of the support platform 15 to collect spectrum information of the corresponding area in real time; the two groups of fill lights 16 are symmetrically installed on the middle crossbeam of the support platform 15 with the middle vertical plane of the hyperspectral imager 6 lens as the center, which can meet the fill light requirements in weather and time periods with insufficient light; the GreenSeeker conversion control device 17 is installed at the rear of the middle crossbeam of the support platform 15 to realize the conversion, transmission and control of vegetation index collection information. The crop detection data is transmitted to the laptop computer 2 by the hyperspectral imager 6 and the GreenSeeker detector 10. The laptop computer 2 processes and analyzes the data and sends instructions to the fertilizer groove wheel 1405, the adjustable fertilizer pipe 1404 and the drive motor 1406. The drive motor 1406 rotates to control the binocular structured light 3D camera 1403 to identify the near-root part of the target crop. The fertilizer pipe adjustment motor 14041 drives the fertilizer pipe spring wire movement 14043 to drive the fertilizer pipe 14042 to the near-root part. The drive groove wheel 14052 installed inside the fertilizer groove wheel 1405 discharges fertilizer quantitatively according to the instructions, thereby realizing the quantitative fertilization and pesticide application of the fertilizer groove wheel 1405 and the adjustable fertilizer pipe 1404 to the target.

[0043] like Figure 1 As shown, an intelligent identification control device 7, a Beidou navigation system 4, a wind direction sensor 8, a wind speed sensor 9, an energy supply device 5, an energy storage device 3, a laptop computer 2, and a GreenSeeker output control device 1 are installed on the upper crossbeam of the supporting platform 15.

[0044] like Figures 1 to 4As shown, the intelligent recognition control device 7 is installed at the front middle position of the upper crossbeam of the support platform 15, which can realize 360° unlimited rotation, and the upward viewing angle is 180° without blind spots. It is used for real-time monitoring of information collection and feedback of operation conditions, and meets the intelligent and accurate recognition and information upload functions under complex conditions. The Beidou navigation system 4 is installed in the middle and rear part of the upper crossbeam of the support platform 15, located at the rear of the intelligent recognition control device 7, to detect the position information of the robot in real time, and cooperate with the intelligent recognition control device 7 to achieve efficient and accurate operation. The wind direction sensor 8 is installed at the front of the upper crossbeam of the support platform 15, located on the left side of the intelligent recognition control device 7, and can collect wind direction information in real time; the wind speed sensor 9 is installed at the front of the upper crossbeam of the support platform 15, located on the right side of the intelligent recognition control device 7, and can collect wind speed information in real time. The energy supply device 5 is installed at the middle and rear part of the upper crossbeam of the supporting platform 15, and is located on the left side of the Beidou navigation system 4. It obtains solar energy through solar panels and converts it into electrical energy to supply the robot for driving and operation. The remaining energy is stored in the energy storage device 3 in time for emergency use; the energy storage device 3 is installed at the rear part of the upper crossbeam of the supporting platform 15, and is located on the left side of the laptop computer 2, and is used to store electrical energy. The laptop computer 2 is installed at the rear of the upper crossbeam of the supporting platform 15 and at the rear of the Beidou navigation system 4. The laptop computer 2 serves as the brain center of the robot and realizes the intelligent collection, analysis, decision-making and control of the operation information of each link. A multiple input multiple output deep convolutional neural network (MIMO-DCNN) model is installed inside the laptop computer 2. The network model integrates Beidou satellite information, image information, climate information, location information, distance information, crop phenotype information and other multimodal information, and realizes the robot's intelligent walking, recognition, detection, decision-making and feedback to a certain extent; the GreenSeeker output control device 1 is installed at the rear of the upper crossbeam of the supporting platform 15 and at the right side of the laptop computer 2. It collects and analyzes vegetation index information in real time and transmits it to the laptop computer 2.

[0045] The method for realizing intelligent detection and feedback of crop information by using the above-mentioned webbed-foot bionic robot based on intelligent detection and feedback of crop information comprises the following process:

[0046] Step 1: Initial data collection.

[0047] After being powered on and preheated for a period of time, the robot collects Beidou satellite information, image information, climate information, location information, distance information, crop phenotypic information and other data in real time through the Beidou navigation system 4, intelligent recognition control device 7, wind direction sensor 8, wind speed sensor 9, ultrasonic ranging sensor 12, depth camera 11, binocular structured light 3D camera 1403 and other intelligent devices, analyzes and identifies and obtains more comprehensive perception information of the farmland environment and target crops, and collects initial data for the robot operation.

[0048] Step 2: Walking drive and posture adjustment.

[0049] The initial data of the farmland environment and target crops are transmitted to the laptop computer 2 through the communication system for real-time analysis and decision-making. The laptop computer 2 uses the internally trained Multiple Input Multiple Output Deep Convolutional Neural Network (MIMO-DCNN) model to input data from multiple sensors or information sources into the model, and obtains the optimal walking path and optimal working posture based on the output results, thereby driving the intelligent concave webbed bionic foot 13 to walk according to the corresponding route and work in the corresponding posture. Through multimodal information fusion technology, the robot can realize functions such as autonomous navigation, path planning, precise operation, and obstacle avoidance.

[0050] Step 3: Real-time data collection, transmission and analysis.

[0051] During the walking process, the Beidou navigation system 4, intelligent recognition control device 7, wind direction sensor 8, wind speed sensor 9, ultrasonic ranging sensor 12, depth camera 11, binocular structured light 3D camera 1403 and other intelligent devices carried by the robot work synchronously, collect relevant information about the surrounding environment and target crops in real time, and update the fused multimodal information in time to ensure the best walking route and working posture; at the same time, the hyperspectral imager 6 and GreenSeeker detector 10 collect and detect farmland information such as crop growth status, pest and disease conditions in real time, and transmit the corresponding data to the Multiple Input Multiple Output Deep Convolutional Neural Network (MIMO-DCNN) model trained inside the laptop computer 2 through the communication system for real-time processing and analysis to make the best decision. Under the premise of fusing multimodal information, the robot can accurately detect and identify the target crop, move to the most accurate position from the target crop, and adjust to the best working posture to prepare for subsequent operations.

[0052] Step 4: Information feedback and control of corresponding component operations.

[0053] According to the solution results of multimodal information fusion, the laptop computer 2 sends instructions to the detachable intelligent fertilization device 14 to control the detachable intelligent fertilization device 14 to accurately target and quantitatively apply fertilizers and pesticides; at the same time, the laptop computer 2 also feeds back the collected data to relevant personnel through Internet connection or other means, providing crop information and suggestions for their decision-making and management.

[0054] Of course, the above description is not limited to the above examples. Technical features not described in the present invention can be achieved by or by using existing technologies, which will not be described here. The above embodiments and drawings are only used to illustrate the technical scheme of the present invention and are not limitations of the present invention. The present invention is described in detail with reference to the preferred implementation methods. Ordinary technicians in this field should understand that changes, modifications, additions or substitutions made by ordinary technicians in this technical field within the essential scope of the present invention do not depart from the purpose of the present invention, and should also fall within the scope of protection of the claims of the present invention.

Claims

1. A webbed-foot bionic robot based on intelligent detection and feedback of crop information, characterized in that: The invention comprises a laptop computer (2) installed on a support platform (15) for realizing intelligent collection, analysis, decision-making and control of operation information, wherein an intelligent concave webbed bionic foot (13) is installed below the support platform (15), and the intelligent concave webbed bionic foot (13) is driven to walk by a bionic foot driving device (1305) at the top thereof, and an ultrasonic distance measuring sensor (12) and a depth camera (11) are installed at the front of the bionic foot driving device (1305); a detachable intelligent fertilization device (14) is symmetrically installed on the bottom crossbeam of the support platform (15), and a GreenSeeker detector (10), a fill light (16), a hyperspectral imager (6), and a GreenSeeker conversion control device (17) are installed on the middle crossbeam of the support platform (15); and an intelligent identification control device (7), a Beidou navigation system (4), a wind direction sensor (8), a wind speed sensor (9), an energy supply device (5), an energy storage device (3), and a GreenSeeker output control device (1) are installed on the upper crossbeam of the support platform (15); The detachable intelligent fertilizing device (14) comprises a fertilizer box (1401), three groups of fertilizer discharge groove wheels (1405) are installed at the bottom of the fertilizer box (1401), and the fertilizer discharge groove wheels (1405) include an external fertilizer discharge groove wheel shell (14051) and an internally installed driving groove wheel (14052); the fertilizer discharge port at the bottom of each fertilizer discharge groove wheel (1405) is correspondingly installed with an adjustable fertilizer discharge pipe (1404), the top of the adjustable fertilizer discharge pipe (1404) is installed with a fertilizer discharge pipe adjustment motor (14041), the output end of the fertilizer discharge pipe adjustment motor (14041) is installed with a fertilizer discharge pipe adjustment spring wire (14043), and the fertilizer discharge pipe adjustment spring wire (14043) is arranged along the fertilizer discharge pipe (14042); The bottom outer sides of the support plates on both sides of the fertilizer box (1401) are symmetrically mounted with drive motors (1406); an adjustment support module (1402) is mounted on the output end of the drive motor (1406); a binocular structured light 3D camera (1403) is correspondingly mounted on the front of the adjustment support module (1402); the three are hinged to each other; the binocular structured light 3D camera (1403) rotates in different directions under the indirect drive of the drive motor (1406) to realize all-round recognition of target crops; The four groups of intelligent concave webbed bionic feet (13) are respectively installed at the four corners of the support platform (15), and the intelligent concave webbed bionic feet (13) include a bionic concave webbed (1302) at the bottom, and a plurality of bionic phalanges (1301) are installed on the upper part of the bionic concave webbed (1302), and the bionic phalanges (1301) are hollow structures; the bionic phalanges (1301) are hinged to two groups of bionic tarsometatarsals (1303), and the two groups of bionic tarsometatarsals (1303) are respectively hinged to two groups of bionic tibia-fibula (1304), and the two groups of bionic tibia-fibula (1304) are respectively connected to two groups of power output ends of the bionic foot driving device (1305) through a gear structure; When the output shafts of the two groups of power output ends of the bionic foot driving device (1305) rotate clockwise, the bionic tibia-fibula (1304) is driven to swing backward, thereby driving the bionic tarsometatarsus (1303) to swing forward; when the output shafts of the two groups of power output ends of the bionic foot driving device (1305) rotate counterclockwise, the bionic tibia-fibula (1304) is driven to swing forward, thereby driving the bionic tarsometatarsus (1303) to swing backward; The operation method of the webbed-foot bionic robot based on crop information intelligent detection and feedback includes the following processes: Step 1: After being powered on and preheated for a period of time, the robot collects Beidou satellite information, image information, climate information, location information, distance information, and crop phenotype information data in real time through the Beidou navigation system (4), intelligent recognition control device (7), wind direction sensor (8), wind speed sensor (9), ultrasonic ranging sensor (12), depth camera (11), and binocular structured light 3D camera (1403) carried by the robot, analyzes and identifies and obtains the perception information of the farmland environment and target crops, and collects initial data for the robot operation; Step 2: The initial data is transmitted to the laptop computer (2) for real-time analysis and decision-making. The laptop computer (2) uses the internally trained multi-input multi-output deep convolutional neural network model to input data from multiple sensors or information sources into the model, and obtains the optimal walking path and the optimal working posture based on the output results, thereby controlling the output shafts of the two power output ends of the bionic foot drive device (1305) to rotate clockwise and counterclockwise respectively, realizing the opening and closing movement of the bionic tarsometatarsus (1303) and the bionic tibia-fibula (1304), and driving the intelligent concave webbed bionic foot (13) to walk according to the corresponding route and work according to the corresponding posture; the laptop computer (2) controls the robot to realize autonomous navigation, path planning, precise operation, and obstacle avoidance functions through multimodal information fusion technology; Step 3: During the walking process, the robot continues to collect relevant information about the surrounding environment and target crops in real time and updates the multimodal information. At the same time, the hyperspectral imager (6) and the GreenSeeker detector (10) collect and detect farmland information including crop growth status and pest and disease conditions in real time, and transmit the corresponding data to the multi-input multi-output deep convolutional neural network model trained inside the laptop computer (2) for real-time processing and analysis to make the best decision. The laptop computer (2) fuses the multimodal information, detects and identifies the target crops, controls the robot to move to the target position, and adjusts to the best working posture to prepare for subsequent operations. Step 4: Based on the solution of the multimodal information fusion, the laptop computer (2) sends instructions to the detachable intelligent fertilization device (14) to control the detachable intelligent fertilization device (14) to accurately target and quantitatively fertilize and apply pesticides; at the same time, the laptop computer (2) also feeds back the collected data to relevant staff in real time.

2. The webbed-foot bionic robot based on intelligent detection and feedback of crop information according to claim 1, characterized in that: The GreenSeeker detector (10) is symmetrically installed on the front of the middle crossbeam of the support platform (15) for real-time collection of vegetation index information; the hyperspectral imager (6) is used to collect spectral information of the corresponding area in real time; the fill light (16) is symmetrically installed on the middle crossbeam of the support platform (15) with the vertical plane of the hyperspectral imager (6) lens as the center, to meet the fill light demand in weather and time periods with insufficient light; the GreenSeeker conversion control device (17) is used to realize the conversion, transmission and control of vegetation index collection information.

3. The webbed-foot bionic robot based on intelligent detection and feedback of crop information according to claim 1, characterized in that: The intelligent identification control device (7) is capable of 360° unlimited rotation and has an upward viewing angle of 180° without blind spots, and is used for real-time monitoring of information collection and feedback of operation conditions; the Beidou navigation system (4) is used for real-time detection of the robot's position information; the wind direction sensor (8) is used for real-time collection of wind direction information; the wind speed sensor (9) is used for real-time collection of wind speed information; the energy supply device (5) obtains solar energy through a solar panel and converts it into electrical energy to supply the robot with driving and operation, and the remaining energy is stored in the energy storage device (3); the energy storage device (3) is used to store electrical energy; the GreenSeeker output control device (1) is used for real-time collection and analysis of vegetation index information, and transmits it to a laptop computer (2).

4. The webbed-foot bionic robot based on intelligent detection and feedback of crop information according to claim 1, characterized in that: The laptop computer (2) is internally installed with a multi-input and multi-output deep convolutional neural network model, which integrates multimodal information including Beidou satellite information, image information, climate information, location information, distance information, and crop phenotype information to achieve intelligent walking, recognition, detection, decision-making and feedback of the robot.

5. The webbed-foot bionic robot based on intelligent detection and feedback of crop information according to claim 1, characterized in that: The hyperspectral imager (6) and the GreenSeeker detector (10) transmit the crop detection data to the laptop computer (2), which processes and analyzes the data and then sends instructions to the fertilizer groove wheel (1405), the adjustable fertilizer discharge pipe (1404) and the drive motor (1406). The drive motor (1406) rotates to control the binocular structured light 3D camera (1403) to identify the near-root part of the target crop. The fertilizer discharge pipe adjustment motor (14041) drives the fertilizer discharge pipe spring wire to move (14043), thereby driving the fertilizer discharge pipe (14042) to the near-root part. The fertilizer groove wheel (1405) discharges fertilizer quantitatively according to the instructions, thereby realizing the fertilizer groove wheel (1405) and the adjustable fertilizer discharge pipe (1404) to quantitatively fertilize and apply fertilizer to the target.