System, method and device for monitoring alien invasive plants

What is AI technical title?
AI technical title is built by Patsnap AI team. It summarizes the technical point description of the patent document.
By designing an alien invasive plant monitoring system that integrates image acquisition, location acquisition, walking drive and deep convolutional neural network processing, the problem of monitoring of invasive plants in the plantation area is solved, efficient and accurate monitoring and identification is achieved, and labor costs and labor volume are reduced.

CN119810653AInactive Publication Date: 2025-04-11GUIYANG UNIV

View PDF 0 Cites 0 Cited by

Patent Information

Application Number: CN202411872303.2
Authority / Receiving Office: CN · China
Patent Type: Applications(China)
Current Assignee / Owner
Filing Date: 2024-12-18
Publication Date: 2025-04-11
Estimated Expiration: Not applicable · inactive patent

AI Technical Summary

Technical Problem

The prior art is difficult to effectively monitor and identify invasive plants in plantations, resulting in serious harm to the seedlings in the park.

Method used

A monitoring system for invasive foreign plants is designed, including an image acquisition device, a position acquisition device, a walking drive device and a host device. The acquired image information is processed using a deep convolutional neural network to determine whether there are invasive foreign plants, and the monitoring results are displayed through a visual display device.

Benefits of technology

It has achieved efficient monitoring of invasive plants in the plantation area, reduced labor and labor costs, improved monitoring efficiency, and ensured the safety of seedlings in the park.

✦ Generated by Eureka AI based on patent content.

Smart Images

Figure CN119810653A_ABST

Patent Text Reader

Abstract

The invention relates to the technical field of alien plant invasion monitoring, in particular to an alien invasive plant monitoring system, method and device, and the system comprises an image obtaining device which is used for obtaining the image information of a target area; the position acquisition device is used for acquiring real-time position information of the image acquisition device; the walking driving device is used for driving the image acquisition device and the position acquisition device to move and assisting the image acquisition device in acquiring image information of different target areas; the input end of the host device is connected with the image acquisition device and the position acquisition device, and the host device is used for receiving the image information of the image acquisition device and the position information of the position acquisition device and can automatically monitor foreign plants in the planting park; and the position of the region corresponding to the alien invasive plant can be displayed through the display module, so that the searching efficiency of personnel is greatly improved, and the planting cost is saved.

Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of alien plant invasion monitoring, and in particular to an alien invasive plant monitoring system, a monitoring method and a device. Background Art

[0002] Yunnan, Guizhou, Sichuan and other places are prone to invasive alien species. For example, the well-known invasive alien species Eupatorium adenophorum in Yunnan has no natural enemies in the local area. Cattle and sheep will be immediately poisoned if they eat it. Humans who are cut by it will also develop allergic diseases. Moreover, it has strong adaptability to the environment. It can survive in arid and barren land or narrow crevices. Of course, there are other invasive alien species, such as Eichhornia crassipes, Alternanthera philoxeroides, Mikania micrantha, Tithonia divaricata, Morning glory, Lantana camara, and Bidens pilosa. These invasive species have caused serious harm to the local ecological environment.

[0003] Yunnan, Guizhou, Sichuan and other places are rich in fruits, such as peaches, plums, apples, etc. However, for peach orchards and plum orchards where early seedlings are cultivated, since the seedlings are small and have weak competitiveness, once alien invasive species appear and cannot be discovered and dealt with in time, they will cause serious harm to the seedlings in the orchard. Based on the above situation, it is necessary to design a monitoring system, monitoring method and device for alien invasive plants to solve the above problems. Summary of the invention

[0004] The present invention provides a monitoring system, a monitoring method and a device for invasive alien plants, which can automatically monitor the interior of a plantation area for invasive alien plants and can display the location of a target area corresponding to the invasive alien plants through a display module, thereby greatly improving the efficiency of personnel searches and saving planting costs.

[0005] The technical problem solved by the present invention is achieved by adopting the following technical solutions:

[0006] A monitoring system for invasive alien plants includes an image acquisition device for acquiring image information of a target area;

[0007] A position acquisition device, used to acquire the real-time position information of the image acquisition device;

[0008] A travel drive device, used to drive the image acquisition device and the position acquisition device to move, and assist the image acquisition device to acquire image information of different target areas;

[0009] A host device, wherein an input end of the host device is connected to the image acquisition device and the position acquisition device, and is used to receive image information from the image acquisition device and position information from the position acquisition device; an output end of the host device is connected to the image acquisition device and the travel drive device, and is used to control the image acquisition device to capture images and control the travel drive device to move to a next target area;

[0010] The host device has an image classification unit, which processes the image information of the image acquisition device through a trained deep convolutional neural network and determines whether there are alien invasive plants in the image information.

[0011] Preferably, it also includes a visualization display device, which is connected to the output end of the host device and is used to display the processing result of the host device on the image information and the position information corresponding to the image information.

[0012] Preferably, the travel drive device includes a path track and a driving trolley installed on the path track and capable of moving along the extension direction of the path track, the image acquisition device and the position acquisition device are both installed on the driving trolley, and the driving trolley is controlled and operated by a host device.

[0013] A method for monitoring invasive alien plants, the method comprising:

[0014] An acquisition step, acquiring position information and picture information of different target areas by an image acquisition device and a position acquisition device;

[0015] In the processing step, the trained deep convolutional neural network is used to process the image information of target areas at different locations, and to determine whether there are invasive alien plants in each target area.

[0016] Preferably, the method further includes a display step for displaying the image information processing results and corresponding position information of different target areas.

[0017] Preferably, the acquisition of the position information and picture information of different target areas is achieved by the driving trolley driving the image acquisition device and the position acquisition device to move to different target areas on a path track.

[0018] A monitoring device for invasive alien plants, comprising:

[0019] An acquisition module, used for receiving position information and picture information of different target areas sent by the image acquisition device and the position acquisition device;

[0020] The processing module processes the received image information through a trained deep convolutional neural network and determines whether there are any invasive alien plants in the image information.

[0021] Preferably, it also includes a display module for displaying the image information processing results and corresponding position information of different target areas.

[0022] Preferably, the position information and picture information of different target areas are achieved by the driving trolley driving the image acquisition device and the position acquisition device to move to different target areas on the path track.

[0023] The beneficial effect of the present invention is that by acquiring images of each target area in the plantation area and processing the image information of the area, it is possible to determine whether there are alien invasive plants in the area, thereby realizing the monitoring of alien invasive plants in the plantation area, greatly reducing the workload and saving labor costs.

[0024] By displaying the processed image information results and the corresponding location information through a visual display device, it is possible to manually deal with alien invasive plants at a fixed point, saving personnel searching time.

[0025] By setting up a walking drive device consisting of a path track and a driving trolley, and the driving trolley is controlled and operated by a host device, the image acquisition device can acquire images of different target areas. At the same time, the path track can enable the image acquisition device to be in a stable shooting state when acquiring images. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0027] Figure 1 The schematic diagram of the structure of the monitoring system of the present invention is as follows:

[0028] Figure 2 It is a circuit principle block diagram of the monitoring system of the present invention;

[0029] Figure 3 is a flow chart of the steps of the monitoring method of the present invention;

[0030] Figure 4 It is a structural block diagram of the monitoring device of the present invention.

[0031] In the figure, 1, plantation area; 2, fruit tree seedlings; 3, image acquisition device; 4, driving vehicle; 5, position acquisition module; 6, path track; 7, host device; 701, image classification unit; 8, visualization display device; 9, walking drive device. DETAILED DESCRIPTION

[0032] In order to make the technical means, creative features, objectives and effects achieved by the present invention easy to understand, the present invention is further explained below with reference to specific diagrams.

[0033] refer to Figure 1 In a plantation area 1, fruit tree seedlings 2 are planted. Conventionally, in order to avoid the invasion of alien plants (non-planted plants, wild weeds, or shrubs), regular inspections of the plantation area 1 are often carried out manually. Since the area of the plantation area 1 is large and the labor cost is high, this method is less economical and has a lower monitoring efficiency. Based on this, in a first aspect, the present invention provides a monitoring system for alien invasive plants, which is used in the plantation area 1. The system includes: an image acquisition device 3, which is used to acquire image information of a target area; a position acquisition device 5, which is used to acquire real-time position information of the image acquisition device 3; a walking drive device 9, which is used to drive the image acquisition device 3 and the position acquisition device 5 to move. The auxiliary image acquisition device 3 acquires image information of different target areas; the host device 7, the input end of the host device 7 is connected with the image acquisition device 3 and the position acquisition device 5, and is used to receive the image information of the image acquisition device 3 and the position information of the position acquisition device 5, and the output end of the host device 7 is connected with the image acquisition device 3 and the walking drive device 9, and is used to control the image acquisition device 3 to take images and control the walking drive device 9 to move to the next target area; the host device 7 has an image classification unit 701, and the image classification unit 701 processes the image information of the image acquisition device 3 through a trained deep convolutional neural network, and determines whether there are alien invasive plants in the image information.

[0034] The image acquisition device 3 is a camera located above the ground in the plantation area 1, which can take pictures of the target area in the plantation area 1. Figure 1 In the example, the plantation area 1 is divided into a plurality of target areas of equal and connected areas. The target area can be a rectangle of two meters in length and two meters in width, such as area A1, area A2, area A3, area A4, and so on. Figure 1 In the embodiment, a rectangular shape is used for division, but the actual division process can also be performed in other shapes for equal area division. The image acquisition device 3 takes pictures of target areas such as area A1, area A2, area A3, and area A4 respectively to obtain image information of the corresponding target areas and sends it to the host device 7. It should be noted that in order to ensure that the plantation area 1 can be monitored in all directions, the photographing area of the image acquisition device 3 should be greater than or equal to the area of the current target area. The photographing area can be as follows: Figure 1In the figure, the S1 area and the S2 area are shown as a circular shooting area with a radius of two meters. Since the shooting area is larger than the target area, there will be some overlap in the shooting area, but it also ensures that the planting area 1 can be monitored in all directions. Of course, it can also be achieved by overlapping the shooting area and the target area. For example, the S1 shooting area has the same shape and area as the A1 shooting area, and S1 just covers A1. This method can reduce the picture information as much as possible, thereby reducing the information processing amount of the host device 7. When the image acquisition device 3 finishes shooting in the A1 area and moves to the A2 area, it is achieved through the travel drive device 9. The operation of the travel drive device 9 is controlled by the host device 7 to achieve automatic operation without human control.

[0035] The process of the host device 7 controlling the walking drive device 9 and the image acquisition device 3 to work is as follows: first, the host device 7 receives an instruction to monitor foreign plants in the planting area 1. The host device 7 first obtains the current position of the walking drive device 9 according to the information of the current position acquisition device 5. The position acquisition device 5 is a position sensor. The host device 7 determines whether the current walking drive device 9 is a suitable area for taking pictures. If it is in an area that is not suitable for taking pictures (the walking drive device 9 is not at the center point of the target area), the walking drive device 9 is controlled to move to the nearest center point of the target area. When the walking drive device 9 reaches the center point of the target area, the host device 7 controls the walking drive device 9 to stop running, and controls the image acquisition device 3 to take pictures of the target area. When the host device 7 receives an image signal of the current target area, the walking drive device 9 is controlled to move to the next target area, and this cycle is repeated until images of all target areas are obtained. It should be further explained that since the area of the planting area 1 is large, the host device 7 and the image acquisition device 3, the position acquisition device 5 and the walking drive device 9 are preferably connected by wireless communication.

[0036] It should be further explained that the host device 7 also has an image classification unit 701 capable of processing the acquired image, wherein the image classification unit 701 mainly uses the trained deep convolutional neural network to classify the acquired image. In the deep convolutional neural network training process, the images with alien plant invasion and the images without alien plant invasion are combined and divided into a training set and a test set, wherein the images in the training set and the test set are both assigned labels, and the labels include labels with alien plant invasion and labels without alien plant invasion. The deep convolutional neural network is trained by the training set, and then the test set is used to test whether the deep convolutional neural network can meet the expected standard. If the expected standard cannot be met, the deep convolutional neural network is adjusted, and the adjusted deep convolutional neural network is retested with the test set until the expected standard is met. The principle of using a deep convolutional neural network to classify images is a prior art, and it is not part of the innovation of the present invention, and will not be elaborated on in detail here. Therefore, after the host device 7 processes the received image information, the image information will be divided into one of the categories of having an alien plant invasion label and not having an alien plant invasion.

[0037] Furthermore, in order to facilitate personnel to query the monitoring results and to carry out targeted management of specific areas where alien plant invasions occur based on the monitoring results, the system also includes a visual display device 8, which is connected to the output end of the host device 7, and is used to display the processing results of the host device 7 on the image information and the location information corresponding to the image information. The location information output by the host device 7 can be displayed by naming the target area (A1 area, A2 area, A3 area, etc.) so that the staff can understand it, that is, the output result is that alien plant invasion occurs in area A1, and there is no alien plant invasion in area A2, etc. Since the visual display device 8 is generally set at a position close to the host device 7, it is more reliable for the two to communicate by wire. Of course, the host device 7 can also be connected to other devices by wireless communication, such as a mobile phone, etc., to receive the monitoring result data sent by the host device 7.

[0038] Specifically, in order to ensure the high consistency of the image acquisition device 3 when taking pictures, and to be able to accurately position it, and the photographing process is in a stable state, the travel drive device 9 is implemented in the following manner: the travel drive device 9 includes a path track 6 and a driving trolley 4 installed on the path track 6 and capable of moving along the extension direction of the path track 6. The image acquisition device 3 and the position acquisition device 5 are both installed on the driving trolley 4, and the driving trolley 4 is controlled and operated by the host device 7, that is, the host device 7 controls the operation of the driving trolley 4 in real time through the position signal.

[0039] In a second aspect, the present invention also provides a method for monitoring invasive alien plants, which is used in a plantation area. The method comprises:

[0040] Acquisition step, acquiring position information and picture information of different target areas through the image acquisition device 3 and the position acquisition device 5;

[0041] In the processing step, the trained deep convolutional neural network is used to process the image information of target areas at different locations, and to determine whether there are invasive alien plants in each target area.

[0042] Furthermore, the method further includes a display step for displaying the picture information processing results and corresponding position information of different target areas.

[0043] Furthermore, the location information and picture information of different target areas are obtained by driving the trolley 4 to drive the image acquisition device 3 and the location acquisition device 5 to move to different target areas on the path track 6.

[0044] In a third aspect, the present invention further provides a monitoring device for invasive alien plants, comprising:

[0045] An acquisition module, used for receiving position information and picture information of different target areas sent by the image acquisition device 3 and the position acquisition device 5;

[0046] The processing module processes the received image information through a trained deep convolutional neural network and determines whether there are any invasive alien plants in the image information.

[0047] Furthermore, it also includes a display module for displaying the image information processing results and corresponding position information of different target areas.

[0048] Furthermore, the position information and picture information of different target areas are obtained by driving the trolley 4 to drive the image acquisition device 3 and the position acquisition device 5 to move to different target areas on the path track 6 .

[0049] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments, and the above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, and these changes and improvements fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. A monitoring system for invasive alien plants, used in a plantation area (1), wherein the plantation area (1) is divided into a plurality of connected target areas, characterized in that: The system comprises: An image acquisition device (3) is used to acquire image information of a target area; A position acquisition device (5) is used to acquire the real-time position information of the image acquisition device (3); A travel drive device (9) is used to drive the image acquisition device (3) and the position acquisition device (5) to move, and to assist the image acquisition device (3) in acquiring image information of different target areas; A host device (7), wherein an input end of the host device (7) is connected to an image acquisition device (3) and a position acquisition device (5) and is used to receive image information from the image acquisition device (3) and position information from the position acquisition device (5); an output end of the host device (7) is connected to the image acquisition device (3) and a travel drive device (9) and is used to control the image acquisition device (3) to capture images and to control the travel drive device (9) to move to a next target area; The host device (7) has an image classification unit (701), which processes the image information of the image acquisition device (3) through a trained deep convolutional neural network and determines whether there are invasive alien plants in the image information.

2. The monitoring system for invasive alien plants according to claim 1, characterized in that: It also comprises a visual display device (8), which is connected to the output end of the host device (7) and is used to display the processing result of the host device (7) on the image information and the position information corresponding to the image information.

3. The monitoring system for invasive alien plants according to claim 1, characterized in that: The travel drive device (9) comprises a path track (6) and a driving trolley (4) mounted on the path track (6) and capable of moving along the extension direction of the path track (6); the image acquisition device (3) and the position acquisition device (5) are both mounted on the driving trolley (4); and the driving trolley (4) is controlled and operated by a host device (7).

4. A method for monitoring invasive alien plants, used in a plantation area (1), wherein the plantation area (1) is divided into a plurality of connected target areas, characterized in that: The method comprises: An acquisition step, in which the positions of different target areas are acquired by an image acquisition device (3) and a position acquisition device (5) Information and screen information; In the processing step, the trained deep convolutional neural network is used to process the image information of target areas at different locations, and to determine whether there are invasive alien plants in each target area.

5. The method for monitoring invasive alien plants according to claim 4, characterized in that: The method also includes a display step for displaying the picture information processing results and corresponding position information of different target areas.

6. The method for monitoring invasive alien plants according to claim 4, characterized in that: The acquisition of position information and picture information of different target areas is achieved by the driving trolley (4) driving the image acquisition device (3) and the position acquisition device (5) to move to different target areas on the path track (6).

7. A monitoring device for invasive alien plants, characterized in that: include; An acquisition module, used for receiving position information and picture information of different target areas sent by the image acquisition device (3) and the position acquisition device (5); The processing module processes the received image information through a trained deep convolutional neural network and determines whether there are any invasive alien plants in the image information.

8. The monitoring device for invasive alien plants according to claim 7, characterized in that: It also includes a display module for displaying the picture information processing results and corresponding position information of different target areas.

9. The monitoring device for invasive alien plants according to claim 7, characterized in that: The position information and picture information of different target areas are obtained by the driving vehicle (4) driving the image acquisition device (3) and the position acquisition device (5) to move to different target areas on the path track (6).