Environmental problem identification method and system for rivers and lakes

By collecting water bodies images by drones and using AI recognition modules for image comparison, the problem of inefficient water bodies recognition in the existing technology is solved, and efficient and accurate water bodies environmental problems are achieved.

CN112113541BActive Publication Date: 2025-04-29HUBEI JUNBANG ENVIRONMENTAL TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202010920103.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-09-04
Publication Date
2025-04-29
Estimated Expiration
2040-09-04

AI Technical Summary

Technical Problem

The prior art is inefficient in identifying environmental problems of lakes, rivers and surrounding water bodies, and the existing artificial intelligence identification system is not suitable for water body environment identification.

Method used

The drone has an image acquisition device and a satellite positioning device for cruise, collects water bodies images in real time, and compares images through the comparison module of the AI ​​recognition module and the microprocessor to determine whether there are environmental problems and generate a document report.

Benefits of technology

It realizes efficient identification of lakes, rivers and their surrounding water environments, reduces the labor intensity of staff, and improves the accuracy and efficiency of identification.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112113541B_ABST
    Figure CN112113541B_ABST
Patent Text Reader

Abstract

The present invention relates to a method and system for identifying environmental problems of rivers and lakes, and to the technical field of environmental problem identification. It includes real-time acquisition of water body images of rivers and lakes, the water body images are collected by an image acquisition device on a drone, and the water body images include a first water body image, a second water body image, and a third water body image taken in chronological order; the Lab value of the first water body image is compared with the Lab value of the second water body image to obtain a first Lab value comparison result; it is determined whether the first Lab value comparison result exceeds a preset allowable error range, and when the first Lab value comparison result exceeds the allowable error range, the real-time position information of the drone at this time and the second water body image are used to generate a standardized document, and the document is used to display the environmental problems existing in rivers and lakes. The present invention has the advantage of being able to identify the water environment of lakes, rivers and their surroundings.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of environmental problem identification, and in particular to a method and system for identifying environmental problems of rivers and lakes. Background Art

[0002] There are many different environmental problems in lakes, rivers and their surrounding areas. Even the most easily identifiable outlets have different shapes, apertures and colors. Existing technologies are of little or no help in identifying environmental problems in lakes and rivers.

[0003] When identifying and judging environmental problems existing in lakes, rivers and their surrounding environments, the existing technology mainly uses manual patrols to conduct on-site environmental identification in the early stage, and then uses drones to shoot videos and play them back in areas that cannot be reached by manpower in the later stage, and then manually identifies the water environment of rivers and lakes in the video by judging the video content. The above-mentioned existing technical solutions are time-consuming, labor-intensive and inefficient. Therefore, it is a very meaningful project to use artificial intelligence recognition technology to identify and judge problems existing in lakes, rivers and their surrounding environments.

[0004] At present, the existing artificial intelligence recognition systems are mainly used in two directions: face recognition and fixed-point straw burning monitoring. The technologies in these two directions are relatively fixed in terms of the content that artificial intelligence recognition technology needs to recognize, and the form is relatively simple. For example, face recognition technology mainly focuses on fixed recognition of face shape, pupils and other parts; straw burning monitoring mainly focuses on fixed recognition of the color of rising smoke (most of the smoke is white). The above-mentioned existing technical solutions are not suitable for the recognition of lakes, rivers and their surrounding environments.

[0005] A Chinese patent with publication number CN110647650A has been retrieved, which discloses a method and system for identifying a sea and lake environment in an offshore basin, including: judging whether the image of the nth stratum in the core image has a typical marine sedimentary structure, and obtaining a first sedimentary environment result; judging whether the relative sea level change curve of the nth stratum is consistent with the change trend of the global sea level change curve, and obtaining a second sedimentary environment result; judging whether the geochemical parameter value of the sedimentary rock sample is within the preset geochemical parameter range, and obtaining a third sedimentary environment result; judging whether the biological fossils in the nth stratum have marine ecological characteristics, and obtaining a fourth sedimentary environment result; comprehensively analyzing the first sedimentary environment result, the second sedimentary environment result, the third sedimentary environment result and the fourth sedimentary environment result to determine the sea and lake environment identification result of the offshore basin, and the sea and lake environment identification result of the offshore basin is a sea basin, a land basin or a relict lake basin.

[0006] The above-mentioned environment identification method and system are mainly used to identify the sea and lake environment of offshore basins, and cannot identify the water environment of lakes, rivers and their surrounding areas. Summary of the invention

[0007] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a method for identifying environmental problems of rivers and lakes, which has the advantage of being able to identify the water environment of lakes, rivers and their surrounding areas.

[0008] The above-mentioned object of the present invention is achieved through the following technical solutions:

[0009] A method for identifying environmental problems of rivers and lakes, the method comprising:

[0010] Acquire water body images of rivers and lakes in real time, wherein the water body images are acquired by an image acquisition device on a drone, and the water body images include a first water body image, a second water body image, and a third water body image captured in chronological order;

[0011] Compare the Lab value of the first water body image with the Lab value of the second water body image to obtain a first Lab value comparison result;

[0012] Determine whether the first Lab value comparison result exceeds the preset allowable error range, and when the first Lab value comparison result exceeds the allowable error range, generate a document in a standardized format using the real-time position information of the drone and the second water body image at this time, wherein the document is used to display the environmental problems existing in rivers and lakes.

[0013] By adopting the above technical solution, the drone can cruise with an image acquisition device and a satellite positioning device, the GPS can transmit the location of the drone in real time, thereby reflecting the areas where environmental problems exist in lakes and rivers, the image acquisition device can be used to acquire images, the comparison module of the AI ​​recognition module can be used to compare images, the microprocessor of the AI ​​recognition module can determine whether there are environmental problems in the images taken by the drone based on the comparison results of the comparison module, and the report generation module can generate a document report for the problematic images. In this way, with the joint action of the drone, the AI ​​recognition module and the report generation module, the present application can identify the water environment of lakes, rivers and their surrounding areas, thereby reducing the labor intensity of the staff.

[0014] In a preferred example, the present invention can be further configured to, when the first Lab value comparison result exceeds the allowable error range, compare the Lab value of the second water body image with the Lab value of the standard water body image in the standard image library module to obtain a second Lab value comparison result, determine whether the second Lab value comparison result exceeds a preset allowable error range, and when the second Lab value exceeds the allowable error range, generate a standardized document of the real-time position information of the drone at this time and the second water body image.

[0015] By adopting the above-mentioned technical solution, the present application compares the second water body image captured by the image acquisition device with the standard water body image, so that the microprocessor can more accurately determine whether the image captured by the image acquisition device has environmental problems, and thus the report displayed by the report generation module is more accurate.

[0016] In a preferred example, the present invention can be further configured to include, before generating a document report: comparing the Lab value of the second water body image with the Lab values ​​of each image in the later image supplement module, determining whether the third Lab value comparison result is within a preset error range, and when the third Lab value comparison result is within the error range, generating a document in the format of the real-time position information of the drone at this time and the second water body image.

[0017] By adopting the above-mentioned technical scheme, the images in the late image supplement module of the present invention can be added by workers in the later process of using the present recognition system. When the workers believe that there are environmental problems in the water environment of a lake or river and its surrounding areas, the images collected by the workers later can be entered into the late image supplement module. If the Lab value of the image taken by the drone is basically the same as the Lab value of the image in the late image supplement module or is within the allowable error range, it means that there are environmental problems in the water image taken by the drone.

[0018] In a preferred example, the present invention can be further configured as follows: when the third Lab value comparison result exceeds the allowable error range, the Lab value of the third water body image is compared with the Lab value of the standard water body image to obtain a fourth Lab value comparison result, and it is determined whether the fourth Lab value comparison result exceeds a preset allowable error range. When the fourth Lab value comparison result exceeds the allowable error range, a standardized document is generated for the real-time position information of the drone at this time and the third water body image.

[0019] By adopting the above-mentioned technical solution, the present application compares the third water body image captured by the image acquisition device with the standard water body image, so that the microprocessor can more accurately determine whether the image captured by the image acquisition device has environmental problems, and thus the report displayed by the report generation module is more accurate.

[0020] The second object of the present invention is achieved through the following technical solutions:

[0021] A system for identifying environmental problems in rivers and lakes, comprising a drone, an AI identification module and a report generation module, wherein the drone is equipped with an image acquisition device and a satellite positioning device, and the AI ​​identification module comprises a comparison module and a microprocessor;

[0022] The satellite positioning device is used to send the real-time position information of the UAV during cruising to the microprocessor;

[0023] The image acquisition device is used to collect water images of rivers and lakes taken by the drone during cruising in real time, and send the water images to the comparison module and the microprocessor, wherein the water images include a first water image and a second water image taken in chronological order;

[0024] The comparison module is used to receive the first water body image and the second water body image from the image acquisition device, compare the Lab value of the second water body image with the Lab value of the first water body image to obtain a first Lab value comparison result, and send the first Lab value comparison result to the microprocessor;

[0025] The microprocessor is used to receive the first Lab value comparison result from the comparison module and the real-time position information from the satellite positioning device, and determine whether the first Lab value comparison result exceeds a preset allowable error range, and when the first Lab value comparison result exceeds the allowable error range, send the real-time position information of the drone and the second water body image to the report generation module;

[0026] The report generation module is used to generate a standardized document report using the real-time location information of the drone from the microprocessor and the second water body image to display the water environment of rivers and lakes.

[0027] By adopting the above technical solution, the drone can cruise with an image acquisition device and a satellite positioning device, the GPS can transmit the location of the drone in real time, thereby reflecting the areas where environmental problems exist in lakes and rivers, the image acquisition device can be used to acquire images, the comparison module of the AI ​​recognition module can be used to compare images, the microprocessor of the AI ​​recognition module can determine whether there are environmental problems in the images taken by the drone based on the comparison results of the comparison module, and the report generation module can generate a document report for the problematic images. In this way, with the joint action of the drone, the AI ​​recognition module and the report generation module, the present application can identify the water environment of lakes, rivers and their surrounding areas, thereby reducing the labor intensity of the staff.

[0028] In a preferred example, the present invention can be further configured to also include an alarm and a memory, the alarm is used to receive the alarm signal sent by the microprocessor and issue an alarm, and the memory is connected to the image acquisition device and the satellite positioning device respectively.

[0029] By adopting the above technical solution, the alarm can emit a sharp beeping sound when the drone identifies environmental problems in lakes and rivers (such as floating objects on the water, or illegal buildings along the river), thereby reminding people that there are problems in the water body where the drone is located; the memory can store the video and images captured by the image acquisition device, so that the functions of the present application are more complete and can better identify lakes, rivers and their surrounding environment.

[0030] In a preferred example, the present invention can be further configured as follows: the image acquisition device is a camera installed on a drone, and the camera adopts a TI series Da Vinci series high-decibel DPS.

[0031] By adopting the above technical solution, the Da Vinci series high-decibel DPS can enable the drone to capture more accurate and detailed information, thereby helping the comparison module and microprocessor to make more accurate judgments, thereby enabling the application to more accurately identify the water environment of lakes and rivers.

[0032] In a preferred example, the present invention can be further configured to also include a standard image library module, wherein the standard image library module stores a plurality of standard water body images with various types of floating objects on the water body.

[0033] By adopting the above-mentioned technical solution, the comparison module is also used to compare the Lab value of the second water body image with the Lab value of the standard water body image to obtain a second Lab value comparison result, and send the second Lab value comparison result to the microprocessor. After judgment, the microprocessor sends the second Lab value comparison result from the comparison module to the report generation module. In this way, the present invention can more accurately determine whether there is a problem with the water environment of lakes and rivers.

[0034] In a preferred example, the present invention can be further configured as follows: a later image supplement module is also provided in the standard image library module, and the later image supplement module is used to input images of rivers and lakes with environmental problems collected in real time by drones.

[0035] By adopting the above technical solution, the comparison module compares the Lab value of the second water body image with the Lab values ​​of each image in the later image supplement module to obtain a third Lab value comparison result, and sends the third Lab value comparison result to the microprocessor. The microprocessor determines whether the third Lab value comparison result is within a preset error range, and when the third Lab value comparison result is within the error range, sends the real-time position information of the drone and the second water body image to the report generation module.

[0036] In a preferred example, the present invention can be further configured to further include an image fusion module, and an output end of the image fusion module is connected to the report generation module.

[0037] By adopting the above technical solution, the existing image fusion module can be used to fuse two or more image information from the image acquisition device into one image, so that the fused image contains more information, so that the document report generated by the report generation module can more accurately reflect the environmental problems existing in lakes and rivers.

[0038] In a preferred example, the present invention can be further configured to also include an intelligent analysis server, which adopts an embedded operating system. The intelligent analysis server includes a floating object size detection and analysis module, a floating object type distinction module, and a floating object quantity statistics module.

[0039] By adopting the above technical solution, the floating object size detection and analysis module can judge the size, type and quantity of floating objects on lakes and rivers, so that the present application can more accurately judge the problems existing in the water bodies on lakes and rivers.

[0040] In summary, the present invention includes at least one of the following beneficial technical effects:

[0041] 1. The drone can cruise with an image acquisition device and a satellite positioning device. The GPS can transmit the location of the drone in real time, thereby reflecting the areas where environmental problems exist in lakes and rivers. The image acquisition device can be used to acquire images. The comparison module of the AI ​​recognition module can be used to compare images. The microprocessor of the AI ​​recognition module can determine whether there are environmental problems in the images taken by the drone based on the comparison results of the comparison module. The report generation module can generate a document report for the problematic images. In this way, with the joint action of the drone, the AI ​​recognition module and the report generation module, the present application can identify the water environment of lakes, rivers and their surrounding areas, thereby reducing the labor intensity of the staff.

[0042] 2. The existing image fusion module can be used to fuse two or more image information from the image acquisition device into one image, so that the fused image contains more information, so that the document report generated by the report generation module can more accurately reflect the environmental problems existing in lakes and rivers.

[0043] 3. The present invention first compares the first water body image with the second water body image, so that the present invention can preliminarily identify the water environment of lakes and rivers, and then compares the second water body image with the standard water body image, so that the present invention can further identify the problems existing in the water environment of lakes and rivers, and then compares the second water body image with each image in the later image supplement module, and finally compares the third water body image to enable the present invention to more accurately identify the problems existing in the water environment of lakes and rivers. In this way, under the joint action of the four-fold identification method, the present invention can more accurately determine whether there are water environment problems in lakes and rivers.

[0044] 4. The four-level image comparison method adopted by the present invention enables the recognition system to realize the judgment function more accurately, specifically:

[0045] The first Lab value comparison result is mainly used to determine whether the objects photographed by the drone have changed. Generally, the first Lab value comparison result can help the recognition system preliminarily determine whether there are floating objects in rivers and lakes (because if there are floating objects in rivers and lakes, the Lab value of the image taken by the drone will definitely change).

[0046] The second Lab value comparison result is mainly used to further help the recognition system determine whether there are floating objects or illegal buildings in rivers and lakes. The specific number of images in the standard image library module can be set according to actual needs. The standard image library module can use images of water bodies with water environmental problems as standard water body images, or use images of water bodies without floating objects and illegal buildings in different sections of rivers and lakes as standard water body images. People can use one of the above two methods as the standard water body image as needed.

[0047] The main function of the third Lab value comparison result is to further help the recognition system determine whether there are floating objects or illegal buildings in rivers and lakes. The images in the later image supplement module are all when people use this recognition system to identify the water environment, and the water environment of lakes, rivers and their surrounding areas recorded later is in a situation where there are floating objects or illegal buildings.

[0048] The fourth Lab value comparison result mainly functions as a secondary confirmation to make the judgment result of the present invention more accurate. It is mainly used for reconfirmation through the third water body image when the first Lab value comparison result to the third Lab value comparison result all judge that there are environmental problems in the water body image. After the third water body image is used for judgment (the specific judgment method can be found in the second water body image), the recognition system still believes that there are floating objects or illegal buildings in the water environment of lakes, rivers and their surrounding areas. This means that in actual work, there may really be floating objects or illegal buildings in the water environment of lakes, rivers and their surrounding areas. In this way, the judgment result of the recognition system described in the present invention may be more accurate.

[0049] 5. The images in the late image supplement module of the present invention can be added by workers in the later use of the present recognition system. When the workers believe that there are environmental problems in the water environment of a lake or river and its surrounding areas, the images collected by the workers later can be entered into the late image supplement module. If the Lab value of the image taken by the drone is basically the same as the Lab value of the image in the late image supplement module or is within the allowable error range, it means that there are environmental problems in the water image taken by the drone. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 It is a structural schematic diagram of the environmental problem identification system for rivers and lakes described in the present invention.

[0051] Figure numerals: 1. UAV; 2. AI recognition module; 3. Report generation module; 4. Image acquisition device; 5. Satellite positioning device; 6. Comparison module; 7. Microprocessor; 8. Memory; 9. Alarm; 10. Standard image library module; 11. Image fusion module; 12. Intelligent analysis server. DETAILED DESCRIPTION

[0052] The present invention is further described in detail below in conjunction with the accompanying drawings.

[0053] like Figure 1 As shown, the present invention provides an environmental problem identification system for rivers and lakes, including an unmanned aerial vehicle 1, an AI recognition module 2 and a report generation module 3. The unmanned aerial vehicle 1 is equipped with an image acquisition device 4 and a satellite positioning device 5. The AI ​​recognition module 2 includes a comparison module 6 and a microprocessor 7. Under the joint action of the unmanned aerial vehicle 1, the AI ​​recognition module 2 and the report generation module 3, the present application can identify the water environment of lakes and rivers and their surrounding areas, thereby reducing the labor intensity of the staff.

[0054] The present invention mainly identifies the water environment problems existing in lakes, rivers and their surrounding areas, and helps people to judge the environmental problems existing in lakes, rivers and their surrounding areas. There is no need to pay attention to the video or image taken by the drone 1 all the time. People only need to judge whether there are environmental problems in the water bodies of lakes, rivers and their surrounding areas according to the document report generated by the report generation module 3. In actual work, the present invention has a good effect on identifying floating objects on the water bodies of lakes and rivers and buildings around the river slope protection, especially the recognition accuracy of floating objects on the water bodies of lakes and rivers is high.

[0055] The satellite positioning device 5 is installed on the drone 1, and is used to send the real-time position information of the drone 1 during cruising to the microprocessor 7. In actual operation, the satellite positioning device 5 can use a GPS positioning device or a Beidou positioning device. When the microprocessor 7 determines that there is a problem with the water environment of rivers and lakes, the position information collected by the satellite positioning device 5 can be sent to the report generation module 3, and the report generation module 3 displays this position information on the document report.

[0056] The image acquisition device 4 is connected to the comparison module 6 for real-time acquisition of water images of rivers and lakes captured by the drone 1 during cruising, and sends the water images to the comparison module 6 and the microprocessor 7. The water images include the first water image, the second water image and the third water image captured in chronological order. In actual operation, the second water image is the current water image captured by the drone 1 at the time of cruising, the first water image is the previous water image corresponding to the current water image at the previous moment, and the third water image is the next water image corresponding to the current water image at the next moment.

[0057] In actual operation, the image acquisition device 4 can be a camera installed on the drone 1, or a camera device that comes with the drone 1. The camera uses the TI series Da Vinci series high-decibel DPS. The Da Vinci series high-decibel DPS can allow the drone 1 to capture more accurate and detailed information, thereby helping the comparison module 6 and the microprocessor 7 to make more accurate judgments, thereby making the present application more accurate in identifying the water environment of lakes and rivers.

[0058] The comparison module 6 is connected to the microprocessor 7. The comparison module 6 of the AI ​​recognition module 2 can be used to compare images, and is mainly used to receive the first water body image and the second water body image from the image acquisition device 4, compare the Lab value of the second water body image with the Lab value of the first water body image, obtain a first Lab value comparison result, and send the first Lab value comparison result to the microprocessor 7;

[0059] The microprocessor 7 is connected to the report generation module 3, and is used to receive the first Lab value comparison result from the comparison module 6 and the real-time position information from the satellite positioning device 5, and judge whether the first Lab value comparison result exceeds the preset allowable error range, and when the first Lab value comparison result exceeds the allowable error range, the real-time position information of the drone 1 and the second water body image are sent to the report generation module 3. The microprocessor 7 of the AI ​​recognition module 2 can judge whether there is an environmental problem in the image taken by the drone 1 according to the comparison result of the comparison module 6.

[0060] The report generating module 3 is used to generate a document report in a format of the real-time position information of the UAV 1 from the microprocessor 7 and the second water body image to display the water environment of the rivers and lakes.

[0061] In actual operation, the present invention further includes an alarm 9, which is connected to the microprocessor 7 and is used to receive an alarm signal sent by the microprocessor 7 and send an alarm. When the drone 1 identifies that there are environmental problems in lakes and rivers (such as floating objects on the water, or illegal buildings along the river), the alarm 9 can send a sharp buzzing sound to remind people that there are problems in the water body where the drone 1 is located.

[0062] In actual operation, the present invention further includes a memory 8 installed on the drone 1, and the memory is connected to the image acquisition device 4 and the satellite positioning device 5 respectively. The memory 8 can store the video and images acquired by the image acquisition device 4, so that the functions of the present application are more complete and can better identify lakes, rivers and their surrounding environments. In actual operation, when the image captured by the image acquisition device 4 is located in the memory 8, the comparison module 8 needs to call the image information from the memory 8, and at this time the comparison module needs to be connected to the memory 8 for communication.

[0063] As a further identification scheme of the present invention, in order to further improve the judgment accuracy of the microprocessor 7, the present invention also includes a standard image library module 10, which is connected to the comparison module 6. The standard image library module 10 internally stores a plurality of standard water body images of various types of floating objects. The comparison module 6 is also used to compare the Lab value of the second water body image with the Lab value of the standard water body image to obtain a second Lab value comparison result, and send the second Lab value comparison result to the microprocessor 7. The microprocessor 7 sends the second Lab value comparison result from the comparison module 6 to the report generation module 3.

[0064] During actual operation, the second Lab value comparison result can be used as a supplementary comparison means when the first Lab value comparison result is greater than the allowable error range. When the first Lab value comparison result is greater than the allowable error range, the microprocessor 7 can issue a reconfirmation instruction to the comparison module 6. After receiving the reconfirmation instruction from the microprocessor 7, the comparison module 6 calls the standard water body image in the standard image library module 10, and compares the second water body image with the second standard water body image, so as to determine the type, size and quantity of floating objects on the water body.

[0065] In actual operation, the present invention further includes an image fusion module 11, the input end of the image fusion module 11 is connected to the microprocessor 7, and the output end of the image fusion module 11 is connected to the report generation module 3. The existing image fusion module 11 can fuse two or more image information from the image acquisition device 4 into one image, so that the fused image contains more information, so that the document report generated by the report generation module 3 can more accurately reflect the environmental problems existing in lakes and rivers.

[0066] In actual operation, the present invention further includes an intelligent analysis server 12, which uses an embedded operating system, an input end of the intelligent analysis server 12 is connected to the microprocessor 7, and an output end of the intelligent analysis server 12 is connected to the report generation module 3, and the intelligent analysis server 12 includes a floating object size detection and analysis module, a floating object type distinction module, and a floating object quantity statistics module. The floating object size detection and analysis module can judge the size, type and quantity of floating objects on lakes and rivers, so that the present application can more accurately judge the problems existing in the water bodies on lakes and rivers.

[0067] The present invention provides an identification method of the above-mentioned river and lake environmental problem identification system, comprising the following steps:

[0068] S1: Acquire water body images of rivers and lakes in real time, wherein the water body images are acquired by an image acquisition device on a drone, and the water body images include a first water body image, a second water body image, and a third water body image captured in chronological order;

[0069] S2: Compare the Lab value of the first water body image with the Lab value of the second water body image to obtain a first Lab value comparison result;

[0070] In actual operation, the comparison module 6 compares the Lab value of the first water body image from the image acquisition device 4 with the Lab value of the second water body image to obtain a first Lab value comparison result, and sends the first Lab value comparison result to the microprocessor 7;

[0071] S3: Determine whether the first Lab value comparison result exceeds a preset allowable error range, and when the first Lab value comparison result exceeds the allowable error range, generate a document in a format of the real-time position information of the drone (1) and the second water body image, wherein the document is used to display the environmental problems existing in rivers and lakes.

[0072] In actual work, the first Lab value comparison result, the second Lab value comparison result, the third Lab value comparison result and the fourth Lab value comparison result can all be collectively referred to as Lab value comparison results. If people want the Lab value comparison results to more accurately reflect the environmental problems of rivers and lakes, they can compare the Lab values ​​of each pixel in the image to be compared. If people just want to have a general understanding of the environmental problems of rivers and lakes, they can compare the average Lab values ​​of each pixel in the image.

[0073] In actual work, in order to better display the environmental problems of rivers and lakes in the document report, the report generation module 3 can also convert the Lab value of the image into a CMYK value.

[0074] In order to improve the judgment accuracy of the microprocessor 7, the present invention also provides the following improvement scheme: before generating a document report (at this time, the first Lab value comparison result exceeds the allowable error range), it also includes: comparing the Lab value of the second water body image with the Lab values ​​of each image in the later image supplement module, judging whether the third Lab value comparison result is within a preset error range, and when the third Lab value comparison result is within the error range, generating a document in the format of the real-time position information of the drone (1) and the second water body image.

[0075] The present application compares the second water body image captured by the image acquisition device 4 with the standard water body image, so that the microprocessor 7 can more accurately determine whether the image captured by the image acquisition device 4 has environmental problems, and the report displayed by the report generation module 3 is more accurate.

[0076] In actual work, the comparison result of the second Lab value is mainly used to further help the recognition system determine whether there are floating objects or illegal buildings in rivers and lakes. The specific number of images in the standard image library module can be set according to actual needs. The standard image library module can use images of water bodies with water environmental problems as standard water body images, or it can use images of water bodies without floating objects and illegal buildings in different sections of rivers and lakes as standard water body images.

[0077] If the standard water body image uses the situation of no floating objects and no illegal buildings, the microprocessor only needs to determine whether the Lab value of the image captured by the drone is within the range determined by the standard water body image. If the Lab value is not within this range, it means that there are water environment problems in rivers and lakes. If the standard water body image uses the existence of water environment problems in the water body as a reference, the microprocessor only needs to determine whether the Lab value of the image captured by the drone is within the range determined by the standard water body image. If the Lab value is within this range, it means that there are water environment problems in rivers and lakes.

[0078] If the comparison result of the second Lab value exceeds the preset allowable error range, the microprocessor 7 continues to send the real-time position information of the drone 1 and the water body image collected by the image acquisition device 4 to the report generation module 3. If the comparison result of the second Lab value does not exceed the preset allowable error range, the microprocessor 7 cancels sending the real-time position information of the drone 1 and the water body image collected by the image acquisition device 4 to the report generation module 3.

[0079] In order to further improve the judgment accuracy of the microprocessor 7, the present invention also provides the following further improvement scheme: before generating the document report, it also includes: comparing the Lab value of the second water body image with the Lab values ​​of each image in the later image supplement module, judging whether the third Lab value comparison result is within a preset error range, and when the third Lab value comparison result is within the error range, generating a document of the real-time position information of the drone (1) and the second water body image.

[0080] In order to further improve the judgment accuracy of the microprocessor 7, the present invention also provides the following further improvement scheme: when the second Lab value comparison result exceeds the allowable error range, the Lab value of the third water body image is compared with the Lab value of the standard water body image to obtain a third Lab value comparison result, and the comparison module 6 sends the third Lab value comparison result to the microprocessor 7 again. The microprocessor 7 determines whether the third Lab value comparison result exceeds the preset allowable error range, and when the first Lab value comparison result exceeds the allowable error range, the real-time position information of the drone 1 at this time and the second water body image and the third water body image are sent to the report generation module 3.

[0081] In actual operation, when the comparison result of the second Lab value exceeds the allowable error range, the Lab value of the third water body image is compared with the Lab value of the standard water body image. The following steps are required: the microprocessor 7 also sends a secondary confirmation instruction to the comparison module 6, and after the comparison module 6 receives the secondary confirmation instruction, it compares the Lab value of the third water body image with the Lab value of the standard water body image.

[0082] The present application compares the third water body image captured by the image acquisition device 4 with the standard water body image, so that the microprocessor 7 can more accurately determine whether the image captured by the image acquisition device 4 has environmental problems, and the report displayed by the report generation module 3 is more accurate.

[0083] In actual operation, if the comparison result of the third Lab value does not exceed the preset allowable error range, the microprocessor 7 cancels sending the real-time position information of the drone 1 and the water body image collected by the image acquisition device 4 to the report generation module 3. At this time, the report generation module 3 does not generate a water environment report.

[0084] The drone 1, comparison module 6, microprocessor 7, image acquisition device 4 and other products or functional modules of the present invention are all prior art. The present invention mainly compares the color (Lab value) of water images on rivers and lakes through existing drones, comparison modules, microprocessors and image acquisition devices 4 and other products or functional modules (that is, combining the above-mentioned existing products or functional modules), so as to determine whether there is a water environment on rivers and lakes (such as floating objects on the water, or illegal buildings along the river).

[0085] In actual operation, the main function of the drone 1 is to cruise the rivers and lakes. It can use DJI's Mavic-Air-2 portable foldable aerial photography drone. The main function of the satellite positioning device 7 is to perform satellite positioning. It can use a positioning device based on Amap or Baidu Map for positioning. The alarm 9 can use the spy tiger's early warning device or an ordinary buzzer; the memory can be a storage device that comes with the drone, or it can be an additionally installed (mobile) hard disk or disk. The image fusion module is mainly implemented using existing image fusion technology, and the intelligent analysis server is mainly implemented using existing embedded systems.

[0086] The microprocessor may be a conventional CPU processor, and its main function is to determine whether two values ​​being compared with each other are out of range. The microprocessor of the present invention may also be a processor of Qualcomm or HiSilicon.

[0087] The main function of the report generation module is to generate a standardized document from the drone's location information and the received pictures. The report generation module can use a Qualcomm or HiSilicon processor to achieve the above function, or it can be achieved through a commonly used computer.

[0088] The comparison module 6 is not a circuit that compares two values ​​and an analog voltage signal with a reference voltage as people think. The comparison module 6 of the present invention can actually be called a comparator. Its main function is to compare two values ​​(no comparison is required). The comparison module 6 can use a Qualcomm or HiSilicon processor (chip) to implement the above function.

[0089] It should be noted that the function of the comparison module of the present invention is only to compare the Lab value values ​​in the image, and the microprocessor only determines whether the difference between the two compared values ​​is too large. More specifically, the technical solution of the present invention can be understood as the comparison module placing the two values ​​together, and the microprocessor determines whether the difference between the two values ​​is too large.

[0090] Since the microprocessor, comparison module 6 and report generation module of the present invention can all use Qualcomm or HiSilicon processors to implement their respective functions, in actual operation, the microprocessor, comparison module 6 and report generation module can use a total of three processors to implement the respective functions of the above-mentioned products or functional modules, so that the technical solution of the present invention can be easier to implement, and the microprocessor, comparison module 6 and report generation module can also be integrated into one CPU processor to save costs.

[0091] The embodiments of this specific implementation method are all preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Therefore, any equivalent changes made based on the structure, shape, and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for identifying environmental problems in rivers and lakes, characterized in that: The identification method comprises: Acquiring water body images of rivers and lakes in real time, the water body images being acquired by an image acquisition device (4) on a drone (1), the water body images comprising a first water body image, a second water body image and a third water body image taken in chronological order; Compare the Lab value of the first water body image with the Lab value of the second water body image to obtain a first Lab value comparison result; Determining whether the first Lab value comparison result exceeds a preset allowable error range, and when the first Lab value comparison result exceeds the allowable error range, generating a document in a format of the real-time position information of the drone (1) and the second water body image at this time, wherein the document is used to display the environmental problems existing in rivers and lakes; Before generating the document report, the method further includes: when the first Lab value comparison result exceeds the allowable error range, comparing the Lab value of the second water body image with the Lab value of the standard water body image in the standard image library module (10) to obtain a second Lab value comparison result, judging whether the second Lab value comparison result exceeds the preset allowable error range, and when the second Lab value exceeds the allowable error range, generating a standardized document with the real-time position information of the drone (1) and the second water body image; Before generating the document report, the method further includes: when the second Lab value exceeds the allowable error range, comparing the Lab value of the second water body image with the Lab values ​​of each image in the later image supplementation module, judging whether the third Lab value comparison result is within the preset error range, and when the third Lab value comparison result is within the error range, generating a document in the format of the real-time position information of the drone (1) and the second water body image; the image in the later image supplementation module is an image of the lake, river and its surrounding water environment recorded later with floating objects or illegal buildings; When the third Lab value comparison result exceeds the allowable error range, the Lab value of the third water body image is compared with the Lab value of the standard water body image to obtain a fourth Lab value comparison result, and it is determined whether the fourth Lab value comparison result exceeds a preset allowable error range. When the fourth Lab value comparison result exceeds the allowable error range, the real-time position information of the drone (1) at this time and the third water body image are generated into a standardized document.

2. A system for identifying environmental problems in rivers and lakes, characterized in that: The invention comprises an unmanned aerial vehicle (1), an AI recognition module (2) and a report generation module (3), wherein the unmanned aerial vehicle (1) is equipped with an image acquisition device (4) and a satellite positioning device (5), and the AI ​​recognition module (2) comprises a comparison module (6) and a microprocessor (7); The satellite positioning device (5) is used to send real-time position information of the unmanned aerial vehicle (1) during cruising to the microprocessor (7); The image acquisition device (4) is used to acquire in real time water body images of rivers and lakes captured by the drone (1) during cruising, and to send the water body images to the comparison module (6) and the microprocessor (7), wherein the water body images include a first water body image, a second water body image, and a third water body image captured in chronological order; The comparison module (6) is used to receive the first water body image and the second water body image from the image acquisition device (4), compare the Lab value of the second water body image with the Lab value of the first water body image, obtain a first Lab value comparison result, and send the first Lab value comparison result to the microprocessor (7); The microprocessor (7) is used to receive the first Lab value comparison result from the comparison module (6) and the real-time position information from the satellite positioning device (5), and to determine whether the first Lab value comparison result exceeds a preset allowable error range, and when the first Lab value comparison result exceeds the allowable error range, to send the real-time position information of the drone (1) and the second water body image at this time to the report generation module (3); The report generation module (3) is used to generate a document report in a format using the real-time position information of the drone (1) from the microprocessor (7) and the second water body image to display the water environment of rivers and lakes; The microprocessor is also used to compare the Lab value of the second water body image with the Lab value of the standard water body image in the standard image library module (10) when the first Lab value comparison result exceeds the allowable error range, obtain a second Lab value comparison result, determine whether the second Lab value comparison result exceeds a preset allowable error range, and generate a standardized document of the real-time position information of the drone (1) and the second water body image when the second Lab value exceeds the allowable error range; Before generating the document report, the method further includes: when the second Lab value exceeds the allowable error range, comparing the Lab value of the second water body image with the Lab values ​​of each image in the later image supplementation module, judging whether the third Lab value comparison result is within the preset error range, and when the third Lab value comparison result is within the error range, generating a document in the format of the real-time position information of the drone (1) and the second water body image; the image in the later image supplementation module is an image of the lake, river and its surrounding water environment recorded later with floating objects or illegal buildings; When the third Lab value comparison result exceeds the allowable error range, the Lab value of the third water body image is compared with the Lab value of the standard water body image to obtain a fourth Lab value comparison result, and it is determined whether the fourth Lab value comparison result exceeds a preset allowable error range. When the fourth Lab value comparison result exceeds the allowable error range, the real-time position information of the drone (1) at this time and the third water body image are generated into a standardized document.

3. The system for identifying environmental problems of rivers and lakes according to claim 2, characterized in that: It also includes an alarm (9) and a memory (8), wherein the alarm (9) is used to receive an alarm signal sent by the microprocessor (7) and generate an alarm, and the memory (8) is connected to an image acquisition device (4) and a satellite positioning device (5) respectively; the image acquisition device (4) is a camera installed on the drone (1), and the camera adopts a TI series Da Vinci series high-decibel DPS.

4. The system for identifying environmental problems of rivers and lakes according to claim 3 is characterized in that: It also comprises a standard image library module (10), wherein the standard image library module (10) stores a plurality of standard water body images of various types of floating objects.

5. The system for identifying environmental problems of rivers and lakes according to claim 4 is characterized in that: The standard image library module (10) is also provided with a later image supplement module, and the later image supplement module is used to input images of rivers and lakes with environmental problems collected in real time by staff.

6. The system for identifying environmental problems of rivers and lakes according to claim 5, characterized in that: It also includes an image fusion module (11), and the output end of the image fusion module (11) is connected to the report generation module (3).

7. The system for identifying environmental problems of rivers and lakes according to claim 6, characterized in that: It also comprises an intelligent analysis server (12), which adopts an embedded operating system. The intelligent analysis server (12) comprises a floating object size detection and analysis module, a floating object type distinction module, and a floating object quantity statistics module.

Citation Information

Patent Citations

  • Offshore basin sea lake environment identification method and system

    CN110647650A

  • Water and air-integrated intelligent floater collection system and collection method thereof

    CN107622231A

  • Forest fire recognition device and system

    CN108537202A

  • All-weather water quality identification method

    CN110533626A