METHOD AND SYSTEM FOR AVIATION PATROL

Abstract

The present invention relates to the field of aerial monitoring of territories. A method for aerial patrolling is described, comprising the following steps: setting a patrol route for at least one aircraft comprising a detection module, a processing module and a data transmission module; directing at least one aircraft along the specified route and, using the detection module, obtaining aerial image data of the terrain with reference to the coordinates and time of shooting; processing the image data in flight using the processing module, including a pre-trained machine learning algorithm; using the machine learning algorithm, segmenting images, recognizing patterns and classifying recognized objects on the specified patrol route are carried out;identifying at least one type of incident and generating an entry in the incident log containing at least data on the type and location of the identified incident; verifying at least one of the identified incidents by receiving and processing additional data from the detection module and / or receiving an operator command; sending incident log entries via the in-flight data transmission module over the data transmission network to the server of the information and analytical platform. The technical result is an increase in the efficiency and speed of incident identification during aviation patrolling, a reduction in the transmitted traffic and the load on the data transmission network.

Claims

1. A system for aerial patrolling, comprising at least one aircraft configured to follow a given patrol route, containing a detection module capable of obtaining aerial image data of the terrain with reference to the coordinates and time of shooting; a processing module configured to receive terrain image data from the detection module, process it in flight and identify incidents on the terrain by means of at least one pre-trained machine learning algorithm with the formation of an incident log, including at least the type and location of the incident on the patrol route, wherein the processing module is configured to further verify the incident identified by the pre-trained machine learning algorithm in flight, by receiving and processing additional data from the detection module and / or receiving user input from the operator; a data transmission module configured to send in-flight incident log records via a data transmission network to at least one server of the information and analytical platform; The system further comprises at least one database comprising at least one set of historical data of images of the terrain along a given patrol route, the processing module is further configured to obtain historical data and identify incidents on the terrain by comparing, by means of a pre-trained machine learning algorithm, the current data received from the detection module and the historical data.

2. The system according to claim 1, wherein the detection module is configured to obtain images in the visible and infrared spectrum, and the processing module is configured to identify incidents based on the data of images of the terrain in the visible and infrared ranges.

3. The system according to claim 1, wherein the detection module further comprises one or more of: a laser scanner, an automatic object tracking device, a gas analyzer, a radiation-chemical reconnaissance device, and the processing module is configured to receive additional data from the detection module and use it to identify incidents through a pre-trained machine learning algorithm.

4. The system according to claim 1, which comprises a data storage module connected to the detection module and the processing module, and configured to at least store data received by the detection module and / or data processed by the processing module.

5. The system according to claim 1, which further comprises an automated operator workstation configured to exchange data with the incident processing and verification module by outputting to the operator the terrain image data from the detection module and / or the result of data processing and incident identification, and with the ability to receive user input from the operator.

6. The system according to claim 5, wherein the aircraft is a manned or unmanned aircraft, and the automated operator workstation is located in the aircraft.

7. The system according to paragraph 5, in which the aircraft is a manned or unmanned aircraft, and the automated operator workstation is designed with the possibility of remote data exchange with the processing module via a data transmission network.

8. The system according to claim 1, in which the processing module, via the data transmission module, is further configured to send to the server of the information and analytical platform at least one frame of image data of the terrain containing the identified incident for verification of the incident.

9. The system according to claim 1, in which the aircraft is configured to at least partially change the specified patrol route for additional verification of the incident by receiving a command from the processing module and / or from the operator’s automated workstation and / or from the server of the information and analytical platform.

10. The system according to claim 1, in which the aircraft is configured to change at least one patrol parameter for additional verification of an incident by receiving a command from the processing module and / or from the operator’s automated workstation and / or from the server of the information and analytical platform.

11. The system of claim 10, wherein the aircraft patrol parameter includes one or more of: speed of movement, altitude, direction of movement, maneuvering, pitch.

12. The system according to claim 1, including at least one additional aircraft configured to follow a route that at least partially coincides with a given patrol route, wherein the processing module of the first aircraft is configured to additionally verify the incident by receiving additional data via a data transmission network from a detection module installed on the additional aircraft.

13. The system according to claim 1, including at least one server of the information and analytical platform, configured with the ability to receive incident log records via a data transmission network from at least one aircraft in flight following a given patrol route, wherein the server is configured with the ability to extract log records and generate digital models of incidents identified on the ground while at least one aircraft is following a given patrol route.

14. The system according to claim 13, in which the server of the information-analytical platform is additionally configured with the possibility of receiving at least one frame of data of an image of the terrain containing an identified incident for verification of the incident and / or formation of a digital model of at least one incident identified on the terrain while at least one aircraft is following a given patrol route.

15. A method for air patrolling comprising the following steps: setting a patrol route for at least one aircraft containing a detection module, a processing module and a data transmission module, and at the route setting stage recording at least one set of historical data of images of the terrain along the specified patrol route; direct at least one aircraft along a given route and, using a detection module, obtain aerial image data of the terrain with reference to the coordinates and time of shooting; process the image data in flight using a processing module that includes a pre-trained machine learning algorithm; at the processing stage, historical data is additionally obtained and incidents on the ground are identified by comparing, using a pre-trained machine learning algorithm, the current data received from the detection module and historical data of the corresponding area of ​​the terrain; using a machine learning algorithm, image segmentation, pattern recognition and classification of recognized objects on a given patrol route are carried out; identifying at least one type of incident and generating an entry in an incident log containing at least data on the type and location of the identified incident; verify at least one of the identified incidents by receiving and processing additional data from the detection module and / or receiving an operator command; Using the in-flight data transmission module, incident log records are sent over the data transmission network to the information and analytical platform server.

16. The method according to paragraph 15, in which, at the stage of setting the route, the types of incidents for identification are additionally specified, and at the stage of processing the data, the specified types of incidents are identified.

17. The method according to claim 15, in which verification of an identified incident corresponding to at least one of the specified types of incidents is carried out.

18. The method according to paragraph 15, in which, at the stage of setting the route, the type of patrol object is additionally specified, and at the stage of processing the data, the types of incidents related to the specified type of patrol object are identified.

19. The method according to claim 15, wherein the types of incidents to be identified include at least one or more of the following: smoke, fire, consequences of a fire, landslide, avalanche, pipeline rupture, pipeline exposure, washout, flooding, icing, leak, gas emission, unauthorized dumping, man-made accident, water body pollution, deforestation, overgrowing of clearings, stationary foreign objects, mobile foreign objects, line break, damage to infrastructure elements of linear objects, presence of defects in linear objects and coatings.

20. The method according to claim 18, wherein the type of patrol object includes at least one or more of the following: a pipeline, a railway line, a power line, a communication line, a forest area, a settlement area, agricultural land, a body of water, a mountain range, an industrial zone.

21. The method according to claim 15, wherein at the stage of obtaining aerial image data of the terrain with reference to coordinates and time of shooting, images are obtained in the visible and infrared spectrum, and at the processing stage, at least one type of incident is identified based on the obtained image in the visible and / or infrared spectrum.

22. The method according to claim 15, in which, by means of the detection module, additional data is obtained by means of one or more means selected from: a laser scanner, an automatic object tracking device, a gas analyzer, a radiation-chemical reconnaissance device, and at the processing stage, at least one type of incident is identified based on the additional data obtained.

23. The method according to claim 15, wherein at least a portion of the image data obtained by the detection module is recorded.

24. The method according to claim 23, in which mapping of a given patrol route is carried out in the visible and / or infrared ranges by means of a detection module and a processing module on board the aircraft.

25. The method according to paragraph 23, in which, at the stage of verifying the identified incident, an incident log record with image data of the corresponding identified incident is sent via the data transmission network to the server of the information and analytical platform and / or the automated workstation of the operator.

26. The method according to paragraph 15, in which, at the stage of incident verification, the image data of the terrain is output from the detection module and / or the result of data processing from the processing module to the automated operator workstation located in the aircraft.

27. The method according to any of paragraphs 25, 26, in which, at the stage of incident verification, user input or a command is received from the server of the information and analytical platform with confirmation or denial of the incident.

28. The method according to claim 15, wherein at the stage of verifying the identified incident, at least a partial change is made to the specified patrol route and additional image data is obtained for further verification of the identified incident by receiving a command from the processing module and / or from the operator’s automated workstation and / or from the server of the information and analytical platform.

29. The method according to claim 28, wherein changing the specified route includes at least one or more of the following: changing the course, returning to the area of ​​the identified incident, performing additional patrol of the area of ​​the identified incident with an expansion of the patrol radius, descending in the area of ​​the identified incident, landing the aircraft in the area of ​​the identified incident.

30. The method according to claim 15, wherein at the stage of verifying the identified incident, at least one patrol parameter is changed and additional image data is obtained for further verification of the identified incident by receiving a command from the processing module and / or from the operator’s automated workstation and / or from the server of the information and analytical platform.

31. The method according to claim 30, wherein the aircraft patrol parameter includes one or more of: speed of movement, altitude, direction of movement, maneuvering, pitch.

32. The method according to claim 15, wherein at the stage of verifying the identified incident, a request is sent via the data transmission module containing the coordinates and type of the identified incident to at least one additional aircraft following a route that at least partially coincides with the specified patrol route, and in response to the request, additional image data associated with the identified incident is received from the detection module installed on the additional aircraft.

33. The method according to any one of paragraphs 28-32, in which additional image data associated with the identified incident is processed by means of a processing module and the identified incident is confirmed or refuted.

34. The method according to claim 33, wherein in response to confirmation of the identified incident, an entry is generated in the incident log containing at least data on the type and location of the verified identified incident.

35. The method according to claim 33, wherein in response to a denial of an identified incident, an entry is deleted from the incident log or an entry about a falsely identified incident is added.

36. The method according to claim 15, wherein the step of sending the in-flight log records further comprises sending at least one image or a sequence of several images for the verified identified incident.

37. The method according to paragraph 15, in which, at the stage of setting the patrol route, the coordinates of the control areas are additionally set, and the transmission of the incident log data is carried out when the aircraft reaches the control area.

38. The method according to paragraph 15, in which the incident log records are received via a data transmission network on at least one server of the information and analytical platform and the received data is further processed and a report on the identified incidents on the patrol route is generated.

39. The method according to paragraph 15, in which the incident log records are received via a data transmission network on at least one server of the information and analytical platform and a digital model of incidents identified on the ground while at least one aircraft is following a given patrol route is formed.

40. The method according to paragraph 39, which further comprises processing the said digital model using a decision support algorithm and automatically generating a scenario for responding to incidents identified on the ground while at least one aircraft is following a given patrol route.

41. The method according to paragraph 36, in which at least one image or a sequence of several images is obtained for a verified identified incident via a data transmission network on at least one server of the information and analytical platform, the received data is processed and additional training of the machine learning algorithm is performed based on the verified identified incident.

Images