Vehicle-mounted unmanned aerial vehicle beyond-visual-range road condition detection device and method and storage medium

The vehicle-mounted drone system addresses the limitation of driver visibility by collecting and fusing data to generate a 3D terrain image, enhancing situational awareness and reducing traffic congestion by providing real-time road condition monitoring and optimal routing.

CN119694153APending Publication Date: 2025-03-25ZHEJIANG ZEEKR INTELLIGENT TECH CO LTD +1

Patent Information

Application Number
CN202311231376.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-22
Publication Date
2025-03-25

AI Technical Summary

Technical Problem

Existing vehicles are unable to perceive road conditions beyond their visual range, leading to unforeseen traffic situations and inaccurate navigation due to limited driver visibility and outdated map data.

Method used

A vehicle-mounted drone system that extends the driver's field of view by flying beyond the visible range to collect data, which is then fused with navigation and satellite data to generate a 3D terrain image, providing real-time awareness of road conditions and optimal routing.

Benefits of technology

Enables real-time monitoring of conditions beyond the driver's visual range, allowing for proactive route adjustments and reducing traffic congestion by integrating drone-collected data with navigation and satellite information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119694153A_ABST
    Figure CN119694153A_ABST
Patent Text Reader

Abstract

The invention provides a vehicle-mounted unmanned aerial vehicle beyond visual range road condition detection device and method and a storage medium, and the device comprises a visual range amplification module which controls a vehicle-mounted unmanned aerial vehicle to fly to a designated position within an effective voyage distance beyond the visual field range sensed by a driver, and sends the vehicle-mounted unmanned aerial vehicle to a vehicle-mounted unmanned aerial vehicle; and the vehicle-mounted unmanned aerial vehicle is controlled to collect unmanned aerial vehicle field beyond visual range sensing data corresponding to the specified position. According to the invention, the road condition outside the sight distance in front of a driver can be monitored and returned in real time, and the driver can perceive the road condition information in advance; information merging analysis is performed in combination with satellite big data, an optimal driving route is given, and traffic jam is reduced to the maximum extent; under a field off-road condition, detection can be carried out aiming at surrounding terrains, whether the surrounding terrains can pass or not is confirmed, and reference information is provided for a driver; the system can be quickly released and help search and rescue in an outdoor rescue scene.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of road detection, and in particular to a vehicle-mounted unmanned aerial vehicle (UAV) beyond-visual-range road condition detection device, method and storage medium. Background Art

[0002] When existing cars are driving on the road, the driver's field of vision is limited, so it is impossible to perceive the road conditions beyond the line of sight. In addition, cars often encounter unexpected traffic jams when driving on the road, and it is impossible to predict and adjust the route in advance. In addition, due to the untimely update of map navigation software, it will also lead to inaccurate judgment of road conditions. Summary of the invention

[0003] In view of the shortcomings of the prior art described above, the purpose of the present invention is to provide a vehicle-mounted drone beyond-visual-range road condition detection device, method and storage medium, which are used to solve the problems in the prior art that existing cars cannot perceive the road conditions beyond the visual range, existing cars often encounter unexpected traffic jams on the road, cannot predict in advance, adjust the route in advance, the existing map navigation software is not updated in time, and the road condition judgment is inaccurate.

[0004] To achieve the above-mentioned purpose and other related purposes, the present invention provides a vehicle-mounted unmanned aerial vehicle (UAV) beyond-visual-range road condition detection device, comprising: a visual range amplification module, the visual range amplification module controls the vehicle-mounted UAV to be launched to a designated position within an effective range outside the field of vision perceived by the driver, and controls the vehicle-mounted UAV to collect the corresponding UAV on-site beyond-visual-range perception data at the designated position; a fusion data acquisition module, the fusion data acquisition module controls the collection of map navigation data and satellite data corresponding to the designated position; a data processing module, the data processing module controls the map navigation data, satellite data and UAV on-site beyond-visual-range perception data to be transmitted back to the vehicle-mounted computer, performs fusion calculation and generates corresponding three-dimensional terrain; and a return control module, the return control module collects a completion control signal for terrain detection, and controls the vehicle-mounted UAV to return to the corresponding transceiver cabin of the vehicle for storage and charging.

[0005] In one embodiment of the present invention, the drone's on-site beyond-visual-range perception data includes at least one of photo taking, video, audio recording, 3D real-time laser scanning ranging, and GPS information.

[0006] In one embodiment of the present invention, the line-of-sight augmentation module includes: a range control module, which controls the vehicle-mounted drone to fly to a designated position corresponding to the effective range; and a data monitoring module, which controls the vehicle-mounted drone to collect the drone on-site beyond-line-of-sight perception data at the corresponding designated position based on the arrival signal of the vehicle-mounted drone arriving at the designated position.

[0007] In one embodiment of the present invention, the range control module includes: a start control module, which collects the position calibration information of the calibrated area in the map navigation and controls the launch of the vehicle-mounted drone; and a flight control module, which controls the vehicle-mounted drone to fly to the calibrated area in advance.

[0008] In one embodiment of the present invention, the startup control module includes: a transceiver cabin control module, which controls the opening and closing of the transceiver cabin cover; and a route control module, which controls the vehicle-mounted drone to fly from the transceiver cabin to the calibration area along the route of map navigation.

[0009] In one embodiment of the present invention, the data monitoring module includes: an aerial photography module, which controls video recording, audio collection and photo shooting of a designated location; a laser ranging module, which controls the measurement of the distance and height of each location in the corresponding video in the video recording and the corresponding photo in the photo shooting; a 3D laser scanning module, which controls the 3D scanning of the terrain at the designated location; and a GPS module, which obtains the GPS information of the designated location where the vehicle-mounted drone is located.

[0010] In one embodiment of the present invention, a fusion data acquisition module, a data processing module, a return control module, a range control module, and a vehicle-mounted computer are installed on a vehicle, and an aerial photography module, a laser ranging module, a 3D laser scanning module, and a GPS module are all installed on a vehicle-mounted drone.

[0011] In one embodiment of the present invention, the fusion data acquisition module includes: a navigation data acquisition module, which collects map navigation data when the vehicle is traveling; and a satellite data acquisition module, which collects satellite big data of historical weather, historical photo images, current weather and photo images of the detection location of the vehicle-mounted drone.

[0012] In one embodiment of the present invention, the data processing module includes: a data return module, which controls the map navigation data, satellite data and drone on-site beyond-visual-range perception data corresponding to the specified location to be returned to the on-board computer; a fusion processing module, which compares and confirms the coordinates returned to the on-board computer with the photo images and road network information of the same coordinates on the map navigation server and the satellite data server, and generates a 3D fused image with big data information; and a data sharing module, which controls the road condition information corresponding to the specified location and the road condition information of the specified location shared by others on the network to be provided to the on-board computer.

[0013] The present invention also provides a method for detecting road conditions beyond visual range using a vehicle-mounted drone, comprising the following steps:

[0014] S1: Control the vehicle-mounted drone to fly to a designated location within the effective range beyond the driver's field of vision, and control the vehicle-mounted drone to collect the corresponding drone on-site beyond-visual-range perception data at the designated location;

[0015] S2: Control the collection of map navigation data, satellite data and drone on-site beyond-visual-range perception data corresponding to the specified location;

[0016] S3: Control the transmission of map navigation data, satellite data and drone on-site beyond-visual-range perception data to the on-board computer for fusion calculation and generation of corresponding three-dimensional terrain;

[0017] S4: Collect the completion control signal of terrain detection and control the vehicle-mounted UAV to return to the transceiver cabin for storage and charging.

[0018] The present invention further provides a computer-readable storage medium, in which at least one instruction is stored, and the instruction is loaded and executed by a processor to implement the aforementioned method.

[0019] As described above, a vehicle-mounted drone over-the-horizon road condition detection device and method of the present invention has the following beneficial effects: when the vehicle is driving and the driver cannot know the corresponding terrain and road conditions nearby outside the field of vision perceived by the driver, the vehicle-mounted drone is controlled to fly to a designated position beyond the field of vision perceived by the driver, and the drone on-site over-the-horizon perception data at the designated position is obtained. Combined with the vehicle's map navigation data and satellite data, and transmitted back to the vehicle-mounted computer. The coordinates are compared and confirmed by the vehicle-mounted computer with the photos and road network information of the same coordinate points on the map navigation server and the satellite data server, and a 3D fusion image with big data information is generated, and the situation of the location and the status shared by others on the network are provided to the driver for reference. Then, the terrain and road conditions of the current designated area are determined, so as to determine whether it can pass. The above-mentioned vehicle-mounted drone over-the-horizon detection can realize real-time monitoring and transmission of the road conditions outside the visual range ahead, so that the driver can perceive the road condition information in advance. Combined with satellite big data for information merging and analysis, the best driving route can be given to minimize traffic jams. Moreover, in off-road conditions, it can detect the surrounding terrain to confirm whether it is passable and provide reference information for the driver. At the same time, it can also be quickly released and help with search and rescue in outdoor rescue scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 FIG. 4 is a structural diagram of the road condition detection device of the present invention.

[0021] Figure 2 Shown is a schematic diagram of a vehicle-mounted drone detection process in one embodiment of the present invention.

[0022] Figure 3 Flow chart of the road condition detection method of the present invention. DETAILED DESCRIPTION

[0023] The following is an explanation of the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the features in the following embodiments and the embodiments can be combined with each other without conflict. It should also be understood that the terms used in the embodiments of the present invention are intended to describe specific embodiments, rather than to limit the scope of protection of the present invention. The test methods for which specific conditions are not specified in the following examples are usually carried out under conventional conditions or according to the conditions recommended by the manufacturers.

[0024] See also Figures 1 to 3 . It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings in this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the limiting conditions for the implementation of the present invention, so they have no substantial technical significance. Any modification of the structure, change in the proportional relationship, or adjustment of the size should still fall within the scope of the technical content disclosed by the present invention without affecting the effects and purposes that can be achieved by the present invention. At the same time, the terms such as "upper", "lower", "left", "right", "middle" and "one" quoted in this specification are only for the convenience of description, and are not used to limit the scope of the implementation of the present invention. Changes or adjustments in their relative relationships should also be regarded as the scope of the implementation of the present invention without substantially changing the technical content.

[0025] See also Figure 1 The present invention provides a vehicle-mounted unmanned aerial vehicle (UAV) beyond-visual-range road condition detection device, comprising: a visual range expansion module, the visual range expansion module controls the vehicle-mounted UAV to be launched to a designated position within an effective range outside the field of vision perceived by the driver, and controls the vehicle-mounted UAV to collect the corresponding UAV on-site beyond-visual-range perception data of the designated position; a fusion data acquisition module, the fusion data acquisition module controls the collection of map navigation data and satellite data corresponding to the designated position; a data processing module, the data processing module controls the fusion calculation of the map navigation data and the satellite data and generates the corresponding three-dimensional terrain; and a return control module, the return control module collects the completion control signal of the terrain detection, and controls the vehicle-mounted UAV to return to the corresponding transceiver cabin of the vehicle for storage and charging.

[0026] In one embodiment of the present invention, when the vehicle is driving and the situation in the front or surrounding area is unclear, the sight range expansion module is used to realize the corresponding vehicle-mounted drone on the vehicle to be released to the designated location for detection beyond the driver's field of vision. At the same time, the vehicle-mounted drone collects the drone's on-site over-the-horizon perception data at the designated location. The fusion data acquisition module is used to collect the corresponding map navigation data and satellite data at the designated location. And by using the data processing module, the map navigation data, satellite data and drone's on-site over-the-horizon perception data are returned to the vehicle's on-board computer, and the on-board computer performs the fusion calculation of the map navigation data, satellite data and drone's on-site over-the-horizon perception data to obtain the fusion big data at the designated location, and the three-dimensional terrain of the designated area of ​​the vehicle-mounted drone is returned, which can be displayed on the vehicle-mounted display screen for the driver to make data reference for terrain, etc. After the data is returned and the calculation is completed, the vehicle-mounted drone is controlled to return to the transceiver cabin by the return control module, and this transceiver cabin can not only store the vehicle-mounted drone, but also charge the returned vehicle-mounted drone. It is worth noting that the effective range is the maximum distance that a vehicle-mounted drone can fly from the vehicle.

[0027] The drone's on-site beyond-visual-range perception data includes at least one of photo taking, video, audio recording, 3D real-time laser scanning ranging, and GPS information.

[0028] The line-of-sight expansion module includes: a range control module, which controls the vehicle-mounted UAV to fly to a designated position corresponding to the effective range; and a data monitoring module, which controls the vehicle-mounted UAV to collect the UAV on-site beyond-line-of-sight perception data at the corresponding designated position based on the arrival signal of the vehicle-mounted UAV arriving at the designated position.

[0029] In one embodiment of the present invention, the sight range expansion module realizes flight control of the vehicle-mounted UAV at a designated position set within the effective range through the range control module during the process of realizing the sight range expansion of the driver. And through the data monitoring module, when the vehicle-mounted UAV arrives at the designated position, the vehicle-mounted UAV is controlled to collect the UAV on-site beyond-visual-range perception data such as photography, video, audio recording, 3D real-time laser scanning ranging, and GPS information of the designated area.

[0030] The range control module includes: a start control module, which collects the position calibration information of the calibrated area in the map navigation and controls the vehicle-mounted UAV to be launched; and a flight control module, which controls the vehicle-mounted UAV to fly to the calibrated area in advance.

[0031] In one embodiment of the present invention, during the flight range control of the vehicle-mounted drone, when the driver detects the map navigation calibration area, the control module will be started to collect the position calibration information when the calibration area in the map navigation is calibrated, and the transceiver cabin will be opened and the vehicle-mounted drone will be started. When the drone is sent out, the flight control module is used to control the vehicle-mounted drone to fly in advance from the vehicle's location to the calibration area calibrated by the map navigation to the calibration area to detect the road conditions. It is worth noting that the map navigation can be connected to mainstream map data services such as AutoNavi and Baidu to obtain map navigation data, for example, through a 5G network.

[0032] The start control module includes: a transceiver cabin control module, which controls the opening and closing of the transceiver cabin cover; and a route control module, which controls the vehicle-mounted drone to fly from the transceiver cabin to the calibration area along the route of map navigation.

[0033] In one embodiment of the present invention, when the start control module controls the vehicle-mounted UAV to start from the transceiver cabin, the transceiver cabin control module is used to control the opening or closing of the transceiver cabin cover, so that when the transceiver cabin cover is opened, the vehicle-mounted UAV is controlled to fly out. When flying out, the route control module is used to control the vehicle-mounted UAV to fly along the calibrated area from the vehicle location.

[0034] The data monitoring module includes: an aerial photography module, which controls video recording, audio collection and photo shooting of a designated location; a laser ranging module, which controls the measurement of the distance and height of each location in the corresponding video in video recording and the corresponding photo in photo shooting; a 3D laser scanning module, which controls the 3D scanning of the terrain at the designated location; and a GPS module, which obtains the GPS information of the designated location where the vehicle-mounted drone is located.

[0035] In one embodiment of the present invention, when the data monitoring module collects the drone's on-site beyond-visual-range perception data, the aerial photography module is used to collect the video data, audio data, and photo image data required for synthesizing a 3D fusion image. The laser ranging module is used to measure the distance and height of each position in the corresponding video in the video recording and the corresponding photo in the photo shooting. And the 3D laser scanning module is used to perform a 3D scan of the terrain conditions at the current designated location. The GPS module is used to obtain the position coordinates of the drone at the designated location in real time. The data collected by the aerial photography module, the laser ranging module, the 3D laser scanning module, and the GPS module are then transmitted back to the on-board computer.

[0036] The fusion data acquisition module, data processing module, return control module, range control module, and vehicle-mounted computer are installed on the vehicle, and the aerial photography module, laser ranging module, 3D laser scanning module, and GPS module are all installed on the vehicle-mounted UAV. By installing the aerial photography module, laser ranging module, 3D laser scanning module, and GPS module on the vehicle-mounted UAV, it is possible to realize the beyond-visual-range perception data collection of the UAV at different position coordinates according to the movement of the vehicle-mounted UAV.

[0037] The fusion data acquisition module includes: a navigation data acquisition module, which collects map navigation data when the vehicle is driving; and a satellite data acquisition module, which collects satellite big data of historical weather, historical photo images, current weather and photo images of the detection location of the vehicle-mounted drone.

[0038] In one embodiment of the present invention, when the navigation data acquisition module acquires the map navigation data of the vehicle, it can acquire the map navigation data by accessing mainstream map data servers such as Amap and Baidu. When the satellite data acquisition module acquires satellite big data, it can acquire it through satellite photo data servers such as Google Earth.

[0039] The data processing module includes: a data return module, which controls the map navigation data, satellite data and drone on-site beyond-visual-range perception data corresponding to the designated location to be returned to the on-board computer; a fusion processing module, which compares and confirms the coordinates returned to the on-board computer with the photo images and road network information of the same coordinates on the map navigation server and satellite data server, and generates a 3D fused image with big data information; and a data sharing module, which controls the road condition information corresponding to the designated location and the road condition information of the designated location shared by others on the network to be provided to the on-board computer.

[0040] In one embodiment of the present invention, when the data processing module performs the fusion processing of the drone's on-site beyond-visual-range perception data, map navigation data, and satellite data, the data return module is used to realize the return of the drone's on-site beyond-visual-range perception data, map navigation data, and satellite data corresponding to the specified location to the on-board computer. Thus, the fusion processing module controls the on-board computer to aggregate (i.e., fuse) the returned drone's on-site beyond-visual-range perception data, map navigation data, and satellite data, and display them on the on-board display screen of the on-board computer. At the same time, a 3D fusion image with fusion data is generated based on the drone's on-site beyond-visual-range perception data to display the three-dimensional terrain data of the specified area on the vehicle's on-board display screen. In addition, the road condition information of the specified location and the historical road conditions of the specified location shared by others are displayed on the on-board display screen of the on-board computer through the data sharing module to provide reference to the driver. Specifically, for example, when collecting data, the on-board drone uses its own 3D scanner to scan the image information of the current specified location. Based on the image information, a 3D fusion image is automatically generated on the vehicle-mounted drone, and the 3D fusion image is transmitted back to the vehicle-mounted computer using the data transmission module. When the 3D fusion image is transmitted back to the vehicle-mounted computer, other fusion big data, such as satellite data, map navigation data, and sound data obtained by the vehicle-mounted drone, are also transmitted back to the vehicle-mounted computer and displayed comprehensively on the vehicle display screen.

[0041] See also Figure 2 In the embodiment shown, during the driving of the vehicle, the sight distance of the area directly in front of the driver is the field of vision that the driver can perceive. The area beyond the sight distance is the beyond-visual-range area, which is obtained by detecting the road condition beyond visual range by the drone. Moreover, the drone can also return to the corresponding transceiver cabin on the vehicle after the detection is completed. When the drone detects the road condition beyond visual range, the vehicle's map navigation data, satellite positioning big data and the drone's on-site beyond-visual-range perception data detected by the drone are combined, and the signal is wirelessly transmitted back to the vehicle's on-board computer system for fusion calculation, so as to draw a 3D fusion image corresponding to the specified position detected by the drone and display it on the vehicle's on-board display screen.

[0042] The present invention also provides several application scenarios based on the vehicle-mounted drone beyond-visual-range road condition detection device, which are as follows:

[0043] When a vehicle is driving on the road and needs to confirm whether there is a traffic jam ahead, the driver opens the map navigation and specifies the vehicle-mounted drone to detect the calibrated area on the map. Based on the calibrated position, the vehicle-mounted drone is controlled to fly to the designated position corresponding to the calibrated area. When arriving at the designated position, the vehicle-mounted drone obtains the drone's on-site over-the-horizon perception data of the area, and combines it with the map navigation data and satellite data for fusion calculation to obtain a 3D fusion image and display it to the driver to confirm whether there is congestion or other terrain conditions (such as construction) ahead, thereby controlling the map navigation to re-plan the route to plan the best driving route and minimize traffic jams.

[0044] ② When driving off-road, if the surrounding terrain is unclear, the vehicle-mounted drone can be dispatched to a designated location in the surrounding area, and the drone's on-site over-the-horizon perception data in the area can be transmitted back, combined with map navigation data and satellite data for fusion calculation to obtain a 3D fusion image. This can accurately determine whether there is a passable area around, providing the driver with road condition reference information.

[0045] ③ In outdoor rescue scenarios, drive the vehicle outdoors and cooperate with the vehicle-mounted drone to achieve the maximum search and rescue range (i.e. effective range). Then control the vehicle-mounted drone to fly out of the vehicle's transceiver compartment to conduct reconnaissance of surrounding locations to help rescue personnel and vehicles quickly conduct search and rescue work.

[0046] like Figure 3 As shown, the present invention also provides a method for detecting road conditions beyond visual range by a vehicle-mounted drone, comprising the following steps:

[0047] S1: Control the vehicle-mounted drone to fly to a designated location within the effective range beyond the driver's field of vision, and control the vehicle-mounted drone to collect the corresponding drone on-site beyond-visual-range perception data at the designated location;

[0048] S2: Control the collection of map navigation data, satellite data and drone on-site beyond-visual-range perception data corresponding to the specified location;

[0049] S3: Control the transmission of map navigation data, satellite data and drone on-site beyond-visual-range perception data to the on-board computer for fusion calculation and generation of corresponding three-dimensional terrain;

[0050] S4: Collect the completion control signal of terrain detection and control the vehicle-mounted UAV to return to the corresponding transceiver cabin of the vehicle for storage and charging.

[0051] In one embodiment of the present invention, when using a vehicle-mounted drone for beyond-visual-range road condition detection, the designated location to be detected is first determined according to the driver's demand for the vehicle-mounted drone to detect outside the driver's field of vision. And the vehicle-mounted drone is controlled to fly to the designated location to collect the drone's on-site beyond-visual-range perception data, wherein the collected drone's on-site beyond-visual-range perception data includes photo taking, video, recording, 3D real-time laser scanning ranging, GPS information, etc. While collecting the drone's on-site beyond-visual-range perception data, the map navigation data and satellite data of the designated location corresponding to the detection are also obtained. And the drone's on-site beyond-visual-range perception data, map navigation data and satellite data are transmitted back to the vehicle's on-board computer for fusion calculation to obtain fusion big data, and the 3D fusion image of the designated location scanned by the vehicle-mounted drone's 3D scanner is obtained and transmitted back to the vehicle display screen to display the three-dimensional terrain of the designated location. And after the vehicle-mounted drone data collection is completed, it returns to the corresponding transceiver cabin on the vehicle to realize the storage and charging of the vehicle-mounted drone.

[0052] The present invention further provides a computer-readable storage medium, in which at least one instruction is stored, and the instruction is loaded and executed by a processor to implement the aforementioned method. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0053] In summary, when the driver is driving a vehicle and cannot obtain the corresponding terrain and road conditions nearby outside the field of vision perceived by the driver, the present invention controls the vehicle-mounted drone to fly to a designated position beyond the field of vision perceived by the driver, and obtains the drone's on-site beyond-line-of-sight perception data at the designated position. Combine the vehicle's map navigation data and satellite data, and transmit it back to the vehicle-mounted computer. The vehicle-mounted computer compares and confirms the coordinates with the photos and road network information of the same coordinate points on the map navigation server and the satellite data server, generates a 3D fusion image with big data information, and provides the driver with the situation of the location and the status shared by others on the network for reference. Then determine the terrain and road conditions of the current designated area, so as to determine whether it can pass. The above-mentioned vehicle-mounted drone beyond-line-of-sight detection can realize real-time monitoring and feedback of the road conditions outside the line of sight ahead, so that the driver can perceive the road condition information in advance. Combined with satellite big data for information merging and analysis, the best driving route can be given to minimize traffic jams. Moreover, under offroad conditions in the wild, the surrounding terrain can be detected to confirm whether it can pass, and provide reference information for the driver. At the same time, it can also be quickly released and help search and rescue in outdoor rescue scenes. Therefore, the present invention effectively overcomes various shortcomings in the prior art and has high industrial utilization value.

[0054] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A vehicle-mounted drone beyond-visual-range road condition detection device, characterized in that: include: A line-of-sight amplification module, wherein the line-of-sight amplification module controls the vehicle-mounted drone to be launched to a designated position within an effective range beyond the field of vision perceived by the driver, and controls the vehicle-mounted drone to collect the corresponding drone on-site beyond-line-of-sight perception data at the designated position; A fusion data acquisition module, wherein the fusion data acquisition module controls the acquisition of map navigation data and satellite data corresponding to a specified location; A data processing module, wherein the data processing module controls the map navigation data, the satellite data and the drone on-site beyond-visual-range perception data to be transmitted back to the vehicle-mounted computer, performs fusion calculation and generates corresponding three-dimensional terrain; as well as A return control module collects a control signal indicating the completion of terrain detection and controls the vehicle-mounted UAV to return to a transceiver compartment corresponding to the vehicle for storage and charging.

2. The vehicle-mounted drone beyond-visual-range road condition detection device according to claim 1, characterized in that: The drone's on-site beyond-visual-range perception data includes at least one of photo taking, video, audio recording, 3D real-time laser scanning ranging, and GPS information.

3. The vehicle-mounted drone beyond-visual-range road condition detection device according to claim 1, characterized in that: The line-of-sight amplification module comprises: A range control module, the range control module controls the vehicle-mounted UAV to fly to the designated position corresponding to the effective range; and A data monitoring module controls the vehicle-mounted drone to collect the drone on-site beyond-visual-range perception data at the corresponding designated location according to an arrival signal of the vehicle-mounted drone arriving at the designated location.

4. The vehicle-mounted drone beyond-visual-range road condition detection device according to claim 3 is characterized in that: The range control module includes: A start control module is used to collect the position calibration information of the calibration area in the map navigation and control the launch of the vehicle-mounted UAV; and A flight control module is used to control the vehicle-mounted UAV to fly to the calibration area in advance.

5. The vehicle-mounted drone beyond-visual-range road condition detection device according to claim 4 is characterized in that: The startup control module includes: a transceiver cabin control module, the transceiver cabin control module controlling the opening and closing of the transceiver cabin cover; and A route control module controls the vehicle-mounted drone to fly from the transceiver cabin to the marked area along the route navigated by the map.

6. The vehicle-mounted drone beyond-visual-range road condition detection device according to claim 3, characterized in that: The data monitoring module includes: An aerial photography module, which controls video recording, audio collection and photo shooting of the designated location; A laser ranging module, the laser ranging module controls the measurement of the distance and height of each position in the corresponding video in the video recording and the corresponding photo in the photo shooting; a 3D laser scanning module, the 3D laser scanning module controlling a 3D scan of the terrain at the designated location; and A GPS module is used to obtain GPS information of the designated location where the vehicle-mounted drone is located.

7. The vehicle-mounted drone beyond-visual-range road condition detection device according to claim 6, characterized in that: The fusion data acquisition module, the data processing module, the return control module, the range control module, and the on-board computer are installed on the vehicle, and the aerial photography module, the laser ranging module, the 3D laser scanning module and the GPS module are all installed on the vehicle-mounted drone.

8. The vehicle-mounted drone beyond-visual-range road condition detection device according to claim 1, characterized in that: The fusion data acquisition module comprises: A navigation data acquisition module, which acquires map navigation data when the vehicle is traveling; and A satellite data acquisition module collects satellite big data of historical weather and historical photo images, current weather and photo images of the detection location of the vehicle-mounted drone.

9. The vehicle-mounted drone beyond-visual-range road condition detection device according to claim 1, characterized in that: The data processing module comprises: A data return module, wherein the data return module controls the map navigation data, satellite data and drone on-site beyond-visual-range perception data corresponding to the designated location to be returned to the on-board computer; A fusion processing module, which compares and confirms the coordinates transmitted back to the on-board computer with the photo images and road network information of the same coordinates on the map navigation server and the satellite data server, and generates a 3D fused image with big data information; and A data sharing module controls the provision of the road condition information corresponding to the designated location and the road condition information of the designated location shared by other people on the network to the on-board computer.

10. A method for detecting road conditions beyond visual range using a vehicle-mounted drone, characterized in that: The steps include: S1: Control the vehicle-mounted drone to fly to a designated location within an effective range outside the field of vision perceived by the driver, and control the vehicle-mounted drone to collect the corresponding drone on-site beyond-visual-range perception data at the designated location; S2: Control the collection of map navigation data, satellite data and on-site beyond-visual-range perception data of the UAV corresponding to the designated location; S3: Control the map navigation data, the satellite data and the drone on-site beyond-visual-range perception data to be transmitted back to the on-board computer, perform fusion calculation and generate corresponding three-dimensional terrain; S4: Collecting a control signal for completing terrain detection, and controlling the vehicle-mounted UAV to return to the corresponding transceiver compartment of the vehicle for storage and charging.

11. A computer-readable storage medium, characterized in that: The storage medium stores at least one instruction, which is loaded and executed by the processor to implement the method as claimed in claim 10.

Citation Information

Patent Citations

  • Vehicular beyond visual range navigation system based on unmanned aerial vehicle and method

    CN106197464A

  • Multi-source data management and control platform based on airspace-ground integration

    CN108832986A

  • Navigation positioning method based on multi-source data fusion and storage medium

    CN113959438A

  • Map creation and localization for autonomous driving applications

    CN114667437A

  • Over-the-horizon perception system based on vehicle, road and unmanned aerial vehicle information fusion

    CN114783184A

Cited By

  • Vehicle navigation control method, electronic equipment and vehicle

    CN121252843A