Data processing method, device, system and medium

By integrating cameras and radars on drones, acquiring and packaging data to analyze the compatibility of radar processing algorithms, the problem of radar data being unable to be optimized after processing is solved, and the accuracy and sensitivity of drone obstacle avoidance are improved.

CN114217316BActive Publication Date: 2025-09-30AUTEL ROBOTICS CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202111522246.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-13
Publication Date
2025-09-30
Estimated Expiration
2041-12-13

AI Technical Summary

Technical Problem

In existing drone obstacle avoidance technology, the radar processing algorithm cannot be optimized after radar data processing, resulting in imperfect obstacle avoidance function.

Method used

By integrating cameras and radars on drones, we can acquire and package radar and camera data, perform data association based on timestamps, analyze the matching between radar-processed data and original data, and determine whether the radar processing algorithm needs to be optimized.

Benefits of technology

The radar processing algorithm has been optimized, the accuracy and sensitivity of the drone's obstacle avoidance have been improved, and the data processing cost has been reduced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114217316B_ABST
    Figure CN114217316B_ABST
Patent Text Reader

Abstract

Embodiments of the present invention disclose a data processing method, device, system, and medium. The method is applied to a data processing system, in which the electronic equipment, camera, and radar in the data processing system are all fixed to an unmanned aerial vehicle. When the unmanned aerial vehicle flies in a target area, the electronic equipment obtains first data obtained by the radar detecting a target object in the target area, and obtains second data obtained by the camera detecting the target object; the electronic equipment packages the first data and the second data according to a timestamp to obtain raw data associated with the target object; the electronic equipment obtains third data from the radar, which is the data obtained after the radar processes the first data; and the electronic equipment determines whether the radar processing algorithm needs to be optimized based on the third data and the raw data. Using the above technical solution, the accuracy of the radar's internal algorithm in processing the first data can be determined, and the technical effect of optimizing the radar processing algorithm based on the raw data can be achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of drone technology, and more particularly to a data processing method, device, system, and medium. Background Art

[0002] With the development of society, drones are widely used in various fields such as military, surveying and mapping, and aerial photography due to their advantages such as small size, low cost, and good maneuverability. During the flight of drones, obstacle avoidance technology is also increasingly needed to ensure the safety of drones.

[0003] Drones have different obstacle avoidance requirements in different application scenarios. For example, when inspecting construction sites, drones need to maintain a specific distance or angle from the main structure to avoid possible collisions. When inspecting towers, they must be able to avoid delicate wires to avoid becoming entangled in them, which could cause danger. During flight, drones use radar sensors to collect information about their surroundings. If an obstacle is detected, the radar sensor analyzes the data and determines the distance from the current position to the obstacle. Based on this distance, the drone is instructed to perform corresponding actions, thereby achieving obstacle avoidance.

[0004] In order to analyze the performance of radar sensors and thus improve the drone's "obstacle avoidance" function, it is necessary to accumulate radar data from multiple scenarios, multiple environments, and multiple working conditions. However, the radar data obtained by existing solutions are all processed data, which cannot optimize the radar processing algorithm. Summary of the Invention

[0005] Embodiments of the present invention provide a data processing method, device, system, and medium, which can optimize existing data processing solutions to optimize radar processing algorithms by processing data.

[0006] In a first aspect, an embodiment of the present invention provides a data processing method, which is applied to a data processing system. The data processing system includes an electronic device, a camera, a radar, and a drone. The electronic device, the camera, and the radar are all fixed to the drone, and the drone flies in a target area. The method includes:

[0007] The electronic device acquires first data obtained by the radar detecting a target object in the target area, and acquires second data obtained by the camera detecting the target object;

[0008] The electronic device packages the first data and the second data according to the timestamp to obtain original data associated with the target object;

[0009] The electronic device acquires third data from the radar, where the third data is data obtained after the radar processes the first data;

[0010] The electronic device determines whether a processing algorithm of the radar needs to be optimized based on the third data and the original data.

[0011] Furthermore, the electronic device determines whether it is necessary to optimize the processing algorithm of the radar based on the third data and the original data, including:

[0012] The electronic device processes the raw data to obtain target data;

[0013] The electronic device determines whether the third data matches the target data;

[0014] If the third data does not match the target data, it is determined that the processing algorithm of the radar needs to be optimized.

[0015] Furthermore, the electronic device processes the original data to obtain target data, including:

[0016] The electronic device analyzes the first data using the second data as reference information of the target object to obtain interference data and non-interference data of the target object;

[0017] The electronic device performs noise reduction processing on the interference data contained in the first data using a preset noise reduction algorithm, and processes the non-interference data using a preset processing algorithm to obtain target data associated with the target object.

[0018] Furthermore, after determining that the processing algorithm of the radar needs to be optimized, the method further includes:

[0019] The electronic device sends the target data to the cloud server, so that the server optimizes the processing algorithm of the radar based on the target data.

[0020] Furthermore, the electronic device packages the first data and the second data according to the timestamp to obtain original data associated with the target object, including:

[0021] The electronic device performs analog-to-digital conversion on the first data to obtain digital data corresponding to the first data;

[0022] The electronic device packages the digital data and the second data according to the timestamp to obtain original data associated with the target object.

[0023] Furthermore, the electronic device obtains the first data from the radar through local area network communication, and obtains the second data from the camera through local area network communication.

[0024] Furthermore, the electronic device obtains the third data from the radar through serial communication.

[0025] In a second aspect, an embodiment of the present invention provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the data processing method provided in the embodiment of the present invention is implemented.

[0026] In a third aspect, an embodiment of the present invention provides a data processing system, which includes a camera, a radar, a drone and an electronic device, wherein the electronic device, the camera and the radar are all fixed on the drone, and the electronic device in the data processing system is used to execute the data processing method provided in the embodiment of the present invention.

[0027] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the data processing method provided in the embodiment of the present invention.

[0028] The data processing solution provided in the embodiment of the present invention is applied to a data processing system, in which the electronic equipment, camera and radar in the data processing system are all fixed on a drone. When the drone flies in a target area, the electronic equipment first obtains the first data obtained by the radar detecting the target object in the target area, and obtains the second data obtained by the camera detecting the target object; the electronic equipment then packages the first data and the second data according to the timestamp to obtain the original data associated with the target object; the electronic equipment obtains the third data from the radar, which is the data obtained after the radar processes the first data; and the electronic equipment finally determines whether it is necessary to optimize the radar processing algorithm based on the third data and the original data. By adopting the above technical solution, the original data obtained by the radar when detecting the target object in the target area and the third data obtained after the radar processes the first data can be combined with the second data obtained by the camera detecting the target object to perform a comparison analysis, thereby determining the accuracy of the radar internal algorithm in processing the first data, and achieving the technical effect of optimizing the radar processing algorithm based on the original data. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1a A flowchart of a data processing method provided in Example 1 of the present invention;

[0030] Figure 1b A structural block diagram of a data processing system provided in Example 1 of the present invention;

[0031] Figure 2a A flowchart of a data processing method provided in Embodiment 2 of the present invention;

[0032] Figure 2b A logic block diagram of a data processing method provided in the second embodiment of the present invention;

[0033] Figure 3 A structural block diagram of a data processing device provided in Embodiment 3 of the present invention;

[0034] Figure 4 This is a structural block diagram of an electronic device provided in Example 4 of the present invention. DETAILED DESCRIPTION

[0035] The technical solution of the present invention will be further described below with reference to the accompanying drawings and through specific embodiments. It will be understood that the specific embodiments described herein are intended only to illustrate the present invention and are not intended to limit the present invention. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present invention, not all of the structures.

[0036] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe the steps as sequential processes, many of the steps can be implemented in parallel, concurrently, or simultaneously. In addition, the order of the steps can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the accompanying drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0037] Example 1

[0038] Figure 1a This is a flow chart of a data processing method provided in the first embodiment of the present invention. The method can be executed by a data processing device, wherein the device can be implemented by software and / or hardware and is generally used in a data processing system. Figure 1b , Figure 1b This is a structural block diagram of a data processing system provided in Example 1 of the present invention.

[0039] The above-mentioned data processing system includes electronic equipment, a camera, a radar and a drone, wherein the electronic equipment, the camera and the radar are all fixed on the drone. When the drone flies in the target area, the above-mentioned data processing system can be used to execute the data processing method provided in the embodiment of the present invention.

[0040] Optionally, when securing the electronic equipment, camera, and radar to the drone, a bracket can be provided to secure the electronic equipment, camera, and radar to the bracket. The bracket can then be provided with screw holes or fasteners to secure the electronic equipment, camera, and radar to the drone. Alternatively, the electronic equipment, camera, and radar can be directly secured to the drone by gluing or screwing. The specific method for securing the electronic equipment, camera, and radar to the drone is not limited herein.

[0041] It should be noted that charging interfaces are respectively provided on the radar, camera and electronic equipment, and the charging interfaces are connected to the drone via a universal serial bus (USB); the drone provides power to the radar, the camera and electronic equipment through the charging interfaces.

[0042] like Figure 1a As shown, the data processing method provided by the embodiment of the present invention includes:

[0043] S110: The electronic device obtains first data obtained by detecting a target object in a target area by a radar, and obtains second data obtained by detecting the target object by a camera.

[0044] In order to optimize the radar processing algorithm, the radar needs to accumulate raw data from multiple scenes, multiple environments, and multiple working conditions. Therefore, the data processing method provided in the embodiment of the present invention can enable the drone to fly in the target area when obtaining the raw data. The target area can be manually set according to the test requirements of the tester. In addition to the target object, the target area can also include other objects related to the target object to achieve the technical effect of simulating the real environment in the target area.

[0045] For example, using a drone conducting an aerial inspection as an example, the target area could be configured with utility poles, trees, tall buildings, flying birds, and thin wires. This allows the radar to collect data about these objects in addition to the target object, allowing analysis of their impact on the target object's data. The specific target objects within the target area are not limited here and are determined by the tester's actual needs.

[0046] When a drone detects a target object while flying in a target area, the radar fixed on the drone can emit electromagnetic waves through the transmitter of the internal sensor. When the electromagnetic waves touch the target object, the point cloud data of the electromagnetic waves can be fed back to the receiver of the internal sensor. The current point cloud data of the electromagnetic waves can represent the first data when the target object in the target area is detected.

[0047] The target object isn't necessarily a fixed object within the target area. During drone flight, the radar's detection range changes accordingly. For example, consider a drone performing an aerial inspection. Within the target area, within the radar's detection range, data about a utility pole close to the drone can be detected. In this case, the current target object could be the utility pole. At this moment, in addition to the detected utility pole data, data about tall buildings and trees within the radar transmitter's signal range surrounding the pole could also be detected. As the drone flies, subtle data about wires might also be detected when the drone is relatively close to the pole. In this case, the pole and wires could be the target objects.

[0048] Furthermore, in order to clarify the actual environment when the first data is obtained within the radar detection range, the data processing method provided in the embodiment of the present invention is also equipped with a camera on the drone. When the drone is flying, the camera can capture the actual environmental data in the target area in real time, and the current data is the second data.

[0049] It should be noted that the second data may be photo data or video data captured by a camera, and the specific type of the second data is not limited here.

[0050] The electronic device acquires first data obtained by detecting a target object in a target area by a radar, and acquires second data obtained by detecting the target object by a camera. The electronic device may be a device composed of a hardware system and a software system capable of independently operating to perform a specific function. For example, the device may be a physical electronic device including a memory and a processor, specifically a laptop computer, a tablet computer, an ultrabook, etc. The specific type of electronic device is not limited herein.

[0051] Optionally, the electronic device obtains the first data from the radar through local area network communication, and obtains the second data from the camera through local area network communication.

[0052] Among them, the above-mentioned local area network can be Ethernet, a wireless transmission module is set in the camera and the radar, and a wireless receiving module is set in the electronic device. The wireless transmission module and the wireless receiving module transmit the collected first data and second data to the electronic device via Ethernet.

[0053] S120: The electronic device packages the first data and the second data according to the timestamp to obtain original data associated with the target object.

[0054] Since the first data is the signal data of the radar when it detects the target object, and the second data is the environmental data in the target area when the camera captures the target object, in order to facilitate the analysis of the first data and the second data at the same time, the electronic device can package the first data and the second data obtained at the same time through the timestamp and store them in the corresponding position of the electronic device, thereby obtaining the original data associated with the target object.

[0055] It should be noted that since both the camera and radar are mounted on the drone, as the drone's flight attitude changes over the target area, the first data received by the radar receiver and the second data collected by the camera within its field of view will also change accordingly. When the first and second data are transmitted to the electronic device, they are time-stamped according to the time of acquisition. This ensures that when the electronic device packages the first and second data based on the timestamps, the first and second data, at the same timestamp, represent the original data collected at the same time for the target object.

[0056] S130: The electronic device obtains third data from the radar, where the third data is data obtained after the radar processes the first data.

[0057] During flight, the drone collects environmental information around the target area through the radar's internal sensors. If a target object is detected, the radar analyzes and processes the first data obtained in step S110 to obtain third data. The radar then obtains the distance from the current position to the target object based on the analysis of the third data, and instructs the drone to perform corresponding action instructions based on the current distance, thereby achieving the purpose of "obstacle avoidance".

[0058] The current third data may be point track data and track data obtained after the radar processes the first data. The point track data is obtained by the radar when it detects a target object and can be used to reflect the characteristics of data points after the radar has initially processed the first data when detecting the target object. For example, the current initial processing may include removing abnormal data from the first data or performing noise reduction on the first data, and the specific initial processing method is not limited here. The track data is obtained by the radar after clustering the point track data using a preset clustering algorithm. The track data can be used to represent the characteristics of the target object within the radar's detection range.

[0059] The above-mentioned preset clustering algorithm can be: K-Means clustering algorithm, mean shift clustering or density-based clustering method (DBSCAN), etc. The type of specific clustering algorithm is not limited here.

[0060] Optionally, the electronic device may package the first data, the second data, and the third data and store them in corresponding locations according to the timestamp to obtain original data and processed data related to the target object.

[0061] It should be noted that the above step S120 corresponds to the process of packaging the first data and the second data according to the timestamp after obtaining the first data and the second data, and step S130 corresponds to the process of obtaining the third data after the radar processes the first data. These two processes are independent of each other, and the embodiment of the present application does not limit the execution order of the two processes.

[0062] The specific execution order of the above two processes needs to be determined based on actual conditions, so the actual execution can be carried out in the order described in the above embodiments of this application, or step S130 can be executed first and then step S120.

[0063] Optionally, the electronic device obtains the third data from the radar via a serial communication method, that is, the radar sends the third data to the electronic device via a serial interface.

[0064] A serial interface is an expansion interface that uses serial communication, meaning data is transmitted sequentially, bit by bit. A serial interface is characterized by simple communication lines; a single pair of transmission lines allows for bidirectional communication, significantly reducing data transmission costs. These serial interfaces can be RS-232-C, RS-422, RS485, or USB, and the specific serial interface model is not limited here.

[0065] S140: The electronic device determines whether it is necessary to optimize the radar processing algorithm based on the third data and the original data.

[0066] In electronic devices, by storing, based on timestamps, the third data output by a radar at the same moment and the original data obtained when the radar detected a target object, a comparison analysis can be performed on the original data and the third data at each moment. For example, this analysis can include analyzing the impact of signals from other data associated with the target object on signals related to the target object, or analyzing the accuracy of the third data processed by the radar. This allows testers to determine whether the radar processing algorithm needs to be optimized to achieve more accurate target object recognition in actual applications, thereby achieving more sensitive obstacle avoidance for drones.

[0067] Optionally, when it is determined that the radar processing algorithm needs to be optimized, the optimization process can be to adjust the characteristic parameters of the radar processing algorithm, adjust the signal noise threshold, or adjust the filter inside the radar, etc. The specific method of optimizing the radar processing algorithm based on the original data is not limited here.

[0068] The data processing method provided in an embodiment of the present invention is applied to a data processing system, in which the electronic equipment, camera, and radar in the data processing system are all fixed on an unmanned aerial vehicle. When the unmanned aerial vehicle flies in a target area, the electronic equipment first obtains first data obtained by the radar detecting a target object in the target area, and obtains second data obtained by the camera detecting the target object; the electronic equipment then packages the first data and the second data according to the timestamp to obtain the original data associated with the target object; the electronic equipment obtains third data from the radar, which is the data obtained after the radar processes the first data; and the electronic equipment finally determines whether the radar processing algorithm needs to be optimized based on the third data and the original data. By adopting the above technical solution, the original data obtained by the radar when detecting the target object in the target area and the third data obtained after the radar processes the first data can be combined with the second data obtained by the camera detecting the target object to perform a comparison analysis, thereby determining the accuracy of the radar internal algorithm in processing the first data, and achieving the technical effect of optimizing the radar processing algorithm based on the original data.

[0069] Example 2

[0070] This embodiment of the present invention further improves upon the above-described embodiment by optimizing the electronic device's determination of whether to optimize the radar's processing algorithm based on the third data and the raw data. The optimization step includes: the electronic device processing the raw data to obtain target data; the electronic device determining whether the third data matches the target data; and, if the third data does not match the target data, determining that the radar's processing algorithm needs to be optimized. This configuration has the advantage of processing the collected raw data, resulting in more accurate optimization results when optimizing the radar's processing algorithm based on the third data and target data.

[0071] The electronic device also optimizes the steps of packaging the first and second data based on the timestamp to obtain the original data associated with the target object, including: performing analog-to-digital conversion on the first data to obtain digital data corresponding to the first data; and packaging the digital data with the second data based on the timestamp to obtain the original data associated with the target object. This arrangement has the advantage of ensuring that the first and second data are generated at the same time when analyzing the first data using the second data as a reference, thereby improving the accuracy of the analysis results.

[0072] like Figure 2a As shown, Figure 2a A flowchart of a data processing method provided in Embodiment 2 of the present invention is provided. Specifically, the method includes the following steps:

[0073] S210: The electronic device obtains first data obtained by detecting a target object in a target area by a radar, and obtains second data obtained by detecting the target object by a camera.

[0074] S220: The electronic device performs analog-to-digital conversion on the first data to obtain digital data corresponding to the first data.

[0075] Since the first data received from the radar receiver is analog data, in order to facilitate the analysis of the first data, an analog-to-digital converter (ADC) can be provided in the electronic device to convert the analog data of the obtained first data into digital data, so that the speed, distance, angle and other attribute information of the drone when detecting the target object can be analyzed based on the digital data corresponding to the first data.

[0076] S230: The electronic device packages the digital data and the second data according to the timestamp to obtain original data associated with the target object.

[0077] When the digital data corresponding to the first data is packaged with the second data based on the timestamp, the current timestamp is the timestamp when the first data was obtained, not the timestamp when the first data was converted to digital data, to ensure data accuracy during subsequent data analysis. Thus, the digital data corresponding to the first data and the second data are packaged based on the timestamp to obtain the original data associated with the target object.

[0078] Optionally, when the electronic device stores digital data and second data, they can be stored in the form of data packets, that is, the data obtained in the current time period is packaged and stored every preset time period, and a corresponding time tag is added to each data packet to distinguish the obtained data.

[0079] S240: The electronic device processes the original data to obtain target data.

[0080] Since the first data contained in the original data may contain interfering digital signals or abnormal digital signals, in order to ensure the accuracy of data analysis, the first data contained in the original data can be processed to obtain target data when the radar detects the target object. The current target data includes the processed first data and the second data obtained by the camera.

[0081] In an optional embodiment, the electronic device processes raw data to obtain target data, including: parsing first data using second data as reference information of the target object to obtain interference data and non-interference data of the target object. The electronic device uses a preset noise reduction algorithm to reduce noise in the interference data contained in the first data, and uses a preset processing algorithm to process the non-interference data to obtain target data associated with the target object.

[0082] Among them, the above-mentioned preset noise reduction algorithm can be a constant false alarm rate (CFAR) algorithm; the above-mentioned preset processing algorithm can include: a one-dimensional fast Fourier transform (1Dimensions Fast Fourier Transform, referred to as 1DFFT) algorithm, a two-dimensional Doppler fast Fourier transform algorithm (2DFFT), a digital beam forming (Digital Beam Forming, referred to as DBF) algorithm and at least one of a Kalman filter algorithm.

[0083] Please refer to Figure 2b , Figure 2b This is a logic block diagram of a data processing method provided in the second embodiment of the present invention. In this embodiment of the present invention, the electronic device obtains raw data, and then processes the raw data according to the above-mentioned preset noise reduction algorithm and preset processing algorithm to obtain target data. The process may be:

[0084] When the radar detects a target object, the electronic device can obtain the third data processed by the radar through the serial port, and obtain the first data when the radar detects the target object and the second data collected by the camera through the local area network; the electronic device can parse the third data into point data and track data, and convert the first data into digital data through the AD sampler, and then perform secondary processing on the current digital data; first, the second data is associated with the first data according to the timestamp to determine whether the target data comes from the same target object; then, with the second data as a reference, the constant false alarm rate algorithm can filter out the interference data in the first data to extract non-interference data; then, the one-dimensional fast Fourier transform algorithm can be used to obtain the distance between the drone and the target object; the two-dimensional Doppler fast Fourier transform algorithm can be used to obtain the speed of the target object; the digital beam synthesis algorithm can be used to predict the angle of the drone relative to the target object; finally, the Kalman filter algorithm is used to filter the noise data and interference data to obtain target data associated with the target object.

[0085] S250: The electronic device determines whether the third data matches the target data.

[0086] Since the data of the target object obtained in different time periods are different, the radar processing methods for different target objects may be different, and since the target data is collected in real time during the flight of the UAV, if the third data at the current moment matches the target data, the target data corresponding to the next time period can be re-acquired, and step S210 is executed again; if there is no match, step S260 is executed.

[0087] It should be noted that when analyzing whether the third data matches the target data, the current data can be the data in a data packet when stored in subpackets. In order to reflect the diversity of the data, the data contained in multiple data packets can also be analyzed together. The specific analysis method is not limited here.

[0088] Furthermore, when determining whether the third data matches the target data, the result of the target data is not necessarily completely consistent with the third data. The current match can be a matching rate. When the matching rate between the third data and the target data is greater than a preset threshold, it is considered a match. If it is less than the preset threshold, it is considered a mismatch.

[0089] The current preset threshold may be 80%, 85% or 90%, etc. The specific value of the preset threshold is not limited here and is subject to the actual needs of the R&D personnel.

[0090] Optionally, the target data may be parsed into point data and track data, and then compared with the point data and track data contained in the third data. The specific method of determining whether the third data matches the target data is not limited here.

[0091] S260: If the third data does not match the target data, it is determined that the radar processing algorithm needs to be optimized.

[0092] When it is determined that the radar processing algorithm needs to be optimized, the target data can be analyzed on the current client to achieve the purpose of optimizing the radar processing algorithm, or the target data can be sent to the cloud server to optimize the radar processing algorithm based on the target data. The advantage of doing so is that data sharing can be achieved. Remote personnel can log in to the cloud server client and access and view the required data in real time to analyze the data and achieve the purpose of optimizing the radar processing algorithm.

[0093] Please continue to refer to Figure 2b , when sending the target data to the cloud server, the current data processing system also includes: a cloud server, and the cloud server and the electronic device are connected to each other through a fourth-generation mobile communication technology (4G) / fifth-generation mobile communication technology (5G) base station communication.

[0094] When it is determined that the radar processing algorithm needs to be optimized, the optimization process can be to adjust the characteristic parameters of the radar processing algorithm, adjust the signal noise threshold, or adjust the filter inside the radar, etc. The specific method of optimizing the radar processing algorithm based on the original data is not limited here.

[0095] The data processing method provided by the embodiments of the present invention can cost-effectively address the lack of raw data during radar development. By processing the collected raw data to obtain target data, the radar's processing algorithm can be optimized based on the target data and analyzed with radar-processed third-party data, thereby improving radar performance. Furthermore, the target data and third-party data can be wirelessly transmitted to a cloud platform, enabling data sharing and enabling further data analysis and processing by remote personnel.

[0096] Example 3

[0097] Figure 3 This is a block diagram of the structure of a data processing device provided in the third embodiment of the present invention. The device can be implemented by software and / or hardware and can generally be integrated into a computer device such as a server. The device can process data by executing a data processing method to optimize the radar processing algorithm by processing the data. The data processing device is integrated into a data processing system, which also includes a camera, a radar, and a drone. The electronic device, the camera, and the radar are all fixed on the drone, and the drone flies in a target area, such as Figure 3 As shown, the device includes: a first acquisition module 31, a packaging module 32, a second acquisition module 33 and a determination module 34, wherein:

[0098] A first acquisition module 31 is configured to acquire first data obtained by the radar detecting a target object in the target area, and to acquire second data obtained by the camera detecting the target object;

[0099] a packaging module 32, configured to package the first data and the second data according to the timestamp to obtain original data associated with the target object;

[0100] A second acquisition module 33 is configured to acquire third data from the radar, where the third data is data obtained after the radar processes the first data;

[0101] The determination module 34 is configured to determine whether the processing algorithm of the radar needs to be optimized based on the third data and the original data.

[0102] The data processing device provided in an embodiment of the present invention is applied to a data processing system, in which the electronic equipment, camera, and radar in the data processing system are all fixed on an unmanned aerial vehicle. When the unmanned aerial vehicle flies in a target area, the electronic equipment first obtains first data obtained by the radar detecting a target object in the target area, and obtains second data obtained by the camera detecting the target object; the electronic equipment then packages the first data and the second data according to the timestamp to obtain original data associated with the target object; the electronic equipment obtains third data from the radar, which is the data obtained after the radar processes the first data; and the electronic equipment finally determines whether it is necessary to optimize the radar processing algorithm based on the third data and the original data. By adopting the above technical solution, the original data obtained by the radar when detecting the target object in the target area and the third data obtained after the radar processes the first data can be combined with the second data obtained by the camera detecting the target object to perform a comparison analysis, thereby determining the accuracy of the radar internal algorithm in processing the first data, and achieving the technical effect of optimizing the radar processing algorithm based on the original data.

[0103] Optionally, the determining module 34 includes: a processing unit, a first determining unit, and a second determining unit, wherein:

[0104] a processing unit, configured to process the raw data to obtain target data;

[0105] a first determining unit, configured to determine whether the third data matches the target data;

[0106] The second determining unit is configured to determine that a processing algorithm of the radar needs to be optimized if the third data does not match the target data.

[0107] Optionally, the processing unit includes: a parsing subunit and a processing subunit, wherein:

[0108] a parsing subunit, configured for the electronic device to parse the first data using the second data as reference information of the target object to obtain interference data and non-interference data of the target object;

[0109] The processing subunit is configured to perform noise reduction processing on the interference data contained in the first data using a preset noise reduction algorithm, and to process the non-interference data using a preset processing algorithm to obtain target data associated with the target object.

[0110] Optionally, the device further comprises: an optimization module, wherein:

[0111] An optimization module is used to send the target data to the cloud server so that the server optimizes the processing algorithm of the radar based on the target data.

[0112] Optionally, the packaging module 32 includes: a conversion unit and a packaging unit, wherein:

[0113] a conversion unit, configured to perform analog-to-digital conversion on the first data to obtain digital data corresponding to the first data;

[0114] A packaging unit is used to package the digital data and the second data according to the timestamp to obtain original data associated with the target object.

[0115] Optionally, the data processing device obtains the first data from the radar through local area network communication, and obtains the second data from the camera through local area network communication.

[0116] Optionally, the data processing device obtains the third data from the radar via serial communication.

[0117] The data processing device provided by the embodiment of the present invention can execute the data processing method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the method.

[0118] Example 4

[0119] Please refer to Figure 4 , Figure 4 This is a structural block diagram of an electronic device provided in Embodiment 4 of the present invention. The electronic device 400 may include: a memory 401, a processor 402, and a computer program stored in the memory 401 and executable by the processor. When the processor 402 executes the computer program, the data processing method according to the embodiment of the present invention is implemented.

[0120] The data processing system provided by the embodiment of the present invention can execute the data processing method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the method.

[0121] Example 5

[0122] The embodiment of the present invention provides a data processing system, please continue to refer to Figure 1b The data processing system includes a camera, a radar, a drone, and electronic equipment, wherein the electronic equipment, the camera, and the radar are all fixed to the drone. The electronic equipment in the data processing system is used to execute the data processing method as described in the embodiment of the present invention.

[0123] Example 6

[0124] An embodiment of the present invention further provides a storage medium containing computer-executable instructions. When the computer-executable instructions are executed by a computer processor, the computer-executable instructions are used for a data processing method, which is applied to a data processing system. The data processing system includes an electronic device, a camera, a radar, and a drone. The electronic device, the camera, and the radar are all fixed to the drone. The drone flies in a target area. The method includes:

[0125] The electronic device acquires first data obtained by the radar detecting a target object in the target area, and acquires second data obtained by the camera detecting the target object;

[0126] The electronic device packages the first data and the second data according to the timestamp to obtain original data associated with the target object;

[0127] The electronic device acquires third data from the radar, where the third data is data obtained after the radar processes the first data;

[0128] The electronic device determines whether a processing algorithm of the radar needs to be optimized based on the third data and the original data.

[0129] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROMs, floppy disks, or tape drives; computer system memory or random access memory, such as DRAM, DDRRAM, SRAM, EDORAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (such as hard disks or optical storage); registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a different second computer system that is connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media that can reside in different locations (e.g., in different computer systems connected via a network). The storage medium can store program instructions (e.g., embodied as a computer program) that can be executed by one or more processors.

[0130] Of course, the computer executable instructions of a storage medium containing computer executable instructions provided by an embodiment of the present invention are not limited to the data processing operations described above, and can also execute related operations in the data processing method provided by any embodiment of the present invention.

[0131] The data processing devices, systems, and storage media provided in the above embodiments can execute the data processing methods provided in any embodiment of the present invention, and have the corresponding functional modules and beneficial effects of executing the methods. For technical details not fully described in the above embodiments, please refer to the data processing methods provided in any embodiment of the present invention.

[0132] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the concept of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. A data processing method, characterized in that: Applied to a data processing system, the data processing system includes electronic equipment, a camera, a radar, and a drone, wherein the electronic equipment, the camera, and the radar are all fixed on the drone, and the drone flies in a target area, the method comprising: The electronic device acquires first data obtained by the radar detecting a target object in the target area, and acquires second data obtained by the camera detecting the target object; The electronic device packages the first data and the second data according to the timestamp to obtain original data associated with the target object; The electronic device acquires third data from the radar, where the third data is data obtained after the radar processes the first data; The electronic device determines whether a processing algorithm of the radar needs to be optimized based on the third data and the original data; The electronic device determines whether it is necessary to optimize a processing algorithm of the radar based on the third data and the original data, including: The electronic device processes the raw data to obtain target data; The electronic device determines whether the third data matches the target data; If the third data does not match the target data, determining that a processing algorithm of the radar needs to be optimized; The electronic device processes the original data to obtain target data, including: The electronic device analyzes the first data using the second data as reference information of the target object to obtain interference data and non-interference data of the target object; The electronic device performs noise reduction processing on the interference data contained in the first data using a preset noise reduction algorithm, and processes the non-interference data using a preset processing algorithm to obtain target data associated with the target object.

2. The method according to claim 1, characterized in that After determining that the radar processing algorithm needs to be optimized, the method further includes: The electronic device sends the target data to a cloud server, so that the cloud server optimizes a processing algorithm of the radar based on the target data.

3. The method according to claim 1, characterized in that The electronic device packages the first data and the second data according to the timestamp to obtain original data associated with the target object, including: The electronic device performs analog-to-digital conversion on the first data to obtain digital data corresponding to the first data; The electronic device packages the digital data and the second data according to the timestamp to obtain original data associated with the target object.

4. The method according to claim 1, wherein The electronic device obtains the first data from the radar through local area network communication, and obtains the second data from the camera through local area network communication.

5. The method according to claim 1, wherein The electronic device obtains the third data from the radar through serial communication.

6. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 5 is implemented.

7. A data processing system, characterized in that: include: A camera, a radar, a drone, and the electronic device as claimed in claim 6, wherein the electronic device, the camera, and the radar are all fixed on the drone.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Citation Information

Patent Citations

  • Millimeter wave radar detection system and detection method based on visual information

    CN112946627A