Automatic driving data processing method and device, equipment and storage medium

By normalizing and correlating the format of autonomous driving data, the high cost and inefficiency problems caused by the difference in formats of multiple sources are solved, and the effective management and use of data is realized, which is convenient for the iterative development of autonomous driving technology.

CN118964868APending Publication Date: 2024-11-15CHINA FAW CO LTD +1
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN202410943368.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-15
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

Due to the difference in formats, the subsequent data processing and application cost is high and the data is insufficient. How to effectively manage and use differentiated autonomous driving data from multiple sources is an important issue.

Method used

By reading the original data in the autonomous driving data packet and normalizing the format based on the preset standard data format, standard autonomous driving data is obtained, and then data correlation and display based on the attribute information of the standard data is realized to achieve different categories of data Relevance and management.

Benefits of technology

It reduces data management costs, extends the validity period of data, facilitates subsequent data processing and application, and improves data usage efficiency and consistency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118964868A_ABST
    Figure CN118964868A_ABST
Patent Text Reader

Abstract

The invention discloses an automatic driving data processing method and device, equipment and a storage medium, and relates to the technical field of intelligent driving. The automatic driving data processing method comprises the steps of reading original automatic driving data in an automatic driving data packet, and performing format normalization on the original automatic driving data based on a preset standard data format to obtain standard automatic driving data; the automatic driving data packet comprises various types of original automatic driving data, and each type corresponds to one standard data format; based on the attribute information of the original automatic driving data associated with the standard automatic driving data, performing data association on different types of standard automatic driving data; and performing association display on the standard automatic driving data based on the association relationship of the standard automatic driving data. According to the technical scheme of the embodiment of the invention, format normalization and data association can be carried out on automatic driving data from different sources, and subsequent data processing and application are facilitated.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent driving technology, and in particular to an automatic driving data processing method, device, equipment and storage medium. Background Art

[0002] With the increasing application of technology in transportation, autonomous driving technology has emerged. The upgrade of autonomous driving functions and the optimization of algorithms rely on a large amount of effective real-world vehicle data.

[0003] There are many sources of data in the process of autonomous driving. Due to cost and other factors, the data formats of various data sources will be different, which will lead to a series of problems such as high cost and insufficient use of subsequent data processing and application. How to manage and use differentiated autonomous driving data from multiple sources is very important for the subsequent iteration of autonomous driving technology. Summary of the invention

[0004] The present invention provides an autonomous driving data processing method, device, equipment and storage medium to solve the problem that format differences of autonomous driving data from multiple sources lead to high subsequent data processing and application costs and insufficient data utilization.

[0005] According to one aspect of the present invention, there is provided a method for processing autonomous driving data, comprising:

[0006] Reading original autonomous driving data in an autonomous driving data packet, and normalizing the format of the original autonomous driving data based on a preset standard data format to obtain standard autonomous driving data; the autonomous driving data packet contains multiple categories of original autonomous driving data, each category corresponding to a standard data format;

[0007] Based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, data association is performed on the standard autonomous driving data of different categories;

[0008] Based on the association relationship of the standard autonomous driving data, the standard autonomous driving data is displayed in an associated manner.

[0009] According to another aspect of the present invention, there is provided an automatic driving data processing device, comprising:

[0010] a format normalization module, configured to read raw autonomous driving data in an autonomous driving data packet, and perform format normalization on the raw autonomous driving data based on a preset standard data format to obtain standard autonomous driving data; the autonomous driving data packet includes raw autonomous driving data of multiple categories, each category corresponding to a standard data format;

[0011] A data association module, for performing data association on different categories of standard autonomous driving data based on attribute information of original autonomous driving data associated with the standard autonomous driving data;

[0012] An association display module is used to display the standard autonomous driving data in an associated manner based on the association relationship of the standard autonomous driving data.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the autonomous driving data processing method described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the autonomous driving data processing method described in any embodiment of the present invention when executed.

[0018] According to another aspect of the present invention, a computer program product is provided, including a computer program, which implements the autonomous driving data processing method of any embodiment of the present disclosure when executed by a processor.

[0019] The technical solution of the embodiment of the present invention, after reading the original autonomous driving data in the autonomous driving data packet, performs format normalization on the original autonomous driving data based on a preset standard data format to obtain standard autonomous driving data, and then performs data association on different categories of standard autonomous driving data based on attribute information of the original autonomous driving data associated with the standard autonomous driving data, and finally performs associated display on the standard autonomous driving data based on the association relationship of the standard autonomous driving data. The autonomous driving data from different sources can be format normalized and data associated, which is convenient for subsequent data processing and application.

[0020] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 is a flowchart of an automatic driving data processing method provided according to Embodiment 1 of the present invention;

[0023] Figure 2a is a flowchart of an automatic driving data processing method provided according to Embodiment 2 of the present invention;

[0024] Figure 2b is a schematic diagram of data format normalization provided in Embodiment 2 of the present invention;

[0025] Figure 2c is a schematic diagram of data association provided according to Embodiment 2 of the present invention;

[0026] Figure 3 is a structural diagram of an automatic driving data processing device provided according to Embodiment 3 of the present invention;

[0027] Figure 4 It is a structural schematic diagram of an electronic device that implements the autonomous driving data processing method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0030] Embodiment 1

[0031] Figure 1 A flowchart of an autonomous driving data processing method is provided for the first embodiment of the present invention. This embodiment is applicable to the case of processing differentiated autonomous driving data from multiple sources. The method can be executed by an autonomous driving data processing device. The autonomous driving data processing device can be implemented in the form of hardware and / or software. The autonomous driving data processing device can be configured in various general-purpose computing devices. Figure 1 As shown, the method includes:

[0032] S110. Read the original autonomous driving data in the autonomous driving data packet, and normalize the format of the original autonomous driving data based on a preset standard data format to obtain standard autonomous driving data; the autonomous driving data packet contains multiple categories of original autonomous driving data, and each category corresponds to a standard data format.

[0033] The original autonomous driving data is data uploaded by different vehicles and contains multiple categories. For example, the original autonomous driving data may include image data captured by cameras respectively set at the front and rear ends of the vehicle, positioning information collected by the vehicle positioning system, point cloud information collected by the vehicle radar, and environmental perception information collected by other vehicle sensors, etc. The original autonomous driving data may also include prediction information and planning information obtained by prediction and planning based on the collected environmental information.

[0034] During the autonomous driving process, raw autonomous driving data will continue to be generated. The vehicle can package all the raw autonomous driving data of the vehicle into an autonomous driving data packet and upload it to the cloud at set intervals, for example, every 10 seconds. The amount of raw autonomous driving data received by the cloud is huge, and the format of the same type of data uploaded by different vehicles is different. At this time, it is necessary to consider how to post-process and visualize the autonomous driving data from multiple sources, and whether the data processing can reduce the data management cost and extend the data validity period.

[0035] The autonomous driving data package contains multiple categories of raw autonomous driving data, and the formats of the same category of raw autonomous driving data uploaded by different vehicles may be different. In order to facilitate data management and application, the cloud defines a standard data format for each category of autonomous driving data. For example, for image data, the standard data format defined by the cloud is the JPEG (Joint Photographic Experts Group) format. When the data uploaded by the autonomous driving vehicle is in binary format or Portable Network Graphics (PNG) format, the cloud will convert it to JPEG format for storage for subsequent applications.

[0036] Although the specific formats of autonomous driving data may differ, the core information they contain is basically the same, and can be mainly divided into point cloud data, image data, positioning information, perception information, prediction information, planning information, and other data. After the differentiated original autonomous driving data from multiple sources is uploaded to the cloud, they can all fall into one of the above categories. Therefore, the cloud can define a standard data format for each of the above categories. Among them, other data is a summary of the remaining data except point cloud data, image data, positioning information, perception information, prediction information, and planning information.

[0037] In an embodiment of the present invention, after receiving the autonomous driving data packet uploaded by the vehicle, the cloud reads the multiple original autonomous driving data contained in the autonomous driving data packet. Furthermore, for the pre-defined standard data format, a corresponding data format conversion tool is used to normalize the format of the original autonomous driving data to obtain standard autonomous driving data. Specifically, the original format of each item of original autonomous driving data is compared with the standard data format corresponding to the original autonomous driving data. If they are different, the original autonomous driving data needs to be converted to the standard data format. Alternatively, the original autonomous driving data is first classified to obtain the category to which the original autonomous driving data belongs, and then the standard data format associated with the category is determined. Finally, the original autonomous driving data is converted from the original data format to the standard data format. Among them, the standard autonomous driving data falls into one of point cloud data, image data, positioning information, perception information, prediction information, planning information and other data.

[0038] The differentiated raw autonomous driving data from multiple sources are converted into a standard data format defined by the cloud. After the data format is normalized, the data post-processing processes and visualization tools used in the cloud can be reused. The data after format normalization can serve the iterative development of the algorithm, extending the validity period of the data.

[0039] It is worth noting that in addition to normalizing the format of the original autonomous driving data, the cloud also provides a data format restoration tool to prevent the subsequent use of the original autonomous driving data. The data format restoration tool is the reverse of the tool used for the above data format normalization, and is used to restore the standard autonomous driving data after format normalization to the original autonomous driving data.

[0040] S120. Based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, data association is performed on different categories of standard autonomous driving data.

[0041] The attribute information of the original autonomous driving data is information used to describe the basic attributes of the original autonomous driving data. For example, the attribute information may be the collection time or collection location (i.e., positioning information) of the original autonomous driving data.

[0042] After the above format normalization process, there is no direct correlation between the obtained standard autonomous driving data. For example, by reading the standard autonomous driving data, users cannot know the positioning information corresponding to a certain picture.

[0043] In the embodiment of the present invention, in order to establish the association relationship between various types of autonomous driving data, data association is performed on different types of standard autonomous driving data based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data. For example, since each original autonomous driving data has a collection time, data association can be performed on different types of standard autonomous driving data based on the collection time of the original autonomous driving data associated with the standard autonomous driving data.

[0044] Also exemplarily, based on the collection time of the original autonomous driving data associated with the standard autonomous driving data, the positioning information associated with the original autonomous driving data at the collection time is determined, and based on the positioning information, different categories of standard autonomous driving data are positionally associated.

[0045] After data association, users can use a variety of query conditions to query data. For example, by defining a range on the map using location information, users can search for standard autonomous driving data within that range. Another example is setting a time range to query standard autonomous driving data corresponding to the original autonomous driving data collected within that time range.

[0046] S130. Based on the association relationship of the standard autonomous driving data, the standard autonomous driving data is displayed in association.

[0047] In an embodiment of the present invention, based on the association relationship of the standard autonomous driving data established above, the standard autonomous driving data is displayed in association. For example, the standard autonomous driving data can be displayed in association in the time dimension based on the collection time.

[0048] The technical solution of the embodiment of the present invention reads the original autonomous driving data in the autonomous driving data packet, normalizes the format of the original autonomous driving data based on a preset standard data format, and obtains standard autonomous driving data. Then, based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, data association is performed on different categories of standard autonomous driving data. Finally, based on the association relationship of the standard autonomous driving data, the standard autonomous driving data is associated and displayed. The format of the autonomous driving data uploaded by different vehicles can be normalized to facilitate subsequent data processing and application.

[0049] Embodiment 2

[0050] Figure 2a This is a flowchart of an autonomous driving data processing method provided in the second embodiment of the present invention. This embodiment further refines the above embodiment and provides specific steps for normalizing the format of the original autonomous driving data based on a preset standard data format to obtain standard autonomous driving data, and specific steps for data association of different categories of standard autonomous driving data based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data. Figure 2a As shown, the method includes:

[0051] S210: Read the original autonomous driving data in the autonomous driving data packet, and classify the original autonomous driving data to obtain the target category to which the original autonomous driving data belongs.

[0052] In an embodiment of the present invention, in order to facilitate the management of autonomous driving data, after reading the original autonomous driving data in the autonomous driving data packet, the original autonomous driving data is classified to obtain the target category to which the original autonomous driving data belongs, so as to determine the tool used for format normalization.

[0053] The categories of raw autonomous driving data ultimately fall into pre-defined point cloud data, image data, positioning information, perception information, prediction information, planning information, and other data.

[0054] S220. Determine a target format conversion tool that matches the original autonomous driving data based on the original data format of the original autonomous driving data, the target category, and the standard data format associated with the target category; the autonomous driving data packet contains multiple categories of original autonomous driving data, and each category corresponds to a standard data format.

[0055] In an embodiment of the present invention, after determining the target category to which the original autonomous driving data belongs, a target format conversion tool matching the original autonomous driving data can be determined based on the original data format of the original autonomous driving data, the target category, and the standard data format associated with the target category. Specifically, after determining the target category to which the original autonomous driving data belongs, the standard data format corresponding to the target category is determined. Then, in the conversion tool, a conversion tool from the original data format to the standard data format is determined as the target format conversion tool.

[0056] S230. Convert the format of the original autonomous driving data using a target format conversion tool to obtain standard autonomous driving data.

[0057] In the embodiment of the present invention, the data format normalization process is as follows: Figure 2b As shown, after determining the target format conversion tool corresponding to the original autonomous driving data currently being processed, the original autonomous driving data is format converted by the target format conversion tool to obtain standard autonomous driving data.

[0058] Optionally, when the category of the original autonomous driving data is a point cloud data category, an image data category, a positioning information category, or a perception information category, the original autonomous driving data is converted into a standard autonomous driving data by using a target format conversion tool, including:

[0059] The original autonomous driving data is format converted through a target format conversion tool to obtain standard autonomous driving data stored in a folder; the folder includes multiple data files named according to the collection time of the original autonomous driving data associated with the standard autonomous driving data.

[0060] In this optional embodiment, a specific method is provided for converting the format of the original autonomous driving data to obtain standard autonomous driving data by using a target format conversion tool when the category of the original autonomous driving data is a point cloud data category, an image data category, a positioning information category, or a perception information category: since the standard autonomous driving data of the point cloud data category, the image data category, the positioning information category, or the perception information category may be used for subsequent technical iterations. Therefore, the original autonomous driving data is converted to a format by using a target format conversion tool to obtain standard autonomous driving data stored in a folder. The folder includes multiple data files named after the acquisition time of the original autonomous driving data associated with the standard autonomous driving data, which facilitates data query and use.

[0061] Optionally, when the category of the original autonomous driving data is a prediction information category, a planning information category, or another data category, the original autonomous driving data is converted into a standard autonomous driving data by using a target format conversion tool, including:

[0062] The target format conversion tool is used to convert the original autonomous driving data into a format that can be used to obtain standard autonomous driving data stored in the form of files.

[0063] In this optional embodiment, a specific method is provided for converting the format of the original autonomous driving data through a target format conversion tool to obtain standard autonomous driving data when the category of the original autonomous driving data is a prediction information category, a planning information category, or other data categories: the original autonomous driving data is format converted through a target format conversion tool to obtain standard autonomous driving data stored in the form of files, and these data are stored in the cloud in the form of a single data file.

[0064] Optionally, after the format of the original autonomous driving data is normalized to obtain standard autonomous driving data, the following is further included:

[0065] Generate an overall description file based on the attribute information of the autonomous driving data packet;

[0066] The overall description file includes at least one of the source of the original autonomous driving data, the vehicle corresponding to the original autonomous driving data, the storage path of the original autonomous driving data, and the label of the autonomous driving data packet.

[0067] In this optional embodiment, in order to increase the dimension of data obtained in the cloud, after the format of the original autonomous driving data is normalized to obtain standard autonomous driving data, in addition to storing the standard autonomous driving data, an overall description file is generated based on the attribute information of the autonomous driving data packet. The attribute information carried by the autonomous driving data packet includes the identity document (ID) of the data packet, the vehicle ID that uploaded the data packet, the environmental information during data collection (for example, sunny days, rainy days), the map used during vehicle driving, and time and other information. Therefore, based on the attribute information of the autonomous driving data packet, the generated overall description file includes the autonomous driving data packet ID, environmental information, map, time and other information. In addition, the overall description file also includes the storage path of the original autonomous driving data, the storage path of the prediction file, the storage path of the planning file, and the storage path of other files.

[0068] By generating an overall description file, you can also query data based on vehicle ID, environmental information or map during the subsequent data query process, which increases the data query dimension and facilitates data management.

[0069] S240. Based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, data association is performed on different categories of standard autonomous driving data.

[0070] Optional, such as Figure 2c As shown, the autonomous driving data package includes vehicle, map, prediction, planning and other file paths. The point cloud data, image data, positioning information, perception information and the data package are associated with each other through the data package ID to ensure that all relevant information can be found through the data package ID. At the same time, based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, data association is performed on different categories of standard autonomous driving data, including at least one of the following:

[0071] Temporally correlate different categories of standard autonomous driving data based on the collection time of the original autonomous driving data associated with the standard autonomous driving data;

[0072] Based on the collection time of the original autonomous driving data associated with the standard autonomous driving data, the positioning information associated with the original autonomous driving data is determined, and based on the positioning information, the positions of different categories of standard autonomous driving data are associated.

[0073] In this optional embodiment, two methods are provided for associating data of different categories of standard autonomous driving data based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data. The two methods can be used one by one or at the same time. In the original autonomous driving data, positioning information is the basis, and positioning information is the most frequently collected. For example, within 1 second, positioning information may be collected 100 times, and other information may be collected 10 times. Therefore, all data can be associated with positioning information based on the collection time. The specific association methods are as follows:

[0074] Method 1: Based on the collection time of the original autonomous driving data associated with the standard autonomous driving data, time association is performed on different categories of standard autonomous driving data. After time association, users can search for data based on time.

[0075] Method 2: Based on the collection time of the original autonomous driving data associated with the standard autonomous driving data, the positioning information associated with the original autonomous driving data corresponding to the collection time is queried. Furthermore, based on the positioning information, different categories of standard autonomous driving data are associated with each other.

[0076] By establishing associations between data, we can not only increase the dimension of data query, but also establish connections between different categories of data, which is of great significance for subsequent technology iteration and development.

[0077] Optionally, after data association is performed on different categories of standard autonomous driving data based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, the method further includes:

[0078] In response to a data query instruction initiated by a user based on the collection time, based on the time association relationship of the standard autonomous driving data, searching for standard autonomous driving data that matches the collection time; or,

[0079] In response to a data query instruction initiated by a user based on positioning information, the standard autonomous driving data matching the positioning information is searched based on the position association relationship of the standard autonomous driving data.

[0080] In this optional embodiment, after data association is performed on different categories of standard autonomous driving data based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, a multi-dimensional data query can be performed based on the collection time and positioning information. Specifically, in response to a data query instruction initiated by a user based on the collection time, based on the time association relationship of the standard autonomous driving data, the standard autonomous driving data that matches the collection time is searched; or, in response to a data query instruction initiated by a user based on the positioning information, based on the location association relationship of the standard autonomous driving data, the standard autonomous driving data that matches the positioning information is searched. Exemplarily, the user can circle a range on the map and search for standard autonomous driving data within the range based on the positioning information. The above method facilitates customized search and use by users and accelerates the iterative upgrade of autonomous driving algorithms.

[0081] S250. Based on the correlation relationship of the standard autonomous driving data, the standard autonomous driving data is displayed in an associated manner.

[0082] The technical solution of the embodiment of the present invention, after converting the original autonomous driving data into standard autonomous driving data through the corresponding format conversion tool, performs data association on different categories of standard autonomous driving data based on the collection time and positioning information of the original autonomous driving data associated with the standard autonomous driving data. This not only increases the dimension of data query, but also establishes connections between different categories of data, which is of great significance for subsequent technology iteration and development.

[0083] Embodiment 3

[0084] Figure 3 This is a schematic diagram of the structure of an automatic driving data processing device provided by Embodiment 3 of the present invention. Figure 3 As shown, the device comprises:

[0085] a format normalization module 310, configured to read raw autonomous driving data in an autonomous driving data packet, and perform format normalization on the raw autonomous driving data based on a preset standard data format to obtain standard autonomous driving data; the autonomous driving data packet includes raw autonomous driving data of multiple categories, each of which corresponds to a standard data format;

[0086] A data association module 320, configured to perform data association on different categories of standard autonomous driving data based on attribute information of the original autonomous driving data associated with the standard autonomous driving data;

[0087] The association display module 330 is used to display the standard autonomous driving data in an associated manner based on the association relationship of the standard autonomous driving data.

[0088] The technical solution of the embodiment of the present invention reads the original autonomous driving data in the autonomous driving data packet, normalizes the format of the original autonomous driving data based on a preset standard data format, and obtains standard autonomous driving data. Then, based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, data association is performed on different categories of standard autonomous driving data. Finally, based on the association relationship of the standard autonomous driving data, the standard autonomous driving data is associated and displayed. The format of the autonomous driving data uploaded by different vehicles can be normalized to facilitate subsequent data processing and application.

[0089] Optionally, the format normalization module 310 includes:

[0090] a data classification unit, configured to classify the original autonomous driving data to obtain a target category to which the original autonomous driving data belongs;

[0091] a tool determination unit, configured to determine a target format conversion tool matching the original autonomous driving data based on an original data format of the original autonomous driving data, a target category, and a standard data format associated with the target category;

[0092] The format conversion unit is used to convert the format of the original autonomous driving data through the target format conversion tool to obtain standard autonomous driving data.

[0093] Optionally, when the category of the original autonomous driving data is a point cloud data category, a picture data category, a positioning information category, or a perception information category, the format conversion unit is specifically used to:

[0094] The target format conversion tool is used to convert the original autonomous driving data into a format that obtains standard autonomous driving data stored in a folder; the folder includes a plurality of data files named according to the collection time of the original autonomous driving data associated with the standard autonomous driving data.

[0095] Optionally, when the category of the original autonomous driving data is a prediction information category, a planning information category, or another data category, the format conversion unit is specifically configured to:

[0096] The target format conversion tool is used to convert the original autonomous driving data into a format that is used to obtain standard autonomous driving data stored in a file format.

[0097] Optionally, the autonomous driving data processing device further includes:

[0098] a description file generating module, configured to generate an overall description file based on attribute information of the autonomous driving data packet after normalizing the format of the original autonomous driving data to obtain standard autonomous driving data;

[0099] The overall description file includes at least one of the source of the original autonomous driving data, the vehicle corresponding to the original autonomous driving data, the storage path of the original autonomous driving data, and the label of the autonomous driving data packet.

[0100] Optionally, the data association module 320 is specifically configured to perform at least one of the following:

[0101] Temporally correlating different categories of standard autonomous driving data based on the collection time of the original autonomous driving data associated with the standard autonomous driving data;

[0102] Based on the collection time of the original autonomous driving data associated with the standard autonomous driving data, the positioning information associated with the original autonomous driving data is determined, and based on the positioning information, different categories of standard autonomous driving data are positionally associated.

[0103] Optionally, the autonomous driving data processing device further includes:

[0104] A first query module is configured to, after associating different types of standard autonomous driving data based on attribute information of original autonomous driving data associated with the standard autonomous driving data, search for standard autonomous driving data matching the collection time based on the time association relationship of the standard autonomous driving data in response to a data query instruction initiated by a user based on the collection time; or

[0105] The second query module is used to respond to a data query instruction initiated by a user based on the positioning information, and to search for standard autonomous driving data that matches the positioning information based on the location association relationship of the standard autonomous driving data.

[0106] The autonomous driving data processing device provided in the embodiment of the present invention can execute the autonomous driving data processing method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0107] Embodiment 4

[0108] According to an embodiment of the present invention, the present invention also provides an electronic device, a readable storage medium and a computer program product.

[0109] Figure 4 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0110] like Figure 4 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0111] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0112] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as the autonomous driving data processing method.

[0113] In some embodiments, the autonomous driving data processing method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the autonomous driving data processing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the autonomous driving data processing method in any other appropriate manner (e.g., by means of firmware).

[0114] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0115] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0116] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0117] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0118] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0119] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0120] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0121] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for processing autonomous driving data, characterized in that: include: Reading original autonomous driving data in an autonomous driving data packet, and normalizing the format of the original autonomous driving data based on a preset standard data format to obtain standard autonomous driving data; the autonomous driving data packet contains multiple categories of original autonomous driving data, each category corresponding to a standard data format; Based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, data association is performed on the standard autonomous driving data of different categories; Based on the association relationship of the standard autonomous driving data, the standard autonomous driving data is displayed in an associated manner.

2. The method according to claim 1, characterized in that Based on a preset standard data format, the original autonomous driving data is normalized to obtain standard autonomous driving data, including: Classifying the original autonomous driving data to obtain a target category to which the original autonomous driving data belongs; Determining a target format conversion tool that matches the original autonomous driving data based on an original data format of the original autonomous driving data, a target category, and a standard data format associated with the target category; The target format conversion tool is used to convert the original autonomous driving data into standard autonomous driving data.

3. The method according to claim 2, characterized in that In a case where the category of the original autonomous driving data is a point cloud data category, an image data category, a positioning information category, or a perception information category, the target format conversion tool is used to convert the format of the original autonomous driving data to obtain standard autonomous driving data, including: The target format conversion tool is used to convert the original autonomous driving data into a format that obtains standard autonomous driving data stored in a folder; the folder includes a plurality of data files named according to the collection time of the original autonomous driving data associated with the standard autonomous driving data.

4. The method according to claim 2, characterized in that: In the case where the category of the original autonomous driving data is a prediction information category, a planning information category, or another data category, the target format conversion tool is used to convert the format of the original autonomous driving data to obtain standard autonomous driving data, including: The target format conversion tool is used to convert the original autonomous driving data into a format that is used to obtain standard autonomous driving data stored in a file format.

5. The method according to claim 1, characterized in that After the format of the original autonomous driving data is normalized to obtain standard autonomous driving data, the method further includes: Generate an overall description file based on the attribute information of the autonomous driving data packet; The overall description file includes at least one of the source of the original autonomous driving data, the vehicle corresponding to the original autonomous driving data, the storage path of the original autonomous driving data, and the label of the autonomous driving data packet.

6. The method according to claim 1, characterized in that Based on the attribute information of the original autonomous driving data associated with the standard autonomous driving data, data association is performed on the standard autonomous driving data of different categories, including at least one of the following: Temporally correlating different categories of standard autonomous driving data based on the collection time of the original autonomous driving data associated with the standard autonomous driving data; Based on the collection time of the original autonomous driving data associated with the standard autonomous driving data, the positioning information associated with the original autonomous driving data is determined, and based on the positioning information, different categories of standard autonomous driving data are positionally associated.

7. The method according to claim 6, characterized in that After data association of different categories of standard autonomous driving data is performed based on attribute information of the original autonomous driving data associated with the standard autonomous driving data, the following is also included: In response to a data query instruction initiated by a user based on the collection time, based on the time association relationship of the standard autonomous driving data, searching for standard autonomous driving data that matches the collection time; or, In response to a data query instruction initiated by a user based on positioning information, the standard autonomous driving data matching the positioning information is searched based on the position association relationship of the standard autonomous driving data.

8. An automatic driving data processing device, characterized in that: include: a format normalization module, configured to read raw autonomous driving data in an autonomous driving data packet, and perform format normalization on the raw autonomous driving data based on a preset standard data format to obtain standard autonomous driving data; the autonomous driving data packet includes raw autonomous driving data of multiple categories, each category corresponding to a standard data format; A data association module, for performing data association on different categories of standard autonomous driving data based on attribute information of original autonomous driving data associated with the standard autonomous driving data; An associated display module is used to display the standard autonomous driving data in an associated manner based on the associated relationship of the standard autonomous driving data.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the autonomous driving data processing method described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the autonomous driving data processing method according to any one of claims 1 to 7 when executed.

Citation Information

Patent Citations

  • Data processing method and device for vehicle, electronic equipment and medium

    CN113946729A

  • Map generation method and device, electronic equipment and storage medium

    CN114490910A

  • Data processing method and device, storage medium and electronic device

    CN115793993A

  • Data processing method and device, electronic equipment and storage medium

    CN115994183A

  • Automatic driving data visualization processing method and system

    CN116009767A