Data processing method and device and electronic equipment

Abstract

The invention relates to the technical field of data processing, in particular to a data processing method and device and electronic equipment, and is used for solving the problem of how to uniformly manage data of multiple services. The method comprises the following steps: when a first data packet reported by a vehicle-mounted terminal is received, creating a first storage space for the first data packet; when a first processing result obtained when the business model performs business processing by using the original data and / or the historical processing result in the first storage space is received, generating a corresponding second storage path according to the storage address of the original data and / or the historical processing result corresponding to the first processing result, and storing the first processing result as a historical processing result into the first storage space according to the second storage path.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to a data processing method, device and electronic device. Background Art

[0002] At present, different businesses of autonomous driving need to process corresponding data through the business systems of each business, and then store the data generated by each business in their respective memories. For example, the image data collected by the vehicle body image acquisition device can be used for lane line recognition or obstacle recognition, but the lane line recognition results and obstacle recognition will be stored in corresponding memories respectively.

[0003] Although the above method can manage the data of each business, when the number of businesses is large, the difficulty of managing each business will be greatly increased. Therefore, how to uniformly manage the data of multiple businesses has become an urgent problem to be solved. Summary of the invention

[0004] In order to solve the above technical problems, the present disclosure provides a data processing method, device and electronic device.

[0005] In order to achieve the above objectives, the present invention adopts the following technical solutions:

[0006] In a first aspect, the present disclosure provides a data processing method, comprising:

[0007] When a first data packet reported by the vehicle-mounted terminal is received, a first storage space is created for the first data packet; wherein the first data packet includes at least one type of original data collected by the vehicle-mounted device, and a first storage space corresponds to a unique storage address; a splicing identifier is generated by the vehicle identifier and start time corresponding to the first data packet, and the storage address is determined using the splicing identifier; a corresponding first storage path is generated in the storage address according to the data types of different original data in the first data; the original data in the first data packet is stored in the first storage space according to the corresponding first storage path; when a first processing result is received that is obtained by performing business processing on the original data and / or historical processing results in the first storage space using the business model, a corresponding second storage path is generated according to the storage address of the original data and / or historical processing results corresponding to the first processing result, and the first processing result is stored in the first storage space as a historical processing result according to the second storage path.

[0008] In some feasible examples, a splicing identifier is generated from the vehicle identifier and the start time corresponding to the first data packet, and a storage address is determined using the splicing identifier, including: obtaining the vehicle identifier of the vehicle-mounted terminal and collecting the start time of the first data packet; splicing the vehicle identifier and the start time to generate a splicing identifier; using the splicing identifier as the root directory, and creating a first parent directory under the root directory; wherein the name of the first parent directory includes the data name of the original data; generating a storage address based on the correspondence between the root directory and the first parent directory; wherein one type of original data corresponds to one storage address.

[0009] In some implementable examples, a business model corresponds to a configuration parameter, and the configuration parameter includes a model name; a corresponding second storage path is generated according to the storage address of the original data and / or historical processing results corresponding to the first processing result, including: taking the splicing identifier as the root directory, creating a second parent directory under the root directory, and creating a subdirectory under the second parent directory; wherein the name of the second parent directory includes the model name, and one subdirectory corresponds to one first processing result; a storage address is generated based on the correspondence between the root directory, the second parent directory, and the subdirectory; the storage address and the network address of the electronic device that creates the first storage space are spliced ​​to generate a second storage path.

[0010] In some feasible examples, the configuration parameter includes version information; and the name of the subdirectory includes the version information.

[0011] In some implementable examples, the data processing method provided by the present disclosure also includes: receiving query information; wherein the query information includes a first parent directory, or the query information includes a second parent directory, or the query information includes a second parent directory and a subdirectory, or the query information includes a root directory, or the query information includes a root directory and a first parent directory, or the query information includes a root directory, a second parent directory, and a subdirectory; querying the query information in a storage relationship corresponding to the first storage space, and if the storage relationship has a storage entry that is the same as the query information, using the network address corresponding to the storage entry as the network address corresponding to the query information; concatenating the directory information included in the query information to obtain a storage address corresponding to the query information; wherein the directory information includes a root directory, a first parent directory, and a first parent directory, or the directory information includes a root directory, a second parent directory, and a second parent directory; in the storage space of the network address corresponding to the query information, performing a data query with the storage address corresponding to the query information to obtain storage data corresponding to the query information; wherein the storage data includes original data, or any one of the first processing results.

[0012] In some implementable examples, the data processing method provided by the present disclosure also includes: obtaining download information; wherein the download information includes a network address, a storage address, and an actual storage address for storing the acquired storage data; in the storage space corresponding to the network address, performing a data query with the storage address to obtain the storage data; wherein the storage data includes the original data, or any one of the processing results; based on the storage data, storing the storage data to the actual storage address.

[0013] In a second aspect, the present disclosure provides a data processing device, including: a processing unit, configured to create a first storage space for the first data packet when a receiving unit receives a first data packet reported by an on-board terminal; wherein the first data packet includes at least one type of original data collected by an on-board device, and a first storage space corresponds to a unique storage address; a splicing identifier is generated by a vehicle identifier and a start time corresponding to the first data packet, and a storage address is determined using the splicing identifier; a corresponding first storage path is generated in the storage address according to the data type of different original data in the first data; and the original data in the first data packet is stored in the first storage space according to the corresponding first storage path;

[0014] The processing unit is also used to generate a corresponding second storage path according to the storage address of the original data and / or historical processing results corresponding to the first processing result when the receiving unit receives a first processing result obtained by the business model using the original data and / or historical processing results in the first storage space to perform business processing, and store the first processing result as a historical processing result in the first storage space according to the second storage path.

[0015] In some implementable examples, an acquisition unit is used to acquire a vehicle identification of a vehicle-mounted terminal and a start time for collecting a first data packet; a processing unit is used to splice the vehicle identification acquired by the acquisition unit and the start time acquired by the acquisition unit to generate a spliced ​​identification; the processing unit is used to create a first parent directory under a root target with the spliced ​​identification as the root directory; wherein the name of the first parent directory includes the data name of the original data; the processing unit is used to generate a storage address based on the correspondence between the root directory and the first parent directory; wherein one type of original data corresponds to one storage address.

[0016] In some implementable examples, a business model corresponds to a configuration parameter, the configuration parameter includes a model name; a processing unit is specifically used to create at least one second parent directory under the root directory with a splicing identifier as the root directory, and create a subdirectory under the second parent directory; wherein the name of the second parent directory includes the model name, and a subdirectory corresponds to a first processing result; the processing unit is specifically used to generate a storage address based on the correspondence between the root directory, the second parent directory, and the subdirectory; the processing unit is specifically used to splice the storage address and the network address of the electronic device that creates the first storage space to generate a second storage path.

[0017] In some feasible examples, the configuration parameter includes version information; and the name of the subdirectory includes the version information.

[0018] In some implementable examples, the receiving unit is further used to receive query information; wherein the query information includes the first parent directory, or the query information includes the second parent directory, or the query information includes the second parent directory and the subdirectory, or the query information includes the root directory, or the query information includes the root directory and the first parent directory, or the query information includes the root directory, the second parent directory, and the subdirectory; the processing unit is further used to query the query information received by the receiving unit in the storage relationship corresponding to the first storage space, and if the storage relationship has a storage entry that is the same as the query information, use the network address corresponding to the storage entry as the network address corresponding to the query information; the processing unit is further used to splice the directory information included in the query information received by the receiving unit to obtain the storage address corresponding to the query information; wherein the directory information includes the root directory, the first parent directory, and the first parent directory, or the directory information includes the root directory, the second parent directory, and the second parent directory; the processing unit is further used to perform data query at the storage address corresponding to the query information in the storage space of the network address corresponding to the query information received by the receiving unit, and obtain the storage data corresponding to the query information; wherein the storage data includes the original data, or any one of the first processing results.

[0019] In some feasible examples, the acquisition unit is also used to acquire download information; wherein the download information includes a network address, a storage address, and an actual storage address for storing acquired storage data; the processing unit is also used to perform data query in a storage space corresponding to the network address acquired by the acquisition unit, using the storage address acquired by the acquisition unit to obtain storage data; wherein the storage data includes original data, or any one of the first processing results; the processing unit is also used to store the storage data to the actual storage address based on the storage data.

[0020] In a third aspect, the present disclosure provides an electronic device, comprising: a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to enable the electronic device to implement the data processing method provided in the first aspect when executing the computer program.

[0021] In a fourth aspect, the present disclosure provides a computer-readable storage medium, comprising: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a computing device, the computing device implements the data processing method provided in the first aspect above.

[0022] In a fifth aspect, the present disclosure provides a vehicle, comprising any data processing device provided in the second aspect.

[0023] In the present disclosure, the name of the above-mentioned data processing device does not limit the device or functional module itself. In actual implementation, these devices or functional modules may appear with other names. As long as the functions of each device or functional module are similar to those of the present disclosure, they fall within the scope of the claims of the present disclosure and their equivalent technologies.

[0024] These and other aspects of the present disclosure will become more apparent from the following description.

[0025] Compared with the prior art, the technical solution provided by the present invention has the following advantages:

[0026] The data processing method provided by the present disclosure, when receiving the first data packet reported by the vehicle terminal, creates a first storage space for storing the first data packet, and stores the first data packet in the first storage space, so that the storage of the original data is completed. Afterwards, since the business needs to process the original data, the original data and / or the historical processing results in the first data packet are input into the business model for business processing to obtain the first processing result. In this way, the first processing results of the original data / or the historical processing results of different businesses can be obtained. In order to facilitate unified management, by storing the first processing result in the first storage space, the original data and the first processing result (including the processed results of the original data and / or the first processing results of the historical processing results) are stored in the same first storage space at the same time. In this way, when it is necessary to consult it later, it is only necessary to enter the corresponding first storage space to consult the original data stored in the first storage space, and the first processing result, which is convenient for unified management and solves the problem of how to manage the data of multiple businesses in a unified manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0028] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0029] Figure 1 One of the flowcharts of a data processing method provided by an embodiment of the present disclosure;

[0030] Figure 2 A schematic diagram of data included in a clip in a data processing method provided in an embodiment of the present disclosure;

[0031] Figure 3 A schematic diagram of storing clips in a data processing method provided in an embodiment of the present disclosure;

[0032] Figure 4 A second flowchart of a data processing method provided by an embodiment of the present disclosure;

[0033] Figure 5 A third flowchart of a data processing method provided in an embodiment of the present disclosure;

[0034] Figure 6 A fourth flowchart of a data processing method provided in an embodiment of the present disclosure;

[0035] Figure 7 A fifth flowchart of a data processing method provided in an embodiment of the present disclosure;

[0036] Figure 8 A schematic diagram of the structure of a data processing device provided in an embodiment of the present disclosure;

[0037] Fig. 9 A schematic diagram of the structure of a server provided in an embodiment of the present disclosure;

[0038] Fig.10 A schematic diagram of the structure of a computer program product of a data processing method provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0039] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0040] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0041] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0042] Exemplarily, the data processing method provided by the embodiment of the present disclosure is introduced by taking the execution subject of the data processing method provided by the embodiment of the present disclosure as a server as an example.

[0043] like Figure 1 As shown, the data processing method provided by the embodiment of the present disclosure includes the following steps S11 and S12:

[0044] S11. When a first data packet reported by the vehicle-mounted terminal is received, a first storage space is created for the first data packet; wherein the first data packet includes at least one type of original data collected by the vehicle-mounted device, and a first storage space corresponds to a unique storage address; a splicing identifier is generated by the vehicle identifier and the start time corresponding to the first data packet, and the storage address is determined using the splicing identifier; a corresponding first storage path is generated in the storage address according to the data type of different original data in the first data; and the original data in the first data packet is stored in the first storage space according to the corresponding first storage path.

[0045] In some examples, the first data packet includes raw data collected by an onboard device of the vehicle, where the onboard device includes one or more of a laser radar, an image acquisition device, and a sensor.

[0046] In some examples, the vehicle-mounted terminal collects the first data packet according to a preset time length, such as a preset time length of 30 seconds or 60 seconds.

[0047] In some examples, the first data packet mainly includes data collected by various sensors installed on the vehicle, including but not limited to lidar data, video data, radar data, odometry data, vehicle-side calibration parameter data, etc., mainly data generated by the vehicle's sensors.

[0048] In some examples, the first data packet may also be referred to as a clip.

[0049] For example, the clip size is 15 seconds, that is, each first data packet collects 15 seconds of data for the vehicle-mounted device, such as Figure 2 As shown in the figure, the clip includes raw data pandar, raw data video, raw data odometry, raw data calibration, and raw data others. Among them, pandar is the data collected by the laser radar. The amount of data generated per second varies according to the frequency. Taking the above example, assuming that the frequency of the laser radar is 10HZ, that is, 10 frames of data are generated per second (that is, 10 point cloud files (Point Cloud Data, pcd)), then there will be 150 (15s×10 / s) pcd files in the pandar folder. Video is the video taken by various image acquisition devices (such as cameras, fisheye cameras, etc.). Generally, the acquisition vehicle has left front, front, right front, left rear, rear, right rear, and multiple fisheye cameras. Each camera will collect a video within 15 seconds. For example, the video format of the video can be mp4. Odometry is the data collected by some other sensors, which may include inertial measurement unit (Inertial Measurement Unit, IMU), pose, radar and other data; like pandar and video, these data are collected by different sensors according to their own frequencies. Calibration records the external parameters and internal parameters of each sensor. Others indicates data collected by other sensors that already exist or may exist in the future.

[0050] In some examples, when the original data in the first data packet is stored in the first storage space, for the convenience of management, the data processing method provided by the embodiment of the present disclosure, when receiving the first data packet reported by the vehicle terminal, creates a first storage space for storing the first data packet, obtains the vehicle identification (such as the vehicle identification code (Vehicle Identification Number, VIN)) of the vehicle terminal, and the start time of collecting the first data packet. The vehicle identification and the start time are spliced ​​to generate a spliced ​​identification. For example: the vehicle identification is 5201690795688447, and the start time is 15:59:18 on September 5, 2023. At this time, the vehicle identification and the start time can be spliced ​​in the order of vehicle identification first and start time later to obtain the spliced ​​identification 520169079568844720230905155918. Afterwards, the first parent directory is created with the spliced ​​identification as the root directory. Among them, the name of the first parent directory includes the data name of the original data (such as: pandar, Video, odometry, calibration, others, etc.). Based on the correspondence between the root directory and the first parent directory, a first storage path is generated. Among them, one original data corresponds to one first storage path. In the first storage space, the original data is stored according to the first storage path. For example: the splicing identifier is 520169079568844720230905155918, and the name of the first parent directory is pandar. At this time, it can be determined that the first storage path is 520169079568844720230905155918-pandar. In the first storage space, the data of pandar in the clip can be stored according to 520169079568844720230905155918-pandar.

[0051] Specifically, the process of storing the original data such as Video, odometry, calibration, and others in the clip into the first storage space is the same as the process of storing the pandar in the clip in the clip into the first storage space, which will not be repeated here.

[0052] In some examples, when there are other sub-data under the first parent directory, at least one first sub-directory may be created under the first parent directory, wherein one first sub-directory corresponds to one sub-data.

[0053] S12. When a first processing result is received by the business model using the original data and / or historical processing results in the first storage space to perform business processing, a corresponding second storage path is generated according to the storage address of the original data and / or historical processing results corresponding to the first processing result, and the first processing result is stored as a historical processing result in the first storage space according to the second storage path.

[0054] In some examples, business models include, but are not limited to, the following:

[0055] 1. The point cloud will pass through the three-dimensional (3D) object detection model, point cloud segmentation model, object tracking model, etc.

[0056] 2. For videos (images), a two-dimensional (2-dimention, 2D) obstacle detection model will be used.

[0057] 3. Post-fusion results after 3D object detection or 2D object detection, etc.

[0058] In some examples, each model or post-processing service will generate a processing result. Any subset of these processing results may be used as the true value as training data for different vehicle-side models, or as input data for model evaluation.

[0059] In some examples, the unit is clip; all data generated by a clip during the entire cloud data processing process are associated with the current clip.

[0060] For example, Figure 3 As shown in the figure, firstly, all the data corresponding to the clip is stored in the object storage service (OSS). Figure 3 As shown, each rectangle is a folder, non-leaf nodes are folders, and leaf nodes contain one or more files or folders, representing specific data. Taking pandar as an example, there will be multiple pcd files in the pandar directory. These files will be stored on oss with pandar as the parent directory. Taking lidar_obj_detect / v-1.0 as an example, there will be many json files below, and they will also be stored in folders with v-1.0 as the parent directory. All data is rooted in the clip id. The clip id can be called clip_vid, which is a globally unique value. For example, clip_vid is obtained based on the number of the collection vehicle and the start timestamp of the clip collection. An exemplary clip_vid can be 520169079568844720230905155918.

[0061] In some examples, when the first processing result is stored in the first storage space, for the convenience of management, the data processing method provided by the embodiment of the present disclosure uses the splicing identifier as the root directory, creates a second parent directory, and a subdirectory corresponding to the second parent directory. The name of the second parent directory includes the model name, and the name of the subdirectory includes version information. Afterwards, based on the correspondence between the root directory, the second parent directory, and the subdirectory, a second storage path is generated. In the first storage space, the processing result is stored according to the second storage path. For example, the splicing identifier (i.e., the root target) is 520169079568844720230905155918, the name of the second parent directory is lidar_obj_detect, and the name of the subdirectory is v-1.0. At this time, it can be determined that the first storage path is 520169079568844720230905155918-lidar_obj_detect-v-1.0, and the processing result corresponding to lidar_obj_detect-v-1.0 in the clip can be stored in the first storage space according to 520169079568844720230905155918-lidar_obj_detect-v-1.0.

[0062] In some examples, the model name includes any of lidar_obj_detect (3D obstacle detection model), lidar_seg (point cloud segmentation model), 2D_vehicle_detect (2D vehicle detection model), and 2D_person_detect (D pedestrian detection model).

[0063] Specifically, the process of storing the data results generated by lidar_seg, 2D_vehicle_detect, and 2D_person_detect in the first storage space is the same as the process of storing the data results generated by lidar_obj_detect in the first storage space, which will not be repeated here.

[0064] In some examples, after the original data in the first data packet and the first processing result corresponding to the original data are stored in the first storage space, when the user needs to view a certain type of data, a query message can be sent to the server. The server queries the query information in the storage relationship corresponding to the first storage space, and if the storage relationship has a storage entry that is the same as the query information, the storage address corresponding to the query information is determined. The server splices the directory information included in the query information to obtain the storage location corresponding to the query information. The server performs a data query in the first storage space of the storage address corresponding to the query information with the storage path corresponding to the query information to obtain the storage data corresponding to the query information.

[0065] Exemplarily, the storage relationship is shown in Table 1.

[0066] Table 1

[0067]

[0068] For example, for raw data, the user can obtain the first parent directory (such as pandar) based on the data name of the raw data, and then send a query message to the server. In this way, the server can query the data whose first parent directory is pandar in the storage relationship corresponding to the first storage space shown in Table 1, so that the storage address corresponding to each data whose first parent directory is pandar is xxxx.com, and the storage path is 520169079568844720230905155918-pandar. Alternatively, when the user needs to check the processing results, the user can obtain the second parent directory and subdirectory (such as lidar_obj_detect-v-1.0) based on the model name and version information, and then send a query message to the server. In this way, the server can query the data whose second parent directory is lidar_obj_detect and whose subdirectory is v-1.0 in the storage relationship corresponding to the first storage space shown in Table 1, so as to obtain the storage address corresponding to each data whose second parent directory is lidar_obj_detect and whose subdirectory is v-1.0 as xxxx.com, and the storage path as 520169079568844720230905155918-lidar_obj_detect-v-1.0.

[0069] Alternatively, the user needs to check the data of a certain vehicle at any time point, such as the original data. At this time, the user can obtain the splicing mark (such as splicing mark 1) based on the vehicle identification and time point of the vehicle. At the same time, the user obtains the first parent directory (such as pandar) based on the data name of the original data, and then sends a query message to the server. In this way, the server can query the data whose root directory is splicing mark 1 and the first parent directory is pandar in the storage relationship corresponding to the first storage space shown in Table 1, so that the corresponding storage address of the root directory splicing mark 1 and the first parent directory pandar can be obtained as xxxx.com, and the storage path is 20169079568844720230905155918-pandar. Alternatively, when the user needs to check the processing results, the user can obtain the splicing mark (such as splicing mark 1) based on the vehicle identification and time point of the vehicle. At the same time, the user can obtain the second parent directory and subdirectory (such as lidar_obj_detect-v-1.0) based on the model name and version information, and then send a query message to the server. In this way, the server can query the data whose root directory is the splicing identifier 1, the second parent directory is lidar_obj_detect, and the subdirectory is v-1.0 in the storage relationship corresponding to the first storage space shown in Table 1, so as to obtain the storage address corresponding to the data whose root directory is the splicing identifier 1, the second parent directory is lidar_obj_detect, and the subdirectory is v-1.0. After that, the directory information included in the query information is spliced ​​to obtain the storage location corresponding to the query information as xxxx.com and the storage path as 20169079568844720230905155918-idar_obj_detect-v-1.0.

[0070] In some examples, each storage entry in the storage relation also includes the data type (2.data_type) of the current data entry.

[0071] In some examples, when a user needs to download a clip on a server to a local storage, such as storing the clip on the server in a memory of an electronic device (such as a computer), the user can generate download information based on the storage address and storage location obtained in the above steps, as well as a third storage location in the memory. Afterwards, the download information is sent to the server via a computer. Afterwards, after receiving the download information sent by the computer, the server performs a data query based on the storage location in the first storage space corresponding to the storage address to obtain the stored data. The stored data includes the original data or any one of the processing results. Afterwards, the server sends the stored data to the computer so that the computer stores the stored data to the actual storage address based on the stored data. Of course, the user can also store the stored data to a specified location of the server, such as the actual storage address. At this time, after obtaining the stored data, the server can store the stored data to the third storage location.

[0072] It can be seen that the data processing method provided by the embodiment of the present disclosure can unify the storage method of the clip reported by the vehicle terminal, which is efficient, convenient and easy to manage. At the same time, since the original data and the processing results corresponding to the original data are stored in the same clip, the data can be centrally managed, unnecessary redundant storage is avoided, data barriers are broken (different processing results are stored in the same clip), and each business end shares data.

[0073] In some possible implementation examples, combined with Figure 1 ,like Figure 4 As shown, the above S11 can be specifically implemented through the following S110-S114.

[0074] S110. When a first data packet reported by the vehicle-mounted terminal is received, a first storage space is created for the first data packet, wherein the first data packet includes at least one type of original data collected by the vehicle-mounted device, and a first storage space corresponds to a unique storage address; the vehicle identification of the vehicle-mounted terminal and the start time of collecting the first data packet are obtained.

[0075] S111. Concatenate the vehicle identification and the start time to generate a concatenated identification.

[0076] S112: Create a first parent directory under the root directory with the splicing mark as the root directory, wherein the name of the first parent directory includes the data name of the original data.

[0077] S113: Generate a storage address based on the corresponding relationship between the root directory and the first parent directory, wherein one type of original data corresponds to one storage address.

[0078] S114, generating a corresponding first storage path in the storage address according to the data types of different original data in the first data; and storing the original data in the first data packet into the first storage space according to the corresponding first storage path.

[0079] In some feasible examples, a business model corresponds to a configuration parameter, and the configuration parameter includes a model name; Figure 4 ,like Figure 5 As shown, the above S12 can be specifically implemented through the following S120-S122.

[0080] S120: When receiving a first processing result obtained by the business model performing business processing using the original data and / or historical processing results in the first storage space, create a second parent directory with the concatenated identifier as the root directory, and create a subdirectory under the second parent directory, wherein the name of the second parent directory includes the model name, and one subdirectory corresponds to one first processing result.

[0081] S121. Generate a storage address based on the correspondence between the root directory, the second parent directory, and the subdirectory.

[0082] S122: Concatenate the storage address and the network address of the electronic device that creates the first storage space to generate a second storage path, and store the first processing result as a historical processing result in the first storage space according to the second storage path.

[0083] In some examples, when creating a first storage space for storing a first data packet, the server needs to determine the network address of the electronic device corresponding to the first storage space. For example, when the electronic device is a server, the network address is the network address of the server. Afterwards, the network address and the storage address are concatenated to generate a second storage path. For example, if the network address is xxxx.com and the storage address is 520169079568844720230905155918-lidar_obj_detect-v-1.0, the second storage path is xxxx.com / 520169079568844720230905155918-lidar_obj_detect-v-1.0.

[0084] It should be noted that the generation process of the first storage path is the same as the generation process of the second storage path, which will not be repeated here.

[0085] In some feasible examples, the configuration parameter includes version information; and the name of the subdirectory includes the version information.

[0086] In some possible implementation examples, combined with Figure 1 ,like Figure 6As shown, the data processing method provided by the embodiment of the present disclosure also includes: S13-S16.

[0087] S13, receiving query information, wherein the query information includes the first parent directory, or the second parent directory, or the second parent directory and the subdirectory, or the root directory, or the root directory and the first parent directory, or the root directory, the second parent directory, and the subdirectory.

[0088] S14. Searching for the query information in the storage relationship corresponding to the first storage space, if the storage relationship has a storage entry identical to the query information, using the network address corresponding to the storage entry as the network address corresponding to the query information.

[0089] S15, concatenating the directory information included in the query information to obtain a storage address corresponding to the query information, wherein the directory information includes a root directory, a first parent directory, and a first parent directory, or the directory information includes a root directory, a second parent directory, and a second parent directory.

[0090] S16: In the storage space of the network address corresponding to the query information, perform data query with the storage address corresponding to the query information to obtain the storage data corresponding to the query information, wherein the storage data includes the original data or any one of the first processing results.

[0091] In some possible implementation examples, combined with Figure 1 ,like Figure 7 As shown, the data processing method provided by the embodiment of the present disclosure also includes: S17-S19.

[0092] S18, obtaining download information, wherein the download information includes a network address, a storage address, and an actual storage address for storing the obtained storage data.

[0093] S19: In the storage space corresponding to the network address, data is searched with the storage address to obtain the stored data, wherein the stored data includes the original data or any one of the processing results.

[0094] S20. Based on the storage data, store the storage data to the actual storage address.

[0095] The above mainly introduces the solution provided by the embodiment of the present disclosure from the perspective of the method. In order to achieve the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present disclosure.

[0096] The embodiments of the present disclosure may divide the data processing device into functional modules according to the above method examples. For example, each functional module may be divided according to each function, or two or more functions may be integrated into one processing module. The above integrated modules may be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiments of the present disclosure is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0097] like Figure 8 As shown, it is a schematic diagram of the structure of a data processing device 10 provided by an embodiment of the present disclosure. It includes a processing unit 101 and a receiving unit 102. The processing unit 101 is used to create a first storage space for the first data packet when the receiving unit 102 receives the first data packet reported by the vehicle-mounted terminal; wherein the first data packet includes at least one kind of original data collected by the vehicle-mounted device, and a first storage space corresponds to a unique storage address; a splicing identifier is generated by the vehicle identifier and the start time corresponding to the first data packet, and the storage address is determined by using the splicing identifier; a corresponding first storage path is generated in the storage address according to the data type of different original data in the first data; the original data in the first data packet is stored in the first storage space according to the corresponding first storage path;

[0098] The processing unit 101 is also used to generate a corresponding second storage path according to the storage address of the original data and / or historical processing results corresponding to the first processing result when the receiving unit 102 receives a first processing result obtained by the business model using the original data and / or historical processing results in the first storage space for business processing, and store the first processing result as a historical processing result in the first storage space according to the second storage path.

[0099] In some implementable examples, the acquisition unit 103 is used to acquire the vehicle identification of the vehicle-mounted terminal and the start time of collecting the first data packet; the processing unit 101 is specifically used to splice the vehicle identification acquired by the acquisition unit 103 and the start time acquired by the acquisition unit 103 to generate a spliced ​​identification; the processing unit 101 is specifically used to create a first parent directory under the root target with the spliced ​​identification as the root directory; wherein the name of the first parent directory includes the data name of the original data; the processing unit 101 is specifically used to generate a storage address based on the correspondence between the root directory and the first parent directory; wherein one type of original data corresponds to one storage address.

[0100] In some implementable examples, a business model corresponds to a configuration parameter, and the configuration parameter includes a model name; a processing unit 101 is specifically used to create at least one second parent directory under the root directory with a splicing identifier as the root directory, and create a subdirectory under the second parent directory; wherein the name of the second parent directory includes the model name, and a subdirectory corresponds to a first processing result; the processing unit 101 is specifically used to generate a storage address based on the correspondence between the root directory, the second parent directory, and the subdirectory; the processing unit 101 is specifically used to splice the storage address and the network address of the electronic device that creates the first storage space to generate a second storage path.

[0101] In some feasible examples, the configuration parameter includes version information; and the name of the subdirectory includes the version information.

[0102] In some implementable examples, the receiving unit 102 is further used to receive query information; wherein the query information includes the first parent directory, or the query information includes the second parent directory, or the query information includes the second parent directory and the subdirectory, or the query information includes the root directory, or the query information includes the root directory and the first parent directory, or the query information includes the root directory, the second parent directory, and the subdirectory; the processing unit 101 is further used to query the query information received by the receiving unit 102 in the storage relationship corresponding to the first storage space, and if the storage relationship has a storage entry that is the same as the query information, the network address corresponding to the storage entry is used as the query information. The processing unit 101 is further used to concatenate the directory information included in the query information received by the receiving unit 102 to obtain a storage address corresponding to the query information; wherein the directory information includes a root directory, a first parent directory, and a first parent directory, or the directory information includes a root directory, a second parent directory, and a second parent directory; the processing unit 101 is further used to perform a data query in the storage space of the network address corresponding to the query information received by the receiving unit 102, using the storage address corresponding to the query information, to obtain storage data corresponding to the query information; wherein the storage data includes original data, or any one of the first processing results.

[0103] In some implementable examples, the acquisition unit 103 is also used to obtain download information; wherein the download information includes a network address, a storage address, and an actual storage address for storing the acquired storage data; the processing unit 101 is also used to perform data query in the storage space corresponding to the network address obtained by the acquisition unit 103, using the storage address obtained by the acquisition unit 103 to obtain the storage data; wherein the storage data includes the original data, or any one of the first processing results; the processing unit 101 is also used to store the storage data to the actual storage address based on the storage data.

[0104] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and its role will not be repeated here.

[0105] Of course, the data processing device 10 provided in the embodiment of the present disclosure includes but is not limited to the above modules, for example, the data processing device 10 may also include a storage unit 104. The storage unit 104 may be used to store the program code of the data processing device 10, and may also be used to store data generated by the data processing device 10 during operation, such as data in a write request, etc.

[0106] Fig. 9 A schematic diagram of the structure of a vehicle-mounted terminal provided in an embodiment of the present disclosure is shown in FIG. Fig. 9 As shown, the vehicle-mounted terminal may include: at least one processor 51 , a memory 52 , a communication interface 53 and a communication bus 54 .

[0107] Combine the following Fig. 9 The following is a detailed introduction to the various components of the vehicle terminal:

[0108] The processor 51 is the control center of the electronic device 10, and may be a processor or a general term for multiple processing elements. For example, the processor 51 is a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present disclosure, such as one or more DSPs, or one or more field programmable gate arrays (FPGAs).

[0109] In a specific implementation, as an embodiment, the processor 51 may include one or more CPUs, such as Fig. 9 Also, as an embodiment, the electronic device may include multiple processors, such as Fig. 951 and 55 are shown in FIG. Each of these processors may be a single-core processor (Single-CPU) or a multi-core processor (Multi-CPU). The processor here may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0110] The memory 52 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 52 may exist independently and be connected to the processor 51 via a communication bus 54. The memory 52 may also be integrated with the processor 51.

[0111] In a specific implementation, the memory 52 is used to store the data in the present disclosure and execute the software program in the present disclosure. The processor 51 can execute various functions of the air conditioner by running or executing the software program stored in the memory 52 and calling the data stored in the memory 52.

[0112] The communication interface 53 uses any transceiver-like device to communicate with other devices or communication networks, such as Radio Access Network (RAN), Wireless Local Area Networks (WLAN), terminals, the cloud, etc. The communication interface 53 may include an acquisition unit and a receiving unit to implement the acquisition and reception functions.

[0113] The communication bus 54 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig. 9 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0114] As an example, combining Figure 8 The functions implemented by the receiving unit 102 and the acquiring unit 103 in the data processing device 10 are the same as Fig. 9 The function of the communication interface 53 in the data processing device 10 is the same as that of the processing unit 101 in the data processing device 10. Fig. 9 The function of the processor 51 in the data processing device 10 is the same as that of the storage unit 104 in the data processing device 10. Fig. 9 The function of the memory 52 in is the same.

[0115] Another embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a computing device, the computing device executes the mode switching method shown in the above method embodiment.

[0116] In some embodiments, the disclosed methods may be implemented as computer program instructions encoded in a machine-readable format on a computer-readable storage medium or on other non-transitory media or articles of manufacture.

[0117] Fig.10 A conceptual partial view of a computer program product provided by an embodiment of the present disclosure is schematically shown, wherein the computer program product includes a computer program for executing a computer process on a computing device.

[0118] In one embodiment, the computer program product is provided using a signal bearing medium 410. The signal bearing medium 410 may include one or more program instructions, which when executed by one or more processors may provide the above-mentioned Figure 1 Thus, for example, reference to Figure 1 In the embodiment shown in , one or more features of S11-S13 can be undertaken by one or more instructions associated with the signal bearing medium 410. In addition, Fig.10 The program instructions in also describe example instructions.

[0119] In some examples, signal bearing medium 410 may include computer readable medium 411, such as, but not limited to, a hard drive, a compact disk (CD), a digital video disk (DVD), a digital tape, a memory, a read-only memory (ROM), or a random access memory (RAM), and the like.

[0120] In some implementations, signal bearing medium 410 may include computer recordable medium 412 such as, but not limited to, memory, read / write (R / W) CD, R / W DVD, and the like.

[0121] In some implementations, signal bearing medium 410 may include communication medium 413 such as, but not limited to, digital and / or analog communication media (eg, fiber optic cables, waveguides, wired communication links, wireless communication links, etc.).

[0122] Signal bearing medium 410 may be communicated by a wireless form of communication medium 413 (eg, wireless communication medium complying with IEEE 802.41 standard or other transmission protocols). The one or more program instructions may be, for example, computing device executable instructions or logic implementing instructions.

[0123] In some examples, such as for Figure 8 The depicted data processing device 10 may be configured to provide various operations, functions, or actions in response to one or more program instructions via computer-readable media 411 , computer-recordable media 412 , and / or communications media 413 .

[0124] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0125] In the several embodiments provided in the present disclosure, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0126] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0127] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0128] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present disclosure is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks or optical disks.

[0129] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A data processing method, It is characterized in that include: When a first data packet reported by the vehicle-mounted terminal is received, a first storage space is created for the first data packet, wherein the first data packet includes at least one type of original data collected by the vehicle-mounted device, and one first storage space corresponds to a unique storage address; a splicing identifier is generated by the vehicle identifier and the start time corresponding to the first data packet, and the storage address is determined by using the splicing identifier; and a corresponding first storage path is generated in the storage address according to the data type of different original data in the first data; Storing the original data in the first data packet into the first storage space according to the corresponding first storage path; When a first processing result is received by the business model using the original data and / or historical processing results in the first storage space to perform business processing, a corresponding second storage path is generated based on the storage address of the original data and / or historical processing results corresponding to the first processing result, and the first processing result is stored as a historical processing result in the first storage space according to the second storage path.

2. The data processing method according to claim 1, It is characterized in that The step of generating a splicing identifier from the vehicle identifier and the start time corresponding to the first data packet, and determining a storage address using the splicing identifier includes: Obtaining a vehicle identification of the vehicle-mounted terminal and a start time of collecting the first data packet; splicing the vehicle identifier and the start time to generate a spliced ​​identifier; Taking the splicing identifier as the root directory, creating a first parent directory under the root target; wherein the name of the first parent directory includes the data name of the original data; Based on the correspondence between the root directory and the first parent directory, a storage address is generated; wherein one type of original data corresponds to one storage address.

3. The data processing method according to claim 2, It is characterized in that One business model corresponds to one configuration parameter, and the configuration parameter includes a model name; the second storage path corresponding to the storage address of the original data and / or the historical processing result corresponding to the first processing result is generated, including: Taking the splicing identifier as a root directory, creating at least one second parent directory under the root directory, and creating a subdirectory under the second parent directory; wherein the name of the second parent directory includes the model name, and one subdirectory corresponds to one first processing result; Generate a storage address based on the corresponding relationship between the root directory, the second parent directory, and the subdirectory; The storage address and the network address of the electronic device that creates the first storage space are concatenated to generate a second storage path.

4. The data processing method according to claim 3, It is characterized in that The configuration parameters include version information; the name of the subdirectory includes the version information.

5. The data processing method according to claim 1, It is characterized in that The method further comprises: Receive query information; wherein the query information includes a first parent directory, or the query information includes a second parent directory, or the query information includes the second parent directory and a subdirectory, or the query information includes a root directory, or the query information includes the root directory and the first parent directory, or the query information includes the root directory, the second parent directory, and the subdirectory; Searching for the query information in the storage relationship corresponding to the first storage space, and if the storage relationship has a storage entry identical to the query information, using the network address corresponding to the storage entry as the network address corresponding to the query information; splicing the directory information included in the query information to obtain a storage address corresponding to the query information; wherein the directory information includes the root directory, the first parent directory, and the first parent directory, or the directory information includes the root directory, the second parent directory, and the second parent directory; In the storage space of the network address corresponding to the query information, data query is performed with the storage address corresponding to the query information to obtain the storage data corresponding to the query information; wherein the storage data includes the original data, or any one of the first processing results.

6. The data processing method according to claim 1, It is characterized in that The method further comprises: Obtain download information; wherein the download information includes a network address, a storage address, and an actual storage address for storing the acquired storage data; In the storage space corresponding to the network address, data query is performed with the storage address to obtain stored data; wherein the stored data includes the original data or any one of the first processing results; Based on the storage data, the storage data is stored in the actual storage address.

7. A data processing device, It is characterized in that include: The processing unit is configured to create a first storage space for the first data packet when the receiving unit receives the first data packet reported by the vehicle-mounted terminal; wherein the first data packet includes at least one type of original data collected by the vehicle-mounted device, and one first storage space corresponds to a unique storage address; a splicing identifier is generated by the vehicle identifier and the start time corresponding to the first data packet, and the storage address is determined by using the splicing identifier; a corresponding first storage path is generated in the storage address according to the data type of different original data in the first data; and the original data in the first data packet is stored in the first storage space according to the corresponding first storage path; The processing unit is also used to generate a corresponding second storage path according to the storage address of the original data and / or historical processing results corresponding to the first processing result when the receiving unit receives a first processing result obtained by the business model using the original data and / or historical processing results in the first storage space for business processing, and store the first processing result as a historical processing result in the first storage space according to the second storage path.

8. An electronic device, It is characterized in that include: A memory and a processor, wherein the memory is used to store a computer program; and the processor is used to enable the electronic device to implement the data processing method according to any one of claims 1 to 6 when executing the computer program.

9. A computer-readable storage medium, It is characterized in that include: The computer-readable storage medium stores a computer program, and when the computer program is executed by a computing device, the computing device implements the data processing method according to any one of claims 1 to 6.

10. A server, It is characterized in that Comprising the data processing device as claimed in claim 7.

Images