Data processing method and device and vehicle

Abstract

The invention relates to a data processing method and device and a vehicle, and relates to the technical field of intelligent driving. The method comprises the following steps: receiving vehicle sensing data provided by a plurality of data channels; extracting to-be-processed data from the vehicle sensing data; wherein the to-be-processed data at least comprises first data and second data, and vehicle sensing information types corresponding to the first data and the second data are the same; data channels corresponding to the first data and the second data are different; and based on the priority sequence of the plurality of data channels, performing duplicate removal processing on the to-be-processed data to obtain target data. The sensing data can be simplified, the resource consumption of the C-V2X system for subsequent processing of the vehicle sensing data is reduced, and generation of subsequent intelligent driving decision judgment is also facilitated.

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent driving technology, and in particular to a data processing method, device and vehicle. Background Art

[0002] With the development of intelligent driving technology, the perception of the vehicle to the outside world is particularly important. At present, smart cars are generally equipped with C-V2X systems. C-V2X (Cellular Vehicle-to-Everything) is a vehicle-to-the-outside communication technology based on cellular networks, which aims to achieve information exchange between vehicles (V2V), vehicles and infrastructure (V2I), vehicles and pedestrians (V2P) and vehicles and networks (V2N). C-V2X technology is an important part of intelligent transportation systems (ITS) and autonomous driving technology, which can improve road safety, optimize traffic flow and support various value-added services.

[0003] The C-V2X system has multiple communication interfaces to receive various sensory data and realize all-round information exchange between the vehicle and the outside world. However, in related technologies, the C-V2X system receives various sensory data but does not process the received data. The amount of received data is huge, requiring a lot of resources, and is not conducive to the generation of subsequent intelligent driving decision-making judgments.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The present disclosure provides a data processing method, device, electronic device and storage medium.

[0006] According to a first aspect of an embodiment of the present disclosure, there is provided a data processing method, including: Receiving vehicle perception data provided by multiple data channels; Extracting data to be processed from the vehicle perception data; wherein the data to be processed includes at least first data and second data, the first data and the second data correspond to the same type of vehicle perception information; and the first data and the second data correspond to different data channels; Based on the priority order of the multiple data channels, the data to be processed is deduplicated to obtain target data.

[0007] In some embodiments, extracting the data to be processed from the vehicle perception data includes: extracting event data from the vehicle perception data; Determine the first data and the second data in the event data to obtain the data to be processed; The event data types corresponding to the first data and the second data are the same.

[0008] In some embodiments, the event data includes at least: object size data and object absolute position coordinate data; The difference between the object size data in the first data and the object size data in the second data is within a predetermined range; And the difference between the absolute position coordinate data of the object in the first data and the absolute position coordinate data of the object in the second data is within a second preset range.

[0009] In some embodiments, based on the priority order of the multiple data channels, deduplication processing is performed on the data to be processed to obtain target data, including: Determining at least two data channels corresponding to the data to be processed; Determining a target data channel with the highest priority among the at least two data channels based on the priority order of the multiple data channels; The data corresponding to the target data channel in the data to be processed is retained to obtain the target data.

[0010] In some embodiments, a data processing method is provided, further comprising: determining a priority order of the plurality of data channels; Determining the priority order of the multiple data channels includes: Determining a preset priority order of the plurality of data channels; Determining a credibility ranking of each of the at least two data channels based on the confidence identifier in the data to be processed; Based on the credibility ranking, the preset priority order is adjusted to obtain the priority order of the multiple data channels.

[0011] In some embodiments, the data processing method provided further includes: preprocessing the vehicle perception data to obtain processed vehicle perception data; Wherein, extracting the data to be processed from the vehicle perception data includes: The data to be processed is extracted from the processed vehicle perception data.

[0012] In some embodiments, preprocessing the vehicle perception data includes: For the vehicle perception data provided by each data channel, determining repeated perception data based on the object identification and object position information in the vehicle perception data; Based on the duplicate perception data, the vehicle perception data is deduplicated.

[0013] In some embodiments, the plurality of data channels include at least: an ego-vehicle perception channel; In response to the data channel corresponding to the target data not being a self-vehicle perception channel, the target data is sent to an intelligent driving domain perception source.

[0014] In some embodiments, the plurality of data channels include: Cloud perception channel, vehicle perception channel, other vehicle perception channel and roadside unit perception channel.

[0015] In some embodiments, the priority order of the plurality of data channels is preset; The priority order of the multiple data channels includes: the priority of the self-vehicle perception channel is higher than the priority of the other vehicle perception channels; the priority of the other vehicle perception channels is higher than the roadside unit perception channel; the priority of the roadside unit perception channel is higher than the cloud perception channel.

[0016] According to a second aspect of an embodiment of the present disclosure, there is provided a data processing device, including: A data receiving unit, used for receiving vehicle perception data provided by multiple data channels; A data extraction unit, configured to extract data to be processed from the vehicle perception data; wherein the data to be processed includes at least first data and second data, the first data and the second data correspond to the same type of vehicle perception information; and the first data and the second data correspond to different data channels; The deduplication processing unit is used to perform deduplication processing on the data to be processed based on the priority order of the multiple data channels to obtain target data.

[0017] According to a third aspect of an embodiment of the present disclosure, a vehicle is provided, comprising: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: implement the data processing method described in the first aspect above.

[0018] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is enabled to execute the data processing method described in the first aspect above.

[0019] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects: By receiving vehicle perception data provided by multiple data channels; extracting the data to be processed from the vehicle perception data, so that the data to be processed includes at least the first data and the second data, the first data and the second data correspond to the same type of vehicle perception information and the first data and the second data correspond to different data channels; based on the priority order of multiple data channels, deduplication processing is performed on the data to be processed to obtain target data. The vehicle perception data provided by multiple data channels received by the C-V2X system is processed, and the perception data is streamlined through deduplication processing, which reduces the resource consumption of the C-V2X system for subsequent processing of the vehicle perception data, and is also conducive to the generation of subsequent intelligent driving decision judgments.

[0020] The general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0022] Figure 1 A data processing method according to some embodiments of the present disclosure is shown in FIG. Figure 1 .

[0023] Figure 2 is a flowchart of an implementation process of step S104 according to some embodiments of the present disclosure.

[0024] Figure 3 is a flowchart of an implementation process of step S106 according to some embodiments of the present disclosure.

[0025] Figure 4 The present invention is a flowchart of an implementation process for determining the priority order of multiple data channels according to some embodiments of the present disclosure.

[0026] Figure 5 A data processing method according to some embodiments of the present disclosure is shown in FIG. Figure 2 .

[0027] Figure 6 It is a schematic diagram of the working data flow of a vehicle functional system according to a specific example shown in some embodiments of the present disclosure.

[0028] Figure 7 It is a block diagram of a data processing device according to some embodiments of the present disclosure.

[0029] Figure 8 It is a schematic diagram of a functional block diagram of a vehicle according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0030] Some embodiments of the present disclosure will be described in detail here, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. Various changes, modifications and equivalents of the methods, devices and / or systems described herein will become apparent after understanding the present disclosure. For example, the order of operations described herein is merely an example and is not limited to those orders set forth herein, but can be changed as becomes apparent after understanding the present disclosure, except for operations that must be performed in a specific order. In addition, for clarity and brevity, descriptions of features known in the art may be omitted.

[0031] The embodiments described in some embodiments of the present disclosure below do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0032] The specific implementation of the embodiment of the present disclosure is described in detail below with reference to the accompanying drawings.

[0033] Figure 1 A data processing method according to some embodiments of the present disclosure is shown in FIG. Figure 1 ,like Figure 1 As shown, the data processing method can be applied to electronic devices, including but not limited to vehicles.

[0034] Figure 1 The data processing method shown includes the following steps.

[0035] In step S102, vehicle perception data provided by multiple data channels is received.

[0036] It should be noted that multiple data channels are data source channels that are in communication connection with the C-V2X system in the vehicle. The corresponding communication interface is set in the C-V2X system to receive the vehicle perception data provided by the corresponding data channel. Vehicle perception data refers to the information about the vehicle's surrounding environment, vehicle status and driving behavior collected by each data channel through sensors and other devices and receiving information transmitted by other data sources. These data are crucial to realizing autonomous driving, assisted driving functions, and improving driving safety and traffic efficiency. They can include vehicle status data, vehicle location information, driving behavior data, environmental perception data and weather information.

[0037] In an exemplary embodiment of the present disclosure, multiple data channels may include: a cloud perception channel, a self-vehicle perception channel, other vehicle perception channels, and a roadside unit perception channel. It should be noted that the cloud perception channel refers to a data channel through which the cloud or other servers provide perception data to the vehicle, also known as the Uu SDK (Software Development Kit) perception channel. The vehicle can achieve perception of the surrounding environment information through the software development kit provided by the Uu interface of the C-V2X system. The self-vehicle perception channel refers to a data channel through which the vehicle itself provides perception data to the vehicle through technical means such as sensing, also known as the HV (Highly Automated Vehicle) self-perception channel. The vehicle can access the intelligent driving domain self-perception capability module through the C-V2X system to receive the vehicle perception data collected by its own vehicle. The intelligent driving domain self-perception capability module collects and processes the perception of the surrounding environment data in real time through a variety of sensors and technical means such as cameras, radars, and laser radars (LiDAR) to generate a comprehensive understanding of the vehicle's surroundings. Other vehicle perception channels refer to data channels through which other vehicles provide perception data to the vehicle, also known as V2V (Vehicle-to-Vehicle) PC5 perception channels. Vehicles can establish communication connections with other vehicles through the PC5 interface of the C-V2X system to obtain information collected by other vehicles to achieve perception of surrounding environment information. Roadside unit perception channels refer to data channels through which roadside units (RSUs) provide perception data to the vehicle, also known as RSU PC5 perception channels. Vehicles can establish communication connections with RSUs through the PC5 interface of the C-V2X system to obtain information collected by RSUs to achieve perception of surrounding environment information. It can be understood by those skilled in the art that the multiple data channels in the embodiments of the present disclosure may be at least two of any of the four channels mentioned above, and may also include other data channels that provide vehicle perception data to the vehicle, such as V2P (Vehicle-to-Pedestrian) PC5 perception channels. Vehicles can establish communication connections with devices carried by pedestrians, such as smartphones, through the PC5 interface of the C-V2X system to obtain vehicle perception data such as location information, which is not limited in the embodiments of the present disclosure.

[0038] In step S104, the data to be processed is extracted from the vehicle perception data.

[0039] It should be noted that the data to be processed includes at least the first data and the second data, the first data and the second data correspond to different data channels and the first data and the second data correspond to the same type of vehicle perception information. The first data and the second data are vehicle perception data provided by different data channels, but the types of vehicle perception information described are the same, for example, they may be vehicle location, traffic light information, obstacle information, driving behavior, vehicle travel information, weather information, etc. In other words, the data to be processed may be repeated data with the same data description provided by different data channels. For example, it may include vehicle location information provided by the vehicle perception channel, vehicle location information provided by other vehicle perception channels, and vehicle location information provided by the cloud perception channel.

[0040] In an exemplary embodiment of the present disclosure, the data to be processed may include first data, second data, and third data, and the vehicle perception information type corresponding to the first data, the second data, and the third data is the same, and the data channels corresponding to the first data, the second data, and the third data are different. The data to be processed may include first data, second data, third data, and fourth data, and the vehicle perception information type corresponding to the first data, the second data, the third data, and the fourth data is the same, and the data channels corresponding to the first data, the second data, the third data, and the fourth data are different. It can be understood by those skilled in the art that the data to be processed may include first data, second data, ..., Nth data, and the vehicle perception information type corresponding to the first data, the second data, ..., the Nth data is the same, and the corresponding data channels are different, and N is less than or equal to the number of multiple data channels.

[0041] In step S106, based on the priority order of multiple data channels, the data to be processed is deduplicated to obtain target data.

[0042] It should be noted that the priority order of multiple data channels represents the order in which the data channels are retained first. The higher the priority order, the higher the corresponding data will be retained. Based on the priority order of multiple data channels, the part of the data to be processed that has the highest priority order of the corresponding data channel is retained, and the rest of the data is deleted to achieve deduplication of the data to be processed and obtain the target data.

[0043] It can be seen from the above steps that the data processing method provided by the embodiment of the present disclosure receives vehicle perception data provided by multiple data channels; extracts the data to be processed from the vehicle perception data, so that the data to be processed includes at least the first data and the second data, the vehicle perception information type corresponding to the first data and the second data is the same and the data channels corresponding to the first data and the second data are different; based on the priority order of the multiple data channels, the data to be processed is deduplicated to obtain the target data. The processing of the vehicle perception data provided by the multiple data channels received by the C-V2X system is realized, and the perception data is streamlined through deduplication processing. The C-V2X system only needs to process the streamlined target data in the future, reducing the resource consumption of the C-V2X system for the subsequent processing of the vehicle perception data; at the same time, the subsequent intelligent driving decision-making judgment only needs to analyze the target data, which does not require repeated analysis multiple times, and avoids the complex decision-making judgment caused by the inconsistent analysis results caused by the inconsistent vehicle perception data provided by different data channels, thereby facilitating the generation of subsequent intelligent driving decision-making judgments.

[0044] like Figure 2 As shown, it is a flowchart of the implementation process of step S104 provided for some exemplary embodiments of the present disclosure, including the following steps.

[0045] In step S202, event data is extracted from the vehicle perception data.

[0046] In step S204, first data and second data are determined in the event data to obtain data to be processed.

[0047] It should be noted that the event data types corresponding to the first data and the second data are the same. Event data represents data related to events that occur during vehicle driving, and the event data types may be collision events, obstacle detection events, signal light events, lane departure events, fault events, pedestrian detection events, etc. It can be understood by those skilled in the art that the data to be processed may include the first data, the second data, ..., the Nth data, and the event data types corresponding to the first data, the second data ..., the Nth data are the same and the corresponding data channels are different, and N is less than or equal to the number of multiple data channels.

[0048] In some exemplary embodiments of the present disclosure, event data at least includes: object size data and object absolute position coordinate data. Different types of event data may include object size data, such as obstacle size data, pedestrian size data, and own vehicle size data, and may include object absolute position coordinate data, such as obstacle absolute position coordinate data, pedestrian absolute position coordinate data, and own vehicle absolute position coordinate data. Specifically, the difference between the object size data in the first data and the object size data in the second data is within a first preset range, and the difference between the object absolute position coordinate data in the first data and the object absolute position coordinate data in the second data is within a second preset range. It can be understood by those skilled in the art that the data to be processed may include the first data, the second data, ..., the Nth data, the difference between the object size data in any two data is within the first preset range, and the difference between the object absolute position coordinate data in any two data is within the second preset range. That is to say, by judging that the object sizes in the event data provided by different data channels are the same or the difference in the object sizes is within the error range, and judging that the object absolute position coordinates in the event data provided by different data channels are the same or the difference in the absolute position coordinates is within the error range, it can be determined that the event data provided by different data channels describe the same event and need to be reprocessed.

[0049] Those skilled in the art can understand that the first preset range and the second preset range are preset and are a smaller error range. The first preset range can be the same as or different from the second preset range and can be set according to actual conditions. The embodiments of the present disclosure are not limited thereto.

[0050] In some exemplary embodiments of the present disclosure, event data may also include object color information, object type, etc. When extracting the data to be processed, the data may be filtered by first determining whether the object color information in the event data provided by different data channels is consistent and whether the object type is consistent, so as to screen out data that may describe the same event. It should be noted that the color information describes the color of the object in the event, such as the color of the vehicle in front, the color of the roadblock, etc. The object type describes the type of object in the event, such as whether the vehicle in front is a car or a truck, whether the object next to it is a motor vehicle or a pedestrian, etc. Obviously inconsistent data is filtered in advance through basic information such as object color information and object type, and then the data to be processed is determined through object size data and object absolute position coordinate data, so as to reduce the amount of calculation during data extraction, save computing resources, and improve the efficiency of data extraction.

[0051] like Figure 3 As shown, it is a flowchart of the implementation process of step S106 provided for some exemplary embodiments of the present disclosure, including the following steps.

[0052] In step S302, at least two data channels corresponding to the data to be processed are determined.

[0053] In step S304, based on the priority order of the multiple data channels, a target data channel with the highest priority among the at least two data channels is determined.

[0054] In step S306, the data corresponding to the target data channel in the data to be processed is retained to obtain the target data.

[0055] It should be noted that at least two data channels corresponding to the data to be processed are part or all of the multiple data channels. Based on the priority order of the multiple data channels, the target data channel with the highest priority among the at least two data channels can be determined. The data corresponding to the target data channel in the data to be processed is retained, that is, one of the first data, the second data, ..., the Nth data, and the other data is deleted to obtain the target data. According to the priority order of the multiple data channels, the data corresponding to the data channel with the highest priority in the data to be processed is retained, and the data corresponding to the remaining data channels is deleted to achieve data deduplication, so as to reduce the repeated processing of the subsequent C-V2X system when processing this part of the data, and to avoid the inconsistency of the data provided by multiple data channels in certain contents, which may lead to contradictions in decision analysis in the subsequent processing process.

[0056] Accordingly, in an exemplary embodiment of the present disclosure, the provided data processing method further includes: determining the priority order of multiple data channels. In some exemplary embodiments of the present disclosure, the priority order of multiple data channels is preset, and the setting order takes into account the data credibility and data timeliness of each data channel, and the data channels with high credibility and / or strong timeliness are sorted first. In an embodiment where the multiple data channels include a cloud perception channel, a self-vehicle perception channel, other vehicle perception channels, and a roadside unit perception channel, the priority order of the multiple data channels includes: the priority of the self-vehicle perception channel is higher than that of other vehicle perception channels; the priority of other vehicle perception channels is higher than that of the roadside unit perception channel; and the priority of the roadside unit perception channel is higher than that of the cloud perception channel.

[0057] In some other exemplary embodiments of the present disclosure, the priority order of multiple data channels can be preset and then dynamically adjusted. Figure 4 As shown, a flowchart of an implementation process for determining the priority order of multiple data channels provided in some exemplary embodiments of the present disclosure includes the following steps.

[0058] In step S402, a preset priority order of multiple data channels is determined.

[0059] In step S404, the credibility ranking of each data channel in at least two data channels is determined based on the confidence identifier in the data to be processed.

[0060] In step S406, based on the credibility ranking, the preset priority order is adjusted to obtain the priority order of the multiple data channels.

[0061] It should be noted that the preset priority order of multiple data channels is pre-set. Referring to the examples provided in the above embodiments, the data credibility and data timeliness of each data channel are considered, and data channels with high credibility and / or strong timeliness are sorted first.

[0062] It should be noted that the confidence identifier in the data to be processed is provided together with the vehicle perception data in the form of a confidence identifier after each data channel determines whether the data is credible and evaluates the credibility when providing the vehicle perception data. In some embodiments of the present disclosure, the confidence identifiers provided by different data channels and the pre-set credibility judgment rules can determine the credibility ranking of each data channel in at least two data channels. The credibility judgment rules are pre-set and describe the confidence identifier comparison rules corresponding to different data channels. For example, the confidence levels represented by the confidence identifiers corresponding to different data channels can be directly compared. The larger the value, the higher the credibility; or when the confidence level represented by the confidence identifier corresponding to the vehicle perception channel is lower than 50%, the credibility can be ranked lowest. The setting of specific rules needs to be determined according to actual conditions, and the embodiments of the present disclosure are not limited here.

[0063] In an exemplary embodiment of the present disclosure, based on the credibility ranking, the preset priority order is adjusted to obtain the priority order of multiple data channels. Specifically, the priority order of the channel with a higher credibility ranking is also higher, and the ranking not described in the credibility ranking still refers to the preset priority order. For example, the preset priority order is: the priority of the vehicle perception channel is higher than that of other vehicle perception channels; the priority of other vehicle perception channels is higher than that of the roadside unit perception channel; the priority of the roadside unit perception channel is higher than that of the cloud perception channel. The credibility ranking is that the roadside unit perception channel is ranked before other vehicle perception channels, and the adjusted priority order of the multiple data channels is: the priority of the vehicle perception channel is higher than that of the roadside unit perception channel; the priority of the roadside unit perception channel is higher than that of other vehicle perception channels; and the priority of other vehicle perception channels is higher than that of the cloud perception channel. By dynamically adjusting the priority order of multiple data channels based on the confidence identifier uploaded with the data, it is ensured that when the data of some data channels is unreliable, it will not be retained due to the higher priority order, so as to ensure the credibility of the target data after deduplication.

[0064] Figure 5A data processing method according to some embodiments of the present disclosure is shown in FIG. Figure 2 , Figure 5 In the data processing method shown in FIG. Figure 1 Steps S102 and S106 in the data processing method shown correspond to each other and will not be repeated here.

[0065] In some embodiments of the present disclosure, Figure 1 Based on the data processing method shown, Figure 5 The data processing method shown may also include the following steps.

[0066] In step S504, the vehicle perception data is preprocessed to obtain processed vehicle perception data.

[0067] In step S506, the data to be processed is extracted from the processed vehicle perception data.

[0068] It should be noted that the preprocessing of vehicle perception data can be data cleaning, such as removing error data, or data integration, data format alignment, protocol conversion, etc.

[0069] In some exemplary embodiments of the present disclosure, the implementation of step S504 may include: for the vehicle perception data provided by each data channel, based on the object identification and object location information in the vehicle perception data, determining the repeated perception data; based on the repeated perception data, deduplicating the vehicle perception data. It should be noted that the vehicle perception data is real-time, and the same event may be reported at different times, that is, repeated perception. The repeated perception data is not worthy of attention for the C-V2X system. Through deduplication processing, the data perceived for the first time can be retained, thereby reducing the computing resource consumption caused by multiple processing of repeated data and improving data processing efficiency.

[0070] In some exemplary embodiments of the present disclosure, for the vehicle perception data provided by each data channel, by comparing it with the vehicle perception data at the previous reporting time, based on the object identification (ID) and object location information, it is determined whether it is repeated perception data. If the object identification and object location information are the same as those at the previous reporting time, it is determined to be repeated perception data and can be directly deleted. For example, the roadside unit perception channel provides vehicle perception data every 2 seconds, and there is a vehicle parked on the roadside. While the vehicle is stationary, the relevant data for the vehicle in the vehicle perception data provided by the roadside unit perception channel every 2 seconds are the same. Except for the data reported for the first time, the relevant data of the vehicle in the vehicle perception data provided subsequently can be determined as repeated perception data and can be deleted. Until the vehicle starts to move, the object location information changes, and it will no longer be determined as repeated perception data, and enters the subsequent processing flow.

[0071] In some exemplary embodiments of the present disclosure, after obtaining the target data, the target data is sent to the V2X system application layer to provide specific application scenarios and service functions, directly serve the end user or application, and prompt the user through the HMI (Human-Machine Interface). The application layer can support various types of services, such as traffic safety, traffic efficiency improvement, information services, etc.

[0072] It should be noted that the vehicle perception data provided by the self-vehicle perception channel is crucial to functions such as vehicle intelligent driving, and the data is highly timely and reliable. Therefore, multiple data channels include at least: a self-vehicle perception channel. Functions such as intelligent driving decision analysis in the vehicle can be determined based on the vehicle perception data provided by the self-vehicle perception channel, but there are also cases where the vehicle perception data provided by the self-vehicle perception channel is missing or unreliable. In order to ensure the accurate implementation of the intelligent driving function, in some embodiments of the present disclosure, in response to the data channel corresponding to the target data not being the self-vehicle perception channel, the target data is sent to the intelligent driving domain perception source to complete or correct the data source of the intelligent driving domain perception source.

[0073] It should be noted that the Intelligent Driving Domain refers to the part of the vehicle responsible for realizing autonomous driving functions and related intelligent assisted driving technologies. It is a complex system that integrates multiple subsystems such as perception, decision-making and execution, aiming to improve driving safety, comfort and efficiency. The intelligent driving domain perception source is used to collect or receive corresponding perception data for the intelligent driving domain. It can collect data on the vehicle's surrounding environment through sensors including cameras, radars (RADAR), laser radars (LiDAR), ultrasonic sensors, etc. The precise position and posture of the vehicle can be determined through positioning systems such as GPS and inertial measurement units (IMU). Detailed geographic information can be provided through map data to help vehicles understand complex road environments.

[0074] In order to better illustrate the data processing method provided by the embodiment of the present disclosure, a specific example is now provided for further explanation. Figure 6 The figure is a partial data flow diagram of a vehicle functional system constructed by applying the data processing method provided by the embodiment of the present disclosure in this specific example.

[0075] like Figure 6 As shown, the vehicle is equipped with an intelligent driving domain system, a V2X system and a cockpit domain display system.

[0076] The V2X system includes a data access and protocol stack layer and an application layer, and an arbitration deduplication layer is provided in the data access and protocol stack layer. The data access and protocol stack layer is used to access data transmitted by various communication interfaces and perform data format conversion and other processing according to the corresponding protocol. The arbitration deduplication layer is used to perform data processing provided by the embodiment of the present disclosure on the accessed data.

[0077] Specifically, vehicle-cloud integrated data is connected to the V2X system via the UU SDK interface, external data is connected to the V2X system via the RSU PC5 interface and the V2V PC5 interface, and the data provided by the self-vehicle perception channel is transmitted to the V2X system by the self-perception capability unit of the intelligent driving domain. After the vehicle perception data provided by multiple data channels are connected to the V2X system, they are processed by the arbitration deduplication layer to obtain the target data and then transmitted to the application layer. When the data channel corresponding to the target data is not the self-vehicle perception channel, the target data is sent to the intelligent driving domain system via the application layer to supplement the data of the intelligent driving domain perception source. After the application layer processes the target data, it displays the service results to the user through the display system of the cockpit domain, such as the HMI time prompt and / or signal display.

[0078] By setting up an arbitration deduplication layer, duplicate event data from multiple data sources is deduplicated, and the deduplicated data is reported to the V2X application layer and downstream data application parties to avoid the V2X application layer from repeatedly processing the same event data due to data reported by multiple channel data sources, thereby reducing system load. Avoid duplicate prompts caused by the same event data input to the V2X application layer by multiple channel data sources, and the resulting functional failure or poor functional effect.

[0079] It should be noted that the acquisition, storage, use, and processing of data in the technical solution disclosed in this disclosure are in compliance with the relevant provisions of national laws and regulations.

[0080] The following are embodiments of the device disclosed herein, which can be used to execute the method embodiments disclosed herein. For details not disclosed in the device embodiments disclosed herein, please refer to the method embodiments disclosed herein.

[0081] Figure 7 is a block diagram of a data processing device according to some embodiments of the present disclosure. Figure 7 The device includes: a data receiving unit 701, a data extracting unit 702, and a deduplication processing unit 703.

[0082] A data receiving unit 701 is used to receive vehicle sensing data provided by multiple data channels; The data extraction unit 702 is used to extract the data to be processed from the vehicle perception data; wherein the data to be processed includes at least first data and second data, the first data and the second data correspond to the same type of vehicle perception information; and the first data and the second data correspond to different data channels; The deduplication processing unit 703 is used to perform deduplication processing on the data to be processed based on the priority order of multiple data channels to obtain target data.

[0083] It should be noted that the multiple data channels include: cloud perception channel, self-vehicle perception channel, other vehicle perception channel and roadside unit perception channel. The priority order of the multiple data channels is preset; the priority order of the multiple data channels includes: the priority of the self-vehicle perception channel is higher than the other vehicle perception channel; the priority of the other vehicle perception channel is higher than the roadside unit perception channel; the priority of the roadside unit perception channel is higher than the cloud perception channel.

[0084] In some exemplary embodiments of the present disclosure, the data extraction unit 702 is configured to: Extracting event data from vehicle perception data; Determine first data and second data in the event data to obtain data to be processed; The event data types corresponding to the first data and the second data are the same.

[0085] In some exemplary embodiments of the present disclosure, event data includes at least: object size data and object absolute position coordinate data; the difference between the object size data in the first data and the object size data in the second data is within a first preset range; and the difference between the object absolute position coordinate data in the first data and the object absolute position coordinate data in the second data is within a second preset range.

[0086] In some exemplary embodiments of the present disclosure, the deduplication processing unit 703 is configured to: Determine at least two data channels corresponding to the data to be processed; Determine a target data channel with the highest priority among at least two data channels based on the priority order of the multiple data channels; The data corresponding to the target data channel in the data to be processed is retained to obtain the target data.

[0087] In some exemplary embodiments of the present disclosure, the provided data processing device further includes: an order determination unit, configured to: determine a priority order of the plurality of data channels.

[0088] In some exemplary embodiments of the present disclosure, the sequence determination unit is configured to: Determine a preset priority order of multiple data channels; Determine the credibility ranking of each data channel in at least two data channels based on the confidence identifier in the data to be processed; Based on the credibility ranking, the preset priority order is adjusted to obtain the priority order of multiple data channels.

[0089] In some exemplary embodiments of the present disclosure, the provided data processing device further includes: a preprocessing unit, which is used to: preprocess the vehicle perception data to obtain processed vehicle perception data. Accordingly, the data extraction unit 702 is used to: extract the data to be processed from the processed vehicle perception data.

[0090] In some exemplary embodiments of the present disclosure, the preprocessing unit is configured to: For the vehicle perception data provided by each data channel, determining repeated perception data based on object identification and object position information in the vehicle perception data; Based on duplicate perception data, the vehicle perception data is deduplicated.

[0091] In some exemplary embodiments of the present disclosure, the multiple data channels include at least: a self-vehicle perception channel. The provided data processing device also includes: a data sending unit, which is used to: in response to the data channel corresponding to the target data not being the self-vehicle perception channel, send the target data to the intelligent driving domain perception source.

[0092] Figure 8 800 is a block diagram of a vehicle 800 according to an exemplary embodiment. For example, the vehicle 800 may be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. The vehicle 800 may be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

[0093] Reference Figure 8 , the vehicle 800 may include various subsystems, for example, an infotainment system 810, a perception system 820, a decision control system 830, a drive system 840, and a computing platform 850. The vehicle 800 may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and each component of the vehicle 800 may be interconnected by wire or wireless means.

[0094] In some embodiments, the infotainment system 810 may include a communication system, an entertainment system, and a navigation system, etc.

[0095] The perception system 820 may include several sensors for sensing information about the environment around the vehicle 800. For example, the perception system 820 may include a global positioning system (the global positioning system may be a GPS system, or a Beidou system or other positioning systems), an inertial measurement unit (IMU), a laser radar, a millimeter wave radar, an ultrasonic radar, and a camera.

[0096] The decision control system 830 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.

[0097] The drive system 840 may include components that provide powered motion for the vehicle 800. In one embodiment, the drive system 840 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of an internal combustion engine, an electric motor, and an air compression engine. The engine is capable of converting energy provided by the energy source into mechanical energy.

[0098] Some or all functions of the vehicle 800 are controlled by a computing platform 850. The computing platform 850 may include at least one processor 851 and a memory 852, and the processor 851 may execute instructions 853 stored in the memory 852.

[0099] The processor 851 may be any conventional processor, such as a commercially available CPU. The processor may also include a data processor (Graphic Process Unit, GPU), a Field Programmable Gate Array (Field Programmable Gate Array, FPGA), a System on Chip (System on Chip, SOC), an Application Specific Integrated Circuit (Application Specific Integrated Circuit, ASIC) or a combination thereof.

[0100] The memory 852 may be implemented by any type of volatile or nonvolatile memory device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0101] In addition to instructions 853 , memory 852 may also store data, such as road maps, route information, vehicle location, direction, speed, etc. The data stored in memory 852 may be used by computing platform 850 .

[0102] In the embodiment of the present disclosure, the processor 851 may execute instruction 853 to complete all or part of the steps of the above-mentioned data processing method.

[0103] In some embodiments of the present disclosure, a non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a mobile terminal, enables the mobile terminal to execute the above-mentioned data processing method.

[0104] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0105] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A data processing method, characterized in that: include: Receiving vehicle perception data provided by multiple data channels; Extracting data to be processed from the vehicle perception data; wherein the data to be processed includes at least first data and second data, the first data and the second data correspond to the same type of vehicle perception information; and the first data and the second data correspond to different data channels; Based on the priority order of the multiple data channels, the data to be processed is deduplicated to obtain target data.

2. The data processing method according to claim 1, characterized in that: Extracting data to be processed from the vehicle perception data includes: extracting event data from the vehicle perception data; Determine the first data and the second data in the event data to obtain the data to be processed; The event data types corresponding to the first data and the second data are the same.

3. The data processing method according to claim 2, characterized in that: The event data at least includes: object size data and object absolute position coordinate data; The difference between the object size data in the first data and the object size data in the second data is within a predetermined range; And the difference between the absolute position coordinate data of the object in the first data and the absolute position coordinate data of the object in the second data is within a second preset range.

4. The data processing method according to claim 1, characterized in that: Based on the priority order of the multiple data channels, deduplication processing is performed on the data to be processed to obtain target data, including: Determining at least two data channels corresponding to the data to be processed; Determining a target data channel with the highest priority among the at least two data channels based on the priority order of the multiple data channels; The data corresponding to the target data channel in the data to be processed is retained to obtain the target data.

5. The data processing method according to claim 4, characterized in that: Also includes: Determining a priority order of the plurality of data channels; Determining the priority order of the multiple data channels includes: Determining a preset priority order of the plurality of data channels; Determining a credibility ranking of each of the at least two data channels based on the confidence identifier in the data to be processed; Based on the credibility ranking, the preset priority order is adjusted to obtain the priority order of the multiple data channels.

6. The data processing method according to claim 1, characterized in that: Also includes: Preprocessing the vehicle perception data to obtain processed vehicle perception data; Wherein, extracting the data to be processed from the vehicle perception data includes: The data to be processed is extracted from the processed vehicle perception data.

7. The data processing method according to claim 6, characterized in that: Preprocessing the vehicle perception data includes: For the vehicle perception data provided by each data channel, determining repeated perception data based on the object identification and object position information in the vehicle perception data; Based on the duplicate perception data, the vehicle perception data is deduplicated.

8. The data processing method according to claim 1, characterized in that: The multiple data channels include at least: a self-vehicle perception channel; In response to the data channel corresponding to the target data not being a self-vehicle perception channel, the target data is sent to an intelligent driving domain perception source.

9. The data processing method according to claim 1, characterized in that: The multiple data channels include: Cloud perception channel, vehicle perception channel, other vehicle perception channel and roadside unit perception channel.

10. The data processing method according to claim 9, characterized in that: The priority order of the multiple data channels is preset; The priority order of the multiple data channels includes: the priority of the self-vehicle perception channel is higher than the priority of the other vehicle perception channels; the priority of the other vehicle perception channels is higher than the roadside unit perception channel; the priority of the roadside unit perception channel is higher than the cloud perception channel.

11. A data processing device, characterized in that: include: A data receiving unit, used for receiving vehicle perception data provided by multiple data channels; A data extraction unit, configured to extract data to be processed from the vehicle perception data; wherein the data to be processed includes at least first data and second data, the first data and the second data correspond to the same type of vehicle perception information; and the first data and the second data correspond to different data channels; The deduplication processing unit is used to perform deduplication processing on the data to be processed based on the priority order of the multiple data channels to obtain target data.

12. A vehicle, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: Implement a data processing method as described in any one of claims 1 to 10.

13. A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is enabled to execute a data processing method according to any one of claims 1 to 10.

Images