Data processing method and device and intelligent driving equipment

Abstract

The embodiment of the invention provides a data processing method and device and intelligent driving equipment. The data processing method comprises the steps that it is determined that the intelligent driving equipment is in a first driving scene; acquiring first data from the sensors in the first sensor group and processing the first data, wherein the first data corresponds to a first frame rate; when determining that the intelligent driving equipment is switched from the first driving scene to a second driving scene, acquiring second data from sensors in a second sensor group and processing the second data, or acquiring third data from sensors in a first sensor group and processing the third data, the third data corresponds to a second frame rate, the second sensor group comprises a part of sensors in the first sensor group, and the first frame rate is greater than the second frame rate. The embodiment of the invention can be applied to an intelligent automobile or an electric automobile, and the endurance and economical efficiency of the automobile can be improved.

Description

Data processing method, device and intelligent driving equipment Technical Field

[0001] The embodiments of the present application relate to the field of intelligent driving, and more specifically, to a data processing method, apparatus, and intelligent driving device. Background Art

[0002] With the advancement of vehicle intelligence, more and more vehicles are equipped with intelligent driving systems, such as advanced driving assistant systems (ADAS). ADAS include high-power devices, such as system-on-chips (SoCs). If these high-power devices remain in high-power scenarios, they can affect the range and economic efficiency of intelligent driving devices.

[0003] Summary of the Invention

[0004] The embodiments of the present application provide a data processing method, apparatus, and intelligent driving device, which help to improve the endurance and economy of the intelligent driving device.

[0005] The intelligent driving device in this application may include road vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or entertainment equipment, etc. For example, the intelligent driving device can be a vehicle, which is a vehicle in a broad sense, and can be a vehicle (such as a commercial vehicle, a passenger car, a motorcycle, a flying car, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), agricultural equipment (such as a mower, a harvester, etc.), amusement equipment, a toy vehicle, etc. The embodiment of this application does not specifically limit the type of vehicle. For example, the intelligent driving device can be a vehicle such as an airplane or a ship. In addition to being applicable to intelligent driving devices, the embodiments of this application can also be applied to other devices, for example, a terminal device (such as a mobile phone) or a robot (such as a drone).

[0006] In a first aspect, a data processing method is provided, comprising: acquiring first data from a sensor in a first sensor group and processing the first data, the first data corresponding to a first frame rate; when it is determined that a preset condition is met, acquiring second data from a sensor in a second sensor group and processing the second data, or acquiring third data from a sensor in the first sensor group and processing the third data, the third data corresponding to a second frame rate, wherein the first frame rate and the second frame rate are different.

[0007] In the embodiment of the present application, the intelligent driving device can process the first data from the first sensor group and, when a preset condition is met, can process the second data from the second sensor group or the third data from a sensor in the first sensor group. In this way, the intelligent driving device can flexibly choose to process data from different sensors, or choose to process data from the same sensor at different frame rates, which helps to improve the flexibility of the intelligent driving device in data processing.

[0008] In combination with the first aspect, in some implementations of the first aspect, the second sensor group includes some sensors in the first sensor group, and the first frame rate is greater than the second frame rate.

[0009] In an embodiment of the present application, when preset conditions are met, processing the data of some sensors or processing the third data after reducing the frame rate helps to reduce the power consumption of the intelligent driving device, thereby helping to improve the battery life and economy of the intelligent driving device.

[0010] In combination with the first aspect, in certain implementations of the first aspect, the obtaining of first data from sensors in the first sensor group and processing the first data includes: when it is determined that the intelligent driving device is in a first driving scene, obtaining first data from sensors in the first sensor group and processing the first data, and the first driving scene is associated with the first frame rate; when it is determined that a preset condition is met, obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, includes: when it is determined that the intelligent driving device switches from the first driving scene to the second driving scene, obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, and the second driving scene is associated with the second frame rate.

[0011] In an embodiment of the present application, when the intelligent driving device switches from a first driving scenario to a second driving scenario, the intelligent driving device can process the second data from the sensors in the second sensor group, or process the third data collected by the sensors in the first sensor group. This helps reduce the power consumption of the intelligent driving device, thereby improving the endurance and economy of the intelligent driving device; it also helps prevent the temperature of components in the intelligent driving system from overheating, thereby improving the reliability and safety of the intelligent driving system.

[0012] In some possible implementations, the autonomous driving level corresponding to the first driving scenario is higher than the autonomous driving level corresponding to the second driving scenario. For example, the first driving scenario is a highway autonomous driving scenario, and the second driving scenario is a highway assisted driving scenario.

[0013] In some possible implementations, the driving function corresponding to the first driving scenario is different from the driving function corresponding to the second driving scenario.

[0014] In some possible implementations, acquiring second data from sensors in the second sensor group and processing the second data includes: acquiring data from sensors in the first sensor group and processing second data in the data collected by sensors in the second sensor group.

[0015] In some possible implementations, before acquiring the second data from the sensors in the second sensor group and processing the second data, the method includes: turning off other sensors in the first sensor group except the second sensor group.

[0016] In some possible implementations, shutting down the other sensors in the first sensor group except the second sensor group includes shutting down the other sensors in the first sensor group except the second sensor group through power gating or clock gating.

[0017] Turning off the other sensors in the first sensor group except the second sensor group by power gate or clock gate can also be understood as turning off the other sensors in the first sensor group except the second sensor group by turning off the power or turning off the clock.

[0018] In combination with the first aspect, in certain implementations of the first aspect, when determining that the intelligent driving device switches from the first driving scene to the second driving scene, second data from the sensors in the second sensor group is obtained and the second data is processed; wherein, the method also includes: when determining that the intelligent driving device switches from the second driving scene to the third driving scene, fifth data from the sensors in the third sensor group is obtained and the fifth data is processed, or, sixth data from the sensors in the second sensor group is obtained and the sixth data is processed, the third driving scene is associated with the third frame rate; wherein, the third sensor includes some sensors in the second sensor group, and the frame rate corresponding to the second data is greater than the frame rate corresponding to the sixth data.

[0019] In an embodiment of the present application, when the intelligent driving device switches from the second driving scenario to the third driving scenario, the intelligent driving device can process the fifth data from the sensors in the third sensor group, or process the sixth data collected from the sensors in the second sensor group. This helps reduce the power consumption of the intelligent driving device, thereby helping to improve the endurance and economy of the intelligent driving device. Furthermore, reducing the power consumption of the intelligent driving device can prevent excessive temperature increases in the device, thereby helping to improve the reliability and safety of the intelligent driving system.

[0020] In combination with the first aspect, in certain implementations of the first aspect, the processing of the first data includes: processing the first data by multiple processing devices in the first processor; wherein, obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, includes: processing the second data by some processing devices in the multiple processing devices, or processing the third data by some processing devices.

[0021] In an embodiment of the present application, when the intelligent driving device switches from a first driving scenario to a second driving scenario, the intelligent driving device can select some of the processing devices from the multiple processing devices to process the second data or the third data. This helps reduce the power consumption of the intelligent driving device by reducing the number of processing devices, thereby improving the endurance and economy of the intelligent driving device. Furthermore, reducing the power consumption of the intelligent driving device can prevent excessive temperature increases in the device, thereby improving the reliability and safety of the intelligent driving system.

[0022] In some possible implementations, before processing the second data or the third data, the method further includes: shutting down other processing devices among the multiple processing devices except for the part of the processing devices.

[0023] In some possible implementations, shutting down the other processing devices among the multiple processing devices except for the part of the processing devices includes: shutting down the other processing devices among the multiple processing devices except for the part of the processing devices through a power gate or a clock gate.

[0024] In some possible implementations, the processing device may be a central processing unit (CPU) or a computing core. For example, the computing core may be an artificial intelligence core (AI core) or a graphics processing unit (GPU) core.

[0025] In combination with the first aspect, in certain implementations of the first aspect, before obtaining second data from a sensor in the second sensor group and processing the second data, or obtaining third data from a sensor in the first sensor group and processing the third data, the method also includes: determining that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, and the second preset temperature is greater than the first preset temperature.

[0026] In an embodiment of the present application, when the intelligent driving device switches from a first driving scenario to a second driving scenario and the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, the intelligent driving device may process the second data from the sensors in the second sensor group, or process the third data collected by the sensors in the first sensor group. In this way, by combining the switching of intelligent driving scenarios with the change in the temperature of the first processor, the accuracy of the intelligent driving device's decisions can be further improved. Furthermore, it helps prevent the temperature of components in the intelligent driving system from overheating, thereby improving the reliability and safety of the intelligent driving system.

[0027] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when it is determined that the temperature of the first processor is greater than or equal to the second preset temperature, stopping data processing by the first processor.

[0028] In this embodiment of the present application, when the temperature of the first processor is greater than or equal to a second preset temperature, data processing by the first processor may be stopped. This helps prevent the reliability and safety of the intelligent driving system from being affected by the overheating of the first processor, and also helps prevent damage to the first processor.

[0029] In some possible implementations, the method further includes: when stopping data processing by the first processor, taking over the intelligent driving system or intelligent driving device by a micro controller unit (MCU).

[0030] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when it is determined that the temperature of the first processor is greater than or equal to the second preset temperature for a duration greater than or equal to the first preset duration, stopping data processing by the first processor.

[0031] In this embodiment of the present application, if the temperature of the first processor is greater than or equal to the second preset temperature for a period greater than or equal to the first preset time, data processing by the first processor may be stopped. This helps prevent the reliability and safety of the intelligent driving system from being affected by the excessive temperature of the first processor and also helps prevent damage to the first processor.

[0032] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when determining that the intelligent driving device switches from the second intelligent driving scene to the first intelligent driving scene, obtaining fourth data from the sensor in the first sensor group and processing the fourth data, the fourth data corresponding to the first frame rate.

[0033] In combination with the first aspect, in certain implementations of the first aspect, the processing of the first data includes: when it is determined that the temperature of the first processor is less than a first preset temperature, processing the first data by the first processor; when it is determined that the preset condition is met, obtaining second data from the sensors in the second sensor group and processing the second data, or obtaining third data from the sensors in the first sensor group and processing the third data, including: when it is determined that the temperature of the first processor is greater than or equal to the first preset temperature and less than the second preset temperature, obtaining second data from the sensors in the second sensor group and processing the second data, or obtaining third data from the sensors in the first sensor group and processing the third data, wherein the first preset temperature is less than the second preset temperature.

[0034] In an embodiment of the present application, when the temperature of the first processor is too high, it is possible to choose to process the second data from some sensors or the third data with a lower frame rate, which helps to reduce the power consumption of the intelligent driving device, thereby helping to improve the battery life and economy of the intelligent driving device; at the same time, it helps to avoid the impact of the high temperature of the first processor on the reliability and safety of the intelligent driving device system, and also helps to avoid damage to the first processor.

[0035] In some possible implementations, acquiring second data from sensors in the second sensor group and processing the second data includes: acquiring data from sensors in the first sensor group and processing second data in the data collected by sensors in the second sensor group.

[0036] In some possible implementations, before acquiring the second data from the sensors in the second sensor group and processing the second data, the method includes: turning off other sensors in the first sensor group except the second sensor group.

[0037] In combination with the first aspect, in certain implementations of the first aspect, the first processor includes multiple processing devices, and the processing of the first data by the first processor includes: processing the first data by the multiple processing devices; obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, includes: processing the second data by some of the processing devices in the multiple processing devices, or processing the third data by the some of the processing devices.

[0038] In an embodiment of the present application, when the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, the intelligent driving device may select some of the processing devices from the plurality of processing devices to process the second data or the third data. This, by reducing the number of processing devices, helps further reduce the power consumption of the intelligent driving device, thereby helping to improve the endurance and economy of the intelligent driving device. Furthermore, reducing the power consumption of the intelligent driving device can prevent the temperature of components in the intelligent driving system from continuing to rise, helping to improve the reliability and safety of the intelligent driving system and also helping to prevent damage to components in the intelligent driving system.

[0039] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when it is determined that the temperature of the first processor is greater than or equal to the second preset temperature, stopping data processing by the first processor.

[0040] In this embodiment of the present application, when the temperature of the first processor is greater than or equal to a second preset temperature, data processing by the first processor may be stopped. This helps prevent the reliability and safety of the intelligent driving system from being affected by the overheating of the first processor, and also helps prevent damage to the first processor.

[0041] In some possible implementations, the method further includes: when stopping data processing by the first processor, taking over the intelligent driving system or intelligent driving device by the MCU.

[0042] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when it is determined that the temperature of the first processor is greater than or equal to the second preset temperature for a duration greater than or equal to the first preset duration, stopping data processing by the first processor.

[0043] In this embodiment of the present application, if the temperature of the first processor is greater than or equal to the second preset temperature for a period greater than or equal to the first preset time, data processing by the first processor may be stopped. This helps prevent the reliability and safety of the intelligent driving system from being affected by the excessive temperature of the first processor and also helps prevent damage to the first processor.

[0044] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when determining that the temperature of the first processor is less than or equal to a third preset temperature, obtaining fourth data from the sensor in the first sensor group and processing the fourth data, the fourth data corresponding to the first frame rate; wherein the first preset temperature is greater than the third preset temperature.

[0045] In an embodiment of the present application, by setting the hysteresis temperature (the difference between the first preset temperature and the third preset temperature), the intelligent driving system can be prevented from switching back and forth between different system states, thereby helping to improve the reliability and safety of the intelligent driving system.

[0046] In combination with the first aspect, in certain implementations of the first aspect, the processing of the first data includes: processing the first data within a first time period; when it is determined that the preset condition is met, obtaining second data from the sensors in the second sensor group and processing the second data, or obtaining third data from the sensors in the first sensor group and processing the third data, includes: at the end of the first time period, obtaining second data from the sensors in the second sensor group and processing the second data, or obtaining third data from the sensors in the first sensor group and processing the third data.

[0047] In combination with the first aspect, in some implementations of the first aspect, the second sensor group includes the first sensor group and a third sensor group, and the first frame rate is lower than the second frame rate.

[0048] In combination with the first aspect, in certain implementations of the first aspect, the obtaining of first data from sensors in the first sensor group and processing the first data includes: when it is determined that the intelligent driving device is in a first driving scene, obtaining first data from sensors in the first sensor group and processing the first data, and the first driving scene is associated with the first frame rate; when it is determined that a preset condition is met, obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, includes: when it is determined that the intelligent driving device switches from the first driving scene to the second driving scene, obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, and the second driving scene is associated with the second frame rate.

[0049] In some possible implementations, the autonomous driving level corresponding to the first driving scenario is lower than the autonomous driving level corresponding to the second driving scenario.

[0050] For example, the first driving scenario is a highway assisted driving scenario, and the second driving scenario is a highway automatic driving scenario.

[0051] In combination with the first aspect, in certain implementations of the first aspect, the processing of the first data includes: when it is determined that the temperature of the first processor is greater than or equal to a fourth preset temperature, processing the first data by the first processor; when it is determined that the preset condition is met, obtaining second data from the sensors in the second sensor group and processing the second data, or obtaining third data from the sensors in the first sensor group and processing the third data, including: when it is determined that the temperature of the first processor is less than the fourth preset temperature and greater than or equal to a fifth preset temperature, obtaining second data from the sensors in the second sensor group and processing the second data, or obtaining third data from the sensors in the first sensor group and processing the third data, wherein the fourth preset temperature is greater than the fifth preset temperature.

[0052] In a second aspect, a data processing device is provided, which includes: a data processing unit for acquiring first data from sensors in a first sensor group and processing the first data, the first data corresponding to a first frame rate; a determination unit for determining whether a preset condition is satisfied; the data processing unit is also used to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from sensors in the first sensor group and process the third data, the third data corresponding to a second frame rate, wherein the first frame rate and the second frame rate are different.

[0053] In combination with the second aspect, in some implementations of the second aspect, the second sensor group includes some sensors in the first sensor group, and the first frame rate is greater than the second frame rate.

[0054] In combination with the second aspect, in certain implementations of the second aspect, the data processing unit is used to obtain first data from sensors in the first sensor group and process the first data when the determination unit determines that the intelligent driving device is in a first driving scene, and the first driving scene is associated with the first frame rate; when the determination unit determines that the intelligent driving device switches from the first driving scene to the second driving scene, obtain second data from sensors in the second sensor group and process the second data, or obtain third data from sensors in the first sensor group and process the third data, and the second driving scene is associated with the second frame rate.

[0055] In combination with the second aspect, in certain implementations of the second aspect, the data processing unit is used to: process the first data through multiple processing devices in the first processor; process the second data through some processing devices in the multiple processing devices, or process the third data through the some processing devices.

[0056] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is further used to: before the data processing unit processes the second data or the third data, determine that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, and the second preset temperature is greater than the first preset temperature.

[0057] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is further used to: determine that the temperature of the first processor is greater than or equal to the second preset temperature; and the data processing unit is further used to: stop data processing through the first processor.

[0058] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is further used to: determine that the temperature of the first processor is greater than or equal to the second preset temperature and the duration is greater than or equal to the first preset duration; the data processing unit is further used to: stop data processing through the first processor.

[0059] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is further used to: determine that the intelligent driving device switches from the second intelligent driving scene to the first intelligent driving scene; the data processing unit is further used to: obtain fourth data from the sensor in the first sensor group and process the fourth data, the fourth data corresponding to the first frame rate.

[0060] In combination with the second aspect, in certain implementations of the second aspect, the data processing unit is used to process the first data through a first processor; when it is determined that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, obtain second data from a sensor in the second sensor group and process the second data, or obtain third data from a sensor in the first sensor group and process the third data, wherein the first preset temperature is less than the second preset temperature.

[0061] In combination with the second aspect, in certain implementations of the second aspect, the first processor includes multiple processing devices, and the data processing unit is used to: process the first data through the multiple processing devices; process the second data through some of the multiple processing devices, or process the third data through the some of the processing devices.

[0062] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is further used to: determine that the temperature of the first processor is greater than or equal to the second preset temperature; and the data processing unit is further used to: stop data processing through the first processor.

[0063] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is further used to: determine that the temperature of the first processor is greater than or equal to the second preset temperature and the duration is greater than or equal to the first preset duration; the data processing unit is further used to: stop data processing through the first processor.

[0064] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is further used to: determine that the temperature of the first processor is less than or equal to a third preset temperature; the data processing unit is further used to obtain fourth data from the sensor in the first sensor group and process the fourth data, the fourth data corresponding to the first frame rate; wherein the first preset temperature is greater than the third preset temperature.

[0065] In combination with the second aspect, in some implementations of the second aspect, the second sensor group includes the first sensor group and a third sensor group, and the first frame rate is lower than the second frame rate.

[0066] In combination with the second aspect, in certain implementations of the second aspect, the data processing unit is used to: when the determination unit determines that the intelligent driving device is in a first driving scene, obtain first data from sensors in the first sensor group and process the first data, and the first driving scene is associated with the first frame rate; when the determination unit determines that the intelligent driving device switches from the first driving scene to the second driving scene, obtain second data from sensors in the second sensor group and process the second data, or obtain third data from sensors in the first sensor group and process the third data, and the second driving scene is associated with the second frame rate.

[0067] In combination with the second aspect, in certain implementations of the second aspect, the data processing unit is used to: process the first data through a first processor; when the determination unit determines that the temperature of the first processor is less than a fourth preset temperature and greater than or equal to a fifth preset temperature, obtain second data from the sensor in the second sensor group and process the second data, or obtain third data from the sensor in the first sensor group and process the third data, wherein the fourth preset temperature is greater than the fifth preset temperature.

[0068] In a third aspect, the present application provides a data processing device, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the device to perform any possible method in the first aspect.

[0069] In a fourth aspect, the present application provides an intelligent driving device, which includes any possible device in the second aspect, or includes the device described in the third aspect.

[0070] In combination with the fourth aspect, in some implementations of the fourth aspect, the intelligent driving device is a vehicle.

[0071] In a fifth aspect, the present application provides a computer program product, comprising: a computer program code, which, when executed on a computer, enables the computer to execute any possible method in the first aspect.

[0072] It should be noted that the above-mentioned computer program code can be stored in whole or in part on the first storage medium, wherein the first storage medium can be packaged together with the processor or separately packaged with the processor, and the embodiments of the present application do not specifically limit this.

[0073] In a sixth aspect, the present application provides a computer-readable medium storing a program code, which enables the computer to execute any possible method in the first aspect when the computer program code is run on the computer.

[0074] In a seventh aspect, the present application provides a chip comprising a circuit for executing any possible method in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0075] FIG1 is a functional block diagram of an intelligent driving device provided in an embodiment of the present application.

[0076] FIG2 is a schematic structural diagram of a vehicle provided in an embodiment of the present application.

[0077] FIG3 is a schematic flow chart of a data processing method provided in an embodiment of the present application.

[0078] FIG4 is a schematic diagram of different system states of an intelligent driving device provided in an embodiment of the present application.

[0079] FIG5 is a schematic flowchart of a system state switching method provided in an embodiment of the present application.

[0080] FIG6 is a schematic block diagram of a data processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0081] In the description of the embodiments of the present application, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; “and / or” in this article is merely a way to describe the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0082] In the embodiments of the present application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity or content of the described objects. The use of prefixes such as ordinal numbers to distinguish description objects in the embodiments of the present application does not constitute a restriction on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary restriction. In addition, in the description of this embodiment, unless otherwise specified, the meaning of "plurality" is two or more.

[0083] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0084] Figure 1 is a functional block diagram of an intelligent driving device 100 provided in an embodiment of the present application. The intelligent driving device 100 may include a perception system 110 and a computing platform 120, wherein the perception system 110 may include one or more sensors for sensing information about the environment surrounding the intelligent driving device 100. For example, the perception system 110 may include a positioning system, which may be a global positioning system (GPS), a Beidou system, or other positioning systems. The perception system 110 may also include one or more of an inertial measurement unit (IMU), a laser radar, a millimeter-wave radar, an ultrasonic radar, and a camera device.

[0085] Some or all functions of the intelligent driving device 100 can be controlled by the computing platform 120. The computing platform 120 may include one or more processors, such as processors 121 to 12n (n is a positive integer). A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a CPU, a microprocessor, a GPU (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. The logical relationships of the hardware circuits are fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration file to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor may also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 120 may also include a memory for storing instructions, and some or all of the processors 121 to 12n may call the instructions in the memory to implement corresponding functions.

[0086] Taking the intelligent driving device 100 as an example of a vehicle, FIG2 shows a schematic structural diagram of a vehicle 200 provided in an embodiment of the present application. As shown in FIG2, the vehicle 200 may include front-view cameras 201-204, side-view cameras 205-206, surround-view cameras 207-210, rear-view cameras 211-212, millimeter-wave radars 213-214, GPS 215, gateway 216, ultrasonic radars 217-224, left-side visual field monitors 225, right-side visual field monitors 226, laser radars 227-229, and an intelligent driving system 230. Among them, the intelligent driving system 230 includes a power supply 2301, an intelligent driving state machine 2302, an MCU 2303, and a processor 2304. The processor 2304 may include multiple processing devices. For example, taking the processing device as an SOC as an example, the processor 2304 may include multiple SOCs (e.g., SOC 1 to SOC n, where n is a positive integer greater than 1). For another example, taking the processing device as a computing core as an example, the processor 2304 may include multiple computing cores. The power supply 2301 is used to control the power on or off of the MCU 2303 and the processor 2304. The intelligent driving state machine 2302 is used to determine the driving scene in which the vehicle 200 is currently located or to determine the temperature of the processor 2304. The processor 2304 can determine which sensors collect data for data processing based on the results output by the intelligent driving state machine 2302 to obtain data processing results. The processor 2304 can also generate a vehicle control instruction based on the data processing result and send the vehicle control instruction to the electronic control unit (ECU).

[0087] The MCU 2303 can be used to control the vehicle 200 based on sensor data when the processor 2304 fails or overheats. For example, if the processor 2304 temperature is greater than or equal to 105°C, the power supply 2301 can be used to power down the processor 2304. At this point, the MCU 2303 can receive sensor data. Based on this sensor data, the MCU 2303 can generate vehicle control commands, which can be used to safely park the vehicle.

[0088] For example, if the processor 2304 includes multiple SOCs, the temperature of the processor 2304 may be the temperature of the SOC with the highest temperature among the multiple SOCs. Alternatively, if the processor 2304 includes multiple computing cores, the temperature of the processor 2304 may be the temperature of the computing core with the highest temperature among the multiple computing cores.

[0089] The front-view cameras 201-204, side-view cameras 205-206, surround-view cameras 207-210, rear-view cameras 211-212, millimeter-wave radars 213-214, GPS 215, ultrasonic radars 217-224, and lidars 227-229 are sensors in vehicle 200 and may be located in perception system 110. Intelligent driving system 230 may be located in computing platform 120.

[0090] The above gateway 216 , left side visual field monitor 225 , and right side visual field monitor 226 may be peripheral devices in the vehicle 200 .

[0091] The above structure of the vehicle 200 is merely illustrative, and the embodiment of the present application does not specifically limit the number and types of sensors and peripherals included in the vehicle 200.

[0092] FIG3 shows a schematic flow chart of a data processing method 300 provided in an embodiment of the present application. The method 300 can be executed by the intelligent driving device 100 or the vehicle 200, or the computing platform 120, or the SOC in the computing platform 120, or the processor in the computing platform 120, or the intelligent driving system 230, or the processor 2304. As shown in FIG3, the method 300 includes:

[0093] S301 , acquiring first data from a sensor in a first sensor group and processing the first data, the first data corresponding to a first frame rate.

[0094] In one embodiment, taking the vehicle 200 as an example, the sensors and peripherals in the vehicle 200 may be grouped. For example, Table 1 shows the results of grouping the front-view cameras 201-204, side-view cameras 205-206, surround-view cameras 207-210, rear-view cameras 211-212, millimeter-wave radars 213-214, GPS 215, gateway 216, ultrasonic radars 217-224, left-side field of view monitor 225, right-side field of view monitor 226, and lidars 227-229.

[0095] Table 1

[0096]

[0097] The above grouping of sensors and peripherals in the vehicle 200 is merely illustrative and is not specifically limited in the embodiments of the present application.

[0098] Each of the above sensor groups may include sensors and / or peripherals. For example, in sensor group B, side-view cameras 205-206, lidars 228 and 229, and millimeter-wave radar 214 are sensors, while gateway 216 is a peripheral. For another example, in sensor group D, rearview cameras 211-212 are sensors, while left-side field of view monitor 225 and right-side field of view monitor 226 are peripherals.

[0099] For example, the first sensor group may include sensors in sensor group A, sensor group B, sensor group C, and sensor group D. When processor 2304 is powered on, processor 2304 may acquire and process data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D. Thus, after processor 2304 is powered on, it may be possible to determine whether the status of sensors and peripherals in each sensor group is normal.

[0100] The first data corresponding to the first frame rate can be understood as obtaining the first data collected by the sensors in the first sensor group according to the first frame rate. The first sensor group can include multiple sensors, and the first frame rate can include the frame rate corresponding to each sensor in the multiple sensors.

[0101] Exemplarily, Table 2 shows the frame rate of each sensor when the sensors in the first sensor group (eg, including the above-mentioned sensor group A, sensor group B, sensor group C, and sensor group D) collect the first data.

[0102] Table 2

[0103] Sensor frame rate: Front view camera 201-204 (30fps), Side view camera 205-206 (30fps), Surround view camera 207-210 (10fps), Rear view camera 211-212 (30fps), Millimeter wave radar 213 (13fps), Millimeter wave radar 214 (16fps), LiDAR 227-229 (10fps), Left view monitor 225, Right view monitor 226 (20fps)

[0104] The correspondence between different types of sensors and frame rates shown in Table 2 above is merely illustrative and is not specifically limited in the embodiments of the present application.

[0105] The first data corresponding to the first frame rate can also be understood as obtaining data collected by the sensors in the first sensor group at a frame rate higher than the first frame rate and processing the data so that the frame rate corresponding to the data finally obtained is the first frame rate. For example, the processor 2304 can obtain image data 1 collected by the camera, and the image data 1 can be data collected when the frame rate of the camera is 30fps. The processor 2304 can choose to process the first data (part of the image data 1), and the frame rate corresponding to the part of the image data 1 is 15fps.

[0106] S302, when it is determined that the preset condition is met, obtain second data from the sensor in the second sensor group and process the second data, or obtain third data from the sensor in the first sensor group and process the third data, the third data corresponding to a second frame rate, wherein the first frame rate and the second frame rate are different.

[0107] In one embodiment, the second sensor group includes some sensors in the first sensor group, and the first frame rate is greater than the second frame rate.

[0108] Exemplarily, if the first sensor group includes sensors in the above-mentioned sensor group A, sensor group B, sensor group C, and sensor group D, then the second sensor group may include sensors in the above-mentioned sensor group A, sensor group B, and sensor group C; or, the second group of sensors may include sensors in the above-mentioned sensor group A, sensor group B, and sensor group D; or, the second group of sensors may include sensors in the above-mentioned sensor group B, sensor group C, and sensor group D; or, the second sensor group may include sensors in the above-mentioned sensor group A and sensor group B; or, the second sensor group may include sensors in the above-mentioned sensor group A and sensor group C; or, the second The sensor group may include sensors in the above-mentioned sensor group A and sensor group D; or, the second sensor group may include sensors in the above-mentioned sensor group B and sensor group C; or, the second sensor group may include sensors in the above-mentioned sensor group B and sensor group D; or, the second sensor group may include sensors in the above-mentioned sensor group C and sensor group D; or, the second sensor group may include sensors in the above-mentioned sensor group A; or, the second sensor group may include sensors in the above-mentioned sensor group B; or, the second sensor group may include sensors in the above-mentioned sensor group C; or, the second sensor group may include sensors in the above-mentioned sensor group D.

[0109] For example, FIG4 shows a schematic diagram of a sensor group of an intelligent driving device provided in an embodiment of the present application. As shown in FIG4 , the system states of the intelligent driving device can be divided into S1-S4. In system state S1, the processor 2304 can process data from sensors in sensor group A; in system state S2, the processor 2304 can process data from sensors in sensor group A and sensor group B; in system state S3, the processor 2304 can process data from sensors in sensor group A, sensor group B, and sensor group C; and in system state S4, the processor 2304 can process data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D.

[0110] The intelligent driving system 230 may also include a camera deserializer, an onboard Ethernet interface (ETH IF), a controller area network interface (CAN IF), and a display serializer. The camera deserializer is used to connect to the front-view cameras 201-204, side-view cameras 205-206, surround-view cameras 207-210, and rear-view cameras 211-212; the onboard ETH IF or CAN IF is used to connect to the lidars 227-229, millimeter-wave radars 213-214, GPS 215, and gateway 216; the CAN IF is also used to connect to the ultrasonic radars 217-224; and the display serializer is used to connect to the left-side field of view monitor 225 and the right-side field of view monitor 226.

[0111] In one embodiment, the system states of the intelligent driving device may further include S1'-S4'. For example, in system state S4', compared to system state S4, the sensors are the same, but the frame rate of the data acquired by processor 2304 is reduced. For example, the frame rate of the data acquired in system state S4' is 1 / 2 of the frame rate of the data acquired in system state S4.

[0112] System state S1 can be a system state that meets regulatory requirements. For example, system state S1 can support safe parking under autonomous emergency braking (AEB). System state S2 can support basic functions. System state S3 can support advanced functions. System state S4 can support all functions of the intelligent driving device.

[0113] The above description is based on the example of an intelligent driving device including S1-S4 and S1'-S4'. The embodiment of the present application does not specifically limit the number of system states. The intelligent driving device may include some of the system states in S1-S4 and S1'-S4'. For example, the system states of the intelligent driving device may include S4, S4', S3, S2, and S1. Alternatively, the intelligent driving device may also include other system states in addition to S1-S4 and S1'-S4'.

[0114] For example, Table 3 shows the power consumption of the intelligent driving system 230 in the system states S4, S4', S3, S2, and S1.

[0115] Table 3

[0116] System status Intelligent driving system power consumption S4120WS4'100WS380WS260WS150W

[0117] It can be seen from the power consumption results shown in Table 3 that the power consumption of the intelligent driving system 230 gradually decreases in the system states S4, S4', S3, S2 and S1.

[0118] Exemplarily, in S301 , the intelligent driving device may be in system state S4 .

[0119] For example, taking the intelligent driving device switching from the above system state S4 to S3 as an example, Table 4 shows the frame rate of each sensor when the sensors in the second sensor group (eg, including the above sensor group A, sensor group B, and sensor group C) collect the second data.

[0120] Table 4

[0121] Sensor frame rate: Front view camera 201-20430fps Side view camera 205-20630fps

[0122] Surround view camera 207-210 10fps millimeter wave radar 213 13fps millimeter wave radar 214 16fps lidar 227-229 10fps...

[0123] In an embodiment of the present application, when the preset conditions are met, the second data from the sensors in the second sensor group can be processed. This helps to reduce the power consumption of the intelligent driving device, thereby helping to improve the battery life and economy of the intelligent driving device; at the same time, it helps to avoid excessive temperature of devices in the intelligent driving system, and helps to improve the reliability and safety of the intelligent driving system.

[0124] For example, taking the intelligent driving device switching from the above system state S4 to S4' as an example, Table 5 shows the frame rate of each sensor when the sensors in the first sensor group (eg, including the above sensor group A, sensor group B, sensor group C, and sensor group D) collect the third data.

[0125] Table 5

[0126] Sensor frame rate: Front view camera 201-204 (15fps); Side view camera 205-206 (15fps); Surround view camera 207-210 (5fps); Rear view camera 211-212 (15fps); Millimeter wave radar 2137fps; Millimeter wave radar 2148fps; LiDAR 227-2295fps; Left view monitor 225; Right view monitor 226 (10fps); ...

[0127] The above description is based on an example in which the second frame rate is 1 / 2 of the first frame rate, but the present invention is not limited thereto. For example, the second frame rate may also be 1 / 3 of the first frame rate.

[0128] The above preset conditions may include switching of the driving scene in which the intelligent driving device is located.

[0129] In one embodiment, obtaining first data from sensors in a first sensor group and processing the first data includes: when it is determined that the intelligent driving device is in a first driving scene, obtaining first data from sensors in the first sensor group and processing the first data, and the first driving scene is associated with the first frame rate; when it is determined that a preset condition is met, obtaining second data from sensors in a second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, includes: when it is determined that the intelligent driving device switches from the first driving scene to the second driving scene, obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, and the second driving scene is associated with the second frame rate.

[0130] The above different driving scenarios may be associated with different frame rates.

[0131] For example, in a highway pilot (HWP) scenario, the intelligent driving device may be in system state S4, where the frame rate of data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D is frame rate 1. It should be understood that frame rate 1 may include multiple frame rates corresponding to multiple sensors.

[0132] For another example, in a highway assist (HWA) scenario, the intelligent driving device may be in system state S4', where the frame rate of data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D is frame rate 2, where frame rate 2 may be less than frame rate 1. For example, frame rate 2 is 1 / 2 of frame rate 1.

[0133] The above frame rate 2 is less than the frame rate 1, which can be understood as that under S4', the frame rate corresponding to the data of each sensor in at least some of the sensors in sensor group A, sensor group B, sensor group C and sensor group D is less than the frame rate corresponding to the data of each sensor in at least some of the sensors under S4.

[0134] In one embodiment, the driving scenarios of the intelligent driving device include, but are not limited to, HWP scenarios, HWA scenarios, traffic jam pilot (TJP) scenarios, automatic lane change (ALC), and automatic parking scenarios. The automatic parking scenarios may include automatic parking assist (APA), remote parking assist (RPA), and automatic valet parking (AVP).

[0135] For example, the first driving scenario and the second driving scenario may be different driving scenarios. For example, if the first driving scenario is a highway autonomous driving scenario, the first sensor group may include the aforementioned sensor group A, sensor group B, sensor group C, and sensor group D. If the second driving scenario is a highway assisted driving scenario, the second sensor group may include the aforementioned sensor group A, sensor group B, and sensor group C.

[0136] In the embodiments of the present application, by processing the data of some sensors or by processing the data after reducing the frame rate, it helps to reduce the power consumption of the intelligent driving device, thereby helping to improve the battery life and economy of the intelligent driving device; at the same time, it helps to avoid excessive temperature of devices in the intelligent driving system, and helps to improve the reliability and safety of the intelligent driving system.

[0137] In some possible implementations, the first driving scenario and the second driving scenario may be different driving functions in the same driving scenario.

[0138] Exemplarily, the different driving functions may correspond to different levels of autonomous driving.

[0139] For example, the autonomous driving level can be based on the grading standards of the Society of Automotive Engineers (SAE), for example, the autonomous driving levels can be divided into L0-L5. Among them, L0 is no automation; L1 is driving assistance; L2 is partial automation; L3 is conditional automation; L4 is high automation; L5 is full automation. For example, with APA, the driver does not need to operate the steering wheel, but still needs to operate the accelerator and brake on the vehicle; with RPA, the driver can use a terminal device (such as a mobile phone) to remotely park the vehicle from the outside of the vehicle; for AVP, the vehicle can complete parking without a driver. In terms of the corresponding autonomous driving levels, APA is approximately at the L1 level, RPA is approximately at the L2-L3 level, and AVP is approximately at the L4 level.

[0140] For example, if the function corresponding to the first driving scenario is AVP, the first sensor group may include the sensor group A, sensor group B, sensor group C, and sensor group D. If the function corresponding to the second driving scenario is APA, the second sensor group may include the sensor group A, sensor group B, and sensor group C.

[0141] In one embodiment, acquiring second data from sensors in the second sensor group and processing the second data includes: acquiring data from sensors in the first sensor group and processing second data in the data collected by sensors in the second sensor group.

[0142] In one embodiment, before acquiring the second data from the sensors in the second sensor group and processing the second data, the method includes: turning off the other sensors in the first sensor group except the second sensor group.

[0143] For example, shutting down the other sensors in the first sensor group except the second sensor group includes shutting down the other sensors in the first sensor group except the second sensor group through a power gate or a clock gate.

[0144] In one embodiment, when it is determined that the intelligent driving device switches from the first driving scene to the second driving scene, second data from the sensors in the second sensor group is obtained and the second data is processed; wherein, the method further includes: when it is determined that the intelligent driving device switches from the second driving scene to the third driving scene, fifth data from the sensors in the third sensor group is obtained and the fifth data is processed, or, sixth data from the sensors in the second sensor group is obtained and the sixth data is processed, the sixth data corresponds to a third frame rate, and the third driving scene is associated with the third frame rate; wherein, the third sensor includes some sensors in the second sensor group, and the second frame rate is greater than the third frame rate.

[0145] Exemplarily, if the second sensor group includes sensors in the above-mentioned sensor group A, sensor group B and sensor group C, then the third sensor group may include sensors in the above-mentioned sensor group A and sensor group B; or, the third sensor group may include sensors in the above-mentioned sensor group A and sensor group C; or, the third sensor group may include sensors in the above-mentioned sensor group B and sensor group C; or, the second sensor group may include sensors in the above-mentioned sensor group A; or, the second sensor group may include sensors in the above-mentioned sensor group B; or, the second sensor group may include sensors in the above-mentioned sensor group C.

[0146] For example, the second driving scenario is a highway assisted driving scenario, and the third driving scenario can be a traffic congestion autonomous driving scenario. The third sensor group can include the aforementioned sensor group A and sensor group B. For example, taking the intelligent driving device switching from the aforementioned system state S3 to S2 as an example, Table 6 shows the frame rate of each sensor when the sensors in the third sensor group (e.g., including the aforementioned sensor group A and sensor group B) collect the fifth data.

[0147] Table 6

[0148] Sensor frame rate: Front camera 201-204 30fps Side camera 205-206 30fps Millimeter wave radar 213 13fps Millimeter wave radar 214 16fps LiDAR 227-229 10fps...

[0149] For example, when it is determined that the intelligent driving device switches from the second driving scene to the third driving scene, the sensor group C may be turned off so that the fifth data from the sensor group A and the sensor group B can be processed.

[0150] For example, taking the intelligent driving device switching from the above system state S3 to S3' as an example, Table 7 shows the frame rates of the sensors in the second sensor group (eg, including the above sensor group A and sensor group B) when collecting the sixth data.

[0151] Table 7

[0152] Sensor frame rate: Front view camera 201-20415fps Side view camera 205-20615fps Surround view camera 207-2105fps Millimeter wave radar 2137fps

[0153] Millimeter-wave radar 2148fps, laser radar 227-2295fps...

[0154] The above description is based on an example in which the third frame rate is 1 / 2 of the second frame rate, but the present invention is not limited thereto. For example, the third frame rate may also be 1 / 3 of the second frame rate.

[0155] In one embodiment, the processing of the first data includes: processing the first data by multiple processing devices in the first processor; wherein, obtaining second data from the sensor in the second sensor group and processing the second data, or obtaining third data from the sensor in the first sensor group and processing the third data, includes: processing the second data by some processing devices in the multiple processing devices, or processing the third data by some processing devices.

[0156] For example, the first processor is the processor 2304, and the processor 2304 may include three SOCs. The processor 2304 may process the first data using the three SOCs. The processor 2304 may process the second data or the third data using two of the three SOCs. The processor 2304 may process the fifth data or the sixth data using one of the three SOCs.

[0157] For example, the first processor is the aforementioned processor 2304. The processor 2304 may include a SOC, which may include five computing cores. The processor 2304 may process the first data using the five computing cores. The processor 2304 may process the second data or the third data using four of the five computing cores. The processor 2304 may process the fifth data or the sixth data using three of the five computing cores.

[0158] In one embodiment, before processing the second data or the third data, the method further includes: shutting down other processing devices among the multiple processing devices except for the part of the processing devices.

[0159] In one embodiment, shutting down other processing devices except the part of the processing devices among the multiple processing devices includes: shutting down other processing devices except the part of the processing devices among the multiple processing devices through a power gate or a clock gate.

[0160] In one embodiment, before obtaining second data from a sensor in the second sensor group and processing the second data, or obtaining third data from a sensor in the first sensor group and processing the third data, the method further includes: determining that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, and the second preset temperature is greater than the first preset temperature.

[0161] For example, assuming the first processor is processor 2304, processor 2304 may include three SOCs: SOC1, SOC2, and SOC3. Intelligent driving state machine 2302 may detect the temperatures of SOC1, SOC2, and SOC3, respectively. Processor 2304 may obtain the temperatures of each SOC from intelligent driving state machine 2302. Processor 2304 may thereby determine that the temperature of processor 2304 is the temperature of SOC1, where the temperature of SOC1 is greater than the temperature of SOC2 and greater than the temperature of SOC3.

[0162] For example, assuming the first processor is processor 2304, processor 2304 may include a SOC, which includes computing core 1, computing core 2, and computing core 3. The intelligent driving state machine 2302 may detect the temperatures of computing core 1, computing core 2, and computing core 3, respectively. Processor 2304 may obtain the temperature of each computing core from the intelligent driving state machine 2302. Processor 2304 may thereby determine that the temperature of processor 2304 is the temperature of computing core 1, where the temperature of computing core 1 is greater than the temperature of computing core 2 and greater than the temperature of computing core 3.

[0163] In one embodiment, the temperature of the first processor may be an average of the temperatures of the plurality of processing devices.

[0164] For example, the first preset temperature is 75° C. and the second preset temperature is 105° C. Thus, when the intelligent driving device switches from the first driving scenario to the second driving scenario and the temperature of the first processor is greater than or equal to 75° C. and less than 105° C., the second data from the second sensor group can be processed, or the third data from the first sensor group can be processed.

[0165] In one embodiment, the method 300 further includes: when it is determined that the temperature of the first processor is greater than or equal to the second preset temperature, stopping data processing by the first processor.

[0166] For example, when the temperature of the processor 2304 is greater than or equal to 105° C., data processing by the processor 2304 may be stopped. At this time, the MCU 2303 may take over the vehicle 200 .

[0167] In one embodiment, the method 300 further includes: stopping data processing by the first processor when it is determined that the temperature of the first processor is greater than or equal to the second preset temperature for a duration greater than or equal to a first preset duration.

[0168] Exemplarily, the first preset time period is 15 minutes. When the temperature of the first processor is greater than or equal to 105° C. for a period greater than or equal to 15 minutes, data processing by the first processor may be stopped.

[0169] In one embodiment, the method 300 further includes: when determining that the intelligent driving device switches from the second intelligent driving scenario to the first intelligent driving scenario, obtaining fourth data from the sensor in the first sensor group and processing the fourth data, the fourth data corresponding to the first frame rate.

[0170] The above preset conditions may include a determination of the temperature of the first processor.

[0171] In one embodiment, the processing of the first data includes: when it is determined that the temperature of the first processor is less than a first preset temperature, processing the first data by the first processor; when it is determined that the preset condition is met, obtaining second data from the sensors in the second sensor group and processing the second data, or obtaining third data from the sensors in the first sensor group and processing the third data, including: when it is determined that the temperature of the first processor is greater than or equal to the first preset temperature and less than the second preset temperature, obtaining second data from the sensors in the second sensor group and processing the second data, or obtaining third data from the sensors in the first sensor group and processing the third data, wherein the first preset temperature is less than the second preset temperature.

[0172] Exemplarily, the first preset temperature is 75°C, and the second preset temperature is 105°C.

[0173] In one embodiment, acquiring second data from sensors in the second sensor group and processing the second data includes: acquiring data from sensors in the first sensor group and processing second data in the data collected by sensors in the second sensor group.

[0174] In one embodiment, before acquiring the second data from the sensors in the second sensor group and processing the second data, the method includes: turning off the other sensors in the first sensor group except the second sensor group.

[0175] In one embodiment, the first processor includes multiple processing devices, and the processing of the first data by the first processor includes: processing the first data by the multiple processing devices; obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, includes: processing the second data by some of the processing devices in the multiple processing devices, or processing the third data by the some of the processing devices.

[0176] For example, taking the first processor as the aforementioned processor 2304, the processor 2304 may include one SOC, which may include five computing cores. The processor 2304 may process the first data using the five computing cores. The processor 2304 may process the second data or the third data using four of the five computing cores.

[0177] In one embodiment, the method further includes: when it is determined that the temperature of the first processor is greater than or equal to the second preset temperature, stopping data processing by the first processor.

[0178] In one embodiment, the method 300 further includes: stopping data processing by the first processor when it is determined that the temperature of the first processor is greater than or equal to the second preset temperature for a duration greater than or equal to a first preset duration.

[0179] In one embodiment, the method 300 further includes: when determining that the temperature of the first processor is less than or equal to a third preset temperature, obtaining fourth data from the sensor in the first sensor group and processing the fourth data, the fourth data corresponding to the first frame rate; wherein the first preset temperature is greater than the third preset temperature.

[0180] Exemplarily, the third preset temperature is 70° C. Thus, when the temperature of the first processor is less than or equal to 70° C., the fourth data from the sensors of the first sensor group can be processed.

[0181] In an embodiment of the present application, by setting a hysteresis temperature (the hysteresis temperature is the difference between the first preset temperature and the second preset temperature), the intelligent driving device can be avoided from switching back and forth between different system states, thereby helping to improve the reliability and safety of the intelligent driving system.

[0182] FIG5 shows a schematic diagram of a system state switching method 500 provided in an embodiment of the present application. The method 500 may be executed by the intelligent driving device 100 or the vehicle 200, or the computing platform 120, or the SOC in the computing platform 120, or the processor in the computing platform 120, or the intelligent driving system 230, or the processor 2304. The method 500 may include:

[0183] S501 : When the temperature of the first processor is less than 75° C., control the intelligent driving device to be in system state S4 .

[0184] For example, when processor 2304 is powered on by power supply 2301 and the temperature of processor 2304 is less than 75° C., the intelligent driving device can be controlled to be in system state S4. At this time, processor 2304 can process data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D, and the frame rate corresponding to this data is the first frame rate.

[0185] S502: Determine whether the temperature of the first processor is greater than or equal to 75° C.

[0186] If the temperature of the first processor is greater than or equal to 75° C., execute S503 ; otherwise, continue to maintain the system state at S4 .

[0187] S503: Control the system state of the intelligent driving device to switch from S4 to S4'.

[0188] For example, when the temperature of the first processor is greater than or equal to 75°C, the intelligent driving device may switch the system state from S4 to S4'. At this time, data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D may be processed, and the frame rate corresponding to the data is a second frame rate, which is lower than the first frame rate.

[0189] In one embodiment, when switching from S4 to S4', it may be determined whether the temperature of the first processor is less than or equal to 70° C. When the temperature of the first processor is less than or equal to 70° C., the system state may be switched from S4' to S4.

[0190] In the embodiment of the present application, by setting a hysteresis temperature (eg, 5° C.), it is possible to avoid the system state from switching back and forth between S4 and S4 ′.

[0191] S504: Determine whether the temperature of the first processor is greater than or equal to 85° C.

[0192] If the temperature of the first processor is greater than or equal to 85° C., execute S505 ; otherwise, continue to maintain the system state at S4 ′.

[0193] S505 , controlling the system state of the intelligent driving device to switch from S4 ′ to S3 .

[0194] For example, when the temperature of the first processor is greater than or equal to 85° C., the intelligent driving device may switch the system state from S4′ to S3. At this time, the first processor may process data from sensors in sensor group A, sensor group B, and sensor group C.

[0195] In one embodiment, when switching from S4' to S3, it may be determined whether the temperature of the first processor is less than or equal to 80° C. When the temperature of the first processor is less than or equal to 80° C., the system state may be switched from S3 to S4'.

[0196] In the embodiment of the present application, by setting a hysteresis temperature (eg, 5° C.), it is possible to avoid the system state from switching back and forth between S4 ′ and S3 .

[0197] S506: Determine whether the temperature of the first processor is greater than or equal to 95°C.

[0198] If the temperature of the first processor is greater than or equal to 95° C., execute S507 ; otherwise, continue to maintain the system state in S3 .

[0199] S507 , controlling the system state of the intelligent driving device to switch from S3 to S2 .

[0200] For example, when the temperature of the first processor is greater than or equal to 95° C., the intelligent driving device may switch from system state S3 to S2. At this time, the first processor may process data from sensors in sensor group A and sensor group B.

[0201] In one embodiment, when switching from S3 to S2, it may be determined whether the temperature of the first processor is less than or equal to 90° C. When the temperature of the first processor is less than or equal to 90° C., the system state may be switched from S2 to S3.

[0202] In the embodiment of the present application, by setting a hysteresis temperature (eg, 5° C.), it is possible to avoid the system state from switching back and forth between S3 and S2.

[0203] S508: Determine whether the temperature of the first processor is greater than or equal to 100° C.

[0204] If the temperature of the first processor is greater than or equal to 100° C., execute S509 ; otherwise, continue to maintain the system state at S2 .

[0205] S509: Control the intelligent driving device to switch from system state S2 to S1.

[0206] For example, when the temperature of the first processor is greater than or equal to 100° C., the intelligent driving device may switch the system state from S2 to S1. At this time, the first processor may process data from sensors in sensor group A.

[0207] In one embodiment, when switching from S2 to S1, it may be determined whether the temperature of the first processor is less than or equal to 97° C. When the temperature of the first processor is less than or equal to 97° C., the system state may be switched from S1 to S2.

[0208] In the embodiment of the present application, by setting a hysteresis temperature (for example, 3° C.), it is possible to avoid the system state from switching back and forth between S2 and S1.

[0209] S510: Determine whether the temperature of the first processor is greater than or equal to 105°C.

[0210] If the temperature of the first processor is greater than or equal to 105° C., execute S511 ; otherwise, continue to maintain the system state at S1 .

[0211] S511: Stop processing data through the first processor.

[0212] In one embodiment, when it is detected that the temperature of the first processor is greater than or equal to 105° C. for a period greater than or equal to 15 minutes, data processing by the first processor is stopped. At this time, the MCU can take over the vehicle.

[0213] In one embodiment, when the duration of stopping data processing by the first processor is greater than or equal to a second preset duration, the intelligent driving device may be controlled to enter system state S4.

[0214] Exemplarily, the second preset duration is 15 minutes.

[0215] The above preset condition may also be used to determine the time period in which the intelligent driving device is located.

[0216] In one embodiment, the processing of the first data includes: processing the first data within a first time period; when it is determined that a preset condition is met, obtaining second data from a sensor in the second sensor group and processing the second data, or obtaining third data from a sensor in the first sensor group and processing the third data, includes: at the end of the first time period, obtaining second data from the sensor in the second sensor group and processing the second data, or obtaining third data from the sensor in the first sensor group and processing the third data.

[0217] For example, during the time period from T1 to T2, the intelligent driving device may be controlled to be in the system state S4; during the time period from T2 to T3, the intelligent driving device may be controlled to switch from the system state S4 to S4'.

[0218] In one embodiment, the second sensor group includes the first sensor group and a third sensor group, and the first frame rate is lower than the second frame rate.

[0219] For example, the first sensor group may include the sensor group A, the third sensor group may include the sensor group B, and the second sensor group may include the sensor group A and the sensor group B. For example, in S301 , the intelligent driving device may be in system state S1 . When a preset condition is met, the system state of the intelligent driving device may switch from S1 to S2 .

[0220] In one embodiment, obtaining first data from sensors in a first sensor group and processing the first data includes: when it is determined that the intelligent driving device is in a first driving scene, obtaining first data from sensors in the first sensor group and processing the first data, and the first driving scene is associated with the first frame rate; when it is determined that a preset condition is met, obtaining second data from sensors in a second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, includes: when it is determined that the intelligent driving device switches from the first driving scene to the second driving scene, obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, and the second driving scene is associated with the second frame rate.

[0221] Exemplarily, the first driving scenario is a highway assisted driving scenario, and the second driving scenario is a highway autonomous driving scenario. When the intelligent driving device is in the highway assisted driving scenario, the intelligent driving device is in system state S3, at which point the first processor can process data 1 from sensor group A, sensor group B, and sensor group C, with the frame rate corresponding to data 1 being frame rate 1. When it is determined that the intelligent driving scenario switches from the highway assisted driving scenario to the highway autonomous driving scenario, the intelligent driving device can switch from system state S3 to S4, at which point the first processor can process data 2 from sensor group A, sensor group B, sensor group C, and sensor group D, with the frame rate corresponding to data 2 being frame rate 2.

[0222] Alternatively, when it is determined that the intelligent driving scenario switches from a highway assisted driving scenario to a highway automatic driving scenario, the intelligent driving device can switch from system state S3 to S4'. At this time, the first processor can process data 3 from sensor group A, sensor group B, sensor group C and sensor group D. The frame rate corresponding to data 3 is frame rate 3, where frame rate 3 is less than frame rate 2.

[0223] Alternatively, when it is determined that the intelligent driving scenario switches from the highway assisted driving scenario to the highway automatic driving scenario, the intelligent driving device can switch from system state S3 to S3", at which time the first processor can process data 4 from sensor group A, sensor group B and sensor group C, where the frame rate of data 4 is frame rate 4, and frame rate 4 is greater than frame rate 1.

[0224] In one embodiment, the processing of the first data includes: when it is determined that the temperature of the first processor is greater than or equal to a fourth preset temperature, processing the first data by the first processor; when it is determined that the preset condition is met, obtaining second data from the sensor in the second sensor group and processing the second data, or obtaining third data from the sensor in the first sensor group and processing the third data, including: when it is determined that the temperature of the first processor is less than a fourth preset temperature and greater than or equal to a fifth preset temperature, obtaining second data from the sensor in the second sensor group and processing the second data, or obtaining third data from the sensor in the first sensor group and processing the third data, wherein the fourth preset temperature is greater than the fifth preset temperature.

[0225] Exemplarily, the fourth preset temperature is 90°C, and the fifth preset temperature is 80°C.

[0226] When the temperature of the first processor is greater than or equal to 90°C, the system state of the intelligent driving device may be S2, at which point the first processor may process data from sensor group A and sensor group B. When the temperature of the first processor is less than 90°C and greater than or equal to 80°C, the system state of the intelligent driving device may switch from S2 to S3, at which point the first processor may process data from sensors in sensor group A, sensor group B, and sensor group C.

[0227] FIG6 shows a schematic block diagram of a data processing device 600 provided in accordance with an embodiment of the present application. As shown in FIG6 , the device 600 includes: a data processing unit 610 configured to acquire and process first data from sensors in a first sensor group, the first data corresponding to a first frame rate; a determination unit 620 configured to determine whether a preset condition is satisfied; and the data processing unit 610 further configured to acquire and process second data from sensors in a second sensor group, or acquire and process third data from sensors in the first sensor group, the third data corresponding to a second frame rate, wherein the first frame rate and the second frame rate are different.

[0228] Optionally, the second sensor group includes some sensors in the first sensor group, and the first frame rate is greater than the second frame rate.

[0229] Optionally, the data processing unit 610 is configured to, when the determination unit 620 determines that the intelligent driving device is in a first driving scene, obtain first data from sensors in the first sensor group and process the first data, and the first driving scene is associated with the first frame rate; when the determination unit 620 determines that the intelligent driving device switches from the first driving scene to the second driving scene, obtain second data from sensors in the second sensor group and process the second data, or obtain third data from sensors in the first sensor group and process the third data, and the second driving scene is associated with the second frame rate.

[0230] Optionally, the data processing unit 610 is configured to: process the first data through multiple processing devices in the first processor; process the second data through some processing devices in the multiple processing devices, or process the third data through the some processing devices.

[0231] Optionally, the determination unit 620 is also used to: before the data processing unit 610 processes the second data or the third data, determine that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, and the second preset temperature is greater than the first preset temperature.

[0232] Optionally, the determination unit 620 is further used to: determine that the temperature of the first processor is greater than or equal to the second preset temperature; the data processing unit 610 is further used to: stop data processing through the first processor.

[0233] Optionally, the determination unit 620 is further used to determine that the temperature of the first processor is greater than or equal to the second preset temperature for a duration greater than or equal to the first preset duration; the data processing unit 610 is further used to stop data processing through the first processor.

[0234] Optionally, the determination unit 620 is further used to determine whether the intelligent driving device switches from the second intelligent driving scenario to the first intelligent driving scenario; the data processing unit 610 is further used to obtain fourth data from the sensor in the first sensor group and process the fourth data, where the fourth data corresponds to the first frame rate.

[0235] Optionally, the data processing unit 610 is used to process the first data through a first processor; when the determination unit 620 determines that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, obtain second data from the sensor in the second sensor group and process the second data, or obtain third data from the sensor in the first sensor group and process the third data, wherein the first preset temperature is less than the second preset temperature.

[0236] Optionally, the first processor includes multiple processing devices, and the data processing unit 610 is used to: process the first data through the multiple processing devices; process the second data through some of the multiple processing devices, or process the third data through the some of the processing devices.

[0237] Optionally, the determination unit 620 is further used to: determine that the temperature of the first processor is greater than or equal to the second preset temperature; and the data processing unit is further used to: stop data processing through the first processor.

[0238] Optionally, the determination unit 620 is further used to determine that the temperature of the first processor is greater than or equal to the second preset temperature for a duration greater than or equal to the first preset duration; the data processing unit 610 is further used to stop data processing through the first processor.

[0239] Optionally, the determination unit 620 is further used to: determine that the temperature of the first processor is less than or equal to a third preset temperature; the data processing unit 610 is further used to obtain fourth data from the sensor in the first sensor group and process the fourth data, the fourth data corresponding to the first frame rate; wherein the first preset temperature is greater than the third preset temperature.

[0240] Optionally, the second sensor group includes the first sensor group and a third sensor group, and the first frame rate is lower than the second frame rate.

[0241] Optionally, the data processing unit 610 is used to: when the determination unit 620 determines that the intelligent driving device is in a first driving scene, obtain first data from the sensors in the first sensor group and process the first data, and the first driving scene is associated with the first frame rate; when the determination unit 620 determines that the intelligent driving device switches from the first driving scene to the second driving scene, obtain second data from the sensors in the second sensor group and process the second data, or obtain third data from the sensors in the first sensor group and process the third data, and the second driving scene is associated with the second frame rate.

[0242] Optionally, the data processing unit 610 is used to: process the first data through a first processor; when the determination unit 620 determines that the temperature of the first processor is less than a fourth preset temperature and greater than or equal to a fifth preset temperature, obtain second data from the sensor in the second sensor group and process the second data, or obtain third data from the sensor in the first sensor group and process the third data, wherein the fourth preset temperature is greater than the fifth preset temperature.

[0243] It should be understood that the division of the various units in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or they may be physically separated. Furthermore, the units in the device may be implemented in the form of a processor calling software; for example, the device includes a processor connected to a memory storing instructions, and the processor calls the instructions stored in the memory to implement any of the above methods or the functions of the various units in the device, where the processor is, for example, a general-purpose processor such as a CPU or a microprocessor, and the memory is a memory within the device or a memory external to the device. Alternatively, the units in the device may be implemented in the form of hardware circuits, and the functions of some or all of the units may be implemented through the design of the hardware circuits. The hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units may be implemented through the design of the logical relationships between the components within the circuits. In another implementation, the hardware circuit may be implemented using a PLD, such as an FPGA, which may include a large number of logic gate circuits, and the connections between the logic gate circuits may be configured using a configuration file to implement the functions of some or all of the above units. All units of the above apparatus may be implemented entirely in the form of software called by a processor, or entirely in the form of hardware circuits, or partially in the form of software called by a processor and the rest in the form of hardware circuits.

[0244] Each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0245] In addition, the various units in the above apparatus may be fully or partially integrated together, or may be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-chip (SOC). The SOC may include at least one processor for implementing any of the above methods or implementing the functions of the various units of the apparatus. The at least one processor may be of different types, such as a CPU and an FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.

[0246] An embodiment of the present application also provides a device, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit, so that the device performs the method or steps in the above embodiment.

[0247] Optionally, if the device is located in an intelligent driving device, the processing unit may be the processors 121 - 12n shown in FIG. 1 .

[0248] An embodiment of the present application further provides a data processing system, which includes multiple sensors and a computing platform, wherein the computing platform may include the above-mentioned device 600.

[0249] An embodiment of the present application further provides an intelligent driving device, which may include the above-mentioned data processing device 600 or data processing system.

[0250] Optionally, the intelligent driving device may be a vehicle.

[0251] An embodiment of the present application further provides a computer program product, which includes: computer program code, which enables the computer to execute the above-mentioned data processing method when the computer program code is run on a computer.

[0252] An embodiment of the present application further provides a computer-readable medium, wherein the computer-readable medium stores a program code. When the computer program code is run on a computer, the computer executes the above-mentioned data processing method.

[0253] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

[0254] It should be understood that in the embodiment of the present application, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.

[0255] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0256] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0257] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0258] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0259] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0260] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0261] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0262] The above is only a specific implementation method of the present application, but the protection scope of the present application is not limited thereto. Any changes or replacements that can be easily thought of by any technician familiar with this technical field within the technical scope disclosed in this application should be covered.

Claims

1. A data processing method, characterized in that: include: Determining that the intelligent driving device is in a first driving scenario; Acquire first data from a sensor in a first sensor group and process the first data, the first data corresponding to a first frame rate, the first driving scene being associated with the first frame rate; When it is determined that the intelligent driving device switches from the first driving scenario to the second driving scenario, obtaining second data from sensors in the second sensor group and processing the second data, or obtaining third data from sensors in the first sensor group and processing the third data, the third data corresponding to a second frame rate, and the second driving scenario is associated with the second frame rate; The second sensor group includes some sensors in the first sensor group, and the first frame rate is greater than the second frame rate.

2. The method according to claim 1, wherein The processing of the first data includes: Processing the first data by a plurality of processing devices in a first processor; The acquiring of second data from sensors in the second sensor group and processing the second data, or the acquiring of third data from sensors in the first sensor group and processing the third data, includes: The second data is processed by some of the plurality of processing devices, or the third data is processed by some of the processing devices.

3. The method according to claim 2, wherein Before acquiring the second data from the sensors in the second sensor group and processing the second data, or acquiring the third data from the sensors in the first sensor group and processing the third data, the method further includes: It is determined that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, and the second preset temperature is greater than the first preset temperature.

4. The method according to claim 3, wherein The method further comprises: When it is determined that the temperature of the first processor is greater than or equal to the second preset temperature, data processing by the first processor is stopped.

5. The method according to claim 3, wherein The method further comprises: When it is determined that the temperature of the first processor is greater than or equal to the second preset temperature and the duration is greater than or equal to the first preset duration, data processing by the first processor is stopped.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: When it is determined that the intelligent driving device switches from the second intelligent driving scenario to the first intelligent driving scenario, fourth data from the sensors in the first sensor group is obtained and processed, where the fourth data corresponds to the first frame rate.

7. A data processing method, characterized in that: include: Acquire first data from a sensor in a first sensor group and process the first data using a first processor, the first data corresponding to a first frame rate; When it is determined that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, obtaining second data from a sensor in the second sensor group and processing the second data, or obtaining third data from a sensor in the first sensor group and processing the third data, the third data corresponding to a second frame rate; The first preset temperature is lower than the second preset temperature, the second sensor group includes some sensors in the first sensor group, and the first frame rate is higher than the second frame rate.

8. The method according to claim 7, wherein The first processor includes a plurality of processing devices, and processing the first data by the first processor includes: processing the first data by the multiple processing devices; The acquiring second data from the sensors in the second sensor group and processing the second data, or acquiring third data from the sensors in the first sensor group and processing the third data, includes: The second data is processed by some of the plurality of processing devices, or the third data is processed by some of the processing devices.

9. The method according to claim 7 or 8, wherein The method further comprises: When it is determined that the temperature of the first processor is greater than or equal to the second preset temperature, data processing by the first processor is stopped.

10. The method according to claim 7 or 8, characterized in that The method further comprises: When it is determined that the temperature of the first processor is greater than or equal to the second preset temperature and the duration is greater than or equal to the first preset duration, data processing by the first processor is stopped.

11. The method according to any one of claims 7 to 10, characterized in that The method further comprises: When it is determined that the temperature of the first processor is less than or equal to a third preset temperature, acquiring fourth data from a sensor in the first sensor group and processing the fourth data, the fourth data corresponding to the first frame rate; Wherein, the first preset temperature is greater than the third preset temperature.

12. A data processing device, characterized in that: include: a determining unit, configured to determine that the intelligent driving device is in a first driving scenario; a data processing unit, configured to acquire first data from a sensor in a first sensor group and process the first data, wherein the first data corresponds to a first frame rate, and the first driving scene is associated with the first frame rate; The determining unit is further configured to determine that the intelligent driving device switches from the first driving scenario to the second driving scenario; The data processing unit is further configured to obtain second data from sensors in the second sensor group and process the second data, or obtain third data from sensors in the first sensor group and process the third data, wherein the third data corresponds to a second frame rate, and the second driving scene is associated with the second frame rate; The second sensor group includes some sensors in the first sensor group, and the first frame rate is greater than the second frame rate.

13. The device according to claim 12, wherein The data processing unit is configured to: process the first data through a plurality of processing devices in the first processor; The second data is processed by some of the plurality of processing devices, or the third data is processed by some of the processing devices.

14. The device according to claim 13, wherein The determining unit is further configured to: Before the data processing unit processes the second data or the third data, it is determined that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, and the second preset temperature is greater than the first preset temperature.

15. The device according to claim 14, wherein The determining unit is further configured to: determine that the temperature of the first processor is greater than or equal to the second preset temperature; The data processing unit is further configured to stop data processing by the first processor.

16. The device according to claim 14, wherein The determining unit is further configured to: determine that a duration during which the temperature of the first processor is greater than or equal to the second preset temperature is greater than or equal to a first preset duration; The data processing unit is further configured to stop data processing by the first processor.

17. The device according to any one of claims 12 to 16, characterized in that The determining unit is further configured to: determine that the intelligent driving device switches from the second intelligent driving scenario to the first intelligent driving scenario; The data processing unit is further configured to: obtain fourth data from the sensors in the first sensor group and process the fourth data, where the fourth data corresponds to the first frame rate.

18. A data processing device, characterized in that: include: a data processing unit, configured to obtain first data from a sensor in a first sensor group and process the first data using a first processor, the first data corresponding to a first frame rate; a determining unit, configured to determine that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature; The processing unit is further configured to obtain second data from a sensor in the second sensor group and process the second data, or obtain third data from a sensor in the first sensor group and process the third data, wherein the third data corresponds to a second frame rate; The first preset temperature is lower than the second preset temperature, the second sensor group includes some sensors in the first sensor group, and the first frame rate is higher than the second frame rate.

19. The device according to claim 18, wherein The first processor includes a plurality of processing devices, and the data processing unit is configured to: processing the first data by the multiple processing devices; The second data is processed by some of the plurality of processing devices, or the third data is processed by some of the processing devices.

20. The device according to claim 18 or 19, characterized in that The determining unit is further configured to: determine that the temperature of the first processor is greater than or equal to the second preset temperature; The data processing unit is further configured to stop data processing by the first processor.

21. The device according to claim 18 or 19, characterized in that The determining unit is further configured to: determine that a duration during which the temperature of the first processor is greater than or equal to the second preset temperature is greater than or equal to a first preset duration; The data processing unit is further configured to stop data processing by the first processor.

22. The device according to any one of claims 18 to 21, characterized in that The determining unit is further configured to: determine that the temperature of the first processor is less than or equal to a third preset temperature; The data processing unit is further configured to obtain fourth data from sensors in the first sensor group and process the fourth data, the fourth data corresponding to the first frame rate; Wherein, the first preset temperature is greater than the third preset temperature.

23. A data processing device, characterized in that: include: Memory for storing computer programs; A processor, configured to execute the computer program stored in the memory, so that the apparatus performs the method according to any one of claims 1 to 11.

24. A data processing system, characterized in that: The system comprises a plurality of sensor groups and a computing platform, wherein the computing platform comprises the data processing device according to any one of claims 12 to 23.

25. An intelligent driving device, characterized in that: The data processing device comprises the data processing apparatus according to any one of claims 12 to 23, or the data processing system according to claim 24.

26. The intelligent driving device according to claim 25, characterized in that: The intelligent driving device is a vehicle.

27. A computer-readable storage medium, characterized in that A computer program is stored thereon, and when the computer program is executed by a computer, the data processing method according to any one of claims 1 to 11 is implemented.

28. A chip, characterized in that: The chip includes a circuit configured to execute the data processing method according to any one of claims 1 to 11.

Images