DATA PROCESSING METHOD AND DATA PROCESSING APPARATUS, AND INTELLIGENT DRIVING DEVICE

Abstract

[0009] The present application provides a data processing method, a data processing apparatus, and an intelligent driving device. The data processing method includes: determining that the intelligent driving device is in a first driving scenario; acquiring first data from sensors in a first sensor group and processing the first data, where the first data corresponds to a first frame rate; and, if the intelligent driving device determines that the first driving scenario will switch to a second driving scenario, acquiring second data from sensors in a second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, where the third data corresponds to a second frame rate, where the second sensor group includes some of the sensors in the first sensor group, and the first frame rate is greater than the second frame rate. The present application may be applied to intelligent vehicles or electric vehicles to help improve the durability and economy of the vehicles.

Description

[Technical Field]

[0001] FIELD OF THE INVENTION The embodiments of the present application relate to the field of intelligent driving, and more particularly to a data processing method and apparatus, and an intelligent driving device. [Background technology]

[0002] With the development of intelligent vehicles, more and more vehicles are configured with intelligent driving systems, such as advanced driver assistance systems (ADAS). ADAS includes several power-intensive components, such as systems on a chip (SOC). In a scenario where these power-intensive components remain power-intensive, the durability and economy of the intelligent driving devices will be affected. Summary of the Invention

[0003] The embodiments of the present application provide a data processing method and a data processing apparatus, and an intelligent driving device, to help improve the durability and economy of the intelligent driving device. [Means for solving the problem]

[0004] The intelligent driving device in the present application may include land transportation means, water transportation means, air transportation means, industrial devices, agricultural devices, entertainment devices, etc. For example, the intelligent driving device may be a vehicle. The vehicle is a vehicle in a broad sense and may be a transportation means (e.g., a commercial vehicle, a passenger car, a motorcycle, a flying car, or a train), an industrial vehicle (e.g., a forklift truck, a trailer, or a tractor), an engineering vehicle (e.g., an excavator, a bulldozer, or a crane), an agricultural device (e.g., a lawn mower or a harvester), a recreational device, or a toy vehicle. The type of vehicle is not specifically limited in the embodiments of the present application. As another example, the intelligent driving device may be a transportation means such as an airplane or a ship. In addition to the intelligent driving device, the embodiments of the present application may be applied to other devices, such as a terminal device (e.g., a mobile phone) or a robot (e.g., a drone).

[0005] According to a first aspect, there is provided a data processing method, the method including: acquiring first data from sensors in a first sensor group and processing the first data, the first data corresponding to a first frame rate, and, if a preset condition is determined to be satisfied, acquiring second data from sensors in a second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, the third data corresponding to a second frame rate, where the first frame rate is different from the second frame rate.

[0006] In this embodiment of the present application, the intelligent driving device can process first data from a first sensor group, and when a preset condition is met, process second data from a second sensor group, or process third data from a sensor in the first sensor group. In this way, the intelligent driving device can flexibly select to process data from different sensors or process data from the same sensor at different frame rates. This helps to improve the flexibility of the intelligent driving device during data processing.

[0007] Referring to the first aspect, in some implementations of the first aspect, the second sensor group includes some of the sensors in the first sensor group, and the first frame rate is higher than the second frame rate.

[0008] In this embodiment of the present application, if a preset condition is met, data from some sensors is processed, or third data corresponding to a reduced frame rate is processed, which helps reduce the power consumption of the intelligent driving device and further improves the durability and economy of the intelligent driving device.

[0009] Referring to the first aspect, in some implementations of the first aspect, the step of acquiring first data from sensors in a first sensor group and processing the first data includes the step of acquiring first data from sensors in a first sensor group and processing the first data when it is determined that the intelligent driving device is in a first driving scenario, wherein the first driving scenario is associated with a first frame rate; and the step of acquiring second data from sensors in a second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data when it is determined that a preset condition is satisfied, includes the step of acquiring second data from sensors in a second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data when it is determined that the intelligent driving device will switch from the first driving scenario to a second driving scenario, wherein the second driving scenario is associated with a second frame rate.

[0010] In this embodiment of the present application, when the intelligent driving device switches from the first driving scenario to the second driving scenario, the intelligent driving device can process the second data from the sensors in the second sensor group or process the third data collected by the sensors in the first sensor group. This helps to reduce the power consumption of the intelligent driving device, further helping to improve the durability and economy of the intelligent driving device. Furthermore, this helps to avoid excessively high temperatures of components in the intelligent driving system, helping to improve the reliability and security of the intelligent driving system.

[0011] In some possible implementations, a level of automation corresponding to the first driving scenario is higher than a level of automation corresponding to the second driving scenario, for example, the first driving scenario is a Highway Pilot scenario and the second driving scenario is a Highway Assist scenario.

[0012] In some possible implementations, the driving features corresponding to the first driving scenario are different from the driving features corresponding to the second driving scenario.

[0013] In some possible implementations, acquiring second data from sensors in the second sensor group and processing the second data includes acquiring data from sensors in the first sensor group and processing the second data that is in the data and collected by sensors in the second sensor group.

[0014] In some possible implementations, prior to the step of acquiring second data from the sensors in the second sensor group and processing the second data, the method includes a step of disabling the sensors in the first sensor group except for the sensors in the second sensor group.

[0015] In some possible implementations, disabling the sensors in the first sensor group except for the sensors in the second sensor group includes disabling the sensors in the first sensor group except for the sensors in the second sensor group by using power gating or clock gating.

[0016] The step of disabling the sensors in the first sensor group except for the sensors in the second sensor group by using power gating or clock gating may also be understood as disabling the sensors in the first sensor group except for the sensors in the second sensor group by powering off or disabling the clock.

[0017] Referring to the first aspect, in some implementations of the first aspect, when the intelligent driving device determines to switch from the first driving scenario to the second driving scenario, second data is acquired from the sensors in the second sensor group and the second data is processed. When the intelligent driving device determines to switch from the second driving scenario to a third driving scenario, the method further includes acquiring fifth data from the sensors in the third sensor group and processing the fifth data, or acquiring sixth data from the sensors in the second sensor group and processing the sixth data, where the third driving scenario is associated with a third frame rate, the third sensors include some of the sensors in the second sensor group, and the frame rate corresponding to the second data is higher than the frame rate corresponding to the sixth data.

[0018] In this embodiment of the present application, when the intelligent driving device switches from the second driving scenario to the third driving scenario, the intelligent driving device can process the fifth data from the sensors in the third sensor group or process the sixth data collected by the sensors in the second sensor group. This helps reduce the power consumption of the intelligent driving device, further helping to improve the durability and economy of the intelligent driving device. In addition, reducing the power consumption of the intelligent driving device can help prevent excessively high temperatures of components and improve the reliability and security of the intelligent driving system.

[0019] Referring to the first aspect, in some implementations of the first aspect, the step of processing the first data includes a step of processing the first data by using a plurality of processing devices in the first processor, and the step of acquiring second data from sensors in the second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data includes a step of processing the second data by using some of the processing devices in the plurality of processing devices, or a step of processing the third data by using some of the processing devices.

[0020] In this embodiment of the present application, when the intelligent driving device switches from the first driving scenario to the second driving scenario, the intelligent driving device can select a part of the processing devices from the multiple processing devices to process the second data or the third data. In this way, reducing the number of processing devices helps to reduce the power consumption of the intelligent driving device and further helps to improve the durability and economy of the intelligent driving device. In addition, reducing the power consumption of the intelligent driving device can help to prevent excessively high temperatures of components and improve the reliability and security of the intelligent driving system.

[0021] In some possible implementations, before the step of processing the second data or the step of processing the third data, the method further includes a step of disabling processing devices other than some of the processing devices within the plurality of processing devices.

[0022] In some possible implementations, disabling processing units other than some of the processing units in the plurality of processing units includes disabling processing units other than some of the processing units in the plurality of processing units by using power gating or clock gating.

[0023] In some possible implementations, the processing unit may be a central processing unit (CPU) or a computing core, for example, an artificial intelligence core (AI core), a graphics processing unit (GPU) core, etc.

[0024] Referring to the first aspect, in some implementations of the first aspect, before the step of acquiring second data from sensors in the second sensor group and processing the second data or the step of acquiring third data from sensors in the first sensor group and processing the third data, the method further includes a step of determining that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, wherein the second preset temperature is higher than the first preset temperature.

[0025] In this embodiment of the present application, when the intelligent driving device switches from a first driving scenario to a second driving scenario and the temperature of the first processor is equal to or greater than the first preset temperature but less than the second preset temperature, the intelligent driving device can process second data from the sensors in the second sensor group or process third data collected by the sensors in the first sensor group. This helps to further improve the decision-making accuracy of the intelligent driving device through the switching of intelligent driving scenarios and the temperature change of the first processor. In addition, this helps to prevent excessively high temperatures of components in the intelligent driving system, thereby improving the reliability and security of the intelligent driving system.

[0026] Referring to the first aspect, in some implementations of the first aspect, the method further includes stopping data processing by using the first processor when it is determined that the temperature of the first processor is equal to or greater than a second preset temperature.

[0027] In this embodiment of the present application, when the temperature of the first processor is equal to or higher than the second preset temperature, data processing using the first processor can be stopped, which helps to avoid the impact on the reliability and security of the intelligent driving device system caused by the excessively high temperature of the first processor, and also helps to avoid damage to the first processor.

[0028] In some possible implementations, the method further includes taking over the intelligent driving system or the intelligent driving device using a microcontroller unit (MCU) when data processing by using the first processor is stopped.

[0029] Referring to the first aspect, in some implementations of the first aspect, the method further includes stopping data processing by using the first processor when it is determined that the duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than the first preset duration.

[0030] In this embodiment of the present application, when the duration that the temperature of the first processor is equal to or higher than the second preset temperature is equal to or longer than the first preset duration, data processing using the first processor may be stopped, which helps to avoid the impact on the reliability and security of the intelligent driving device system caused by an excessively high temperature of the first processor, and also helps to avoid damage to the first processor.

[0031] Referring to the first aspect, in some implementation forms of the first aspect, the method further includes, when it is determined that the intelligent driving device will switch from the second intelligent driving scenario to the first intelligent driving scenario, acquiring fourth data from sensors in the first sensor group and processing the fourth data, wherein the fourth data corresponds to a first frame rate.

[0032] Referring to the first aspect, in some implementations of the first aspect, the step of processing the first data includes a step of processing the first data by using the first processor when it is determined that the temperature of the first processor is less than a first preset temperature, and when it is determined that the preset condition is satisfied, the step of acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, includes a step of acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, when it is determined that the temperature of the first processor is greater than or equal to the first preset temperature and less than the second preset temperature, and the first preset temperature is less than the second preset temperature.

[0033] In this embodiment of the present application, when the temperature of the first processor is excessively high, the first processor can select to process the second data from some sensors or the third data corresponding to a low frame rate. This helps reduce the power consumption of the intelligent driving device, further improving the durability and economy of the intelligent driving device. In addition, this helps avoid the impact on the reliability and security of the intelligent driving system caused by the excessively high temperature of the first processor, and also helps avoid damage to the first processor.

[0034] In some possible implementations, acquiring second data from sensors in the second sensor group and processing the second data includes acquiring data from sensors in the first sensor group and processing the second data that is in the data and collected by sensors in the second sensor group.

[0035] In some possible implementations, prior to the step of acquiring second data from the sensors in the second sensor group and processing the second data, the method includes a step of disabling the sensors in the first sensor group except for the sensors in the second sensor group.

[0036] Referring to the first aspect, in some implementations of the first aspect, the first processor includes a plurality of processing devices. The step of processing the first data by using the first processor includes a step of processing the first data by using the plurality of processing devices. The step of acquiring second data from sensors in the second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data, includes a step of processing the second data by using some of the processing devices in the plurality of processing devices, or a step of processing the third data by using some of the processing devices.

[0037] In this embodiment of the present application, when the temperature of the first processor is equal to or greater than the first preset temperature and less than the second preset temperature, the intelligent driving device can select a processing device from the plurality of processing devices to process the second data or the third data. In this way, reducing the number of processing devices helps reduce the power consumption of the intelligent driving device and further helps improve the durability and economy of the intelligent driving device. In addition, reducing the power consumption of the intelligent driving device prevents the temperature of components in the intelligent driving system from continuously increasing, helps improve the reliability and security of the intelligent driving system, and also helps avoid damage to the components in the intelligent driving system.

[0038] Referring to the first aspect, in some implementations of the first aspect, the method further includes stopping data processing by using the first processor when it is determined that the temperature of the first processor is equal to or greater than a second preset temperature.

[0039] In this embodiment of the present application, when the temperature of the first processor is equal to or higher than the second preset temperature, data processing using the first processor can be stopped, which helps to avoid the impact on the reliability and security of the intelligent driving device system caused by the excessively high temperature of the first processor, and also helps to avoid damage to the first processor.

[0040] In some possible implementations, the method further includes, when data processing by using the first processor is stopped, the intelligent driving system or the intelligent driving device taking over by using the MCU.

[0041] Referring to the first aspect, in some implementations of the first aspect, the method further includes stopping data processing by using the first processor when it is determined that the duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than the first preset duration.

[0042] In this embodiment of the present application, when the duration that the temperature of the first processor is equal to or higher than the second preset temperature is equal to or longer than the first preset duration, data processing using the first processor may be stopped, which helps to avoid the impact on the reliability and security of the intelligent driving device system caused by an excessively high temperature of the first processor, and also helps to avoid damage to the first processor.

[0043] Referring to the first aspect, in some implementations of the first aspect, the method further includes a step of acquiring fourth data from sensors in the first sensor group and processing the fourth data when it is determined that the temperature of the first processor is equal to or less than a third preset temperature, wherein the fourth data corresponds to a first frame rate, and the first preset temperature is higher than the third preset temperature.

[0044] In this embodiment of the present application, a hysteresis temperature (the difference between the first preset temperature and the third preset temperature) is set, which can prevent the intelligent driving system from switching back and forth between different system states, which helps to improve the reliability and security of the intelligent driving system.

[0045] Referring to the first aspect, in some implementations of the first aspect, the step of processing the first data includes the step of processing the first data within a first period of time, and when it is determined that the preset condition is satisfied, the step of acquiring second data from sensors in the second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data, includes the step of acquiring second data from sensors in the second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data, when the first period of time ends.

[0046] Referring to the first aspect, in some implementation forms of the first aspect, the second sensor group includes the first sensor group and a third sensor group, and the first frame rate is lower than the second frame rate.

[0047] Referring to the first aspect, in some implementations of the first aspect, the step of acquiring first data from sensors in a first sensor group and processing the first data includes the step of acquiring first data from sensors in a first sensor group and processing the first data when it is determined that the intelligent driving device is in a first driving scenario, wherein the first driving scenario is associated with a first frame rate; and the step of acquiring second data from sensors in a second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data when it is determined that a preset condition is satisfied, includes the step of acquiring second data from sensors in a second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data when it is determined that the intelligent driving device will switch from the first driving scenario to a second driving scenario, wherein the second driving scenario is associated with a second frame rate.

[0048] In some possible implementations, the level of automation corresponding to the first driving scenario is lower than the level of automation corresponding to the second driving scenario.

[0049] For example, the first driving scenario is a Highway Assist scenario and the second driving scenario is a Highway Pilot scenario.

[0050] Referring to the first aspect, in some implementations of the first aspect, the step of processing the first data includes a step of processing the first data by using the first processor when it is determined that the temperature of the first processor is equal to or greater than a fourth preset temperature, and when it is determined that the preset condition is satisfied, the step of acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, includes a step of acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, when it is determined that the temperature of the first processor is less than the fourth preset temperature but greater than or equal to a fifth preset temperature, and the fourth preset temperature is higher than the fifth preset temperature.

[0051] According to a second aspect, a data processing device is provided, the device including: a data processing unit configured to acquire first data from sensors in a first sensor group and process the first data, the first data corresponding to a first frame rate; and a determination unit configured to determine that a preset condition is met. The data processing unit is further configured to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from sensors in the first sensor group and process the third data, the third data corresponding to a second frame rate, and the first frame rate being different from the second frame rate.

[0052] Referring to the second aspect, in some implementations of the second aspect, the second sensor group includes a portion of the sensors in the first sensor group, and the first frame rate is greater than the second frame rate.

[0053] Referring to the second aspect, in some implementations of the second aspect, the data processing unit is configured to acquire first data from sensors in a first sensor group and process the first data when the determination unit determines that the intelligent driving device is in a first driving scenario, the first driving scenario being associated with a first frame rate, and to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from sensors in the first sensor group and process the third data when the determination unit determines that the intelligent driving device will switch from the first driving scenario to a second driving scenario, the second driving scenario being associated with a second frame rate.

[0054] Referring to the second aspect, in some implementations of the second aspect, the data processing unit is configured to process first data by using a plurality of processing units in the first processor, process second data by using some of the processing units in the plurality of processing units, or process third data by using some of the processing units.

[0055] Referring to the second aspect, in some implementations of the second aspect, the determination unit is further configured to determine that before the data processing unit processes the second data or the third data, the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, and the second preset temperature is higher than the first preset temperature.

[0056] Referring to the second aspect, in some implementations of the second aspect, the determination unit is further configured to determine that the temperature of the first processor is equal to or greater than a second preset temperature, and the data processing unit is further configured to stop data processing by using the first processor.

[0057] Referring to the second aspect, in some implementations of the second aspect, the determination unit is further configured to determine that the duration during which the temperature of the first processor is equal to or greater than a second preset temperature is equal to or greater than a first preset duration, and the data processing unit is further configured to stop data processing by using the first processor.

[0058] Referring to the second aspect, in some implementation forms of the second aspect, the determination unit is further configured to determine that the intelligent driving device switches from the second intelligent driving scenario to the first intelligent driving scenario, and the data processing unit is further configured to acquire fourth data from sensors in the first sensor group and process the fourth data, wherein the fourth data corresponds to the first frame rate.

[0059] Referring to the second aspect, in some implementations of the second aspect, the data processing unit is configured to process first data by using the first processor, and acquire second data from sensors in the second sensor group and process the second data when it is determined that the temperature of the first processor is greater than or equal to the first preset temperature and less than the second preset temperature, or acquire third data from sensors in the first sensor group and process the third data, and the first preset temperature is less than the second preset temperature.

[0060] Referring to the second aspect, in some implementations of the second aspect, the first processor includes a plurality of processing devices, and the data processing unit is configured to process first data by using the plurality of processing devices, process second data by using some of the processing devices in the plurality of processing devices, or process third data by using some of the processing devices.

[0061] Referring to the second aspect, in some implementations of the second aspect, the determination unit is further configured to determine that the temperature of the first processor is equal to or greater than a second preset temperature, and the data processing unit is further configured to stop data processing by using the first processor.

[0062] Referring to the second aspect, in some implementations of the second aspect, the determination unit is further configured to determine that the duration during which the temperature of the first processor is equal to or greater than a second preset temperature is equal to or greater than a first preset duration, and the data processing unit is further configured to stop data processing by using the first processor.

[0063] Referring to the second aspect, in some implementation forms of the second aspect, the determination unit is further configured to determine that the temperature of the first processor is less than or equal to a third preset temperature, and the data processing unit is configured to acquire fourth data from sensors in the first sensor group and process the fourth data, the fourth data corresponding to a first frame rate, and the first preset temperature is higher than the third preset temperature.

[0064] Referring to the second aspect, in some implementation forms of the second aspect, the second sensor group includes the first sensor group and the third sensor group, and the first frame rate is lower than the second frame rate.

[0065] Referring to the second aspect, in some implementations of the second aspect, the data processing unit is configured to acquire first data from sensors in a first sensor group and process the first data when the determination unit determines that the intelligent driving device is in a first driving scenario, the first driving scenario being associated with a first frame rate, and to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from sensors in the first sensor group and process the third data when the determination unit determines that the intelligent driving device will switch from the first driving scenario to a second driving scenario, the second driving scenario being associated with a second frame rate.

[0066] Referring to the second aspect, in some implementation forms of the second aspect, the data processing unit is configured to process first data by using the first processor, and acquire second data from sensors in the second sensor group and process the second data when the determination unit determines that the temperature of the first processor is less than a fourth preset temperature and greater than or equal to a fifth preset temperature, or acquire third data from sensors in the first sensor group and process the third data, and the fourth preset temperature is higher than the fifth preset temperature.

[0067] According to a third aspect, the present application provides a data processing apparatus, the apparatus including a processing unit and a storage unit, the storage unit configured to store instructions, the processing unit executing the instructions stored in the storage unit to enable the apparatus to perform any possible method according to the first aspect.

[0068] According to a fourth aspect, the present application provides an intelligent driving device, which may include any possible device according to the second aspect, or may include a device according to the third aspect.

[0069] Referring to the fourth aspect, in some implementations of the fourth aspect, the intelligent driving device is a vehicle.

[0070] According to a fifth aspect, the present application provides a computer program product, the computer program product comprising computer program code that, when executed on a computer, enables the computer to perform a method according to any possible implementation of the first aspect.

[0071] It should be noted that some or all of the computer program code may be stored in a first storage medium, which may be encapsulated together with the processor or may be encapsulated separately from the processor, which is not specifically limited in the embodiments of the present application.

[0072] According to a sixth aspect, the present application provides a computer-readable medium storing program code that, when executed on a computer, enables the computer to perform a method according to any possible implementation of the first aspect.

[0073] According to a seventh aspect, the present application provides a chip, the chip including a circuit, the circuit configured to perform any possible method according to the first aspect. [Brief explanation of the drawings]

[0074] [Figure 1] FIG. 1 is a functional block diagram of an intelligent driving device according to an embodiment of the present application. [Figure 2] 1 is a diagram of a vehicle structure according to an embodiment of the present application; [Figure 3] 1 is a schematic flowchart of a data processing method according to an embodiment of the present application; [Figure 4] 1A and 1B are diagrams illustrating an intelligent driving device in different system states according to one embodiment of the present application. [Figure 5] 1 is a schematic flowchart of a system state switching method according to an embodiment of the present application; [Figure 6] 1 is a block diagram of a data processing apparatus according to an embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION

[0075] In the description of the embodiments of the present application, " / " means "or" unless otherwise specified. For example, A / B may represent A or B. In this specification, "and / or" only describes a relational relationship for describing related objects and indicates that three relations may exist. For example, A and / or B may represent the following three cases: when only A exists, when both A and B exist, and when only B exists.

[0076] In the embodiments of the present application, prefix terms such as "first" and "second" are used merely to distinguish between different described objects, and do not limit the position, order, priority, quantity, or content of the described objects. In the embodiments of the present application, the use of prefix terms to distinguish between described objects, such as ordinal numbers, does not constitute a limitation on the described objects. For an explanation of the described purpose, please refer to the contextual description in the claims or embodiments, and the use of prefix terms should not constitute a redundant limitation. Also, in the description of the embodiments, "plurality" means two or more, unless otherwise specified.

[0077] The following describes the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application.

[0078] 1 is a functional block diagram of an intelligent driving device 100 according to one embodiment of the present application. The intelligent driving device 100 may include a perception system 110 and a computing platform 120. The perception system 110 may include one or more sensors that sense information about the surrounding environment of the intelligent driving device 100. For example, the perception system 110 may include a positioning system, which may be a global positioning system (GPS), a Beidou system, or another positioning system. The perception system 110 may further include one or more of an inertial measurement unit (IMU), a lidar, a millimeter-wave radar, an ultrasonic radar, and a camera device.

[0079] Some or all of the functions of the intelligent driving device 100 may be controlled by a computing platform 120. The computing platform 120 may include one or more processors, such as processors 121 through 12n (where n is a positive integer), where a processor is a circuit having signal processing capabilities. In one implementation, the processor may be a circuit having instruction reading and execution capabilities, such as a CPU, a microprocessor, a GPU (which may also be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor may perform a particular function based on the logical relationships of a hardware circuit, which may be fixed or reconfigurable. For example, the processor may be a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of a processor loading a configuration document to implement the hardware circuit configuration may be understood as the process of the processor loading instructions to perform some or all of the functions of the aforementioned units. In addition, the processor may alternatively be a hardware circuit designed for artificial intelligence and may be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), or a deep learning processing unit (DPU). In addition, the computing platform 120 may include a memory configured to store instructions.Some or all of the processors 121 through 12n can invoke instructions in memory to implement corresponding functions.

[0080] For example, the intelligent driving device 100 is a vehicle. Figure 2 is a diagram of the structure of a vehicle 200 according to one embodiment of the present application. As shown in Figure 2, the vehicle 200 may include front-view cameras 201 to 204, side-view cameras 205 and 206, surround-view cameras 207 to 210, rear-view cameras 211 and 212, millimeter-wave radars 213 and 214, a GPS 215, a gateway 216, ultrasonic radars 217 to 224, a left-view monitor 225, a right-view monitor 226, lidars 227 to 229, and an intelligent driving system 230. The intelligent driving system 230 includes a power supply 2301, an intelligent driving state machine 2302, an MCU 2303, and a processor 2304. The processor 2304 may include multiple processing units. For example, the processing unit is a SOC. The processor 2304 may include multiple SOCs (e.g., SOC1 to SOCn, where n is a positive integer greater than 1). In another example, the processing device is a computing core. The processor 2304 may include multiple computing cores. The power supply 2301 is configured to control the MCU 2303 and the processor 2304 to be powered on or off. The intelligent driving state machine 2302 is configured to determine a current driving scenario of the vehicle 200 or to determine a temperature of the processor 2304. The processor 2304 can determine a specific sensor whose data needs to be processed based on the result output by the intelligent driving state machine 2302 to obtain a data processing result. The processor 2304 can further generate a vehicle control command based on the data processing result and send the vehicle control command to an electronic control unit (ECU).

[0081] The MCU 2303 may be configured to control the vehicle 200 based on data collected by the sensors if the processor 2304 fails or has an excessively high temperature. For example, if the temperature of the processor 2304 is 105°C or higher, the power supply 2301 may be used to control the processor 2304 to be powered off. In this case, the MCU 2303 may receive data collected by the sensors. The MCU 2303 may generate vehicle control commands based on the data collected by the sensors. The vehicle control commands may be used for safe parking of the vehicle.

[0082] For example, if the processor 2304 includes multiple SOCs, the temperature of the processor 2304 may be the temperature of the SOC with the highest temperature among the multiple SOCs. Alternatively, if the processor 2304 includes multiple computing cores, the temperature of the processor 2304 may be the temperature of the computing core with the highest temperature among the multiple computing cores.

[0083] Front-view cameras 201-204, side-view cameras 205 and 206, surround-view cameras 207-210, rear-view cameras 211 and 212, millimeter-wave radars 213 and 214, GPS 215, ultrasonic radars 217-224, and lidars 227-229 are sensors within vehicle 200 and may be included in perception system 110. Intelligent driving system 230 may reside within computing platform 120.

[0084] The gateway 216 , the left view monitor 225 , and the right view monitor 226 may be peripheral devices within the vehicle 200 .

[0085] The above-described structure of the vehicle 200 is merely an example. The number and types of sensors and peripherals included in the vehicle 200 are not particularly limited in the embodiments of the present application.

[0086] 3 is a schematic flowchart of a data processing method 300 according to an embodiment of the present application. The method 300 may be performed by the intelligent driving device 100 or the vehicle 200, or the method 300 may be performed by the computing platform 120, or the method 300 may be performed by a SOC in the computing platform 120, or the method 300 may be performed by a processor in the computing platform 120, or the method 300 may be performed by the intelligent driving system 230, or the method 300 may be performed by the processor 2304. As shown in FIG. 3 , the method 300 includes the following steps:

[0087] S301: Obtain first data from sensors in a first sensor group, and process the first data, where the first data corresponds to a first frame rate.

[0088] In one embodiment, vehicle 200 is used as an example, and sensors and peripheral devices in vehicle 200 may be grouped. For example, Table 1 shows grouping results for front-view cameras 201 to 204, side-view cameras 205 and 206, surround-view cameras 207 to 210, rear-view cameras 211 and 212, millimeter-wave radars 213 and 214, GPS 215, gateway 216, ultrasonic radars 217 to 224, left-view monitor 225, right-view monitor 226, and lidars 227 to 229.

[0089] [Table 1]

[0090] The above grouping of sensors and peripherals in the vehicle 200 is merely an example, which is not specifically limited in the embodiments of the present application.

[0091] Each of the aforementioned sensor groups may include sensors and / or peripheral devices. For example, in sensor group B, side view cameras 205 and 206, lidars 228 and 229, and millimeter wave radar 214 are sensors, and gateway 216 is a peripheral device. In another example, in sensor group D, rear view cameras 211 and 212 are sensors, and left field of view monitor 225 and right field of view monitor 226 are peripheral devices.

[0092] For example, a first sensor group may include sensors in sensor group A, sensor group B, sensor group C, and sensor group D. When processor 2304 is powered on, processor 2304 may obtain and process data from the sensors in sensor group A, sensor group B, sensor group C, and sensor group D. In this manner, after processor 2304 is powered on, it may be determined whether the status of the sensors and peripheral devices in each sensor group is normal.

[0093] The first data corresponding to the first frame rate may be understood as acquiring the first data collected by the sensors in the first sensor group at the first frame rate. The first sensor group may include multiple types of sensors, and the first frame rate may include a frame rate corresponding to each type of sensor.

[0094] For example, Table 2 shows the frame rate at which each of the sensors in a first sensor group (eg, including sensor group A, sensor group B, sensor group C, and sensor group D) collects first data.

[0095] [Table 2]

[0096] The correspondence between different types of sensors and frame rates shown in Table 2 is merely an example, which is not limited to the details in the embodiments of the present application.

[0097] Corresponding to the first data at the first frame rate may alternatively be understood as acquiring data collected by sensors in the first sensor group at a frame rate higher than the first frame rate and processing the data such that the frame rate corresponding to the ultimately acquired data is the first frame rate. For example, processor 2304 may acquire image data 1 collected by a camera, where image data 1 may be data collected when the camera's frame rate is 30 fps. Processor 2304 may select to process the first data (a portion of the data in image data 1) to enable the frame rate corresponding to the portion of the data in image data 1 to be 15 fps.

[0098] S302: If it is determined that the preset condition is satisfied, acquire second data from sensors in a second sensor group and process the second data, or acquire third data from sensors in the first sensor group and process the third data, where the third data corresponds to a second frame rate and the first frame rate is different from the second frame rate.

[0099] In one embodiment, the second sensor group includes a portion of the sensors in the first sensor group, and the first frame rate is greater than the second frame rate.

[0100] For example, a first sensor group includes sensors in sensor group A, sensor group B, sensor group C, and sensor group D. In this case, the second sensor group may include sensors in sensor group A, sensor group B, and sensor group C; the second sensor group may include sensors in sensor group A, sensor group B, and sensor group D; the second sensor group may include sensors in sensor group B, sensor group C, and sensor group D; the second sensor group may include sensors in sensor group A and sensor group B; the second sensor group may include sensors in sensor group A and sensor group C; the second sensor group may include sensors in sensor group A and sensor group D; the second sensor group may include sensors in sensor group B and sensor group C; the second sensor group may include sensors in sensor group B and sensor group D; the second sensor group may include sensors in sensor group C and sensor group D; the second sensor group may include sensors in sensor group A; the second sensor group may include sensors in sensor group B; the second sensor group may include sensors in sensor group C; or the second sensor group may include sensors in sensor group D.

[0101] For example, FIG. 4 is a diagram of sensor groups of an intelligent driving device according to one embodiment of the present application. As shown in FIG. 4, the system states of the intelligent driving device may be categorized as S1 to S4. In system state S1, processor 2304 can process data from sensors in sensor group A. In system state S2, processor 2304 can process data from sensors in sensor group A and sensor group B. In system state S3, processor 2304 can process data from sensors in sensor group A, sensor group B, and sensor group C. In system state S4, processor 2304 can process data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D.

[0102] The intelligent driving system 230 may further include a camera deserializer, an on-board Ethernet interface (ETH IF), a controller area network interface (CAN IF), and a display serializer. The camera deserializer is configured to connect to the front-view cameras 201 to 204, the side-view cameras 205 and 206, the surround-view cameras 207 to 210, and the rear-view cameras 211 and 212. The on-board ETH IF or CAN IF is configured to connect to the lidars 227 to 229, the millimeter-wave radars 213 and 214, the GPS 215, and the gateway 216. The CAN IF is further configured to connect to the ultrasonic radars 217 to 224. The display serializer is configured to connect to the left-view monitor 225 and the right-view monitor 226.

[0103] In one embodiment, the system states of the intelligent driving device may further include S1' to S4'. For example, a frame rate corresponding to data acquired from a sensor by the processor 2304 in system state S4' is lower than a frame rate corresponding to data acquired from the same sensor by the processor 2304 in system state S4. For example, the frame rate of data acquired in system state S4' is half the frame rate of data acquired in system state S4.

[0104] System state S1 may be a system state that meets regulatory requirements. For example, system state S1 may meet safe stopping during autonomous emergency braking (AEB). System state S2 may support basic functions. System state S3 may support advanced functions. System state S4 may support all functions of the intelligent driving device.

[0105] The foregoing is explained by using an example in which the intelligent driving device includes S1 to S4 and S1' to S4'. The number of system states is not specifically limited in the embodiments of the present application. The intelligent driving device may include several system states S1 to S4 and S1' to S4'. For example, the system states of the intelligent driving device may include S4, S4', S3, S2, and S1. Alternatively, the intelligent driving device may include system states other than S1 to S4 and S1' to S4'.

[0106] For example, Table 3 shows the power consumption of the intelligent driving system 230 in system states S4, S4', S3, S2, and S1.

[0107] [Table 3]

[0108] From the power consumption results shown in Table 3, it can be learned that the power consumption of the intelligent driving system 230 in the system states S4, S4', S3, S2, and S1 gradually decreases.

[0109] For example, in S301, the intelligent driving device may be in system state S4.

[0110] For example, the intelligent driving device switches the system state from S4 to S3. Table 4 shows the frame rate at which each sensor in the second sensor group (e.g., including sensor group A, sensor group B, and sensor group C) collects the second data.

[0111] [Table 4]

[0112] In this embodiment of the present application, if a preset condition is met, the second data from the sensors in the second sensor group can be processed. This helps reduce the power consumption of the intelligent driving device, further improving the durability and economy of the intelligent driving device. In addition, this helps prevent excessively high temperatures of components in the intelligent driving system, helping to improve the reliability and security of the intelligent driving system.

[0113] For example, the intelligent driving device switches the system state from S4 to S4'. Table 5 shows the frame rate at which each of the sensors in the first sensor group (e.g., including sensor group A, sensor group B, sensor group C, and sensor group D) collects the third data.

[0114] [Table 5]

[0115] The above description is given using an example in which the second frame rate is half the first frame rate. The embodiments of the present application are not limited thereto. For example, the second frame rate may alternatively be one-third the first frame rate.

[0116] The preset conditions may include switching driving scenarios of the intelligent driving device.

[0117] In one embodiment, the step of acquiring first data from sensors in a first sensor group and processing the first data includes the step of acquiring first data from sensors in a first sensor group and processing the first data when it is determined that the intelligent driving device is in a first driving scenario, the first driving scenario being associated with a first frame rate; and the step of acquiring second data from sensors in a second sensor group and processing the second data or acquiring third data from sensors in the first sensor group and processing the third data when it is determined that a preset condition is met includes the step of acquiring second data from sensors in a second sensor group and processing the second data or acquiring third data from sensors in the first sensor group and processing the third data when it is determined that the intelligent driving device will switch from the first driving scenario to a second driving scenario, the second driving scenario being associated with a second frame rate.

[0118] The different driving scenarios discussed above may be associated with different frame rates.

[0119] For example, in a highway pilot (HWP) scenario, the intelligent driving device may be in system state S4, where the frame rate of data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D is frame rate 1. It should be understood that frame rate 1 may include multiple frame rates corresponding to multiple sensors.

[0120] As another example, in a highway assist (HWA) scenario, the intelligent driving device may be in system state S4'. In this case, the frame rate of data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D is frame rate 2. Frame rate 2 may be lower than frame rate 1. For example, frame rate 2 is half of frame rate 1.

[0121] Frame rate 2 being lower than frame rate 1 can be understood as the frame rate corresponding to data from each of at least some of the sensors in sensor group A, sensor group B, sensor group C, and sensor group D in S4' being lower than the frame rate corresponding to data from each of at least some of the sensors in S4.

[0122] In one embodiment, the driving scenarios of the intelligent driving device include, but are not limited to, an HWP scenario, an HWA scenario, a traffic jam pilot (TJP) scenario, an automotive lane change (ALC) scenario, and an automated parking scenario. The automated parking scenario may include auto parking assist (APA), remote parking assist (RPA), auto valet parking (AVP), etc.

[0123] For example, the first driving scenario and the second driving scenario may be different driving scenarios. For example, if the first driving scenario is a Highway Pilot scenario, the first sensor group may include sensor group A, sensor group B, sensor group C, and sensor group D. If the second driving scenario is a Highway Assist scenario, the second sensor group may include sensor group A, sensor group B, and sensor group C.

[0124] In this embodiment of the present application, data from a portion of the sensors is processed, or data corresponding to a reduced frame rate is processed. This helps to reduce the power consumption of the intelligent driving device, which further helps to improve the durability and economy of the intelligent driving device. In addition, this helps to avoid excessively high temperatures of components in the intelligent driving system, which helps to improve the reliability and security of the intelligent driving system.

[0125] In some possible implementations, the first driving scenario and the second driving scenario may be different driving functions in the same driving scenario.

[0126] For example, different driving functions may support different levels of automation.

[0127] For example, the level of automation may be based on the classification criteria of the Society of Automotive Engineers (SAE). For example, the level of automation may be classified from L0 to L5. L0 indicates no automation, L1 indicates driver assistance, L2 indicates partial automation, L3 indicates conditional automation, L4 indicates high automation, and L5 indicates full automation. For example, in the case of APA, the driver does not need to control the steering wheel but still needs to control the vehicle's throttle and brakes. In the case of RPA, the driver can remotely park the vehicle outside the vehicle by using a terminal device (e.g., a mobile phone). In the case of AVP, the vehicle can complete parking without the driver. In terms of corresponding levels of automation, APA is approximately at level L1, RPA is approximately at level L2 or L3, and AVP is approximately at level L4.

[0128] For example, if the function corresponding to the first driving scenario is AVP, the first sensor group may include sensor group A, sensor group B, sensor group C, and sensor group D. If the function corresponding to the second driving scenario is APA, the second sensor group may include sensor group A, sensor group B, and sensor group C.

[0129] In one embodiment, acquiring second data from sensors in the second sensor group and processing the second data includes acquiring data from sensors in the first sensor group and processing the second data that is in the data and collected by sensors in the second sensor group.

[0130] In one embodiment, prior to the step of acquiring second data from sensors in the second sensor group and processing the second data, the method includes the step of disabling sensors in the first sensor group except for the sensors in the second sensor group.

[0131] For example, disabling the sensors in the first sensor group except for the sensors in the second sensor group includes disabling the sensors in the first sensor group except for the sensors in the second sensor group by using power gating or clock gating.

[0132] In one embodiment, when the intelligent driving device determines to switch from the first driving scenario to the second driving scenario, second data is acquired from the sensors in the second sensor group and the second data is processed. When the intelligent driving device determines to switch from the second driving scenario to a third driving scenario, the method further includes acquiring fifth data from the sensors in the third sensor group and processing the fifth data, or acquiring sixth data from the sensors in the second sensor group and processing the sixth data, where the sixth data corresponds to a third frame rate, the third driving scenario is associated with the third frame rate, the third sensors include some of the sensors in the second sensor group, and the second frame rate is greater than the third frame rate.

[0133] For example, the second sensor group includes sensors in sensor group A, sensor group B, and sensor group C. In this case, the third sensor group may include sensors in sensor group A and sensor group B, the third sensor group may include sensors in sensor group A and sensor group C, the third sensor group may include sensors in sensor group B and sensor group C, the second sensor group may include sensors in sensor group A, the second sensor group may include sensors in sensor group B, or the second sensor group may include sensors in sensor group C.

[0134] For example, the second driving scenario may be a highway assist scenario, and the third driving scenario may be a traffic jam pilot scenario. The third sensor group may include sensor group A and sensor group B. For example, the intelligent driving device switches the system state from S3 to S2. Table 6 shows the frame rate at which each of the sensors in the third sensor group (e.g., including sensor group A and sensor group B) collects the fifth data.

[0135] [Table 6]

[0136] For example, if it is determined that the intelligent driving device will switch from the second driving scenario to the third driving scenario, sensor group C may be selected to be disabled so that the fifth data from sensor group A and sensor group B can be processed.

[0137] For example, the intelligent driving device switches the system state from S3 to S3'. Table 7 shows the frame rate at which each of the sensors in the second sensor group (e.g., including sensor group A and sensor group B) collects the sixth data.

[0138] [Table 7]

[0139] The above description is given using an example in which the third frame rate is half the second frame rate. The embodiments of the present application are not limited thereto. For example, the third frame rate may alternatively be 1 / 3 of the second frame rate.

[0140] In one embodiment, the step of processing the first data includes processing the first data by using multiple processing units in the first processor, and the step of acquiring second data from sensors in the second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data includes processing the second data by using some of the processing units in the multiple processing units, or processing the third data by using some of the processing units.

[0141] For example, the first processor is processor 2304. Processor 2304 may include three SOCs. Processor 2304 can process first data by using the three SOCs. Processor 2304 can process second data or third data by using two of the three SOCs. Processor 2304 can process fifth data or sixth data by using one of the three SOCs.

[0142] For example, the first processor is processor 2304. Processor 2304 may include one SOC, which may include five computing cores. Processor 2304 may process first data by using the five computing cores. Processor 2304 may process second data or third data by using four of the five computing cores. Processor 2304 may process fifth data or sixth data by using three of the five computing cores.

[0143] In one embodiment, before the step of processing the second data or the step of processing the third data, the method further includes a step of disabling processing devices other than some of the processing devices in the plurality of processing devices.

[0144] In one embodiment, disabling processing units other than some of the processing units in the plurality of processing units comprises disabling processing units other than some of the processing units in the plurality of processing units by using power gating or clock gating.

[0145] In one embodiment, prior to the step of acquiring second data from sensors in the second sensor group and processing the second data or the step of acquiring third data from sensors in the first sensor group and processing the third data, the method further includes determining that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, wherein the second preset temperature is greater than the first preset temperature.

[0146] For example, the first processor is processor 2304. Processor 2304 may include three SOCs, namely, SOC1, SOC2, and SOC3. Intelligent driving state machine 2302 can detect the temperatures of SOC1, SOC2, and SOC3 separately. Processor 2304 can obtain the temperature of each SOC from intelligent driving state machine 2302. Thus, processor 2304 can determine that the temperature of processor 2304 is the temperature of SOC1, which is higher than the temperature of SOC2 and higher than the temperature of SOC3.

[0147] For example, the first processor is processor 2304. Processor 2304 may include one SOC, which includes computing core 1, computing core 2, and computing core 3. Intelligent driving state machine 2302 can detect the temperatures of computing core 1, computing core 2, and computing core 3 separately. Processor 2304 can obtain the temperature of each computing core from intelligent driving state machine 2302. Thus, processor 2304 can determine that the temperature of processor 2304 is the temperature of computing core 1, which is higher than the temperature of computing core 2 and higher than the temperature of computing core 3.

[0148] In one embodiment, the temperature of the first processor may be an average of the temperatures of multiple processing units.

[0149] For example, the first preset temperature is 75°C, and the second preset temperature is 105°C. In view of this, when the intelligent driving device switches from the first driving scenario to the second driving scenario and the temperature of the first processor is equal to or greater than 75°C and less than 105°C, the second data from the second sensor group may be processed, or the third data from the first sensor group may be processed.

[0150] In one embodiment, the method 300 further includes stopping data processing by using the first processor if the temperature of the first processor is determined to be equal to or greater than the second preset temperature.

[0151] For example, if the temperature of the processor 2304 is equal to or higher than 105° C., data processing by using the processor 2304 may be stopped. In this case, the MCU 2303 may take over the vehicle 200.

[0152] In one embodiment, the method 300 further includes stopping data processing using the first processor if it is determined that the duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than the first preset duration.

[0153] For example, the first preset duration is 15 minutes (min), and if the duration that the temperature of the first processor is 105°C or higher is 15 minutes or longer, data processing by using the first processor may be stopped.

[0154] In one embodiment, the method 300 further includes, when it is determined that the intelligent driving device will switch from the second intelligent driving scenario to the first intelligent driving scenario, acquiring fourth data from the sensors in the first sensor group and processing the fourth data, wherein the fourth data corresponds to the first frame rate.

[0155] The preset condition may include determining a temperature of the first processor.

[0156] In one embodiment, the step of processing the first data includes processing the first data by using the first processor when it is determined that the temperature of the first processor is less than a first preset temperature, and when it is determined that the preset condition is met, the step of acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, includes acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, when it is determined that the temperature of the first processor is greater than or equal to the first preset temperature and less than the second preset temperature, and the first preset temperature is less than the second preset temperature.

[0157] For example, the first preset temperature is 75°C and the second preset temperature is 105°C.

[0158] In one embodiment, acquiring second data from sensors in the second sensor group and processing the second data includes acquiring data from sensors in the first sensor group and processing the second data that is in the data and collected by sensors in the second sensor group.

[0159] In one embodiment, prior to the step of acquiring second data from sensors in the second sensor group and processing the second data, the method includes the step of disabling sensors in the first sensor group except for the sensors in the second sensor group.

[0160] In one embodiment, the first processor includes a plurality of processing devices, and processing the first data using the first processor includes processing the first data using the plurality of processing devices, and acquiring second data from sensors in the second sensor group and processing the second data or acquiring third data from sensors in the first sensor group and processing the third data includes processing the second data using some of the processing devices in the plurality of processing devices or processing the third data using some of the processing devices.

[0161] For example, the first processor is processor 2304. Processor 2304 may include one SOC, which may include five computing cores. Processor 2304 can process first data by using the five computing cores. Processor 2304 can process second data or third data by using four of the five computing cores.

[0162] In one embodiment, the method further includes stopping data processing by using the first processor when the temperature of the first processor is determined to be equal to or greater than a second preset temperature.

[0163] In one embodiment, the method 300 further includes stopping data processing using the first processor if it is determined that the duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than the first preset duration.

[0164] In one embodiment, the method 300 further includes, when the temperature of the first processor is determined to be less than or equal to a third preset temperature, acquiring fourth data from the sensors in the first sensor group and processing the fourth data, wherein the fourth data corresponds to the first frame rate, and the first preset temperature is greater than the third preset temperature.

[0165] For example, the third preset temperature is 70° C. In view of this, if the temperature of the first processor is equal to or lower than 70° C., the fourth data from the sensor in the first sensor group may be processed.

[0166] In this embodiment of the present application, a hysteresis temperature (the hysteresis temperature is the difference between the first preset temperature and the second preset temperature) is set, which can prevent the intelligent driving device from switching back and forth between different system states, which helps to improve the reliability and security of the intelligent driving system.

[0167] 5 is a schematic flowchart of a system state switching method 500 according to an embodiment of the present application. Method 500 may be performed by intelligent driving device 100 or vehicle 200, or may be performed by computing platform 120, or may be performed by a SOC in computing platform 120, or may be performed by a processor in computing platform 120, or may be performed by intelligent driving system 230, or may be performed by processor 2304. Method 500 may include the following steps:

[0168] S501: When the temperature of the first processor is less than 75°C, control the intelligent driving device to enter system state S4.

[0169] For example, the first processor is processor 2304. When processor 2304 is powered on by using power supply 2301, the temperature of processor 2304 is less than 75°C, and the intelligent driving device may be controlled to enter system state S4. In this case, data from sensors in sensor group A, sensor group B, sensor group C, and sensor group D may be processed by using processor 2304, and the frame rate corresponding to the data is a first frame rate.

[0170] S502: Determine whether the temperature of the first processor is 75°C or higher.

[0171] If the temperature of the first processor is equal to or greater than 75°C, S503 is executed; otherwise, the system state continues to be maintained in S4.

[0172] S503: Control the intelligent driving device to switch the system state from S4 to S4'.

[0173] For example, if the temperature of the first processor is 75°C or higher, the intelligent driving device can switch the system state from S4 to S4'. In this case, data from sensors of sensor group A, sensor group B, sensor group C, and sensor group D may be processed. The frame rate corresponding to the data is a second frame rate, and the second frame rate is smaller than the first frame rate.

[0174] In one embodiment, when S4 is switched to S4', it may be determined whether the temperature of the first processor is less than or equal to 70° C. If the temperature of the first processor is less than or equal to 70° C., the system state may be switched from S4' to S4.

[0175] In this embodiment of the application, a hysteresis temperature (eg, 5° C.) may be set to prevent the system state from toggling back and forth between S4 and S4′.

[0176] S504: Determine whether the temperature of the first processor is equal to or greater than 85°C.

[0177] If the temperature of the first processor is equal to or greater than 85°C, S505 is executed; otherwise, the system state continues to be maintained in S4'.

[0178] S505: Control the intelligent driving device to switch the system state from S4' to S3.

[0179] For example, if the temperature of the first processor is 85°C or higher, the intelligent driving device may switch the system state from S4' to S3, in which case the first processor can process data from sensors in sensor group A, sensors in sensor group B, and sensors in sensor group C.

[0180] In one embodiment, when S4′ is switched to S3, it may be determined whether the temperature of the first processor is less than or equal to 80° C. If the temperature of the first processor is less than or equal to 80° C., the system state may be switched from S3 to S4′.

[0181] In this embodiment of the present application, a hysteresis temperature (eg, 5° C.) may be set to prevent the system state from toggling back and forth between S4′ and S3.

[0182] S506: Determine whether the temperature of the first processor is 95°C or higher.

[0183] If the temperature of the first processor is equal to or greater than 95°C, S507 is executed; otherwise, the system state continues to be maintained in S3.

[0184] S507: Control the intelligent driving device to switch the system state from S3 to S2.

[0185] For example, if the temperature of the first processor is 95°C or higher, the intelligent driving device can switch the system state from S3 to S2, in which case the first processor can process data from sensors in sensor group A and sensor group B.

[0186] In one embodiment, when S3 is switched to S2, it may be determined whether the temperature of the first processor is less than or equal to 90° C. If the temperature of the first processor is less than or equal to 90° C., the system state may be switched from S2 to S3.

[0187] In this embodiment of the present application, a hysteresis temperature (eg, 5°C) may be set to prevent the system state from switching back and forth between S3 and S2.

[0188] S508: Determine whether the temperature of the first processor is 100°C or higher.

[0189] If the temperature of the first processor is equal to or greater than 100°C, S509 is executed; otherwise, the system state continues to be maintained in S2.

[0190] S509: Control the intelligent driving device to switch the system state from S2 to S1.

[0191] For example, if the temperature of the first processor is 100°C or higher, the intelligent driving device can switch the system state from S2 to S1, in which case the first processor can process data from sensors in sensor group A.

[0192] In one embodiment, when S2 is switched to S1, it may be determined whether the temperature of the first processor is less than or equal to 97° C. If the temperature of the first processor is less than or equal to 97° C., the system state may be switched from S1 to S2.

[0193] In this embodiment of the present application, a hysteresis temperature (eg, 3°C) may be set to prevent the system state from switching back and forth between S2 and S1.

[0194] S510: Determine whether the temperature of the first processor is 105°C or higher.

[0195] If the temperature of the first processor is equal to or greater than 105°C, S511 is executed; otherwise, the system state continues to be maintained in S1.

[0196] S511: Stop processing data by using the first processor.

[0197] In one embodiment, if the temperature of the first processor is detected to be 105° C. or higher for a duration of 15 minutes or more, data processing using the first processor is stopped, in which case the MCU can take over control of the vehicle.

[0198] In one embodiment, if the duration for stopping data processing by using the first processor is equal to or greater than a second preset duration, the intelligent driving device may be controlled to enter system state S4.

[0199] For example, the second preset duration is 15 minutes.

[0200] Alternatively, the preset condition may be to determine a time period corresponding to the intelligent driving device.

[0201] In one embodiment, processing the first data includes processing the first data within a first period of time, and if it is determined that the preset condition is met, acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, includes acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, when the first period of time ends.

[0202] For example, in the period from T1 to T2, the intelligent driving device may be controlled to be in system state S4, and in the period from T2 to T3, the intelligent driving device may be controlled to switch the system state from S4 to S4'.

[0203] In one embodiment, the second sensor group includes the first sensor group and a third sensor group, and the first frame rate is lower than the second frame rate.

[0204] For example, the first sensor group may include sensor group A, and the third sensor group may include sensor group B. In this case, the second sensor group may include sensor group A and sensor group B. For example, in S301, the intelligent driving device may be in system state S1, and when a preset condition is met, the system state of the intelligent driving device may be switched from S1 to S2.

[0205] In one embodiment, the step of acquiring first data from sensors in a first sensor group and processing the first data includes the step of acquiring first data from sensors in a first sensor group and processing the first data when it is determined that the intelligent driving device is in a first driving scenario, the first driving scenario being associated with a first frame rate; and the step of acquiring second data from sensors in a second sensor group and processing the second data or acquiring third data from sensors in the first sensor group and processing the third data when it is determined that a preset condition is met includes the step of acquiring second data from sensors in a second sensor group and processing the second data or acquiring third data from sensors in the first sensor group and processing the third data when it is determined that the intelligent driving device will switch from the first driving scenario to a second driving scenario, the second driving scenario being associated with a second frame rate.

[0206] For example, the first driving scenario is a highway assist scenario, and the second driving scenario is a highway pilot scenario. When the intelligent driving device is in the highway assist scenario, the intelligent driving device is in system state S3. In this case, the first processor can process data 1 from sensor group A, sensor group B, and sensor group C. The frame rate corresponding to data 1 is frame rate 1. When it is determined that the intelligent driving scenario is to be switched from the highway assist scenario to the highway pilot scenario, the intelligent driving device can switch the system state from S3 to S4. In this case, the first processor can process data 2 from sensor group A, sensor group B, sensor group C, and sensor group D. The frame rate corresponding to data 2 is frame rate 2.

[0207] Alternatively, when it is determined that the intelligent driving scenario is to be switched from the Highway Assist scenario to the Highway Pilot scenario, the intelligent driving device may switch the system state from S3 to S4'. In this case, the first processor may process Data 3 from Sensor Group A, Sensor Group B, Sensor Group C, and Sensor Group D. The frame rate corresponding to Data 3 is Frame Rate 3, and Frame Rate 3 is smaller than Frame Rate 2.

[0208] Alternatively, if it is determined that the intelligent driving scenario is to be switched from the Highway Assist scenario to the Highway Pilot scenario, the intelligent driving device may switch the system state from S3 to S3''. In this case, the first processor may process data 4 from sensor group A, sensor group B, and sensor group C. The frame rate of data 4 is frame rate 4, which is higher than frame rate 1.

[0209] In one embodiment, the step of processing the first data includes processing the first data by using the first processor when it is determined that the temperature of the first processor is greater than or equal to a fourth preset temperature, and when it is determined that the preset condition is met, the step of acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, includes the step of acquiring second data from sensors in the second sensor group and processing the second data, or acquiring third data from sensors in the first sensor group and processing the third data, when it is determined that the temperature of the first processor is less than the fourth preset temperature but greater than or equal to a fifth preset temperature, and the fourth preset temperature is higher than the fifth preset temperature.

[0210] For example, the fourth preset temperature is 90°C and the fifth preset temperature is 80°C.

[0211] If the temperature of the first processor is 90°C or higher, the intelligent driving device may be in system state S2. In this case, the first processor can process data from sensor group A and sensor group B. If the temperature of the first processor is less than 90°C but greater than or equal to 80°C, the intelligent driving device can switch the system state from S2 to S3. In this case, the first processor can process data from the sensors in sensor group A, the sensors in sensor group B, and the sensors in sensor group C.

[0212] 6 is a block diagram of a data processing device 600 according to an embodiment of the present application. As shown in FIG. 6, the device 600 includes a data processing unit 610 configured to acquire first data from sensors in a first sensor group and process the first data, where the first data corresponds to a first frame rate, and a determining unit 620 configured to determine that a preset condition is met. The data processing unit 610 is further configured to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from sensors in the first sensor group and process the third data, where the third data corresponds to a second frame rate, and the first frame rate is different from the second frame rate.

[0213] Optionally, the second sensor group includes some of the sensors in the first sensor group, and the first frame rate is higher than the second frame rate.

[0214] Optionally, the data processing unit 610 is configured to acquire first data from sensors in a first sensor group and process the first data when the determination unit 620 determines that the intelligent driving device is in a first driving scenario, the first driving scenario being associated with a first frame rate, and the data processing unit is configured to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from sensors in the first sensor group and process the third data when the determination unit 620 determines that the intelligent driving device will switch from the first driving scenario to a second driving scenario, the second driving scenario being associated with a second frame rate.

[0215] Optionally, the data processing unit 610 is configured to process first data by using multiple processing units in the first processor, process second data by using some of the processing units in the multiple processing units, or process third data by using some of the processing units.

[0216] Optionally, the determining unit 620 is further configured to determine that before the data processing unit 610 processes the second data or the third data, the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, wherein the second preset temperature is higher than the first preset temperature.

[0217] Optionally, the determining unit 620 is further configured to determine that the temperature of the first processor is equal to or greater than a second preset temperature, and the data processing unit 610 is further configured to stop data processing by using the first processor.

[0218] Optionally, the determining unit 620 is further configured to determine that the duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than the first preset duration, and the data processing unit 610 is further configured to stop data processing by using the first processor.

[0219] Optionally, the determination unit 620 is further configured to determine that the intelligent driving device switches from the second intelligent driving scenario to the first intelligent driving scenario, and the data processing unit 610 is further configured to acquire fourth data from the sensors in the first sensor group and process the fourth data, where the fourth data corresponds to the first frame rate.

[0220] Optionally, the data processing unit 610 is configured to process the first data by using the first processor, and to acquire second data from sensors in the second sensor group and process the second data, or to acquire third data from sensors in the first sensor group and process the third data, when the determination unit 620 determines that the temperature of the first processor is greater than or equal to the first preset temperature and less than the second preset temperature, and the first preset temperature is less than the second preset temperature.

[0221] Optionally, the first processor includes a plurality of processing units, and the data processing unit 610 is configured to process the first data by using the plurality of processing units, process the second data by using some of the processing units in the plurality of processing units, or process the third data by using some of the processing units.

[0222] Optionally, the determining unit 620 is further configured to determine that the temperature of the first processor is equal to or greater than a second preset temperature, and the data processing unit is further configured to stop data processing by using the first processor.

[0223] Optionally, the determining unit 620 is further configured to determine that the duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than the first preset duration, and the data processing unit 610 is further configured to stop data processing by using the first processor.

[0224] Optionally, the determination unit 620 is further configured to determine that the temperature of the first processor is less than or equal to a third preset temperature, and the data processing unit 610 is further configured to obtain fourth data from the sensors in the first sensor group and process the fourth data, wherein the fourth data corresponds to the first frame rate, and the first preset temperature is higher than the third preset temperature.

[0225] Optionally, the second sensor group includes the first sensor group and a third sensor group, and the first frame rate is lower than the second frame rate.

[0226] Optionally, the data processing unit 610 is configured to acquire first data from sensors in a first sensor group and process the first data when the determination unit 620 determines that the intelligent driving device is in a first driving scenario, the first driving scenario being associated with a first frame rate, and the data processing unit is configured to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from sensors in the first sensor group and process the third data when the determination unit 620 determines that the intelligent driving device will switch from the first driving scenario to a second driving scenario, the second driving scenario being associated with a second frame rate.

[0227] Optionally, the data processing unit 610 is configured to process the first data by using the first processor, and to acquire second data from sensors in the second sensor group and process the second data, or to acquire third data from sensors in the first sensor group and process the third data, when the determination unit 620 determines that the temperature of the first processor is less than a fourth preset temperature and greater than or equal to a fifth preset temperature, and the fourth preset temperature is higher than the fifth preset temperature.

[0228] It should be understood that the division into units in the above-described device is merely a logical division of functions. In actual implementation, all or some of the units may be integrated into one physical entity or physically separated. In addition, the units in the device may be implemented in the form of software called by a processor. For example, the device may include a processor connected to a memory, which stores instructions, and the processor calls the instructions stored in the memory to perform any one of the above-described methods or to perform the functions of each unit of the device. The processor may be, for example, a general-purpose processor such as a CPU or a microprocessor. The memory may be memory within the device or memory external to the device. Alternatively, the units in the device may be implemented in the form of hardware circuits, and some or all of the functions of the units may be implemented by designing the hardware circuits. The hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and some or all of the functions of the aforementioned units are implemented by designing logical relationships between elements within the circuit. As another example, in another implementation, the hardware circuit may be implemented by using a PLD. An FPGA is used as an example. The hardware circuit may include a number of logic gate circuits, and the connections between the logic gate circuits are configured to implement some or all of the functions of the aforementioned units by using a configuration file. All of the units in the aforementioned device may be implemented in the form of software called by a processor, or all of the units may be implemented in the form of hardware circuits, or some of the units may be implemented in the form of software called by a processor and the remaining units may be implemented in the form of hardware circuits.

[0229] Each unit in the aforementioned apparatus may be one or more processors (or processing circuits) configured to perform the aforementioned method, such as a CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, or FPGA, or a combination of at least two of these processor forms.

[0230] In addition, all or some of the units in the aforementioned devices may be integrated or implemented independently. In one implementation, these units are integrated and implemented in the form of a SOC. The SOC may include at least one processor configured to perform any one of the methods or to perform the functions of the units of the device. The at least one processor may be of different types; for example, the at least one processor may include a CPU and an FPGA, a CPU and an artificial intelligence processor, or a CPU and a GPU.

[0231] An embodiment of the present application further provides an apparatus, the apparatus including a processing unit and a storage unit, the storage unit configured to store instructions, the processing unit executes the instructions stored in the storage unit to enable the apparatus to perform the method or steps performed in the aforementioned embodiments.

[0232] Optionally, if the apparatus is located in an intelligent driving device, the processing unit may be a processor 121 to 12n shown in FIG.

[0233] An embodiment of the present application further provides a data processing system, the system including a plurality of sensors and a computing platform, the computing platform may include the device 600.

[0234] An embodiment of the present application further provides an intelligent driving device, which may include a data processing device 600 or a data processing system.

[0235] Optionally, the intelligent driving device may be a vehicle.

[0236] An embodiment of the present application further provides a computer program product, which includes computer program code that, when executed on a computer, enables the computer to perform a data processing method.

[0237] An embodiment of the present application further provides a computer-readable medium, which stores program code, which, when executed on a computer, enables the computer to perform a data processing method.

[0238] In the implementation process, the steps of the aforementioned method can be completed by using hardware integrated logic circuits in a processor or by using instructions in the form of software. The method disclosed with reference to the embodiments of the present application may be directly executed by a hardware processor, or may be executed by using a combination of hardware and software modules in a processor. The software modules may be located in a mature storage medium in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register. The storage medium is located in the memory, and the processor reads information in the memory and completes the steps in the aforementioned method in combination with the hardware of the processor. To avoid repetition, details will not be described again here.

[0239] It should be understood that in this embodiment of the present application, memory may include read-only memory and random access memory to provide instructions and data to the processor.

[0240] It should be further understood that the sequence numbers of the above processes in various embodiments of the present application do not imply an execution order, and the execution order of the processes should be determined based on the functions and internal logic of the processes, and should not be construed as any limitation on the implementation process in the embodiments of the present application.

[0241] Those skilled in the art can recognize that the units and algorithm steps described with reference to examples in the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether a function is performed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but the implementation should not be considered to go beyond the scope of this application.

[0242] For the purpose of easy description, it can be clearly understood by those skilled in the art that the detailed working processes of the aforementioned systems, devices and units should be referred to the corresponding processes of the aforementioned method embodiments, and the details will not be described again in this specification.

[0243] In some embodiments provided in the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the above-described device embodiments are merely examples. For example, the division of units is merely a division of logical functions, and other divisions may be used in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not implemented. In addition, the shown or described mutual couplings or direct couplings or communication connections may be implemented via some interfaces. Indirect couplings or communication connections between devices or units may be implemented electronically, mechanically, or in another form.

[0244] Units described as separate parts may or may not be physically separate, and parts shown as units may or may not be physical units, located in one location or distributed over multiple network units. Some or all of the units may be selected based on actual requirements to achieve the objectives of the solutions of the embodiments.

[0245] In addition, the functional units in the embodiments of the present application may be integrated into one processing unit, and each of the units may exist physically alone, or two or more units may be integrated into one unit.

[0246] When a function is implemented in the form of a software functional unit and sold or used as an independent product, the function may be stored in a computer-readable storage medium. Based on this understanding, the technical solution, the portion contributing to the prior art, or some of the technical solutions in the present application may be essentially implemented in the form of a software product. The computer software product is stored in a storage medium and includes some instructions for instructing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or some of the steps of the method in the embodiments of the present application. The aforementioned storage medium includes any medium capable of storing program code, such as a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0247] The above description is merely a specific implementation form of the present application and is not intended to limit the protection scope of the present application. Any variations or replacements that can be easily thought up by those skilled in the art within the technical scope disclosed in the present application shall fall within the protection scope of the present application. [Explanation of symbols]

[0248] 1, 2, 3 Computing Cores 100 Intelligent Driving Devices 110 Perception System 120 Computing Platform 121 processors 200 vehicles 201, 202, 203, 204 Front view camera 205, 206 Side view camera 207, 208, 209, 210 Surround View Camera 211, 212 Rear view camera 213, 214 Millimeter wave radar 215 GPS 216 Gateway 217, 218, 219, 220, 221, 222, 223, 224 Ultrasonic radar 225 Left visual field monitor 226 Right Field of View Monitor 227, 228, 229 Rider 230 Intelligent Driving System 300 Data Processing Methods 500 System state switching method 600 Data processing device 610 Data Processing Unit 620 Decision Unit 2301 Power supply 2302 Intelligent Driving State Machine 2303 MCU 2304 processor A, B, C, D sensor groups S1, S2, S3, S4, S4' system states

Claims

1. determining that the intelligent driving device is in a first driving scenario; acquiring first data from sensors in a first sensor group and processing the first data, wherein the first data is associated with a first frame rate and the first driving scenario is associated with the first frame rate; When the intelligent driving device determines to switch from the first driving scenario to a second driving scenario, acquiring second data from sensors in a second sensor group and processing the second data, or acquiring third data from the sensors in the first sensor group and processing the third data, wherein the third data corresponds to a second frame rate and the second driving scenario is associated with the second frame rate; Including, the second sensor group includes some of the sensors in the first sensor group, and the first frame rate is higher than the second frame rate; Data processing methods.

2. said step of processing said first data further comprising: processing the first data by using a plurality of processing units in a first processor; Including, the step of acquiring second data from sensors in a second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data, processing the second data by using some of the processing devices in the plurality of processing devices, or processing the third data by using some of the processing devices; Including, The method of claim 1.

3. Prior to the step of acquiring second data from sensors in a second sensor group and processing the second data or the step of acquiring third data from sensors in the first sensor group and processing the third data, the method further comprises: determining that the temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, the second preset temperature being greater than the first preset temperature; 3. The method of claim 2, further comprising:

4. The method comprises: stopping data processing using the first processor when it is determined that the temperature of the first processor is equal to or greater than the second preset temperature; 4. The method of claim 3, further comprising:

5. The method comprises: stopping data processing using the first processor when it is determined that the duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than a first preset duration.

4. The method of claim 3, further comprising:

6. The method comprises: When it is determined that the intelligent driving device will switch from the second intelligent driving scenario to the first intelligent driving scenario, acquiring fourth data from the sensors in the first sensor group and processing the fourth data, wherein the fourth data corresponds to the first frame rate.

6. The method of claim 1, further comprising:

7. acquiring first data from sensors in a first sensor group and processing the first data by using a first processor, the first data corresponding to a first frame rate; if the temperature of the first processor is determined to be greater than or equal to a first preset temperature and less than a second preset temperature, acquiring second data from sensors in a second sensor group and processing the second data, or acquiring third data from the sensors in the first sensor group and processing the third data, wherein the third data corresponds to a second frame rate; Including, the first preset temperature is lower than the second preset temperature, the second sensor group includes some of the sensors in the first sensor group, and the first frame rate is higher than the second frame rate; Data processing methods.

8. The first processor comprises a plurality of processing units, and the step of processing the first data by using the first processor comprises: processing the first data by using the plurality of processing devices. Including, the step of acquiring second data from sensors in a second sensor group and processing the second data, or the step of acquiring third data from sensors in the first sensor group and processing the third data, a step of processing the second data by using some of the processing devices in the plurality of processing devices, or a step of processing the third data by using some of the processing devices. Including, The method of claim 7.

9. The method comprises: stopping data processing using the first processor when it is determined that the temperature of the first processor is equal to or greater than the second preset temperature; 9. The method of claim 7 or 8, further comprising:

10. The method comprises: stopping data processing using the first processor when it is determined that the duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than a first preset duration.

9. The method of claim 7 or 8, further comprising:

11. The method comprises: if the temperature of the first processor is determined to be less than or equal to a third preset temperature, acquiring fourth data from the sensors in the first sensor group and processing the fourth data, the fourth data corresponding to the first frame rate. further comprising the first preset temperature is higher than the third preset temperature; 11. The method according to any one of claims 7 to 10.

12. a determining unit configured to determine that the intelligent driving device is in a first driving scenario; a data processing unit configured to acquire first data from sensors in a first sensor group and process the first data, the first data corresponding to a first frame rate, and the first driving scenario being associated with the first frame rate; Equipped with The determining unit is further configured to determine that the intelligent driving device switches from the first driving scenario to a second driving scenario; the data processing unit is further configured to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from the sensors in the first sensor group and process the third data, the third data corresponding to a second frame rate, and the second driving scenario being associated with the second frame rate; the second sensor group includes some of the sensors in the first sensor group, and the first frame rate is higher than the second frame rate; Data processing device.

13. the data processing unit processes the first data by using a plurality of processing units in a first processor; Processing the second data by using some of the processing devices in the plurality of processing devices, or processing the third data by using some of the processing devices. The apparatus of claim 12 configured to:

14. The decision unit: and determining, before the data processing unit processes the second data or the third data, that a temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature, the second preset temperature being greater than the first preset temperature.

14. The apparatus of claim 13.

15. the determining unit is further configured to determine that the temperature of the first processor is greater than or equal to the second preset temperature; the data processing unit is further configured to stop data processing by using the first processor.

15. The apparatus of claim 14.

16. the determining unit is further configured to determine that a duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than the first preset duration; the data processing unit is further configured to stop data processing by using the first processor.

15. The apparatus of claim 14.

17. the determining unit is further configured to determine that the intelligent driving device switches from the second intelligent driving scenario to the first intelligent driving scenario; the data processing unit is configured to acquire fourth data from the sensors in the first sensor group and process the fourth data, the fourth data corresponding to the first frame rate.

17. Apparatus according to any one of claims 12 to 16.

18. a data processing unit configured to acquire first data from sensors in a first sensor group and process the first data, the first data corresponding to a first frame rate; a determining unit configured to determine that a temperature of the first processor is greater than or equal to a first preset temperature and less than a second preset temperature; Equipped with the processing unit is further configured to acquire second data from sensors in a second sensor group and process the second data, or acquire third data from the sensors in the first sensor group and process the third data, the third data corresponding to a second frame rate; the first preset temperature is lower than the second preset temperature, the second sensor group includes a portion of the sensors in the first sensor group, and the first frame rate is higher than the second frame rate; Data processing device.

19. the first processor comprises a plurality of processing units, and the data processing unit comprises: processing the first data using the plurality of processing devices; The second data is processed by using some of the processing devices in the plurality of processing devices, or the third data is processed by using some of the processing devices.

20. The apparatus of claim 18, configured to:

20. the determining unit is further configured to determine that the temperature of the first processor is greater than or equal to the second preset temperature; the data processing unit is further configured to stop data processing by using the first processor.

20. Apparatus according to claim 18 or 19.

21. the determining unit is further configured to determine that a duration during which the temperature of the first processor is equal to or greater than the second preset temperature is equal to or greater than a first preset duration; the data processing unit is further configured to stop data processing by using the first processor.

20. Apparatus according to claim 18 or 19.

22. the determining unit is further configured to determine that the temperature of the first processor is less than or equal to a third preset temperature; the data processing unit is configured to acquire fourth data from the sensors in the first sensor group and process the fourth data, the fourth data corresponding to the first frame rate; the first preset temperature is higher than the third preset temperature; 22. Apparatus according to any one of claims 18 to 21.

23. a memory configured to store a computer program; a processor configured to execute the computer program stored in the memory to enable the device to perform the method of any one of claims 1 to 11; A data processing device comprising:

24. A data processing system comprising a plurality of sensor groups and a computing platform, said computing platform comprising a data processing device according to any one of claims 12 to 23.

25. An intelligent driving device comprising a data processing device according to any one of claims 12 to 23 or a data processing system according to claim 24.

26. 26. The intelligent driving device of claim 25, wherein the intelligent driving device is a vehicle.

27. 12. A computer-readable storage medium storing a computer program that, when executed by a computer, performs the data processing method of any one of claims 1 to 11.

28. A chip, the chip comprising circuitry, the circuitry configured to perform the data processing method of any one of claims 1 to 11.

Images