Automatic driving vehicle-mounted system fault smooth switching method and system and vehicle

By splitting the decision information calculation process into multiple subprocesses and synchronizing the processing of result data, the problem of data inconsistent when the main and backup modules of the autonomous driving vehicle system is solved, and a safer operation of autonomous driving vehicles is achieved.

CN119065342AActive Publication Date: 2024-12-03BYD CO LTD +1
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202310643708.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-03
Estimated Expiration
2043-05-31

Smart Images

  • Figure CN119065342A_ABST
    Figure CN119065342A_ABST
Patent Text Reader

Abstract

The invention provides an automatic driving vehicle-mounted system fault smooth switching method and system and a vehicle. The method comprises the steps that a first processing unit and a second processing unit obtain processing result data of the sub-processes of the first processing unit and the second processing unit respectively according to a plurality of sub-processes with a logic relation in the decision information generation process; the first processing unit and the second processing unit respectively store processing result data of the sub-processes of the first processing unit and the second processing unit as local data blocks, and send the processing result data to the opposite side; the first processing unit and the second processing unit respectively store the received processing result data of the sub-processes of the opposite side as synchronous data blocks; and when a preset main-standby switching condition is met, the first processing unit and the second processing unit perform main-standby switching, and the processing unit originally serving as the standby generates decision information based on the synchronous data block. According to the method, the current decision information can be generated uninterruptedly during main-standby switching, and smooth switching of the automatic driving vehicle-mounted system is achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and more specifically to a method, system and vehicle for smooth fault switching of an autonomous driving vehicle-mounted system. Background Art

[0002] Autonomous driving vehicles, also known as unmanned vehicles, computer-driven vehicles or wheeled mobile robots, are intelligent cars that achieve unmanned driving through computer systems. Autonomous driving vehicles rely on artificial intelligence, visual computing, radar, monitoring devices and global positioning systems to work together to allow computers to automatically operate motor vehicles.

[0003] The vehicle-mounted system, or vehicle-mounted terminal system, is the management and control system of the vehicle, which integrates online monitoring, dispatch management, report management, real-time vehicle condition information management and other functions. The reliability of the autonomous driving vehicle-mounted system directly affects the driving safety of the car.

[0004] At present, the core modules of autonomous driving vehicle systems usually use redundant modules to improve the reliability of the system. When the main module fails, the vehicle control is switched to the backup module, so that the system can continue to work normally. However, when the main and backup modules are switched, the data calculated by the two modules may be inconsistent, resulting in the main and backup modules not being able to switch smoothly, which brings safety risks to autonomous driving vehicles.

[0005] Therefore, how to achieve smooth switching of autonomous driving vehicle systems and ensure the safety of autonomous driving vehicles has become a technical problem that needs to be solved urgently. Summary of the invention

[0006] The present application is proposed in consideration of the above problems. The present application provides a method, system and vehicle for smooth fault switching of an autonomous driving vehicle system, which splits the decision information calculation process into multiple sub-processes and synchronizes the processing result data of each sub-process to the other processing unit, so that the current decision information can be continuously generated during the active-standby switching, making the active-standby switching smoother and ensuring the safety of the autonomous driving vehicle.

[0007] According to one aspect of the present application, a fault smooth switching method for an autonomous driving vehicle system is provided, wherein the autonomous driving vehicle system includes a first processing unit and a second processing unit operating in a master-slave relationship, the first processing unit and the second processing unit are communicatively connected, and are used to generate decision information of the autonomous driving vehicle system based on acquired perception information, respectively. The method includes:

[0008] For a plurality of sub-processes having a logical relationship included in the process of generating the decision information by the first processing unit and the second processing unit, the first processing unit and the second processing unit respectively obtain processing result data of their own sub-processes;

[0009] The first processing unit and the second processing unit respectively save the processing result data of the sub-process of their own as local data blocks, and send the processing result data to each other;

[0010] The first processing unit and the second processing unit respectively save the received processing result data of the sub-process of the other party as a synchronization data block;

[0011] When the preset master-slave switching conditions are met, the first processing unit and the second processing unit perform master-slave switching, and the original backup processing unit generates decision information of the autonomous driving vehicle system based on the synchronization data block.

[0012] In one embodiment of the present application, the processing unit originally used as a backup generates decision information of the autonomous driving vehicle-mounted system based on the synchronization data block, including:

[0013] comparing each of the local data blocks with each of the synchronization data blocks;

[0014] When the data are inconsistent, determining the subprocess corresponding to the synchronization data block and its associated subprocesses according to the execution order corresponding to the logical relationship;

[0015] Based on the synchronization data block, the sub-process corresponding to the synchronization data block and its associated sub-processes are executed to generate the current decision information of the autonomous driving vehicle system.

[0016] In one embodiment of the present application, the active / standby switching condition includes:

[0017] When it is detected that the first processing unit as the main unit fails but the second processing unit as the backup unit does not fail; or

[0018] When it is detected that the second processing unit as the main unit fails and the first processing unit as the backup unit has recovered from the failure; or,

[0019] When it is detected that the second processing unit serving as the main unit has not failed and the first processing unit serving as the backup unit has recovered from the failure.

[0020] In one embodiment of the present application, the fault detection method of the first processing unit or the second processing unit includes:

[0021] Performing a heartbeat detection on the first processing unit or the second processing unit, and obtaining a fault detection result of the first processing unit or the second processing unit based on the heartbeat detection result; or,

[0022] A communication detection is performed on the first processing unit or the second processing unit, and a fault detection result of the first processing unit or the second processing unit is obtained based on the communication detection result.

[0023] In one embodiment of the present application, the master-slave relationship between the first processing unit and the second processing unit is determined by a preset master-slave election strategy, and the master-slave election strategy includes:

[0024] The first processing unit is used as a main processing unit, and the second processing unit is used as a backup processing unit; or,

[0025] The first processing unit and the second processing unit compete for the lock, and the one that grabs the lock serves as the main processing unit, and the one that fails to grab the lock serves as the backup processing unit.

[0026] In one embodiment of the present application, the method further includes:

[0027] Before generating the decision information, the first processing unit and the second processing unit respectively obtain sensor information collected by sensors in real time, and respectively generate perception information based on the sensor information, wherein the sensor includes one or more of an image sensor, a positioning sensor, a light sensor, an infrared sensor, and a radar sensor.

[0028] In one embodiment of the present application, when a preset master-slave switching condition is met, the first processing unit and the second processing unit perform a master-slave switching based on a received switching trigger instruction, and the switching trigger instruction is issued by a control unit for generating a control instruction according to the decision information.

[0029] According to a second aspect of the present application, there is provided an autonomous driving vehicle-mounted system, comprising a first processing unit, a second processing unit and a control unit, wherein the first processing unit, the second processing unit and the control unit are respectively communicatively connected;

[0030] The first processing unit and the second processing unit are configured to operate in a determined active / standby relationship;

[0031] The control unit is used to perform fault detection on the first processing unit and the second processing unit respectively, obtain fault detection results, and generate a switching trigger instruction based on the fault detection results and send it to the first processing unit and the second processing unit;

[0032] The first processing unit and the second processing unit are further configured to perform fault smooth switching based on the switching trigger instruction during operation by using the aforementioned fault smooth switching method.

[0033] In one embodiment of the present application, the control unit is further used to determine the master-slave relationship between the first processing unit and the second processing unit based on a preset master-slave election strategy.

[0034] In one embodiment of the present application, the first processing unit and the second processing unit are further used to respectively obtain sensor information collected by sensors in real time, and the sensors include one or more of image sensors, positioning sensors, light sensors, infrared sensors, and radar sensors.

[0035] In one embodiment of the present application, the control unit includes:

[0036] a heartbeat detection module, configured to perform heartbeat detection on the first processing unit and the second processing unit respectively, and obtain fault detection results of the first processing unit and the second processing unit based on the heartbeat detection results; or

[0037] The communication detection module is used to perform communication detection on the first processing unit and the second processing unit respectively, and obtain fault detection results of the first processing unit and the second processing unit based on the communication detection results.

[0038] In one embodiment of the present application, the control unit includes a switching trigger instruction generation module, and the switching trigger instruction generation module is used to:

[0039] When the fault detection result is that the first processing unit as the main unit fails but the first processing unit as the backup unit does not fail, a switching trigger instruction is generated; or,

[0040] When the fault detection result is that the second processing unit as the main unit fails and the first processing unit as the backup unit has recovered from the failure, generating a switching trigger instruction; or,

[0041] When the fault detection result is that the second processing unit serving as the main unit has not failed and the first processing unit serving as the backup unit has recovered from the failure, a switching trigger instruction is generated.

[0042] In one embodiment of the present application, the control unit includes a first controller and a second controller operating in a master-slave relationship.

[0043] In one embodiment of the present application, the autonomous driving vehicle system also includes an Ethernet switch, and the first processing unit, the second processing unit, the first controller, and the second controller are respectively connected to the Ethernet switch.

[0044] In one embodiment of the present application, the autonomous driving vehicle system includes a first temperature sensor and a first positioning sensor connected to the first controller, and a second temperature sensor and a second positioning sensor connected to the second controller.

[0045] According to a third aspect of the present application, a vehicle is provided, characterized in that the vehicle includes the above-mentioned autonomous driving vehicle-mounted system.

[0046] The present application splits the decision information calculation process into multiple sub-processes and synchronizes the processing result data of each sub-process to the other processing unit, so that the current decision information can be continuously generated during the primary-standby switching, making the primary-standby switching smoother, and the calculation result of the standby processing unit is close to the calculation result of the already abnormal primary processing unit. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The above and other purposes, features and advantages of the present invention will become more apparent by describing the embodiments of the present invention in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0048] Figure 1 is a schematic block diagram of an autonomous driving vehicle system according to an embodiment of the present application;

[0049] Figure 2 is a schematic flow chart of a fault smooth switching method of an autonomous driving vehicle-mounted system according to an embodiment of the present application;

[0050] Figure 3 is a schematic flowchart of a method for a backup processing unit to generate decision information of an autonomous driving vehicle-mounted system based on a synchronization data block according to an embodiment of the present application;

[0051] Figure 4 is a schematic block diagram of an autonomous driving vehicle system according to another embodiment of the present application;

[0052] Figure 5 is a schematic block diagram of an autonomous driving vehicle-mounted system according to a first embodiment of the present application;

[0053] Figure 6 It is a schematic flowchart of a fault smooth switching method for an autonomous driving vehicle-mounted system according to the second embodiment of the present application. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical scheme and advantages of the present invention more obvious, the exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments of the present invention, and it should be understood that the present invention is not limited to the exemplary embodiments described herein. Based on the embodiments of the present invention described in the present invention, all other embodiments obtained by those skilled in the art without creative work should fall within the protection scope of the present invention.

[0055] Since the core modules of the current autonomous driving vehicle system usually use redundant modules to improve the reliability of the system, when the main and backup modules are switched, the data calculated by the two modules may be inconsistent, resulting in the main and backup modules not being able to switch smoothly, which brings safety hazards to the autonomous driving vehicle. Based on this, the present application proposes a fault smooth switching method, system and vehicle for an autonomous driving vehicle system.

[0056] First, refer to Figure 1 To describe the autonomous driving vehicle system 100 for implementing an embodiment of the present invention.

[0057] like Figure 1 As shown, the autonomous driving vehicle system 100 includes a first processor 111, a second processor 112, a memory 120, and a communication interface 130 running in a master-slave relationship. The memory 120, the first processor 111, the second processor 112, and the communication interface 130 can communicate through a communication bus 140.

[0058] Optionally, the communication interface 130 may also include a transmitter and / or a receiver.

[0059] The first processor 111 and the second processor 112 can be a microcontroller unit (MCU), a central processing unit (CPU), a digital signal processor (DSP), a single-chip microcomputer and an embedded device, or other forms of processing units with data processing capabilities and / or instruction execution capabilities, and can control other components in the autonomous driving vehicle system to perform desired functions.

[0060] The memory 120 may be a computer-readable storage medium in various forms, such as a volatile memory and / or a non-volatile memory. The volatile memory may include, for example, a random access memory (RAM), a cache memory (cache), a synchronous dynamic random access memory (SDRAM), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory (Flash), etc. One or more computer program instructions may also be stored on the computer-readable storage medium, and the memory 120 may run the program instructions to implement the fault smoothing switching method in the embodiment of the present invention described below.

[0061] Next, refer to Figure 2 To describe the fault smooth switching method of the autonomous driving vehicle system according to an embodiment of the present application.

[0062] like Figure 2 As shown, the fault smooth switching method provided by the present application includes:

[0063] In step S210, for the first processing unit and the second processing unit, a plurality of sub-processes having a logical relationship included in the process of generating the decision information, the first processing unit and the second processing unit respectively obtain processing result data of their own sub-processes.

[0064] In the process of generating the decision information, the first processing unit and the second processing unit respectively split the generation process of the decision information into a plurality of sub-processes with logical relationships according to the same preset splitting strategy. The first processing unit and the second processing unit are primary and secondary, so the programs running therein are the same, and accordingly, the sub-processes finally obtained by the two are also the same.

[0065] Here, the first processing unit and the second processing unit may be two general or dedicated processors provided on the autonomous driving vehicle, or may be an electronic control unit (ECU).

[0066] Specifically, the perception information may include: environmental information around the autonomous driving vehicle. The environmental information includes dynamic objects and / or static objects, specifically, the appearance, shape and / or position of dynamic objects, and the appearance, shape and / or position of static objects. Dynamic objects include pedestrians, motor vehicles or non-motor vehicles; static objects include curbs, trees, road signs, lanes or other obstacles.

[0067] The perception information can be obtained by processing the sensor information collected by the sensor, or it can be obtained through vehicle to everything (V2X), vehicle to vehicle (V2V), and vehicle to infrastructure (V2I). The embodiments of the present application do not specifically limit the method for obtaining the perception information.

[0068] When the perception information is obtained by processing the sensor information collected by the sensor, the fault smooth switching method provided in the present application can also be applied to the entire process of generating decision information based on the sensor information.

[0069] For example, during the autonomous driving process, sensor information can be collected through on-board sensors and sent to the ECU. The ECU uses a preset algorithm to process the information to obtain perception information, and generates decision information for the autonomous driving vehicle system based on the acquired perception information. It also generates control instructions based on the decision results, and then completes autonomous driving based on the control instructions.

[0070] The method for generating decision information of the autonomous driving vehicle system based on the acquired perception information can be flexibly set by those skilled in the art according to actual needs, and this application does not make specific limitations. The process of generating decision information is also the process of processing data according to logical relationships by the program. The various steps of program processing can be divided into multiple sub-processes according to the same preset splitting strategy. The multiple sub-processes here can specifically be multiple sub-processes with certain logical relationships during program operation. The logical relationship can be determined based on the algorithm and splitting strategy of the program. For example, the logical relationship can be a sequential relationship, a parallel relationship, or a nested loop relationship. The embodiment of this application does not make specific limitations on the logical relationship.

[0071] In step S220, the first processing unit and the second processing unit respectively save the processing result data of their own sub-processes as local data blocks, and send the processing result data to each other.

[0072] It should be understood that the storage medium of the first processing unit and the second processing unit may store the local data block, and when the first processing unit and the second processing unit save the processing result data as a local data block, it may be saved in a volatile memory or a non-volatile memory.

[0073] In step S230, the first processing unit and the second processing unit respectively save the received processing result data of the sub-process of the other party as a synchronization data block.

[0074] When the first processing unit and the second processing unit save the received processing result data as a synchronization data block, they can be saved in a volatile memory or a non-volatile memory, and can be saved in the same memory as the local data block or in a different memory.

[0075] It should be noted that when the first processing unit and the second processing unit send the processing result data, they can send the processing result data of the current sub-process, the processing result data of all previous sub-processes, or the processing result data of the most recent two or more sub-processes.

[0076] In step S240, when the preset master-slave switching conditions are met, the first processing unit and the second processing unit perform master-slave switching, and the original backup processing unit generates decision information of the autonomous driving vehicle system based on the synchronization data block.

[0077] Specifically, the active-standby switching condition may be whether the working state of the current active processing unit is normal. For example, by obtaining the working states of the current active processing unit and the standby processing unit in real time, it is determined whether the current active processing unit is in a normal operating state, and it is also possible to determine whether the standby processing unit is in a normal operating state. When it is detected that the working state of the active processing unit is in an abnormal state, it is determined that the active processing unit meets the active-standby switching condition.

[0078] After the first processing unit and the second processing unit perform the master-slave switching, the original backup processing unit will generate decision information as the main processing unit. At this time, it generates the decision information of the autonomous driving vehicle system based on the synchronization data block.

[0079] By splitting the decision information calculation process into multiple sub-processes and synchronizing the processing result data of each sub-process to the other processing unit, the current decision information can be continuously generated during the active-standby switching, making the active-standby switching smoother, and the calculation result of the standby processing unit is close to the calculation result of the already abnormal active processing unit.

[0080] Figure 3 is a schematic block diagram of a method for generating decision information of an autonomous driving vehicle-mounted system based on a synchronization data block by a backup processing unit according to an embodiment of the present application, such as Figure 3 As shown, according to one embodiment of the present application, the processing unit originally used as a backup generates decision information of the autonomous driving vehicle-mounted system based on the synchronization data block, including:

[0081] S310, comparing each local data block with each synchronization data block;

[0082] S320, when the data is inconsistent, determining the sub-process corresponding to the synchronization data block and its associated sub-processes according to the execution order corresponding to the logical relationship;

[0083] S330. Based on the synchronization data block, execute the sub-process corresponding to the synchronization data block and its associated sub-processes to generate the current decision information of the autonomous driving vehicle system.

[0084] It can be understood that when the data is consistent, the current decision information of the autonomous driving vehicle system can be generated based on the local data block or the synchronized data block.

[0085] Specifically, since the process of generating decision information is divided into multiple sub-processes, when the data is inconsistent, starting from the sub-process corresponding to the inconsistent data block, the corresponding sub-process is executed in the execution order corresponding to the logical relationship, and the decision information is generated based on the synchronous data block calculation. Exemplarily, when multiple data blocks are inconsistent, the decision information is calculated starting from the sub-process corresponding to the earliest generated data block in the execution order corresponding to the logical relationship.

[0086] When the data is inconsistent, the current decision information of the autonomous driving vehicle system is generated by starting the calculation from the sub-process corresponding to the inconsistent data block, so that the generation of decision information remains more continuous in time.

[0087] According to an embodiment of the present application, the active / standby switching condition includes:

[0088] When it is detected that the first processing unit as the main unit fails but the second processing unit as the backup unit does not fail; or

[0089] When it is detected that the second processing unit as the main unit fails and the first processing unit as the backup unit has recovered from the failure; or,

[0090] When it is detected that the second processing unit serving as the main unit has not failed and the first processing unit serving as the backup unit has recovered from the failure.

[0091] When it is detected that the second processing unit as the main unit has failed and the first processing unit as the backup has recovered from the failure, the switch is performed, that is, logically the second processing unit is a backup machine, so it is easier to troubleshoot when a problem occurs. When it is detected that the second processing unit as the main unit has not failed and the first processing unit as the backup has recovered from the failure, the switch is performed, which can reduce the number of switches.

[0092] It should be noted that in the above master-slave switching conditions, the first processing unit is assumed to be the master processing unit and the second processing unit is assumed to be the backup processing unit; in a specific implementation, the second processing unit can also be the master processing unit and the first processing unit can be the backup processing unit. This application does not limit the master processing unit and the backup processing unit. The master processing unit and the backup processing unit can be determined according to the master-slave election method preset by the system when the system starts running. The master-slave election method preset by the system can adopt the existing method, which will not be elaborated here.

[0093] According to an embodiment of the present application, the master-slave relationship between the first processing unit and the second processing unit may also be determined by a preset master-slave election strategy, and the master-slave election strategy may be to use the first processing unit as the master processing unit and the second processing unit as the backup processing unit.

[0094] According to another embodiment of the present application, the first processing unit and the second processing unit compete for the lock, and the one that grabs the lock serves as the main processing unit, and the one that fails to grab the lock serves as the backup processing unit.

[0095] According to one embodiment of the present application, the fault detection method of the first processing unit or the second processing unit includes:

[0096] Perform a heartbeat detection on the first processing unit or the second processing unit, and obtain a fault detection result of the first processing unit or the second processing unit based on the heartbeat detection result.

[0097] According to another embodiment of the present application, the fault detection method of the first processing unit or the second processing unit includes: performing communication detection on the first processing unit or the second processing unit, and obtaining a fault detection result of the first processing unit or the second processing unit based on the communication detection result.

[0098] The following specifically describes the process of heartbeat detection and communication detection by taking the first processing unit as an example.

[0099] Detecting the heartbeat information sent by the first processing unit, and if the heartbeat information sent by the first processing unit is received within the preset time threshold, determining that the first processing unit has not failed;

[0100] If the heartbeat information sent by the first processing unit is not received within a preset time threshold, it is determined that a failure occurs in the first processing unit.

[0101] A communication detection is performed on the first processing unit. If the first processing unit can communicate with the network, it is determined that the first processing unit has not failed. Otherwise, it is determined that the first processing unit has failed.

[0102] The communication detection performed on the first processing unit or the second processing unit may be an Internet Packet Groper (ping) test or a remote login (telnet) test.

[0103] According to one embodiment of the present application, the method further includes:

[0104] Before generating the decision information, the first processing unit and the second processing unit respectively obtain sensor information collected by sensors in real time, and respectively generate perception information based on the sensor information.

[0105] Sensors may include image sensors, radar sensors, positioning sensors, wind speed sensors, light sensors, infrared sensors, and the like. Image sensors, such as vehicle forward cameras, vehicle side cameras, and vehicle rear cameras, the environmental information collected by the camera is image data within the camera's field of view. Radar sensors, such as ultrasonic radars, millimeter wave radars, laser radars, and the like, may also be other types of radar sensors, which are not specifically limited here. The positioning sensor may be a global positioning system (GPS), a global navigation satellite system (GNSS), or an inertial navigation system (INS), and the like. The environmental information collected by the positioning sensor is the vehicle's location information, the environmental information collected by the wind speed sensor is wind speed, wind direction, and the like, and the environmental information collected by the light sensor is light intensity.

[0106] According to one embodiment of the present application, when a preset master-slave switching condition is met, the first processing unit and the second processing unit perform a master-slave switching based on a received switching trigger instruction, and the switching trigger instruction is issued by a control unit for generating a control instruction based on the decision information.

[0107] Next, refer to Figure 4 To describe the autonomous driving vehicle system according to an embodiment of the present application.

[0108] like Figure 4 As shown, the autonomous driving vehicle system 400 includes a first processing unit 410, a second processing unit 420 and a control unit 430, and the first processing unit 410, the second processing unit 420 and the control unit 430 are respectively connected in communication;

[0109] The first processing unit 410 and the second processing unit 420 are configured to operate in a determined primary-backup relationship;

[0110] The control unit 430 is used to perform fault detection on the first processing unit 410 and the second processing unit 420 respectively to obtain a fault detection result, and based on the fault detection result, generate a switching trigger instruction and send it to the first processing unit 410 and the second processing unit 420;

[0111] The first processing unit 410 and the second processing unit 420 are further configured to perform fault smooth switching based on the switching trigger instruction during operation by using the fault smooth switching method as described above according to any one of the embodiments of the present application.

[0112] The control unit 430 in the autonomous driving vehicle system 400 may be a general purpose processor, a microcontroller unit (MCU), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a digital signal processor (DSP) or a combination thereof. The above-mentioned PLD may be a complex programmable logic device (CPLD), a field programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof, which is not specifically limited in the embodiments of the present application.

[0113] In the above implementation process, the first processing unit and the second processing unit split the decision information calculation process into multiple sub-processes, and synchronize the processing result data of each sub-process to the other processing unit, so that the current decision information can be continuously generated during the active-standby switching, making the active-standby switching smoother, and the calculation result of the standby processing unit is close to the calculation result of the already abnormal active processing unit.

[0114] According to an embodiment of the present application, the control unit is further used to determine the master-slave relationship between the first processing unit and the second processing unit based on a preset master-slave election strategy. The master-slave election strategy can be to use the first processing unit as the master processing unit and the second processing unit as the backup processing unit; or, the first processing unit and the second processing unit compete for the lock, and the one that grabs the lock is used as the master processing unit, and the one that fails to grab the lock is used as the backup processing unit.

[0115] According to one embodiment of the present application, the first processing unit and the second processing unit are also used to respectively obtain sensor information collected by sensors in real time, and the sensors include one or more of image sensors, positioning sensors, light sensors, infrared sensors, and radar sensors.

[0116] Sensors may include image sensors, radar sensors, positioning sensors, wind speed sensors, light sensors, infrared sensors, etc. Image sensors, such as vehicle-mounted cameras, are used to identify environmental information such as pedestrians, bicycles, motor vehicles, road trajectories, road signs, traffic lights, etc. Radar sensors, such as ultrasonic radars, millimeter-wave radars, and laser radars, are used to detect and locate objects.

[0117] It should be noted that the sensor may also be other types of sensors, which are not specifically limited here.

[0118] According to one embodiment of the present application, the control unit includes:

[0119] a heartbeat detection module, configured to perform heartbeat detection on the first processing unit and the second processing unit respectively, and obtain fault detection results of the first processing unit and the second processing unit based on the heartbeat detection results; or

[0120] The communication detection module is used to perform communication detection on the first processing unit and the second processing unit respectively, and obtain fault detection results of the first processing unit and the second processing unit based on the communication detection results.

[0121] According to an embodiment of the present application, the control unit includes a switching trigger instruction generation module, and the switching trigger instruction generation module is used to:

[0122] When the fault detection result is that the first processing unit as the main unit fails but the first processing unit as the backup unit does not fail, a switching trigger instruction is generated; or,

[0123] When the fault detection result is that the second processing unit as the main unit fails and the first processing unit as the backup unit has recovered from the failure, generating a switching trigger instruction; or,

[0124] When the fault detection result is that the second processing unit serving as the main unit has not failed and the first processing unit serving as the backup unit has recovered from the failure, a switching trigger instruction is generated.

[0125] Next, refer to Figure 5 To describe the autonomous driving vehicle system according to the first embodiment of the present application.

[0126] In this embodiment, the processing unit adopts a system on chip (SoC), and the controller adopts a microcontroller unit (MCU). Specifically, the SoC is set by an advanced RISC Machine (ARM). The autonomous driving vehicle system includes a first SoC521, a second SoC522, a first MCU541 and a second MCU542. The first SoC521 and the second SoC522 are connected to the first MCU541 and the second MCU542 which are mutually active and standby.

[0127] When a SoC module fails, another SoC module can continue to work, improving the reliability of the SoC.

[0128] When an MCU module fails, another MCU module can continue to work, improving the reliability of the MCU.

[0129] The vehicle camera 511, millimeter wave radar 512, ultrasonic radar 513, and laser radar 514 are connected to the first SoC 521 and the second SoC 522 to collect sensor data, and these sensor data are sent to the first SoC 521 and the second SoC 522 for dual-channel collection. The first SoC 521 is connected to the first SDRAM 523 and the first Flash 524 to form a minimum operating unit for processing sensor data and calculating decision information and running other programs. The second SoC 522 is connected to the second SDRAM 525 and the second Flash 526. The first SoC521 and the second SoC522 constitute the master and standby of the SoC and are connected to the Ethernet switch chip 531. The Ethernet switch chip 531 is connected to the vehicle Ethernet and is also connected to the first MCU541 and the second MCU542. The first MCU541 is connected to the first GPS / IMU543 and the first temperature sensor 544. The second MCU542 is connected to the second GPS / IMU545 and the second temperature sensor 546. The first MCU541 and the second MCU542 constitute the master and standby of the SoC and are respectively connected to the controller area network bus (Controller Area Network, CAN) 552 and the debugging interface 543. Figure 5 As can be seen from the architecture diagram, the SoC consists of two pieces that serve as the primary and backup for each other, the MCU, GPS / IMU543, and the temperature sensor are all two pieces that also serve as the primary and backup. They are redundant in hardware and can improve the reliability of the SoC and MCU.

[0130] It should be noted that Figure 5 The composition and structure of the autonomous driving vehicle system shown are merely exemplary and non-restrictive. The autonomous driving vehicle system may also have other component modules and structures as needed.

[0131] The MCU interacts with the first SoC 521 and the second SoC 522 internally through the Ethernet switch chip, and the global positioning system (GPS), inertial measurement unit (IMU), temperature sensor, etc. interact with the MCU. In terms of external interfaces, the MCU leads to a debugging interface and a vehicle control CAN interface. The debugging interface is mainly responsible for the debugging of the board, and the CAN interface realizes the control function of the vehicle.

[0132] SoC receives sensor information from onboard cameras, millimeter-wave radars, ultrasonic radars, and lidars, performs perception information calculations to obtain perception decision information, and sends the decision information to the MCU. The perception information decision calculation must be split into multiple sub-processes, and the end of each sub-process is taken as a node. Each node stores the data generated by the calculation and sends it to another SoC.

[0133] The MCU is responsible for fault detection and master-slave election of the two SoCs. When the master fails, the master-slave switch is triggered, and the backup SoC is notified to compare the data calculated by each node with the synchronized data. If there is any inconsistency, the synchronized data shall prevail and the decision information shall be recalculated. The MCU generates control instructions based on the received decision information and sends them to the corresponding actuator.

[0134] This embodiment solves the unevenness problem caused by the active-standby switching of SoC by dividing the decision information calculation process of the main module and the standby module into multiple sub-processes and synchronizing the calculation data of each node to the opposite node.

[0135] The above-mentioned automatic driving system is set on the automatic driving car. Next, refer to Figure 6 To describe the fault smooth switching method of the autonomous driving vehicle system according to the second embodiment of the present application.

[0136] The specific steps of the fault smooth switching method include:

[0137] Step S501: The master MCU determines the master-slave relationship between the first SoC and the second SoC based on a preset master-slave election strategy.

[0138] The method for determining the master-slave relationship between the first MCU and the second MCU may adopt an existing method, which will not be described in detail here.

[0139] Step S502: The first SoC and the second SoC respectively receive sensor data sent by the vehicle-mounted sensor.

[0140] Specifically, sensor data includes data collected by vehicle-mounted cameras, millimeter-wave radars, ultrasonic radars, and lidars.

[0141] In this step, the onboard sensors of the autonomous driving vehicle collect sensor data and send it to the ARMs of the first SoC and the second SoC. Correspondingly, the ARMs of the first SoC and the second SoC receive the sensor data.

[0142] Step S503: The first SoC and the second SoC divide the calculation process of the decision information into sub-process 1 to sub-process N;

[0143] In this step, the SoC decision information calculation process is divided into multiple calculation sub-processes. In the subsequent decision information calculation process, the calculation results will be saved when the sub-process results are finally generated in each sub-process; at the same time, the saved data will be sent to another SoC.

[0144] Step S504: ARBs of the first SoC and the second SoC calculate decision information of the autonomous driving vehicle system using a preset algorithm based on the acquired sensor data; during this process, the first SoC and the second SoC save the processing result data of each sub-process as a local data block respectively, and send the processing result data to each other;

[0145] Step S505: the first SoC and the second SoC save the received processing result data as a synchronization data block respectively;

[0146] These node data are used to restore the on-site data of the active-standby switch. When the active-standby switch occurs, the standby machine will use the synchronized node data to overwrite the local calculation data and recalculate. In this way, the decision information generated after the switch is closer to the decision information before the active-standby switch, so the active-standby switch is smoother.

[0147] Step S506: During the operation of the first SoC and the second SoC, the active MCU performs fault detection on the active SoC, and when a fault is detected, issues an active-standby switching instruction.

[0148] For example, the decision information calculation programs of the first SoC and the second SoC send heartbeats to the MCU respectively. If the heartbeat is interrupted, it is considered that the SoC is faulty.

[0149] Step S507: When a failure occurs in the main SoC, the first SoC and the second SoC perform a master-slave switch, and the original backup SoC generates decision information of the autonomous driving vehicle system based on the synchronization data block.

[0150] Step S508: SoC sends the decision information to MCU.

[0151] Step S509: After receiving the decision information, the main MCU generates a control instruction according to the decision information and sends it to the corresponding execution mechanism, so that the control mechanism performs automatic driving according to the control execution.

[0152] Specifically, the MCU will generate control instructions based on the decision information produced by the SoC and send them to the CAN or send them to the SoC through the Scalable service-oriented middleware over IP (SOME / IP) protocol, the integrated circuit bus (Inter-Integrated Circuit, IIC), etc.

[0153] In the above implementation process, the first SoC and the second SoC split the decision information calculation process into multiple sub-processes and synchronize multi-node data to each other, so that the current decision information can be continuously generated during the active-standby switching, making the active-standby switching smoother.

[0154] An embodiment of the present application also provides a vehicle, which includes the above-mentioned autonomous driving vehicle-mounted system.

[0155] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely exemplary and are not intended to limit the scope of the present invention thereto. Various changes and modifications may be made therein by one of ordinary skill in the art without departing from the scope and spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as required by the appended claims.

[0156] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0157] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.

[0158] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0159] Similarly, it should be understood that in order to streamline the present invention and help understand one or more of the various inventive aspects, in the description of the exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, the method of the present invention should not be interpreted as reflecting the following intention: the claimed invention requires more features than the features explicitly stated in each claim. More specifically, as reflected in the corresponding claims, the inventive point is that the corresponding technical problem can be solved with less than all the features of a single disclosed embodiment. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present invention.

[0160] It will be understood by those skilled in the art that, except for mutually exclusive features, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this specification may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature that provides the same, equivalent or similar purpose.

[0161] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims, any one of the claimed embodiments may be used in any combination.

[0162] The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the functions of some modules in the article analysis device according to an embodiment of the present invention. The present invention may also be implemented as a device program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0163] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc., does not indicate any order. These words may be interpreted as names.

[0164] The above is only a specific embodiment of the present invention or an explanation of a specific embodiment. The protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. The protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A fault smooth switching method for an autonomous driving vehicle system, characterized in that: The autonomous driving vehicle-mounted system includes a first processing unit and a second processing unit operating in a master-slave relationship, the first processing unit and the second processing unit being communicatively connected and configured to generate decision information of the autonomous driving vehicle-mounted system based on acquired perception information, respectively. The method includes: For a plurality of sub-processes having a logical relationship included in the process of generating the decision information by the first processing unit and the second processing unit, the first processing unit and the second processing unit respectively obtain processing result data of their own sub-processes; The first processing unit and the second processing unit respectively save the processing result data of the sub-process of their own as local data blocks, and send the processing result data to each other; The first processing unit and the second processing unit respectively save the received processing result data of the sub-process of the other party as a synchronization data block; When the preset master-slave switching conditions are met, the first processing unit and the second processing unit perform master-slave switching, and the original backup processing unit generates decision information of the autonomous driving vehicle system based on the synchronization data block.

2. The fault smooth switching method according to claim 1, characterized in that: The processing unit used as a backup generates decision information of the automatic driving vehicle system based on the synchronization data block, including: comparing each of the local data blocks with each of the synchronization data blocks; When the data are inconsistent, determining the subprocess corresponding to the synchronization data block and its associated subprocesses according to the execution order corresponding to the logical relationship; Based on the synchronization data block, the sub-process corresponding to the synchronization data block and its associated sub-processes are executed to generate the current decision information of the autonomous driving vehicle system.

3. The fault smooth switching method according to any one of claims 1 to 2, characterized in that: The master-slave switching conditions include: When it is detected that the first processing unit as the main unit fails but the second processing unit as the backup unit does not fail; or When it is detected that the second processing unit as the main unit fails and the first processing unit as the backup unit has recovered from the failure; or, When it is detected that the second processing unit serving as the main unit has not failed and the first processing unit serving as the backup unit has recovered from the failure.

4. The fault smooth switching method according to claim 3, characterized in that: The fault detection method of the first processing unit or the second processing unit includes: Performing a heartbeat detection on the first processing unit or the second processing unit, and obtaining a fault detection result of the first processing unit or the second processing unit based on the heartbeat detection result; or, A communication detection is performed on the first processing unit or the second processing unit, and a fault detection result of the first processing unit or the second processing unit is obtained based on the communication detection result.

5. The fault smooth switching method according to any one of claims 1 to 4, characterized in that: The master-slave relationship between the first processing unit and the second processing unit is determined by a preset master-slave election strategy, and the master-slave election strategy includes: The first processing unit is used as a main processing unit, and the second processing unit is used as a backup processing unit; or, The first processing unit and the second processing unit compete for the lock, and the one that grabs the lock serves as the main processing unit, and the one that fails to grab the lock serves as the backup processing unit.

6. The fault smooth switching method according to any one of claims 1 to 5, characterized in that: The method further includes: Before generating the decision information, the first processing unit and the second processing unit respectively obtain sensor information collected by sensors in real time, and respectively generate perception information based on the sensor information, wherein the sensor includes one or more of an image sensor, a positioning sensor, a light sensor, an infrared sensor, and a radar sensor.

7. The fault smooth switching method according to any one of claims 1 to 6, characterized in that: When a preset active-standby switching condition is met, the first processing unit and the second processing unit perform active-standby switching based on a received switching trigger instruction, where the switching trigger instruction is issued by a control unit for generating a control instruction according to the decision information.

8. An automatic driving vehicle system, characterized in that: It comprises a first processing unit, a second processing unit and a control unit, wherein the first processing unit, the second processing unit and the control unit are respectively connected in communication; The first processing unit and the second processing unit are configured to operate in a determined active / standby relationship; The control unit is used to perform fault detection on the first processing unit and the second processing unit respectively, obtain fault detection results, and generate a switching trigger instruction based on the fault detection results and send it to the first processing unit and the second processing unit; The first processing unit and the second processing unit are further configured to perform fault smooth switching based on the switching trigger instruction during operation by using the fault smooth switching method described in any one of claims 1 to 7.

9. The automatic driving vehicle system according to claim 8, characterized in that: The control unit is further used to determine the master-slave relationship between the first processing unit and the second processing unit based on a preset master-slave election strategy.

10. The automatic driving vehicle-mounted system according to any one of claims 8 to 9, characterized in that: The first processing unit and the second processing unit are further used to respectively obtain sensor information collected by sensors in real time, and the sensors include one or more of image sensors, positioning sensors, light sensors, infrared sensors, and radar sensors.

11. The automatic driving vehicle system according to any one of claims 8 to 10, characterized in that: The control unit comprises: a heartbeat detection module, configured to perform heartbeat detection on the first processing unit and the second processing unit respectively, and obtain fault detection results of the first processing unit and the second processing unit based on the heartbeat detection results; or The communication detection module is used to perform communication detection on the first processing unit and the second processing unit respectively, and obtain fault detection results of the first processing unit and the second processing unit based on the communication detection results.

12. The automatic driving vehicle-mounted system according to any one of claims 8 to 11, characterized in that: The control unit includes a switching trigger instruction generation module, and the switching trigger instruction generation module is used to: When the fault detection result is that the first processing unit as the main unit fails but the first processing unit as the backup unit does not fail, a switching trigger instruction is generated; or, When the fault detection result is that the second processing unit as the main unit fails and the first processing unit as the backup unit has recovered from the failure, generating a switching trigger instruction; or, When the fault detection result is that the second processing unit serving as the main unit has not failed and the first processing unit serving as the backup unit has recovered from the failure, a switching trigger instruction is generated.

13. The automatic driving vehicle-mounted system according to any one of claims 8 to 12, characterized in that: The control unit includes a first controller and a second controller operating in a master-slave relationship.

14. The automatic driving vehicle system according to claim 13, characterized in that: The autonomous driving vehicle system also includes an Ethernet switch, and the first processing unit, the second processing unit, the first controller, and the second controller are respectively connected to the Ethernet switch.

15. The automatic driving vehicle-mounted system according to any one of claims 8 to 14, characterized in that: The autonomous driving vehicle system includes a first temperature sensor and a first positioning sensor connected to the first controller, and a second temperature sensor and a second positioning sensor connected to the second controller.

16. A vehicle, characterized in that: The vehicle includes the autonomous driving on-board system according to any one of claims 8-15.

Citation Information

Patent Citations

  • Control apparatus and recovery processing method for control apparatus

    CN108885575A

  • Automatic driving system

    CN111665849A

  • High-speed railway dispatching centralized autonomous machine system capable of synchronizing main and standby data in real time

    CN112238881A

  • Data synchronization method and device of redundant structure, equipment and storage medium

    CN115981879A

  • Method for operating a redundant automation system

    EP3971662A1