Autonomous driving system and autonomous driving control method, device, vehicle and equipment

Abstract

The present disclosure relates to the field of automatic driving, and proposes an automatic driving system, an automatic driving control method and device, a vehicle and equipment. The automatic driving system comprises an intelligent driving domain controller (ADD), an intelligent cockpit domain controller (DCD), and a camera assembly electrically connected to the ADD. The camera assembly is configured to collect an initial cockpit image and provide the initial cockpit image to the intelligent driving domain controller (ADD) and the intelligent cockpit domain controller (DCD) respectively. The intelligent driving domain controller (ADD) is configured to receive the initial cockpit image from the camera assembly and output an image processing result. The intelligent cockpit domain controller (DCD) is configured to output an image recognition result. The image processing result and the image recognition result are used together for automatic driving control. The present disclosure can effectively balance the efficiency requirement and the safety requirement of driving behavior of automatic driving, effectively improve the efficiency of automatic driving control, and enhance driving safety.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of automatic driving, in particular to an automatic driving system, an automatic driving control method and device, a vehicle and equipment. BACKGROUND

[0002] With the development of intelligent vehicles, in the automatic driving system deployed in the vehicle, the driver monitoring system (DMS) plays an important role. The DMS system can realize safety detection functions such as line-of-sight detection, in-position detection, fatigue detection, distraction detection, and dangerous behavior detection on the driver. The driver monitoring system DMS can also realize the face identity document (Face ID) function.

[0003] In the related art, the camera module in the DMS system is used for automatic driving control.

[0004] In this way, the automatic driving control process cannot effectively balance the automatic driving efficiency requirement and the driving behavior safety requirement. SUMMARY

[0005] The present disclosure aims to at least partially solve one of the technical problems in the related art.

[0006] To this end, the purpose of the present disclosure is to propose an automatic driving system, an automatic driving control method and device, a vehicle and equipment, which can effectively balance the automatic driving efficiency requirement and the driving behavior safety requirement, effectively improve the efficiency of automatic driving control, and enhance driving safety.

[0007] An automatic driving system is provided in a first aspect of the present disclosure, comprising: an intelligent driving domain controller ADD, an intelligent cockpit domain controller DCD, and a camera assembly electrically connected to the ADD, wherein the camera assembly is configured to capture an initial cockpit image and provide the initial cockpit image to the intelligent driving domain controller ADD and the intelligent cockpit domain controller DCD respectively; the intelligent driving domain controller ADD is configured to receive the initial cockpit image from the camera assembly and output an image processing result; and the intelligent cockpit domain controller DCD is configured to output an image recognition result, wherein the image processing result and the image recognition result are used together for automatic driving control.

[0008] The first aspect embodiment of the present disclosure provides an automatic driving system. The initial cockpit image is provided to the autonomous driving domain controller (ADD) and the digital cockpit domain controller (DCD) respectively, the initial cockpit image is received from the camera assembly by the autonomous driving domain controller ADD, and the image processing result is output, the image recognition result is output by the digital cockpit domain controller DCD, the efficiency requirement and the safety requirement of the driving behavior of the automatic driving efficiency can be effectively considered, the efficiency of the automatic driving control is improved, and the driving safety is enhanced.

[0009] The second aspect embodiment of the present disclosure provides an automatic driving control method. The initial cockpit image is collected, and the initial cockpit image is provided to the autonomous driving domain controller ADD and the digital cockpit domain controller DCD respectively. The autonomous driving domain controller ADD receives the initial cockpit image and outputs the image processing result. The digital cockpit domain controller DCD outputs the image recognition result. The image processing result and the image recognition result are used for automatic driving control.

[0010] The automatic driving control method provided by the second aspect embodiment of the present disclosure collects the initial cockpit image, and provides the initial cockpit image to the autonomous driving domain controller ADD and the digital cockpit domain controller DCD respectively. Then, the autonomous driving domain controller ADD receives the initial cockpit image and outputs the image processing result, and the digital cockpit domain controller DCD outputs the image recognition result. The image processing result and the image recognition result are used for automatic driving control. The autonomous driving domain controller ADD receives the initial cockpit image and outputs the image processing result, and the digital cockpit domain controller DCD outputs the image recognition result. The efficiency requirement and the safety requirement of the driving behavior of the automatic driving efficiency can be effectively considered, the efficiency of the automatic driving control is improved, and the driving safety is enhanced.

[0011] The third aspect embodiment of the present disclosure provides an automatic driving control device. The acquisition module is used for controlling the camera assembly to collect the initial cockpit image, and providing the initial cockpit image to the autonomous driving domain controller ADD and the digital cockpit domain controller DCD respectively. The first control module is used for controlling the autonomous driving domain controller ADD to receive the initial cockpit image and output the image processing result. The second control module is used for controlling the digital cockpit domain controller DCD to output the image recognition result. The image processing result and the image recognition result are used for automatic driving control.

[0012] The automatic driving control device provided in the third aspect of the present disclosure can effectively balance the efficiency requirement of automatic driving and the safety requirement of driving behavior, effectively improve the efficiency of automatic driving control, and enhance driving safety.

[0013] The fourth aspect of the present disclosure provides a vehicle, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the steps of the automatic driving control method provided in the second aspect of the present disclosure.

[0014] The fifth aspect of the present disclosure provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of the automatic driving control method provided in the second aspect of the present disclosure are implemented.

[0015] The sixth aspect of the present disclosure provides a non-transitory computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the automatic driving control method provided in the second aspect of the present disclosure are implemented.

[0016] The seventh aspect of the present disclosure provides a computer program product, wherein when the instructions in the computer program product are executed by a processor, the steps of the automatic driving control method provided in the second aspect of the present disclosure are executed.

[0017] The additional aspects and advantages of the present disclosure will be partially given in the following description, partially will become obvious from the following description, or will be understood by practicing the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0018] The above and / or additional aspects and advantages of the present disclosure will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:

[0019] Figure 1 is a schematic diagram of an automatic driving system structure according to an embodiment of the present disclosure;

[0020] Figure 2 is a schematic diagram of an automatic driving system structure according to another embodiment of the present disclosure;

[0021] Figure 3 is a schematic diagram of an automatic driving system architecture according to another embodiment of the present disclosure;

[0022] Figure 4 is a schematic diagram of an automatic driving control method according to an embodiment of the present disclosure;

[0023] Figure 5 is a schematic diagram of an automatic driving control device according to an embodiment of the present disclosure;

[0024] Figure 6 shows a block diagram of an exemplary electronic device suitable for implementing embodiments of the present disclosure. DETAILED DESCRIPTION

[0025] Embodiments of the present disclosure are described in detail below with reference to the accompanying drawings, in which examples of the embodiments are shown, wherein the same or similar notations are used to denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by reference to the drawings are exemplary only, and are used only for explanation of the present disclosure, and cannot be understood as a limitation of the present disclosure. On the contrary, the embodiments of the present disclosure include all changes, modifications and equivalents falling within the spirit and scope of the appended claims.

[0026] Figure 1 is a schematic diagram of an automatic driving system architecture according to an embodiment of the present disclosure.

[0027] It should be noted that the embodiments of the present disclosure support the use of the camera assembly 103 to collect initial cockpit images, and the process is obtained after authorization, which conforms to the provisions of relevant laws and regulations and does not violate public order and good customs.

[0028] As Figure 1 shown, the automatic driving system 10 includes an intelligent driving domain controller ADD 101, an intelligent cockpit domain controller DCD 102, and a camera assembly 103 electrically connected to the ADD 101, wherein

[0029] The camera assembly 103 is configured to collect initial cockpit images and provide the initial cockpit images to the intelligent driving domain controller ADD 101 and the intelligent cockpit domain controller DCD 102, respectively.

[0030] The intelligent driving domain controller ADD 101 is configured to receive the initial cockpit images from the camera assembly 103 and output image processing results.

[0031] The intelligent cockpit domain controller DCD 102 is configured to output image recognition results, wherein the image processing results and the image recognition results are used together for automatic driving control.

[0032] The intelligent driving domain controller ADD 101 is a domain controller for controlling the vehicle to automatically drive. The intelligent driving domain controller ADD 101 can be configured with functions such as multi-sensor fusion, positioning, path planning, decision control, wireless communication, high-speed communication, etc. Through external connection of multiple cameras, millimeter wave radars, laser radars, etc., functions such as image recognition and data processing are completed.

[0033] The intelligent cockpit domain controller DCD 102 is a domain controller responsible for the functions of the vehicle cockpit electronic system. The intelligent cockpit domain controller DCD 102 can integrate functions such as the vehicle information system (instrument) and the vehicle entertainment system, and can also integrate functions such as the driver monitoring system, the surround view system, the vehicle data recorder, and the air conditioner controller.

[0034] The camera assembly 103 is a camera module installed in the vehicle cockpit. One camera module can be used as the camera assembly 103, or multiple camera modules can be configured in the cockpit to collectively serve as the camera assembly 103, without limitation.

[0035] The initial cockpit image can be picture data or video data captured by the camera assembly 103, without limitation.

[0036] For example, the Joint Photographic Experts Group (JPEG) format data captured by the camera assembly 103 can be used as the initial cockpit image, or the Audio Video Interleaved (AVI) format data recorded by the camera assembly 103 can be used as the initial cockpit image. Of course, the initial cockpit image can also be any other possible format of image data, without limitation.

[0037] In the embodiments of the present disclosure, the camera assembly 103 can periodically capture image data as the initial cockpit image, or continuously record a video file of the cockpit image and use the video file as the initial cockpit image, or adaptively process according to the situation in the cockpit, such as triggering the camera assembly 103 to collect the initial cockpit image when a change in the cockpit is detected, without limitation.

[0038] In the embodiments of the present disclosure, when the automatic driving system is started, the camera assembly 103 can be immediately powered on to control the camera assembly 103 to start and collect the initial cockpit image, or the camera assembly 103 can be kept on (for example, a power supply is configured for the camera assembly 103, which is not limited), so as to directly control the camera assembly 103 to collect the initial cockpit image when the automatic driving system is started, which is not limited.

[0039] In some embodiments, the camera assembly 103 collects the initial cockpit image, which can be that an acquisition instruction is sent to the camera assembly 103 after the automatic driving system is started, and the camera assembly 103 receives the acquisition instruction and collects the initial cockpit image.

[0040] In other embodiments, the camera assembly 103 collects the initial cockpit image, which can also be that the camera assembly 103 continuously collects the initial cockpit image, which is not limited.

[0041] In the embodiments of the present disclosure, after the camera assembly 103 collects the initial cockpit image, the collected initial cockpit image is provided to the intelligent driving domain controller ADD 101 and the intelligent cockpit domain controller DCD 102 respectively.

[0042] The intelligent driving domain controller ADD 101 is configured to receive the initial cockpit image from the camera assembly 103 and output an image processing result.

[0043] The image processing result can be, for example, an automatic driving safety detection result, such as a line of sight detection result, an in-position detection result, a fatigue detection result, a distraction detection result, and a dangerous behavior detection result, which is not limited.

[0044] In some embodiments, the intelligent driving domain controller ADD 101 can be configured with a deep neural network (DNN) to extract corresponding features from the initial cockpit image using the deep neural network, and determine the image processing result according to the feature extraction result.

[0045] In other embodiments, the intelligent driving domain controller ADD 101 can also use an image processing model to input the initial cockpit image, analyze and identify the initial cockpit image through the image processing model, and output the image processing result. Of course, other possible implementation manners can also be used to obtain the image processing result, such as a long short-term memory (LSTM) network, an artificial intelligence model based on big data, a digital image processing technology, which is not limited.

[0046] Among them, the intelligent cockpit domain controller DCD102 is used to output image recognition results.

[0047] The image recognition results can specifically include driver identification results such as face recognition (Face ID), iris recognition, and fingerprint recognition, and there are no restrictions on this.

[0048] In this embodiment of the disclosure, facial recognition is used as a specific example. A facial recognition algorithm based on visible light images can be configured in the intelligent cockpit domain controller DCD102 to receive the initial cockpit image and output the image recognition result according to the facial recognition algorithm. Alternatively, a facial recognition system based on infrared spectrum can be configured to output the image recognition result. Or, an artificial intelligence model based on image recognition can be used to output the image recognition result. There are no restrictions on this.

[0049] In this embodiment of the disclosure, the image processing results and the image recognition results are used together for autonomous driving control.

[0050] Among them, autonomous driving control is used to control the operation of the vehicle and related in-vehicle devices (such as air conditioning, voice microphones, displays, etc.) based on the results of image processing and image recognition.

[0051] For example, the safety of a driver's driving behavior can be determined based on the image processing results, such as detecting the driver's fatigue state or whether there is any dangerous behavior. Based on the safety of the driver's behavior, the system can select to control the devices in the vehicle to remind the driver or stop the vehicle's operation. Alternatively, the system can detect whether the driver is a designated driver based on the image recognition results, and configure the status of the devices in the cockpit based on the preset operating habits of the designated driver, such as controlling the position of the seat and adjusting the air conditioning. There are no restrictions on this.

[0052] In this embodiment, the initial cockpit image is provided to the Intelligent Driving Domain Controller (ADD) and the Intelligent Cockpit Domain Controller (DCD) respectively. The ADD receives the initial cockpit image from the camera component and outputs the image processing result, while the DCD outputs the image recognition result. This effectively balances the needs of autonomous driving efficiency and driving behavior safety, effectively improving the efficiency of autonomous driving control and enhancing driving safety.

[0053] Figure 2 This is a schematic diagram of the structure of an autonomous driving system proposed in another embodiment of this disclosure.

[0054] like Figure 2 As shown, the intelligent driving domain controller ADD101 includes: a driver monitoring subsystem DMS1011, wherein,

[0055] The camera assembly 103 provides the initial cockpit image to the driver monitoring subsystem DMS 1011;

[0056] The driver monitoring subsystem DMS 1011 processes the initial cockpit image to obtain an image processing result.

[0057] The driver monitoring subsystem DMS 1011 is a functional system for realizing line-of-sight detection, in-position detection, fatigue detection, distraction detection, dangerous behavior, etc.

[0058] In the embodiments of the present disclosure, the driver monitoring subsystem DMS 1011 can be configured in the intelligent driving domain controller ADD 101, and the initial cockpit image is processed by the driver monitoring subsystem DMS 1011 to obtain an image processing result, which is not limited.

[0059] Optionally, in some embodiments of the present disclosure, as shown in Figure 2 The intelligent driving domain controller ADD 101 further includes a first deserializer 1012 and a serializer 1013, wherein

[0060] The camera assembly 103 provides the initial cockpit image to the first deserializer 1012;

[0061] The first deserializer 1012 processes the initial cockpit image to obtain a first cockpit image and a second cockpit image, and provides the first cockpit image to the driver monitoring subsystem DMS 1011, and provides the second cockpit image to the serializer 1013;

[0062] The serializer 1013 provides the second cockpit image to the intelligent cockpit domain controller DCD 102.

[0063] The serializer and the deserializer are interface circuits in high-speed data communication, and high-speed data transmission can be realized by using the serializer and the deserializer.

[0064] In the embodiments of the present disclosure, the first deserializer 1012 supports dividing one data frame into two data frames, that is, the initial cockpit image can be divided into the first cockpit image and the second cockpit image by the first deserializer 1012, and the first cockpit image and the second cockpit image can be the same or different, which is not limited.

[0065] The first cockpit image is a cockpit image for transmission to the driver monitoring subsystem DMS 1011, and the second cockpit image is a cockpit image for providing to the serializer 1013.

[0066] In the embodiments of the present disclosure, the initial cockpit image can be copied into two parts by the first deserializer 1012 as the first cockpit image and the second cockpit image, or the initial cockpit image can be parsed and classified to obtain the first cockpit image and the second cockpit image, that is, the first cockpit image and the second cockpit image can be the same or different, and no limitation is made thereto.

[0067] Optionally, in some embodiments of the present disclosure, as shown in Figure 2 The intelligent driving domain controller ADD 101 further includes a motor control unit 1014 electrically connected with the first deserializer 1012 and the serializer 1013 respectively; wherein,

[0068] The motor control unit 1014 is configured to send a first transmission control instruction to the first deserializer 1012 and the serializer 1013 respectively.

[0069] The first deserializer 1012 is configured to provide the first cockpit image to the driver monitoring subsystem DMS 1011 in response to the first transmission control instruction.

[0070] The serializer 1013 is configured to provide the second cockpit image to the intelligent cockpit domain controller DCD 102 in response to the first transmission control instruction.

[0071] The motor control unit 1014 can be a microcontroller unit (MCU) for example, and the microcontroller unit MCU has the characteristics of fast power-on, so that the use of the microcontroller unit MCU can effectively improve the efficiency of automatic driving control, and no limitation is made thereto.

[0072] The first transmission control instruction is instruction information for controlling the operation of the first deserializer 1012 and the serializer 1013, and the first transmission control instruction can control the data transmission of the first deserializer 1012 and the serializer 1013, and no limitation is made thereto.

[0073] In the embodiments of the present disclosure, by configuring the motor control unit 1014, the first deserializer 1012 and the serializer 1013 can be controlled to quickly power on via the motor control unit 1014, thereby effectively improving the start-up speed of the first deserializer 1012 and the serializer 1013, and further effectively improving the efficiency of automatic driving control.

[0074] Optionally, in some embodiments of the present disclosure, as shown in Figure 2 The intelligent cockpit domain controller DCD 102 includes an image recognition component 1021; wherein,

[0075] The serializer 1013 provides the second cockpit image to the image recognition component 1021.

[0076] The image recognition component 1021 processes the second cockpit image to obtain an image recognition result.

[0077] The image recognition component 1021 can be specifically, for example, a face recognition component, that is, the present disclosure supports processing the second cockpit image using the face recognition component to identify the facial features of the driver in the second cockpit image, and taking the facial features as the image recognition result. Of course, the image recognition component 1021 can also be specifically, for example, an iris recognition component, a fingerprint recognition component, etc., which is not limited.

[0078] Optionally, in some embodiments of the present disclosure, as shown in Figure 2 The intelligent cockpit domain controller DCD 102 further includes a second deserializer 1022; wherein,

[0079] The serializer 1013 provides the second cockpit image to the second deserializer 1022;

[0080] The second deserializer 1022 receives the second cockpit image and provides the second cockpit image to the image recognition component 1021.

[0081] The second deserializer 1022 is a deserializer arranged in the intelligent cockpit domain controller DCD 102.

[0082] In the embodiments of the present disclosure, the second cockpit image may change after being transmitted by the serializer 1013 (for example, a certain serialization processing is performed on the parallel transmission data), therefore, the second deserializer 1022 can be configured to receive and process the second cockpit image sent by the serializer 1013, and provide the second cockpit image to the image recognition component 1021.

[0083] Optionally, in some embodiments of the present disclosure, as shown in Figure 2 The intelligent driving domain controller ADD 101 further includes a system-level chip 1015 electrically connected with the first deserializer 1012 and the serializer 1013; wherein,

[0084] The system-level chip 1015 is configured to send an image processing instruction to the driver monitoring subsystem DMS 1011.

[0085] The driver monitoring subsystem DMS 1011 processes the first cockpit image to obtain an image processing result in response to the image processing instruction.

[0086] The system chip 1015 can be a system on chip (SOC) configured in the intelligent driving domain controller ADD 101, for example. The system chip 1015 is used to integrate various systems including the driver monitoring subsystem DMS 1011 to implement the functions of the intelligent driving domain controller ADD 101.

[0087] The image processing instruction is an instruction information for controlling the driver monitoring subsystem DMS 1011 to process the first cockpit image.

[0088] In the embodiments of the present disclosure, the image processing instruction can be generated by the system chip 1015 to enable the driver monitoring subsystem DMS 1011 to process the initial cockpit image based on the image processing instruction to obtain an image processing result, which is not limited.

[0089] Optionally, in some embodiments of the present disclosure, the system chip 1015 is further configured to detect an elapsed time after the motor control unit 1014 sends the first transmission control instruction, and send a second transmission control instruction to the first deserializer 1012 and the serializer 1013 when the elapsed time reaches a time threshold, and perform transmission control on the first deserializer 1012 and the serializer 1013 based on the second transmission control instruction.

[0090] The time threshold is a threshold value of the elapsed time after the first transmission control instruction is sent. When the elapsed time exceeds the threshold value, target control is triggered on the first deserializer 1012 and the serializer 1013 based on the second transmission control instruction.

[0091] The target control is a control manner of the first deserializer 1012 and the serializer 1013, which can be, for example, control of data transmission, power-on of the first deserializer 1012 and the serializer 1013, and the like, which is not limited.

[0092] That is, the system chip 1015 and the motor control unit 1014 both support control of the first deserializer 1012 and the serializer 1013. The motor control unit 1014 controls the first deserializer 1012 and the serializer 1013 based on the first transmission control instruction, and the system chip 1015 controls the first deserializer 1012 and the serializer 1013 based on the second transmission control instruction. When the autonomous driving system is started, the motor control unit 1014 can be used to quickly power on and quickly control the first deserializer 1012 and the serializer 1013 based on the first transmission control instruction, and then when the time reaches the time threshold, the control of the first deserializer 1012 and the serializer 1013 is switched to the system chip 1015, and the first deserializer 1012 and the serializer 1013 are controlled based on the second transmission control instruction.

[0093] In this embodiment of the disclosure, a control selection switch can be set. When the elapsed time reaches a time threshold, the system-on-a-chip 1015 can be used to control the first deserializer 1012 and the serializer 1013 based on the second transmission control command. Thus, while satisfying the fast startup requirement, the control logic can be simplified and the control efficiency can be effectively improved.

[0094] In this embodiment, the initial cockpit image is provided to the Intelligent Driving Domain Controller (ADD) and the Intelligent Cockpit Domain Controller (DCD) respectively. The ADD receives the initial cockpit image from the camera component and outputs the image processing result, while the DCD outputs the image recognition result. This effectively balances the needs of autonomous driving efficiency and driving behavior safety, effectively improving the efficiency of autonomous driving control and enhancing driving safety.

[0095] In summary, as Figure 3 As shown, Figure 3is another embodiment of the present disclosure proposes an automatic driving system architecture diagram, the automatic driving system 10 includes: intelligent driving domain controller ADD 101, intelligent cockpit domain controller DCD 102 and camera assembly 103. Wherein, the intelligent driving domain ADD 101 includes driver monitoring subsystem DMS 1011, first deserializer 1012, serializer 1013, motor control unit 1014 and system level chip 1015; Intelligent cockpit domain controller DCD 102 includes image recognition component 1021 and second deserializer 1022. When the automatic driving system 10 starts, the initial cockpit image is collected by the camera assembly 103, and the first deserializer 1012 and the serializer 1013 are controlled by the motor control unit 1014 to be powered on quickly, based on the first deserializer 1012, the initial cockpit image is divided into a first cockpit image and a second cockpit image, the first cockpit image is sent to the driver monitoring subsystem DMS 1011, and the image processing result is obtained after the driver monitoring subsystem DMS 1011 processing, and the second cockpit image is transmitted to the image recognition component 1021 via the serializer 1013 and the second deserializer 1022, and the image recognition result is obtained by processing via the image recognition component 1021, and the image processing result and the image recognition result are used for automatic driving control. In some embodiments, the control selector is supported to be set in the intelligent driving domain ADD 101, and the time threshold is configured, when the time threshold is reached, the control right of the first deserializer 1012 and the serializer 1013 can be switched to the system level chip 1015, to simplify the control logic of the first deserializer 1012 and the serializer 1013, in some embodiments of the present disclosure, the image processing result is also supported to be provided to the intelligent cockpit domain controller DCD 102, and the image recognition result is provided to the intelligent driving domain controller ADD 101 (for example, using physical transmission interface, wireless transmission and the like), to realize multi-angle, multi-domain controller linkage automatic driving control.

[0096] Figure 4 is an embodiment of the present disclosure proposes a flowchart of an automatic driving control method.

[0097] The execution subject of the automatic driving control method of the embodiment is an automatic driving control device, which can be realized by software and / or hardware, and can be configured in a vehicle.

[0098] As Figure 4 shown, the automatic driving control method comprises:

[0099] S401: collect the initial cockpit image, and provide the initial cockpit image to the intelligent driving domain controller ADD and the intelligent cockpit domain controller DCD respectively.

[0100] In the embodiments of the present disclosure, when the automatic driving system is started, the camera assembly can be powered on immediately to control the camera assembly to start and collect the initial cockpit image, or the camera assembly can be kept powered on (for example, a power supply is configured for the camera assembly alone, which is not limited) so that the camera assembly directly collects the initial cockpit image when the automatic driving system is started, which is not limited.

[0101] In the embodiments of the present disclosure, the initial cockpit image can be provided to the intelligent driving domain controller ADD and the intelligent cockpit domain controller DCD, for example, the initial cockpit image is copied into two copies, or the initial cockpit image is analyzed and divided into two parts according to the analysis result, and then the initial cockpit image is provided to the intelligent driving domain controller ADD and the intelligent cockpit domain controller DCD, which is not limited.

[0102] S402: Control the intelligent driving domain controller ADD to receive the initial cockpit image and output the image processing result.

[0103] In the embodiments of the present disclosure, the driver monitoring module DMS can be controlled to receive the initial cockpit image collected by the camera module and analyze and process the initial cockpit image to obtain the image processing result.

[0104] S403: Control the intelligent cockpit domain controller DCD to output the image recognition result, wherein the image processing result and the image recognition result are used together for automatic driving control.

[0105] In the embodiments of the present disclosure, the intelligent cockpit domain controller DCD can be controlled to receive the second cockpit image, and the image recognition component in the intelligent cockpit domain controller DCD analyzes and recognizes the initial cockpit image to obtain the image recognition result.

[0106] In the embodiments of the present disclosure, the automatic driving control can be based on the image processing result and the image recognition result.

[0107] In the present embodiment, by collecting the initial cockpit image and providing the initial cockpit image to the intelligent driving domain controller ADD and the intelligent cockpit domain controller DCD, then controlling the intelligent driving domain controller ADD to receive the initial cockpit image and output the image processing result, and controlling the intelligent cockpit domain controller DCD to output the image recognition result, wherein the image processing result and the image recognition result are used together for automatic driving control, by using the control intelligent driving domain controller ADD to receive the initial cockpit image and output the image processing result, and the control intelligent cockpit domain controller DCD and output the image recognition result, the efficiency requirement and the driving behavior safety requirement of the automatic driving can be effectively considered, the efficiency of the automatic driving control is effectively improved, and the driving safety is enhanced.

[0108] Figure 5 is a structural schematic diagram of an automatic driving control device provided by an embodiment of the present disclosure.

[0109] As shown in Figure 5 , the automatic driving control device 50 comprises:

[0110] The acquisition module 501 is configured to acquire an initial cockpit image and provide the initial cockpit image to an intelligent driving domain controller ADD and an intelligent cockpit domain controller DCD respectively.

[0111] The first control module 502 is configured to control the intelligent driving domain controller ADD to receive the initial cockpit image and output an image processing result.

[0112] The second control module 503 is configured to control the intelligent cockpit domain controller DCD to output an image recognition result, wherein the image processing result and the image recognition result are used together for automatic driving control.

[0113] Corresponding to the automatic driving control method provided by the above Figure 4 embodiments, the present disclosure also provides an automatic driving control device. Since the automatic driving control device provided by the embodiments of the present disclosure corresponds to the automatic driving control method provided by the above Figure 4 embodiments, the implementation of the automatic driving control method is also applicable to the automatic driving control device provided by the embodiments of the present disclosure, which will not be described in detail in the embodiments of the present disclosure.

[0114] In the present embodiment, the initial cockpit image is acquired and provided to the intelligent driving domain controller ADD and the intelligent cockpit domain controller DCD respectively, and then the intelligent driving domain controller ADD is controlled to receive the initial cockpit image and output the image processing result, and the intelligent cockpit domain controller DCD is controlled to output the image recognition result, wherein the image processing result and the image recognition result are used together for automatic driving control. Since the intelligent driving domain controller ADD is controlled to receive the initial cockpit image and output the image processing result, and the intelligent cockpit domain controller DCD is controlled to output the image recognition result, the efficiency requirement and the safety requirement of the driving behavior of the automatic driving can be effectively considered, the efficiency of the automatic driving control can be effectively improved, and the driving safety can be enhanced.

[0115] In order to realize the above-mentioned embodiments, the present disclosure further provides a vehicle comprising a processor and a memory for storing processor executable instructions, wherein the processor can realize the automatic driving control method provided by the above-mentioned embodiments of the present disclosure when executing the instructions.

[0116] To implement the above embodiments, this disclosure also proposes a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the autonomous driving control method proposed in the foregoing embodiments of this disclosure.

[0117] To implement the above embodiments, this disclosure also provides a computer program product, including a computer program that, when executed by a processor, implements the autonomous driving control method of the foregoing embodiments of this disclosure.

[0118] Figure 6 A block diagram of an exemplary electronic device suitable for implementing embodiments of the present disclosure is shown. Figure 6 The electronic device 12 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0119] like Figure 6 As shown, electronic device 12 is represented in the form of a general-purpose computing device. Components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, and a bus 18 connecting different system components (including system memory 28 and processing unit 16). Bus 18 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the MicroChannel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0120] Electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by electronic device 12, including volatile and non-volatile media, removable and non-removable media.

[0121] Memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and / or cache memory 32. Electronic device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media (… Figure 6 Not shown; usually referred to as a "hard drive".

[0122] although Figure 6 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disc drive for reading and writing to a removable non-volatile optical disc (e.g., a compact disc read-only memory (CD-ROM), a digital video disc read-only memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of this disclosure.

[0123] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 42 typically perform the functions and / or methods described in the embodiments of this disclosure.

[0124] The electronic device 12 can also communicate with one or more external devices 15 such as a keyboard or a pointing device, a display 24, etc.; other devices that enable a user to interact with the electronic device 12; and / or any devices (e.g., a networking module, a modem, etc.) that enable the electronic device 12 to communicate with one or more other computing devices. Such communication can occur via the input / output (I / O) interface 22. Still yet, the electronic device 12 can communicate with one or more networks (such as one or more Local Area Networks (LANs), Wide Area Networks (WANs), and / or the Internet) through a network adapter 20. As depicted, the network adapter 20 communicates with the other components of the electronic device 12 through the bus 18. It should be appreciated that the network adapter 20 and / or the other hardware and / or software components depicted in FIG. 1 can be utilized in other electronic devices, such as a smart phone, a tablet computer, a personal computer, a server, etc.

[0125] The processing unit 16 performs various

[0126] Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the features disclosed herein. The disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such

[0127] It should be understood that the present disclosure is not limited to the precise structures described and illustrated in the foregoing description and accompanying drawings, and that various modifications and changes can be made without departing from the scope thereof.

[0128] It should be noted that, in the description of the present disclosure, the terms "first", "second", etc. are used only for descriptive purposes and are not to be construed as indicating or implying relative importance. In addition, in the description of the present disclosure, the meaning of "a plurality of" is two or more unless otherwise specified.

[0129] Any procedural or methodological descriptions in flow charts or otherwise described herein can be understood to represent modules, segments, or portions of code that include executable instructions for implementing the specific logical functions or steps, and the scope of preferred embodiments of the present disclosure includes additional implementations in which the functions are performed in an order different from that shown or discussed, including substantially simultaneously, or in reverse order, as will be understood by those skilled in the art to which the embodiments of the present disclosure pertain.

[0130] It should be understood that portions of the present disclosure can be implemented in hardware, software, firmware, or combinations thereof. In the above-described embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, and as in another embodiment, it can be implemented using any or a combination of the following technologies, which are known in the art: discrete logic circuitry having logic gates for implementing logic functions upon data signals, application specific integrated circuits having appropriate combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

[0131] Those skilled in the art of the present technology can understand that all or part of the steps carried out by the above-described embodiments can be completed by programs instructing related hardware, and the programs can be stored in a computer-readable storage medium, and when executed, include one or a combination of steps of the method embodiments.

[0132] In addition, each functional unit in each embodiment of the present disclosure can be integrated into one processing module, or each unit can be physically present separately, or two or more units can be integrated into one module. The above-mentioned integrated module can be realized in the form of hardware or in the form of a software functional module. When the integrated module is realized in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0133] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0134] In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "an example", "a specific example", or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present disclosure. In the present specification, the illustrative description of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0135] Although the embodiments of the present disclosure have been shown and described above, it is understood that the above-described embodiments are exemplary, and it is not construed that the present disclosure is limited to the above-described embodiments, and a person of ordinary skill in the art can make changes, modifications, replacements, and variations to the above-described embodiments within the scope of the present disclosure.

Claims

1. An autonomous driving system, characterized in that, include: The system includes an intelligent driving domain controller (ADD), an intelligent cockpit domain controller (DCD), and a camera assembly electrically connected to the intelligent driving domain controller (ADD). The camera component is used to acquire initial cockpit images and provide the initial cockpit images to the intelligent driving domain controller (ADD) and the intelligent cockpit domain controller (DCD), respectively. The intelligent driving domain controller (ADD) receives the initial cockpit image from the camera assembly and outputs the image processing result. The intelligent cockpit domain controller (DCD) is used to output image recognition results, wherein the image processing results and the image recognition results are used together for autonomous driving control; wherein, The intelligent driving domain controller (ADD) includes: a driver monitoring subsystem (DMS), a first deserializer and a serializer, and a motor control unit electrically connected to the first deserializer and the serializer respectively; The camera assembly provides the initial cockpit image to the first deserializer; The first deserializer processes the initial cockpit image to obtain a first cockpit image and a second cockpit image, and provides the second cockpit image to the serializer; The motor control unit is used to send a first transmission control command to the first deserializer and the serializer respectively; The first deserializer is configured to provide the first cockpit image to the driver monitoring subsystem (DMS) in response to the first transmission control command. The serializer is used to provide the second cockpit image to the intelligent cockpit domain controller (DCD) in response to the first transmission control command.

2. The system as described in claim 1, characterized in that, The camera assembly provides the initial cockpit image to the driver monitoring subsystem (DMS); The Driver Monitoring Subsystem (DMS) processes the initial cockpit image to obtain the image processing result.

3. The system as described in claim 2, characterized in that, The intelligent cockpit domain controller (DCD) includes: an image recognition component; wherein... The serializer provides the second cockpit image to the image recognition component; The image recognition component processes the second cockpit image to obtain the image recognition result.

4. The system as described in claim 3, characterized in that, The intelligent cockpit domain controller (DCD) further includes: a second deserializer; wherein... The serializer provides the second cockpit image to the second deserializer; The second deserializer receives the second cockpit image and provides the second cockpit image to the image recognition component.

5. The system as described in claim 2, characterized in that, The intelligent driving domain controller (ADD) further includes: a system-on-a-chip electrically connected to the first deserializer and the serializer, respectively; wherein... The system-on-a-chip is used to send image processing instructions to the driver monitoring subsystem (DMS). The driver monitoring subsystem (DMS) responds to the image processing command and processes the first cockpit image to obtain the image processing result.

6. The system as described in claim 5, characterized in that, in, The system-on-a-chip is used to detect the elapsed time after the motor control unit sends the first transmission control command, and when the elapsed time reaches a time threshold, to send a second transmission control command to the first deserializer and the serializer respectively, and to perform transmission control on the first deserializer and the serializer based on the second transmission control command respectively.

7. An automatic driving control method, characterized in that, include: The camera module acquires an initial cockpit image, and the initial cockpit image is provided to the Intelligent Driving Domain Controller (ADD) and the Intelligent Cockpit Domain Controller (DCD) respectively. The intelligent driving domain controller (ADD) receives the initial cockpit image and outputs the image processing results. The intelligent cockpit domain controller (DCD) outputs image recognition results, wherein the image processing results and the image recognition results are used together for autonomous driving control; The intelligent driving domain controller (ADD) includes: a driver monitoring subsystem (DMS), a first deserializer and a serializer, and a motor control unit electrically connected to the first deserializer and the serializer respectively; The camera assembly provides the initial cockpit image to the first deserializer; The first deserializer processes the initial cockpit image to obtain a first cockpit image and a second cockpit image, and provides the second cockpit image to the serializer; The motor control unit is used to send a first transmission control command to the first deserializer and the serializer respectively; The first deserializer is configured to provide the first cockpit image to the driver monitoring subsystem (DMS) in response to the first transmission control command. The serializer is used to provide the second cockpit image to the intelligent cockpit domain controller (DCD) in response to the first transmission control command.

8. An automatic driving control device, characterized in that, include: The acquisition module is used to control the camera assembly to acquire initial cockpit images and provide the initial cockpit images to the Intelligent Driving Domain Controller (ADD) and the Intelligent Cockpit Domain Controller (DCD), respectively. The first control module is used to control the intelligent driving domain controller (ADD) to receive the initial cockpit image and output the image processing result; The second control module is used to control the output of image recognition results by the intelligent cockpit domain controller DCD, wherein the image processing results and the image recognition results are used together for autonomous driving control; The intelligent driving domain controller (ADD) includes: a driver monitoring subsystem (DMS), a first deserializer and a serializer, and a motor control unit electrically connected to the first deserializer and the serializer respectively; The camera assembly provides the initial cockpit image to the first deserializer; The first deserializer processes the initial cockpit image to obtain a first cockpit image and a second cockpit image, and provides the second cockpit image to the serializer; The motor control unit is used to send a first transmission control command to the first deserializer and the serializer respectively; The first deserializer is configured to provide the first cockpit image to the driver monitoring subsystem (DMS) in response to the first transmission control command. The serializer is used to provide the second cockpit image to the intelligent cockpit domain controller (DCD) in response to the first transmission control command.

9. A vehicle, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured as follows: The steps for implementing the autonomous driving control method described in claim 7 above.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, in, The computer instructions are used to cause the computer to execute the automatic driving control method of claim 7.

Images