A smart cockpit domain controller and its control method, a vehicle

Through the multi-controller integration of smart cockpit domain controllers, the problems of low bandwidth and complexity of traditional automotive network architectures are solved, high bandwidth and centralized control are realized, intelligent and secure interactive experience are improved, and the electrical cost of the whole vehicle is reduced , and simplifies software iterative updates.

CN115604322BActive Publication Date: 2024-11-15CHONGQING CHANGAN TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202211058831.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-30
Publication Date
2024-11-15
Estimated Expiration
2042-08-30

AI Technical Summary

Technical Problem

The low bandwidth of traditional automotive network architecture and flattening networks have led to an increase in the complexity of electronic and electrical architectures, which cannot meet the needs of intelligent automotive functions and software complexity, especially in terms of data processing and safe response speed.

Method used

Design an intelligent cockpit domain controller, integrating communication module, data recording module, monitoring module, display module, alarm module and vehicle communication service terminal, and optimize the distributed electronic and electrical architecture through multi-controller integration to achieve high bandwidth and centralization Control logic, supporting advanced load driving and autonomous driving technology.

Benefits of technology

It improves the intelligent and safe interactive experience of the car, reduces the electrical cost of the whole vehicle, improves the customer experience, and solves the problems of large number of controllers and logical dispersion of functions in distributed architectures, and optimizes the efficiency of software iteration and updates.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115604322B_ABST
    Figure CN115604322B_ABST
Patent Text Reader

Abstract

The present application provides an intelligent cockpit domain controller and its control method, and a vehicle. The cockpit domain controller integrates an instrument, an infotainment controller, a networking module, a remote management unit, a low-speed pedestrian alarm, fatigue monitoring, a driving recorder, a head-up display, etc., so that the present application not only reconstructs the automotive electronic and electrical architecture, but also conforms to the development trend of the electronic and electrical architecture, and can also optimize the distributed electronic and electrical architecture. The low bandwidth, flattened network, and the need for an ECU unit for each function are the problems; the present application can reduce the electrical cost of the entire vehicle, create value for customers, and enhance customer experience. The present application further centralizes the control logic, improves development efficiency, and facilitates software iteration and updating. At the same time, the cockpit domain controller can enhance customer experience through a high-computing-power SOC, and solve bottlenecks such as the number of distributed architecture controllers and the dispersion of multi-function logic.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to an intelligent cockpit domain controller and a control method thereof, and a vehicle. Background Art

[0002] With the development needs of the new four modernizations represented by automobile electrification, networking, intelligence, and sharing, the functions of the whole vehicle are increasing, and the number of controllers is increasing. The traditional automobile network architecture is a distributed architecture connected by multiple controllers. It is characterized by low bandwidth, flat network, and one ECU unit for each function. With the continuous improvement of the level of network connection of smart cars, the rich functions of cars require more ECUs. However, a more complex system architecture will lead to a decrease in the reliability of automotive electronics, and such a network architecture cannot meet future needs. Therefore, in order to cope with the increase in the complexity of intelligent car functions and software, achieve higher levels of safety and response speed, and ensure that a large amount of data is received, processed, and corresponding instructions are issued in a timely manner, it is necessary to reconstruct the automotive electronic and electrical architecture. Summary of the invention

[0003] In view of the above-mentioned shortcomings of the prior art, the present application provides an intelligent cockpit domain controller and a control method thereof to solve the above-mentioned technical problems.

[0004] The present application provides a smart cockpit domain controller, including:

[0005] A communication module, used to provide controller area network communication and Ethernet communication for the target vehicle, and to perform signal routing management and network management for the target vehicle; wherein the target vehicle is a vehicle including an intelligent cockpit domain controller;

[0006] A data recording module, used to record the internal image of the target vehicle and the image within a first distance from the target vehicle;

[0007] A monitoring module, configured to monitor a first object and output a first prompt message based on a monitoring result; wherein the first object includes a driving object that controls the target vehicle;

[0008] A display module, used to display the driving information of the target vehicle and provide a human-computer interaction interface for the first object to perform human-computer interaction with the target vehicle;

[0009] an alarm module, configured to output a second prompt message, wherein the second prompt message comprises: a message generated when a second object outside the target vehicle is at a second distance from the target vehicle;

[0010] The vehicle-mounted communication service terminal is used for remote control of the target vehicle and transparent data transmission.

[0011] In one embodiment of the present application, the cockpit domain controller also includes: an infotainment control module for providing in-vehicle entertainment, navigation, radio and music.

[0012] In one embodiment of the present application, if the target vehicle is a new energy vehicle, the cockpit domain controller further includes: a remote management module for uploading the power information of the target vehicle to a data platform.

[0013] In one embodiment of the present application, when recording the internal image of the target vehicle and recording the image within the first distance from the target vehicle, the data recording module further includes:

[0014] Divide the recorded image into frames to obtain multiple single-frame images;

[0015] Inputting each single-frame image into a first preset neural network model for recognition to determine whether a first object exists in the single-frame image;

[0016] If the first object exists in the single-frame image, controlling the door of the target vehicle to be in an open state;

[0017] If the first object does not exist in the single-frame image, the door of the target vehicle is controlled to be in a closed state.

[0018] In one embodiment of the present application, the process in which the monitoring module monitors the first object and outputs the first prompt message based on the monitoring result includes:

[0019] Acquire an image of the interior of the target vehicle including the first object recorded by the data recording module, and record it as a vehicle interior image;

[0020] Frame the vehicle interior image to obtain multiple single-frame vehicle interior images;

[0021] Input each single frame of the vehicle interior image into a second preset neural network model, perform behavior recognition on the first object, and determine the behavior score of the first object; wherein the behavior recognition includes: expression recognition, driving action recognition, body posture recognition, and eyelid action recognition;

[0022] Comparing the behavior action score with a preset score;

[0023] If the action score is greater than or equal to a preset score, outputting a first prompt message to the first object, wherein the first prompt message includes a message prompting the first object to pay attention to fatigue driving;

[0024] If the behavior action score is less than a preset score, the vehicle interior image is re-framed, and behavior action recognition is performed on the multiple single-frame vehicle interior images after framing.

[0025] In one embodiment of the present application, the data recording module includes a driving recorder.

[0026] In one embodiment of the present application, the display module includes an instrument of the target vehicle; and / or, the display module includes a display screen disposed inside the target vehicle.

[0027] The present application also provides a method for controlling a smart cockpit domain controller, the method comprising the following steps:

[0028] Receive a request command to start the smart cockpit domain controller;

[0029] In response to the request instruction, the target vehicle is provided with controller area network communication and Ethernet communication, and signal routing management and network management are performed on the target vehicle; and the internal image of the target vehicle is recorded, and the image within a first distance from the target vehicle is recorded; and a first object is monitored, and a first prompt message is output based on the monitoring result; and driving information of the target vehicle is displayed, and a human-computer interaction interface is provided for human-computer interaction between the first object and the target vehicle; and a second prompt message is generated and output when a second object outside the target vehicle is at a second distance from the target vehicle; and the target vehicle is remotely controlled and data is transparently transmitted; wherein, the target vehicle is a vehicle including a smart cockpit domain controller, and the first object includes a driving object that controls the target vehicle.

[0030] The present application also provides a vehicle, comprising a smart cockpit domain controller as described in any one of the above.

[0031] The present application also provides an electronic device, the electronic device comprising:

[0032] one or more processors;

[0033] A storage device is used to store one or more programs. When the one or more programs are executed by the one or more processors, the electronic device implements the method for controlling the smart cockpit domain controller as described above.

[0034] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor of a computer, the computer executes the method for controlling the smart cockpit domain controller as described above.

[0035] As described above, the present application provides an intelligent cockpit domain controller and a control method thereof, and a vehicle, which have the following beneficial effects:

[0036] In order to cope with the increase in the complexity of intelligent car functions and software, achieve higher levels of safety and response speed, and ensure that a large amount of data is received, processed, and issued corresponding instructions in a timely manner, this application proposes a multi-controller integrated intelligent cockpit domain controller, which integrates instruments, infotainment controllers, networking modules, remote management units, low-speed pedestrian alarms, fatigue monitoring, driving recorders, head-up displays, etc., and brings a more intelligent and safe interactive experience to the car through multi-screen integration. It is also a key interface for technologies such as advanced load driving, automatic driving, and artificial intelligence. This application reconstructs the automotive electronic and electrical architecture, which not only conforms to the development trend of the electronic and electrical architecture, but also optimizes the problems of low bandwidth, flattened network, and the need for an ECU unit for each function of the distributed electronic and electrical architecture; at the same time, this application integrates multiple controllers into an intelligent cockpit domain controller, which can reduce the electrical cost of the whole vehicle, create value for customers, and improve customer experience. This is equivalent to integrating infotainment controllers, instruments, driving recorders, DMS, low-speed pedestrian alarms, remote management units, T-BOX, etc. through cockpit domain controllers, so that the control logic is further centralized, development efficiency is improved, and software iteration and update are easy. At the same time, the cockpit domain controller can improve customer experience through high-computing-power SOC and solve bottlenecks such as the number of distributed architecture controllers and the dispersion of multi-function logic.

[0037] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0039] Figure 1 A schematic diagram of the hardware structure of a smart cockpit domain controller provided in an embodiment of the present application;

[0040] Figure 2 A distributed network architecture diagram of a smart cockpit domain controller provided in an embodiment of the present application;

[0041] Figure 3 A domain architecture network topology diagram of a smart cockpit domain controller provided in an embodiment of the present application;

[0042] Figure 4 A schematic diagram of an exemplary system architecture for applying the technical solutions in one or more embodiments of the present application;

[0043] Figure 5 The hardware structure diagram of an electronic device suitable for implementing one or more embodiments of the present application. DETAILED DESCRIPTION

[0044] The following will describe the implementation methods of the present application with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are only for illustrating the present application, not for limiting the scope of protection of the present application.

[0045] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application, and thus the drawings only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed at will, and the component layout may also be more complicated.

[0046] In the following description, a large number of details are discussed to provide a more thorough explanation of the embodiments of the present application. However, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present application difficult to understand.

[0047] The above section introduces the contents of an exemplary system architecture that applies the technical solution of the present application. Next, we will continue to introduce the smart cockpit domain controller of the present application.

[0048] Figure 1 FIG. 1 shows a hardware structure diagram of a smart cockpit domain controller provided by an embodiment of the present application. Specifically, Figure 1 As shown, this embodiment provides a smart cockpit domain controller, including:

[0049] The communication module 101 is used to provide controller area network communication and Ethernet communication for the target vehicle, and to perform signal routing management and network management for the target vehicle; wherein the target vehicle is a vehicle including an intelligent cockpit domain controller. As an example, the present embodiment can use the communication module 101 to send and receive control instructions, status instructions, OTA data packets, etc. of each controller of the vehicle in a communication mode such as CAN, Ethernet, or CANFD.

[0050] The data recording module 102 is used to record the internal image of the target vehicle and the image within the first distance from the target vehicle. Specifically, when recording the internal image of the target vehicle and the image within the first distance from the target vehicle, the data recording module 102 also includes: framing the recorded image to obtain multiple single-frame images; inputting each single-frame image into a first preset neural network model for identification, and determining whether there is a first object in the single-frame image; if the first object exists in the single-frame image, the door of the target vehicle is controlled to be in an open state; if the first object does not exist in the single-frame image, the door of the target vehicle is controlled to be in a closed state. Among them, the first object in this embodiment includes a driving object that controls the target vehicle, for example, the first object in this embodiment can be a driver. In this embodiment, the first distance can be set according to actual conditions, and this embodiment does not limit the specific value, for example, it can be set to 20 meters. As an example, the data recording module in this embodiment includes but is not limited to a driving recorder.

[0051] The monitoring module 103 is used to monitor the first object and output a first prompt message based on the monitoring result. Specifically, the monitoring module 103 monitors the first object and outputs the first prompt message based on the monitoring result, including: obtaining the image of the target vehicle recorded by the data recording module, which contains the first object, and recording it as the vehicle interior image; framing the vehicle interior image to obtain multiple single-frame vehicle interior images; inputting each single-frame vehicle interior image into a second preset neural network model, performing behavior action recognition on the first object, and determining the behavior action score of the first object; wherein the behavior action recognition includes: expression recognition, driving action recognition, body posture recognition and eyelid action recognition; comparing the behavior action score with the preset score; if the behavior action score is greater than or equal to the preset score, outputting a first prompt message to the first object, the first prompt message including a message to remind the first object to pay attention to fatigue driving; if the behavior action score is less than the preset score, reframing the vehicle interior image, and performing behavior action recognition on the multiple single-frame vehicle interior images after framing. It can be seen that the present embodiment can recognize the driver's expression, driving action, body posture and eyelid action through the monitoring module, so as to monitor the driver's fatigue and distraction to prevent the driver from driving fatigued. At the same time, it can also give the driver some tips when the driver is driving fatigued to assist the driver to drive safely.

[0052] The display module 104 is used to display the driving information of the target vehicle and provide a human-machine interaction interface for the first object to perform human-machine interaction with the target vehicle. As an example, the display module 104 includes an instrument of the target vehicle; and / or, the display module includes a display screen arranged inside the target vehicle. It can be seen that this embodiment realizes the display control of driving information through the display module, and at the same time provides the driver with some HMI (HumanMachine Interface, human-machine interaction interface, referred to as HMI) displays to assist the driver in driving safely.

[0053] The alarm module 105 is used to output a second prompt message, wherein the second prompt message includes: a message generated when a second object outside the target vehicle is at a second distance from the target vehicle. The second object includes, but is not limited to, humans and animals. As an example, the second distance in this embodiment can be set according to actual conditions. This embodiment does not limit the specific value, for example, it can be set to 2 meters. It can be seen that this embodiment can prompt the driver when people and animals around the vehicle approach the vehicle to prevent the driver from harming the surrounding people or animals.

[0054] The vehicle communication service terminal 106 is used to remotely control the target vehicle and transparently transmit data.

[0055] The infotainment control module 107 is used to provide in-vehicle entertainment, navigation, radio and music.

[0056] In an exemplary embodiment, if the target vehicle is a new energy vehicle, the cockpit domain controller further includes: a remote management module for uploading the power information of the target vehicle to a data platform.

[0057] like Figure 2 and Figure 3 As shown, in another exemplary embodiment of the present application, the present application also provides a multi-controller integrated intelligent cockpit domain controller, which integrates instruments, infotainment controllers, networking modules, remote management units, low-speed pedestrian alarms, fatigue monitoring, driving recorders, head-up displays, etc., and brings a more intelligent and safe interactive experience to the car through multi-screen integration. It is also a key interface for technologies such as advanced load driving, autonomous driving and artificial intelligence. The internal chip of the intelligent cockpit domain controller is mainly composed of a CPU, and a SOC chip composed of a GPU, ISP, and DSP. It is responsible for the calculation and processing of massive data inside the cockpit, including video access from multiple cameras, in-car audio processing, voice, and image rendering and output of multiple display screens, in-car WIFI / BT interconnection, and Ethernet data interaction with other domains in the car.

[0058] like Figure 2 As shown, Figure 2It describes the distributed vehicle network topology, which mainly represents the network communication of the vehicle. When a distributed architecture is adopted, the controller has a single function and the control logic is decentralized. Among them, the gateway S100 is mainly responsible for the vehicle CAN and Ethernet communication, and is responsible for the signal routing and network management of the vehicle. S111 represents CAN communication, S112 represents Ethernet communication, and S113 represents CANFD communication. It is mainly the vehicle communication medium, which is used to send and receive control instructions, status instructions, OTA data packets, etc. of each controller of the vehicle. The driving recorder S101 is mainly used to record and save images around and inside the vehicle, and is used as source data for playback. The infotainment controller S102 mainly realizes functions such as in-vehicle entertainment, navigation, radio, music, etc., and mainly provides customers with entertainment and other related perceptions. The DMS monitoring module S103 mainly realizes driver fatigue monitoring and distraction monitoring, and gives the driver some prompts when the driver is tired. The instrument S104 mainly realizes the display control of driving information, provides some HMI displays to the driver, and assists the driver in safe driving. Remote management unit S105 is mainly used to upload power-related information such as power battery packs to the data platform in accordance with the regulations of new energy vehicles. Low-speed pedestrian alarm S107 is mainly used to provide driving warning sounds for new energy vehicles to alert people around the vehicle. T-BOX vehicle communication service terminal S108 is mainly used to realize vehicle remote control functions, data transparent transmission and other functions.

[0059] like Figure 3 As shown, Figure 3 It shows the network topology of the domain architecture, which shows the cockpit domain controller S209 and other domain controllers under the gateway S100. In this embodiment, the cockpit domain controller integrates the infotainment controller, instrument, driving recorder, DMS, low-speed pedestrian alarm, remote management unit, T-BOX, etc., so as to further centralize the control logic, improve development efficiency, and facilitate software iteration and update. At the same time, the cockpit domain controller can improve the customer experience through the high-computing power SOC, and solve the bottlenecks such as the number of distributed architecture controllers and the dispersion of multi-function logic.

[0060] In summary, the present application provides an intelligent cockpit domain controller, which integrates an instrument, an infotainment controller, a networking module, a remote management unit, a low-speed pedestrian alarm, fatigue monitoring, a driving recorder, a head-up display, etc., and brings a more intelligent and safe interactive experience to the car through multi-screen integration. It is also a key interface for technologies such as advanced load driving, autonomous driving and artificial intelligence. By reconstructing the automotive electronic and electrical architecture, the present application not only conforms to the development trend of the electronic and electrical architecture, but also optimizes the problems of low bandwidth, flattened network, and the need for an ECU unit for each function of the distributed electronic and electrical architecture; at the same time, the present application integrates multiple controllers into an intelligent cockpit domain controller, which can reduce the electrical cost of the whole vehicle, create value for customers, and improve customer experience. This is equivalent to the present application integrating the infotainment controller, instrument, driving recorder, DMS, low-speed pedestrian alarm, remote management unit, T-BOX, etc. through the cockpit domain controller, so that the control logic is further centralized, the development efficiency is improved, and the software iteration and update are easy. At the same time, the cockpit domain controller can improve the customer experience through the high-computing power SOC, and solve the bottlenecks such as the number of distributed architecture controllers and the dispersion of multi-function logic.

[0061] In an exemplary embodiment of the present application, the present application also provides a vehicle, which includes a smart cockpit domain controller as described in any of the above. It should be noted that the vehicle provided in the above embodiment and the smart cockpit domain controller provided in the above embodiment belong to the same concept, and the specific manner in which each module performs the operation has been described in detail in the method embodiment, which will not be repeated here. In actual application, the vehicle provided in the above embodiment can distribute the above functions to different functional modules as needed, that is, divide the internal structure of the system into different functional modules to complete all or part of the functions described above, and this is not limited here.

[0062] In an exemplary embodiment of the present application, the present application also provides a method for controlling a smart cockpit domain controller, the method comprising the following steps:

[0063] Receive a request command to start the smart cockpit domain controller;

[0064] In response to the request instruction, the target vehicle is provided with controller area network communication and Ethernet communication, and signal routing management and network management are performed on the target vehicle; and the internal image of the target vehicle is recorded, and the image within a first distance from the target vehicle is recorded; and a first object is monitored, and a first prompt message is output based on the monitoring result; and driving information of the target vehicle is displayed, and a human-computer interaction interface is provided for human-computer interaction between the first object and the target vehicle; and a second prompt message is generated and output when a second object outside the target vehicle is at a second distance from the target vehicle; and the target vehicle is remotely controlled and data is transparently transmitted; wherein, the target vehicle is a vehicle including a smart cockpit domain controller, and the first object includes a driving object that controls the target vehicle.

[0065] It can be seen that this method can reconstruct the automotive electronic and electrical architecture, which is not only in line with the development trend of electronic and electrical architecture, but also can optimize the problems of low bandwidth, flat network, and one ECU unit for each function in the distributed electronic and electrical architecture; at the same time, it can reduce the electrical cost of the whole vehicle, create value for customers, and improve customer experience. In addition, the control logic can be further centralized, development efficiency can be improved, and software iteration and update can be facilitated. At the same time, the cockpit domain controller can improve customer experience through the high-computing power SOC and solve bottlenecks such as the number of distributed architecture controllers and the dispersion of multi-function logic. In this embodiment, the specific methods executed by each module of the intelligent cockpit domain controller have been described in detail in the above embodiment, so this embodiment will not be repeated.

[0066] Specifically, Figure 4 A schematic diagram of an exemplary system architecture to which the technical solution in one or more embodiments of the present application can be applied is shown. Figure 4 As shown, the system architecture 100 may include a terminal device 110, a network 120, and a server 130. The terminal device 110 may include various electronic devices such as a smart phone, a tablet computer, a laptop computer, and a desktop computer. The server 130 may be an independent physical server, or a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The network 120 may be a communication medium of various connection types that can provide a communication link between the terminal device 110 and the server 130, such as a wired communication link or a wireless communication link.

[0067] According to the implementation requirements, the system architecture in the embodiment of the present application can have any number of terminal devices, networks and servers. For example, the server 130 can be a server group composed of multiple server devices. In addition, the technical solution provided in the embodiment of the present application can be applied to the terminal device 110, can also be applied to the server 130, or can be implemented by the terminal device 110 and the server 130 together, and the present application does not make any special restrictions on this.

[0068] In one embodiment of the present application, the terminal device 110 or the server 130 of the present application can receive a request instruction to start a smart cockpit domain controller; respond to the request instruction, and provide controller area network communication and Ethernet communication to the target vehicle, and perform signal routing management and network management on the target vehicle; and, record the internal image of the target vehicle, and record the image within a first distance from the target vehicle; and, monitor the first object and output a first prompt message based on the monitoring result; and, display the driving information of the target vehicle, and provide a human-computer interaction interface for the first object to perform human-computer interaction with the target vehicle; and, generate and output a second prompt message when a second object outside the target vehicle is at a second distance from the target vehicle; and remotely control the target vehicle and transmit data transparently; wherein, the target vehicle is a vehicle including a smart cockpit domain controller, and the first object includes a driving object that controls the target vehicle. By using the terminal device 110 or the server 130 to execute the method of controlling the intelligent cockpit domain controller, the automotive electronic and electrical architecture can be reconstructed, which not only conforms to the development trend of the electronic and electrical architecture, but also can optimize the distributed electronic and electrical architecture with low bandwidth, flat network, and the need for one ECU unit for each function. At the same time, it can reduce the electrical cost of the whole vehicle, create value for customers, and improve customer experience. In addition, it can further centralize the control logic, improve development efficiency, and facilitate software iteration and update. At the same time, the cockpit domain controller can improve customer experience through a high-computing-power SOC and solve bottlenecks such as the number of distributed architecture controllers and the dispersion of multi-function logic.

[0069] An embodiment of the present application also provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device implements the method for controlling the smart cockpit domain controller provided in the above-mentioned embodiments.

[0070] Figure 5 The structure diagram of the computer system suitable for implementing the electronic device of the embodiment of the present application is shown. It should be noted that: Figure 5The computer system 1000 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0071] like Figure 5 As shown, the computer system 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage part 1008 to the random access memory (RAM) 1003, such as executing the method described in the above embodiment. In the RAM 1003, various programs and data required for system operation are also stored. The CPU 1001, the ROM 1002 and the RAM 1003 are connected to each other through the bus 1004. The input / output (I / O) interface 1005 is also connected to the bus 1004.

[0072] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed so that a computer program read therefrom is installed into the storage section 1008 as needed.

[0073] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 1009, and / or installed from a removable medium 1011. When the computer program is executed by a central processing unit (CPU) 1001, various functions defined in the system of the present application are executed.

[0074] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (Erasable Programmable Read Only Memory, EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. This propagated data signal can take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0075] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. Among them, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0076] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0077] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer executes the method for controlling the intelligent cockpit domain controller as described above. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0078] Another aspect of the present application further provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method for controlling the intelligent cockpit domain controller provided in each of the above embodiments.

[0079] The above embodiments are merely illustrative of the principles and effects of the present application, and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.

Claims

1. An intelligent cockpit domain controller, characterized in that: Included are: A communication module, used to provide controller area network communication and Ethernet communication for the target vehicle, and to perform signal routing management and network management for the target vehicle; wherein the target vehicle is a vehicle including an intelligent cockpit domain controller; A data recording module, used to record the internal image of the target vehicle and the image within a first distance from the target vehicle; A monitoring module, used to monitor a first object and output a first prompt message based on the monitoring result; comprising: obtaining an image of the target vehicle recorded by the data recording module containing the first object, recorded as a vehicle interior image; framing the vehicle interior image to obtain a plurality of single-frame vehicle interior images; inputting each single-frame vehicle interior image into a second preset neural network model, performing behavior action recognition on the first object, and determining the behavior action score of the first object; wherein the behavior action recognition includes: expression recognition, driving action recognition, body posture recognition, and eyelid action recognition; comparing the behavior action score with a preset score; if the behavior action score is greater than or equal to the preset score, outputting a first prompt message to the first object, the first prompt message including a message to remind the first object to pay attention to fatigue driving; if the behavior action score is less than the preset score, reframing the vehicle interior image, and performing behavior action recognition on the plurality of single-frame vehicle interior images after framing; wherein the first object includes a driving object that controls the target vehicle; A display module, used to display the driving information of the target vehicle and provide a human-computer interaction interface for the first object to perform human-computer interaction with the target vehicle; an alarm module, configured to output a second prompt message, wherein the second prompt message comprises: a message generated when a second object outside the target vehicle is at a second distance from the target vehicle; The vehicle-mounted communication service terminal is used for remote control of the target vehicle and transparent data transmission.

2. The intelligent cockpit domain controller according to claim 1, characterized in that: The cockpit domain controller also includes: an infotainment control module, which is used to provide in-vehicle entertainment, navigation, radio and music.

3. The intelligent cockpit domain controller according to claim 1, characterized in that: If the target vehicle is a new energy vehicle, the cockpit domain controller further includes: a remote management module, which is used to upload the power information of the target vehicle to a data platform.

4. The intelligent cockpit domain controller according to any one of claims 1 to 3, characterized in that: When recording the internal image of the target vehicle and recording the image within the first distance from the target vehicle, the data recording module further includes: Divide the recorded image into frames to obtain multiple single-frame images; Inputting each single-frame image into a first preset neural network model for recognition to determine whether a first object exists in the single-frame image; If the first object exists in the single-frame image, controlling the door of the target vehicle to be in an open state; If the first object does not exist in the single-frame image, the door of the target vehicle is controlled to be in a closed state.

5. The intelligent cockpit domain controller according to claim 1, characterized in that: The data recording module includes a driving recorder.

6. The intelligent cockpit domain controller according to claim 1, characterized in that: The display module includes an instrument of the target vehicle; and / or, the display module includes a display screen arranged inside the target vehicle.

7. A method for controlling the smart cockpit domain controller according to any one of claims 1 to 6, characterized in that: The method comprises the following steps: Receive a request command to start the smart cockpit domain controller; In response to the request instruction, the controller area network communication and Ethernet communication are provided to the target vehicle, and the signal routing management and network management are performed on the target vehicle; and the internal image of the target vehicle is recorded, and the image within the first distance from the target vehicle is recorded; and the first object is monitored, and a first prompt message is output based on the monitoring result; and the driving information of the target vehicle is displayed, and a human-computer interaction interface is provided for the first object to perform human-computer interaction with the target vehicle; and a second prompt message is generated and output when a second object outside the target vehicle is at a second distance from the target vehicle; and the target vehicle is remotely controlled and data is transparently transmitted; wherein the target vehicle is a vehicle including a smart cockpit domain controller, and the first object includes a driving object that controls the target vehicle; Among them, the process of monitoring the first object and outputting a first prompt message based on the monitoring results includes: obtaining the image of the interior of the target vehicle containing the first object recorded by the data recording module, recorded as the vehicle interior image; framing the vehicle interior image to obtain multiple single-frame vehicle interior images; inputting each single-frame vehicle interior image into a second preset neural network model, performing behavior action recognition on the first object, and determining the behavior action score of the first object; wherein the behavior action recognition includes: expression recognition, driving action recognition, body posture recognition and eyelid action recognition; comparing the behavior action score with a preset score; if the behavior action score is greater than or equal to the preset score, outputting a first prompt message to the first object, the first prompt message including a message prompting the first object to pay attention to fatigue driving; if the behavior action score is less than the preset score, re-framing the vehicle interior image, and performing behavior action recognition on the multiple single-frame vehicle interior images after framing.

8. A vehicle, characterized in that: The vehicle includes the smart cockpit domain controller as described in any one of claims 1 to 6.