AI-based intelligent cockpit interaction systems and vehicles

Abstract

This invention discloses an AI-based intelligent cockpit interaction system and a vehicle. The AI-based intelligent cockpit interaction system is applied to a vehicle and includes: at least one ECU (Electronic Control Unit) for controlling the functional devices of the intelligent cockpit; and an AI engine connected to the at least one ECU via a vehicle API. Upon receiving a scene selection command, the AI ​​engine determines the target ECU from the at least one ECU based on the control parameters corresponding to the scene selection command, and controls the functional devices corresponding to the target ECU to realize the scene. Furthermore, when a change in control parameters is detected, the AI ​​engine updates the control parameters corresponding to the scene selection command. This simplifies user operation, improves driving safety, and enhances the user's driving experience.

Description

Technical Field

[0001] This invention relates to the field of automotive technology, and more particularly to an AI-based intelligent cockpit interaction system and a vehicle. Background Technology

[0002] With the rapid development of new energy vehicles, users are placing increasingly stringent demands on the cabin, and a good cabin system is crucial to the overall competitiveness of the vehicle. Current technologies primarily rely on users manually adjusting various functions within the cabin system, such as the air conditioning, windows, and seats. These operations are cumbersome and can easily lead to traffic accidents while driving, resulting in a poor user experience. Summary of the Invention

[0003] This invention aims to at least partially solve one of the technical problems in related technologies. To this end, the first objective of this invention is to propose an AI (Artificial Intelligence)-based intelligent cockpit interaction system. This system uses an AI engine to, upon receiving a scene selection command, determine a target ECU from at least one ECU based on the control parameters corresponding to the scene selection command, and control the functional devices corresponding to the target ECU to realize the scene selection. Furthermore, when changes in control parameters are detected, the control parameters corresponding to the scene selection command are updated, thereby simplifying user operation, improving driving safety, and enhancing the user's driving experience.

[0004] The second objective of this invention is to provide a vehicle.

[0005] To achieve the above objectives, a first aspect of the present invention proposes an AI-based intelligent cockpit interaction system, which is applied to a vehicle. The system includes: at least one ECU (Electronic Control Unit), which controls the functional devices of the intelligent cockpit; and an AI engine connected to the at least one ECU via a vehicle API (Application Programming Interface). Upon receiving a scene selection command, the AI ​​engine determines a target ECU from the at least one ECU based on control parameters corresponding to the scene selection command, and controls the functional devices corresponding to the target ECU to realize the scene. Furthermore, when a change in the control parameters is detected, the AI ​​engine updates the control parameters corresponding to the scene selection command.

[0006] According to an embodiment of the present invention, the AI-based intelligent cockpit interaction system uses an AI engine to determine the target ECU from at least one ECU based on the control parameters corresponding to the scene selection command when a scene selection command is received, and controls the functional devices corresponding to the target ECU to realize the scene. When a change in the control parameters is detected, the control parameters corresponding to the scene selection command are updated, thereby simplifying the user's operation, improving driving safety, and enhancing the user's driving experience.

[0007] In addition, the AI-based intelligent cockpit interaction system according to the above embodiments of the present invention may further include the following additional technical features:

[0008] According to one embodiment of the present invention, each of the at least one ECU defines an ECU API and is connected to the functional device through the ECU API.

[0009] According to one embodiment of the present invention, the AI ​​engine is further configured to: acquire environmental information of the smart cockpit; and, upon determining that the vehicle is in a safe state, automatically determine a target ECU from the at least one ECU based on the environmental information, and control the functional devices corresponding to the target ECU to improve the comfort of the smart cockpit.

[0010] According to one embodiment of the present invention, the functional device includes at least one of hardware facilities and software facilities.

[0011] According to one embodiment of the present invention, the system further includes a display device for displaying a list of scenes controlled by the AI ​​engine.

[0012] According to one embodiment of the present invention, the scene list includes single-function scenes and multi-function scenes.

[0013] According to one embodiment of the present invention, the multi-functional scene includes: a rest scene, a camping scene, a children's scene, a movie scene, or a karaoke scene; the single-functional scene includes: an air conditioning adjustment scene, a lighting adjustment scene, a sound system adjustment scene, or a seat adjustment scene.

[0014] According to one embodiment of the present invention, the display device is further provided with an AI trigger button, and when the AI ​​trigger button is triggered, the display device is controlled to display the scene list.

[0015] According to one embodiment of the present invention, the AI ​​trigger button is triggered based on the body language of the driver and passenger.

[0016] To achieve the above objectives, a second aspect of the present invention provides a vehicle that includes the AI-based intelligent cockpit interaction system described in the aforementioned embodiments of the present invention.

[0017] According to an embodiment of the present invention, the vehicle employs the AI-based intelligent cockpit interaction system described above. This system enables the AI ​​engine to determine the target ECU from at least one ECU based on the control parameters corresponding to the scene selection command when a scene selection command is received. The system then controls the functional devices corresponding to the target ECU to realize the scene selection. Furthermore, when a change in control parameters is detected, the system updates the control parameters corresponding to the scene selection command, thereby simplifying user operations, improving driving safety, and enhancing the user's driving experience.

[0018] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0019] Figure 1 This is a system architecture diagram of an AI-based intelligent cockpit interaction system according to an embodiment of the present invention;

[0020] Figure 2 This is a flowchart of the AI ​​engine's workflow according to an embodiment of the present invention;

[0021] Figure 3 This is a block diagram of a vehicle according to an embodiment of the present invention. Detailed Implementation

[0022] Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain the present invention, and should not be construed as limiting the present invention.

[0023] The following description, with reference to the accompanying drawings, describes an AI-based intelligent cockpit interaction system and vehicle according to embodiments of the present invention.

[0024] Figure 1 This is a system architecture diagram of an AI-based intelligent cockpit interaction system according to an embodiment of the present invention.

[0025] Specifically, in some embodiments of the present invention, such as Figure 1 As shown, the AI-based intelligent cockpit interaction system 100 is applied to a vehicle, wherein the AI-based intelligent cockpit interaction system 100 includes:

[0026] At least one ECU, such as Figure 1The ECUs, such as ECU1, ECU2, and ECU3, are used to control the functional devices in the smart cockpit. These functional devices include at least one type of hardware and software. The hardware devices include air conditioning, headlights, audio systems, seats, and sunroofs, while the software devices include the operating system, entertainment system software, navigation software, and vehicle status monitoring software. The ECUs mainly perform calculations, processing, and judgments on the information input from various sensors based on the programs and data stored in memory, and then output instructions to control the functional devices in the smart cockpit. For example, when the user adjusts the air conditioning fan speed, the ECU receives the adjustment signal and, based on the internally stored programs and data, controls the air conditioning system to adjust the fan speed parameters to achieve the user-set comfortable environment.

[0027] The AI ​​engine connects to at least one ECU via the Vehicle API. When it receives a scene selection command, the AI ​​engine determines the target ECU from the at least one ECU based on the control parameters corresponding to the scene selection command, and controls the functional devices corresponding to the target ECU to realize the scene. When it detects a change in the control parameters, it updates the control parameters corresponding to the scene selection command.

[0028] Specifically, in this embodiment, such as Figure 1 As shown, the AI ​​engine connects to ECUs such as ECU1, ECU2, and ECU3 via the Vehicle API. The OEM is responsible for defining the Vehicle API, including determining parameters such as the API's ID, name, method, version, applicable vehicle model name, and applicable vehicle model number. The relevant code defined in the specification is as follows:

[0029]

[0030]

[0031] After defining the vehicle API, taking air conditioning activation as an example, you can instruct the air conditioning to be turned on by calling the `callVehicleAPI` function. The relevant code is as follows:

[0032]

[0033] Where 0x0001 represents the API ID, OpenClose indicates on or off, v1.0.0 represents the API version, A represents the vehicle model name, B represents the vehicle model number, and {'opt': 'open'} represents the extensible API parameters.

[0034] When a scene selection command is received, the AI ​​engine determines the target ECU from at least one ECU based on the control parameters corresponding to the scene selection command, and controls the functional devices corresponding to the target ECU by calling the corresponding vehicle API functions to realize the scene. When a change in control parameters is detected, the control parameters corresponding to the scene selection command are updated.

[0035] It should be noted that, as Figure 2 As shown, user actions generate new user data, causing changes in control parameters. These actions include navigation habits, music preferences, video styles, air conditioning temperature, in-car lighting habits, and seat adjustment habits. The AI ​​engine updates the generated Scene and Function based on these user actions. One Scene corresponds to multiple Functions. For example, when entering a rest scene, functions related to the rest scene are activated, such as turning on the air conditioning sleep mode, adjusting the seat to a comfortable angle, turning on ambient lighting, and playing soothing music. If the user feels the air conditioning is too cold and chooses to raise it by 1°C, the AI ​​engine receives the user's action data and updates the air conditioning temperature setting in the Function generated by the AI ​​engine. Consequently, the next time the user enters a rest scene, the air conditioning temperature setting will be the one that the user finds comfortable.

[0036] Furthermore, when the AI ​​engine receives user operation parameter data and detects changes in control parameters, it updates the control parameters corresponding to the scene selection command and then destroys the received user operation data. This protects user privacy, reduces the risk of data leakage, and improves system efficiency.

[0037] Furthermore, in some embodiments of the present invention, at least one ECU defines an ECU API and is connected to a functional device through the ECU API.

[0038] Specifically, in this embodiment, the OEM first manages and maintains the ECU matrix based on the information in the ECU manifest to ensure that the information in the ECU matrix is ​​up-to-date and accurate, thereby improving vehicle performance and safety. The ECU manifest is a document that records detailed information about each electronic control unit (ECU) in the vehicle, including the ECU type, function, and configuration parameters. Secondly, the OEM defines ECU APIs, which define the rules and methods for calling, using, and managing ECUs. These defined ECU APIs are then output as an ECU API specification document, which includes the ECU name, version, ECU parameters, ECU ID, calling method, and API method name. Next, the OEM releases the ECU API specification to suppliers, who develop ECUs according to the specification and send the completed, compliant ECUs to the OEM. Finally, the OEM integrates the compliant ECUs into the vehicle.

[0039] Furthermore, in this embodiment, the AI ​​engine is also used to: acquire environmental information of the smart cockpit; and, when the vehicle is determined to be in a safe state, automatically identify a target ECU from at least one ECU based on the environmental information, and control the functional devices corresponding to the target ECU to improve the comfort of the smart cockpit.

[0040] Specifically, in this embodiment, the environmental information of the smart cockpit includes in-vehicle and out-of-vehicle temperature information, in-vehicle and out-of-vehicle humidity information, light information, and air quality information. When the acquired in-vehicle and out-of-vehicle temperature information is 36°C outside and 34°C inside, and the vehicle is determined to be in a safe state, the AI ​​engine automatically determines the target ECU from at least one ECU based on the in-vehicle and out-of-vehicle temperature information. The target ECU is the ECU related to temperature control, and then the corresponding functional devices of the target ECU are controlled, such as the air conditioning equipment, to reduce the temperature inside the vehicle to 24°C, 25°C, or 26°C, thereby improving the comfort of the smart cockpit.

[0041] When the acquired air quality information indicates that the oxygen content inside the vehicle is low or there are harmful substances such as secondhand smoke, the AI ​​engine automatically identifies the target ECU from at least one ECU based on the temperature information inside and outside the vehicle. The target ECU is the ECU related to the vehicle's ventilation system. The engine then controls the corresponding functional devices of the target ECU, such as controlling the air purification device or ventilation ducts, to ensure that passengers can breathe fresh air, thereby improving the comfort of the smart cockpit.

[0042] It should be noted that the "safe state" refers to the following aspects: In terms of driving state: the vehicle is stationary or in a stable driving state, without dangerous actions such as sudden acceleration, sudden braking, or sharp turns; in terms of external environment: the road conditions around the vehicle are relatively good, without obstacles, traffic congestion, or extreme weather conditions; and in terms of internal system state: the vehicle's braking system, steering system, tire pressure, and airbags are all in normal working condition, without any malfunctions or warning signs. Furthermore, this invention may not specifically limit the "safe state."

[0043] Furthermore, after the AI ​​engine receives environmental information from the smart cockpit and determines that the vehicle is in a safe state, it automatically identifies the target ECU from at least one ECU based on the environmental information and controls the functional devices corresponding to the target ECU. Then, it destroys the received environmental information from the smart cockpit, thereby protecting user privacy, reducing the risk of data leakage, and improving system efficiency.

[0044] Furthermore, in some embodiments of the present invention, the AI-based intelligent cockpit interaction system further includes a display device for displaying a list of scenes controlled by an AI engine.

[0045] Specifically, in this embodiment, the display device is a vehicle central control screen, which includes a UI (User Interface). The UI is used to display a list of scenes controlled by an AI engine. The scene list includes single-function scenes and multi-function scenes. Multi-function scenes include: rest scenes, camping scenes, children's scenes, movie scenes, or karaoke scenes. Single-function scenes include: air conditioning adjustment scenes, lighting adjustment scenes, audio adjustment scenes, or seat adjustment scenes.

[0046] When a user triggers a rest scenario, the AI ​​engine adjusts the air conditioning to a comfortable temperature of 24°C, 25°C, or 26°C, and activates the internal circulation to improve air quality. Regarding lighting, the AI ​​engine dims the interior lights or switches to a softer lighting mode to create a relaxing atmosphere. For the audio system, it plays soft music. For the seats, it automatically adjusts to the most comfortable resting angle or activates the seat massage function to relieve user fatigue. For the windows and sunroof, it closes to isolate external noise and light, ensuring quietness and privacy inside the vehicle. Regarding the security system, the AI ​​engine automatically locks the doors and activates the anti-theft alarm system to ensure safety during rest. Furthermore, this invention does not specifically limit the functions corresponding to triggering a rest scenario.

[0047] Furthermore, in some embodiments of the present invention, the display device is also provided with an AI trigger button, and when the AI ​​trigger button is triggered, the display device is controlled to display a scene list. The scene list includes single-function scenes and multi-function scenes.

[0048] Furthermore, in some embodiments of the present invention, the AI ​​trigger button is triggered based on the body language of the driver and passengers.

[0049] Specifically, in this embodiment, the AI ​​trigger button is triggered based on the body language of the driver and passengers, where body language can be touch, voice, gestures, and eye contact, etc.

[0050] In summary, the AI-based intelligent cockpit interaction system according to the embodiments of the present invention uses an AI engine to determine the target ECU from at least one ECU according to the control parameters corresponding to the scene selection command when a scene selection command is received, and controls the functional device corresponding to the target ECU to realize the scene. When a change in the control parameters is detected, the control parameters corresponding to the scene selection command are updated, thereby simplifying the user's operation, improving driving safety, and enhancing the user's driving experience.

[0051] Figure 3 This is a block diagram of a vehicle according to an embodiment of the present invention.

[0052] like Figure 3 As shown, the vehicle 1000 includes the AI-based intelligent cockpit interaction system 100 of the above embodiments of the present invention.

[0053] According to an embodiment of the present invention, the vehicle employs the AI-based intelligent cockpit interaction system described above. This system enables the AI ​​engine to determine the target ECU from at least one ECU based on the control parameters corresponding to the scene selection command when a scene selection command is received. The system then controls the functional devices corresponding to the target ECU to realize the scene selection. Furthermore, when a change in control parameters is detected, the system updates the control parameters corresponding to the scene selection command, thereby simplifying user operations, improving driving safety, and enhancing the user's driving experience.

[0054] Furthermore, other components and functions of the vehicle in the embodiments of the present invention are known to those skilled in the art, and will not be described in detail here to reduce redundancy.

[0055] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0056] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0057] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0058] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and simplifying the description, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0059] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0060] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components, unless otherwise explicitly limited. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0061] In this invention, unless otherwise explicitly specified and limited, "above" or "below" the second feature can mean that the first feature is in direct contact with the second feature, or that the first feature is in indirect contact with the second feature through an intermediate medium. Furthermore, "above," "over," and "on top" of the second feature can mean that the first feature is directly above or diagonally above the second feature, or simply that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature can mean that the first feature is directly below or diagonally below the second feature, or simply that the first feature is at a lower horizontal level than the second feature.

[0062] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. An AI-based intelligent cockpit interaction system, characterized in that, Applied to vehicles, the system includes: At least one ECU, the ECU being used to control the functional devices of the smart cockpit; The AI ​​engine is connected to the at least one ECU via the vehicle API. When a scene selection instruction is received, the AI ​​engine determines the target ECU from the at least one ECU according to the control parameters corresponding to the scene selection instruction, and controls the functional device corresponding to the target ECU to realize the scene. When the control parameters are detected to have changed, the control parameters corresponding to the scene selection instruction are updated. The AI ​​engine is also used to: acquire environmental information of the smart cockpit; and, when the vehicle is determined to be in a safe state, automatically determine a target ECU from the at least one ECU based on the environmental information, and control the functional devices corresponding to the target ECU to improve the comfort of the smart cockpit. A display device is used to display a list of scenes controlled by the AI ​​engine; The display device is also equipped with an AI trigger button, and when the AI ​​trigger button is triggered, the display device is controlled to display the scene list.

2. The AI-based intelligent cockpit interaction system according to claim 1, characterized in that, Each of the at least one ECU defines an ECU API and connects to the functional device through the ECU API.

3. The AI-based intelligent cockpit interaction system according to any one of claims 1-2, characterized in that, The functional equipment includes at least one of hardware facilities and software facilities.

4. The AI-based intelligent cockpit interaction system according to claim 1, characterized in that, The scenario list includes single-function scenarios and multi-function scenarios.

5. The AI-based intelligent cockpit interaction system according to claim 4, characterized in that, The multi-functional scenarios include: rest scenarios, camping scenarios, children's scenarios, movie scenarios, or karaoke scenarios; the single-functional scenarios include: air conditioning adjustment scenarios, lighting adjustment scenarios, audio adjustment scenarios, or seat adjustment scenarios.

6. The AI-based intelligent cockpit interaction system according to claim 1, characterized in that, The AI-triggered button is activated based on the body language of the driver and passengers.

7. A vehicle, characterized in that, The system includes the AI-based intelligent cockpit interaction system according to any one of claims 1-6.

Images