Vehicle control method, system and vehicle based on user state

Abstract

This invention belongs to the field of vehicle control and provides a vehicle control method, system, and vehicle based on user status. The vehicle control method includes acquiring video information of all users within the vehicle; extracting the identity information and control command information of all users based on the video information; comparing the identity information of all users with identity information in a user information database; when the corresponding user identity information exists in the user information database, controlling the vehicle components to enter an initial state matching the user identity information; when the corresponding user identity information does not exist in the user information database, directly controlling the corresponding vehicle components to perform corresponding actions based on the user's control command information, and using the state of the vehicle components after the actions are completed as the initial state of the vehicle components matching the corresponding user identity information, and storing it along with the user identity information in the user information database.

Description

Technical Field

[0001] This invention belongs to the field of vehicle control, and particularly relates to a vehicle control method, system and vehicle based on user status. Background Technology

[0002] The statements in this section are merely background information related to the present invention and do not necessarily constitute prior art.

[0003] In vehicle control, volume adjustment, air conditioning adjustment, seat adjustment, etc. are currently all controlled manually. This makes it difficult to control while driving and may also pose a threat to vehicle driving safety.

[0004] The inventors discovered that some existing vehicle control services generate control commands based on the user's gaze and semantic information or through a single monitoring signal; however, the problem with this technical solution is that it does not consider user identity information, the signal is singular, and it is prone to erroneous responses and commands that are misoperated. Summary of the Invention

[0005] To address the technical problems mentioned above, this invention provides a vehicle control method, system, and vehicle based on user status, which enables more convenient operation of vehicle components based on user identity information and reduces misoperation.

[0006] To achieve the above objectives, the present invention adopts the following technical solution:

[0007] The first aspect of the present invention provides a vehicle control method based on user status.

[0008] In one or more embodiments, a vehicle control method based on user state includes:

[0009] Acquire video information of all users inside the vehicle, and extract the identity information and control command information of all users based on the video information;

[0010] The system compares the identity information of all users with the identity information in the user information database, and controls the vehicle components based on the identity information comparison results and control command information; the user information database pre-stores user identity information and the initialization status of the vehicle components that match them.

[0011] When the corresponding user identity information exists in the user information database, the vehicle control components are in an initialization state that matches the user identity information;

[0012] When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information. The state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information.

[0013] A second aspect of the present invention provides a vehicle control system based on user status.

[0014] In one or more embodiments, a vehicle control system based on user state includes:

[0015] The information extraction module is used to acquire video information of all users in the vehicle and extract the identity information and control command information of all users based on the video information.

[0016] The vehicle control module is used to compare the identity information of all users with the identity information in the user information database, and control the vehicle components according to the identity information comparison results and control command information; wherein, the user information database pre-stores the user identity information and the initialization status of the vehicle components that match it.

[0017] When the corresponding user identity information exists in the user information database, the vehicle control components are in an initialization state that matches the user identity information;

[0018] When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information. The state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information.

[0019] In other embodiments, a vehicle control system based on user state includes:

[0020] The video acquisition module is used to collect video information of all users inside the vehicle and transmit it to the vision controller module.

[0021] The vision controller module is used to extract the identity information and control command information of all users based on video information and transmit them to the domain controller module through the vehicle communication module.

[0022] The domain controller module communicates with the body controller system. The domain controller module is used to compare the identity information of all users with the identity information in the user information database, and generate control commands based on the comparison results and send them to the body controller system. The body controller system then controls the vehicle components to perform corresponding actions. The user information database pre-stores user identity information and the initialization status of the vehicle components that match it.

[0023] When the corresponding user identity information exists in the user information database, the vehicle control components are in an initialization state that matches the user identity information;

[0024] When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information. The state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information.

[0025] A third aspect of the present invention provides a vehicle.

[0026] In one or more embodiments, a vehicle includes a user-state-based vehicle control system as described above.

[0027] Compared with the prior art, the beneficial effects of the present invention are:

[0028] This invention utilizes user identity information, control command information, and the initial state of the corresponding vehicle components, which are all pre-stored and then used to control vehicle components based on the identity information comparison results and control command information. This improves the accuracy and portability of vehicle control, avoids misoperation, and enhances the user's comfort experience.

[0029] Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0030] The accompanying drawings, which form part of this invention, are used to provide a further understanding of the invention. The illustrative embodiments of the invention and their descriptions are used to explain the invention and do not constitute an improper limitation of the invention.

[0031] Figure 1 This is a flowchart of a vehicle control method based on user status according to Embodiment 1 of the present invention;

[0032] Figure 2 This is a structural diagram of the vehicle control system based on user status according to Embodiment 2 of the present invention;

[0033] Figure 3 This is a structural diagram of the vehicle control system based on user status according to Embodiment 3 of the present invention;

[0034] Figure 4 This is a flowchart of the vehicle control method based on user status according to Embodiment 3 of the present invention. Detailed Implementation

[0035] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0036] It should be noted that the following detailed description is illustrative and intended to provide further explanation of the invention. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains.

[0037] It should be noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of exemplary embodiments according to the invention. As used herein, the singular form is intended to include the plural form as well, unless the context clearly indicates otherwise. Furthermore, it should be understood that when the terms "comprising" and / or "including" are used in this specification, they indicate the presence of features, steps, operations, devices, components, and / or combinations thereof.

[0038] The vehicles in this invention include new energy vehicles, sedans, SUVs, MPVs, commercial vehicles, etc. These vehicles need to be equipped with a product containing a communication module.

[0039] Example 1

[0040] Reference Figure 1 This embodiment provides a vehicle control method based on user status, which includes:

[0041] Step 1: Obtain video information of all users inside the vehicle, and extract the identity information and control command information of all users based on the video information.

[0042] In the specific implementation of step 1, morphological algorithms are used to extract the identity information and control command information of all users from the videos of all users inside the vehicle.

[0043] For example, the process of extracting all users' identity information based on video information is as follows:

[0044] By capturing facial features from an image and analyzing the facial information, the user's identity is confirmed by comparing the facial information with a database of faces.

[0045] In some specific embodiments, the control command information is action information (such as crying, fatigue, making a heart shape with hands, making a peace sign, etc.), and the action information includes body movement information and eye gaze action information. For example, when the in-vehicle camera detects that a user is crying through image information, it will send a message to the user's designated "closest person" to inform that the passenger is in a bad mood and needs comforting.

[0046] In some specific embodiments, the control command information is voice information. For example, when a user says "turn on the radio," the car radio can be turned on.

[0047] In some other embodiments, the control command information is collaborative control action information and voice information, and the action information includes body movement information and eye gaze action information. For example, when a user looks at the passenger side window and says "open the window," the passenger side window can be opened; the same applies to: left and right rearview mirrors, left and right windows, central control screen, instrument panel, etc., such as looking at the central control screen and saying "turn up the brightness," etc.

[0048] Step 2: Compare the identity information of all users with the identity information in the user information database, and control vehicle components (such as windows, seats, vehicle communication equipment, etc.) based on the identity information comparison results and control command information.

[0049] The user information database pre-stores user identity information and the initialization status of vehicle components that match it.

[0050] When the corresponding user identity information exists in the user information database, the vehicle control components are in an initialization state that matches the user identity information;

[0051] When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information. The state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information.

[0052] For example, when a user gets into the car, the system detects the user's information. If the user's information is already in the user information database, the system will automatically adjust the height, position, and direction of the seat and rearview mirrors based on the information the user has saved, so that the user's body is in the most comfortable state as soon as they get into the car.

[0053] In some other embodiments, when the corresponding user identity information exists in the user information database, after the vehicle components are in an initialization state matching the user identity information, the corresponding vehicle components are controlled to perform corresponding actions according to the user's control instructions. This allows the state of the vehicle components to be adjusted at any time according to user needs.

[0054] Specifically, the initial state of the vehicle's corresponding component actions, along with the user's identity information and control command information, constitute dependency information and are pre-stored. This embodiment utilizes the pre-stored dependency of user identity information, control command information, and the initial state of the vehicle's corresponding component actions, and then controls the vehicle components based on the identity information comparison result and control command information, thereby improving the accuracy and portability of vehicle control and avoiding misoperation.

[0055] Example 2

[0056] Reference Figure 2This embodiment provides a vehicle control system based on user status, which includes:

[0057] The information extraction module is used to acquire video information of all users in the vehicle and extract the identity information and control command information of all users based on the video information.

[0058] For example, the process of extracting all users' identity information based on video information is as follows:

[0059] By capturing facial features from an image and analyzing the facial information, the user's identity is confirmed by comparing the facial information with a database of faces.

[0060] In some specific embodiments, the control command information is action information (such as crying, fatigue, making a heart shape with hands, making a peace sign, etc.), and the action information includes body movement information and eye gaze action information. For example, when the in-vehicle camera detects that a user is crying through image information, it will send a message to the user's designated "closest person" to inform that the passenger is in a bad mood and needs comforting.

[0061] In some specific embodiments, the control command information is voice information. For example, when a user says "turn on the radio," the car radio can be turned on.

[0062] In some other embodiments, the control command information is collaborative control action information and voice information, and the action information includes body movement information and eye gaze action information. For example, when a user looks at the passenger side window and says "open the window," the passenger side window can be opened; the same applies to: left and right rearview mirrors, left and right windows, central control screen, instrument panel, etc., such as looking at the central control screen and saying "turn up the brightness," etc.

[0063] The vehicle control module is used to compare the identity information of all users with the identity information in the user information database, and control vehicle components (such as windows, seats, vehicle communication equipment, etc.) based on the identity information comparison results and control command information.

[0064] The user information database pre-stores user identity information and the initialization status of vehicle components that match it.

[0065] When the corresponding user identity information exists in the user information database, the vehicle control components are in an initialization state that matches the user identity information;

[0066] When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information. The state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information.

[0067] For example, when a user gets into the car, the system detects the user's information. If the user's information is already in the user information database, the system will automatically adjust the height, position, and direction of the seat and rearview mirrors based on the information the user has saved, so that the user's body is in the most comfortable state as soon as they get into the car.

[0068] In some other embodiments, when the corresponding user identity information exists in the user information database, after the vehicle components are in an initialization state matching the user identity information, the corresponding vehicle components are controlled to perform corresponding actions according to the user's control instructions. This allows the state of the vehicle components to be adjusted at any time according to user needs.

[0069] Specifically, the initial state of the vehicle's corresponding component actions, along with the user's identity information and control command information, constitute dependency information and are pre-stored. This embodiment utilizes the pre-stored dependency of user identity information, control command information, and the initial state of the vehicle's corresponding component actions, and then controls the vehicle components based on the identity information comparison result and control command information, thereby improving the accuracy and portability of vehicle control and avoiding misoperation.

[0070] It should be noted that each module in this embodiment corresponds one-to-one with each step in Embodiment 1, and their specific implementation processes are the same, so they will not be repeated here.

[0071] Example 3

[0072] Reference Figure 3 and Figure 4 This embodiment provides a vehicle control system based on user status, which includes:

[0073] The video acquisition module is used to collect video information of all users inside the vehicle and transmit it to the vision controller module.

[0074] The vision controller module is used to extract the identity information and control command information of all users based on video information and transmit them to the domain controller module through the vehicle communication module.

[0075] The domain controller module communicates with the body controller system. The domain controller module is used to compare the identity information of all users with the identity information in the user information database, and generate control commands based on the comparison results and send them to the body controller system. The body controller system then controls the vehicle components to perform corresponding actions. The user information database pre-stores user identity information and the initialization status of the vehicle components that match it.

[0076] When the corresponding user identity information exists in the user information database, the vehicle control components are in an initialization state that matches the user identity information;

[0077] When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information. The state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information.

[0078] In some embodiments, the control instruction information is action information, which includes body movement information and eye gaze action information.

[0079] In other embodiments, the control command information is voice information.

[0080] In this embodiment, the control command information is collaborative control action information and voice information, and the action information includes body action information and eye gaze action information.

[0081] The video acquisition module can be implemented using a DMS / OMS / RMS camera 1.

[0082] In this embodiment, the DMS / OMS / RMS cameras are: driver's seat / passenger seat / rear seat camera.

[0083] Vehicle communication module: This product has the ability to communicate via the network and exchange information within the vehicle's internal network.

[0084] Domain Controller Module: The domain controller is the core of each functional domain in a vehicle. It mainly consists of three parts: the domain master processor, the operating system, and application software and algorithms. It is generally referred to as the "host".

[0085] The vision controller module monitors the user's status through a camera, analyzes and processes the acquired images, extracts features through morphological algorithms, compares data, and outputs data. It also processes the images in layers according to information such as pixel distribution, brightness, and color, and converts them into digital signals for external transmission.

[0086] Vehicle Networking Backend: The enterprise's vehicle networking service platform.

[0087] Reference Figure 3 and Figure 4 :

[0088] 1) When the vehicle system is started, the DMS / OMS / RMS camera 1 starts to work to collect user images and convert brightness and color into digital signals: compare the face image with the face database.

[0089] 2) When the digital signal information converted by the vision controller 2 is personnel information, the vehicle communication module 3 will take out the information in the vehicle network background 7 for comparison and analysis. If the analysis shows that the current passenger information has been saved in the vehicle network background 7, the vehicle body controller system 6 will execute the data parameters of the vehicle network background 7. For example, when a user who has saved data in the cloud gets in the car, the height, position and direction of the seat and rearview mirror will be automatically adjusted according to the information saved by the user.

[0090] 3) The digital signals converted by the vision controller 2 are action information: crying, fatigue, making a heart shape with hands, making a peace sign, etc. The information stored in the domain controller module 5 will automatically extract and compare each pre-input dependency. If all dependencies are met, the vehicle control system 6 will execute the action according to the pre-input parameters. For example, when the user looks at the passenger window and says "open the window", the passenger window will open. (The same applies to: left and right rearview mirrors, left and right windows, central control screen, instrument panel, etc., such as looking at the central control screen and saying "turn up the brightness", etc.)

[0091] 4) When the digital signal converted by the vision controller 2 is personnel information, if the information in the vehicle network backend 7 is successfully compared with the digital signal by the vehicle communication module 3, and if the action information converted by the vision controller 2 is also successfully compared with the information in the vehicle network backend 7, the vehicle network backend 7 will be operated through the vehicle communication module 3 according to the data stored in the domain controller 5: when the in-vehicle camera detects that the user is crying through image information, a message will be sent to the "closest person" set by the user to inform the other party that the passenger is in a bad mood and needs comfort.

[0092] When the information is identity information, it is compared with the identity information stored in the vehicle network backend. If the identity information already exists in the backend, the parameters already saved in the backend data are automatically retrieved. When the information is action information, if this type of information is stored in the domain controller, the information is compared, and then compared with other dependencies in the saved data, comparing each dependency information.

[0093] This embodiment enhances the vehicle's intelligence by coordinating eye and voice commands to enable vehicle control operations in designated areas. For example, by looking at the passenger-side window and saying "open the window," the passenger-side window can be opened. (This also applies to the left and right rearview mirrors, left and right windows, the central control screen, the instrument panel, etc. For example, by looking at the central control screen and saying "increase the brightness," etc.)

[0094] This embodiment improves the convenience of vehicle control: it makes operation more convenient for users, reduces the need to tap the screen while driving, and if the vehicle system is in a scenario that requires user confirmation / cancellation, the user only needs to nod / shake their head to confirm / cancel the operation.

[0095] This embodiment enhances the user's comfort experience: when a user gets into the car, the camera detects the user, and if the user information is already available in the cloud, the seat and rearview mirror height, position, and direction are automatically adjusted based on the information the user has saved, so that the user's body is in the most comfortable state as soon as they get into the car.

[0096] Example 4

[0097] This embodiment provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the user-state-based vehicle control method described above.

[0098] Example 5

[0099] This embodiment provides a vehicle that includes a user-state-based vehicle control system as described above.

[0100] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, as well as combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0101] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A vehicle control method based on user state, characterized in that, include: Acquire video information of all users inside the vehicle, and extract the identity information and control command information of all users based on the video information; The system monitors the user's status through a camera, analyzes and processes the collected images, extracts features through morphological algorithms, compares data and outputs data externally, and processes the images in layers according to pixel distribution, brightness, and color information, converting them into digital signals for external transmission. All user identity information is compared with the identity information in the user information database, and vehicle components are controlled according to the identity information comparison results and control command information. The vehicle components include, but are not limited to, windows, seats, and vehicle communication devices. The user information database pre-stores user identity information and the initialization status of the vehicle components that match it. When the corresponding user identity information exists in the user information database, the vehicle components are controlled to be in an initialization state that matches the user identity information. Then, the corresponding vehicle components are controlled to perform corresponding actions according to the user's control command information. When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information, and the state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information. When the vehicle's infotainment system is started, the DMS / OMS / RMS cameras capture images of the user and convert brightness and color into digital signals; then the facial images are compared with facial images in the database. When the digital signal information converted by the vision controller is personnel information, the vehicle communication module will retrieve the information from the vehicle network backend for comparison and analysis. If the analysis shows that the current passenger information has been saved in the vehicle network backend, the vehicle controller system will execute the vehicle network backend data parameters. When the digital signal information converted by the vision controller is action information, the information stored in the domain controller module will automatically extract and compare each pre-input dependency. If each dependency is satisfied, the body control system will execute the action according to the pre-input parameters. When the digital signal information converted by the vision controller is personnel information, and the vehicle communication module successfully compares the information in the vehicle network backend with the digital signal, if the action information converted by the vision controller is also successfully compared with the information in the vehicle network backend, the vehicle network backend is operated through the vehicle communication module according to the data stored in the domain controller.

2. The vehicle control method based on user state as described in claim 1, characterized in that, The initial state of the corresponding vehicle components, together with the user's identity information and control command information, constitutes dependency information and is pre-stored.

3. The vehicle control method based on user state as described in claim 1, characterized in that, The control command information is action information, which includes body movement information and eye gaze action information.

4. The vehicle control method based on user state as described in claim 1, characterized in that, The control command information is voice information.

5. The vehicle control method based on user state as described in claim 1, characterized in that, The control command information consists of collaborative control action information and voice information, and the action information includes body movement information and eye gaze action information.

6. A vehicle control system based on user status, characterized in that, include: The information extraction module is used to acquire video information of all users in the vehicle and extract the identity information and control command information of all users based on the video information. The system monitors the user's status through a camera, analyzes and processes the collected images, extracts features through morphological algorithms, compares data and outputs data externally, and processes the images in layers according to pixel distribution, brightness, and color information, converting them into digital signals for external transmission. The vehicle control module is used to compare the identity information of all users with the identity information in the user information database, and control the vehicle components according to the identity information comparison results and control command information. The vehicle components include, but are not limited to, windows, seats, and vehicle communication devices. The user information database pre-stores user identity information and the initialization status of the vehicle components that match it. When the corresponding user identity information exists in the user information database, the vehicle components are controlled to be in an initialization state that matches the user identity information. Then, the corresponding vehicle components are controlled to perform corresponding actions according to the user's control command information. When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information, and the state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information. When the vehicle's infotainment system is started, the DMS / OMS / RMS cameras capture images of the user and convert brightness and color into digital signals; then the facial images are compared with facial images in the database. When the digital signal information converted by the vision controller is personnel information, the vehicle communication module will retrieve the information from the vehicle network backend for comparison and analysis. If the analysis shows that the current passenger information has been saved in the vehicle network backend, the vehicle controller system will execute the vehicle network backend data parameters. When the digital signal information converted by the vision controller is action information, the information stored in the domain controller module will automatically extract and compare each pre-input dependency. If each dependency is satisfied, the body control system will execute the action according to the pre-input parameters. When the digital signal information converted by the vision controller is personnel information, and the vehicle communication module successfully compares the information in the vehicle network backend with the digital signal, if the action information converted by the vision controller is also successfully compared with the information in the vehicle network backend, the vehicle network backend is operated through the vehicle communication module according to the data stored in the domain controller.

7. The vehicle control system based on user status as described in claim 6, characterized in that, The initial state of the corresponding vehicle components, together with the user's identity information and control command information, constitutes dependency information and is pre-stored.

8. A vehicle control system based on user status, characterized in that, include: The video acquisition module is used to collect video information of all users inside the vehicle and transmit it to the vision controller module. The system monitors the user's status through a camera, analyzes and processes the collected images, extracts features through morphological algorithms, compares data and outputs data externally, and processes the images in layers according to pixel distribution, brightness, and color information, converting them into digital signals for external transmission. The vision controller module is used to extract the identity information and control command information of all users based on video information and transmit them to the domain controller module through the vehicle communication module. The domain controller module communicates with the body controller system. The domain controller module compares the identity information of all users with the identity information in the user information database, and generates control commands based on the comparison results and sends them to the body controller system. The body controller system then controls the vehicle components to perform corresponding actions. The vehicle components include, but are not limited to, windows, seats, and in-vehicle communication devices. The user information database pre-stores user identity information and the initialization status of the vehicle components that match it. When the corresponding user identity information exists in the user information database, the vehicle components are controlled to be in an initialization state that matches the user identity information. Then, the corresponding vehicle components are controlled to perform corresponding actions according to the user's control command information. When the corresponding user identity information is not in the user information database, the corresponding vehicle component is directly controlled to perform the corresponding action according to the user's control command information, and the state of the corresponding vehicle component after the action is completed is used as the initial state of the vehicle component matched with the corresponding user identity information, and stored in the user information database along with the user identity information. When the vehicle's infotainment system is started, the DMS / OMS / RMS cameras capture images of the user and convert brightness and color into digital signals; then the facial images are compared with facial images in the database. When the digital signal information converted by the vision controller is personnel information, the vehicle communication module will retrieve the information from the vehicle network backend for comparison and analysis. If the analysis shows that the current passenger information has been saved in the vehicle network backend, the vehicle controller system will execute the vehicle network backend data parameters. When the digital signal information converted by the vision controller is action information, the information stored in the domain controller module will automatically extract and compare each pre-input dependency. If each dependency is satisfied, the body control system will execute the action according to the pre-input parameters. When the digital signal information converted by the vision controller is personnel information, and the vehicle communication module successfully compares the information in the vehicle network backend with the digital signal, if the action information converted by the vision controller is also successfully compared with the information in the vehicle network backend, the vehicle network backend is operated through the vehicle communication module according to the data stored in the domain controller.

9. A vehicle, characterized in that, Including a user-state-based vehicle control system as described in any one of claims 6-7.

Images