Methods, systems, devices, media, products, and vehicles for controlling a vehicle

Abstract

The embodiment of the application discloses a kind of methods for controlling vehicle, system, equipment, medium, product and vehicle, it is related to vehicle technical field, method includes: in the case where received voice control instruction, the user instruction information corresponding to voice control instruction is acquired, voice control instruction is used to indicate that vehicle executes target function for first user, user instruction information is used to indicate first user;According to user instruction information, the reference face image of first user is determined, and according to reference face image, and the face monitoring image that camera in vehicle is collected is carried out face matching to determine the target ride position of first user in vehicle;In response to voice control instruction, control the target function component of multiple function components corresponding to target ride position executes target function, whole control process combines voice and visual recognition technology, can accurately identify user intent, improve the accuracy of voice control.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and more particularly to a method, system, device, medium, product, and vehicle for controlling a vehicle. Background Technology

[0002] With the continuous upgrading of consumer demands, the automotive industry has experienced rapid development from gasoline vehicles to electric vehicles, and then to intelligent vehicles. Voice control has become one of the important human-machine interaction methods in the field of intelligent vehicles. The application of voice control not only enhances the driving experience but also injects new vitality into in-car life. For example, in-car voice assistants can perform various operations based on the driver's voice commands, thereby greatly reducing the operational burden during driving. However, the voice control technology in related fields cannot accurately recognize user intentions, resulting in low accuracy.

[0003] Application content

[0004] In view of this, one of the purposes of this application is to provide a method, system, device, medium, product and vehicle for controlling a vehicle, which can accurately identify user intent and has a low accuracy rate for voice control.

[0005] To achieve the above objectives, the technical solution of this application is implemented as follows:

[0006] In a first aspect, embodiments of this application provide a method for controlling a vehicle, including:

[0007] Upon receiving a voice control command, the user instruction information corresponding to the voice control command is obtained. The voice control command is used to instruct the vehicle to perform a target function for the first user, and the user instruction information is used to instruct the first user. The vehicle includes multiple functional components, and each functional component is pre-associated with a seating position inside the vehicle.

[0008] Based on the user's instructions, determine the reference face image of the first user;

[0009] Face matching is performed based on reference facial images and facial monitoring images captured by cameras inside the vehicle to determine the target seating position of the first user in the vehicle.

[0010] In response to voice control commands, the target functional component corresponding to the target seating position among multiple functional components is controlled to perform the target function.

[0011] In one possible implementation, obtaining user instruction information corresponding to the voice control command includes:

[0012] Determine the location where the voice control command is issued;

[0013] The facial image of the second user sitting at the location where the voice was made is obtained from the facial monitoring images captured by the camera inside the vehicle;

[0014] Based on the second user's facial image, determine the second user's voice control permission information;

[0015] If the voice control permission information indicates that the second user is a user with voice control permission, obtain the user instruction information corresponding to the voice control command.

[0016] In one possible implementation, in response to a voice control command, the target functional component corresponding to the target seating position among a plurality of functional components is controlled to perform a target function, including:

[0017] In response to voice control commands, the permission level of the second user is determined based on voice control permission information;

[0018] Based on the access level, control the target functional component corresponding to the target seating position to execute the target function among multiple functional components;

[0019] Under different permission operation levels, the target functional component will have different execution results when performing the target function.

[0020] In one possible implementation, before obtaining the user instruction information corresponding to the received voice control command, the method further includes:

[0021] Control the surveillance cameras inside the vehicle to capture facial images of the occupants.

[0022] The face images in the face surveillance images are matched with the preset registered face images to obtain the matching results;

[0023] If the matching result indicates that a face image exists in the face monitoring image that matches the preset registered face image, the vehicle's voice monitoring function will be activated.

[0024] Among them, voice control commands are received when the voice monitoring function is activated.

[0025] In one possible implementation, controlling the target functional component corresponding to the target seating position among multiple functional components to perform the target function includes:

[0026] Based on the reference facial image, user group information is obtained, which is used to indicate the user group to which the first user belongs;

[0027] Based on user group information, among multiple preset control modes associated with the target function, the target control mode corresponding to the user group to which the first user belongs is determined. The processing procedures for executing the target function differ under different preset control modes.

[0028] Based on the target control mode, control the target functional component corresponding to the target seating position among multiple functional components to execute the target function.

[0029] In one possible implementation, different preset control modes are pre-configured with different control weights among a variety of preset control modes;

[0030] According to the target control mode, the target functional component corresponding to the target seating position among multiple functional components is controlled to execute the target function, including:

[0031] When the voice control command is a command with ambiguous semantics and is used to indicate the control parameters for adjusting the target function, obtain the standard control parameters of the target function and the target weight value of the target control mode.

[0032] Based on the standard control parameters and target weight values, determine the target control parameters for the target function;

[0033] Based on the target control parameters, control the target functional component corresponding to the target seating position among multiple functional components to execute the target function.

[0034] Secondly, embodiments of this application provide a system for controlling a vehicle, the system comprising:

[0035] The first determining module is used to determine the key features in the detected voice control commands;

[0036] The second determining module is used to determine the face data label corresponding to the key feature based on the first association relationship, wherein the first association relationship includes the association relationship between the key feature and the face data label;

[0037] The third determining module is used to determine the standard face image corresponding to the face data label based on the second association relationship. The standard face image is a registered face image.

[0038] The fourth determination module is used to determine the target face image that matches the standard face image from the face monitoring images of the occupants in the vehicle;

[0039] The control module is used to control at least one functional component associated with the target seat according to voice control commands when the target facial image corresponds to the target seat of the passenger.

[0040] Thirdly, embodiments of this application provide an electronic device, which includes a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, it implements the method for controlling a vehicle provided in the first aspect.

[0041] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program, which, when executed by one or more processors, implements the method for controlling a vehicle provided in the first aspect.

[0042] Fifthly, embodiments of this application provide a computer program product comprising a computer program that, when executed by one or more processors, implements the method for controlling a vehicle provided in the first aspect.

[0043] Sixthly, embodiments of this application provide a vehicle that includes at least one of the following:

[0044] Such as the second aspect: vehicle control systems;

[0045] Such as electronic devices in the third aspect;

[0046] Such as the computer-readable storage medium in the fourth aspect.

[0047] This application provides a method for controlling a vehicle. Upon receiving a voice control command, the method acquires user instruction information corresponding to the voice control command. The voice control command instructs the vehicle to perform a target function for a first user, and the user instruction information instructs the first user. Then, based on the user instruction information, a reference facial image of the first user is determined. Face matching is then performed between the reference facial image and a facial monitoring image captured by a camera inside the vehicle to determine the first user's target seating position within the vehicle. Finally, in response to the voice control command, the method controls the target functional component corresponding to the target seating position to perform the target function. The entire control process combines voice and visual recognition technologies, enabling accurate recognition of user intentions and improving the accuracy of voice control. Attached Figure Description

[0048] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. It should be understood that the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0049] Figure 1 A flowchart illustrating a method for controlling a vehicle, as provided in an embodiment of this application;

[0050] Figure 2 A display interface diagram related to a method for controlling a vehicle provided in an embodiment of this application;

[0051] Figure 3 Another display interface involved in a method for controlling a vehicle provided in an embodiment of this application;

[0052] Figure 4 Another display interface involved in a method for controlling a vehicle provided in an embodiment of this application;

[0053] Figure 5 Another display interface involved in a method for controlling a vehicle provided in an embodiment of this application;

[0054] Figure 6 This application provides a schematic diagram of the functional modules of a vehicle control system.

[0055] Figure 7 This is a diagram illustrating the internal structure of an electronic device as provided in an embodiment of this application. Detailed Implementation

[0056] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0057] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0058] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0059] In various embodiments of this application, the expression "or" or "at least one of A and / or B" includes any combination or all combinations of the words listed simultaneously. For example, the expression "A or B" or "at least one of A and / or B" may include A, may include B, or may include both A and B.

[0060] In the description of this application, it should be noted that if terms such as "upper," "lower," "inner," or "outer" are used to indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, or the orientation or positional relationship in which the product of the invention is usually placed during use, they are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application.

[0061] Furthermore, the terms "first" and "second" are used only to distinguish descriptions and should not be interpreted as indicating or implying relative importance.

[0062] It should be noted that, where there is no conflict, the features in the embodiments of this application can be combined with each other.

[0063] Furthermore, in the embodiments of this application, the term "connection" can refer to "electrical connection" or "direct connection." "Electrical connection" can refer to two components being directly electrically connected, or it can refer to two components being electrically connected via one or more normally open tubes or other components.

[0064] To address the technical problems in the background art, embodiments of this application provide a method, system, device, medium, product, and vehicle for controlling a vehicle. The method for controlling a vehicle provided in this application embodiment will be described first below.

[0065] Please see Figure 1 , Figure 1 This application provides a flowchart of a method for controlling a vehicle, which can be applied to vehicle control systems and electronic devices described in the following embodiments. These electronic devices include personal computers, servers, mobile devices, cloud computing platforms, and supercomputers. The method for controlling a vehicle will be described below from the perspective of its application to electronic devices, and specifically includes the following steps:

[0066] Step 110: Upon receiving a voice control command, obtain the user instruction information corresponding to the voice control command. The voice control command is used to instruct the vehicle to perform a target function for the first user, and the user instruction information is used to instruct the first user. The vehicle includes multiple functional components, and each functional component is pre-associated with a seating position within the vehicle.

[0067] Step 120: Determine the reference face image of the first user based on the user's instructions.

[0068] Step 130: Perform face matching based on the reference face image and the face monitoring image captured by the camera inside the vehicle to determine the target seating position of the first user in the vehicle.

[0069] Step 140: In response to the voice control command, control the target functional component corresponding to the target seating position among multiple functional components to perform the target function.

[0070] This application provides a method for controlling a vehicle. Upon receiving a voice control command, the method acquires user instruction information corresponding to the voice control command. The voice control command instructs the vehicle to perform a target function for a first user, and the user instruction information instructs the first user. Then, based on the user instruction information, a reference facial image of the first user is determined. Face matching is then performed between the reference facial image and a facial monitoring image captured by a camera inside the vehicle to determine the first user's target seating position within the vehicle. Finally, in response to the voice control command, the method controls the target functional component corresponding to the target seating position to perform the target function. The entire control process combines voice and visual recognition technologies, enabling accurate recognition of user intentions and improving the accuracy of voice control.

[0071] The following will discuss how Figure 1 The steps of the Chinese method are explained in detail.

[0072] In step 110, the electronic device receives a voice control command.

[0073] Voice control commands can refer to commands that users use to control devices or applications through voice input. Accordingly, in this embodiment, the voice control commands received by the electronic device can be used to control at least one functional component on the vehicle to achieve the corresponding target function, so as to achieve the control intent corresponding to the voice control command.

[0074] The first user is the user included in the voice control command. The electronic device can identify the first user through the user instruction information in the voice control command. Specifically, the electronic device can identify the identity information of the first user through the user instruction information in the voice control command.

[0075] In some embodiments, the user instruction information includes the name of the first user, so that the electronic device can quickly determine the identity information of the first user based on the user instruction information.

[0076] In some embodiments, the electronic device may determine the method for obtaining user instruction information corresponding to the voice control command based on the specific format of the voice control command.

[0077] Specifically, if the voice control command has not undergone format conversion and is still in voice format, the electronic device can use the slot extraction method to obtain the user instruction information corresponding to the voice control command.

[0078] If the voice control command has been formatted and converted into text format, the electronic device can use keyword extraction to obtain the user instruction information corresponding to the voice control command.

[0079] The vehicle includes various functional components, including but not limited to in-vehicle air conditioning, in-vehicle audio, and ambient lighting. Each functional component is pre-associated with a passenger position within the vehicle, and these pre-associated relationships can be modified according to actual needs.

[0080] For example, functional components that are pre-associated with the passenger seat of the vehicle may include ventilation and air conditioning on the passenger seat, windows near the passenger seat, etc.

[0081] In step 120, the reference face image is a face image that has been registered on the vehicle side. In some embodiments, there is a mapping relationship between user instruction information and the reference face image, based on which the electronic device can quickly determine the reference face image of the first user.

[0082] In step 130, the electronic device can control the camera inside the vehicle to capture facial monitoring images of the occupants inside the vehicle. While capturing facial monitoring images, the camera can also record the location of the occupant corresponding to the facial monitoring image.

[0083] By comparing a facial image with a facial surveillance image, if a match is successful, it indicates that the passenger corresponding to the facial surveillance image has registered their facial image with the vehicle. In other words, the passenger corresponding to the facial surveillance image is the first user, and the electronic device can then determine the first user's target seating position within the vehicle.

[0084] In step 140, after determining the first user and the target seating location of the first user, the electronic device can respond to the received voice control command to control the target functional component corresponding to the target seating location to perform the target function.

[0085] If the voice control command is "Turn on Zhang San's seat ventilation", the implementation process is as follows:

[0086] Based on the steps described above, the electronic device can identify the first user "Zhang San" through the received voice control commands;

[0087] Then, find the reference face image corresponding to "Zhang San" in the face images registered on the vehicle to confirm that "Zhang San" is a person whose face image has been registered on the vehicle.

[0088] Next, the camera inside the vehicle can identify the face of the first user "Zhang San" from the captured face monitoring images, and at the same time determine that the target sitting position of "Zhang San" in the vehicle is the front passenger seat;

[0089] Finally, after the electronic device identifies Zhang San, his target seating position as the front passenger seat, and the target functional components corresponding to the front passenger seat, it can control the seat ventilation and air conditioning on the front passenger seat according to the corresponding control intent of the voice control command. This can accurately recognize the user's intent and improve the accuracy of voice control.

[0090] In one possible implementation, obtaining user instruction information corresponding to the voice control command includes:

[0091] Determine the location where the voice control command is issued;

[0092] The facial image of the second user sitting at the location where the voice was made is obtained from the facial monitoring images captured by the camera inside the vehicle;

[0093] Based on the second user's facial image, determine the second user's voice control permission information;

[0094] If the voice control permission information indicates that the second user is a user with voice control permission, obtain the user instruction information corresponding to the voice control command.

[0095] This application embodiment can determine whether the second user has voice control permissions by identifying the facial image of the second user who issued the voice control command. If the second user is determined to have voice control permissions, the step of obtaining the user instruction information corresponding to the voice control command is executed. Otherwise, the step of obtaining the user instruction information corresponding to the voice control command is not executed, which can save the data processing power consumption of the electronic device and free up the data processing resources of the electronic device.

[0096] The second user sits at the location where the voice command is issued, and can be considered as the user issuing the voice control command.

[0097] Voice control permission information refers to the permissions that the system needs to obtain when a user uses the voice control function in order to correctly recognize and respond to the user's voice commands. These permissions may include access to the microphone, use of the user's location information, access to the user's contacts, and control of at least one functional component within the vehicle.

[0098] Specifically, voice control permissions are linked to facial images. For example, if the second user is a user who has already registered their facial image on the vehicle, then voice control permissions can be assigned to the second user when they register their facial image.

[0099] In some embodiments, multiple microphones already deployed in the vehicle can be used to capture sound signals. Considering that, under normal circumstances, multiple microphones already deployed in the vehicle are arranged according to certain rules to form a microphone array, the sound source can be located by detecting the time difference of sound arriving at different microphones based on the microphone array, thereby determining the location where the voice control command is issued.

[0100] In some embodiments, a camera can be used to monitor vehicle occupants in real time, and the user making the speech and the location where the speech is uttered can be determined by monitoring changes in the lip movements of people in the video stream in real time.

[0101] The location where the voice control command is emitted can be determined by means of methods such as microphone positioning and real-time monitoring of facial and lip movements by a camera.

[0102] In one possible implementation, in response to a voice control command, the target functional component corresponding to the target seating position among a plurality of functional components is controlled to perform a target function, including:

[0103] In response to voice control commands, the permission level of the second user is determined based on voice control permission information;

[0104] Based on the access level, control the target functional component corresponding to the target seating position to execute the target function among multiple functional components;

[0105] Under different permission operation levels, the target functional component will have different execution results when performing the target function.

[0106] Based on the aforementioned embodiments, this application determines the voice control permission information of the second user and further determines the permission operation level of the second user. Through the permission operation level, fine-grained control of target functional components in the vehicle and the security of the control of target functional components can be achieved.

[0107] Specifically, the permission operation level can be set to multiple operation levels of different sizes according to actual needs. This embodiment does not limit the number of permission levels.

[0108] In some embodiments, the target functional component may produce different execution results when performing the target function under different permission operation levels.

[0109] Example of a second user issuing a voice control command "Turn on Zhang San's seat heating", with access levels including first, second, and third levels:

[0110] If the second user corresponds to the first level of access control and does not have the permission to "turn on the seat heating", then the corresponding execution result is: the seat heating at Zhang San's seat is not turned on.

[0111] If the second user has the permission to "turn on seat heating" at the second permission level, but the maximum seat heating threshold at that permission level is 10 degrees, then the execution result is: seat heating is turned on and the maximum heating temperature is 10 degrees.

[0112] If the second user corresponds to the third permission level and has the permission to "turn on seat heating", and the maximum seat heating threshold under this permission level is 30 degrees, then the corresponding execution result is: seat heating is turned on and the maximum heating temperature is 30 degrees.

[0113] If the second user is a minor, for security reasons, the permission operation level that can be assigned to the second user includes either the first operation level or the second operation level.

[0114] In one possible implementation, before obtaining the user instruction information corresponding to the received voice control command, the method further includes:

[0115] Control the surveillance cameras inside the vehicle to capture facial images of the occupants.

[0116] The face images in the face surveillance images are matched with the preset registered face images to obtain the matching results;

[0117] If the matching result indicates that a face image exists in the face monitoring image that matches the preset registered face image, the vehicle's voice monitoring function will be activated.

[0118] Among them, voice control commands are received when the voice monitoring function is activated.

[0119] This application embodiment activates the vehicle's voice monitoring function when it is determined that the occupants in the vehicle have already registered their faces on the vehicle. This can prevent the electronic devices from misinterpreting the in-vehicle voice and causing erroneous control when the occupants have no intention to control the vehicle, thereby improving the safety of vehicle control.

[0120] Furthermore, the in-vehicle voice monitoring function is only activated when the matching result indicates that a face image exists in the preset registered face image in the face monitoring image, rather than being activated all the time, which can reduce the vehicle's energy consumption.

[0121] In some embodiments, if the matching result indicates that a face image matching a preset registered face image exists in the face monitoring image, the vehicle's voice monitoring function can be activated by a preset wake-up word.

[0122] In some embodiments, if the matching result indicates that a face image exists in the face monitoring image that matches a preset registered face image, the electronic device can directly control the vehicle's voice monitoring function to be activated.

[0123] In one possible implementation, controlling the target functional component corresponding to the target seating position among multiple functional components to perform the target function includes:

[0124] Based on the reference facial image, user group information is obtained, which is used to indicate the user group to which the first user belongs;

[0125] Based on user group information, among multiple preset control modes associated with the target function, the target control mode corresponding to the user group to which the first user belongs is determined. The processing procedures for executing the target function differ under different preset control modes.

[0126] Based on the target control mode, control the target functional component corresponding to the target seating position among multiple functional components to execute the target function.

[0127] The embodiments of this application can determine the corresponding target control mode from a variety of preset control modes according to the user group to which the first user belongs, which can further improve the fine control of the vehicle and take into account the user group more, thus improving the safety of vehicle control.

[0128] For example, the voice control command is "Turn on the daughter's seat ventilation," and the corresponding target function is "Turn on the seat ventilation." However, considering that the user group corresponding to "daughter" may be "children," if "turning on the seat ventilation" is to lower the temperature, the seat ventilation temperature should not drop abruptly for "children." Among the various preset control modes associated with the target function "turn on the seat ventilation," the preset control mode that lowers the temperature by 1 degree each time can be selected as the target control mode.

[0129] In one possible implementation, different preset control modes are pre-configured with different control weights among a variety of preset control modes;

[0130] According to the target control mode, the target functional component corresponding to the target seating position among multiple functional components is controlled to execute the target function, including:

[0131] When the voice control command is a command with ambiguous semantics and is used to indicate the control parameters for adjusting the target function, obtain the standard control parameters of the target function and the target weight value of the target control mode.

[0132] Based on the standard control parameters and target weight values, determine the target control parameters for the target function;

[0133] Based on the target control parameters, control the target functional component corresponding to the target seating position among multiple functional components to execute the target function.

[0134] This application embodiment can determine the target control parameters of the target function based on the target weight value of the target control mode, thereby improving the safety of controlling the target function component to execute the target function. Among these, instructions with fuzzy semantics include instructions without specific adjustment parameters, such as "lower" or "higher".

[0135] In some embodiments, during the process of facial registration on the vehicle, if the electronic device recognizes the current facial image and determines that it is an unregistered facial image, the display interface of the vehicle's in-vehicle terminal can display the words "Unregistered" and a "Register" button for the user to perform the registration operation.

[0136] As an example, please see Figure 2 , Figure 2 This application provides a display interface related to a method for controlling a vehicle.

[0137] If the facial information has been registered, the interface will display the word "Registered".

[0138] As an example, please see Figure 3 , Figure 3 This application provides another display interface related to a method for controlling a vehicle as described in an embodiment of the present application.

[0139] In some embodiments, to improve the success rate of face image entry and display, the interface may display messages such as "Please keep your face clearly visible and do not wear hats, masks, sunglasses or other items that obscure your face" to remind users to enter the image correctly.

[0140] If the face registration is successful, the system will redirect to the face registration success process. If the registration is interrupted, the registration display interface will show a message such as "Registration interrupted, please try again" and clear the corresponding registration data on the registration terminal.

[0141] If the data entry is successful, the user can click the "Complete" button to end the entry process. At the same time, the in-vehicle terminal can also announce "Face entry successful" to remind the user that the face entry has been successful.

[0142] In some embodiments, the data entry timeout is 30 seconds for each step, for a total of 90 seconds.

[0143] The reasons for face recognition failure include any of the following:

[0144] [Reason for failure 1]: The face registration process failed because conditions such as the car door being closed or the car being in P gear were not met. A voice prompt such as "Please keep the car door closed and operate in P gear" can be used.

[0145] [Reason for failure 2]: The system already has this face. A voice prompt can be given such as "The system already has this face in another account. Please change your face."

[0146]

Reason for failure 3

[0147] The entered facial image data is encrypted and stored in the cloud in accordance with relevant regulations.

[0148] The entered facial information can be given custom names and managed through tagging.

[0149] As an example, please see Figure 4 , Figure 4 This application provides another display interface related to a method for controlling a vehicle. When the user clicks the "Edit" icon, the name becomes editable; when the user clicks "Delete," the corresponding icon is highlighted, and a second pop-up confirmation window appears.

[0150] For details regarding the display interface of the secondary pop-up confirmation, please refer to [link / reference needed]. Figure 5 , Figure 5 This application provides another display interface related to a method for controlling a vehicle as described in an embodiment of the present application.

[0151] Corresponding to the above method embodiments, this application also provides a system for controlling a vehicle; please refer to [link to relevant documentation]. Figure 6 , Figure 6 This application provides a functional module diagram of a vehicle control system 600, which includes:

[0152] The first determining module 610 is used to determine the key features in the detected voice control commands;

[0153] The second determining module 620 is used to determine the face data label corresponding to the key feature based on the first association relationship, wherein the first association relationship includes the association relationship between the key feature and the face data label;

[0154] The third determining module 630 is used to determine the standard face image corresponding to the face data label based on the second association relationship. The standard face image is a registered face image.

[0155] The fourth determining module 640 is used to determine the target face image that matches the standard face image from the face monitoring images of the occupants in the vehicle;

[0156] The control module 650 is used to control at least one functional component associated with the target seat according to a voice control command when it is determined that the target face image corresponds to the target seat of the passenger.

[0157] The vehicle control system provided in this application embodiment can achieve the following: Figure 1 The various processes implemented in the Chinese method embodiments can achieve similar or the same technical effects, and will not be described again here to avoid repetition.

[0158] This application also provides an electronic device. Please refer to [link to previous application]. Figure 7 , Figure 7 This is a structural diagram of an electronic device provided in an embodiment of this application. The electronic device includes a processor, a memory, and a network interface connected via a system bus. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and may also store a computer program. When executed by the processor, this computer program enables the processor to implement the vehicle control method applied to the electronic device in the above embodiment. The internal memory may also store a computer program, which, when executed by the processor, enables the processor to execute the vehicle control method. Those skilled in the art will understand that… Figure 7 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0159] This application also discloses a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the method for controlling a vehicle as described in the method embodiment.

[0160] This application provides a computer program product stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the embodiments of the method for controlling a vehicle described above, and can achieve similar or the same technical effects. To avoid repetition, it will not be described again here.

[0161] This application provides a computer program product stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the embodiments of the method for controlling a vehicle described above, and can achieve similar or the same technical effects. To avoid repetition, it will not be described again here.

[0162] This application also discloses a vehicle equipped with a vehicle control system, electronic device, or computer-readable storage medium capable of implementing the vehicle control methods of any of the above embodiments.

[0163] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0164] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A method for controlling a vehicle, characterized in that, The method includes: Upon receiving a voice control command, the user instruction information corresponding to the voice control command is obtained. The voice control command is used to instruct the vehicle to perform a target function for a first user. The user instruction information is used to instruct the first user. The vehicle includes multiple functional components, and each functional component is pre-associated with a seating position within the vehicle. Based on the user instruction information, a reference face image of the first user is determined; Face matching is performed based on the reference face image and the face monitoring image captured by the camera inside the vehicle to determine the target seating position of the first user in the vehicle. In response to the voice control command, the target functional component corresponding to the target seating position among the plurality of functional components is controlled to perform the target function.

2. The method according to claim 1, characterized in that, The step of obtaining the user instruction information corresponding to the voice control command includes: Determine the location where the voice control command is issued; The facial image of the second user sitting at the location where the voice was spoken is obtained from the facial monitoring images captured by the camera inside the vehicle. Based on the second user's facial image, determine the second user's voice control permission information; If the voice control permission information indicates that the second user is a user with voice control permission, the user instruction information corresponding to the voice control command is obtained.

3. The method according to claim 2, characterized in that, The step of responding to the voice control command by controlling the target functional component among the plurality of functional components corresponding to the target seating position to execute the target function includes: In response to the voice control command, the permission operation level of the second user is determined according to the voice control permission information; Based on the permission operation level, control the target functional component among the plurality of functional components that corresponds to the target riding position to execute the target function; Under different permission operation levels, the target functional component will have different execution results when executing the target function.

4. The method according to claim 1, characterized in that, Before obtaining the user instruction information corresponding to the received voice control command, the method further includes: Control the monitoring camera inside the vehicle to capture facial images of the occupants inside the vehicle; The face images in the face monitoring images are matched with preset registered face images to obtain matching results; If the matching result indicates that a face image exists in the face monitoring image that matches the preset registered face image, the voice monitoring function of the vehicle is activated. The voice control command is received when the voice monitoring function is activated.

5. The method according to claim 1, characterized in that, The step of controlling the target functional component corresponding to the target seating position among the plurality of functional components to execute the target function includes: Based on the reference face image, user group information is obtained, and the user group information is used to indicate the user group to which the first user belongs; Based on the user group information, among a variety of preset control modes associated with the target function, a target control mode corresponding to the user group to which the first user belongs is determined, wherein the processing procedure for executing the target function differs under different preset control modes; According to the target control mode, the target functional component corresponding to the target seating position among the plurality of functional components is controlled to perform the target function.

6. The method according to claim 5, characterized in that, Different preset control modes are pre-configured with different control weights. The step of controlling the target functional component corresponding to the target seating position among the plurality of functional components to execute the target function according to the target control mode includes: When the voice control command is a command with ambiguous semantics and is used to indicate the control parameters for adjusting the target function, the standard control parameters of the target function and the target weight value of the target control mode are obtained. Based on the standard control parameters and the target weight value, determine the target control parameters for the target function; Based on the target control parameters, the target functional component corresponding to the target seating position among the plurality of functional components is controlled to perform the target function.

7. A system for controlling a vehicle, characterized in that, The system includes: The first determining module is used to determine the key features in the detected voice control commands; The second determining module is used to determine the face data label corresponding to the key feature based on the first association relationship, wherein the first association relationship includes the association relationship between the key feature and the face data label; The third determining module is used to determine the standard face image corresponding to the face data label based on the second association relationship, wherein the standard face image is a registered face image; The fourth determining module is used to determine a target face image that matches the standard face image from the face monitoring images of the occupants in the vehicle. The control module is used to control at least one functional component associated with the target seat according to the voice control command, when it is determined that the target face image corresponds to the target seat of the passenger.

8. An electronic device, characterized in that, The electronic device includes a memory and a processor, wherein the memory stores a computer program that, when executed by the processor, implements the method of any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by one or more processors, implements the method of any one of claims 1 to 6.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by one or more processors, implements the method of any one of claims 1 to 6.

11. A vehicle, characterized in that, Includes at least one of the following: The vehicle control system as described in claim 7; The electronic device as claimed in claim 8; The computer-readable storage medium as described in claim 9.

Images