Method, system and equipment for controlling vehicle, medium, product and vehicle

Abstract

The embodiment of the invention discloses a method, system and device for controlling a vehicle, a medium, a product and the vehicle, and relates to the technical field of vehicles, the method comprises the steps that under the condition that a voice control instruction is received, user indication information corresponding to the voice control instruction is obtained, the voice control instruction is used for indicating the vehicle to execute a target function for a first user, and the target function is obtained; the user indication information is used for indicating the first user; determining a reference face image of the first user according to the user indication information, and performing face matching according to the reference face image and a face monitoring image collected by a camera in the vehicle to determine a target riding position of the first user in the vehicle; and in response to the voice control instruction, the target function assembly corresponding to the target riding position in the multiple function assemblies is controlled to execute the target function, voice and visual recognition technologies are combined in the whole control process, the intention of the user can be accurately recognized, and the accuracy of voice control is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a method, system, device, medium, product and vehicle for controlling a vehicle. Background Art

[0002] With the continuous upgrading of consumer demand, the automotive industry has experienced rapid development from fuel vehicles to electric vehicles and then to intelligent vehicles, and voice control has become one of the important human-computer interaction methods in the field of intelligent vehicles. The application of voice control not only improves the driving experience, but also injects new vitality into in-vehicle life. For example, the in-vehicle voice assistant can perform various operations according to the driver's voice commands, thereby greatly reducing the operating burden during driving. However, the voice control technology in related technologies cannot accurately identify user intentions, and the accuracy of voice control is low.

[0003] Application Contents

[0004] In view of this, one of the purposes of the present application is to provide a method, system, device, medium, product and vehicle for controlling a vehicle, which can accurately identify user intentions and has low accuracy in voice control.

[0005] To achieve the above purpose, the technical solution of this application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a method for controlling a vehicle, comprising:

[0007] In the case of a received voice control instruction, obtaining user indication information corresponding to the voice control instruction, the voice control instruction is used to instruct the vehicle to perform a target function for a first user, and the user indication information is used to instruct the first user, wherein the vehicle includes a plurality of functional components, and each functional component is preset to have an association relationship with a seating position in the vehicle;

[0008] Determining a reference facial image of a first user according to the user indication information;

[0009] Performing face matching based on the reference face image and the face monitoring image captured by the camera in the vehicle to determine the target seating position of the first user in the vehicle;

[0010] In response to the voice control command, a target functional component corresponding to the target seating position among the plurality of functional components is controlled to perform a target function.

[0011] In a possible implementation, obtaining user indication information corresponding to the voice control instruction includes:

[0012] Determine the voice origination location of the voice control command;

[0013] Acquire a facial image of a second user who is seated at a location where the voice is emitted from a facial monitoring image captured by a camera in the vehicle;

[0014] Determining voice control authority information of the second user according to the facial image of the second user;

[0015] When the voice control authority information indicates that the second user is a user with voice control authority, user indication information corresponding to the voice control instruction is obtained.

[0016] In a possible implementation, in response to the voice control instruction, controlling a target functional component corresponding to the target seating position among the plurality of functional components to perform a target function includes:

[0017] In response to the voice control instruction, determining the permission operation level of the second user according to the voice control permission information;

[0018] According to the authority operation level, controlling a target functional component corresponding to the target seating position among the plurality of functional components to execute a target function;

[0019] Among them, under different permission operation levels, the target function component has different execution results when executing the target function.

[0020] In a possible implementation manner, in the case of a received voice control instruction, before obtaining the user indication information corresponding to the voice control instruction, the method further includes:

[0021] Control the surveillance camera in the vehicle to collect facial surveillance images of passengers in the vehicle;

[0022] Matching the face image in the face monitoring image with the preset registered face image to obtain a matching result;

[0023] In the case where the matching result indicates that a facial image matching the preset registered facial image exists in the facial monitoring image, activating the voice monitoring function of the vehicle;

[0024] The voice control command is received when the voice monitoring function is activated.

[0025] In a possible implementation, controlling a target functional component corresponding to the target seating position among the plurality of functional components to perform a target function includes:

[0026] Acquire user group information according to the reference face image, where the user group information is used to indicate the user group to which the first user belongs;

[0027] Determining, according to the user group information, a target control mode corresponding to the user group to which the first user belongs from a plurality of preset control modes associated with the target function, wherein processing procedures for executing the target function in different preset control modes are different;

[0028] According to the target control mode, a target function component corresponding to the target seating position among the plurality of function components is controlled to perform a target function.

[0029] In a possible implementation, different preset control modes among the plurality of preset control modes are preconfigured with different control weights;

[0030] According to the target control mode, a target function component corresponding to the target seating position among the plurality of function components is controlled to perform a target function, including:

[0031] When the voice control instruction is an instruction with fuzzy semantics and is used to indicate the control parameters for adjusting the target function, obtaining the standard control parameters of the target function and the target weight value of the target control mode;

[0032] Determine target control parameters of target functions according to standard control parameters and target weight values;

[0033] According to the target control parameter, a target function component corresponding to the target seating position among the plurality of function components is controlled to perform a target function.

[0034] In a second aspect, an embodiment of the present application provides a system for controlling a vehicle, the system comprising:

[0035] A first determination module, used to determine key features in the detected voice control instruction;

[0036] A second determination module is used to determine the key feature corresponding to the face data label based on the first association relationship, where the first association relationship includes an association relationship between the key feature and the face data label;

[0037] A third determination module is used to determine a standard face image corresponding to the face data label based on the second association relationship, where the standard face image is a registered face image;

[0038] A fourth determination module is used to determine a target face image that matches the standard face image from the face monitoring image of the passengers in the vehicle;

[0039] The control module is used to control at least one functional component associated with the target seat according to the voice control instruction when it is determined that the target face image corresponds to the target seat where the passenger is located.

[0040] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising a memory and a processor, the memory storing a computer program, and when the computer program is executed by the processor, the method for controlling a vehicle provided in the first aspect is implemented.

[0041] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by one or more processors, it implements the method for controlling a vehicle provided in the first aspect.

[0042] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed by one or more processors, it implements the method for controlling a vehicle provided in the first aspect.

[0043] In a sixth aspect, an embodiment of the present application provides a vehicle, the vehicle comprising at least one of the following:

[0044] A system for controlling a vehicle according to the second aspect;

[0045] Such as the electronic device of the third aspect;

[0046] A computer-readable storage medium as in the fourth aspect.

[0047] The embodiment of the present application provides a method for controlling a vehicle, which can obtain user indication information corresponding to the voice control instruction when a voice control instruction is received. The voice control instruction is used to instruct the vehicle to perform a target function for a first user, and the user indication information is used to instruct the first user. Then, based on the user indication information, a reference face image of the first user is determined, and face matching is performed based on the reference face image and the face monitoring image collected by the camera in the vehicle to determine the target seating position of the first user in the vehicle. Finally, in response to the voice control instruction, the target functional component corresponding to the target seating position among multiple functional components is controlled to perform the target function. The entire control process combines voice and visual recognition technology, which can accurately identify user intentions and improve the accuracy of voice control. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. It should be understood that the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0049] Figure 1 A flow chart of a method for controlling a vehicle provided in an embodiment of the present application;

[0050] Figure 2 A display interface diagram related to a method for controlling a vehicle provided in an embodiment of the present application;

[0051] Figure 3 Another display interface involved in a method for controlling a vehicle provided in an embodiment of the present application;

[0052] Figure 4 Another display interface involved in a method for controlling a vehicle provided in an embodiment of the present application;

[0053] Figure 5 Another display interface involved in a method for controlling a vehicle provided in an embodiment of the present application;

[0054] Figure 6 A schematic diagram of functional modules of a system for controlling a vehicle provided in an embodiment of the present application;

[0055] Figure 7 A diagram of the internal structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0057] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0058] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0059] In various embodiments of the present application, the expression "or" or "at least one of A or / and B" includes any combination or all combinations of the words listed at the same time. For example, the expression "A or B" or "at least one of A or / and B" may include A, may include B, or may include both A and B.

[0060] In the description of the present application, it should be noted that if the terms "upper", "lower", "inside", "outside", etc. appear to indicate an orientation or position relationship, it is based on the orientation or position relationship shown in the drawings, or is the orientation or position relationship in which the product of the invention is usually placed when used. It is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application.

[0061] In addition, the terms “first”, “second”, etc., if used, are merely used to distinguish between the descriptions and should not be understood as indicating or implying relative importance.

[0062] It should be noted that, in the absence of conflict, the features in the embodiments of the present application may be combined with each other.

[0063] Furthermore, in the embodiments of the present application, the term "connection" may refer to "electrical connection" or "direct connection". "Electrical connection" may refer to direct electrical connection between two components or electrical connection between two components via one or more normally open tubes or other components.

[0064] In order to solve the technical problems in the background technology, the embodiments of the present application provide a method, system, device, medium, product and vehicle for controlling a vehicle. The method for controlling a vehicle provided by the embodiments of the present application is first introduced below.

[0065] See also Figure 1 , Figure 1 This is a flow chart of a method for controlling a vehicle provided in an embodiment of the present application. The method for controlling a vehicle can be applied to the system and electronic device for controlling a vehicle in the following embodiments, wherein the electronic device includes a personal computer, a server, a mobile device, a cloud computing platform, and a supercomputer, etc. The method for controlling a vehicle will be introduced below from the perspective of application to electronic devices, and the method specifically includes the following steps:

[0066] Step 110, when a voice control instruction is received, obtain user indication information corresponding to the voice control instruction, the voice control instruction is used to instruct the vehicle to perform a target function for a first user, and the user indication information is used to instruct the first user, wherein the vehicle includes multiple functional components, and each functional component is preset with an associated relationship with a seating position in the vehicle.

[0067] Step 120: Determine a reference facial image of the first user according to the user indication information.

[0068] Step 130 , performing face matching based on the reference face image and the face monitoring image captured by the camera in the vehicle to determine the target seating position of the first user in the vehicle.

[0069] Step 140 , in response to the voice control instruction, controlling a target functional component corresponding to the target seating position among the plurality of functional components to execute a target function.

[0070] The embodiment of the present application provides a method for controlling a vehicle, which can obtain user indication information corresponding to the voice control instruction when a voice control instruction is received. The voice control instruction is used to instruct the vehicle to perform a target function for a first user, and the user indication information is used to instruct the first user. Then, based on the user indication information, a reference face image of the first user is determined, and face matching is performed based on the reference face image and the face monitoring image collected by the camera in the vehicle to determine the target seating position of the first user in the vehicle. Finally, in response to the voice control instruction, the target functional component corresponding to the target seating position among multiple functional components is controlled to perform the target function. The entire control process combines voice and visual recognition technology, which can accurately identify user intentions and improve the accuracy of voice control.

[0071] The following will be Figure 1 Each step of the method is described in detail.

[0072] In step 110, the electronic device receives a voice control instruction.

[0073] A voice control instruction may refer to a command that a user uses voice input to control a device or application. Accordingly, the voice control instruction received by the electronic device in this embodiment may be used to control at least one functional component on the vehicle to implement the corresponding target function, thereby achieving the control intent corresponding to the voice control instruction.

[0074] The first user is a user included in the voice control instruction. The electronic device can determine the first user through the user indication information in the voice control instruction. Specifically, the electronic device can determine the identity information of the first user through the user indication information in the voice control instruction.

[0075] In some embodiments, the user indication information includes the name of the first user, so that the electronic device can quickly determine the identity information of the first user based on the user indication information.

[0076] In some embodiments, the electronic device may determine a method for acquiring user instruction information corresponding to the voice control instruction according to a specific format of the voice control instruction.

[0077] Specifically, if the voice control instruction has not been formatted and is still in voice format, the electronic device may use a slot extraction method to obtain the user indication information corresponding to the voice control instruction.

[0078] If the voice control instruction has been converted into a text format, the electronic device may use a keyword extraction method to obtain the user instruction information corresponding to the voice control instruction.

[0079] The multiple functional components on the vehicle include but are not limited to vehicle air conditioning, vehicle audio, ambient lighting, etc. Each functional component is preset with a seating position in the vehicle, and the preset association can be modified according to actual needs.

[0080] Exemplarily, the functional components that are preset to be associated with the co-pilot seat of the vehicle may include the ventilation air conditioner on the co-pilot seat, the window near the co-pilot seat, etc.

[0081] In step 120, the reference facial image is a facial image that has been registered on the vehicle side. In some embodiments, there is a mapping relationship between the user indication information and the reference facial image, and based on the mapping relationship, the electronic device can quickly determine the reference facial image of the first user.

[0082] In step 130, the electronic device may control the camera in the vehicle to collect facial monitoring images of passengers in the vehicle. While collecting the facial monitoring images, the camera may record the positions of the passengers corresponding to the facial monitoring images.

[0083] The reference face image is matched with the face monitoring image. If the match is successful, it can be indicated that the passenger corresponding to the face monitoring image has registered the face image on the vehicle side. That is, the passenger corresponding to the face monitoring image is the first user, and the electronic device can then determine the target seating position of the first user in the vehicle.

[0084] In step 140, after determining the first user and the target seating position where the first user is located, the electronic device may respond to the received voice control instruction to control the target functional component corresponding to the target seating position to perform the target function.

[0085] If the voice control command is "turn on Zhang San's seat ventilation", the implementation process is as follows:

[0086] Based on the introduction of the above steps, the electronic device can determine the first user "Zhang San" through the received voice control command;

[0087] Then, a reference face image corresponding to "Zhang San" is found in the face images registered by the vehicle, and "Zhang San" is determined to be a person who has registered a face image on the vehicle side;

[0088] Next, the camera in the vehicle can determine the facial monitoring image of the first user "Zhang San" in the collected facial monitoring image, and simultaneously determine that the target sitting position of "Zhang San" in the vehicle is the front passenger seat;

[0089] Finally, after the electronic device determines that Zhang San and Zhang San's target sitting position is the front passenger seat, as well as the target functional component corresponding to the front passenger seat, it can turn on the seat ventilation and air conditioning on the front passenger seat according to the control intention corresponding to the voice control command, thereby accurately identifying the user's intention and improving the accuracy of voice control.

[0090] In a possible implementation, obtaining user indication information corresponding to the voice control instruction includes:

[0091] Determine the voice origination location of the voice control command;

[0092] Acquire a facial image of a second user who is seated at a location where the voice is emitted from a facial monitoring image captured by a camera in the vehicle;

[0093] Determining voice control authority information of the second user according to the facial image of the second user;

[0094] When the voice control authority information indicates that the second user is a user with voice control authority, user indication information corresponding to the voice control instruction is obtained.

[0095] The embodiment of the present application can determine whether the second user has voice control authority by determining the face image of the second user who issued the voice control instruction, and if the second user is determined to be a user with voice control authority, execute the step of obtaining the user indication information corresponding to the voice control instruction. Otherwise, the step of obtaining the user indication information corresponding to the voice control instruction is not executed, which can save the data processing energy consumption of the electronic device and release the data processing resources of the electronic device.

[0096] The second user is sitting at the voice issuing position, and the second user can be regarded as the user issuing the voice control command.

[0097] Voice control permission information may refer to the permissions that the system needs to obtain when the user uses the voice control function in order to correctly recognize and respond to the user's voice commands. These permissions may include access to the microphone, use of user location information, access to user contacts, control of at least one functional component in the vehicle, etc.

[0098] Specifically, the voice control authority is associated with the facial image. If the second user is a user who has registered a facial image on the vehicle side, then when the second user registers the facial image, the voice control authority can be allocated to the second user.

[0099] In some embodiments, multiple microphones deployed in the vehicle can be used to capture sound signals. Considering that in general, multiple microphones deployed in the vehicle are arranged according to certain rules to form a microphone array, the sound source can be located based on the time difference between the sound reaching different microphones, thereby determining the voice location of the voice control command.

[0100] In some embodiments, the vehicle occupants may be monitored in real time through a camera, and the speaking user and the location where the speech is emitted may be determined by monitoring the changes in the person's mouth shape in the video stream in real time.

[0101] The location where the voice is emitted by the voice control command can be determined by methods such as microphone positioning and real-time camera monitoring of changes in facial and lip shape.

[0102] In a possible implementation, in response to the voice control instruction, controlling a target functional component corresponding to the target seating position among the plurality of functional components to perform a target function includes:

[0103] In response to the voice control instruction, determining the permission operation level of the second user according to the voice control permission information;

[0104] According to the authority operation level, controlling a target functional component corresponding to the target seating position among the plurality of functional components to execute a target function;

[0105] Among them, under different permission operation levels, the target function component has different execution results when executing the target function.

[0106] The embodiment of the present application determines the voice control authority information of the second user based on the aforementioned embodiment, and further determines the authority operation level of the second user. The authority operation level can realize refined control of the target functional components in the vehicle and the security of the control of the target functional components.

[0107] Specifically, the permission operation level can be set to multiple operation levels of different sizes according to actual needs. This embodiment does not limit the number of permission levels.

[0108] In some embodiments, under different permission operation levels, the target function component has different execution results when executing the target function.

[0109] The voice control command issued by the second user is "turn on Zhang San's seat heating", and the permission operation level includes the first operation level, the second operation level and the third operation level. The following is an example:

[0110] If the second user corresponds to the first permission operation level and does not have the permission to "turn on the seat heating", the corresponding execution result is: the seat heating at Zhang San's seating position is not turned on.

[0111] If the second user corresponds to the second permission operation level and has the permission to "turn on seat heating", but the corresponding maximum seat heating threshold under this permission operation level is 10 degrees, then the corresponding execution result is: seat heating is turned on and the maximum heating temperature is 10 degrees.

[0112] If the second user corresponds to the third authority operation level and has the authority to "turn on seat heating", and the corresponding maximum seat heating threshold under this authority operation level is 30 degrees, then the corresponding execution result is: seat heating is turned on and the maximum heating temperature is 30 degrees.

[0113] If the second user is a minor, for safety reasons, the permission operation level that can be assigned to the second user includes the first operation level or the second operation level.

[0114] In a possible implementation manner, in the case of a received voice control instruction, before obtaining the user indication information corresponding to the voice control instruction, the method further includes:

[0115] Control the surveillance camera in the vehicle to collect facial surveillance images of passengers in the vehicle;

[0116] Matching the face image in the face monitoring image with the preset registered face image to obtain a matching result;

[0117] In the case where the matching result indicates that a facial image matching the preset registered facial image exists in the facial monitoring image, activating the voice monitoring function of the vehicle;

[0118] The voice control command is received when the voice monitoring function is activated.

[0119] The embodiment of the present application activates the voice monitoring function of the vehicle by determining that the occupant in the vehicle is a person who has completed facial registration on the vehicle side. This can avoid the situation where the electronic device recognizes the voice in the vehicle and causes erroneous control when the occupant has no control intention, thereby improving the safety of controlling the vehicle.

[0120] Furthermore, the voice monitoring function in the vehicle is activated only when the matching result indicates that there is a face image matching the preset registered face image in the face monitoring image, and it is not always in the activated state, which can reduce the energy consumption of the vehicle.

[0121] In some embodiments, the voice monitoring function of the vehicle can also be activated by a preset wake-up word when the matching result indicates that there is a facial image in the facial monitoring image that matches the preset registered facial image.

[0122] In some embodiments, when the matching result indicates that there is a facial image in the facial monitoring image that matches a preset registered facial image, the electronic device can directly control the voice monitoring function of the vehicle to be turned on.

[0123] In a possible implementation, controlling a target functional component corresponding to the target seating position among the plurality of functional components to perform a target function includes:

[0124] Acquire user group information according to the reference face image, where the user group information is used to indicate the user group to which the first user belongs;

[0125] Determining, according to the user group information, a target control mode corresponding to the user group to which the first user belongs from a plurality of preset control modes associated with the target function, wherein processing procedures for executing the target function in different preset control modes are different;

[0126] According to the target control mode, a target function component corresponding to the target seating position among the plurality of function components is controlled to perform a target function.

[0127] The embodiment of the present application can determine the corresponding target control mode from a plurality of preset control modes according to the user group to which the first user belongs, which can further improve the refined control of the vehicle and consider the safety of vehicle control more from the perspective of the user group.

[0128] For example, the voice control command is "turn on the daughter's seat ventilation", and the corresponding target function is "turn on the seat ventilation". Considering that the user group corresponding to "daughter" may belong to the "children group", if "turn on the seat ventilation" is to reduce the temperature, the temperature of the seat ventilation should not drop suddenly for the "children group". Among the multiple preset control modes associated with the target function of "turn on the seat ventilation", the preset control mode of reducing the temperature by 1 degree each time can be selected as the target control mode.

[0129] In a possible implementation, different preset control modes among the plurality of preset control modes are preconfigured with different control weights;

[0130] According to the target control mode, a target function component corresponding to the target seating position among the plurality of function components is controlled to perform a target function, including:

[0131] When the voice control instruction is an instruction with fuzzy semantics and is used to indicate the control parameters for adjusting the target function, obtaining the standard control parameters of the target function and the target weight value of the target control mode;

[0132] Determine target control parameters of target functions according to standard control parameters and target weight values;

[0133] According to the target control parameter, a target function component corresponding to the target seating position among the plurality of function components is controlled to perform a target function.

[0134] The embodiment of the present application can determine the target control parameter of the target function according to the target weight value of the target control mode, thereby improving the safety of controlling the target function component to execute the target function. Among them, instructions with fuzzy semantics include instructions without specific adjustment parameters such as lowering and raising.

[0135] In some embodiments, during the process of implementing face registration on the vehicle side, if the electronic device recognizes the current face image and determines it to be an unregistered face image, the display interface of the vehicle's on-board terminal may display the word "unregistered" and a "register" button for the user to perform the registration operation.

[0136] As an example, see Figure 2 , Figure 2 A display interface involved in a method for controlling a vehicle provided in an embodiment of the present application.

[0137] If the facial information has been registered, the display interface may show the words "Registered".

[0138] As an example, see Figure 3 , Figure 3 A method for controlling a vehicle provided in an embodiment of the present application involves another display interface.

[0139] In some embodiments, in the face image entry display interface, in order to improve the success rate of entry, words such as "Please keep your face clearly visible, and do not wear hats, masks, sunglasses or other items that cover your face" may be displayed to remind users to enter the information in a standardized manner.

[0140] If the entry is successful, jump to the face entry success process. If the entry is interrupted, the entry display interface may prompt "Enterprise interrupted, please try again" and clear the entry data corresponding to the entry terminal.

[0141] If the entry is successful, the user can click the "Finish" button to end the entry. At the same time, the vehicle terminal can also voice broadcast words such as "Face entry successful" to prompt the user that the face has been successfully entered.

[0142] In some embodiments, the entry timeout is 30 seconds per session, for a total of 90 seconds.

[0143] The reasons for face registration failure include any of the following:

[0144] [Reason for failure 1]: During the face entry process, if the door is not closed or the P gear is not met, a voice prompt such as "Please keep the door closed and operate in P gear" may be given;

[0145] [Failure reason 2]: The face already exists in the system, and a voice prompt may appear, such as "This face already exists in other accounts in the system, please change the face";

[0146] [Failure reason 3]: If the face entry process fails for unknown reasons, a voice prompt may be given, such as "Face entry failed, please click the button below to re-enter."

[0147] The entered facial image data is uniformly encrypted and stored in the cloud in accordance with relevant regulations.

[0148] The entered facial information can be customized with names and managed in a labeled manner.

[0149] As an example, see Figure 4 , Figure 4 Another display interface involved in a method for controlling a vehicle provided in an embodiment of the present application. When a user clicks the display icon corresponding to "Edit", the name becomes editable, and when a user clicks "Delete", the display corresponding to the name is highlighted, and a second pop-up window can be popped up for confirmation.

[0150] For the secondary pop-up confirmation interface, please refer to Figure 5 , Figure 5 A method for controlling a vehicle provided in an embodiment of the present application involves another display interface.

[0151] Corresponding to the above method embodiment, the present application embodiment also provides a system for controlling a vehicle, see Figure 6 , Figure 6 A schematic diagram of functional modules of a system for controlling a vehicle provided in an embodiment of the present application, wherein the system 600 for controlling a vehicle includes:

[0152] A first determination module 610, configured to determine key features in the detected voice control instruction;

[0153] A second determination module 620, configured to determine, based on a first association relationship, that the key feature corresponds to a face data label, wherein the first association relationship includes an association relationship between the key feature and the face data label;

[0154] A third determination module 630 is used to determine a standard face image corresponding to the face data tag based on the second association relationship, where the standard face image is a registered face image;

[0155] A fourth determination module 640 is used to determine a target face image that matches the standard face image from the face monitoring image of the occupant in the vehicle;

[0156] The control module 650 is used to control at least one functional component associated with the target seat according to the voice control instruction when it is determined that the target face image corresponds to the target seat where the passenger is located.

[0157] The vehicle control system provided in the embodiment of the present application can achieve the following Figure 1 The various processes implemented in the method embodiments can achieve similar or identical technical effects, and will not be described again here to avoid repetition.

[0158] The present application also provides an electronic device. The present application also provides an electronic device. Figure 7 , Figure 7 An internal structure diagram of an electronic device provided for an embodiment of the present application. The electronic device includes a processor, a memory, and a network interface connected via a system bus. The memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the electronic device stores an operating system and may also store a computer program, which, when executed by the processor, enables the processor to implement the method for controlling a vehicle applied to the electronic device in the above-mentioned embodiment. The internal memory may also store a computer program, which, when executed by the processor, enables the processor to execute the method for controlling a vehicle. Those skilled in the art will appreciate that Figure 7 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0159] The embodiment of the present application further discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method for controlling a vehicle in the method embodiment is implemented.

[0160] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the embodiment of the method for controlling a vehicle as described above, and can achieve similar or identical technical effects. To avoid repetition, it will not be described here.

[0161] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the embodiment of the method for controlling a vehicle as described above, and can achieve similar or identical technical effects. To avoid repetition, it will not be described here.

[0162] An embodiment of the present application also discloses a vehicle, on which is installed a vehicle control system, electronic device or computer-readable storage medium capable of implementing the vehicle control method of any of the above embodiments.

[0163] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0164] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A method for controlling a vehicle, characterized in that: The method comprises: In the case of a received voice control instruction, obtaining user indication information corresponding to the voice control instruction, the voice control instruction is used to instruct the vehicle to perform a target function for a first user, and the user indication information is used to indicate the first user, wherein the vehicle includes a plurality of functional components, and each of the functional components is preset to have an association relationship with a seating position in the vehicle; Determining a reference facial image of the first user according to the user indication information; Performing face matching based on the reference face image and the face monitoring image captured by the camera in the vehicle to determine the target seating position of the first user in the vehicle; In response to the voice control instruction, a target functional component corresponding to the target seating position among the plurality of functional components is controlled to perform the target function.

2. The method according to claim 1, characterized in that The obtaining of user indication information corresponding to the voice control instruction includes: Determining a voice issuing position of the voice control instruction; Acquire a facial image of a second user who is seated at the location where the voice is emitted from a facial monitoring image captured by a camera in the vehicle; determining voice control authority information of the second user according to the facial image of the second user; In a case where the voice control authority information indicates that the second user is a user with voice control authority, user indication information corresponding to the voice control instruction is acquired.

3. The method according to claim 2, characterized in that In response to the voice control instruction, controlling a target functional component corresponding to the target seating position among the plurality of functional components to perform the target function comprises: In response to the voice control instruction, determining the permission operation level of the second user according to the voice control permission information; According to the authority operation level, controlling a target functional component corresponding to the target seating position among the plurality of functional components to perform the target function; Among them, under different permission operation levels, the target function component has different execution results when executing the target function.

4. The method according to claim 1, characterized in that: In the case of receiving the voice control instruction, before obtaining the user indication information corresponding to the voice control instruction, the method further includes: Controlling the surveillance camera in the vehicle to collect facial surveillance images of passengers in the vehicle; Matching the face image in the face monitoring image with the preset registered face image to obtain a matching result; In the case where the matching result indicates that a facial image matching the preset registered facial image exists in the facial monitoring image, starting the voice monitoring function of the vehicle; The voice control instruction is received when the voice monitoring function is activated.

5. The method according to claim 1, characterized in that The controlling a target functional component corresponding to the target seating position among the plurality of functional components to perform the target function comprises: acquiring user group information according to the reference face image, wherein the user group information is used to indicate the user group to which the first user belongs; determining, according to the user group information, a target control mode corresponding to the user group to which the first user belongs from a plurality of preset control modes associated with the target function, wherein processing procedures for executing the target function in different preset control modes are different; According to the target control mode, a target functional component corresponding to the target seating position among the plurality of functional components is controlled to perform the target function.

6. The method according to claim 5, characterized in that Different preset control modes among the plurality of preset control modes are pre-configured with different control weights; According to the target control mode, controlling a target functional component among the plurality of functional components corresponding to the target seating position to perform the target function comprises: In a case where the voice control instruction is an instruction with fuzzy semantics and is used to instruct to adjust the control parameters of the target function, obtaining the standard control parameters of the target function and the target weight value of the target control mode; Determining target control parameters of the target function according to the standard control parameters and the target weight value; According to the target control parameter, a target function component corresponding to the target seating position among the plurality of function components is controlled to perform the target function.

7. A system for controlling a vehicle, characterized in that: The system comprises: A first determination module, configured to determine key features in the detected voice control instruction; A second determination module, configured to determine, based on a first association relationship, that the key feature corresponds to a face data label, wherein the first association relationship includes an association relationship between the key feature and the face data label; A third determination module is used to determine a standard face image corresponding to the face data tag based on the second association relationship, wherein the standard face image is a registered face image; A fourth determination module, used to determine a target face image that matches the standard face image from the face monitoring image of the occupant in the vehicle; The control module is used to control at least one functional component associated with the target seat according to the voice control instruction when it is determined that the target face image corresponds to the target seat where the passenger is located.

8. An electronic device, characterized in that: The electronic device comprises a memory and a processor, wherein a computer program is stored in the memory, and the computer program implements the method according to any one of claims 1 to 6 when executed by the processor.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by one or more processors, the method according to any one of claims 1 to 6 is implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, which, when executed by one or more processors, implements the method of any one of claims 1 to 6.

11. A vehicle, characterized in that: Include at least one of the following: The system for controlling a vehicle as claimed in claim 7; The electronic device as claimed in claim 8; The computer readable storage medium of claim 9.

Images