Voice interaction method, vehicle and storage medium

Abstract

The application discloses a voice interaction method, a vehicle and a storage medium. The method comprises the following steps: receiving a voice request issued by a user in a vehicle cabin; confirming identity information of the user according to the voice request; confirming a function type of the voice request according to the voice request, wherein the function type of the voice request is obtained by pre-classifying the voice request according to the relevance between the voice request and vehicle driving and vehicle safety; and executing a control instruction corresponding to the voice request to complete voice interaction according to the identity information and the function type of the voice request. The voice interaction method, the vehicle and the storage medium can directly execute the control instruction corresponding to the voice request if the function of the vehicle has a corresponding controller to issue the voice request after receiving the voice request issued by the user, thereby improving the efficiency and avoiding the situation that the safety of the vehicle is affected due to the fact that some operations are completed by the user who excessively relies on the main driver position of the cabin or the user who relies on the main driver position of the cabin completes some operations.

Description

Technical Field

[0001] This invention relates to the field of intelligent vehicle technology, and in particular to a voice interaction method, a vehicle, and a storage medium. Background Technology

[0002] With the development of intelligent vehicle cockpits, voice technology has provided users with numerous conveniences for controlling the vehicle while driving. In these technologies, the initiator of voice commands is typically limited to a fixed user, such as the user in the driver's seat. That is, only the user in the driver's seat can control the vehicle by voice, while users outside the driver's seat cannot. However, for users outside the driver's seat, certain operations still require the driver's seat to perform. If the driver is distracted while the vehicle is in motion, responding to these operations could potentially create a vehicle safety hazard. Summary of the Invention

[0003] This invention provides a voice interaction method, a vehicle, and a storage medium.

[0004] This invention provides a voice interaction method. The voice interaction method includes: receiving a voice request from a user in a vehicle cabin; confirming the user's identity information based on the voice request; confirming the function type of the voice request based on the voice request, wherein the function type of the voice request is pre-classified according to the relevance of the voice request to vehicle driving and vehicle safety; and executing a control command corresponding to the voice request to complete the voice interaction based on the identity information and the function type of the voice request.

[0005] Thus, the voice interaction method of the present invention can directly execute the control command corresponding to the voice request if the vehicle function has a corresponding control person issuing a voice request after receiving a voice request from the user, thereby improving efficiency and avoiding situations where the operation is overly dependent on the user in the driver's seat, or where the vehicle's safety is threatened by the user in the driver's seat.

[0006] The step of confirming the user's identity information based on the voice request includes: confirming the user's second location information in the vehicle cabin based on the first location information of the microphone receiving the voice request; and confirming the user's identity information based on the second location information.

[0007] Thus, the voice interaction method of the present invention can confirm the user's second location information in the vehicle cabin based on the first location information of the microphone receiving the voice request, and confirm the user's identity information based on the user's second location information.

[0008] The step of confirming the user's identity information based on the second location information includes: confirming that the user is the user in the driver's seat of the vehicle cabin when the microphone is located in the driver's seat of the vehicle cabin.

[0009] Thus, when the microphone is located in the driver's seat of the vehicle's cabin, the user's identity can be confirmed as the user in the driver's seat.

[0010] The step of confirming the user's identity information based on the voice request includes: when the microphone is located in a non-driver's position in the vehicle cabin, obtaining the user's voiceprint information based on the voice request; and confirming the user's identity information based on the voiceprint information.

[0011] In this way, even when the microphone is located in a non-driver's seat in the vehicle cabin, the user's voiceprint information can be obtained based on a voice request, and the user's identity information can be confirmed based on the voiceprint information.

[0012] The step of confirming the user's identity information based on the voiceprint information includes: confirming that the user is a logged-in user of the vehicle system if the voiceprint information matches the voiceprint information of the pre-recorded vehicle system login account.

[0013] Thus, if the voiceprint information matches the voiceprint information of the pre-recorded vehicle system login account, it can be confirmed that the user is a former or current login user of the vehicle system, and that the user has corresponding control over the vehicle.

[0014] The step of confirming the user's identity information based on the voiceprint information includes: in the case that the voiceprint information is inconsistent with the voiceprint information of the pre-recorded vehicle system login account, confirming the user's age range based on the voiceprint information, wherein the age range includes adults and minors.

[0015] In this way, if the voiceprint information is inconsistent with the voiceprint information of the pre-recorded vehicle system login account, the user's age range can be further confirmed based on the voiceprint information, thereby determining whether the user is an adult or a minor, and whether the user has corresponding control over the vehicle, thus ensuring driving safety.

[0016] The step of executing the control command corresponding to the voice request to complete the voice interaction based on the identity information and the function type of the voice request includes: if the function type of the voice request is a first function type, and if the user is a user in the driver's seat or a logged-in user of the vehicle system, controlling the vehicle to execute the control command corresponding to the voice request, wherein the voice request of the first function type is related to vehicle driving and vehicle safety; if the user is an adult or a minor in a non-driver's seat, controlling the vehicle to refuse to respond to the control command corresponding to the voice request.

[0017] In this way, the corresponding control commands can only be executed when the driver or the logged-in user of the vehicle system issues a voice request for the first function type, thus ensuring the safety of the user and the vehicle.

[0018] The step of executing the control command corresponding to the voice request to complete the voice interaction based on the identity information and the function type of the voice request includes: when the function type of the voice request is not the first function type, controlling the vehicle to execute the control command corresponding to the voice request based on the identity information, the function type of the voice request, and the gear information of the vehicle.

[0019] Thus, when the function type of the voice request is not the first function type, the control command corresponding to the voice request is executed according to the user's identity information, the function type of the voice request, and the vehicle's gear information, avoiding situations where the vehicle's safety is compromised due to the user in the driver's seat performing certain operations.

[0020] When the function type of the voice request is not the first function type, the control command corresponding to the voice request is executed according to the identity information, the function type of the voice request, and the vehicle's gear position information. This includes: when the function type of the voice request is the second function type and the vehicle is in P gear, responding to a voice request issued by any user with any identity in the vehicle cabin, executing the control command corresponding to the voice request. The voice request of the second function type is related to vehicle driving but not to vehicle safety. When the function type of the voice request is the second function type and the vehicle is not in P gear, if the user is the user in the driver's seat or the logged-in user, the control command corresponding to the voice request is executed; if the user is an adult or a minor, the control command corresponding to the voice request is refused.

[0021] Thus, when the voice request is of the second function type and the vehicle is in P gear, the vehicle can execute the control command corresponding to the voice request in response to a voice request from any user in the vehicle cabin. When the voice request is of the second function type and the vehicle is not in P gear, if the user is the driver in the cabin or a logged-in user, the vehicle executes the control command corresponding to the voice request. If the user is an adult or a minor, the vehicle refuses to respond to the control command corresponding to the voice request, ensuring the safety of the vehicle and the user.

[0022] When the function type of the voice request is not the first function type, the control command corresponding to the voice request is executed according to the identity information, the function type of the voice request, and the vehicle's gear position information. This includes: when the function type of the voice request is the third function type and the vehicle is in P gear, if the user is the user in the driver's seat, the logged-in user, or an adult, the control command corresponding to the voice request is executed; if the user is a minor, the control command corresponding to the voice request is refused. The voice request of the third function type is not related to vehicle driving but is related to vehicle safety. When the function type of the voice request is the third function type and the vehicle is not in P gear, if the user is the user in the driver's seat or the logged-in user, the control command corresponding to the voice request is executed; if the user is an adult or a minor, the control command corresponding to the voice request is refused.

[0023] Thus, when the voice request is of the third function type and the vehicle is in P gear, if the user is the driver in the driver's seat, a logged-in user, or an adult, the vehicle executes the control command corresponding to the voice request; if the user is a minor, the vehicle refuses to respond to the control command corresponding to the voice request. When the voice request is of the third function type and the vehicle is not in P gear, if the user is the driver in the driver's seat or a logged-in user, the vehicle executes the control command corresponding to the voice request; if the user is an adult or a minor, the vehicle refuses to respond to the control command corresponding to the voice request, ensuring the safety of the vehicle and the user.

[0024] When the function type of the voice request is not the first function type, the control command corresponding to the voice request is executed according to the identity information, the function type of the voice request, and the vehicle's gear position information. This includes: when the function type of the voice request is the fourth function type and the vehicle is in P gear, responding to a voice request issued by any user with any identity in the vehicle cabin, executing the control command corresponding to the voice request, wherein the voice request of the fourth function type is unrelated to vehicle driving and vehicle safety; when the function type of the voice request is the fourth function type and the vehicle is not in P gear, if the user is the user in the driver's seat, the logged-in user, or the adult, executing the control command corresponding to the voice request; if the user is the minor, refusing to respond to the control command corresponding to the voice request.

[0025] Thus, when the voice request is of the fourth function type and the vehicle is in P gear, the vehicle can execute the control command corresponding to the voice request issued by any user in the vehicle cabin. When the voice request is of the fourth function type and the vehicle is not in P gear, if the user is the driver in the driver's seat, the logged-in user, or an adult, the vehicle will execute the control command corresponding to the voice request. If the user is a minor, the vehicle will refuse to respond to the control command corresponding to the voice request to ensure the safety of the vehicle and the user.

[0026] The refusal to respond to the control command corresponding to the voice request includes: if it is confirmed that the user in the driver's seat is in the vehicle cabin, sending an execution request to whether to execute the voice request; if the user in the driver's seat confirms the execution request, executing the control command corresponding to the voice request; if the user in the driver's seat refuses the execution request, refusing to respond to the control command corresponding to the voice request; and in response to the execution conditions fed back by the user in the driver's seat regarding the execution request, executing the control command corresponding to the voice request according to the execution conditions.

[0027] In this way, if a control command is issued by a user who is not in control, the vehicle can actively ask the user in control and execute the control command after obtaining the user's authorization. This can avoid the safety hazard caused by the user in the driver's seat having to manually operate the vehicle when the user in the driver's seat makes a voice request that can only be controlled by the user in the driver's seat.

[0028] When the user in the driver's seat confirms the execution request, controlling the vehicle to execute the control command corresponding to the voice request includes: responding to the user in the driver's seat confirming the execution request and authorizing the user's voice control permission during the current driving process, and executing the control command corresponding to the voice request issued by the user during the current driving process.

[0029] In this way, once the user in the driver's seat authorizes other users' voice requests during the current driving process from a time perspective, the control commands corresponding to any voice requests issued by other users during the current driving process can be executed, which can reduce trouble for the user in the driver's seat and ensure driving safety.

[0030] When the user in the driver's seat confirms the execution request, controlling the vehicle to execute the control command corresponding to the voice request includes: responding to the user in the driver's seat confirming the execution request and authorizing the user's identity information, and executing the control command corresponding to the voice request issued by the user.

[0031] In this way, once the user in the driver's seat authorizes a specific passenger, any voice request from that specific passenger can be directly executed, reducing hassle for the driver and ensuring driving safety.

[0032] When the user in the driver's seat confirms the execution request, controlling the vehicle to execute the control command corresponding to the voice request includes: responding to the user in the driver's seat confirming the execution request and authorizing the vehicle control function corresponding to the voice request, and having any user in the vehicle cabin issue a control command corresponding to the voice request for the vehicle control function.

[0033] In this way, once the user in the driver's seat authorizes a specific function, other users can directly execute the corresponding control commands for voice requests of that specific function, which reduces trouble for the user in the driver's seat and ensures driving safety.

[0034] The method of controlling the vehicle to execute the control command corresponding to the voice request includes: confirming the control object of the voice request is located in a third position within the vehicle cabin; if a user is present at the third position, sending an execution request to determine whether to execute the voice request; if the user at the third position confirms the execution request, executing the control command corresponding to the voice request; if the user at the third position rejects the execution request, refusing to respond to the control command corresponding to the voice request; and in response to the execution conditions provided by the user at the third position regarding the execution request, executing the control command corresponding to the voice request according to the execution conditions.

[0035] In this way, if a user in a non-third-party location issues a voice request for a control command, the vehicle can proactively inquire about the control object of the voice request and confirm the control object's location within the vehicle's cabin. After obtaining authorization from the passenger in the third location, the vehicle can then execute the control command corresponding to the voice request. This avoids the safety hazard caused by a user in a non-driver's seat making a voice request to the vehicle while driving, where only the user in the driver's seat can respond to the voice request due to distraction.

[0036] The method further includes: continuously monitoring the voice content of the user in the vehicle cabin; performing semantic parsing on the voice content; based on the result of the semantic parsing, if the voice content is associated with a vehicle control function, sending a request to whether to execute the control command corresponding to the vehicle control function associated with the voice content; and if the user in the driver's seat confirms the execution request, executing the control command corresponding to the vehicle control function associated with the voice content.

[0037] Thus, based on the solution described above, the vehicle gains the ability to actively and continuously listen to the voice content of users in the vehicle cabin, perform semantic analysis on the voice content, and if the voice content between passengers involves the intention to control vehicle functions, it will actively initiate voice interaction to ask the person with the corresponding function control authority for authorization, further improving the user experience.

[0038] This invention provides a vehicle. The vehicle includes a processor and a memory, the memory storing a computer program. When the computer program is executed by the processor, it implements the voice interaction method described in any of the above embodiments.

[0039] Thus, when the vehicle of the present invention receives a voice request from a user using the above-described voice interaction method, if the vehicle's functions have a corresponding control person issuing a voice request, the control command corresponding to the voice request can be directly executed, improving efficiency and avoiding situations where the operation is overly dependent on the user in the driver's seat, or where certain operations are performed by the user in the driver's seat, causing potential safety hazards to the vehicle.

[0040] The present invention also provides a non-volatile computer-readable storage medium containing a computer program. When the computer program is executed by one or more processors, it implements the voice interaction method described in any of the above embodiments.

[0041] Thus, when the storage medium of the present invention receives a voice request from a user using the above-described voice interaction method, if the vehicle's functions have a corresponding control person issuing a voice request, the control command corresponding to the voice request can be directly executed, improving efficiency and avoiding situations where the operation relies excessively on the user in the driver's seat, or where relying on the user in the driver's seat to complete certain operations causes vehicle safety hazards.

[0042] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0043] The above and / or additional aspects and advantages of the present invention will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, wherein:

[0044] Figure 1 This is a flowchart illustrating the voice interaction method of the present invention;

[0045] Figure 2 This is a flowchart illustrating the voice interaction method of the present invention;

[0046] Figure 3 This is a schematic diagram of the device layout inside the vehicle cabin in this invention;

[0047] Figure 4 This is a flowchart illustrating the voice interaction method of the present invention;

[0048] Figure 5 This is a flowchart illustrating the voice interaction method of the present invention;

[0049] Figure 6 This is a flowchart illustrating the voice interaction method of the present invention;

[0050] Figure 7 This is a flowchart illustrating the voice interaction method of the present invention;

[0051] Figure 8 This is a flowchart illustrating the voice interaction method of the present invention;

[0052] Figure 9 This is a flowchart illustrating the voice interaction method of the present invention;

[0053] Figure 10 This is a flowchart illustrating the voice interaction method of the present invention;

[0054] Figure 11 This is a flowchart illustrating the voice interaction method of the present invention;

[0055] Figure 12 This is a flowchart illustrating the voice interaction method of the present invention;

[0056] Figure 13 This is a flowchart illustrating the voice interaction method of the present invention;

[0057] Figure 14 This is a flowchart illustrating the voice interaction method of the present invention;

[0058] Figure 15 This is a flowchart illustrating the voice interaction method of the present invention;

[0059] Figure 16 This is a flowchart illustrating the voice interaction method of the present invention;

[0060] Figure 17 This is a flowchart illustrating the voice interaction method of the present invention. Detailed Implementation

[0061] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present invention, and should not be construed as limiting the embodiments of the present invention.

[0062] Please see Figure 1 This invention provides a voice interaction method. The voice interaction method includes:

[0063] 01: Receive voice requests from users inside the vehicle cabin;

[0064] 02: Confirm the user's identity information based on the voice request;

[0065] 03: Confirm the function type of the voice request based on the voice request. The function type of the voice request is pre-classified according to the relevance of the voice request to vehicle driving and vehicle safety.

[0066] 04: Based on the identity information and the function type of the voice request, execute the control command corresponding to the voice request to complete the voice interaction.

[0067] The present invention also provides a vehicle. The vehicle includes a processor and a memory, the memory storing a computer program. The processor is used to receive voice requests from users in the vehicle cabin; confirm the user's identity information based on the voice request; confirm the function type of the voice request based on the voice request, the function type of the voice request being pre-classified according to the relevance of the voice request to vehicle driving and vehicle safety; and execute control commands corresponding to the voice request to complete the voice interaction based on the identity information and the function type of the voice request.

[0068] First, it receives voice requests from users inside the vehicle's cabin, such as "open the driver's side window".

[0069] Then, the user's identity information is verified based on the voice request, including confirming the location from which the user made the voice request and verifying the voiceprint of the user. The user's identity information can be used to identify the user, including the user in the driver's seat, the user in a non-driver's seat, the currently logged-in user, and whether they are an adult or a minor. A single user may have multiple identities.

[0070] For example, a user might simultaneously be both a driver in the driver's seat and an adult. When verifying a user's identity, the system first checks if the user is indeed in the driver's seat. If so, it then checks if the user is currently logged into the system. If so, there's no need to determine if the user is an adult or a minor. If not, the system then checks if the user is an adult. If the user is a minor, the vehicle can control itself to refrain from executing any voice requests from that user, preventing minors from issuing disruptive commands and causing accidents.

[0071] Next, the function type of the voice request is confirmed based on the voice request itself. The function type of the voice request is pre-classified according to the relevance of the voice request to vehicle driving and vehicle safety.

[0072] Understandably, vehicle functions can be categorized along two dimensions: driving and safety. For example, functions related to both safety and driving include "suspension adjustment"; functions related to safety but not driving include "child lock on / off"; functions related to driving but not safety include "navigation settings"; and functions unrelated to both safety and driving include "air conditioning settings." Therefore, user voice requests can be categorized into four types based on vehicle functions: those related to both safety and driving, those related to both safety and not driving, those unrelated to safety and driving, and those unrelated to both safety and driving.

[0073] Finally, based on the identity information and the function type of the voice request, the corresponding control command is executed.

[0074] For example, in a non-driving scenario, after a user issues a voice request to "unlock the child lock," and it is determined that the user is an adult not in the driver's seat, and that the voice request is for a safety-related function rather than a driving function, then according to the safety-related functions in Table 2, the adult passenger can control the child lock in a non-driving scenario. Therefore, in a non-driving scenario, after the adult user in the non-driver's seat issues a voice request to "unlock the child lock," the child lock can be directly unlocked.

[0075] Thus, the voice interaction method of the present invention can directly execute the control command corresponding to the voice request if the vehicle function has a corresponding control person issuing a voice request after receiving a voice request from the user, thereby improving efficiency and avoiding situations where the operation is overly dependent on the user in the driver's seat, or where the vehicle's safety is threatened by the user in the driver's seat.

[0076] Please see Figure 2 Step 02 includes:

[0077] 021: Based on the first location information of the microphone that received the voice request, confirm the user's second location information in the vehicle cabin;

[0078] 022: Confirm the user's identity information based on the second location information.

[0079] The processor is used to confirm the user's second location information in the vehicle cabin based on the first location information of the microphone that received the voice request; and to confirm the user's identity information based on the second location information.

[0080] Confirming a user's identity based on a voice request can specifically involve determining the user's second location within the vehicle cabin based on the first location information of the microphone receiving the voice request, and then confirming the user's identity based on that second location information. In other words, the identity of the user at the corresponding location can be confirmed based on the microphone position receiving the voice request. For example, if the microphone receiving the voice request is located at the driver's seat, then the user's identity as the driver can be confirmed.

[0081] Please see Figure 3 The layout of various vehicle components inside the vehicle according to the present invention can be as follows: Figure 3 As shown, each seat is equipped with a microphone to receive voice requests from the user at each seat. It should be understood that in vehicles with relatively small cabin spaces, multiple microphones may receive the same voice request. In such cases, information such as the signal strength can be used to further confirm the actual location from which the voice request originated.

[0082] Thus, the voice interaction method of the present invention can confirm the user's second location information in the vehicle cabin based on the first location information of the microphone receiving the voice request, and confirm the user's identity information based on the user's second location information.

[0083] Please see Figure 4 Step 022 includes:

[0084] 0221: When the microphone is located in the driver's seat in the vehicle's cabin, confirm that the user is the user in the driver's seat.

[0085] The processor is used to confirm that the user is the driver in the driver's seat when the microphone is located in the driver's seat of the vehicle's cabin.

[0086] When the microphone is located in the driver's seat of the vehicle's cabin, it is as follows: Figure 3 When the user is at position 1 as shown, it can be confirmed that the user is the driver in the cockpit. The vehicle can then execute the commands that the driver in the cockpit has control over based on the voice requests made by the user.

[0087] Thus, when the microphone is located in the driver's seat of the vehicle's cabin, the user's identity can be confirmed as the user in the driver's seat.

[0088] Please see Figure 5 Step 02 includes:

[0089] 023: When the microphone is located in a non-driver's seat in the vehicle cabin, obtain the user's voiceprint information based on the voice request;

[0090] 024: Confirm the user's identity information based on voiceprint information.

[0091] The processor is used to acquire the user's voiceprint information based on a voice request when the microphone is located in a non-driver's position in the vehicle cabin; and to verify the user's identity information based on the voiceprint information.

[0092] If the microphone is located in a non-driver's seat position within the vehicle cabin, the user's identity may not be that of the driver. Further analysis based on the voice request is needed to obtain the user's voiceprint information to confirm their identity. This voiceprint information includes voiceprint features, which can be used to verify the user's identity.

[0093] Understandably, the in-vehicle system can pre-store the voices of family members and recognize those voices to generate corresponding voiceprint information. This allows the system to match the voiceprint information of the user's voice request with the pre-stored voiceprint information, thereby confirming the user's identity.

[0094] In this way, even when the microphone is located in a non-driver's seat in the vehicle cabin, the user's voiceprint information can be obtained based on a voice request, and the user's identity information can be confirmed based on the voiceprint information.

[0095] Please see Figure 6 Step 024 includes:

[0096] 0241: If the voiceprint information matches the pre-recorded voiceprint information of the vehicle system login account, the user is confirmed as the login user of the vehicle system.

[0097] The processor is used to confirm that the user is a logged-in user of the vehicle system if the voiceprint information matches the voiceprint information of the pre-recorded vehicle system login account.

[0098] The voice of the in-vehicle system login account can be pre-recorded and the corresponding voiceprint information can be obtained and stored in the in-vehicle system. Understandably, by pre-recording the voice of the in-vehicle system login account, it is possible to identify the accounts that have logged into the vehicle's in-vehicle system, thereby confirming whether the user in the non-driving position is a past or current user of the in-vehicle system. If it is confirmed that the user in the non-driving position is a past or current user of the in-vehicle system, it means that the user in the non-driving position is also familiar with the vehicle's control operations and has corresponding control rights. Therefore, by pre-recording the voice of the login account in the in-vehicle system, it can be determined whether the user in the non-driving position is a past or current user of the in-vehicle system and whether that user has the corresponding control rights over the vehicle.

[0099] When the microphone is located in a non-driver's seat in the vehicle cabin, if the real-time acquired user's voiceprint information mentioned above matches the pre-recorded voiceprint information of the vehicle system login account, it can be confirmed that the user is a former or current logged-in user of the vehicle system, and that the user has corresponding control over the vehicle.

[0100] Thus, if the voiceprint information matches the voiceprint information of the pre-recorded vehicle system login account, it can be confirmed that the user is a former or current login user of the vehicle system, and that the user has corresponding control over the vehicle.

[0101] Please see Figure 7 Step 02 includes:

[0102] 025: If the voiceprint information is inconsistent with the voiceprint information of the pre-recorded vehicle system login account, the user's age range is confirmed based on the voiceprint information. The age range includes adults and minors.

[0103] The processor is used to determine the user's age range based on the voiceprint information when the voiceprint information is inconsistent with the pre-recorded voiceprint information of the vehicle system login account. The age range includes adults and minors.

[0104] If the voiceprint information does not match the pre-recorded voiceprint information of the vehicle system login account, the user's age range can be determined based on the voiceprint information. This age range includes both adults and minors, thus determining whether the user is an adult. It should be understood that if the voiceprint information does not match the pre-recorded voiceprint information of the vehicle system login account, it indicates that the user is not a previous or current logged-in user of the vehicle system. Therefore, in this case, it is necessary to confirm the user's age range in detail based on the voiceprint information to determine whether the user is an adult and thus whether the user has corresponding control over the vehicle. If the user is a minor, they do not have the relevant control over the vehicle that an adult user would have, preventing vehicle safety accidents caused by minors issuing inappropriate voice commands.

[0105] For example, if a user's age is determined to be under 18 (excluding 18) based on voiceprint information, then the user is a minor. If a user's age is determined to be 18 or older based on voiceprint information, then the user is an adult.

[0106] In this way, if the voiceprint information is inconsistent with the voiceprint information of the pre-recorded vehicle system login account, the user's age range can be further confirmed based on the voiceprint information, thereby determining whether the user is an adult or a minor, and whether the user has corresponding control over the vehicle, thus ensuring driving safety.

[0107] Please see Figure 8Step 04 includes:

[0108] 041: When the function type of the voice request is the first function type, if the user is a user in the driver's seat or a logged-in user of the vehicle system, execute the control command corresponding to the voice request. The voice request of the first function type is related to both vehicle driving and vehicle safety.

[0109] 042: If the user is an adult or a minor who is not in the driver's seat, refuse to respond to the control commands corresponding to the voice request.

[0110] The processor is used to execute the control command corresponding to the voice request if the user is a user in the driver's seat or a logged-in user of the vehicle system when the function type of the voice request is the first function type. The voice request of the first function type is related to vehicle driving and vehicle safety. If the user is an adult or a minor in a non-driver's seat, the processor refuses to respond to the control command corresponding to the voice request.

[0111] The first type of voice request is related to both vehicle driving and vehicle safety. For the first type of voice request, regardless of whether the vehicle is in a parked position or not, the corresponding control command can only be executed based on the voice request when the driver, passenger, or logged-in user of the in-vehicle system issues the first type of voice request, thus ensuring the safety of the user and the vehicle.

[0112] When the voice request is of the first function type, if the user is an adult or a minor who is not in the driver's seat, the vehicle will refuse to respond to the control command corresponding to the voice request. That is, when the user is an adult or a minor who is not in the driver's seat and makes a voice request of the first function type, the vehicle will refuse to respond to the control command corresponding to the voice request to avoid a vehicle safety accident.

[0113] In this way, the corresponding control commands can only be executed when the driver or the logged-in user of the vehicle system issues a voice request for the first function type, thus ensuring the safety of the user and the vehicle.

[0114] Please see Figure 9 Step 04 includes:

[0115] 043: If the function type of the voice request is not the first function type, execute the control command corresponding to the voice request based on the identity information, the function type of the voice request, and the vehicle's gear information.

[0116] The processor is used to execute the control command corresponding to the voice request based on the identity information, the function type of the voice request, and the vehicle's gear information when the function type of the voice request is not the first function type.

[0117] When the function type of the voice request is not the first function type, the control command corresponding to the voice request can be executed according to the identity information, the function type of the voice request, and the vehicle's gear information.

[0118] The user's identity information can be used to identify the user, including the user in the driver's seat, the user in the non-driver's seat, the currently logged-in user, and whether the user is an adult or a minor.

[0119] When the function type of the voice request is not the first function type, it includes types related to vehicle driving but not related to vehicle safety, types not related to vehicle driving but related to vehicle safety, and types not related to either vehicle safety or vehicle driving.

[0120] The vehicle's gear information includes whether the vehicle is in Park (P) or not.

[0121] Thus, when the function type of the voice request is not the first function type, the vehicle executes the control command corresponding to the voice request based on the user's identity information, the function type of the voice request, and the vehicle's gear information, avoiding situations where the vehicle's safety is compromised due to the user in the driver's seat performing certain operations.

[0122] Please see Figure 10 Step 043 includes:

[0123] 0431: When the function type of the voice request is the second function type and the vehicle is in P gear, respond to the voice request issued by any user in the vehicle cabin and execute the control command corresponding to the voice request. The voice request of the second function type is related to vehicle driving but not to vehicle safety.

[0124] 0432: If the function type of the voice request is the second function type and the vehicle is not in P gear, if the user is the user in the driver's seat or the logged-in user, execute the control command corresponding to the voice request; if the user is an adult or a minor, refuse to respond to the control command corresponding to the voice request.

[0125] The processor is used to respond to a voice request from any user in the vehicle cabin when the voice request is of the second function type and the vehicle is in P gear, and execute the control command corresponding to the voice request. The second function type voice request is related to vehicle driving but not to vehicle safety. When the voice request is of the second function type and the vehicle is not in P gear, if the user is the user in the driver's seat or the logged-in user, the processor executes the control command corresponding to the voice request. If the user is an adult or a minor, the processor refuses to respond to the control command corresponding to the voice request.

[0126] The second function type is the function type of voice requests that are related to vehicle driving but not to vehicle safety.

[0127] When the function type of the voice request is determined to be the second function type, which is related to vehicle driving but not to vehicle safety, if the vehicle is in P gear, since the vehicle is in a parked state when in P gear, any user in the vehicle cabin can issue a voice request of the second function type, and the vehicle will execute the control command corresponding to the voice request.

[0128] If the vehicle is in a non-Park (Drive) gear, meaning it is in driving mode, and the user in the driver's seat or a logged-in user issues a voice request for the second function type, the vehicle will execute the corresponding control command. However, if the user is an adult or a minor, the vehicle will refuse to respond to the corresponding control command. In other words, in non-Park mode, the vehicle will only execute the corresponding control command when the user in the driver's seat or a logged-in user issues a voice request for that function type. If the user is not in the driver's seat, or is an adult or minor who is not logged in, the vehicle will refuse to execute the control command to ensure user safety.

[0129] For example, if the voice request is "Open navigation," and the vehicle is in Park (P) gear, any user in the vehicle's cabin can execute the corresponding control command if they issue the voice request. If the vehicle is not in Park, the vehicle will only execute the "Open navigation" command if the user in the driver's seat or the logged-in user issues the voice request. If the user is not in the driver's seat, is not a logged-in user, or is an adult or minor, the vehicle will refuse to execute the "Open navigation" command to ensure user safety.

[0130] Thus, when the voice request is of the second function type and the vehicle is in Park (P), the vehicle can execute the control command corresponding to the voice request from any user in the vehicle cabin. When the voice request is of the second function type and the vehicle is not in Park (P), if the user is the driver or a logged-in user, the vehicle executes the control command corresponding to the voice request; if the user is an adult or a minor, the vehicle refuses to respond to the control command corresponding to the voice request, ensuring the user's driving safety.

[0131] Please see Figure 11 Step 043 includes:

[0132] 0433: When the function type of the voice request is the third function type and the vehicle is in P gear, if the user is the user in the driver's seat, the logged-in user, or an adult, the control command corresponding to the voice request will be executed. If the user is a minor, the control command corresponding to the voice request will be refused. The voice request of the third function type is not related to vehicle driving but is related to vehicle safety.

[0133] 0434: If the function type of the voice request is the third function type and the vehicle is not in P gear, if the user is the user in the driver's seat or the logged-in user, the control command corresponding to the voice request will be executed; if the user is an adult or a minor, the control command corresponding to the voice request will be refused.

[0134] The third function type is the voice request function type that is not related to vehicle driving but is related to vehicle safety.

[0135] When the function type of the voice request is determined to be a third function type unrelated to vehicle driving but related to vehicle safety, and the vehicle is in Park (P) gear, since the vehicle is in a parked state, this is related to vehicle safety. When a user (including the driver, logged-in user, or adult) issues a voice request for this function type, the vehicle executes the control command corresponding to the voice request. If a minor issues a voice request for this function type, the vehicle refuses to respond to the control command corresponding to the voice request to ensure the safety of both the vehicle and the user.

[0136] If the vehicle is in a non-Park gear (i.e., the vehicle is in driving mode), and the user issues a voice request for this function to the driver or a logged-in user, the vehicle will execute the control command corresponding to the voice request. If the user issues a voice request for this function to an adult or a minor (other than the driver or logged-in user), the vehicle will refuse to respond to the control command corresponding to the voice request to ensure the user's driving safety.

[0137] For example, if the voice request is "unlock the child lock," and the vehicle is in Park (P), the vehicle will execute the corresponding control command if the user (including the driver, logged-in user, or adult) makes the request. However, if the user is a minor, the vehicle will refuse to execute the "unlock the child lock" command. This ensures that the vehicle can respond to voice requests from anyone other than minors when in Park, preventing minors from independently unlocking the child lock and avoiding unnecessary safety hazards. If the vehicle is not in Park, the vehicle will only execute the "unlock the child lock" command if the user makes the request to the driver or logged-in user. The vehicle will refuse to execute the command if the user is not in the driver's seat, not a logged-in user, an adult, or a minor, ensuring user safety.

[0138] Thus, when the voice request is of the third function type and the vehicle is in P gear, if the user is the driver in the driver's seat, a logged-in user, or an adult, the vehicle will execute the control command corresponding to the voice request; if the user is a minor, the vehicle will refuse to respond to the control command corresponding to the voice request. When the voice request is of the third function type and the vehicle is not in P gear, if the user is the driver in the driver's seat or a logged-in user, the vehicle will execute the control command corresponding to the voice request; if the user is an adult or a minor, the vehicle will refuse to respond to the control command corresponding to the voice request, thus ensuring the safety of the vehicle and the user.

[0139] Please see Figure 12 Step 043 includes:

[0140] 0435: When the function type of the voice request is the fourth function type and the vehicle is in P gear, respond to the voice request issued by any user in the vehicle cabin and execute the control command corresponding to the voice request. The voice request of the fourth function type is not related to vehicle driving or vehicle safety.

[0141] 0436: When the function type of the voice request is the fourth function type and the vehicle is not in P gear, if the user is the user in the driver's seat, the logged-in user, or an adult, the control command corresponding to the voice request will be executed; if the user is a minor, the control command corresponding to the voice request will be refused.

[0142] The processor is used to respond to voice requests from any user in the vehicle cabin when the voice request is of the fourth function type and the vehicle is in P gear, and execute the corresponding control command. The voice request of the fourth function type is not related to vehicle driving or vehicle safety. When the voice request is of the fourth function type and the vehicle is not in P gear, if the user is the user in the driver's seat, the logged-in user, or an adult, the processor executes the corresponding control command. If the user is a minor, the processor refuses to respond to the corresponding control command.

[0143] The fourth function type is the voice request function type that is not related to vehicle driving and vehicle safety.

[0144] When the function type of the voice request is determined to be the fourth function type, which is unrelated to vehicle driving and vehicle safety, if the vehicle is in P gear, since the vehicle is in a parked state in P gear and the voice request does not affect vehicle driving and vehicle safety, then any voice request issued by any user in the vehicle cabin can control the vehicle to execute the control command corresponding to the voice request.

[0145] If the vehicle is not in park (P) and is in driving mode, and the user is a driver, a logged-in user, or an adult, and issues a voice request for this function, the vehicle will execute the control command corresponding to the voice request. If the user is a minor, the vehicle will refuse to respond to the control command corresponding to the voice request to ensure the driving safety of the vehicle and the user.

[0146] For example, if the voice request is "turn on the air conditioning," and the vehicle is in Park (P) gear, the vehicle can execute the corresponding control command if the voice request is made by any user in the vehicle cabin. If the vehicle is not in Park gear, the vehicle will only execute the control command corresponding to the voice request "turn on the air conditioning" if the user is in the driver's seat, a logged-in user, or an adult. If the user is a minor, the vehicle will refuse to execute the control command corresponding to the voice request "turn on the air conditioning," ensuring that minors cannot control the air conditioning independently and extending the lifespan of the vehicle's air conditioning system.

[0147] Thus, when the voice request is of the fourth function type and the vehicle is in P gear, the vehicle can execute the control command corresponding to the voice request issued by any user in the vehicle cabin. When the voice request is of the fourth function type and the vehicle is not in P gear, if the user is the driver in the driver's seat, the logged-in user, or an adult, the vehicle will execute the control command corresponding to the voice request. If the user is a minor, the vehicle will refuse to respond to the control command corresponding to the voice request to ensure the safety of the vehicle and the user.

[0148] In any of the above embodiments, please refer to Figure 13 The vehicle refuses to respond to control commands corresponding to voice requests, including:

[0149] 04371: After confirming that the user in the driver's seat is inside the vehicle's cabin, send an execution request to ask whether to execute the voice request;

[0150] 04372: If the user in the driver's seat confirms the request, execute the control command corresponding to the voice request;

[0151] 04373: If the user in the driver's seat refuses to execute the request, the control command corresponding to the voice request will not be responded to.

[0152] 04374: Responds to the execution conditions provided by the user in the driver's seat regarding the execution request, and executes the control command corresponding to the voice request based on the execution conditions.

[0153] The processor is used to send an execution request to determine whether to execute the voice request if it confirms that the user in the driver's seat is in the vehicle cabin; if the user in the driver's seat confirms the execution request, it executes the control command corresponding to the voice request; if the user in the driver's seat refuses to execute the request, it refuses to respond to the control command corresponding to the voice request; and in response to the execution conditions fed back by the user in the driver's seat regarding the execution request, it executes the control command corresponding to the voice request according to the execution conditions.

[0154] like Figure 3 As shown, a seat sensor is installed on the driver's seat to detect whether someone is in the driver's seat, thereby confirming whether the user in the driver's position is in the vehicle cabin. This seat sensor can be a gravity sensor or an infrared sensor.

[0155] For example, when the seat sensor detects that someone is in the driver's seat, confirming that the user in the driver's seat is in the vehicle cabin, and the vehicle is not in P gear, if a minor in the vehicle cabin makes a voice request, the system will send an execution request to "open the driver's side window". At this time, the vehicle can actively send an execution request to confirm whether to execute the voice request, for example, the execution request could be "Please confirm that the driver's side window is open, please say yes".

[0156] If the driver in the driver's seat replies "OK" at this time, it means that the driver has confirmed the request. The vehicle can then execute the control command corresponding to the voice request "Open the driver's window" and give a voice feedback "Opened".

[0157] If the driver in the driver's seat replies "Do not open" at this time, it means that the driver refuses to execute the request. At this time, the vehicle refuses to respond to the control command corresponding to the voice request "Open the driver's window", that is, it does not execute the control command corresponding to the voice request "Open the driver's window", and gives the voice feedback "Okay, do not open it for now".

[0158] If the vehicle detects that the driver in the driver's seat replies "open the driver's window halfway," the vehicle can perform semantic analysis on the voice to identify the driver's intention to adjust the function in the execution request. That is, the driver in the driver's seat has responded to the execution request with the execution condition "open the driver's window halfway." The vehicle can then execute the control command corresponding to the voice request based on the execution condition, execute the control command to open the driver's window halfway, and give the voice feedback "Okay, the driver's window has been opened halfway."

[0159] In this way, if a control command is issued by a user who is not in control, the vehicle can actively ask the user in control and execute the control command after obtaining the user's authorization. This can avoid the safety hazard caused by the user in the driver's seat having to manually operate the vehicle when the user in the driver's seat makes a voice request that can only be controlled by the user in the driver's seat.

[0160] Furthermore, considering that the user in the driver's seat needs to concentrate on driving while driving, and may not be able to hear or respond to voice requests from other users in a timely manner, the voice interaction method of the present invention allows the user in the driver's seat to authorize time-based authorization, authorization for specific passengers, and authorization for specific functions, thereby further enhancing the user experience.

[0161] Specifically, for authorization of the time dimension, please refer to [link / reference]. Figure 14 Step 04372 includes:

[0162] 043721: Responds to the user's confirmation request in the driver's seat and authorizes the user's voice control permissions during the current driving session, executing the control commands corresponding to the voice requests issued by the user during the current driving session.

[0163] The processor is used to respond to the user's confirmation request in the driver's seat and authorize the user's voice control permissions during the current driving process, and execute the control commands corresponding to the voice requests issued by the user during the current driving process.

[0164] For application scenarios such as a single trip or a single application usage period, the user in the driver's seat can authorize voice control rights during the current driving session from a time-based perspective. For example, in actual dialogue:

[0165] Passenger: I'd like to try out the sport driving mode.

[0166] Voice prompt: This involves driving functions. Please confirm, driver. Driver: Okay, I don't need to ask you again for this trip.

[0167] Voice prompt: Okay, driving mode is now switched to Sport. Please confirm authorization for the passenger to use all functions during this trip.

[0168] Driver: Confirm.

[0169] In this way, once the user in the driver's seat authorizes other users' voice requests during the current driving process from a time perspective, the control commands corresponding to any voice requests issued by other users during the current driving process can be executed, which can reduce trouble for the user in the driver's seat and ensure driving safety.

[0170] Specifically, for authorization of a particular passenger, please refer to [link / reference]. Figure 15 Step 04372 includes:

[0171] 043722: Responds to the user's confirmation request in the driver's seat and authorizes the user's identity information, then executes the control command corresponding to the user's voice request.

[0172] The processor is used to respond to the user's confirmation request in the driver's seat of the cockpit and authorize the user's identity information, and execute the control commands corresponding to the user's voice request.

[0173] For example, if a specific family member of the user in the driver's seat of a vehicle is granted specific authorization, their voiceprint information can be obtained. Then, during subsequent function operations, the control commands corresponding to the voice requests issued by the passenger with that voiceprint feature can be executed directly.

[0174] Taking actual dialogue performance as an example:

[0175] Passenger: I'd like to try out the sport driving mode.

[0176] Voice prompt: This involves driving functions. Please confirm, driver. Driver: Okay, don't ask me anything else he says from now on.

[0177] Voice prompt: Okay, driving mode is now set to Sport, and we've remembered the front passenger's voice.

[0178] In this way, once the user in the driver's seat authorizes a specific passenger, any voice request from that specific passenger can be directly executed, reducing hassle for the driver and ensuring driving safety.

[0179] For authorization of specific functions, please refer to Figure 16 Step 04372 includes:

[0180] 043723: In response to a user confirmation request from the driver in the cockpit and authorization of the vehicle control function corresponding to the voice request, executes the control command corresponding to the voice request for the vehicle control function issued by any user in the vehicle cockpit.

[0181] The processor is used to respond to the user's confirmation request in the driver's seat of the cockpit and authorize the vehicle control function corresponding to the voice request, and to execute the control command corresponding to the voice request for the vehicle control function issued by any user in the vehicle cockpit.

[0182] The user in the driver's seat confirms the execution request and authorizes the vehicle control function corresponding to the voice request. For example, if the vehicle control function is the window function, after the user in the driver's seat authorizes it, all users can initiate a voice request for the window function and execute the control commands related to the window function.

[0183] Taking actual dialogue performance as an example:

[0184] Passenger: I'd like to try out the sport driving mode.

[0185] Voice prompt: This involves driving functions. Please confirm, driver. Driver: Okay, you don't need to confirm driving mode adjustments anymore.

[0186] Voice prompt: Okay, I got it. I've also switched the driving mode to Sport for you.

[0187] In this way, once the user in the driver's seat authorizes a specific function, other users can directly execute the corresponding control commands for voice requests of that specific function, which reduces trouble for the user in the driver's seat and ensures driving safety.

[0188] In any of the above embodiments, considering that the user in the driver's seat may not have the time or energy to confirm whether to execute the request, the voice interaction method of the present invention further divides the functions that can be controlled by adult passengers in the vehicle and defines the associated person of the function. For example, the opening and closing of the passenger window is associated with the passenger in the front passenger seat. When other passengers make related voice requests for the function, they can confirm with the associated person whether to execute the request, thus reducing trouble for the user in the driver's seat.

[0189] Specifically, please refer to Figure 17 Controlling the vehicle to execute control commands corresponding to voice requests, including:

[0190] 04381: Confirm the third location information of the controlled object of the voice request in the vehicle cabin. If there is a passenger in the third location, send an execution request to determine whether to execute the voice request.

[0191] 04382: If the user confirms the execution request at the third position, execute the control command corresponding to the voice request;

[0192] 04383: If the user at the third position refuses to execute the request, refuse to respond to the control commands corresponding to the voice request;

[0193] 04384: In response to the execution conditions provided by the user at the third location regarding the execution request, execute the control command corresponding to the voice request based on the execution conditions.

[0194] The processor is used to confirm the third location information of the control object of the voice request within the vehicle cabin. If a passenger is present at the third location, it sends an execution request to determine whether to execute the voice request. If the user at the third location confirms the execution request, it executes the control command corresponding to the voice request. If the user at the third location refuses to execute the request, it refuses to respond to the control command corresponding to the voice request. In response to the execution conditions fed back by the user at the third location regarding the execution request, it executes the control command corresponding to the voice request according to the execution conditions.

[0195] The third position refers to a position other than the location where the user makes the voice request. The third position includes the driver's seat, the front passenger seat, the seat behind the driver, and the seat behind the front passenger. For example, if the user is currently in the driver's seat, the third position can be any one of the front passenger seat, the seat behind the driver, and the seat behind the front passenger.

[0196] The user in the third position can be the associated person for a function defined by the system default, or the user in the driver's seat can define the associated person for a function themselves.

[0197] For example, if a user in the rear passenger seat makes a voice request to "open the passenger window," the third location information within the vehicle cabin for this voice request is the passenger seat. If there is a passenger in the passenger seat, an execution request can be sent: "Please confirm whether to open the passenger window. Please confirm by saying 'OK.'"

[0198] If the front passenger replies "okay," it means the front passenger has confirmed the request. The vehicle will then execute the control command corresponding to the voice request to open the front passenger window and provide a voice feedback of "opened."

[0199] If the front passenger replies "Don't open," it means the front passenger refuses to comply with the request. The vehicle will then refuse to respond to the control command corresponding to the voice request, will not execute the control command to open the front passenger window, and will give a voice response of "Okay, don't open it yet."

[0200] If the vehicle detects that the front passenger replies "open the window halfway," it can perform semantic analysis on the voice to identify the driver's intention to adjust the function in the execution request. That is, the user in the driver's seat has responded to the execution request with the condition "open the front passenger window halfway." The vehicle can then execute the control command corresponding to the voice request based on the execution condition, execute the control command to open the front passenger window halfway, and give the voice feedback "Okay, the front passenger window has been opened halfway."

[0201] In this way, if a user in a non-third-party location issues a voice request for a control command, the vehicle can proactively inquire about the control object of the voice request and confirm the control object's location within the vehicle's cabin. After obtaining authorization from the passenger in the third location, the vehicle can then execute the control command corresponding to the voice request. This avoids the safety hazard caused by a user in a non-driver's seat making a voice request to the vehicle while driving, where only the user in the driver's seat can respond to the voice request due to distraction.

[0202] Please see Figure 17 The methods also include:

[0203] 05: Continuously monitor the voice content of users in the vehicle cabin;

[0204] 06: Perform semantic analysis on the speech content;

[0205] 07: Based on the results of semantic parsing, when the voice content is associated with vehicle control functions, send a request to determine whether to execute the control command corresponding to the vehicle control function associated with the voice content.

[0206] 08: If the user in the driver's seat confirms the execution request, execute the control command corresponding to the vehicle control function associated with the voice content.

[0207] The processor continuously monitors the voice content of users in the vehicle cabin; performs semantic parsing on the voice content; based on the results of the semantic parsing, if the voice content is associated with a vehicle control function, it sends an execution request to determine whether to execute the control command corresponding to the vehicle control function associated with the voice content; if the user in the driver's seat confirms the execution request, it executes the control command corresponding to the vehicle control function associated with the voice content.

[0208] Specifically, based on the aforementioned solution, the vehicle can be equipped with the ability to actively and continuously monitor the voice content of users in the vehicle cabin, perform semantic analysis on the voice content, and if the result of the semantic analysis is that the voice content between users in the vehicle cabin involves the intention to control vehicle functions, that is, the voice content is related to vehicle control functions, then the vehicle can actively initiate voice interaction, ask the person with the corresponding function control authority for authorization, and execute the relevant control commands, that is, send a request to whether to execute the control command corresponding to the vehicle control function associated with the voice content.

[0209] Taking actual dialogue performance as an example:

[0210] Back seat: Son, I'm a little carsick.

[0211] Driver: Mom, then I'll drive slower.

[0212] Voice prompt: Comfort driving mode can alleviate motion sickness. Would you like me to turn it on for you? Please confirm, driver.

[0213] Driver: Okay

[0214] Voice prompt: We've switched you to Comfort Driving Mode.

[0215] The voice prompts mentioned above refer to the vehicle's control functions related to the comfort driving mode that alleviates motion sickness, which are detected in the voice communication between the rear passengers and the driver.

[0216] Since the vehicle was in a non-Park gear while being driven, the voice request to activate the Comfort Driving Mode falls under the second function type, which is related to driving but not to vehicle safety.

[0217] Therefore, the authorized user of this Comfort Driving Mode is the user in the driver's seat or the logged-in user. The vehicle will then proactively send an execution request to the user in the driver's seat, such as the aforementioned "Comfort Driving Mode can relieve motion sickness. Would you like me to turn it on? Please confirm, driver."

[0218] Thus, based on the solution described above, the vehicle gains the ability to actively and continuously listen to the voice content of users in the vehicle cabin, perform semantic analysis on the voice content, and if the voice content between passengers involves the intention to control vehicle functions, it will actively initiate voice interaction to ask the person with the corresponding function control authority for authorization, further improving the user experience.

[0219] The present invention also provides a non-volatile computer-readable storage medium containing a computer program. When the computer program is executed by one or more processors, it implements the voice interaction method described in any of the above embodiments.

[0220] For example, when a computer program is executed by a processor, it implements the following steps for voice interaction:

[0221] 01: Receive voice requests from users inside the vehicle cabin;

[0222] 02: Confirm the user's identity information based on the voice request;

[0223] 03: Confirm the function type of the voice request based on the voice request. The function type of the voice request is pre-classified according to the relevance of the voice request to vehicle driving and vehicle safety.

[0224] 04: Based on the identity information and the function type of the voice request, execute the control command corresponding to the voice request to complete the voice interaction.

[0225] It is understood that a computer program includes computer program code. Computer program code can be in the form of source code, object code, executable files, or some intermediate form. Computer-readable storage media can include: any entity or device capable of carrying computer program code, recording media, USB flash drives, external hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), and software distribution media, etc.

[0226] The storage medium of the present invention, using the above-described voice interaction method, can directly execute the control command corresponding to the voice request after receiving a voice request from a user, and can directly execute the vehicle's functions after the corresponding controller issues a voice request. This improves efficiency and avoids situations where the operation is overly dependent on the user in the driver's seat, or where the vehicle's safety is threatened by the user in the driver's seat.

Claims

1. A voice interaction method, characterized in that, The method comprises: receiving a voice request issued by a user in a vehicle cabin; confirming identity information of the user according to the voice request; confirming a function type of the voice request according to the voice request, the function type being pre-divided according to the relevance of the voice request to vehicle driving and vehicle safety; executing a control instruction corresponding to the voice request according to the identity information and the function type of the voice request to complete the voice interaction; in a case where the function type of the voice request is a non-first function type, executing the control instruction corresponding to the voice request according to the identity information, the function type of the voice request and gear information of the vehicle, the first function type being a type related to both vehicle driving and vehicle safety.

2. The voice interaction method of claim 1, wherein, The confirming of the identity information of the user according to the voice request comprises: confirming second position information of the user in the vehicle cabin according to first position information of a microphone receiving the voice request; confirming the identity information of the user according to the second position information.

3. The voice interaction method of claim 2, wherein, The confirming of the identity information of the user according to the second position information comprises: in a case where the microphone is located at a main driving position in the vehicle cabin, confirming that the user is a user at the main driving position in the cabin.

4. The voice interaction method of claim 3, wherein, The confirming of the identity information of the user according to the voice request comprises: in a case where the microphone is located at a non-main driving position in the vehicle cabin, acquiring voiceprint information of the user according to the voice request; confirming the identity information of the user according to the voiceprint information.

5. The voice interaction method of claim 4, wherein, The confirming of the identity information of the user according to the voiceprint information comprises: in a case where the voiceprint information is consistent with voiceprint information of a pre-recorded login account of a vehicle-mounted system, confirming that the user is a login user of the vehicle-mounted system.

6. The voice interaction method of claim 5, wherein, The confirming of the identity information of the user according to the voiceprint information comprises: in a case where the voiceprint information is inconsistent with the voiceprint information of the pre-recorded login account of the vehicle-mounted system, confirming an age range of the user according to the voiceprint information, the age range including adults and minors.

7. The voice interaction method of claim 6, wherein, The executing of the control instruction corresponding to the voice request according to the identity information and the function type of the voice request to complete the voice interaction comprises: in a case where the function type of the voice request is a first function type, if the user is a user at the main driving position in the cabin or a login user of the vehicle-mounted system, executing the control instruction corresponding to the voice request, the first function type being a type related to both vehicle driving and vehicle safety; if the user is an adult or a minor at the non-main driving position, refusing to respond to the control instruction corresponding to the voice request.

8. The voice interaction method of claim 7, wherein, The executing of the control instruction corresponding to the voice request according to the identity information, the function type of the voice request and the gear information of the vehicle in a case where the function type of the voice request is a non-first function type comprises: In a case where the function type of the voice request is the second function type and the vehicle gear is in the P gear, in response to a voice request issued by a user of any identity in the vehicle cabin, a control instruction corresponding to the voice request is executed, the second function type of voice request being related to vehicle driving but not related to vehicle safety; In a case where the function type of the voice request is the second function type and the vehicle gear is not in the P gear, if the user is the user of the main driver position of the cabin or the logged-in user, a control instruction corresponding to the voice request is executed, and if the user is the adult or the minor, a control instruction corresponding to the voice request is refused.

9. The voice interaction method of claim 7, wherein, The execution of the control instruction corresponding to the voice request in the case where the function type of the voice request is not the first function type includes: In a case where the function type of the voice request is the third function type and the vehicle gear is in the P gear, if the user is the user of the main driver position of the cabin or the logged-in user or the adult, a control instruction corresponding to the voice request is executed, and if the user is the minor, a control instruction corresponding to the voice request is refused, the third function type of voice request being not related to vehicle driving but related to vehicle safety; In a case where the function type of the voice request is the third function type and the vehicle gear is not in the P gear, if the user is the user of the main driver position of the cabin or the logged-in user, a control instruction corresponding to the voice request is executed, and if the user is the adult or the minor, a control instruction corresponding to the voice request is refused.

10. The voice interaction method of claim 7, wherein, The execution of the control instruction corresponding to the voice request in the case where the function type of the voice request is not the first function type includes: In a case where the function type of the voice request is the fourth function type and the vehicle gear is in the P gear, in response to a voice request issued by a user of any identity in the vehicle cabin, a control instruction corresponding to the voice request is executed, the fourth function type of voice request being not related to vehicle driving and vehicle safety; In a case where the function type of the voice request is the fourth function type and the vehicle gear is not in the P gear, if the user is the user of the main driver position of the cabin or the logged-in user or the adult, a control instruction corresponding to the voice request is executed, and if the user is the minor, a control instruction corresponding to the voice request is refused.

11. The voice interaction method of any one of claims 7, 8, 9, or 10, wherein, The refusal to respond to the control instruction corresponding to the voice request includes: In a case where it is confirmed that the user of the main driver position of the cabin is located in the vehicle cabin, an execution request of whether to execute the voice request is sent; In a case where the user of the main driver position of the cabin confirms the execution request, a control instruction corresponding to the voice request is executed; In a case where the user of the main driver position of the cabin refuses the execution request, a control instruction corresponding to the voice request is refused; In response to an execution condition fed back by the user in the cockpit driver position for the execution request, the control instruction corresponding to the voice request is executed according to the execution condition.

12. The voice interaction method of claim 11, wherein, The execution of the control instruction corresponding to the voice request in the case where the user in the cockpit driver position confirms the execution request comprises: In response to the user in the cockpit driver position confirming the execution request and authorizing the voice control authority of the user in the current driving process, the control instruction corresponding to the voice request issued by the user in the current driving process is executed.

13. The voice interaction method of claim 11, wherein, The execution of the control instruction corresponding to the voice request in the case where the user in the cockpit driver position confirms the execution request comprises: In response to the user in the cockpit driver position confirming the execution request and authorizing the identity information of the user, the control instruction corresponding to the voice request issued by the user is executed.

14. The voice interaction method of claim 11, wherein, The execution of the control instruction corresponding to the voice request in the case where the user in the cockpit driver position confirms the execution request comprises: In response to the user in the cockpit driver position confirming the execution request and authorizing the vehicle control function corresponding to the voice request, the control instruction corresponding to the voice request for the vehicle control function issued by any user in the vehicle cockpit is executed.

15. The voice interaction method of any one of claims 7, 8, 9, or 10, wherein, The control of the vehicle to execute the control instruction corresponding to the voice request comprises: Confirming third position information of a control object of the voice request in the vehicle cockpit, and sending an execution request of whether to execute the voice request in the case where a user exists at the third position; In the case where the user at the third position confirms the execution request, the control instruction corresponding to the voice request is executed; In the case where the user at the third position refuses the execution request, the control instruction corresponding to the voice request is refused; In response to an execution condition fed back by the user at the third position for the execution request, the control instruction corresponding to the voice request is executed according to the execution condition.

16. The voice interaction method of claim 1, wherein, The method further comprises: Continuously monitoring voice content of a user in the vehicle cockpit; Performing semantic analysis on the voice content; According to a result of the semantic analysis, in the case where the voice content is associated with a vehicle control function, an execution request of whether to execute a control instruction corresponding to the vehicle control function associated with the voice content is sent; In the case where the user in the cockpit driver position confirms the execution request, the control instruction corresponding to the vehicle control function associated with the voice content is executed.

17. A vehicle characterized by comprising: The vehicle comprises a processor and a memory, and the memory stores a computer program, when the computer program is executed by the processor, the voice interaction method in any one of claims 1-16 is realized.

18. A non-transitory computer readable storage medium embodying a computer program, comprising: When the computer program is executed by one or more processors, the voice interaction method in any one of claims 1-16 is realized.

Images