Voice control method and device, computer equipment and storage medium

By receiving non-voice triggering operations on the on-board terminal and initiating voice guidance, users can use voice commands to operate on the on-board terminal, solving the problem that users find it difficult to quickly find applications and improving driving safety.

CN119479637APending Publication Date: 2025-02-18SHANGHAI JIDU AUTOMOBILE CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202311016567.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-08-11
Publication Date
2025-02-18

AI Technical Summary

Technical Problem

There are various functions on the on-board terminal, but it is difficult for users to quickly find applications, which affects driving safety.

Method used

By receiving the user's non-voice triggering operation, the historical feedback information of the target operation scenario is obtained. If the voice guidance condition is met, voice guidance will be initiated to help the user perform triggering operations through voice commands.

Benefits of technology

It improves the usage rate of voice trigger operations during driving, reduces the safety risks brought by non-voice trigger operations, and improves the driving safety of users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119479637A_ABST
    Figure CN119479637A_ABST
Patent Text Reader

Abstract

The invention provides a voice control method and device, computer equipment and a storage medium, and the method comprises the steps: receiving a non-voice triggering operation of a user on a vehicle terminal; a target operation scene corresponding to the non-voice trigger operation belongs to a preset operation scene; the preset operation scene is an operation scene which needs to establish cognition of a user using a voice instruction; acquiring historical feedback information corresponding to the target operation scene; if it is determined that the historical feedback information meets the voice guiding condition, voice guiding is initiated, and the voice guiding is used for guiding the user to conduct triggering operation through a voice instruction.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a voice control method, device, computer equipment and storage medium. Background Art

[0002] With the development of vehicle terminal technology, more and more functions can be realized on vehicle terminals. While a large number of vehicle functions enrich the riding experience of vehicle users, they also bring troubles to vehicle users in that they cannot find applications quickly. For example, if a user is looking for a certain function application, he may need to swipe multiple times to find the relevant function application, which may affect the user's driving safety. Summary of the invention

[0003] The embodiments of the present disclosure at least provide a voice control method, apparatus, computer equipment, and storage medium.

[0004] In a first aspect, an embodiment of the present disclosure provides a voice control method, including:

[0005] Receiving a non-voice trigger operation of a vehicle terminal by a user; the target operation scenario corresponding to the non-voice trigger operation belongs to a preset operation scenario; the preset operation scenario is an operation scenario that requires the establishment of the user's cognition of using voice commands;

[0006] Obtaining historical feedback information corresponding to the target operation scenario;

[0007] If it is determined that the historical feedback information meets the voice guidance condition, voice guidance is initiated, and the voice guidance is used to guide the user to perform a trigger operation through a voice instruction.

[0008] In a possible implementation manner, the historical feedback information includes the number of historical positive feedbacks;

[0009] The number of historical positive feedbacks includes: the number of times a trigger operation is performed in the historical target operation scenario through voice instructions after voice guidance is initiated in response to the historical target operation scenario.

[0010] In one possible implementation, the historical feedback information satisfies the voice guidance conditions, including: the number of historical positive feedbacks does not exceed a preset number, and / or, within a historical preset time range, there is no historical record of performing operations through voice commands in the target operation scenario.

[0011] In a possible implementation manner, the initiating voice guidance includes:

[0012] Determine a prompt label under each prompt dimension corresponding to the target operation scenario;

[0013] Initiate voice guidance based on the prompt under the prompt label.

[0014] In a possible implementation manner, after initiating voice guidance, the method further includes determining the voice instruction by the following method:

[0015] Receiving a response voice input by a user;

[0016] Perform word segmentation processing on the text corresponding to the response voice and display the word segmentation processing result;

[0017] In response to an editing operation on the word segmentation processing result, the voice instruction is determined based on the edited text.

[0018] In a possible implementation manner, performing word segmentation processing on the text corresponding to the response voice and displaying the word segmentation processing result includes:

[0019] Determine the current driving state of the vehicle;

[0020] When the driving state is the target driving state, the text corresponding to the response voice is segmented and the segmentation result is displayed.

[0021] In a possible implementation manner, the preset operation scenario includes:

[0022] A scenario in which the time of the non-voice triggering operation is detected to be a target time period;

[0023] Alternatively, a scenario in which the vehicle state of the current vehicle is the target vehicle state;

[0024] Alternatively, the operation information of the non-voice triggered operation meets the scenario of the operation condition.

[0025] In a possible implementation manner, the acquiring the historical feedback information corresponding to the target operation scenario includes:

[0026] Determining a user identifier for performing the non-voice trigger operation;

[0027] When it is detected that the user identifier is a target user identifier, historical feedback information corresponding to the target operation scenario is obtained.

[0028] In a second aspect, the present disclosure also provides a voice control device, including:

[0029] A receiving module, used for receiving a non-voice trigger operation of a user on a vehicle terminal; the target operation scenario corresponding to the non-voice trigger operation belongs to a preset operation scenario; the preset operation scenario is an operation scenario that requires the establishment of the user's cognition of using voice commands;

[0030] An acquisition module, used to acquire historical feedback information corresponding to the target operation scenario;

[0031] The guidance module is used to initiate voice guidance if it is determined that the historical feedback information meets the voice guidance condition, and the voice guidance is used to guide the user to perform a trigger operation through a voice instruction.

[0032] In a possible implementation manner, the historical feedback information includes the number of historical positive feedbacks;

[0033] The number of historical positive feedbacks includes: the number of times a trigger operation is performed in the historical target operation scenario through voice instructions after voice guidance is initiated in response to the historical target operation scenario.

[0034] In one possible implementation, the historical feedback information satisfies the voice guidance conditions, including: the number of historical positive feedbacks does not exceed a preset number, and / or, within a historical preset time range, there is no historical record of performing operations through voice commands in the target operation scenario.

[0035] In a possible implementation manner, the guidance module, when initiating voice guidance, is used to:

[0036] Determine a prompt label under each prompt dimension corresponding to the target operation scenario;

[0037] Initiate voice guidance based on the prompt under the prompt label.

[0038] In a possible implementation manner, after initiating voice guidance, the guidance module is further configured to determine the voice instruction through the following steps:

[0039] Receiving a response voice input by a user;

[0040] Perform word segmentation processing on the text corresponding to the response voice and display the word segmentation processing result;

[0041] In response to an editing operation on the word segmentation processing result, the voice instruction is determined based on the edited text.

[0042] In a possible implementation manner, the guiding module, when performing word segmentation processing on the text corresponding to the response voice and displaying the word segmentation processing result, is used to:

[0043] Determine the current driving state of the vehicle;

[0044] When the driving state is the target driving state, the text corresponding to the response voice is segmented and the segmentation result is displayed.

[0045] In a possible implementation manner, the preset operation scenario includes:

[0046] A scenario in which the time of the non-voice triggering operation is detected to be a target time period;

[0047] Alternatively, a scenario in which the vehicle state of the current vehicle is the target vehicle state;

[0048] Alternatively, the operation information of the non-voice triggered operation meets the scenario of the operation condition.

[0049] In a possible implementation manner, the acquisition module, when acquiring the historical feedback information corresponding to the target operation scenario, is used to:

[0050] Determining a user identifier for performing the non-voice trigger operation;

[0051] When it is detected that the user identifier is a target user identifier, historical feedback information corresponding to the target operation scenario is obtained.

[0052] In a third aspect, an embodiment of the present disclosure further provides a computer device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the above-mentioned first aspect, or any possible implementation of the first aspect are performed.

[0053] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned first aspect, or any possible implementation of the first aspect are executed.

[0054] The voice control method, device, computer equipment and storage medium provided by the embodiments of the present disclosure can obtain historical feedback information corresponding to the target operation scenario when receiving the target operation scenario corresponding to the non-voice trigger operation of the user on the vehicle terminal, which is a preset operation scenario that requires the establishment of the user's cognition of using voice commands, and initiate voice guidance when the historical feedback information meets the voice guidance conditions, so as to help the user establish the cognition of using voice commands in the target operation scenario. In this way, compared with using non-voice trigger operations to realize interactive functions during driving, when the historical feedback information of the target operation scenario corresponding to the current non-voice trigger operation meets the voice guidance conditions, voice guidance is timely provided to the user, and the user is helped to establish the cognition of using voice commands in the target operation scenario, which can improve the utilization rate of voice trigger operations during driving, reduce the safety risks caused by the user's use of non-voice trigger operations during driving, and improve the user's driving safety.

[0055] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following is a brief introduction to the drawings required for use in the embodiments. The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used together with the specification to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can also be obtained based on these drawings without creative work.

[0057] Figure 1 A flow chart of a voice control method provided by an embodiment of the present disclosure is shown;

[0058] Figure 2 A schematic diagram corresponding to a non-voice triggering operation in the voice control method provided in an embodiment of the present disclosure is shown;

[0059] Figure 3 A judgment flow chart for determining whether historical feedback information meets a voice guidance condition in the voice control method provided by an embodiment of the present disclosure is shown;

[0060] Figure 4 A schematic diagram showing voice guidance in the voice control method provided by an embodiment of the present disclosure is shown;

[0061] Figure 5 A schematic diagram showing a word segmentation processing result and an editing operation on the word segmentation processing result in the voice control method provided by an embodiment of the present disclosure is shown;

[0062] Figure 6 A schematic diagram of the architecture of a voice control device provided by an embodiment of the present disclosure is shown;

[0063] Figure 7 A schematic diagram of the structure of a computer device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0064] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.

[0065] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0066] The term "and / or" herein only describes an association relationship, indicating that three relationships may exist. For example, A and / or B may represent the following three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C may represent including any one or more elements selected from the set consisting of A, B, and C.

[0067] Research has found that with the development of vehicle terminal technology, more and more functions can be realized on vehicle terminals. While a large number of vehicle functions enrich the riding experience of vehicle users, they also cause vehicle users to have trouble finding applications quickly. For example, if a user is looking for a certain function application, he may need to swipe multiple times to find the relevant function application, which may affect the user's driving safety.

[0068] Based on the above research, the present disclosure provides a voice control method, device, computer equipment and storage medium. When receiving the target operation scenario corresponding to the non-voice trigger operation of the user on the vehicle terminal, which is a preset operation scenario that requires the establishment of the user's cognition of using voice commands, the historical feedback information corresponding to the target operation scenario can be obtained, and voice guidance can be initiated when the historical feedback information meets the voice guidance conditions to help the user establish the cognition of using voice commands in the target operation scenario. In this way, compared with using non-voice trigger operations to realize interactive functions during driving, when the historical feedback information of the target operation scenario corresponding to the current non-voice trigger operation meets the voice guidance conditions, the user is promptly voice-guided, and the user is helped to establish the cognition of using voice commands in the target operation scenario, which can improve the utilization rate of voice trigger operations during driving, reduce the safety risks caused by the user's use of non-voice trigger operations during driving, and improve the user's driving safety.

[0069] To facilitate understanding of this embodiment, a voice control method disclosed in the embodiment of the present disclosure is first introduced in detail. The execution subject of the voice control method provided in the embodiment of the present disclosure is generally a vehicle-mounted device with certain computing capabilities, and the vehicle-mounted device may be a vehicle-mounted terminal, which may be deployed in an intelligent driving vehicle. In some possible implementations, the voice control method may be implemented by a processor calling a computer-readable instruction stored in a memory.

[0070] See also Figure 1 FIG. 1 is a flow chart of a voice control method provided by an embodiment of the present disclosure, wherein the method includes S101 to S103, wherein:

[0071] S101: Receive a non-voice trigger operation of a user on a vehicle terminal; the target operation scenario corresponding to the non-voice trigger operation belongs to a preset operation scenario; the preset operation scenario is an operation scenario that requires the user to establish cognition of using voice commands.

[0072] S102: Acquire historical feedback information corresponding to the target operation scenario.

[0073] S103: If it is determined that the historical feedback information meets the voice guidance condition, voice guidance is initiated, and the voice guidance is used to guide the user to perform a trigger operation through a voice instruction.

[0074] The following is a detailed description of the above steps.

[0075] For S101, the vehicle terminal may include an on-board display terminal with interactive functions; the non-voice trigger operation may be a trigger operation for a text box displayed on the on-board terminal, a trigger operation for a navigation target input bar, etc.; by establishing the user's cognition of using voice commands, the user can be guided to no longer use non-voice trigger operations in the preset operation scenarios, but to complete the corresponding operation goals through voice trigger operations, and the operation goals may be searching for media content, searching for navigation targets, etc.

[0076] Exemplarily, the schematic diagram corresponding to the non-voice trigger operation may be: Figure 2 As shown, Figure 2 The interface of the vehicle terminal occupies a search page for displaying content and search results. The top of the search page contains a text box for entering search content, and the user can initiate a trigger operation on the text box.

[0077] The preset operation scenarios may include the following scenarios:

[0078] Scenario 1: A scenario in which the time when the non-voice triggering operation is detected is a target time period.

[0079] Here, the time of the non-voice trigger operation may be relative to the usage time of the vehicle terminal, and the usage time relative to the vehicle terminal may be determined through the historical usage record of the vehicle terminal. For example, the time of the non-voice trigger operation may be determined according to the historical usage record of the vehicle terminal as the fifth day of the user's use of the vehicle terminal (or the voice interaction function in the vehicle terminal); the target time period may be a preset time period for characterizing the user as a novice, such as within one month of the user's use of the vehicle terminal (or the voice interaction function in the vehicle terminal). During this time period, since the user has just started using the corresponding functions in the vehicle terminal, he may not be familiar with the functions in the vehicle terminal, and thus this scenario may be used as an operation scenario that requires the establishment of the user's awareness of using voice commands.

[0080] In addition, in addition to determining whether the user is a novice who needs to establish awareness of using voice commands by detecting whether the time of the non-voice trigger operation is within the target time period, it is also possible to determine whether the user is a novice who needs to establish awareness of using voice commands by detecting whether the number of operations of the non-voice trigger operation (or the number of times the vehicle terminal is used) exceeds a preset number of operations. Any of the above-mentioned determination methods can be combined with at least one determination method other than the above-mentioned determination method to determine whether the current scene is the target operation scene.

[0081] Scenario 2: The vehicle state of the current vehicle is the target vehicle state.

[0082] Here, the target vehicle state is used to characterize a state in which it is inconvenient for the user to manually operate the vehicle terminal. For example, the current vehicle is driving fast, the current vehicle is driving on a pedestrian street with a large flow of people, the current vehicle is driving in an accident-prone area where traffic accidents are prone to occur, etc. Since it is inconvenient for the user to manually operate the vehicle terminal at this time, the scenario in which the current vehicle state is the target vehicle state can be used as a target operation scenario that requires establishing the user's cognition of using voice commands.

[0083] Specifically, when determining the vehicle state of the current vehicle, the real-time vehicle state of the current vehicle can be determined by combining at least one parameter among multiple parameters such as the driving parameters of the current vehicle and collected environmental parameters, and then determining whether the vehicle state of the current vehicle is the target vehicle state based on the determined real-time vehicle state.

[0084] Scenario 3: The scenario where the operation information of the non-voice triggered operation meets the operation conditions.

[0085] Here, the operation information is used to record the relevant operation attributes of the non-voice triggered operation. The operation information may include the number of operations, operation time, operation type, etc. The operation information is recorded after user authorization; the operation information meets the operation conditions and may include that the number of operations of non-voice triggered operations of the same operation type (or similar operation type) within a preset time period exceeds the preset number of operations, such as 4 sliding operations (including left sliding operations and right sliding operations) within 5 seconds. At this time, it indicates that the user's non-voice triggered operation may not be able to complete the user's operation goal. Therefore, the scenario where the operation information of the non-voice triggered operation meets the operation conditions can be used as a target operation scenario that requires establishing the user's cognition of using voice commands.

[0086] In this way, by pre-targeting target operation scenarios that require the user to establish awareness of using voice commands, we can combine subsequent operation steps to help users quickly establish awareness of using voice commands through voice guidance, so that users can actively use voice triggered operations in scenarios suitable for voice triggered operations, thereby improving user interaction experience and operation efficiency.

[0087] For S102,

[0088] Here, the historical feedback information may include the number of historical positive and negative feedbacks, the historical records of operations performed through voice commands in the target operation scenario, etc.; the number of historical positive and negative feedbacks may include the number of trigger operations performed in the historical target operation scenario through voice commands after initiating voice guidance in response to the historical target operation scenario.

[0089] Specifically, if the user initiates voice guidance in a historical target operation scenario and then performs a trigger operation through a voice command, it indicates that the user has provided positive feedback to the voice guidance (i.e., has followed the guidance and performed the voice trigger operation). The number of historical positive and negative feedbacks can be used to determine whether it is necessary to continue providing voice guidance to the user.

[0090] In a possible implementation manner, when acquiring the historical feedback information corresponding to the target operation scenario, the following steps A1 to A2 may be performed:

[0091] A1: Determine the user identity of performing the non-voice trigger operation.

[0092] Here, the user identifier for performing the non-voice trigger operation represents the identifier of the user performing the non-voice trigger operation (ie, the user identifier).

[0093] Specifically, when determining the user identification who performs the non-voice trigger operation, the user identification who performs the non-voice trigger operation in the current vehicle can be identified through an image acquisition device deployed in the current vehicle; the image acquisition device performs image acquisition after user authorization, and the user identification who performs the non-voice trigger operation can be determined through the images inside the vehicle acquired by the image acquisition device.

[0094] A2: When it is detected that the user identifier is a target user identifier, historical feedback information corresponding to the target operation scenario is obtained.

[0095] Here, the target user identifier can be the owner of the current vehicle, that is, when it is detected that the user currently performing the non-voice trigger operation is the owner, the historical feedback information corresponding to the target operation scenario is obtained to determine whether voice guidance is needed based on the historical feedback information.

[0096] For S103,

[0097] Here, the voice guidance condition is used to determine whether it is necessary to initiate voice guidance based on the historical feedback information obtained; if it is determined that the historical feedback information does not meet the voice guidance condition, the trigger content corresponding to the non-voice trigger operation can be displayed. For example, a keyboard can be displayed in response to a trigger operation on the search bar so that text content can be input according to the user's trigger operation on the keyboard.

[0098] The historical feedback information meeting the voice guidance condition may include the following situations:

[0099] Case 1: The number of historical positive feedbacks does not exceed the preset number.

[0100] Here, if the number of historical positive and negative feedbacks does not exceed the preset number, it indicates that the user has performed voice trigger operations in accordance with the voice guidance less frequently. At this time, the user may not have developed the habit of performing trigger operations through voice instructions. Therefore, if the number of historical positive and negative feedbacks does not exceed the preset number, it can be determined that the historical feedback information meets the voice guidance conditions, thereby initiating voice guidance to guide the user to perform trigger operations through voice instructions, so as to help the user develop the habit of performing trigger operations through voice instructions.

[0101] Exemplarily, taking the preset number of times as 5 times, when the number of historical positive feedbacks contained in the acquired historical feedback information is 4 times, it can be determined that the historical feedback information meets the voice guidance conditions, thereby initiating voice guidance for guiding the user to trigger the operation through voice instructions.

[0102] Case 2: Within the historical preset time range, there is no historical record of performing operations through voice commands in the target operation scenario.

[0103] Here, the historical preset time range can be within one week before the current moment, within three days before the current moment, etc.; if there is no historical record of performing operations through voice commands in the target operation scenario within the historical preset time range, it means that the user may not have developed the habit of triggering operations through voice commands. Therefore, if there is no historical record of performing operations through voice commands in the target operation scenario within the historical preset time range, it can be determined that the historical feedback information meets the voice guidance conditions, so as to initiate voice guidance for guiding the user to trigger operations through voice commands, so as to help the user develop the habit of triggering operations through voice commands.

[0104] Exemplarily, taking the historical preset time range as one week before the current moment, if there is no historical record of performing operations through voice commands in the target operation scenario within one week before the current moment, it can be determined that the historical feedback information meets the voice guidance conditions, thereby initiating voice guidance to guide the user to trigger the operation through voice commands.

[0105] Case 3: The number of historical positive feedbacks does not exceed the preset number, and within the historical preset time range, there is no historical record of performing operations through voice commands in the target operation scenario.

[0106] Here, if the number of historical positive and negative feedbacks does not exceed the preset number, and there is no historical record of performing operations through voice commands in the target operation scenario within the historical preset time range, it means that the user may not have developed the habit of triggering operations through voice commands. Therefore, if the number of historical positive and negative feedbacks does not exceed the preset number, and there is no historical record of performing operations through voice commands in the target operation scenario within the historical preset time range, it can be determined that the historical feedback information meets the voice guidance conditions, so that voice guidance can be initiated to guide the user to trigger operations through voice commands, so as to help the user develop the habit of triggering operations through voice commands.

[0107] For example, taking the non-voice trigger operation as a trigger operation for a text box displayed on the vehicle terminal as an example, the judgment flow chart for determining whether the historical feedback information meets the voice guidance condition can be as follows: Figure 3 As shown, Figure 3 After the text box is triggered for the first time, voice guidance can be initiated, and it is recorded whether the user performs the trigger operation in the historical target operation scenario through voice instructions after the voice guidance is initiated. If the trigger operation is performed in the historical target operation scenario through voice instructions, it is recorded as positive feedback, and if the trigger operation is not performed in the historical target operation scenario through voice instructions, it is recorded as negative feedback; when the text box is triggered again in the target operation scenario, a first judgment can be made based on the historical feedback information to determine whether the number of historical positive and negative feedbacks exceeds the preset number. If so, a keyboard will pop up for text input. If not, a second judgment can be made based on the historical feedback information to determine whether there is a historical record of performing operations through voice instructions in the target operation scenario within the historical preset time range. If so, a keyboard will pop up for text input. If not, it can be determined that the historical feedback information meets the voice guidance conditions, thereby initiating voice guidance for guiding the user to perform the trigger operation through voice instructions.

[0108] In a possible implementation manner, when initiating voice guidance, the following steps B1 to B2 may be performed:

[0109] B1: Determine the prompt label under each prompt dimension corresponding to the target operation scenario.

[0110] B2: Initiate voice guidance based on the prompt under the prompt label.

[0111] Here, the number of prompt dimensions corresponding to the target operation scenario can be multiple, and different prompt dimensions are used to describe the relationship between the target operation scenario and the prompt label from different dimensions. The prompt dimensions may include common relevance, amount of information, directionality, etc.; each prompt dimension includes at least one prompt label, and the prompt label may be a map, media, etc. Different prompt labels may correspond to dynamically updateable prompt words, so that after the prompt label is determined, voice guidance can be initiated according to the prompt words that can be dynamically updated under the prompt label, so that the prompt words used when initiating voice guidance are associated with the target operation scenario, and the prompt words that can be updated in real time can enrich the content of the prompt words, thereby enriching the user's voice interaction experience.

[0112] Specifically, when determining the prompt labels under each prompt dimension corresponding to the target operation scenario, the degree of association between the preset prompt labels under each prompt dimension and the target operation scenario can be determined respectively, and the preset prompt labels can be screened according to the determined degree of association to determine the prompt labels under each prompt dimension corresponding to the target operation scenario; wherein, when determining the degree of association between the preset prompt labels under each prompt dimension and the target operation scenario, for any prompt dimension, the dimensional content corresponding to the prompt dimension can be used as a judgment basis to determine the prompt label corresponding to the target operation scenario under the prompt dimension.

[0113] Exemplarily, taking the prompt dimension as information volume, the dimension content as rich information volume, and the number of preset prompt labels as 10 as an example, the degree of association between each preset prompt label and the target operation scenario can be determined based on whether the amount of information corresponding to the prompt label is rich, and the preset prompt labels can be screened according to the determined degree of association between each preset prompt label and the target operation scenario to obtain one prompt label that meets the preset association degree requirements, so that voice guidance can be initiated based on the prompt language that can be dynamically updated under the prompt label.

[0114] Exemplarily, the schematic diagram for voice guidance can be as follows: Figure 4 As shown, Figure 4 In the present invention, a pop-up window containing prompt words can be displayed on the upper layer of the search page. The pop-up window can also include triggered "keyboard", "search" and "delete" buttons. After each button is triggered, the corresponding interactive function can be performed.

[0115] Furthermore, after initiating the voice guidance, the voice instructions may be determined through the following steps C1 to C3:

[0116] C1: Receive the response voice input by the user.

[0117] Here, the response voice input by the user can be received through the audio collection device currently deployed in the vehicle.

[0118] C2: Perform word segmentation processing on the text corresponding to the response voice and display the word segmentation processing result.

[0119] Here, when performing word segmentation processing on the text corresponding to the response voice, the response voice can be firstly subjected to speech-to-text conversion processing to obtain the text corresponding to the response voice, and the text corresponding to the response voice is subjected to word segmentation processing by a preset word segmentation algorithm to obtain the word segmentation processing result, so as to display the word segmentation processing result; wherein, the word segmentation algorithm can include word segmentation processing according to a word segmentation dictionary, word segmentation processing according to a preset word segmentation length, etc., and the embodiment of the present disclosure does not limit which specific word segmentation algorithm is adopted.

[0120] In a possible implementation, when performing word segmentation processing on the text corresponding to the response voice and displaying the word segmentation processing result, the following steps C21 to C22 may be performed:

[0121] C21: Determine the current driving state of the vehicle.

[0122] Here, the driving status of the vehicle may include the vehicle's real-time gear position, real-time vehicle speed, etc.

[0123] C22: When the driving state is the target driving state, perform word segmentation processing on the text corresponding to the response voice, and display the word segmentation processing result.

[0124] Here, the target driving state refers to a driving state that is convenient for the user to perform editing operations, and the target driving state may include a low-speed driving state, a stationary state, an automatic driving state, and the like.

[0125] Specifically, since the user can safely perform editing operations in the target driving state, the text corresponding to the response voice can be segmented and the segmentation results can be displayed for the user to perform subsequent editing operations.

[0126] C3: In response to an editing operation on the word segmentation processing result, the voice instruction is determined based on the edited text.

[0127] Here, since the user can safely perform editing operations in the target driving state, the editing operation on the word segmentation processing result can be responded to, and the voice instruction can be determined based on the edited text to perform voice interaction based on the determined voice instruction.

[0128] Exemplarily, taking the response voice of "Is there a song that reminds you of AABB" as an example, when it is determined that the current driving state of the vehicle is the target driving state, the response voice "Is there a song that reminds you of AABB" can be segmented according to a preset word segmentation algorithm to obtain the word segmentation results "is there", "a song", "will make you", "remember", "AA", "BB", and in response to an editing operation on the displayed word segmentation result, the edited text "Is there a song that reminds you of AA" is used as a voice command for voice interaction.

[0129] Continuing with the above example, a diagram showing the word segmentation results and editing the word segmentation results can be as follows: Figure 5 As shown, Figure 5 In the pop-up window, the word segmentation processing result is displayed. The user can edit the word segmentation processing result by triggering the corresponding word segmentation processing result (i.e., the word segmentation content) to the text box above to obtain the voice command.

[0130] The voice control method provided by the embodiment of the present disclosure can obtain historical feedback information corresponding to the target operation scenario when receiving the target operation scenario corresponding to the non-voice trigger operation of the user on the vehicle terminal, which is a preset operation scenario that requires the establishment of the user's cognition of using voice commands, and initiate voice guidance when the historical feedback information meets the voice guidance conditions, so as to help the user establish the cognition of using voice commands in the target operation scenario. In this way, compared with using non-voice trigger operations to realize interactive functions during driving, when the historical feedback information of the target operation scenario corresponding to the current non-voice trigger operation meets the voice guidance conditions, voice guidance is timely provided to the user, and the user is helped to establish the cognition of using voice commands in the target operation scenario, which can improve the utilization rate of voice trigger operations during driving, reduce the safety risks caused by the user's use of non-voice trigger operations during driving, and improve the user's driving safety.

[0131] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0132] Based on the same inventive concept, a voice control device corresponding to the voice control method is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned voice control method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0133] Reference Figure 6, which is a schematic diagram of the architecture of a voice control device provided by an embodiment of the present disclosure, the device includes: a receiving module 601, an acquisition module 602, and a guiding module 603; wherein,

[0134] The receiving module 601 is used to receive a non-voice trigger operation of the user on the vehicle terminal; the target operation scenario corresponding to the non-voice trigger operation belongs to a preset operation scenario; the preset operation scenario is an operation scenario that requires the establishment of the user's cognition of using voice commands;

[0135] An acquisition module 602 is used to acquire historical feedback information corresponding to the target operation scenario;

[0136] The guidance module 603 is used to initiate voice guidance if it is determined that the historical feedback information meets the voice guidance condition, and the voice guidance is used to guide the user to perform a trigger operation through a voice instruction.

[0137] In a possible implementation manner, the historical feedback information includes the number of historical positive feedbacks;

[0138] The number of historical positive feedbacks includes: the number of times a trigger operation is performed in the historical target operation scenario through voice instructions after voice guidance is initiated in response to the historical target operation scenario.

[0139] In one possible implementation, the historical feedback information satisfies the voice guidance conditions, including: the number of historical positive feedbacks does not exceed a preset number, and / or, within a historical preset time range, there is no historical record of performing operations through voice commands in the target operation scenario.

[0140] In a possible implementation manner, the guidance module 603, when initiating voice guidance, is used to:

[0141] Determine a prompt label under each prompt dimension corresponding to the target operation scenario;

[0142] Initiate voice guidance based on the prompt under the prompt label.

[0143] In a possible implementation manner, after initiating voice guidance, the guidance module 603 is further configured to determine the voice instruction through the following steps:

[0144] Receiving a response voice input by a user;

[0145] Perform word segmentation processing on the text corresponding to the response voice and display the word segmentation processing result;

[0146] In response to an editing operation on the word segmentation processing result, the voice instruction is determined based on the edited text.

[0147] In a possible implementation manner, the guiding module 603, when performing word segmentation processing on the text corresponding to the response speech and displaying the word segmentation processing result, is used to:

[0148] Determine the current driving state of the vehicle;

[0149] When the driving state is the target driving state, the text corresponding to the response voice is segmented and the segmentation result is displayed.

[0150] In a possible implementation manner, the preset operation scenario includes:

[0151] A scenario in which the time of the non-voice triggering operation is detected to be a target time period;

[0152] Alternatively, a scenario in which the vehicle state of the current vehicle is the target vehicle state;

[0153] Alternatively, the operation information of the non-voice triggered operation meets the scenario of the operation condition.

[0154] In a possible implementation, the acquisition module 602, when acquiring the historical feedback information corresponding to the target operation scenario, is used to:

[0155] Determining a user identifier for performing the non-voice trigger operation;

[0156] When it is detected that the user identifier is a target user identifier, historical feedback information corresponding to the target operation scenario is obtained.

[0157] The voice control device provided by the embodiment of the present disclosure can obtain historical feedback information corresponding to the target operation scenario when receiving the target operation scenario corresponding to the non-voice trigger operation of the user on the vehicle terminal, which is a preset operation scenario that requires the establishment of the user's cognition of using voice commands, and initiate voice guidance when the historical feedback information meets the voice guidance conditions, so as to help the user establish the cognition of using voice commands in the target operation scenario. In this way, compared with using non-voice trigger operations to realize interactive functions during driving, when the historical feedback information of the target operation scenario corresponding to the current non-voice trigger operation meets the voice guidance conditions, voice guidance is timely provided to the user, and the user is helped to establish the cognition of using voice commands in the target operation scenario, which can improve the utilization rate of voice trigger operations during driving, reduce the safety risks caused by the user's use of non-voice trigger operations during driving, and improve the user's driving safety.

[0158] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference may be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0159] Based on the same technical concept, the embodiment of the present disclosure also provides a computer device. Figure 7 As shown, it is a schematic diagram of the structure of a computer device 700 provided in an embodiment of the present disclosure, including a processor 701, a memory 702, and a bus 703. Among them, the memory 702 is used to store execution instructions, including a memory 7021 and an external memory 7022; the memory 7021 here is also called an internal memory, which is used to temporarily store the operation data in the processor 701, and the data exchanged with the external memory 7022 such as a hard disk. The processor 701 exchanges data with the external memory 7022 through the memory 7021. When the computer device 700 is running, the processor 701 communicates with the memory 702 through the bus 703, so that the processor 701 executes the following instructions:

[0160] Receiving a non-voice trigger operation of a vehicle terminal by a user; the target operation scenario corresponding to the non-voice trigger operation belongs to a preset operation scenario; the preset operation scenario is an operation scenario that requires the establishment of the user's cognition of using voice commands;

[0161] Obtaining historical feedback information corresponding to the target operation scenario;

[0162] If it is determined that the historical feedback information meets the voice guidance condition, voice guidance is initiated, and the voice guidance is used to guide the user to perform a trigger operation through a voice instruction.

[0163] In a possible implementation manner, in the instruction of the processor 701, the historical feedback information includes the number of historical positive feedbacks;

[0164] The number of historical positive feedbacks includes: the number of times a trigger operation is performed in the historical target operation scenario through voice instructions after voice guidance is initiated in response to the historical target operation scenario.

[0165] In one possible implementation, in the instructions of the processor 701, the historical feedback information satisfies the voice guidance conditions, including: the number of historical positive feedbacks does not exceed a preset number, and / or, within a historical preset time range, there is no historical record of performing operations through voice commands in the target operation scenario.

[0166] In a possible implementation manner, in the instruction of the processor 701, the initiating voice guidance includes:

[0167] Determine a prompt label under each prompt dimension corresponding to the target operation scenario;

[0168] Initiate voice guidance based on the prompt under the prompt label.

[0169] In a possible implementation manner, the instructions of the processor 701, after initiating voice guidance, further include determining the voice instruction by the following method:

[0170] Receiving a response voice input by a user;

[0171] Perform word segmentation processing on the text corresponding to the response voice and display the word segmentation processing result;

[0172] In response to an editing operation on the word segmentation processing result, the voice instruction is determined based on the edited text.

[0173] In a possible implementation manner, in the instruction of the processor 701, performing word segmentation processing on the text corresponding to the response voice and displaying the word segmentation processing result includes:

[0174] Determine the current driving state of the vehicle;

[0175] When the driving state is the target driving state, the text corresponding to the response voice is segmented and the segmentation result is displayed.

[0176] In a possible implementation manner, in the instruction of the processor 701, the preset operation scenario includes:

[0177] A scenario in which the time of the non-voice triggering operation is detected to be a target time period;

[0178] Alternatively, a scenario in which the vehicle state of the current vehicle is the target vehicle state;

[0179] Alternatively, the operation information of the non-voice triggered operation meets the scenario of the operation condition.

[0180] In a possible implementation manner, in the instruction of the processor 701, the acquiring the historical feedback information corresponding to the target operation scenario includes:

[0181] Determining a user identifier for performing the non-voice trigger operation;

[0182] When it is detected that the user identifier is a target user identifier, historical feedback information corresponding to the target operation scenario is obtained.

[0183] The present disclosure also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the voice control method described in the above method embodiment are executed. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0184] The embodiments of the present disclosure also provide a computer program product, which carries a program code. The instructions included in the program code can be used to execute the steps of the voice control method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.

[0185] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0186] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0187] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0188] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0189] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0190] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A voice control method, characterized in that: include: Receiving a non-voice trigger operation of a user on a vehicle terminal; the target operation scenario corresponding to the non-voice trigger operation belongs to a preset operation scenario; The preset operation scenario is an operation scenario that requires the user to establish awareness of using voice commands; Obtaining historical feedback information corresponding to the target operation scenario; If it is determined that the historical feedback information meets the voice guidance condition, voice guidance is initiated, and the voice guidance is used to guide the user to perform a trigger operation through a voice instruction.

2. The method according to claim 1, characterized in that The historical feedback information includes the number of historical positive feedbacks; The number of historical positive feedbacks includes: the number of times a trigger operation is performed in the historical target operation scenario through voice instructions after voice guidance is initiated in response to the historical target operation scenario.

3. The method according to claim 2, characterized in that The historical feedback information satisfies the voice guidance condition, including: the number of historical positive feedbacks does not exceed a preset number, and / or, within a historical preset time range, there is no historical record of performing operations through voice instructions in the target operation scenario.

4. The method according to claim 1, characterized in that: The initiating voice guidance comprises: Determine a prompt label under each prompt dimension corresponding to the target operation scenario; Initiate voice guidance based on the prompt under the prompt label.

5. The method according to claim 1 or 4, characterized in that: After initiating voice guidance, the method further includes determining the voice instruction by: Receiving a response voice input by a user; Perform word segmentation processing on the text corresponding to the response voice and display the word segmentation processing result; In response to an editing operation on the word segmentation processing result, the voice instruction is determined based on the edited text.

6. The method according to claim 5, characterized in that The word segmentation processing is performed on the text corresponding to the response voice, and the word segmentation processing result is displayed, including: Determine the current driving state of the vehicle; When the driving state is the target driving state, the text corresponding to the response voice is segmented and the segmentation result is displayed.

7. The method according to claim 1, characterized in that The preset operation scenario includes: A scenario in which the time of the non-voice triggering operation is detected to be a target time period; Alternatively, a scenario in which the vehicle state of the current vehicle is the target vehicle state; Alternatively, the operation information of the non-voice triggered operation meets the scenario of the operation condition.

8. The method according to claim 1, characterized in that The obtaining of historical feedback information corresponding to the target operation scenario includes: Determining a user identifier for performing the non-voice trigger operation; When it is detected that the user identifier is a target user identifier, historical feedback information corresponding to the target operation scenario is obtained.

9. A voice control device, characterized in that: include: A receiving module, used for receiving a non-voice triggering operation of a user on a vehicle terminal; The target operation scenario corresponding to the non-voice trigger operation belongs to a preset operation scenario; The preset operation scenario is an operation scenario that requires the user to establish awareness of using voice commands; An acquisition module, used to acquire historical feedback information corresponding to the target operation scenario; The guidance module is used to initiate voice guidance if it is determined that the historical feedback information meets the voice guidance condition, and the voice guidance is used to guide the user to perform a trigger operation through a voice instruction.

10. A computer device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the voice control method as described in any one of claims 1 to 8 are performed.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the voice control method according to any one of claims 1 to 8 are executed.

Citation Information

Cited By

  • Information prompting method and device, computer equipment and storage medium

    CN121560204A