Vehicle-mounted voice interaction method and device, computer readable medium and electronic equipment
By identifying and analyzing the voice input characteristics of users in the on-board terminal, determining the interactive reply content and playback speed, the problem that the prior art cannot adapt to the dialogue habits of different users is solved, and a more efficient user experience is achieved.
Patent Information
- Application Number
- CN202411427833.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-14
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2044-10-14
AI Technical Summary
The existing in-vehicle voice interaction technology cannot adapt to the conversation habits of different drivers or passengers, resulting in poor user experience.
By receiving voice input from the target user, the user's user age, dialogue speed and dialogue habits are identified, and the interactive reply content and its playback speed are determined based on these characteristics to achieve personalized voice interaction.
It can provide a voice interaction experience that is more in line with their personal habits according to the dialogue characteristics of different users, thereby improving the user experience.
Smart Images

Figure CN119517017A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of voice interaction technology, and in particular, relates to a vehicle-mounted voice interaction method, device, computer-readable medium and electronic device. Background Art
[0002] With the development of artificial intelligence and car networking, in-vehicle voice interaction functions have gradually become popular. In the current technical solution, the voice interaction function configured by the in-vehicle terminal is relatively monotonous and uniform during voice interaction. Although users can change the voice interaction role to improve the interaction experience, they can only perform voice interaction in a specific mode and cannot adapt to the conversation habits of different drivers or passengers, affecting the user experience. Therefore, how to adapt to the conversation habits of different users and ensure user experience has become a technical problem that needs to be solved urgently. Summary of the invention
[0003] The embodiments of the present application provide a vehicle-mounted voice interaction method, device, computer-readable medium and electronic device, which can adapt to the conversation habits of different users to at least a certain extent and ensure user experience.
[0004] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.
[0005] According to one aspect of an embodiment of the present application, a vehicle-mounted voice interaction method is provided, comprising:
[0006] Receiving a voice input from a target user, where the target user is any one of all persons currently in the vehicle;
[0007] Recognize the target user's age, conversation speed, and conversation habits based on the voice input, where the conversation habits are used to characterize the detail level of the target user's conversation;
[0008] Performing semantic recognition based on text information corresponding to the voice input to determine the conversation intention of the target user;
[0009] Determine the corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed and the conversation habit;
[0010] The interactive reply content is voice played according to the playback speed.
[0011] In some embodiments of the present application, based on the above solution, the corresponding interactive reply content and its playback speed are determined according to the conversation intention, the user age, the conversation speed, and the conversation habit, including:
[0012] Performing a query according to the conversation intention to determine a corresponding plurality of to-be-selected interactive response templates, wherein different to-be-selected interactive response templates correspond to different levels of content detail;
[0013] Determining a target interactive response template from a plurality of interactive response templates to be selected according to the user age, the conversation speed and / or the conversation habit;
[0014] Based on the target interactive reply template, generating corresponding interactive reply content;
[0015] The playback speed corresponding to the interactive reply content is determined according to the user age and / or the conversation speed.
[0016] In some embodiments of the present application, based on the aforementioned solution, determining a target interactive reply template from a plurality of the candidate interactive reply templates according to the user age, the conversation speed and / or the conversation habit includes:
[0017] Calculating a weighted sum of the user age, the conversation speed, and the conversation habit, and using the weighted sum as an evaluation score;
[0018] According to the numerical range of the evaluation score, a candidate interactive reply template corresponding to the numerical range is selected from the plurality of candidate interactive reply templates as the target interactive reply template.
[0019] In some embodiments of the present application, based on the above solution, determining the playback speed corresponding to the interactive reply content according to the user age and / or the conversation speed includes:
[0020] If the user age is less than or equal to a first age threshold, obtaining a first preset playback speech speed as the playback speech speed corresponding to the interactive reply content;
[0021] If the user age is greater than or equal to a second age threshold, a second preset playback speed is obtained as the playback speed corresponding to the interactive reply content, and the second age threshold is greater than the first age threshold
[0022] If the user age is greater than the first age threshold and less than the second age threshold, the conversation speaking speed is determined to be the playback speaking speed corresponding to the interactive reply content.
[0023] In some embodiments of the present application, based on the aforementioned solution, determining a target interactive reply template from a plurality of the candidate interactive reply templates according to the user age, the conversation speed and / or the conversation habit includes:
[0024] If the user age is less than or equal to the first age threshold, or the user age is greater than or equal to the second age threshold, selecting a candidate interactive reply template with a detailed content detail level from the plurality of candidate interactive reply templates as a target interactive reply template;
[0025] If the user's age is greater than the first age threshold and less than the second age threshold, a candidate interactive response template whose content detail level corresponds to the conversation habit is selected from the plurality of candidate interactive response templates as a target interactive response template.
[0026] In some embodiments of the present application, based on the above solution, recognition is performed according to the voice input to determine the conversation habits of the target user, including:
[0027] Converting the voice input into corresponding text information;
[0028] Performing word segmentation processing on the text information to obtain at least one keyword;
[0029] The conversation habit of the target user is determined according to the number of keywords corresponding to the target part of speech in at least one of the keywords.
[0030] According to one aspect of an embodiment of the present application, there is provided a vehicle-mounted voice interaction device, including:
[0031] A receiving module, used to receive a voice input from a target user, where the target user is any one of all persons currently in the vehicle;
[0032] A first recognition module is used to perform recognition based on the voice input to determine the user age, conversation speed and conversation habits of the target user, where the conversation habits are used to characterize the content detail of the target user during the conversation;
[0033] A second recognition module is used to perform semantic recognition based on the text information corresponding to the voice input to determine the conversation intention of the target user;
[0034] A determination module, used to determine the corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed and the conversation habit;
[0035] A processing module is used to voice play the interactive response content according to the playback speed.
[0036] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the in-vehicle voice interaction method as described in the above embodiment is implemented.
[0037] According to one aspect of an embodiment of the present application, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the in-vehicle voice interaction method as described in the above embodiments.
[0038] According to one aspect of the embodiments of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the vehicle-mounted voice interaction method provided in the above embodiment.
[0039] Based on the technical solution proposed in this application, by receiving the voice input of the target user, the target user is any one of all the people in the current vehicle, and identifying the target user according to the voice input, the user age, conversation speed and conversation habits of the target user are determined. The conversation habits are used to characterize the content details of the target user during the conversation, and semantic recognition is performed based on the text information corresponding to the voice input to determine the conversation intention of the target user. Then, according to the conversation habits, user age, conversation speed and conversation habits, the corresponding interactive reply content and its playback speed are determined, so that the interactive reply content is voice-played according to the playback speed. In this way, the corresponding interactive reply content and playback speed can be determined according to the conversation characteristics of different users, so as to meet the conversation needs of different users and ensure user experience.
[0040] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:
[0042] Figure 1 A schematic diagram of a process of an in-vehicle voice interaction method according to an embodiment of the present application is shown;
[0043] Figure 2 A block diagram of a vehicle-mounted voice interaction device according to an embodiment of the present application is shown;
[0044] Figure 3A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION
[0045] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0046] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.
[0047] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.
[0048] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.
[0049] In the description of this application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the feature. In the description of this application, unless otherwise specified, "plurality" means two or more.
[0050] Figure 1The flowchart of the vehicle voice interaction method according to an embodiment of the present application is shown. The method can be applied to a terminal device or a server, wherein the terminal device can include but is not limited to one or more of a vehicle terminal, a smart phone, a tablet computer, a portable computer, and a desktop computer; the server can be a physical server or a cloud server.
[0051] like Figure 1 As shown, the vehicle-mounted interaction method at least includes steps S110 to S150, which are described in detail as follows (hereinafter, the method is described by taking the application of the method to a vehicle-mounted terminal as an example, hereinafter referred to as "terminal"):
[0052] In step S110 , a voice input of a target user is received, where the target user is any one of all persons currently in the vehicle.
[0053] In this embodiment, the vehicle terminal can receive the voice input of the target user in real time through its own voice receiving device (such as a microphone). It is worth noting that the target person can be any one of all the people in the current vehicle (such as the driver or a passenger), that is, any person in the current vehicle can perform voice interaction with the vehicle terminal, so that the vehicle terminal can perform voice interaction according to the conversation characteristics of different people in the subsequent process to meet the conversation needs of different people.
[0054] In step S120, recognition is performed based on the voice input to determine the user age, conversation speed and conversation habits of the target user, where the conversation habits are used to characterize the content detail of the target user during the conversation.
[0055] In this embodiment, after receiving the voice input of the target user, the vehicle terminal can perform recognition based on the received voice input, thereby extracting the dialogue features of the target user, which may include the user age, dialogue speed and dialogue habits of the target user, wherein the dialogue habits can be used to characterize the content detail level of the target user during the dialogue. In one example, the content detail level can be divided into three types: concise, medium and detailed. The vehicle terminal can perform recognition and classification based on the voice input of the target user, thereby matching the corresponding type of content detail level for the target user.
[0056] Therefore, by extracting the conversation features of different users and subsequently providing users with a voice interaction experience that is more in line with their personal habits based on the conversation features, the targeted nature of the voice interaction can be ensured and the user experience can be improved.
[0057] In step S130, semantic recognition is performed based on the text information corresponding to the voice input to determine the conversation intention of the target user.
[0058] In this embodiment, the vehicle-mounted terminal can first convert the received voice input into corresponding text information, and perform semantic recognition based on the text information, so as to clarify the conversation intention of the target user, that is, the purpose or demand expressed by the target user during the conversation, such as playing music or map navigation, etc.
[0059] In one example, the vehicle terminal may first determine the keywords in the text information, match the keywords with a predefined list of intent keywords, and determine the target user's conversation intent based on the matching results. In other examples, the vehicle terminal may also use a machine learning algorithm or a deep learning algorithm to identify the text information, thereby determining the target user's conversation intent.
[0060] It should be noted that those skilled in the art may also use other methods to determine the conversation intention, and this application does not specifically limit this.
[0061] In step S140, the corresponding interactive reply content and its playback speed are determined according to the conversation intention, the user age, the conversation speed and the conversation habit.
[0062] In this embodiment, it should be understood that different users may have different conversation requirements during voice interaction. For example, young users who speak concisely and quickly will expect the vehicle terminal to speak quickly and concisely during interaction, while users who speak relatively slowly or children and the elderly will expect the vehicle terminal to speak slowly and with more detailed content during voice interaction. Therefore, after determining the conversation intention of the target user, the vehicle terminal can comprehensively consider the conversation intention, user age, conversation speed and conversation habits of the target user, thereby determining the corresponding interactive reply content and playback speed to achieve targeted voice interaction.
[0063] In step S150, the interactive reply content is voice played according to the playback speed.
[0064] Therefore, based on Figure 1In the embodiment shown, by receiving the voice input of the target user, the target user is any one of all the people in the current vehicle, and performing recognition based on the voice input, the user age, conversation speed and conversation habits of the target user are determined, and the conversation habits are used to characterize the content detail of the target user during the conversation, and semantic recognition is performed based on the text information corresponding to the voice input to determine the conversation intention of the target user, and then, according to the conversation habits, user age, conversation speed and conversation habits, the corresponding interactive reply content and its playback speed are determined, so that the interactive reply content is voice-played according to the playback speed. In this way, the corresponding interactive reply content and playback speed can be determined according to the conversation characteristics of different users, so as to meet the conversation needs of different users and ensure user experience.
[0065] In some embodiments of the present application, determining the corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed, and the conversation habit includes:
[0066] Performing a query according to the conversation intention to determine a corresponding plurality of to-be-selected interactive response templates, wherein different to-be-selected interactive response templates correspond to different levels of content detail;
[0067] Determining a target interactive response template from a plurality of interactive response templates to be selected according to the user age, the conversation speed and / or the conversation habit;
[0068] Based on the target interactive reply template, generating corresponding interactive reply content;
[0069] The playback speed corresponding to the interactive reply content is determined according to the user age and / or the conversation speed.
[0070] In this embodiment, a person skilled in the art can preset multiple interactive response templates for each conversation intent, and different interactive response templates corresponding to the same conversation intent have different levels of content details. Therefore, when voice interaction is required, the vehicle terminal can first query according to the conversation intent of the target user, thereby determining multiple interactive response templates corresponding to the conversation intent, and then the vehicle terminal can select one of the multiple interactive response templates as the target interactive response template according to the user's age, conversation speed and / or conversation habits.
[0071] It is worth noting that the in-vehicle terminal can select a target interaction reply template from multiple candidate interaction reply templates based on one or more of the user's age, conversation speed, and conversation habits. In one example, different age groups correspond to interaction reply templates with different levels of content detail. The in-vehicle terminal can make a selection based only on the user's age, and determine the candidate interaction reply template corresponding to the age group of the user as the target interaction reply template; in another example, the in-vehicle terminal can also select a candidate interaction reply template with the corresponding level of content detail from multiple candidate interaction reply templates as the target interaction reply template based on the target user's conversation habits; in yet another example, the in-vehicle terminal can also comprehensively consider any two or three of the user's age, conversation speed, and conversation habits, and then determine the target interaction reply template from multiple candidate interaction reply templates.
[0072] After determining the target interactive reply template, the vehicle terminal can generate the corresponding interactive reply content based on the target interactive reply template. In one example, when the content detail level corresponding to the target interactive reply template is medium or detailed, it can include at least one slot, and the vehicle terminal can extract specific types of keywords (such as place names or music names, etc.) from the text information corresponding to the voice input to fill in the corresponding slots, thereby generating the corresponding interactive reply content. For example, when the target user needs to perform map navigation, keywords used to represent the destination can be extracted from the text information to fill in the target interactive reply template, thereby generating the interactive reply content. When the content detail level corresponding to the target interactive reply template is concise, it may not include a slot, that is, the target interactive reply template is the interactive reply content. For example, when the target user needs to perform map navigation, the target interactive reply template with a concise content detail level can be "Start Navigation" or "Started", etc.
[0073] Next, the in-vehicle terminal can also determine the playback speed of the interactive response content based on the user age and / or conversation speed of the target user. It should be understood that the playback speed is the TTS (Text To Speech) speed, that is, the in-vehicle terminal can convert the interactive response content in text form into corresponding voice for playback according to the playback speed.
[0074] In one example, the vehicle-mounted terminal can determine the playback speed corresponding to the interactive reply content based only on the user's age. Technical personnel in this field can pre-set the corresponding playback speeds for different age groups, so that in actual use, the corresponding playback speed can be queried and determined according to the user's age group.
[0075] In another example, the vehicle-mounted terminal may also directly determine the target user's conversation speed as the playback speed of the interactive reply content, thereby adapting to the target user's conversation needs.
[0076] In some embodiments of the present application, determining a target interactive reply template from a plurality of the candidate interactive reply templates according to the user age, the conversation speed and / or the conversation habit includes:
[0077] Calculating a weighted sum of the user age, the conversation speed, and the conversation habit, and using the weighted sum as an evaluation score;
[0078] According to the numerical range of the evaluation score, a candidate interactive reply template corresponding to the numerical range is selected from the plurality of candidate interactive reply templates as the target interactive reply template.
[0079] In this embodiment, the vehicle terminal can comprehensively consider the user age, conversation speed and conversation habits of the target user to determine the corresponding target interactive reply template. Specifically, those skilled in the art can pre-set the weights corresponding to the user age, conversation speed and conversation habits, and after obtaining the specific values of the three, they can calculate the weighted sum according to the corresponding weights, and use the calculation result as the evaluation score of the target user.
[0080] Technical personnel in this field can predetermine the numerical ranges corresponding to different candidate interactive reply templates. After obtaining the evaluation score of the target user, they can search for the corresponding candidate interactive reply template according to the numerical range of the evaluation score as the target interactive reply template to ensure the accuracy of the determination of the target interactive reply template.
[0081] In some embodiments of the present application, determining the playback speed corresponding to the interactive reply content according to the user age and / or the conversation speed includes:
[0082] If the user age is less than or equal to a first age threshold, obtaining a first preset playback speech speed as the playback speech speed corresponding to the interactive reply content;
[0083] If the user age is greater than or equal to a second age threshold, a second preset playback speed is obtained as the playback speed corresponding to the interactive reply content, and the second age threshold is greater than the first age threshold
[0084] If the user age is greater than the first age threshold and less than the second age threshold, the conversation speaking speed is determined to be the playback speaking speed corresponding to the interactive reply content.
[0085] In this embodiment, the vehicle-mounted terminal can determine the playback speed only based on the user age of the target user. Specifically, technical personnel in this field can pre-set the first age threshold and the second age threshold based on prior experience, and the second age threshold is greater than the first age threshold. For example, the first age threshold may be 13 years old, and the second age threshold may be 60 years old, etc.
[0086] The vehicle-mounted terminal can compare the user's age with the first age threshold and the second age threshold. If the user's age is less than or equal to the first age threshold, it means that the target user is relatively young. The vehicle-mounted terminal can obtain a first preset playback speed as the playback speed corresponding to the interactive reply content. The first preset playback speed can be a playback speed pre-set by technical personnel in this field based on prior experience and suitable for younger users.
[0087] If the user's age is greater than or equal to the second age threshold, it means that the target user is older and speaks faster and may not be heard clearly. Therefore, the in-vehicle terminal can obtain the second preset playback speed as the playback speed of the interactive reply content. Similarly, the second preset playback speed can also be a playback speed pre-set by technical personnel in this field based on prior experience and suitable for older users.
[0088] Furthermore, if the user's age is between the first age threshold and the second age threshold, that is, the user's age is greater than the first age threshold and less than the second age threshold, it means that the vehicle-mounted terminal can directly determine the conversation speed as the playback speed corresponding to the interactive reply content, thereby adapting to the target user's conversation needs and ensuring user experience.
[0089] Based on the foregoing embodiment, in some embodiments of the present application, determining a target interactive reply template from a plurality of the candidate interactive reply templates according to the user age, the conversation speed and / or the conversation habit includes:
[0090] If the user age is less than or equal to the first age threshold, or the user age is greater than or equal to the second age threshold, selecting a candidate interactive reply template with a detailed content detail level from the plurality of candidate interactive reply templates as a target interactive reply template;
[0091] If the user's age is greater than the first age threshold and less than the second age threshold, a candidate interactive response template whose content detail level corresponds to the conversation habit is selected from the plurality of candidate interactive response templates as a target interactive response template.
[0092] In this embodiment, a candidate interaction reply template with detailed content detail level can be used as a target interaction reply template for a target user who is younger (i.e., less than or equal to the first age threshold) or older (i.e., greater than or equal to the second age threshold), thereby providing the target user with more detailed feedback and allowing the target user to clarify his or her own operation behavior.
[0093] For target users of intermediate age (i.e., older than the first age threshold and younger than the second age threshold), the in-vehicle terminal can give responses with corresponding content details based on their own conversation habits, that is, select the candidate interactive response template with content details corresponding to the conversation habits as the target interactive response template, so as to conform to the conversation habits of the target users and ensure user experience.
[0094] In some embodiments of the present application, performing recognition according to the voice input to determine the conversation habits of the target user includes:
[0095] Converting the voice input into corresponding text information;
[0096] Performing word segmentation processing on the text information to obtain at least one keyword;
[0097] The conversation habit of the target user is determined according to the number of keywords corresponding to the target part of speech in at least one of the keywords.
[0098] In this embodiment, when determining the conversation habits of the target user, the vehicle terminal may first convert the target user's voice input into corresponding text information, and segment the text information to obtain at least one keyword. Then, the vehicle terminal may determine the part of speech of each keyword, and determine the number of keywords corresponding to the target part of speech, thereby determining the conversation habits of the target user based on the number.
[0099] In one example, a person skilled in the art may pre-set a first quantity threshold and a second quantity threshold. If the number of keywords of the target part of speech is less than the first quantity threshold, it means that the conversation of the target user is relatively concise, and the corresponding conversation habit can be determined to be concise; if the number of keywords of the target part of speech is greater than or equal to the first quantity threshold and less than or equal to the second quantity threshold, it can be determined that the conversation habit of the target user is medium; if the number of keywords of the target part of speech is greater than the second quantity threshold, it can be determined that the conversation habit of the target user is detailed.
[0100] As a result, the vehicle-mounted terminal can accurately identify the conversation habits of the target user, and then ensure that the subsequent interactive response content is adaptable to the target user, thereby ensuring the user experience.
[0101] The following describes an embodiment of the device of the present application, which can be used to execute the vehicle-mounted voice interaction method in the above embodiment of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the vehicle-mounted voice interaction method in the above embodiment of the present application.
[0102] Figure 2 A block diagram of an in-vehicle voice interaction device according to an embodiment of the present application is shown.
[0103] Reference Figure 2 As shown, according to an embodiment of the present application, the vehicle-mounted voice interaction device includes:
[0104] A receiving module, used to receive a voice input from a target user, where the target user is any one of all persons currently in the vehicle;
[0105] A first recognition module is used to perform recognition based on the voice input to determine the user age, conversation speed and conversation habits of the target user, where the conversation habits are used to characterize the content detail of the target user during the conversation;
[0106] A second recognition module is used to perform semantic recognition based on the text information corresponding to the voice input to determine the conversation intention of the target user;
[0107] A determination module, used to determine the corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed and the conversation habit;
[0108] A processing module is used to voice play the interactive response content according to the playback speed.
[0109] In some embodiments of the present application, determining the corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed, and the conversation habit includes:
[0110] Performing a query according to the conversation intention to determine a corresponding plurality of to-be-selected interactive response templates, wherein different to-be-selected interactive response templates correspond to different levels of content detail;
[0111] Determining a target interactive response template from a plurality of interactive response templates to be selected according to the user age, the conversation speed and / or the conversation habit;
[0112] Based on the target interactive reply template, generating corresponding interactive reply content;
[0113] The playback speed corresponding to the interactive reply content is determined according to the user age and / or the conversation speed.
[0114] In some embodiments of the present application, determining a target interactive reply template from a plurality of the candidate interactive reply templates according to the user age, the conversation speed and / or the conversation habit includes:
[0115] Calculating a weighted sum of the user age, the conversation speed, and the conversation habit, and using the weighted sum as an evaluation score;
[0116] According to the numerical range of the evaluation score, a candidate interactive reply template corresponding to the numerical range is selected from the plurality of candidate interactive reply templates as the target interactive reply template.
[0117] In some embodiments of the present application, determining the playback speed corresponding to the interactive reply content according to the user age and / or the conversation speed includes:
[0118] If the user age is less than or equal to a first age threshold, obtaining a first preset playback speech speed as the playback speech speed corresponding to the interactive reply content;
[0119] If the user age is greater than or equal to a second age threshold, a second preset playback speed is obtained as the playback speed corresponding to the interactive reply content, and the second age threshold is greater than the first age threshold
[0120] If the user age is greater than the first age threshold and less than the second age threshold, the conversation speaking speed is determined to be the playback speaking speed corresponding to the interactive reply content.
[0121] In some embodiments of the present application, determining a target interactive reply template from a plurality of the candidate interactive reply templates according to the user age, the conversation speed and / or the conversation habit includes:
[0122] If the user age is less than or equal to the first age threshold, or the user age is greater than or equal to the second age threshold, selecting a candidate interactive reply template with a detailed content detail level from the plurality of candidate interactive reply templates as a target interactive reply template;
[0123] If the user's age is greater than the first age threshold and less than the second age threshold, a candidate interactive response template whose content detail level corresponds to the conversation habit is selected from the plurality of candidate interactive response templates as a target interactive response template.
[0124] In some embodiments of the present application, performing recognition according to the voice input to determine the conversation habits of the target user includes:
[0125] Converting the voice input into corresponding text information;
[0126] Performing word segmentation processing on the text information to obtain at least one keyword;
[0127] The conversation habit of the target user is determined according to the number of keywords corresponding to the target part of speech in at least one of the keywords.
[0128] Figure 3 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown.
[0129] It should be noted that Figure 3 The computer system of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0130] like Figure 3 As shown, the computer system includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 302 or the program loaded from the storage part 308 to the random access memory (RAM) 303, such as executing the method described in the above embodiment. In RAM 303, various programs and data required for system operation are also stored. CPU 301, ROM 302 and RAM 303 are connected to each other through bus 304. Input / output (I / O) interface 305 is also connected to bus 304.
[0131] The following components are connected to the I / O interface 305: an input section 306 including a keyboard, a mouse, etc.; an output section 307 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed so that a computer program read therefrom is installed into the storage section 308 as needed.
[0132] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 309, and / or installed from a removable medium 311. When the computer program is executed by a central processing unit (CPU) 301, various functions defined in the system of the present application are executed.
[0133] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.
[0134] The flowchart and block diagram in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0135] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.
[0136] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiment.
[0137] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.
[0138] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation methods of the present application.
[0139] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.
[0140] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.
Claims
1. A vehicle-mounted voice interaction method, characterized in that: include: Receiving a voice input from a target user, where the target user is any one of all persons currently in the vehicle; Recognize the target user's age, conversation speed, and conversation habits based on the voice input, where the conversation habits are used to characterize the detail level of the target user's conversation; Performing semantic recognition based on text information corresponding to the voice input to determine the conversation intention of the target user; Determine the corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed and the conversation habit; The interactive reply content is voice played according to the playback speed.
2. The method according to claim 1, characterized in that: Determining corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed, and the conversation habit, including: Performing a query according to the conversation intention to determine a corresponding plurality of to-be-selected interactive response templates, wherein different to-be-selected interactive response templates correspond to different levels of content detail; Determining a target interactive response template from a plurality of interactive response templates to be selected according to the user's age, the conversation speed and / or the conversation habit; Based on the target interactive reply template, generating corresponding interactive reply content; The playback speed corresponding to the interactive reply content is determined according to the user age and / or the conversation speed.
3. The method according to claim 2, characterized in that Determining a target interactive response template from a plurality of the candidate interactive response templates according to the user age, the conversation speed and / or the conversation habit includes: Calculating a weighted sum of the user age, the conversation speed, and the conversation habit, and using the weighted sum as an evaluation score; According to the numerical range of the evaluation score, a candidate interactive reply template corresponding to the numerical range is selected from the plurality of candidate interactive reply templates as the target interactive reply template.
4. The method according to claim 2, characterized in that: Determining the playback speed corresponding to the interactive reply content according to the user age and / or the conversation speed includes: If the user age is less than or equal to a first age threshold, obtaining a first preset playback speech speed as the playback speech speed corresponding to the interactive reply content; If the user age is greater than or equal to a second age threshold, a second preset playback speed is obtained as the playback speed corresponding to the interactive reply content, and the second age threshold is greater than the first age threshold If the user age is greater than the first age threshold and less than the second age threshold, the conversation speaking speed is determined to be the playback speaking speed corresponding to the interactive reply content.
5. The method according to claim 4, characterized in that Determining a target interactive response template from a plurality of the candidate interactive response templates according to the user age, the conversation speed and / or the conversation habit includes: If the user age is less than or equal to the first age threshold, or the user age is greater than or equal to the second age threshold, selecting a candidate interactive reply template with a detailed content detail level from the plurality of candidate interactive reply templates as a target interactive reply template; If the user's age is greater than the first age threshold and less than the second age threshold, a candidate interactive response template whose content detail level corresponds to the conversation habit is selected from the plurality of candidate interactive response templates as a target interactive response template.
6. The method according to any one of claims 1 to 5, characterized in that Recognizing the target user's conversation habits based on the voice input includes: Converting the voice input into corresponding text information; Performing word segmentation processing on the text information to obtain at least one keyword; The conversation habit of the target user is determined according to the number of keywords corresponding to the target part of speech in at least one of the keywords.
7. A vehicle-mounted voice interaction device, characterized in that: include: A receiving module, used to receive a voice input from a target user, where the target user is any one of all persons currently in the vehicle; A first recognition module is used to perform recognition based on the voice input to determine the user age, conversation speed and conversation habits of the target user, where the conversation habits are used to characterize the content detail of the target user during the conversation; A second recognition module is used to perform semantic recognition based on the text information corresponding to the voice input to determine the conversation intention of the target user; A determination module, used to determine the corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed and the conversation habit; A processing module is used to voice play the interactive response content according to the playback speed.
8. The device according to claim 7, characterized in that Determining corresponding interactive reply content and its playback speed according to the conversation intention, the user age, the conversation speed, and the conversation habit, including: Performing a query according to the conversation intention to determine a corresponding plurality of to-be-selected interactive response templates, wherein different to-be-selected interactive response templates correspond to different levels of content detail; Determining a target interactive response template from a plurality of interactive response templates to be selected according to the user's age, the conversation speed and / or the conversation habit; Based on the target interactive reply template, generating corresponding interactive reply content; The playback speed corresponding to the interactive reply content is determined according to the user age and the conversation speed.
9. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the in-vehicle voice interaction method according to any one of claims 1 to 6 is implemented.
10. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the one or more processors to implement the in-vehicle voice interaction method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Intelligent voice interaction implementation methods and devices, computer equipment, and storage medium
CN108711423A
Voice interaction method, voice interaction device, intelligent robot and computer readable storage medium
CN110085225A
Voice interaction method and device
CN111081244A
Context anaphora-based dialogue response method, device and system
CN112948549A
Voice call interaction method and device, computer equipment and storage medium
CN113873088A
Cited By
Multi-modal interaction method and device suitable for group chat
CN120412595A