Voice interaction model optimization method, interaction method, vehicle and storage medium

Abstract

The invention relates to a voice interaction model optimization method, an interaction method, a vehicle and a storage medium. The method comprises the following steps: receiving a first voice interaction instruction; constructing an initial thinking chain corresponding to the first voice interaction instruction; and after finishing the correction operation on the initial thinking chain, generating a target thinking chain, and optimizing a pre-configured voice interaction model according to the target thinking chain. According to the scheme provided by the invention, the voice interaction accuracy between the user and the vehicle-mounted terminal can be effectively improved.

Description

Technical Field

[0001] This application relates to the field of voice interaction technology, and in particular to optimization methods for voice interaction models, interaction methods, vehicles, and storage media. Background Technology

[0002] With the widespread application of intelligent interaction technology in various terminal devices, intelligent voice-driven methods are gradually becoming an important interaction means. Generally speaking, the intelligent voice-driven process involves ASR (Automatic Speech Recognition) and RAG (Retrieval-Augmented Generation).

[0003] Among them, ASR is responsible for converting acoustic signals into computationally processable text, while RAG is responsible for searching similar APIs (Application Programming Interfaces) in a massive database, concatenating the ASR recognition results with similar APIs to obtain new prompt words, so that NLU (Natural Language Understanding) can combine the new prompt words to generate executable instructions that can accurately express the user's intentions.

[0004] However, while current large models can generate structured results and corresponding COTs (Chain of Thought) based on the newly concatenated prompts, they are often limited by general prior knowledge and cannot fully understand the complex vehicle interaction environment.

[0005] In practical applications, when users issue voice commands to the vehicle terminal, the vehicle terminal has difficulty accurately recognizing the user's intent from the voice commands, resulting in low response accuracy of voice interaction and a poor user experience. Summary of the Invention

[0006] To address or partially address the problems existing in related technologies, this application provides an optimization method for a voice interaction model, an interaction method, a vehicle, and a storage medium, which can effectively improve the accuracy of voice interaction between users and in-vehicle terminals.

[0007] The first aspect of this application provides a method for optimizing a voice interaction model, comprising: Receive the first voice interaction command; Construct the initial thought chain corresponding to the first voice interaction command; After completing the correction operation on the initial thought chain, a target thought chain is generated, and the pre-configured voice interaction model is optimized based on the target thought chain.

[0008] In one instance, generating the target thought chain after completing the modification operation on the initial thought chain includes: Extract the real labels from the first voice interaction command; The initial thought chain is sampled multiple times to obtain predicted labels; Based on the comparison relationship between the predicted labels and the actual labels, the correction method for the initial thought chain is determined; The initial thought chain is modified according to the modification method described above to generate the target thought chain.

[0009] In one instance, the step of modifying the initial thought chain according to the modification method to generate the target thought chain includes: When there is at least one sampling operation whose predicted label is the same as the real label corresponding to the first voice interaction instruction, obtain a reference thought chain example of the first voice interaction instruction. Based on the reference thought chain example, the output format of the initial thought chain is adjusted to generate the target thought chain.

[0010] In one instance, the step of modifying the initial thought chain according to the modification method to generate the target thought chain includes: When the predicted label corresponding to a continuous sampling operation is different from the real label corresponding to the first voice interaction command, the natural language understanding result of the first voice interaction command is obtained. Based on the natural language understanding results, the initial thought chain is self-corrected to generate the target thought chain.

[0011] In one instance, the step of self-correcting the initial thought chain based on the natural language understanding result to generate the target thought chain includes: Based on the natural language understanding results, analyze the reasons for the errors in the initial thought process. The natural language understanding result and the error reason are combined to form a correction prompt message; Based on the correction prompts, the initial thought chain is re-reasoned to generate the target thought chain.

[0012] In one instance, optimizing the pre-configured voice interaction model according to the target thought chain includes: The first voice interaction command and the target thought chain are integrated according to a preset data format to construct a distillation training sample. The pre-configured voice interaction model is iteratively trained using the distilled training samples to enable the voice interaction model to learn the reasoning structure of the target thought chain.

[0013] In one instance, constructing the initial thought chain corresponding to the first voice interaction command includes: Parse the first voice interaction command to obtain the voice interaction text and the vehicle knowledge associated with the voice interaction text; Retrieve a list of application programming interfaces (APIs) corresponding to the voice interaction text; the list of APIs includes several APIs and interface parameters corresponding to each API. The vehicle knowledge, the application programming interface, and the interface parameters are filled into a preset prompt word template to obtain the initial prompt word; The initial thought chain is generated by performing thought chain reasoning on the initial prompt words.

[0014] A second aspect of this application provides a voice interaction method based on a voice interaction model, comprising: Real-time acquisition of second voice interaction commands; The second voice interaction command is input into the optimized voice interaction model to generate the corresponding vehicle control task.

[0015] A third aspect of this application provides a vehicle, comprising: Processor; and A memory that stores executable code, which, when executed by the processor, causes the processor to perform the method described above.

[0016] A fourth aspect of this application provides a computer-readable storage medium having executable code stored thereon, which, when executed by a processor of an electronic device, causes the processor to perform the method described above.

[0017] The fifth aspect of this application provides a computer program product comprising computer instructions that, when executed by a processor, implement the method described above.

[0018] The technical solution provided in this application may include the following beneficial results: In this application, a first voice interaction command is received; an initial thought chain corresponding to the first voice interaction command is constructed; after completing the correction operation of the initial thought chain, a target thought chain is generated, and a pre-configured voice interaction model is optimized according to the target thought chain.

[0019] Compared to related technologies, the technical solution of this application has two advantages: First, by constructing an initial thought chain corresponding to the first voice interaction command, this application makes the abstract reasoning process explicit. This explicit reasoning structure helps to fully understand the user's intent, thereby improving the optimization effect of the voice interaction model. Second, this application does not directly use the initial thought chain to optimize the voice interaction model. Instead, after modifying the initial thought chain, it generates a target thought chain that better conforms to the expected reasoning logic, and trains the voice interaction model with the target thought chain as the optimization target, thereby avoiding the voice interaction model learning incorrect reasoning chains. Therefore, when the optimized voice interaction model is deployed in the vehicle terminal, the vehicle terminal can accurately parse the voice interaction commands issued by the user using the voice interaction model, improving the overall voice interaction effect.

[0020] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0021] The above and other objects, features and advantages of this application will become more apparent from the more detailed description of exemplary embodiments thereof in conjunction with the accompanying drawings, wherein the same reference numerals generally represent the same components in the exemplary embodiments thereof.

[0022] Figure 1 This is a flowchart illustrating an optimization method for a voice interaction model according to an embodiment of this application; Figure 2 This is another flowchart illustrating an optimization method for a voice interaction model as shown in an embodiment of this application; Figure 3 This is a schematic diagram illustrating the complex COT generation process in an embodiment of this application; Figure 4 This application illustrates a voice interaction method based on a voice interaction model. Figure 5 This is a schematic diagram illustrating the process of online voice interaction based on complex COT as shown in the embodiments of this application; Figure 6 This is a schematic diagram of the vehicle structure shown in the embodiments of this application. Detailed Implementation

[0023] Embodiments of this application will now be described in more detail with reference to the accompanying drawings. While embodiments of this application are shown in the drawings, it should be understood that this application may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided to make this application more thorough and complete, and to fully convey the scope of this application to those skilled in the art.

[0024] The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The singular forms “a,” “the,” and “the” used in this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0025] It should be understood that although the terms "first," "second," "third," etc., may be used in this application to describe various information, this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0026] With the widespread application of intelligent interaction technology in various terminal devices, intelligent voice-driven methods are gradually becoming an important interaction means. Generally speaking, the intelligent voice-driven process involves ASR (Automatic Speech Recognition) and RAG (Retrieval-Augmented Generation).

[0027] Among them, ASR is responsible for converting acoustic signals into computationally processable text, while RAG is responsible for searching similar APIs (Application Programming Interfaces) in a massive database, concatenating the ASR recognition results with similar APIs to obtain new prompt words, so that NLU (Natural Language Understanding) can combine the new prompt words to generate executable instructions that can accurately express the user's intentions.

[0028] However, while current large models can generate structured results and corresponding COTs (Chain of Thought) based on the newly concatenated prompts, they are often limited by general prior knowledge and cannot fully understand the complex vehicle interaction environment.

[0029] In practical applications, when users issue voice commands to the vehicle terminal, the vehicle terminal has difficulty accurately recognizing the user's intent from the voice commands, resulting in low response accuracy of voice interaction and a poor user experience.

[0030] To address the aforementioned issues, this application provides an optimization method for a voice interaction model, which can effectively improve the accuracy of voice interaction between users and in-vehicle terminals.

[0031] The technical solution of this application is applicable to human-vehicle interaction scenarios in the vehicle field. The following explanation uses a scenario where a user is in a smart cockpit and issues voice interaction commands from within the smart cockpit as an example.

[0032] The intelligent cockpit refers to an integrated digital platform that integrates artificial intelligence, communication technology, and electronic control systems into the in-vehicle environment. Compared with traditional cockpits, intelligent cockpits have multiple interaction methods such as voice, touch, visual recognition, and gesture perception, offering a more natural human-machine dialogue and more comprehensive in-vehicle function control capabilities.

[0033] In this application, the data processing center of the intelligent cockpit is the vehicle-mounted terminal, which works in conjunction with other devices to complete vehicle control tasks.

[0034] As an example, a smart cockpit is equipped with a voice interaction device that collects voice commands issued by the user. For instance, multiple microphones are installed in the smart cockpit to collect audio data issued by the user in real time. In actual use, the coverage of voice signal collection can be improved by arranging the microphones in different ways.

[0035] In addition, the smart cockpit is also equipped with actuators to perform vehicle control tasks. For example, the seat assembly is used to perform vehicle control tasks such as seat position adjustment, heating control, and ventilation control; the vehicle air conditioning assembly is used to perform vehicle control tasks such as temperature adjustment, air volume adjustment, and airflow direction switching; and the window assembly is used to perform vehicle control tasks such as window raising and lowering, and sunroof opening / closing.

[0036] In addition, considering the need to provide voice prompts to users, the smart cockpit can also be equipped with audio playback devices. For example, multiple speakers can be installed in the smart cockpit, arranged in a surround or zoned manner, to ensure that users can still clearly hear the voice prompts even when the vehicle is in operation.

[0037] As described above regarding the smart cockpit, the main entity handling data processing within the smart cockpit is actually the in-vehicle terminal. In practical applications, the in-vehicle terminal flexibly deploys different types of large models according to different data processing tasks.

[0038] As an example, when data processing tasks involve reasoning about voice interaction commands issued by users in a smart cockpit, the in-vehicle terminal can simultaneously deploy a voice interaction model and a large-scale thought chain correction model. Both the voice interaction model and the large-scale thought chain correction model belong to large language models that can understand user intentions and generate natural language text.

[0039] The voice interaction model refers to a large model used to parse the intent of voice interaction commands and generate corresponding vehicle control tasks. This model mainly undertakes online inference, and can quickly complete tasks such as semantic understanding, slot extraction, and control task generation after receiving voice interaction commands issued by the user in real time, thereby meeting the requirements of high real-time performance and high response speed of intelligent cockpits in actual driving scenarios.

[0040] The large-scale thinking chain correction model refers to a large model with stronger reasoning depth and self-correction capabilities. It can perform reasoning analysis, error location and correction prompts on the initial thinking chain of voice interaction commands, and generate target thinking chains based on the correction prompt information, thereby using the target thinking chain to correct the voice interaction model.

[0041] Compared to the large model of thought chain correction, the above-mentioned voice interaction model is smaller in scale and has a more compact structure, making it more suitable for performing online inference tasks in in-vehicle terminals, ensuring that the actual voice interaction response speed and accuracy remain at a high level.

[0042] The large-scale thinking chain correction model requires in-depth reasoning analysis and error localization of the initial thinking chain. Its reasoning process is relatively complex and computationally intensive, making it more suitable as an optimization module for generating complex COTs. The complex COTs generated by the large-scale thinking chain correction model not only retain prior knowledge but also incorporate subsequent knowledge such as semantic information, control logic, and device relationships of the smart cockpit. This allows the voice interaction model optimized based on the complex COT to fully understand the complex vehicle interaction environment and thus accurately infer voice interaction commands.

[0043] For example, the voice interaction model is a 7B model (7-billion-parameter model). The 7B model has a relatively moderate number of parameters, enabling it to complete tasks such as voice understanding, real-time response, and short text generation on the device side with low latency, thus ensuring the response speed and system stability required for voice interaction scenarios. The thought chain correction model is a 72B model (72-billion-parameter model), which, with its significantly larger parameter capacity and deeper representation capabilities than the 7B model, can correct and optimize inference paths. Integrating these two models into the in-vehicle terminal significantly improves the accuracy of inference while maintaining a natural and fluent output.

[0044] The technical solutions of the embodiments of this application are described in detail below with reference to the accompanying drawings.

[0045] Figure 1 This is a flowchart illustrating an optimization method for a voice interaction model according to an embodiment of this application.

[0046] See Figure 1 This method is applied to an in-vehicle terminal, which is equipped with a voice interaction model and a large model for correcting thought chains. The method includes at least the following steps.

[0047] Step 101: Receive the first voice interaction command.

[0048] In this embodiment, the voice interaction model can receive the first voice interaction command initiated by the user in the smart cockpit.

[0049] Optionally, a user refers to a driver or passenger who is inside the smart cockpit environment and initiates interactive commands to the vehicle via voice. For example, a driver in the driver's seat, a passenger in the front passenger seat, or a passenger in the rear seat.

[0050] The first voice interaction command refers to a voice interaction command that has been successfully collected in the past and responded to by the voice interaction model. This first voice interaction command is stored in the historical interaction database. In this application, the first voice interaction command is used as a high-quality sample for optimizing the voice interaction model.

[0051] For example, the first voice interaction command might be: Within the past day, a user in the smart cockpit issued the command "Adjust the driver's seat back," and the in-vehicle terminal successfully interpreted and accurately executed the control operation "Adjust the driver's seat back to the user's preferred angle." Alternatively, the first voice interaction command might be: Within the past week, a user in the smart cockpit issued the command "Turn off the in-vehicle sound," and the in-vehicle terminal successfully interpreted and accurately executed the control operation "Turn off the audio in the smart cockpit."

[0052] At this point, the instruction not only clearly expresses the user's intent but also carries reliable response data, so it can be used to optimize the voice interaction model.

[0053] Step 102: Construct the initial thought chain corresponding to the first voice interaction command.

[0054] In this embodiment, the voice interaction model analyzes the first voice interaction command based on its original reasoning structure, identifies the user intent, possible interaction objects and interaction operations in the first voice interaction command, and thus obtains the initial thought chain corresponding to the first voice interaction command.

[0055] Optionally, the initial thought chain refers to the reasoning process text generated based on the first voice interaction command and the vehicle knowledge and application programming interface related to that command. The initial thought chain typically reflects the original thought process of the voice interaction model regarding the first voice interaction command before optimization, and therefore may contain defects such as incomplete logic and reasoning bias. These defects are precisely what the subsequent correction process needs to identify and correct.

[0056] As an example, when the first voice interaction command is "lower the right seat cushion of the third row a little", the voice interaction model may generate an initial thought chain according to the following reasoning structure: 1) Understand the first voice interaction command and clarify that the user's intention is to lower the position of the right seat cushion of the third row; 2) Refer to vehicle knowledge and learn that the seat cushion in the car supports up and down adjustment; 3) Select the appropriate API and determine the interface Seat_Gear_Set; 4) Fill in the API interface parameters: device=seat cushion, direction=lower, set_type=lower, seat_position=right side of the third row.

[0057] Step 103: After completing the correction operation of the initial thought chain, generate the target thought chain and optimize the pre-configured voice interaction model based on the target thought chain.

[0058] In this embodiment, the thought chain correction model first verifies the initial thought chain to determine whether a correction operation is needed. If a correction operation is required, a target thought chain is generated after the correction operation is completed, and the pre-configured voice interaction model is optimized based on the target thought chain. If a correction operation is not required, it indicates that the voice interaction model has good inference performance and high prediction accuracy. In this case, the initial thought chain can be directly output, and a positive feedback signal can be generated, indicating that the current voice interaction model's prediction performance on this type of instruction has reached expectations, and there is no need to optimize the voice interaction model.

[0059] The correction operation refers to the process of adjusting the initial thought chain according to a pre-configured correction method. The pre-configured correction method can include exemplary correction methods and self-correction methods based on the cause of the error. The correction operation can be automatically completed by the thought chain correction model combined with human feedback. During the correction process, a multi-turn dialogue is used to gradually guide the model to approach the desired reasoning result, thereby generating an accurate target thought chain.

[0060] Optionally, the target thought chain refers to the reasoning process text that accurately reflects the user's true intent and expected reasoning steps after revising the initial thought chain. The target thought chain can serve as standard data to guide the optimization of the internal reasoning structure of the voice interaction model, thereby improving the voice interaction model's ability to understand voice interaction commands and the accuracy of its decision-making.

[0061] Among them, optimization refers to using the target thought chain as a high-quality supervisory signal and training the current voice interaction model through distillation training, so that it gradually learns the reasoning structure and decision-making logic of the target thought chain.

[0062] The optimized voice interaction model will be deployed back to the in-vehicle terminal to perform online inference tasks, thereby directly outputting highly accurate vehicle control tasks in subsequent real-time voice interaction requests.

[0063] As an example, suppose the first voice interaction command is "I want to lower the right seat cushion of the third row a little." The initial thought chain correctly selects the `Seat_Gear_Set` interface, but the `direction` parameter of the `Seat_Gear_Set` interface is missing, resulting in an incomplete interface call. The thought chain correction model analyzes the initial thought chain, identifies the missing key interface parameter of the `Seat_Gear_Set` interface, determines that the initial thought chain needs correction, and automatically completes the `direction` to "down," generating a complete target thought chain. Inputting the target thought chain into the distillation training samples, after distillation training, the voice interaction model can accurately output complete and accurate API interface parameters when faced with similar commands, improving the success rate of such command execution and reducing on-site confirmation steps.

[0064] In this embodiment, a first voice interaction command is received; an initial thought chain corresponding to the first voice interaction command is constructed; after completing the correction operation of the initial thought chain, a target thought chain is generated, and the pre-configured voice interaction model is optimized according to the target thought chain.

[0065] Compared to related technologies, the technical solution of this application has two advantages: First, by constructing an initial thought chain corresponding to the first voice interaction command, this application makes the abstract reasoning process explicit. This explicit reasoning structure helps to fully understand the user's intent, thereby improving the optimization effect of the voice interaction model. Second, this application does not directly use the initial thought chain to optimize the voice interaction model. Instead, after modifying the initial thought chain, it generates a target thought chain that better conforms to the expected reasoning logic, and trains the voice interaction model with the target thought chain as the optimization target, thereby avoiding the voice interaction model learning incorrect reasoning chains. Therefore, when the optimized voice interaction model is deployed in the vehicle terminal, the vehicle terminal can accurately parse the voice interaction commands issued by the user using the voice interaction model, improving the overall voice interaction effect.

[0066] Figure 2 This is another flowchart illustrating an optimization method for a voice interaction model as shown in an embodiment of this application. Figure 2 relatively Figure 1 The technical solutions of the embodiments of this application are described in more detail.

[0067] Step 201: Receive the first voice interaction command.

[0068] For complex smart cockpit scenarios, the voice interaction model can retrieve the first voice interaction command initiated by the user in the smart cockpit from the historical interaction database. For example, the first voice interaction command might be "lower the right seat cushion in the third row a little".

[0069] Step 202: Construct the initial thought chain corresponding to the first voice interaction command.

[0070] After receiving the first voice interaction command, the voice interaction model triggers a complex COT generation command to obtain the initial thought chain corresponding to the first voice interaction command.

[0071] It is worth noting that the data basis for optimizing the voice interaction model in this application is the initial thought chain generated by the voice interaction model based on its original reasoning structure. The thought chain correction model can directly identify the inherent defects of the voice interaction model by analyzing and correcting the initial thought chain.

[0072] The response process for complex COT generation commands includes at least the following steps: parsing the first voice interaction command to obtain the voice interaction text and the vehicle knowledge associated with it; retrieving the application programming interface (API) list corresponding to the voice interaction text, which includes several APIs and their corresponding interface parameters; filling the vehicle knowledge, APIs, and interface parameters into a preset prompt word template to obtain initial prompt words; and performing thought chain reasoning on the initial prompt words to generate an initial thought chain.

[0073] The voice interaction text refers to the text transcribed from the first voice interaction command using speech recognition technology. This text not only contains the original text content of the first voice interaction command, but may also include contextual information, such as the vehicle interaction environment in which the first voice interaction command was issued.

[0074] Vehicle knowledge refers to the prior knowledge related to smart cockpit functions that is manually compiled and added during the construction of application programming interfaces (APIs). This knowledge assists the voice interaction model in understanding and reasoning about the user's voice commands. Vehicle knowledge includes, but is not limited to, the parameter types, range values, and interface data of each device in the smart cockpit. For example, vehicle knowledge may include the following: "The seat cushion can be adjusted up and down and forward and backward," "The leg rest can be adjusted as part of the seat cushion," "The lumbar support supports forward and backward and up and down adjustment," and "The vehicle is equipped with three rows of seats."

[0075] The application programming interface (API) list refers to the collection of available APIs in the smart cockpit. Each API is the entry point for the smart cockpit control functions, which is to say, the smart cockpit control functions are abstracted into callable interfaces.

[0076] Interface parameters refer to the call information corresponding to each application interface. For example, interface parameters include the parameter name of the PI, the parameter type (enumeration, string, number), the range of selectable values, etc., thereby constraining the content of the API call and avoiding interface call failure due to incorrect API parameters when generating vehicle control tasks.

[0077] Preset prompt templates refer to pre-defined text templates used to guide the voice interaction model or the large-scale thought chain correction model in generating thought chains. These templates specify the prompt structure, output format requirements, and reasoning steps needed to generate thought chains, thereby ensuring that the generated thought chains meet expectations in terms of logical order, information completeness, and format standardization.

[0078] The initial prompt word refers to the concatenated prompt word obtained by filling the voice interaction text, the retrieved application interface list, the corresponding interface parameters, and relevant vehicle knowledge into the preset prompt word template. The initial prompt word is used to guide the voice interaction model to generate the initial thought chain.

[0079] As an example, a preset prompt template could be: "You are an in-car voice assistant that interacts with the user based on their commands, the APIs and their parameters provided in the candidate API list, and the vehicle knowledge given." 1. First, you should think based on the user instructions and your vehicle knowledge, and provide your thought process. 2. Based on logical reasoning, determine whether the following APIs can help you complete the task. If no API can help you complete the task, output "No". 3. If a suitable API is available in the list, select one and then fill in the parameters for that API. 4. Note that if a parameter is required, you must fill it in; if it is an enumeration value, you can only choose from the listed candidate values. [Your output format] Logical thinking: 1. Understanding user instructions: 2. Refer to vehicle knowledge: 3. Choose the appropriate API: 4. Populate API parameters Is there a suitable API: Yes or No Selected API: {"API": "api1", "ARGUMENTS": {"arg1": "value1", "arg2": "value2", ... ,"argn": "valuen"}} [Vehicle Knowledge] The lumbar support can be adjusted forward and backward, as well as up and down. Leg rests can be understood as seat cushions. The seat cushion can be adjusted up and down, and also forward and backward. [List of available APIs]

Seat_Value_Set

[0080] ARGUMENTS: "device": (enumerated value, required) Optional value: one of ['backrest', 'seat', 'leg rest', 'headrest', 'cushion', 'lumbar support']. "direction": (enumeration value, required) Optional values: ['up', 'down', 'forward', 'back', 'middle'] "set_type": (enumeration value, required) The value can be one of the following: ['Raise', 'Lower', 'To', 'Before', 'After']. "seat_position": (enumeration value, optional) Optional values ​​include ['driver', 'passenger', 'front row', 'second row left', 'second row right', 'second row', 'all', 'third row left', 'third row right', 'third row'] "set_value": (string, required) This parameter has no limit on the range of values. It can be one of two types: a number (e.g., 1 to 100) or a relative value (e.g., 3%, half, middle, one-third). Both types of values ​​should be output as text in the command; no numerical conversion is required.

Seat_Gear_Set

[0081] ARGUMENTS: "device": (enumerated value, required) Optional value: one of ['backrest', 'seat', 'leg rest', 'headrest', 'cushion', 'lumbar support']. "direction": (enumeration value, required) Optional values: ['up', 'down', 'forward', 'back', 'middle'] "set_type": (enumeration value, required) The value can be one of ['increment', 'decrement', 'before', 'after']. "seat_position": (enumeration value, optional) Optional values ​​include ['driver', 'passenger', 'front row', 'second row left', 'second row right', 'second row', 'all', 'third row left', 'third row right', 'third row']

Seat_Max_Min_Set

[0082] ARGUMENTS: "device": (enumerated value, required) Optional value: one of ['backrest', 'seat', 'leg rest', 'headrest', 'cushion', 'lumbar support']. "direction": (enumeration value, required) Optional values: ['up', 'down', 'forward', 'back', 'middle'] "set_value": (string, required) Optional values ​​['lowest', 'highest', 'first', 'last']. This parameter is one of the following: "seat_position": (enumeration value, optional) Values ​​can be one of ['driver', 'passenger', 'front row', 'second row left', 'second row right', 'second row', 'all', 'third row left', 'third row right', 'third row']. User commands "Adjust the right seat cushion in the third row to a tiny bit lower."

[0083] Thinking chain reasoning refers to the process by which a voice interaction model generates text reflecting the internal reasoning process step by step according to preset reasoning steps, using initial prompts as input. This process includes understanding and rewriting instructions, making feasibility judgments based on vehicle knowledge, selecting the most suitable interface from the application interface list and filling in the parameters one by one, and finally outputting the initial thinking chain.

[0084] For example, the thought chain reasoning process generates the initial thought chain step by step according to the following preset reasoning steps: 1) For incomplete or ambiguous voice interaction commands, the model first parses and rewrites the voice interaction commands to make their semantics clearer and more executable. 2) Combining information such as device functions, parameter ranges, and constraints in the vehicle knowledge base, the model is assisted in judging the feasibility of the command, which is equivalent to injecting prior knowledge into the model. 3) Based on understanding the voice interaction commands, the API that best matches the user's intent is selected from the list of available application programming interfaces. 4) According to the parameter definitions of the selected API and the voice interaction commands, the API parameters are filled in item by item to ensure the completeness and correctness of the interface call.

[0085] As an example, firstly, the voice interaction model parses the first voice interaction command based on its configured ASR module, outputting the voice interaction text "Turn off the sound in the car." Then, it uses the RAG module to retrieve the top-K similar APIs semantically closest to this voice interaction text, and simultaneously uses the BGE (Big Generalist Embedding) model to retrieve the interface parameters of each API from the API description vector library. Next, it fills the preset prompt word template with vehicle knowledge and the top-K similar APIs and their interface parameters to generate initial prompt words. These initial prompt words explicitly require the voice interaction model to output the thought process, the existence of a suitable API, and the selected API and its parameter filling results according to a preset data format. Finally, the voice interaction model performs thought chain reasoning based on these initial prompt words to generate an initial thought chain.

[0086] Step 203: After completing the correction operation of the initial thought chain, the target thought chain is generated.

[0087] The large-scale model for correcting thought chains can extract real labels from the first voice interaction command after correcting the initial thought chain, and perform multiple sampling operations on the initial thought chain to obtain predicted labels. Based on the comparison between the predicted labels and the real labels, the correction method for the initial thought chain is determined, and the initial thought chain is corrected according to the matching correction method to generate the target thought chain.

[0088] In this context, a label refers to the target value or expected output result associated with a sample. For example, in model optimization, labels can be manually labeled or automatically created identifiers such as categories, values, and attributes.

[0089] Authentic labels refer to the confirmed authentic results for the first voice interaction command, typically expressed as follows:<API,Arguments> The format is represented as follows: it includes the name of the interface to be called and the corresponding interface parameters.

[0090] Predicted labels refer to the natural language understanding results generated each time the initial thought chain is sampled multiple times.<API,Arguments> The predicted label is represented in the form of a symbol. The predicted label reflects the prediction result given by the voice interaction model under the current inference structure.

[0091] When comparing predicted and real labels, the comparison is not limited to complete lexical equality. Instead, it allows for the determination of the matching relationship by calculating the semantic similarity between the two. In other words, as long as the predicted and real labels are semantically consistent, even if there are synonym substitutions, differences in parameter descriptions, or different word orders, they can still be considered a match.

[0092] Sampling refers to performing multiple independent calls (denoted as N times) on a large voice interaction model under the same initial prompt words to obtain N independent inference outputs. Each inference output is then parsed using structured parsing to obtain a predicted label.<API,Arguments> Multiple samplings are used to reflect the stability and consistency of the voice interaction model's inference under the current initial thought chain. If there are significant differences between the predicted labels generated by different sampling operations, it indicates that the model's inference is unstable and requires further correction. If the predicted labels are highly consistent with the true labels, it indicates that the current initial thought chain is of high quality.

[0093] As an example, the voice interaction model itself possesses a certain degree of instruction-following ability. With increased sampling frequency and probability, it may autonomously generate correct inference results. Compared to externally added thought chains, thought chains generated autonomously by the model tend to be closer to its inherent reasoning structure and are more suitable as high-quality samples for subsequent training. Therefore, this step involves independently calling the current voice interaction model N times under the same initial prompt words to obtain N inference outputs. The value of N can be flexibly set according to computational resources and accuracy requirements, such as 5 times, 10 times, or 20 times.

[0094] Preferably, in order to achieve a balance between sampling stability and computational overhead, this application sets N to 10.

[0095] refer to Figure 3 , Figure 3This is a schematic diagram of the complex COT generation process illustrated in the embodiments of this application. During the 10 sampling processes, if any predicted label obtained from a sampling matches the true label (denoted as T1), there is no need to rely on a larger model to regenerate the complete inference chain. Instead, an exemplary correction method is used to correct the initial thought chain, making it conform to the preset structure and inference paradigm, thus obtaining the target thought chain. If the correct result is not obtained for 10 consecutive samplings (denoted as T0), it indicates that the current voice interaction model has insufficient inference ability on this type of instruction, making it difficult to obtain an accurate thought chain through self-sampling. In this case, this application introduces a larger model (the large thought chain correction model), which regenerates the thought chain based on a self-correction method according to the cause of the error, and uses the new thought chain as the target thought chain.

[0096] Furthermore, in case T1, even if the initial thought chain is semantically correct, there may still be issues such as non-standard expression, inconsistent field formats, and missing required parameters. If at least one sampling operation corresponds to a predicted label that is the same as the actual label corresponding to the first voice interaction command, it indicates that the current voice interaction model has the ability to reason correctly; however, the output results are unstable due to the randomness of the prediction process.

[0097] Therefore, the large-scale model for correcting thought chains needs to obtain a reference thought chain example of the first voice interaction command. Based on the reference thought chain example, the output format of the initial thought chain is adjusted to generate the target thought chain. This allows the content of the initial thought chain to be more standardized and structured without changing the original reasoning structure, thus obtaining the target thought chain.

[0098] The reference thought chain example refers to a verified COT example, which typically includes a complete, standardized, and structured description of the reasoning steps. In this application, those skilled in the art can select a batch of typical voice interaction commands based on the voice interaction scenario, write a correct and complete description of the reasoning process for the typical voice interaction commands, and use the description of the reasoning process as the reference thought chain example after verification, thereby ensuring that the reference thought chain example has high reliability.

[0099] In case T0, if the predicted label corresponding to a continuous sampling operation is different from the real label corresponding to the first voice interaction command, it indicates that the current voice interaction model has a significant deviation in its inference path for this type of command, such as selecting the wrong API, misjudging the meaning of the slot, or providing non-compliant interface parameters. In this case, the initial thought chain cannot be corrected through the exemplary correction method.

[0100] Therefore, the large-scale model for correcting thought chains needs to obtain the natural language understanding results of the first voice interaction command, and based on the natural language understanding results, self-correct the initial thought chain to generate the target thought chain.

[0101] The process involves self-correcting the initial thought chain based on natural language understanding results to generate a target thought chain. This includes: analyzing the reasons for errors in the initial thought chain based on the natural language understanding results; concatenating the natural language understanding results and the reasons for errors into correction prompts; and re-reasoning the initial thought chain based on the correction prompts to generate the target thought chain. Here, the natural language understanding results refer to the correct results provided by human feedback. For example, a user might input based on experience: "Correct result as follows: Selected API: {"API": "Seat_Gear_Set", "ARGUMENTS": {"device": "seat cushion", "direction": "down", "set_type": "lower", "seat_position": "third row right side"}}.

[0102] Errors may be caused by, but are not limited to, selecting the wrong API, missing key slots, incorrect parameter formats, or incorrect vehicle knowledge compatibility.

[0103] The correction prompts are target prompts generated by inputting the natural language understanding results and error reasons into a preset prompt template. These prompts guide the thought chain correction model to perform targeted re-reasoning on the initial thought chain, thereby generating a target thought chain that meets semantic and format requirements. For example, the correction prompts could be: "Your output is incorrect. The correct result is below. Please analyze the cause based on the correct result and output the reason why the correct result is correct:" [Correct Result] Selected API: {"API": "Seat_Gear_Set", "ARGUMENTS": {"device": "seat cushion", "direction": "down", "set_type": "lower", "seat_position": "third row right side"}} [Incorrect Result] Selected API: {"API": "Seat_Gear_Set", "ARGUMENTS": {"device": "seat cushion", "direction": "down", "set_type": "lower"}} [Your output format] Correct result: xxx Correct reason: xxx Error result: xxx Error reason: xxx".

[0104] As can be seen, in this application, the initial thought chain is corrected using a multi-round dialogic error correction mechanism: the thought chain correction model gradually converges its reasoning direction through continuous prompts and feedback, avoiding deviations or insufficient understanding caused by a one-time output.

[0105] The first round of dialogue focuses on quickly diagnosing and coarsely correcting the initial thought process, identifying and listing the main errors (such as selecting the wrong API, missing required slots, or non-standard parameter formats).

[0106] The second round of dialogue, based on the diagnostic results of the first round, corrects the output format of the initial thought chain by combining reference thought chain examples, or analyzes the reasons for errors in the initial thought chain based on the verified natural language understanding results, so as to facilitate re-reasoning.

[0107] As an example, if the target thought chain accurately reflects the user's intent and the API and its interface parameters are correctly selected, but the output format or reasoning structure of the target thought chain still does not meet expectations, a multi-turn dialogue can be initiated to correct the output format or reasoning structure of the target thought chain.

[0108] First round of output (initial model reasoning) In the first round, the thought chain correction model directly generates the reasoning process and API call results based on user instructions. The output at this stage is usually quite accurate in semantic understanding, but the reasoning structure and format may still be non-standard, for example: "Logic of thought: The user needs to adjust the driver's seat leg rest and lower it, but no specific value is given. Therefore, theoretically, the Seat_Value_Set API should be used, but due to the lack of value, the Seat_Gear_Set API can only be selected."

[0109] Is there a suitable API? Yes Selected API: {"API": "Seat_Gear_Set", "ARGUMENTS": {"device": "Leg rest", "direction": "Down", "set_type": "Lower", "seat_position": "Driver's seat"}} Although the API was selected correctly in the first round of output, the reasoning level was insufficient and the format did not meet the requirements, so it needs to be corrected in the next round.

[0110] Second round of input (formatting guidelines) The first round's output format or inference structure does not conform to the preset template, and the output format needs to be corrected. Please correct your results based on the error analysis above. Additionally, your output format should be similar to the format shown in the [Output Example] below. [Output Example] Example 1 Logical thinking: 1. Understanding user instructions: The user wants the lumbar support to be adjusted upwards.

[0111] 2. Refer to vehicle information: According to vehicle information, the lumbar support is adjustable up and down. This is available in the provided API.

[0112] 3. Choose the appropriate API: The Seat_Gear_Set API allows for relative adjustment of the device, which meets the user's needs because the user does not specify a specific value, but only requests "a little increase".

[0113] 4. Fill in the API parameters: - device: 'lumbar support', because the user specified that the lumbar support should be adjusted.

[0114] - direction: 'up', the user wants the lumbar support to move upwards.

[0115] - set_type: 'raise' means that the position of the lumbar support should be raised.

[0116] - seat_position: Since the user did not specify a particular seat, this parameter can be omitted.

[0117] Is there a suitable API? Yes Selected API: {"API": "Seat_Gear_Set", "ARGUMENTS": {"device": "lumbar support", "direction": "up", "set_type": "adjust up"}} Example 2 Logical thinking: 1. Understanding User Commands User Command: "Adjust lumbar support in the car" - The user wants to adjust the "lumbar support".

[0118] - The user wants the lumbar support to be "adjusted up".

[0119] 2. Refer to vehicle knowledge: According to the vehicle knowledge, the lumbar support can be adjusted forward and backward, as well as up and down. The user command mentioned "adjust upward," so the lumbar support needs to be adjusted upward.

[0120] 3. Choose the appropriate API According to the list of available APIs: - Seat_Max_Min_Set: Used to adjust the device's maximum and minimum values ​​(highest, lowest, first, last), which does not meet user needs.

[0121] - Seat_Gear_Set: Used to adjust the relative position of the device (higher, lower, forward, backward) to meet user needs.

[0122] - Seat_Value_Set: This is used to adjust the specific value of the device. The user command did not mention a specific value, so it does not meet the requirements.

[0123] 4. Populate API parameters Choose the Seat_Gear_Set API: - device: lumbar support, because the user specified that the lumbar support should be adjusted.

[0124] - direction: up, the user wants the lumbar support to move upwards.

[0125] - set_type: Increase, indicating that the position of the lumbar support should be adjusted to be higher.

[0126] - seat_position: All (Since the user mentioned "inside the car," it means the user wants to adjust all the lumbar support positions inside the car, so "All" is selected.) Is there a suitable API? Yes Selected API: {"API": "Seat_Gear_Set", "ARGUMENTS": {"device": "lumbar support", "direction": "up", "set_type": "adjust up", "seat_position": "all"}}.

[0127] Second round output (formatted model results) Upon receiving a correction request, the model will reorganize the inference chain based on the example, generating a properly formatted and logically complete output. For example: "Logic of thought:" 1. Understanding user instructions: The user wants the driver's leg rest position to be lowered.

[0128] 2. Based on vehicle knowledge: According to vehicle knowledge, a leg rest can be understood as a seat cushion, and a seat cushion is adjustable in height. The user did not mention a specific value, but only wanted it adjusted lower.

[0129] 3. Choose the appropriate API: The Seat_Gear_Set API allows for relative adjustment of the device, which meets the user's needs because the user did not specify a specific value, but only requested to "lower it a little bit".

[0130] 4. Fill in the API parameters: - device: 'Leg rest', because the user specified that the leg rest should be adjusted.

[0131] - direction: 'down', the user wants the leg rest to move downwards.

[0132] - set_type: 'lower' means that the position of the leg rest should be lowered.

[0133] - seat_position: 'driver', because the user specified the seat position to be adjusted to be the driver's seat.

[0134] Is there a suitable API? Yes Selected API: {"API": "Seat_Gear_Set", "ARGUMENTS": {"device": "Leg rest", "direction": "Down", "set_type": "Lower", "seat_position": "Driver's seat"}}.

[0135] The final output not only maintains semantic correctness, but also fully complies with the requirements of standardized structured templates.

[0136] If the large-scale thinking chain correction model still cannot generate a target thinking chain that is consistent with the real label and meets the output format requirements after introducing human feedback and undergoing multiple rounds of self-correction, it indicates that this type of instruction is beyond the understanding range of the voice interaction model and the large-scale thinking chain correction model, and requires human intervention or should be discarded.

[0137] At the same time, record and report the complete metadata of the instruction, such as the original instruction transcription, initial thought chain, all sampling results, human feedback, correction prompts, model output and scores for each round, etc., for post-analysis.

[0138] Step 204: Integrate the first voice interaction command and the target thought chain according to the preset data format to construct the distillation training sample.

[0139] The first voice interaction command obtained and the target thought chain modified in step 203 are combined and encapsulated according to a predefined data format to construct training samples that can be directly used for distillation training.

[0140] The preset data format standardizes the field composition of the distillation training samples, thereby ensuring structural consistency among samples from different sources. For example, the first voice interaction command is written into field A, the target thought chain is written into field B, and optional fields C such as real labels, error type descriptions, and NLU results are added, thus ensuring structural consistency among training data from different sources.

[0141] Step 205: Use distilled training samples to iteratively train the pre-configured voice interaction model so that the voice interaction model learns the reasoning structure of the target thought chain.

[0142] In this application, the large model for correcting the thought chain acts as the teacher model, while the voice interaction model to be optimized acts as the student model. Through knowledge distillation, the student model learns the reasoning structure of the target thought chain generated by the teacher model.

[0143] Before each training iteration, the Mind Chain Correction Model constructs constraint signals for distillation training based on the generated and validated target Mind Chain. These constraint signals not only contain the complete text of the target Mind Chain but are further abstracted into structured information that can be directly used by the model, such as step order constraints, mandatory slot constraints, parameter value constraints, and inter-step dependencies.

[0144] Using distilled training samples as input, the student model is driven to perform forward reasoning, resulting in the initial thought chain and related intermediate layer feature representations generated by the student model. The generated result of the student model is then comprehensively compared with the corresponding target thought chain. The comparison includes, but is not limited to, differences at the structural level (e.g., whether reasoning steps are missing or the order of steps is reversed), differences at the semantic level (e.g., whether slot names or slot values ​​are inconsistent or whether parameter expressions are standardized), and differences in logical consistency (e.g., whether there are unfounded reasoning jumps or breaks in the causal chain).

[0145] Based on the above difference analysis, a joint loss function is constructed, and the model parameters of the student model are updated through the backpropagation algorithm until the preset stopping conditions are met, such as loss convergence or loss value being less than a preset threshold, to obtain the optimized voice interaction model.

[0146] The entire training process is conducted in a cyclical and iterative manner. In each iteration, the gap between the student model output and the target thought chain is continuously narrowed, enabling the student model to deeply understand and learn the reasoning structure of the teacher model.

[0147] In this embodiment, a first voice interaction command is received, an initial thought chain corresponding to the first voice interaction command is constructed, a target thought chain is generated after the initial thought chain is corrected, and the first voice interaction command and the target thought chain are integrated according to a preset data format to construct a distillation training sample. The distillation training sample is used to iteratively train a pre-configured voice interaction model so that the voice interaction model learns the reasoning structure of the target thought chain. This enables the large thought chain correction model to judge and correct prior knowledge itself in the case of generating incorrect or simple COTs, based on complex in-vehicle scenarios and by manually adding correct NLU results. This generates complex COTs that conform to the current intelligent cockpit environment, and then uses the complex COTs to guide the training of the voice interaction model, thereby optimizing the voice interaction model and improving the accuracy and generalization of voice interaction.

[0148] Corresponding to the aforementioned application function implementation method embodiments, this application also provides a voice interaction method, vehicle, and corresponding embodiments based on a voice interaction model.

[0149] Figure 4 This is a schematic diagram illustrating a voice interaction method based on a voice interaction model, as shown in an embodiment of this application.

[0150] See Figure 4 A voice interaction method based on a voice interaction model, comprising: Step 401: Real-time acquisition of the second voice interaction command; Step 402: Input the second voice interaction command into the optimized voice interaction model to generate the corresponding vehicle control task.

[0151] As an example of an embodiment of this application, the process of online voice interaction based on complex COT includes at least the following steps: real-time acquisition of second voice interaction commands, inputting the second voice interaction commands into the optimized voice interaction model, and generating corresponding vehicle control tasks.

[0152] The core of online voice interaction lies in reasoning about the second voice interaction commands initiated by the user in real time in the smart cockpit, and mapping the reasoning results into executable vehicle control tasks, thereby controlling seat components, vehicle air conditioning components, window components, etc.

[0153] In this application, the second voice interaction command refers to a voice interaction command initiated by the user in real time within the smart cockpit, which is used to perform reasoning and execute vehicle control tasks in the optimized voice interaction model.

[0154] It's worth noting that since the first voice interaction command is a historically collected and successfully responded-to command, it carries the correct label, i.e., the true label. The second voice interaction command, however, is a real-time collected command and is not pre-labeled; it carries the label predicted by the voice interaction model.

[0155] refer to Figure 5 , Figure 5 This is a schematic diagram illustrating the online voice interaction based on complex COT as shown in the embodiments of this application. The online processing flow of the second voice interaction command is as follows: During the actual inference phase, upon receiving the second voice interaction command "Turn off the in-car sound," relevant slots are extracted from the second voice interaction command based on the API description and interface parameters retrieved by RAG. The scope of effect is determined using vehicle knowledge, and the slots are standardized to "in-car = all." Combining vehicle knowledge and the API description, the most semantically matching APIs are selected from the candidate API set: "Headrest_Voice_Model_Close" and "Media_Voice_Open." Based on the interface parameter definitions of these APIs, the corresponding interface parameters are extracted from the command: {"target_function":"sound","seat_position":"all"}.

[0156] After obtaining the structured API call parameters, map them back to the original...<API,Arguments> Format. For APIs that are split during the training phase to improve the model's generalization ability, their mapping relationship with the original API is pre-stored in the configuration file, which can automatically complete the mapping and retain the corresponding parameters. The final output is still the original.<API,Arguments> The format ensures consistency between the API splitting during the training phase and the interface format during the actual deployment phase, keeping the entire process seamless for downstream R&D modules and actual users.

[0157] The two most similar APIs and their interface parameters are combined with relevant vehicle knowledge to form the COT cue words required for the current inference. The inference is then completed based on the COT cue words, and the vehicle control task is output.

[0158] However, complex COT inference typically increases inference latency significantly. This application advances the natural language understanding results before COT inference, enabling the voice interaction model to have explicit API selection information before generating the COT. For example, by moving the "Selected API" field before the "Thinking Logic" field, the model can stop generating thought chain content after outputting the API selection during inference, thereby effectively reducing overall inference latency.

[0159] Regarding the methods in the above embodiments, the specific manner in which each step is performed has been described in detail in the embodiments of the method, and will not be elaborated further here.

[0160] Figure 6 This is a schematic diagram of the vehicle structure shown in the embodiments of this application.

[0161] See Figure 6 The vehicle 600 includes a memory 610 and a processor 620.

[0162] The processor 620 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor. Memory 610 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. ROM may store static data or instructions required by the processor 620 or other modules of the computer. Permanent storage devices may be read-write storage devices. Permanent storage devices may be non-volatile storage devices that retain stored instructions and data even when the computer is powered off. In some embodiments, permanent storage devices use mass storage devices (e.g., magnetic or optical disks, flash memory) as permanent storage devices. In other embodiments, permanent storage devices may be removable storage devices (e.g., floppy disks, optical drives). System memory may be a read-write storage device or a volatile read-write storage device, such as dynamic random access memory. System memory may store some or all of the instructions and data required by the processor during operation. Furthermore, memory 610 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (e.g., DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks may also be used. In some embodiments, memory 610 may include a removable storage device that is readable and / or writable, such as a laser disc (CD), a read-only digital multifunction optical disc (e.g., DVD-ROM, dual-layer DVD-ROM), a read-only Blu-ray disc, an ultra-high density optical disc, a flash memory card (e.g., SD card, mini SD card, Micro-SD card, etc.), a magnetic floppy disk, etc. Computer-readable storage media do not contain carrier waves or transient electronic signals transmitted wirelessly or via wired connections.

[0163] The memory 610 stores executable code, which, when processed by the processor 620, can cause the processor 620 to execute part or all of the methods described above.

[0164] Furthermore, the method according to this application can also be implemented as a computer program or computer program product, which includes computer program code instructions for performing some or all of the steps in the method described above.

[0165] Alternatively, this application may be implemented as a computer-readable storage medium (or a non-transitory machine-readable storage medium or a machine-readable storage medium) storing executable code (or computer program or computer instruction code) that, when executed by a processor of an electronic device (or server, etc.), causes the processor to perform part or all of the steps of the methods described above according to this application.

[0166] This application also provides a computer program product, which includes computer instructions that, when executed by a processor, implement the method described above.

[0167] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. An optimization method for a voice interaction model, characterized in that, include: Receive the first voice interaction command; Construct the initial thought chain corresponding to the first voice interaction command; After completing the correction operation on the initial thought chain, a target thought chain is generated, and the pre-configured voice interaction model is optimized based on the target thought chain.

2. The method according to claim 1, characterized in that, The step of generating the target thought chain after completing the correction operation on the initial thought chain includes: Extract the real labels from the first voice interaction command; The initial thought chain is sampled multiple times to obtain predicted labels; Based on the comparison relationship between the predicted labels and the actual labels, the correction method for the initial thought chain is determined; The initial thought chain is modified according to the modification method described above to generate the target thought chain.

3. The method according to claim 2, characterized in that, The step of modifying the initial thought chain according to the modification method to generate the target thought chain includes: When there is at least one sampling operation whose predicted label is the same as the real label corresponding to the first voice interaction instruction, obtain a reference thought chain example of the first voice interaction instruction. Based on the reference thought chain example, the output format of the initial thought chain is adjusted to generate the target thought chain.

4. The method according to claim 2, characterized in that, The step of modifying the initial thought chain according to the modification method to generate the target thought chain includes: When the predicted label corresponding to a continuous sampling operation is different from the real label corresponding to the first voice interaction command, the natural language understanding result of the first voice interaction command is obtained. Based on the natural language understanding results, the initial thought chain is self-corrected to generate the target thought chain.

5. The method according to claim 4, characterized in that, The step of self-correcting the initial thought chain based on the natural language understanding results to generate the target thought chain includes: Based on the natural language understanding results, analyze the reasons for the errors in the initial thought process. The natural language understanding result and the error reason are combined to form a correction prompt message; Based on the correction prompts, the initial thought chain is re-reasoned to generate the target thought chain.

6. The method according to claim 1, characterized in that, The optimization of the pre-configured voice interaction model based on the target thought chain includes: The first voice interaction command and the target thought chain are integrated according to a preset data format to construct a distillation training sample. The pre-configured voice interaction model is iteratively trained using the distilled training samples to enable the voice interaction model to learn the reasoning structure of the target thought chain.

7. The method according to claim 1, characterized in that, The construction of the initial thought chain corresponding to the first voice interaction command includes: Parse the first voice interaction command to obtain the voice interaction text and the vehicle knowledge associated with the voice interaction text; Retrieve a list of application programming interfaces (APIs) corresponding to the voice interaction text; the list of APIs includes several APIs and interface parameters corresponding to each API. The vehicle knowledge, the application programming interface, and the interface parameters are filled into a preset prompt word template to obtain the initial prompt word; The initial thought chain is generated by performing thought chain reasoning on the initial prompt words.

8. A voice interaction method based on a voice interaction model, characterized in that, The voice interaction model is obtained based on the optimization method described in claims 1-7, the method comprising: Real-time acquisition of second voice interaction commands; The second voice interaction command is input into the optimized voice interaction model to generate the corresponding vehicle control task.

9. A vehicle, characterized in that, include: processor; as well as A memory having executable code stored thereon, which, when executed by the processor, causes the processor to perform the method as described in any one of claims 1-8.

10. A computer-readable storage medium having executable code stored thereon, which, when executed by a processor of an electronic device, causes the processor to perform the method as described in any one of claims 1-8.

Images