A voice control method for robots

Abstract

This invention relates to the field of data processing technology, and more particularly to a voice control method for robots. By extracting the interaction process from an interactive database, performing multi-source analysis on control commands, identifying fuzzy data in the control commands, calculating fuzzy representation values, classifying the command execution tendencies, determining the command execution mode, and, in response to the classification results of weak command execution tendencies, determining environmental and target influence feature values, and combining these with the fuzzy representation values ​​to calculate hidden execution representation parameters, the hidden tendency and execution mode of the control commands are determined, execution results are obtained, data comparison and verification are performed, and the effective execution value of the control commands is calculated to determine the effectiveness of the command execution mode. The interaction steps are then updated to optimize the robot interaction model. This invention reduces the number of human-computer interactions, lowers task completion time, and improves execution efficiency by optimizing the voice interaction model.

Description

Technical Field

[0001] This invention relates to the field of voice control technology, and more particularly to a voice control method for robots. Background Technology

[0002] In the field of robotics, voice control technology has been widely used to achieve more natural and convenient human-computer interaction. Existing robot voice control methods typically include steps such as voice signal acquisition, recognition and conversion into text, and then parsing text instructions to control robot actions. However, these methods are often affected by environmental noise in practical applications, leading to a decrease in recognition rate. At the same time, their ability to understand natural language instructions is limited, relying heavily on preset keywords or fixed syntax, making it difficult to accurately handle complex, ambiguous, or context-dependent instructions, thus leading to misjudgment of control intentions and affecting the reliability of interaction and user experience.

[0003] Chinese Patent Publication No. CN108447479A discloses a robot voice control system for noisy working environments. In noisy environments, it achieves human-robot collaboration through a combination of local noise reduction processing and online speech recognition. The system includes a speech and semantic online recognition data platform, a mobile client, a local voice control device, and an industrial collaborative robot. The mobile client enables system networking. The local voice control device integrates a microphone array module to effectively overcome industrial noise environments, collects voice signals, transmits them to the core voice data module, reduces noise, and then transmits them to the deep learning-based speech and semantic online recognition data platform for online speech recognition. The recognized data is returned to the local voice control device for processing and then transmitted to the industrial collaborative robot, which parses the data and executes the commands. This invention effectively overcomes industrial noise environments, exhibits outstanding performance, and has a wide range of applications.

[0004] Chinese Patent Publication No. CN115240668A discloses a voice-interactive home control method and robot. The voice-interactive home control method includes: acquiring a rule base, the rule base including a mutually exclusive rule base; acquiring multiple legal control commands through voice interaction with the user; acquiring a persistent command from the multiple control commands; dividing the multiple control commands into a first command set and a second command set; dividing the first command set into one or more execution combinations according to the mutually exclusive rule base, wherein the control commands in the execution combinations are not mutually exclusive; executing the execution combinations of the first command set one by one; and executing all control commands in the second command set after completing the first command set. This invention can provide the execution order of multiple control commands obtained in a single round of voice interaction, without requiring the user to provide the execution order of the control commands simultaneously, allowing users to control home devices more conveniently.

[0005] However, the following problems still exist in the existing technology.

[0006] In current robot voice interaction systems, the processing of ambiguous commands mainly relies on secondary or multiple interrogation mechanisms. This interaction mode significantly increases the number of rounds of human-computer dialogue, leading to an increase in interaction frequency, prolonged task completion time, reduced command execution efficiency, and impact on the smoothness of user experience. Summary of the Invention

[0007] To address this, the present invention provides a voice control method for robots, which overcomes the problem that in current robot voice interaction systems, the processing of ambiguous commands mainly relies on secondary or multiple interrogation mechanisms. This interaction mode significantly increases the number of rounds of human-computer dialogue, leading to an increase in interaction frequency, prolonged task completion time, reduced command execution efficiency, and impact on the smoothness of user experience.

[0008] To achieve the above objectives, the present invention provides a voice control method for a robot, comprising:

[0009] Extract the interaction process from the interaction database, the interaction process including control instructions, interaction steps and interaction results;

[0010] The control commands are analyzed from multiple sources to identify fuzzy data in the control commands, including spatial fuzzy data, object fuzzy data, and action fuzzy data.

[0011] Based on the spatial fuzzy data, the object fuzzy data, and the action fuzzy data, calculate the instruction fuzzy representation value to classify the instruction execution tendency of the control instruction and determine the instruction execution mode;

[0012] In response to the classification results of weak instruction execution tendency, environmental data and user profiles of the control instructions are collected to determine environmental impact feature values ​​and target impact feature values. Combined with the instruction fuzzy representation values, the hidden execution representation parameters of the control instructions are calculated to determine the hidden tendency and instruction execution mode of the control instructions, and the execution results are obtained.

[0013] Based on the execution result, feedback data is collected in real time to calculate the control command feedback index, determine the effectiveness of the command execution method, and determine whether the execution result needs to be dynamically corrected to complete voice control.

[0014] Furthermore, the process of identifying fuzzy data in the control command includes,

[0015] Analyze the control commands to determine the command range, command object, and command action;

[0016] The ratio of the area of ​​the instruction range to the area of ​​the involved range is determined as the spatial fuzzy feature value;

[0017] Determine the number of associated words for the instruction object, where associated words are words related to the instruction object;

[0018] The ratio of the number of associated words to the total number of words in the control instruction is determined as the object's fuzzy feature value;

[0019] Determine the number of the command actions, and identify the key command actions;

[0020] The ratio of the number of key instruction actions to the total number of instruction actions is determined as the action fuzzy feature value.

[0021] Furthermore, the process of calculating the fuzzy representation value of the instruction includes,

[0022] The ratio of the spatial fuzzy feature value to the reference spatial fuzzy feature value is determined as the first fuzzy factor;

[0023] The ratio of the fuzzy feature value of the object to the fuzzy feature value of the reference object is determined as the second fuzzy factor;

[0024] The ratio of the action fuzzy feature value to the reference action fuzzy feature value is determined as the third fuzzy factor;

[0025] The weighted sum of the first fuzzy factor, the second fuzzy factor, and the third fuzzy factor is determined to be the instruction fuzzy representation value.

[0026] Furthermore, the step of classifying the instruction execution tendency of the control instructions and determining the instruction execution mode, wherein,

[0027] If the instruction fuzzy representation value is greater than the instruction fuzzy representation value threshold, then the control instruction is classified as having a weak instruction execution tendency, and the instruction execution mode is determined as to be analyzed for execution.

[0028] If the instruction fuzzy representation value is less than or equal to the instruction fuzzy representation value threshold, then the control instruction is classified as having a strong instruction execution tendency, and the instruction execution mode is determined to be immediate execution.

[0029] Furthermore, the process of determining the environmental impact characteristic value and the target impact characteristic value includes,

[0030] The noise level of the environment is calculated based on the environmental data;

[0031] The noise level is determined to be an environmental impact characteristic value;

[0032] The location of the controller is determined based on the user profile, and the relationship between the location and the demand for the control commands is analyzed.

[0033] The demand characteristic value corresponding to the demand relationship is determined as the target influence characteristic value.

[0034] Furthermore, the process of calculating the hidden execution representation parameters of the control instructions includes,

[0035] The ratio of the environmental impact characteristic value to the baseline environmental impact characteristic value is determined as the first hidden factor;

[0036] The ratio of the target influence feature value to the baseline target influence feature value is determined as the second hidden factor;

[0037] The ratio of the instruction fuzzy representation value to the baseline instruction fuzzy representation value is determined as the third hidden factor;

[0038] The weighted sum of the first hidden factor, the second hidden factor, and the third hidden factor is determined to be the hidden execution representation parameter.

[0039] Furthermore, the determination of the concealment tendency of the control commands and the command execution method, wherein,

[0040] If the hidden execution characterization parameter is greater than the hidden execution characterization parameter threshold, then the hiding tendency of the control instruction is determined to be high hiding tendency, and the instruction execution mode is determined to be query-after execution;

[0041] If the hidden execution characterization parameter is less than or equal to the hidden execution characterization parameter threshold, then the hiding tendency of the control instruction is determined to be low hiding tendency, and the instruction execution mode is determined to be immediate execution.

[0042] Furthermore, the process of calculating the control command feedback index includes,

[0043] Analyze the collected feedback text to determine the validity of the control commands;

[0044] The validity of the control command is determined as the accuracy feedback factor;

[0045] The ratio of the collected control command execution time to the reference time is determined as the time feedback factor;

[0046] The weighted sum of the accuracy feedback factor and the time feedback factor is determined to be the control command feedback index.

[0047] Furthermore, the determination of the validity of the instruction execution method, wherein,

[0048] If the control command feedback index is greater than the control command feedback index threshold, then the command execution method is determined to be effective, and voice control is completed.

[0049] If the control instruction feedback index is less than or equal to the control instruction feedback index threshold, the instruction execution method is determined to be invalid, and the execution result is dynamically corrected.

[0050] Furthermore, the execution results and the corrected execution results are stored in the interactive database.

[0051] Compared with existing technologies, this invention extracts the interaction process from an interactive database, performs multi-source analysis of control commands, identifies fuzzy data in the control commands, calculates fuzzy representation values, classifies the execution tendencies of the control commands, determines the command execution methods, and, in response to the classification results of weak command execution tendencies, calculates hidden execution representation parameters by determining environmental and target influence feature values ​​and combining them with the fuzzy representation values ​​of the commands. This determines the hidden tendencies and execution methods of the control commands, yields execution results, performs data comparison and verification, calculates the effective execution value of the control commands to determine the effectiveness of the command execution methods, and updates the interaction steps to optimize the robot interaction model. This invention optimizes the voice interaction model, reduces the number of human-computer interactions, lowers task completion time, and improves execution efficiency.

[0052] In particular, by determining the spatial fuzzy feature values, object fuzzy feature values, and action fuzzy feature values ​​of control commands, the fuzzy representation value of the command is calculated to determine the command execution tendency. In reality, user-issued control commands often have significant fuzziness, such as unclear referents, broad scope, or abstract actions. For such fuzzy commands that cannot be directly parsed by the system, the mainstream existing technology adopts a strategy of repeated dialogue clarification, that is, obtaining clear information from the user through secondary or multiple inquiries. This approach significantly increases the frequency and number of human-computer interaction rounds, leading to an increase in the overall task execution latency, reducing interaction efficiency, and even causing more serious consequences in emergency situations. However, frequent interactions, while introducing crucial clarifying information, may also introduce unnecessary contextual features or redundant noise. These interfering factors may cause the robot's natural language understanding module to deviate from the core instruction intent, resulting in semantic drift, or even amplifying the comprehension bias. Based on this, this invention considers analyzing the fuzzy data of control instructions from multiple sources to determine whether the control instructions can be directly executed. For instructions that cannot be directly executed, targeted analysis is conducted. Instead of immediately initiating queries, the intent is completed and disambiguated by mining hidden information in environmental data and user profiles. This reduces unnecessary interactions, improves execution efficiency, and enhances the fluency and success rate of the interaction.

[0053] In particular, by conducting targeted analysis of control instructions with different execution tendencies, the environmental and target influence characteristics of weak instruction execution tendency control instructions are determined. Corresponding hidden execution representation parameters are calculated to obtain the hidden tendency of weak instruction execution tendency control instructions, thereby determining the execution method. In practice, environmental and user characteristics supplement control instructions. Environmental data provides specific constraints and feasible ranges for instructions, narrowing down the possible set of execution objects. User data reflects historical preferences and habitual tendencies, helping to select the option with the highest probability among multiple potential execution paths, providing a decision-making basis for determining the most likely method among multiple possible solutions. Furthermore, without the assistance of these two types of key information, the robot will lose important disambiguation basis, forcing it to initiate clarification inquiries more frequently, leading to increased repeated interaction rounds and decreased execution efficiency. Simultaneously, the decision-making process will lack contextual and individual anchor points, potentially increasing the risk of deviation between executed actions and the user's true intentions. Based on this, this invention considers calculating hidden execution representation parameters, determining requirements based on the constraints of the analysis environment and user data on control instructions, to reduce unnecessary interactions, improve execution efficiency, and enhance the fluency and first-time success rate of interactions.

[0054] In particular, by collecting feedback data, including feedback text and control command execution time, and calculating the control command feedback index, the impact of completing control commands through the above operations on the requirements is verified. It is understandable that reducing the number of interactions can improve the smoothness of interaction. However, in reality, reducing the number of interactions may lead to deviations in commands, causing the task execution results to deviate from expectations. It may also be due to the robot's internal analysis and decision-making time being too long. In cases where the task has high time urgency, this lengthy autonomous analysis process may actually cause an overall response delay, making the total time from command issuance to final execution exceed the time required for moderate interaction, thus reducing the interactive experience. Based on this, the present invention calculates the control command feedback index through feedback data, which can analyze the effectiveness of the control method from both time and response accuracy perspectives, thereby improving the execution efficiency and accuracy of the control method. Attached Figure Description

[0055] Figure 1 This is a schematic diagram illustrating the steps of a voice control method for a robot according to an embodiment of the invention.

[0056] Figure 2 A logical block diagram for classifying the instruction execution tendency of the control instructions and determining the instruction execution mode in an embodiment of the invention;

[0057] Figure 3 A logic block diagram for determining the hiding tendency of the control command and the command execution mode in an embodiment of the invention;

[0058] Figure 4 This is a logic block diagram illustrating the determination of the validity of the instruction execution method in an embodiment of the invention. Detailed Implementation

[0059] To make the objectives and advantages of the present invention clearer, the present invention will be further described below with reference to embodiments; it should be understood that the specific embodiments described herein are merely for explaining the present invention and are not intended to limit the present invention.

[0060] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of the present invention and are not intended to limit the scope of protection of the present invention.

[0061] Please see Figure 1 , Figure 1 This is a schematic diagram illustrating the steps of a voice control method for a robot according to an embodiment of the invention. The voice control method for a robot of the present invention includes:

[0062] Step S1: Extract the interaction process from the interaction database. The interaction process includes control instructions, interaction steps, and interaction results.

[0063] Step S2: Perform multi-source angle analysis on the control command to identify the command fuzzy data in the control command, including spatial fuzzy data, object fuzzy data and action fuzzy data;

[0064] Step S3: Calculate the instruction fuzzy representation value based on the spatial fuzzy data, the object fuzzy data, and the action fuzzy data to classify the instruction execution tendency of the control instruction and determine the instruction execution mode;

[0065] Step S4: In response to the classification results of weak instruction execution tendency, collect the environmental data and user profile of the control instruction to determine the environmental impact feature value and the target impact feature value. Combine the instruction fuzzy representation value to calculate the hidden execution representation parameter of the control instruction, determine the hidden tendency and instruction execution mode of the control instruction, and obtain the execution result.

[0066] Step S5: For the execution result, real-time feedback data is collected to calculate the control command feedback index, determine the effectiveness of the command execution method, and determine whether the execution result needs to be dynamically corrected to complete voice control.

[0067] Specifically, there are no restrictions on how the interactive database is obtained. For example, it can be an existing open-source database, a database built by collecting historical data, or any authorized database, as long as it is reasonable. This will not be elaborated further.

[0068] Specifically, the interaction steps in the robot interaction model can be iteratively optimized based on steps S1 to S5 to improve the autonomous decision-making ability of task execution and reduce the error transmission caused by the inherent semantic ambiguity of natural language interaction.

[0069] Specifically, the hidden execution representation parameters in step S4 can be calculated repeatedly, or only one parameter can be introduced each time. Understandably, reducing the introduction of parameters can help improve execution efficiency, provided that the analysis needs are met.

[0070] Specifically, the process of identifying fuzzy data in the control commands includes,

[0071] Analyze the control commands to determine the command range, command object, and command action;

[0072] The ratio of the area of ​​the instruction range to the area of ​​the involved range is determined as the spatial fuzzy feature value;

[0073] Determine the number of associated words for the instruction object, where associated words are words related to the instruction object;

[0074] The ratio of the number of associated words to the total number of words in the control instruction is determined as the object's fuzzy feature value;

[0075] Determine the number of the command actions, and identify the key command actions;

[0076] The ratio of the number of key instruction actions to the total number of instruction actions is determined as the action fuzzy feature value.

[0077] Specifically, there is no limitation on the specific method for determining the scope of the instruction. For example, in implementation, it can be determined based on the preset geofence where the robot is located, the semantic boundaries implied in the user's instructions (such as "in the living room" or "on the table"), or the physical area corresponding to the user's pointing or gaze focus perceived in real time by sensors (such as cameras or lidar). Of course, those skilled in the art can also use other methods to determine it, as long as they are reasonable, which will not be elaborated here.

[0078] Specifically, the specific actions of the instruction are not limited. For example, in implementation, they can be determined based on the user's historical habits, or by combining domain knowledge graphs to map abstract verbs (such as "organize") into a series of executable basic actions (such as "pick up, classify, place"), or by reasoning based on the state of objects in the environment (such as "closed window" corresponding to the "open" action). Of course, those skilled in the art can also use other methods to determine them, as long as they are reasonable, which will not be elaborated here.

[0079] Specifically, the area involved is determined based on the voice control scenario. For example, if the voice control scenario is at home, the area involved is the home area; if the voice control scenario is at the company, the area involved is the company area. Of course, those skilled in the art can also determine it using other methods, such as the area of ​​the dynamic activity area centered on the robot and with its maximum perception radius as the radius. Any reasonable method will suffice, and will not be elaborated further here.

[0080] Specifically, there are no restrictions on the methods for determining related words. For example, based on common sense knowledge bases or domain ontology, one can query a set of words that are related to the instruction object in terms of attributes, components, categories, or functions. Alternatively, a pre-trained language model can be used to calculate the co-occurrence probability or semantic similarity between the instruction object word and the context words. Any reasonable method will suffice, and this will not be elaborated further.

[0081] Specifically, there are no restrictions on how to determine key instruction actions. For example, they can be determined by the semantic weight of the action and its closeness to the core object. In an instruction containing multiple actions (such as "find the cup, wash it clean, and then bring it over"), "bring it over" is usually considered a key instruction action that satisfies the user's final delivery intention. In addition, attention mechanism models can be used to analyze the contribution of different verbs in the instruction to the completion of the final task, thereby identifying key instruction actions. Any reasonable approach will suffice, and this will not be elaborated further.

[0082] Specifically, the process of calculating the fuzzy representation value of the instruction includes,

[0083] The ratio of the spatial fuzzy feature value to the reference spatial fuzzy feature value is determined as the first fuzzy factor;

[0084] The ratio of the fuzzy feature value of the object to the fuzzy feature value of the reference object is determined as the second fuzzy factor;

[0085] The ratio of the action fuzzy feature value to the reference action fuzzy feature value is determined as the third fuzzy factor;

[0086] The weighted sum of the first fuzzy factor, the second fuzzy factor, and the third fuzzy factor is determined to be the instruction fuzzy representation value.

[0087] Specifically, the reference space fuzzy feature value is calculated in advance, and several historical space fuzzy feature values ​​that can be directly executed control commands are obtained in advance. The average value of each historical space fuzzy feature value is determined as the reference space fuzzy feature value.

[0088] Specifically, the fuzzy feature value of the reference object is calculated in advance, and several fuzzy feature values ​​of historical objects that can be directly executed control instructions are obtained in advance. The average value of the fuzzy feature values ​​of each historical object is determined to be the fuzzy feature value of the reference object.

[0089] Specifically, the baseline action fuzzy feature value is calculated in advance, and several historical action fuzzy feature values ​​that can be directly executed control commands are obtained in advance. The average value of each historical action fuzzy feature value is determined as the baseline action fuzzy feature value.

[0090] Specifically, the sum of the weight coefficients of the first fuzzy factor, the second fuzzy factor, and the third fuzzy factor is 1. When configuring the weight coefficients, considering that the instruction object will directly affect the fuzziness of the control instruction, the weight coefficient of the second fuzzy factor is determined to be 0.4, and the weight coefficients of the first fuzzy factor and the third fuzzy factor are both 0.3.

[0091] Specifically, by determining the spatial fuzzy feature values, object fuzzy feature values, and action fuzzy feature values ​​of control commands, the fuzzy representation value of the command is calculated to determine the command execution tendency. In reality, user-issued control commands often have significant fuzziness, such as unclear referents, broad scope, or abstract actions. For such fuzzy commands that cannot be directly parsed by the system, the mainstream existing technology adopts a strategy of repeated dialogue clarification, that is, obtaining clear information from the user through secondary or multiple inquiries. This method significantly increases the frequency and number of human-computer interaction rounds, leading to an increase in the overall latency of task execution, reducing interaction efficiency, and even causing more serious consequences in emergency situations. Furthermore, while frequent interactions introduce crucial clarifying information, they may also introduce unnecessary contextual features or redundant noise. These interfering factors may cause the robot's natural language understanding module to deviate from the core instruction intent, resulting in semantic drift, or even amplifying the comprehension bias. Based on this, this invention considers analyzing the fuzzy data of control instructions from multiple sources to determine whether the control instructions can be directly executed. For instructions that cannot be directly executed, targeted analysis is conducted. Instead of immediately initiating queries, the intent is completed and disambiguated by mining hidden information in environmental data and user profiles. This reduces the number of unnecessary interactions, improves execution efficiency, and enhances the fluency and first-time success rate of the interaction.

[0092] Please see Figure 2 , Figure 2 This is a logical block diagram illustrating the division of the instruction execution tendency of the control instructions and the determination of the instruction execution mode in an embodiment of the invention. Specifically, the division of the instruction execution tendency of the control instructions and the determination of the instruction execution mode, wherein...

[0093] If the instruction fuzzy representation value is greater than the instruction fuzzy representation value threshold, then the control instruction is classified as having a weak instruction execution tendency, and the instruction execution mode is determined as to be analyzed for execution.

[0094] If the instruction fuzzy representation value is less than or equal to the instruction fuzzy representation value threshold, then the control instruction is classified as having a strong instruction execution tendency, and the instruction execution mode is determined to be immediate execution.

[0095] Specifically, the instruction fuzzy representation value threshold represents the boundary of executable instructions obtained from environmental data and user profile analysis. It is pre-calculated by obtaining several historical instruction fuzzy representation values ​​corresponding to the executable control instructions after analysis. The product of each historical instruction fuzzy representation value and the fuzzy coefficient is determined as the instruction fuzzy representation value threshold. The fuzzy coefficient is selected in the interval [0.8, 1.0]. In practice, in order to improve execution accuracy, the fuzzy coefficient is determined to be 0.9.

[0096] Specifically, the process of determining environmental impact characteristic values ​​and target impact characteristic values ​​includes,

[0097] The noise level of the environment is calculated based on the environmental data;

[0098] The noise level is determined to be an environmental impact characteristic value;

[0099] The location of the controller is determined based on the user profile, and the relationship between the location and the demand for the control commands is analyzed.

[0100] The demand characteristic value corresponding to the demand relationship is determined as the target influence characteristic value.

[0101] Specifically, there is no limitation on the method of calculating noise level. For example, the number of concurrent sound sources in the environment (such as the number of independent users issuing voice commands at the same time) can be collected, and the reciprocal or logarithmic normalized value of the total number of sound sources can be determined as the noise level. Of course, those skilled in the art can also use other methods to determine the noise level, as long as they are reasonable, which will not be elaborated here.

[0102] Specifically, there is no limitation on the calculation method of demand characteristic value. For example, the location of the control personnel can be determined in advance, the historical demand frequency of users for all items at that location can be counted, and the ratio of the historical demand frequency to the total global historical demand frequency can be determined as the demand characteristic value. Of course, those skilled in the art can also use other methods, as long as they are reasonable, which will not be elaborated here.

[0103] Specifically, the process of calculating the hidden execution representation parameters of the control instructions includes,

[0104] The ratio of the environmental impact characteristic value to the baseline environmental impact characteristic value is determined as the first hidden factor;

[0105] The ratio of the target influence feature value to the baseline target influence feature value is determined as the second hidden factor;

[0106] The ratio of the instruction fuzzy representation value to the baseline instruction fuzzy representation value is determined as the third hidden factor;

[0107] The weighted sum of the first hidden factor, the second hidden factor, and the third hidden factor is determined to be the hidden execution representation parameter.

[0108] Specifically, the baseline environmental impact characteristic value is calculated in advance, and several historical environmental impact characteristic values ​​corresponding to control commands that can be executed after analysis are obtained in advance. The average value of each historical environmental impact characteristic value is determined as the baseline environmental impact characteristic value.

[0109] Specifically, the baseline target impact characteristic value is calculated in advance, and several historical target impact characteristic values ​​corresponding to control command execution after analysis are obtained in advance. The average value of each historical target impact characteristic value is determined as the baseline target impact characteristic value.

[0110] Specifically, the fuzzy representation values ​​of the reference instruction are the fuzzy feature values ​​of the reference space, the fuzzy feature values ​​of the reference object, and the fuzzy feature values ​​of the reference action.

[0111] Specifically, the sum of the weight coefficients of the first hidden factor, the second hidden factor, and the third hidden factor is 1. When configuring the weight coefficients, considering that the newly introduced factors will affect the final execution result, the weight coefficients of the first hidden factor and the second hidden factor are both determined to be 0.35, and the weight coefficient of the third hidden factor is 0.3.

[0112] Specifically, by conducting targeted analysis of control instructions with different execution tendencies, the environmental and target influence characteristics of control instructions with weak execution tendencies are determined. Corresponding hidden execution representation parameters are calculated to obtain the hidden tendency of these instructions, thereby determining the execution method. In practice, environmental and user characteristics supplement control instructions. Environmental data provides specific constraints and feasible ranges for instructions, narrowing down the possible set of execution objects. User data reflects historical preferences and habitual tendencies, helping to select the option with the highest probability among multiple potential execution paths. This provides a decision-making basis for determining the most likely method among multiple possible solutions. Furthermore, without the assistance of these two types of key information, the robot will lose important disambiguation basis, forcing it to initiate clarification inquiries more frequently, leading to increased repeated interaction rounds and decreased execution efficiency. Simultaneously, the decision-making process will lack contextual and individual anchors, potentially increasing the risk of deviation between the executed action and the user's true intention. Therefore, this invention considers calculating hidden execution representation parameters and determining requirements based on the constraints of the analysis environment and user data on control instructions, in order to reduce unnecessary interactions, improve execution efficiency, and enhance the fluency and success rate of interactions.

[0113] Please see Figure 3 , Figure 3This is a logic block diagram illustrating the determination of the hiding tendency and execution mode of the control command according to an embodiment of the invention. Specifically, determining the hiding tendency and execution mode of the control command, wherein...

[0114] If the hidden execution characterization parameter is greater than the hidden execution characterization parameter threshold, then the hiding tendency of the control instruction is determined to be high hiding tendency, and the instruction execution mode is determined to be query-after execution;

[0115] If the hidden execution characterization parameter is less than or equal to the hidden execution characterization parameter threshold, then the hiding tendency of the control instruction is determined to be low hiding tendency, and the instruction execution mode is determined to be immediate execution.

[0116] Specifically, the hidden execution representation parameter threshold represents a boundary that the robot can execute after the control command is analyzed. It is calculated in advance by obtaining historical hidden execution representation parameters corresponding to several executable commands in advance, and determining the product of each historical hidden execution representation parameter and the hidden coefficient as the hidden execution representation parameter threshold. The hidden coefficient is obtained in the interval [0.8, 1.0]. In practice, in order to improve the execution accuracy, the hidden coefficient is determined to be 0.9.

[0117] Specifically, the process of calculating the control command feedback index includes,

[0118] Analyze the collected feedback text to determine the validity of the control commands;

[0119] The validity of the control command is determined as the accuracy feedback factor;

[0120] The ratio of the collected control command execution time to the reference time is determined as the time feedback factor;

[0121] The weighted sum of the accuracy feedback factor and the time feedback factor is determined to be the control command feedback index.

[0122] Specifically, there are no restrictions on how the feedback text is obtained. It is understood that the robot can directly obtain voice and text, which will not be elaborated further.

[0123] Specifically, the method for determining the validity of control commands is as follows:

[0124] The collected feedback text is divided into three categories and pre-assigned values: 1 for correct control command feedback, 0 for incorrect control command feedback, and 0.5 for incorrect control command feedback and no re-issuance of the control command. Of course, those skilled in the art can also use other methods to determine the validity of control commands, as long as they are reasonable, which will not be elaborated here.

[0125] Examples exist.

[0126] When the feedback text contains explicit affirmative semantics (such as "okay", "correct", "no problem"), confirmation of task completion (such as "got it", "found it"), or tacit approval (such as no corrective feedback within a preset time), it is considered that the instruction has been accurately executed and the user is satisfied, and a value of 1 is assigned.

[0127] When the feedback text contains negative, corrective, or complaining semantics (such as "wrong", "wrong", "not this"), or when the user actively reissues the correction instruction under the same scenario, it is considered that the execution result deviates significantly from the user's intention and is assigned a value of 0;

[0128] When the feedback text shows uncertainty, partial satisfaction, or a vague attitude (such as "It's okay" or "It seems a bit wrong, but never mind"), or when the user does not explicitly correct the error but subsequent interactions result in indirect abnormal behaviors such as interruption of related tasks or repeated queries, it is considered that the execution result has a deviation but has not triggered the user to actively correct it, and is assigned a value of 0.5.

[0129] Specifically, the reference time is calculated in advance by acquiring the historical time used to complete control commands during several normal interactions, and determining the average of these historical times as the reference time.

[0130] Specifically, the sum of the weight coefficients of the accuracy feedback factor and the time feedback factor is 1. When configuring the weights, considering that both accuracy and time have an impact on the feedback of control commands, the weight coefficients of the accuracy feedback factor and the time feedback factor are both determined to be 0.5.

[0131] Specifically, by collecting feedback data, including feedback text and control command execution time, a control command feedback index is calculated to verify the impact of completing control commands through the above operations on the requirements. It is understandable that reducing the number of interactions can improve the smoothness of interaction. However, in reality, reducing the number of interactions may lead to deviations in commands, causing the task execution results to deviate from expectations. It may also be due to the robot's internal analysis and decision-making time being too long. In cases where the task has high time urgency, this lengthy autonomous analysis process may actually cause an overall response delay, making the total time from command issuance to final execution exceed the time required for moderate interaction, thus reducing the interactive experience. Based on this, the present invention calculates the control command feedback index through feedback data to analyze the effectiveness of the control method from the perspectives of time and response accuracy, so as to improve the execution efficiency and execution accuracy of the control method.

[0132] Please see Figure 4 , Figure 4 This is a logic block diagram illustrating the determination of the validity of the instruction execution method according to an embodiment of the invention. Specifically, determining the validity of the instruction execution method, wherein...

[0133] If the control command feedback index is greater than the control command feedback index threshold, then the command execution method is determined to be effective, and voice control is completed.

[0134] If the control instruction feedback index is less than or equal to the control instruction feedback index threshold, the instruction execution method is determined to be invalid, and the execution result is dynamically corrected.

[0135] Specifically, the control command feedback index threshold represents a boundary at which the robot's response to control commands is considered a correct response. It is calculated in advance by acquiring a number of historical control command feedback indices that have been determined to be executed normally. The product of each historical control command feedback index and the feedback coefficient is determined as the control command feedback index threshold. The feedback coefficient is selected within the range [0.8, 1.0]. In practice, in order to improve the execution accuracy, the feedback coefficient is determined to be 0.9.

[0136] Specifically, there are no restrictions on the specific methods for dynamic correction. For example, it could be through voice inquiry, or other methods, as long as they are reasonable.

[0137] Specifically, the execution results and the corrected execution results are stored in the interactive database.

[0138] Understandably, storing the execution results and the corrected execution results in the interactive database can improve the robot's reaction speed and accuracy when it receives control commands again.

[0139] The technical solution of the present invention has been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will all fall within the scope of protection of the present invention.

[0140] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A voice control method for a robot, characterized by, The method comprises the following steps: extracting an interaction process from an interaction database, the interaction process comprising control instructions, interaction steps and interaction results; performing multi-source angle analysis on the control instructions to identify instruction fuzzy data in the control instructions, including spatial fuzzy characteristic values, object fuzzy characteristic values and action fuzzy characteristic values; calculating instruction fuzzy representation values based on the spatial fuzzy characteristic values, the object fuzzy characteristic values and the action fuzzy characteristic values to divide instruction execution tendencies of the control instructions and determine instruction execution modes; in response to the division result of the weak instruction execution tendency, collecting environment data and user portraits of the control instructions to determine environment influence characteristic values and target influence characteristic values, combining the instruction fuzzy representation values to calculate hidden execution representation parameters of the control instructions, determining hidden tendencies and instruction execution modes of the control instructions, and obtaining execution results; for the execution results, collecting feedback data in real time to calculate control instruction feedback indexes, determining effectiveness of the instruction execution modes, and determining whether dynamic correction of the execution results is needed to complete voice control; the process of identifying instruction fuzzy data in the control instructions comprises: analyzing the control instructions to determine instruction ranges, instruction objects and instruction actions; determining a ratio of an area of the instruction range to an area of a range involved as a spatial fuzzy characteristic value; determining a number of associated words of the instruction object, wherein the associated words are words related to the instruction object; determining a ratio of the number of associated words to a total number of words in the control instructions as an object fuzzy characteristic value; determining a number of the instruction actions and determining key instruction actions; determining a ratio of the number of the key instruction actions to the number of the instruction actions as an action fuzzy characteristic value; the process of calculating instruction fuzzy representation values comprises: determining a ratio of the spatial fuzzy characteristic value to a reference spatial fuzzy characteristic value as a first fuzzy factor; determining a ratio of the object fuzzy characteristic value to a reference object fuzzy characteristic value as a second fuzzy factor; determining a ratio of the action fuzzy characteristic value to a reference action fuzzy characteristic value as a third fuzzy factor; determining a weighted sum value of the first fuzzy factor, the second fuzzy factor and the third fuzzy factor as an instruction fuzzy representation value.

2. The voice control method for a robot according to claim 1, characterized in that, the process of dividing instruction execution tendencies of the control instructions and determining instruction execution modes comprises: if the instruction fuzzy representation value is greater than an instruction fuzzy representation value threshold, the control instructions are divided into weak instruction execution tendencies, and the instruction execution mode is determined to be analysis to be executed; if the instruction fuzzy representation value is less than or equal to the instruction fuzzy representation value threshold, the control instructions are divided into strong instruction execution tendencies, and the instruction execution mode is determined to be immediate execution.

3. The voice control method for a robot according to claim 1, characterized by, the process of determining environment influence characteristic values and target influence characteristic values comprises: calculating a degree of noise of the environment based on the environment data; determining the degree of noise as an environment influence characteristic value; determining a location of a control personnel based on the user portrait, analyzing a demand relationship between the location and the control instructions; determining a demand characteristic value corresponding to the demand relationship as a target influence characteristic value.

4. The voice control method for a robot according to claim 1, characterized in that, The process of calculating the hidden execution characteristic parameter of the control instruction comprises, determining the ratio of the environmental impact characteristic value to the benchmark environmental impact characteristic value as a first hidden factor; determining the ratio of the target impact characteristic value to the benchmark target impact characteristic value as a second hidden factor; determining the ratio of the instruction ambiguity characteristic value to the benchmark instruction ambiguity characteristic value as a third hidden factor; determining the weighted sum of the first hidden factor, the second hidden factor and the third hidden factor as the hidden execution characteristic parameter.

5. The voice control method for a robot according to claim 1, characterized in that, The determination of the hidden tendency of the control instruction and the instruction execution mode comprises, if the hidden execution characteristic parameter is greater than a hidden execution characteristic parameter threshold value, determining the hidden tendency of the control instruction as a high hidden tendency and determining the instruction execution mode as an inquiry-after execution; if the hidden execution characteristic parameter is less than or equal to the hidden execution characteristic parameter threshold value, determining the hidden tendency of the control instruction as a low hidden tendency and determining the instruction execution mode as an immediate execution.

6. The voice control method for a robot according to claim 1, characterized in that, The process of calculating the control instruction feedback index comprises, analyzing the collected feedback text to determine the control instruction effectiveness; determining the control instruction effectiveness as an accuracy feedback factor; determining the ratio of the collected control instruction execution time to the benchmark time as a time feedback factor; determining the weighted sum of the accuracy feedback factor and the time feedback factor as the control instruction feedback index.

7. The voice control method for a robot according to claim 1, characterized in that, The determination of the effectiveness of the instruction execution mode comprises, if the control instruction feedback index is greater than a control instruction feedback index threshold value, determining the instruction execution mode as effective and completing the voice control; if the control instruction feedback index is less than or equal to the control instruction feedback index threshold value, determining the instruction execution mode as ineffective and dynamically modifying the execution result. 8.The voice control method for a robot according to claim 1, wherein, storing the execution result and the modified execution result to an interaction database.

Images