Multi-instruction program control method and device based on voice recognition, cleaning equipment and medium

Abstract

The invention discloses a multi-instruction program control method and device based on voice recognition, cleaning equipment and a medium, and belongs to the technical field of general control or adjustment systems. The method comprises the following steps: acquiring voice information of a user, and extracting semantic features and voiceprint features; generating a first control instruction according to the semantic feature; matching a user portrait according to the voiceprint feature to obtain a second control instruction; when the to-be-cleaned article is recognized, basic parameters of the to-be-cleaned article are obtained, and a third control instruction is generated; identifying a preset determiner in the semantic feature, and determining the priority of each control instruction; determining a comprehensive control instruction; and determining program control parameters of the cleaning equipment according to the comprehensive control instruction. According to the technical scheme, the control instructions in multiple aspects are analyzed through the semantic information, the voiceprint information and the basic parameters of the article, the control instruction meeting the actual requirements of the user can be generated, complex interaction links are not needed, the intelligent degree of the cleaning equipment is improved, and the use experience of the user is improved.

Description

Technical Field

[0001] The present application belongs to the general field of control or regulation system technology, and specifically relates to a multi-instruction program control method, device, cleaning equipment and medium based on voice recognition. Background Art

[0002] With the rapid development of science and technology, the control or adjustment system of cleaning equipment has ushered in more intelligent designs. The development of various equipment is becoming more and more intelligent and convenient, which not only simplifies user operation, but also greatly improves the cleaning efficiency of items, while reducing the cost of user training. Users can quickly determine the cleaning parameters they need through voice and other methods in many functions, and then clean the items.

[0003] However, in the process of continuous intelligent upgrading, there will also be some problems. For example, if the received instructions are not clear enough, it will be difficult to make a correct response. If multiple rounds of confirmation are used, users will feel the trouble caused by voice instructions. Therefore, it is particularly important to be able to obtain the control information required by users more accurately while developing intelligently. How to accurately control cleaning equipment is a technical problem that needs to be solved urgently by technicians in this field. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a multi-instruction program control method, device, cleaning equipment and medium based on voice recognition, with the aim of solving the problems of the need to use completely standardized language when controlling the cleaning equipment, poor semantic understanding ability and inability to accurately control unclear semantics, etc. This solution can identify a variety of control instructions, analyze various control instructions through semantic information, voiceprint information and basic parameters of the object, and then determine the final control instructions for cleaning the object in combination with the actual situation. It can select the control instructions that best meet the actual needs of the user from a variety of control instructions without the need for complex interactive links, thereby improving the intelligence of the cleaning equipment and the user experience.

[0005] In a first aspect, an embodiment of the present application provides a multi-instruction program control method based on speech recognition, the method comprising: Acquire voice information of the user, and extract semantic features and voiceprint features from the voice information; generating a first control instruction according to the semantic feature; Matching the user portrait according to the voiceprint feature, and determining the user preference according to the user portrait to obtain a second control instruction; When an object to be cleaned is identified, basic parameters of the object to be cleaned are acquired, and a third control instruction is generated according to the basic parameters; Identify whether the semantic feature includes a preset qualifier; if so, determine the priority of each control instruction according to the preset qualifier; Determine a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority; The program control parameters of the cleaning equipment are determined according to the comprehensive control instructions.

[0006] Further, determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority includes: According to the first control instruction, the second control instruction, the third control instruction and the priority, determining a comprehensive control instruction based on the control instruction with the highest priority; or, According to the first control instruction, the second control instruction, the third control instruction and the priority, instructions are merged based on the priority order of each control instruction to comprehensively determine a comprehensive control instruction.

[0007] Further, determining the priority of each control instruction according to the preset qualifier includes: Identify a target control instruction among the first control instruction, the second control instruction and the third control instruction associated with the preset qualifier; Based on the priority adjustment information included in the preset qualifier, the priority of the target control instruction is adjusted to obtain the priority of each control instruction.

[0008] Further, determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority includes: According to the first control instruction, the second control instruction, the third control instruction and the priority, determine the filling value of each parameter field in the comprehensive control instruction to fill in and obtain the comprehensive control instruction; Accordingly, the program control parameters of the cleaning equipment are determined according to the comprehensive control instructions, including: The program control parameters of the cleaning equipment are obtained by parsing the filled values ​​of each parameter field in the comprehensive control instruction.

[0009] Further, determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority includes: If there are two conflicting control instructions among the first control instruction, the second control instruction and the third control instruction, the conflicting control instruction with a lower priority is determined as an invalid control instruction, and a comprehensive control instruction is determined according to the other control instructions.

[0010] Furthermore, after determining the program control parameters of the cleaning equipment according to the comprehensive control instruction, the method further includes: Generate prompt information according to the program control parameters, and display it on the cleaning device and / or a smart terminal associated with the cleaning device; If no instruction to modify the program control parameters is received within a preset time period, or if a confirmation instruction for the program control parameters is received within a preset time period, the cleaning operation is performed according to the program control parameters.

[0011] Furthermore, the method further comprises: It is identified whether the semantic feature includes a preset qualifier; if not, the preset default priority of each control instruction is read.

[0012] In a second aspect, an embodiment of the present application provides a multi-instruction program control device based on speech recognition, the device comprising: A feature extraction module, used to obtain the user's voice information and extract semantic features and voiceprint features from the voice information; A first control instruction generating module, used for generating a first control instruction according to the semantic feature; A second control instruction generating module, used for matching the user portrait according to the voiceprint feature, and determining the user preference according to the user portrait to obtain a second control instruction; A third control instruction generating module is used to obtain basic parameters of the object to be cleaned when the object to be cleaned is identified, and generate a third control instruction according to the basic parameters; A priority determination module, used to identify whether the semantic feature includes a preset qualifier; if included, determine the priority of each control instruction according to the preset qualifier; a comprehensive control instruction determination module, configured to determine a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority; The program control parameter determination module is used to determine the program control parameters of the cleaning equipment according to the comprehensive control instructions.

[0013] In a third aspect, an embodiment of the present application provides a cleaning device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.

[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0015] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0016] In the embodiment of the present application, the user's voice information is obtained, and semantic features and voiceprint features are extracted from the voice information; a first control instruction is generated according to the semantic features; a user portrait is matched according to the voiceprint features, and the user preference is determined according to the user portrait to obtain a second control instruction; when the items to be cleaned are identified, the basic parameters of the items to be cleaned are obtained, and a third control instruction is generated according to the basic parameters; it is identified whether the semantic features include preset qualifiers; if included, the priority of each control instruction is determined according to the preset qualifier; a comprehensive control instruction is determined according to the first control instruction, the second control instruction, the third control instruction and the priority; and the program control parameters of the cleaning equipment are determined according to the comprehensive control instruction. The above technical scheme, through the identification of multiple control instructions, can analyze various control instructions through semantic information, voiceprint information and basic parameters of the items, and then determine the final control instruction for cleaning the items in combination with the actual situation, and can select the control instruction that best meets the actual needs of the user from multiple control instructions without complex interactive links, thereby improving the intelligence of the cleaning equipment and the user's experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a flowchart of a multi-instruction program control method based on speech recognition provided in Example 1 of the present application; Figure 2 It is a flowchart of a multi-instruction program control method based on speech recognition provided in Example 2 of the present application; Figure 3 It is a structural diagram of a multi-instruction program control device based on speech recognition provided in Embodiment 3 of the present application; Figure 4 It is a schematic diagram of the structure of the cleaning device provided in Example 4 of the present application. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only part of the present application is shown in the accompanying drawings, but not all of the content. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

[0019] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0020] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0021] In conjunction with the accompanying drawings, the multi-instruction program control method, device, cleaning equipment and medium based on voice recognition provided by the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0022] Embodiment 1 Figure 1 1 is a flow chart of a multi-instruction program control method based on speech recognition provided in the first embodiment of the present application. Figure 1 As shown, the specific steps include: S101, obtaining voice information of a user, and extracting semantic features and voiceprint features from the voice information; First of all, this application is applicable to industrial cleaning scenarios, or to the use scenarios of household cleaning equipment. Based on the above use scenarios, it can be understood that the execution subject of this application can be cleaning equipment. Cleaning equipment is a device used for cleaning operations, which can be equipped with sensing and control technology, such as industrial cleaning equipment, washing machines, and dishwashers.

[0023] Voice information can be the voice of the user, which is input into the system through microphones and other audio acquisition devices. Its content is wide-ranging, covering various operating instructions for cleaning equipment, such as starting cleaning, pausing, adjusting cleaning time, etc. It may also be inquiries about the status of the equipment, such as how long it will take for the equipment to finish cleaning, or special requirements for cleaning methods, such as gentle washing with cold water.

[0024] For the recognition of speech information, for example, in a noisy environment, when the intensity and frequency characteristics of speech are disturbed, noise reduction and enhancement techniques can be used to process it.

[0025] Semantic features can be the characteristic representation of the inner meaning expressed by the voice information. In the field of natural language processing, after the voice is converted into text through speech recognition technology, the text is deeply analyzed. From the vocabulary level, keywords and phrases are extracted, such as wool sweater, strong stain removal, etc. From the grammatical level, the structure and components of the sentence are analyzed to determine the subject, predicate and object relationships. From the semantic level, the overall intention and context of the text are understood. For example, please use the gentle mode to wash this easily faded clothing. The semantic features include not only the gentle mode, easy to fade and other vocabulary information, but also the overall semantics of the special requirements for washing this clothing.

[0026] Semantic features can also contain emotional information, such as the speech related to the user's satisfaction evaluation of cleaning equipment, which can be analyzed to determine whether the emotion is positive, negative or neutral. This is of great significance for understanding user needs and improving equipment services.

[0027] Voiceprint features can be the unique acoustic features of each person's voice, which are determined by the physiological structure of the vocal organs. Voiceprint features are relatively stable under different speaking content, speaking speed, and intonation, and can be used to identify the user. Voiceprint features include information such as fundamental frequency, resonance peak, and spectrum envelope. These features are extracted and processed by professional voiceprint analysis algorithms.

[0028] In this solution, the cleaning equipment is equipped with a highly sensitive microphone whose frequency response range covers the main frequency range of human speech and can accurately capture the user's voice signal. After the microphone converts the sound signal into an electrical signal, it is converted into a digital signal through an analog-to-digital converter for subsequent computer processing. In order to improve the quality of the voice signal, noise reduction technology can also be used, such as a filter-based noise reduction method, to remove background noise in the environment.

[0029] Semantic feature extraction first uses a speech recognition engine, such as a deep learning-based speech recognition model such as WaveNet, DeepSpeech, etc., to convert digital speech signals into text. Then the text is preprocessed, including removing stop words and stemming, and then natural language processing techniques are used, such as named entity recognition algorithms to identify entities in the text, part-of-speech tagging algorithms to determine the part of speech of each word, and dependency syntax analysis algorithms to analyze the grammatical relationship between words in a sentence, and finally extract key features that can represent semantics.

[0030] Voiceprint feature extraction can be specifically done by using digital signal processing technology to perform frame processing on the voice signal, dividing the continuous voice signal into short-time frames. Then, spectrum analysis is performed on each frame signal, such as Fast Fourier Transform (FFT), to convert the time domain signal into a frequency domain signal. Voiceprint feature parameters are extracted, such as Mel-Frequency Cepstral Coefficients (MFCC), which simulates the perception characteristics of the human auditory system to sound frequency and can effectively represent voiceprint features; other feature parameters such as Linear Predictive Cepstral Coefficients (LPCC) can also be extracted.

[0031] S102, generating a first control instruction according to the semantic feature; The first control instruction may be an instruction generated according to the extracted semantic features for directly controlling the operation of the cleaning device. It converts the semantics expressed by the user's voice into an operation command executable by the device, corresponding to the functional module of the cleaning device.

[0032] The instructions may include the selection of cleaning modes, such as standard mode, gentle mode and quick cleaning mode. Each mode corresponds to a different combination of cleaning parameters, such as cleaning time, speed and water consumption. It can also be the control of the equipment operating status, such as start, pause and stop, as well as the adjustment of cleaning parameters, such as increasing the water temperature and increasing the amount of detergent.

[0033] In this solution, a semantic-instruction mapping database is established within the system, which pre-stores the correspondence between various semantic features and control instructions. After the semantic features are extracted, the system searches and matches in the database. For example, if the semantic feature is to select the quick wash mode, the system will find the corresponding control instruction in the database: set the washing mode to quick wash. For some complex semantic features, reasoning and analysis can be performed through natural language understanding algorithms, and then corresponding control instructions are generated. For example, for the semantic feature "this piece of clothing is a little dirty, wash it for a while longer", the system needs to generate a control instruction to increase the washing time based on the semantic information such as "a little dirty" and "wash it for a while longer", combined with the operating rules of the cleaning equipment.

[0034] S103, matching a user portrait according to the voiceprint feature, and determining a user preference according to the user portrait to obtain a second control instruction; User portrait can be a comprehensive and systematic description of users, which is constructed by collecting and analyzing various information about users. It is an abstract model that reflects the personalized characteristics and behavioral habits of users.

[0035] User portraits can include basic information about users, such as age, gender, region, and occupation, which can be obtained from the information filled out when users register or from data collected during the use of the equipment. User portraits can also include information about users' usage habits, such as the frequency of using cleaning equipment, common cleaning modes, preferred water temperature range, and favorite detergent brands, as well as information about users' consumption behavior, such as the price range of cleaning equipment purchased, whether they have purchased related value-added services, etc. User feedback can also be included, such as evaluation of cleaning equipment and suggestions for improvement.

[0036] User preferences can be the personal preferences and tendencies that users show when using cleaning equipment, and are an important part of user portraits.

[0037] User preference information may include preferences for cleaning modes, for example, some users like to use energy-saving mode to save water and electricity; preferences for water temperature, some users believe that 40 degrees Celsius is the best for cleaning; preferences for detergents, such as a certain brand of detergent or a specific type, such as phosphorus-free or natural ingredient detergents; and preferences for cleaning time, such as starting to clean before going to bed at night so that the clothes can be dried directly the next morning.

[0038] The second control instruction may be an instruction to control the cleaning device generated based on the user preferences determined by the user profile, aiming to meet the user's personalized needs. The instruction content of the second control instruction may be to set parameters such as the cleaning mode, water temperature, and detergent dosage according to the user's preferences, or to adjust the running time of the device according to the user's usage habits, such as automatically starting the cleaning program during the user's frequently used time period, or to recommend additional cleaning functions that the user may like, such as softener addition, sterilization mode, etc.

[0039] In this solution, the system can store multiple user portraits and their corresponding voiceprint feature templates. After obtaining the user's voiceprint features, voiceprint matching algorithms such as Dynamic Time Warping (DTW), Gaussian Mixture Model-General Background Model, etc. are used to compare the user's voiceprint features with the voiceprint feature templates in the database one by one. The similarity score between the user's voiceprint features and each template is calculated. The higher the similarity score, the higher the matching degree. By setting a similarity threshold, when the score exceeds the threshold, it is considered that a matching user portrait is found. After matching the user portrait in this solution, the system extracts user preference information related to the operation of cleaning equipment from the user portrait database. Through data analysis and screening algorithms, a large amount of information in the user portrait is processed, information irrelevant to the current cleaning task is removed, and key user preference information is retained. For example, when a user wants to wash clothes, the focus is on extracting preference information related to clothing washing, such as washing mode, water temperature preference, etc.

[0040] S104, when an object to be cleaned is identified, basic parameters of the object to be cleaned are acquired, and a third control instruction is generated according to the basic parameters; The items to be cleaned are objects that need to be cleaned in the cleaning equipment. There are many types of items, including but not limited to industrial equipment, such as product parts, wafers to be processed, etc. They can also be daily necessities, such as clothing, tableware, fruits and vegetables, and household items.

[0041] The information of the items to be cleaned may include material information, such as the material of the clothes may be cotton, wool or silk, etc. Different materials have different requirements for cleaning methods and parameters. Stain information, such as the type of stain, such as oil stains, ink stains and sweat stains, as well as the severity of the stain, shape and size information, such as large curtains require a larger cleaning space and special cleaning procedures, while small tableware can be cleaned in different ways, and weight information of the items to be cleaned.

[0042] The third control instruction may be an instruction for controlling the operation of the cleaning device generated according to basic parameters of the objects to be cleaned, so as to enable the cleaning device to perform appropriate cleaning operations on different objects to be cleaned.

[0043] The third control instruction may include selecting a suitable cleaning mode, such as selecting a gentle mode for woolen clothes, adjusting the cleaning time, and determining the cleaning time based on factors such as the degree of stains and the weight of the items; setting the water temperature, selecting a lower water temperature for some materials that are not resistant to high temperatures, and controlling the amount of detergent used, automatically adjusting the amount of detergent according to the weight of the items and the degree of stains.

[0044] In this solution, the cleaning equipment can be equipped with a variety of sensors to identify the items to be cleaned. For example, an image sensor can capture images of the items to be cleaned, and computer vision technology can be used for image recognition to identify information such as the type, shape, and size of the items. A weight sensor can measure the weight of the items to be cleaned. In addition, material sensors, such as near-infrared spectrum sensors, can be used to detect the material composition of the items, and the material can be determined by analyzing the absorption and reflection characteristics of the items to light of different wavelengths.

[0045] In the process of identifying the items to be cleaned, the corresponding sensors convert the detected information into digital signals and transmit them to the control system of the equipment. The control system processes and analyzes these signals to extract the basic parameters of the items to be cleaned. For example, the image captured by the image sensor is processed by the image recognition algorithm to obtain information such as the type and size of the item; the signal of the weight sensor is processed by amplification, filtering, etc. to obtain the weight parameters of the item.

[0046] S105, identifying whether the semantic feature includes a preset qualifier; if included, determining the priority of each control instruction according to the preset qualifier; Among them, semantic features are features extracted from user voice information that can reflect the meaning of the voice. It contains information such as the operation intention and demand expressed by the voice. For example, the semantic features of selecting the strong cleaning mode include the key information of the strong cleaning mode, which is used to convey the user's specific requirements for the cleaning mode.

[0047] Preset qualifiers are words or phrases with special meanings that are pre-set during the system design phase. These qualifiers are used to limit the execution method and importance of control instructions. For example, "clean it thoroughly this time" emphasizes the preset qualifier "this time", which means that the first control instruction is particularly important in this cleaning task, and the priority of the second control instruction determined based on user preferences should be lowered. Another example: "same as every time" emphasizes the preset qualifier "every time", which means that the second control instruction is particularly important in this cleaning task and its priority should be increased.

[0048] In this solution, priority indicates the order and importance of each control instruction during execution. Instructions with high priority will be executed by the system first to ensure that the equipment operates according to the user's main needs and expectations. When the semantic features contain preset qualifiers, the system will adjust the priority of each control instruction according to the preset rules and logic. Different preset qualifiers correspond to different priority adjustment strategies. This solution can adjust the priority to ensure that the operation of the cleaning equipment meets the actual needs of the user.

[0049] In this solution, optionally, the method further includes: It is identified whether the semantic feature includes a preset qualifier; if not, the preset default priority of each control instruction is read.

[0050] Wherein, when the semantic feature does not include the preset qualifier, the comprehensive control instruction can be generated according to the preset default priority, for example, the priority of the first control instruction is preset to be greater than the priority of the second control instruction, and the priority of the second control instruction is preset to be greater than the priority of the third control instruction.

[0051] S106, determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority; Priority can be a ranking of the importance of the first control instruction, the second control instruction, and the third control instruction, which is used to determine which instructions the system should execute first when multiple instructions exist at the same time, so as to ensure the reasonable operation of the cleaning equipment and meet user needs. Priority setting can be based on a variety of factors, such as the urgency of the instruction, the user's operating intention, and the degree of influence of the instruction on the cleaning effect. Different cleaning equipment or usage scenarios may have different priority setting rules.

[0052] The comprehensive control instruction may be the final control instruction obtained by integrating and processing the first control instruction, the second control instruction and the third control instruction according to the priority, which comprehensively considers the user's voice operation, personalized preferences and the characteristics of the items to be cleaned, and is used to comprehensively control the operation of the cleaning equipment. The comprehensive control instruction may include operating instructions for each functional module of the cleaning equipment, such as the selection of the cleaning mode, the setting of the water temperature, the adjustment of the cleaning time, the addition of detergent and the control of the equipment operation status. It is a complete set of instructions to ensure that the cleaning equipment can operate in the optimal way.

[0053] In one scenario, the first control instruction, the second control instruction, and the third control instruction can be evaluated according to preset priority rules. These rules can be based on logical judgment, such as instructions related to device safety have the highest priority, or can be based on user settings, where users can customize the priority of certain instructions. Each instruction is analyzed to determine the priority category it belongs to, and then the instructions are sorted in order from high to low priority, high-priority instructions are retained, low-priority instructions are removed or modified, and comprehensive control instructions are generated.

[0054] S107, determining program control parameters of the cleaning equipment according to the comprehensive control instruction.

[0055] Program control parameters can be specific parameter values ​​used to control the running program of the cleaning equipment. These parameters directly affect the working state and cleaning effect of the cleaning equipment. Program control parameters may include cleaning mode parameters, water temperature parameters, cleaning time parameters, detergent dosage parameters, spin speed parameters, and rinse times parameters.

[0056] In this solution, after obtaining the comprehensive control instruction, the comprehensive control instruction can be parsed to extract the operation requirements. Then, according to the correspondence between the program control parameters of the cleaning equipment and the operation requirements, the operation requirements are converted into specific program control parameter values. For example, if the comprehensive control instruction is "select the gentle mode, set the water temperature to 30 degrees, and the cleaning time is 40 minutes", the system will convert the gentle mode into the corresponding mode identifier, convert 30 degrees into the water temperature parameter value 30, and convert 40 minutes into the cleaning time parameter value 40. For some complex instructions, further calculations and conversions can be performed, such as calculating the specific detergent dosage parameter value based on the relationship between the detergent dosage and the weight and degree of stains of the item. Finally, a complete set of program control parameters is determined to control the operation of the cleaning equipment.

[0057] The technical solution provided in this embodiment obtains the user's voice information, extracts semantic features and voiceprint features from the voice information; generates a first control instruction based on the semantic features; matches the user portrait based on the voiceprint features, determines the user preference based on the user portrait, and obtains a second control instruction; when identifying the items to be cleaned, obtains the basic parameters of the items to be cleaned, and generates a third control instruction based on the basic parameters; determines a comprehensive control instruction based on the first control instruction, the second control instruction, the third control instruction, and the priority; determines the program control parameters of the cleaning equipment based on the comprehensive control instruction. The above technical solution, through the recognition of multiple control instructions, can analyze various control instructions through semantic information, voiceprint information, and the basic parameters of the items, and then determine the final control instruction for cleaning the items in combination with the actual situation, and can select the control instruction that best meets the actual needs of the user from among the multiple control instructions without complex interactive links, thereby improving the intelligence of the cleaning equipment and the user's experience.

[0058] In one embodiment, optionally, determining the priority of each control instruction according to the preset qualifier includes: Identify a target control instruction among the first control instruction, the second control instruction and the third control instruction associated with the preset qualifier; Based on the priority adjustment information included in the preset qualifier, the priority of the target control instruction is adjusted to obtain the priority of each control instruction.

[0059] The priority adjustment information may be related information contained in a preset qualifier for indicating the adjustment of the priority of the target control instruction. It may clearly specify the increase or decrease of the priority of the target control instruction, or provide rules and strategies for priority adjustment.

[0060] Natural language processing and data analysis techniques can be used to deeply understand the semantics of the preset qualifiers, and match and analyze them with the contents of the first control instruction, the second control instruction, and the third control instruction. For example, after receiving the voice message "still wash as before", the keyword matching algorithm can be used to determine the target control instruction and the priority adjustment method for the target control instruction. For example, the "as before" here can determine that its associated target control instruction is the second control instruction. Then, if the second control instruction is recognized, the priority of the second control instruction can be increased to be the control instruction with the highest priority.

[0061] After determining the target control instruction, the priority of the target control instruction can be changed accordingly according to the priority adjustment information. If the priority adjustment information indicates to increase the priority of the target control instruction, it can be advanced in the priority sorting; if it is to reduce the priority, it will be moved back in the sorting. By adjusting the priority of the target control instruction, the priority order of each control instruction can be determined. This priority order will be used to determine the execution order of each control instruction when the cleaning equipment performs subsequent operations, so that the equipment can operate efficiently according to the user's intentions and needs.

[0062] This technical solution makes the control instruction priority setting of the cleaning equipment more flexible and intelligent by identifying the target control instruction associated with the preset qualifier and accurately adjusting the priority of the target control instruction based on the priority adjustment information of the preset qualifier.

[0063] In one embodiment, optionally, determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority includes: According to the first control instruction, the second control instruction, the third control instruction and the priority, determining a comprehensive control instruction based on the control instruction with the highest priority; or, According to the first control instruction, the second control instruction, the third control instruction and the priority, instructions are merged based on the priority order of each control instruction to comprehensively determine a comprehensive control instruction.

[0064] Among them, the default priority order can be a pre-set order in the control system of the cleaning device, regarding the order of importance of the first control instruction, the second control instruction, and the third control instruction. This order is part of the initial configuration of the system and can be determined based on factors such as the design concept of the device, common usage scenarios, and user needs. For example, the first control instruction operated by the user immediately has the highest priority, the second control instruction based on user preference has a middle priority, and the third control instruction generated based on the basic parameters of the items to be cleaned has the lowest priority. Other settings are also possible.

[0065] In one scenario, after the first control instruction, the second control instruction, and the third control instruction are identified, they can be compared according to the default priority order, and the comprehensive control instruction can be constructed based on the control instruction with the highest priority. That is, the content of the control instruction is directly used as the main part of the comprehensive control instruction, and other control instructions with lower priorities do not participate in the generation of the comprehensive control instruction in this case. For example, if the first control instruction has the highest priority and its content is "set the strong cleaning mode", then the comprehensive control instruction will include the key operation instruction of setting the strong cleaning mode, and other lower priority instructions will be ignored if they are not related to it.

[0066] In another scenario, the system first sorts the first control instruction, the second control instruction, and the third control instruction according to the default priority order. Then, the comprehensive control instruction is generated by comprehensively considering the specific content and priority relationship of each control instruction. If there is no conflict between instructions of different priorities, for example, a high-priority instruction sets the cleaning mode and a low-priority instruction sets the amount of detergent, and the two do not conflict, then their valid information is integrated into the comprehensive control instruction. If there are conflicting instructions, such as a high-priority instruction requiring low-temperature cleaning and a low-priority instruction requiring high-temperature cleaning, the content of the high-priority instruction is retained in order of priority, and the content of the low-priority instruction is discarded or modified. In this way, the system integrates the reasonable parts of each control instruction to form a final comprehensive control instruction to ensure that the cleaning equipment can operate reasonably and effectively based on various factors.

[0067] This technical solution determines the comprehensive control instructions based on the priority of the control instructions in different ways, making the control of the cleaning equipment more intelligent. By setting the default priority order, the main control strategy can be quickly determined under normal circumstances to give priority to important operational requirements, such as ensuring equipment safety or giving priority to executing the user's immediate operational instructions. By merging instructions based on the priority order of each control instruction to comprehensively determine the comprehensive control instruction, various factors can be considered more comprehensively, and the information contained in different control instructions can be fully utilized. When there is no conflict between the instructions, the integration of multiple needs can be achieved, thereby improving the adaptability and user experience of the cleaning equipment. At the same time, the way of handling conflicting instructions ensures the rationality and stability of the equipment operation, avoids abnormal equipment operation due to conflicting instructions, and thus improves the overall performance and reliability of the cleaning equipment.

[0068] In one embodiment, optionally, determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority includes: If there are two conflicting control instructions among the first control instruction, the second control instruction and the third control instruction, the conflicting control instruction with a lower priority is determined as an invalid control instruction, and a comprehensive control instruction is determined according to the other control instructions.

[0069] Conflicting control instructions may be situations where two or more instructions in the first control instruction, the second control instruction, and the third control instruction are contradictory or cannot be executed at the same time. These instructions are called conflicting control instructions. For example, one instruction requires setting the water temperature to 60°C, while another instruction requires setting the water temperature to 30°C. These two instructions on water temperature setting are conflicting control instructions.

[0070] An invalid control instruction may be an instruction that is not adopted and executed by the system due to a lower priority among conflicting control instructions. Once determined to be an invalid control instruction, the operation content contained in the instruction will not affect the operation of the cleaning device.

[0071] In this scheme, the first control instruction, the second control instruction and the third control instruction are first analyzed and compared one by one to determine whether there are conflicts between them. Through the preset conflict detection algorithm, check whether the parameter settings and operation requirements of the instructions are contradictory. During the analysis process, if it is found that the operation requirements between two or more control instructions cannot be met at the same time, that is, there is a conflict, then the priorities of these conflicting control instructions are further compared. According to the priority level, the conflicting control instruction with low priority is marked as an invalid control instruction, which means that the instruction will not be executed, and the operation content contained in it will not have an effect on the operation of the cleaning equipment. After excluding the invalid control instructions, the system integrates the remaining valid control instructions. The parameter settings and operation requirements for the operation of the cleaning equipment in these valid control instructions are summarized and sorted out, and the repeated and redundant parts are removed to form a complete and unified comprehensive control instruction. For example, the setting information of parameters such as cleaning mode, water temperature, and detergent dosage in the valid instructions is sorted out to determine the final comprehensive control instruction to ensure that the cleaning equipment can operate according to reasonable parameters and operation requirements.

[0072] This technical solution effectively solves the possible contradictions between multiple control instructions by judging the priority and handling conflicts of control instructions from different sources. When there are conflicting control instructions, the instructions with low priority are determined to be invalid, ensuring that the system can give priority to executing more important operation instructions, thereby improving the stability of the operation of the cleaning equipment. By integrating effective control instructions to determine comprehensive control instructions, the cleaning equipment can perform comprehensive and reasonable operation parameter settings and operation control according to the user's voice operation intentions, personalized preferences, and the characteristics of the items to be cleaned. This intelligent control method not only improves the operating convenience and user experience of the cleaning equipment, but also can flexibly adjust the cleaning strategy according to different situations to improve the cleaning effect. At the same time, it avoids equipment operation abnormalities or errors caused by command conflicts and enhances the overall performance of the cleaning equipment.

[0073] In one embodiment, optionally, after determining the program control parameters of the cleaning equipment according to the comprehensive control instruction, the method further includes: Generate prompt information according to the program control parameters, and display it on the cleaning device and / or a smart terminal associated with the cleaning device; If no instruction to modify the program control parameters is received within a preset time period, or if a confirmation instruction for the program control parameters is received within a preset time period, the cleaning operation is performed according to the program control parameters.

[0074] The prompt information can be generated according to the program control parameters, and is used to convey to the user the operation information that the cleaning device is about to perform and the information of the relevant parameter settings. It can be in text form, such as: about to clean in standard mode, water temperature 40°C, cleaning time 30 minutes, detergent has been added 100 ml, or in other forms such as charts or graphics to intuitively display the parameter settings.

[0075] The above information can be displayed on the display screen of the cleaning equipment, such as industrial cleaning equipment, washing machines, dishwashers, fruit and vegetable washing machines and other types of machines and equipment that can realize the function of cleaning items.

[0076] Smart terminals can be devices with intelligent processing capabilities associated with cleaning equipment, such as smart phones, tablet computers, and smart watches. These devices can be connected to cleaning equipment through wireless communication technologies such as Wi-Fi and Bluetooth to achieve functions such as remote control of the equipment, status monitoring, and receiving information sent by the equipment.

[0077] The control system of the cleaning equipment or the software system related thereto creates prompt information according to the determined program control parameters and the preset information generation rules and formats. For example, the values ​​of each parameter are organized into a text description according to a certain logic, or the parameters are presented in the form of a chart. Specifically, it can be displayed on the display screen of the cleaning equipment, and / or sent to the smart terminal associated with the cleaning equipment via wireless communication and displayed on the screen of the smart terminal. When displayed on the cleaning equipment, the information may need to be adapted to the size and resolution of the device display screen. When displayed on the smart terminal, it may be displayed according to the interface design of the terminal application.

[0078] The preset duration may be a time length pre-set in the system and used as a time standard for determining whether to perform a cleaning operation. This duration may be set according to actual needs, such as 1 minute, 30 seconds, etc.

[0079] The modification instruction may be an instruction sent by the user through the operation panel of the cleaning device or the intelligent terminal associated therewith, which is used to change the determined program control parameters. For example, the user feels that the currently set water temperature is too high, and sends an instruction to lower the water temperature.

[0080] The confirmation instruction may be sent by the user through the operation panel of the cleaning device or the intelligent terminal associated therewith, and is used to confirm the displayed program control parameters and agree to perform the cleaning operation according to these parameters.

[0081] In this solution, the control system of the cleaning device or the receiving module of the associated smart terminal can receive the instructions sent by the user through the corresponding communication interface, including modification instructions and confirmation instructions. The system will parse and verify the received instructions to ensure the validity of the instructions.

[0082] After the prompt message is displayed, the timing can be started to detect whether a modification instruction or a confirmation instruction is received. If no modification instruction is received at the end of the preset time, it means that the user may approve the current program control parameter setting. If a confirmation instruction is received within the preset time, it directly indicates that the user agrees to perform the cleaning operation according to the current parameters.

[0083] After determining the program control parameters of the cleaning equipment, this technical solution generates and displays prompt information, allowing the user to clearly understand the operation and parameter settings that the equipment is about to perform, thereby increasing the transparency of the operation and the user's right to know. At the same time, a preset time is set to determine the user's intention. If the user does not modify the parameters or directly confirm the parameters within the specified time, the cleaning operation is automatically performed, realizing the automation and convenience of the operation. This not only reduces the user's operating steps and improves the efficiency of use, but also avoids the situation where the equipment cannot operate normally due to the user forgetting or not confirming in time. In addition, prompt information can also be received and displayed through the smart terminal, so that the user can understand the status of the equipment when away from the equipment, enhancing the intelligence of the equipment and the user experience.

[0084] Embodiment 2 Figure 2 It is a flow chart of the multi-instruction program control method based on voice recognition provided in the second embodiment of the present application. This scheme makes a better improvement on the above embodiment, and the specific improvement is: according to the first control instruction, the second control instruction, the third control instruction and the priority, the comprehensive control instruction is determined, including: according to the first control instruction, the second control instruction, the third control instruction and the priority, the filling value of each parameter field in the comprehensive control instruction is determined to fill in the comprehensive control instruction; correspondingly, the program control parameters of the cleaning equipment are determined according to the comprehensive control instruction, including: according to the filling value of each parameter field in the comprehensive control instruction, the program control parameters of the cleaning equipment are obtained. Figure 2 As shown, the specific steps include: S201, obtaining voice information of a user, and extracting semantic features and voiceprint features from the voice information; S202, generating a first control instruction according to the semantic feature; S203, matching the user portrait according to the voiceprint feature, and determining the user preference according to the user portrait to obtain a second control instruction; S204, when an object to be cleaned is identified, basic parameters of the object to be cleaned are acquired, and a third control instruction is generated according to the basic parameters; S205, identifying whether the semantic feature includes a preset qualifier; if included, determining the priority of each control instruction according to the preset qualifier; S206, determining the filling value of each parameter field in the comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority, so as to fill in the filling value to obtain the comprehensive control instruction; The parameter field may be a control instruction of a cleaning device. It usually contains multiple parameters of different aspects. In order to facilitate management and processing, these parameters are divided into different fields according to their functions or properties. For example, the cleaning mode parameter can be used as a field, the water temperature parameter can be used as another field, and the detergent dosage parameter can be used as another field. Each parameter field corresponds to a specific setting of the cleaning device during operation.

[0085] The filled value may be a specific value or status information determined for each parameter field. For example, in the washing mode parameter field, the filled value may be standard mode, gentle mode, and strong mode, etc. In the water temperature parameter field, the filled value may be a specific temperature value, such as 30°C, 40°C, etc. In the detergent dosage parameter field, the filled value may be a specific dosage value such as 100 ml, 150 ml, etc.

[0086] The comprehensive control instruction may be an instruction set that integrates the first control instruction, the second control instruction, and the third control instruction related information and is used to comprehensively control the operation of the cleaning equipment. It includes multiple parameter fields and their corresponding filled values, which determine the specific operation mode and parameter settings of the cleaning equipment during operation.

[0087] In this scheme, the priorities of the first control instruction, the second control instruction, and the third control instruction are first evaluated and compared. Then, according to the order of priority, the parameter information contained in each control instruction is analyzed in turn. For each parameter field, the corresponding parameter filling value in the high-priority control instruction is preferentially adopted. If a parameter field is not involved in the high-priority control instruction, the control instruction with a lower priority is checked until the filling value of each parameter field is determined. For example, if the first control instruction has the highest priority and contains the setting of the cleaning mode as the strong mode, then the filling value of the cleaning mode parameter field in the comprehensive control instruction is determined to be the strong mode. If there is no setting about the amount of detergent in the first control instruction, and there is a relevant setting in the second control instruction, and the second control instruction has the second highest priority, the filling value of the detergent amount in the second control instruction is adopted. In this way, the filling value of each parameter field in the comprehensive control instruction is determined.

[0088] S207, analyzing the filled values ​​of each parameter field in the comprehensive control instruction to obtain program control parameters of the cleaning equipment.

[0089] Program control parameters refer to various specific parameters involved in the operation program of the cleaning equipment, which directly determine the working state and cleaning effect of the cleaning equipment, including but not limited to parameters such as cleaning mode, water temperature, cleaning time, detergent dosage, spin speed, and rinse times.

[0090] The technical solution provided in this embodiment realizes the refined and intelligent control of the cleaning equipment by determining the fill-in value of the parameter field in the comprehensive control instruction according to the priority of the control instruction, and further parsing these fill-in values ​​to obtain the program control parameters of the cleaning equipment. The clear priority judgment and parameter fill-in value determination method enable the system to reasonably integrate information when multiple control instructions exist at the same time, give priority to meeting important operational requirements, and avoid problems caused by instruction conflicts. The accurate parsing of the comprehensive control instruction ensures that the equipment can operate according to the expected parameter settings, improving the operating efficiency and cleaning effect of the cleaning equipment. This method not only improves the user experience, making the user's operating intentions more consistent with the operation of the equipment, but also enhances the adaptability of the equipment, and can cope with the diverse needs of different users and the characteristics of different items to be cleaned, thereby improving the overall performance and reliability of the cleaning equipment.

[0091] Embodiment 3 Figure 3 Schematic diagram of the structure of a multi-instruction program control device based on speech recognition provided in the third embodiment of the present application. Figure 3 As shown, the device comprises: The feature extraction module 301 is used to obtain the user's voice information and extract semantic features and voiceprint features from the voice information; A first control instruction generating module 302, configured to generate a first control instruction according to the semantic feature; A second control instruction generating module 303 is used to match the user portrait according to the voiceprint feature, determine the user preference according to the user portrait, and obtain a second control instruction; The third control instruction generating module 304 is used to obtain basic parameters of the object to be cleaned when the object to be cleaned is identified, and generate a third control instruction according to the basic parameters; A priority determination module 305, for identifying whether the semantic feature includes a preset qualifier; if so, determining the priority of each control instruction according to the preset qualifier; A comprehensive control instruction determination module 306, configured to determine a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority; The program control parameter determination module 307 is used to determine the program control parameters of the cleaning equipment according to the comprehensive control instructions.

[0092] In an embodiment of the present application, a feature extraction module is used to obtain the user's voice information and extract semantic features and voiceprint features from the voice information; a first control instruction generation module is used to generate a first control instruction based on the semantic features; a second control instruction generation module is used to match the user portrait based on the voiceprint features, and determine the user preference based on the user portrait to obtain a second control instruction; a third control instruction generation module is used to obtain the basic parameters of the items to be cleaned when the items to be cleaned are identified, and generate a third control instruction based on the basic parameters; a priority determination module is used to identify whether the semantic features include preset qualifiers; if included, determine the priority of each control instruction based on the preset qualifier; a comprehensive control instruction determination module is used to determine the comprehensive control instruction based on the first control instruction, the second control instruction, the third control instruction and the priority; a program control parameter determination module is used to determine the program control parameters of the cleaning equipment based on the comprehensive control instruction. The above technical scheme, through the recognition of multiple control instructions, can analyze various control instructions through semantic information, voiceprint information and basic parameters of the object, and then determine the final control instructions for cleaning the object based on the actual situation. It can select the control instructions that best meet the actual needs of the user from a variety of control instructions without the need for complicated interactive links, thereby improving the intelligence of the cleaning equipment and enhancing the user experience.

[0093] The multi-instruction program control device based on speech recognition in the embodiment of the present application can be a device, or a component, an integrated circuit, or a chip in a terminal. The device can be the cleaning equipment itself, or a mobile electronic device that controls the cleaning equipment, or a non-mobile electronic device. Exemplary, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device can be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.

[0094] The multi-instruction program control device based on voice recognition in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0095] The multi-instruction program control device based on voice recognition provided in the embodiment of the present application can implement the various processes implemented in the above-mentioned embodiments one to four, and will not be described again here to avoid repetition.

[0096] Embodiment 4 like Figure 4 As shown, the embodiment of the present application also provides a cleaning device 400, including a processor 401, a memory 402, and a program or instruction stored in the memory 402 and executable on the processor 401. When the program or instruction is executed by the processor 401, each process of the above-mentioned multi-instruction program control method embodiment based on voice recognition is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0097] It should be noted that the cleaning device in the embodiment of the present application may include the mobile electronic device and the non-mobile electronic device mentioned above.

[0098] Embodiment 5 An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned multi-instruction program control method embodiment based on speech recognition are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0099] The processor is the processor in the cleaning device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0100] Embodiment 6 An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned multi-instruction program control method embodiment based on voice recognition, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0101] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0102] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0103] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0104] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

[0105] The above are only preferred embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not deviate from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.

Claims

1. A multi-instruction program control method based on voice recognition, characterized in that: The method comprises: Acquire voice information of the user, and extract semantic features and voiceprint features from the voice information; generating a first control instruction according to the semantic feature; Matching the user portrait according to the voiceprint feature, and determining the user preference according to the user portrait to obtain a second control instruction; When an object to be cleaned is identified, basic parameters of the object to be cleaned are acquired, and a third control instruction is generated according to the basic parameters; Identify whether the semantic feature includes a preset qualifier; if so, determine the priority of each control instruction according to the preset qualifier; Determine a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority; The program control parameters of the cleaning equipment are determined according to the comprehensive control instructions.

2. The multi-instruction program control method based on voice recognition according to claim 1, characterized in that: Determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority includes: According to the first control instruction, the second control instruction, the third control instruction and the priority, determining a comprehensive control instruction based on the control instruction with the highest priority; or, According to the first control instruction, the second control instruction, the third control instruction and the priority, instructions are merged based on the priority order of each control instruction to comprehensively determine a comprehensive control instruction.

3. The multi-instruction program control method based on voice recognition according to claim 1, characterized in that: Determining the priority of each control instruction according to the preset qualifier includes: Identify a target control instruction among the first control instruction, the second control instruction and the third control instruction associated with the preset qualifier; Based on the priority adjustment information included in the preset qualifier, the priority of the target control instruction is adjusted to obtain the priority of each control instruction.

4. The multi-instruction program control method based on voice recognition according to claim 1, characterized in that: Determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority includes: According to the first control instruction, the second control instruction, the third control instruction and the priority, determine the filling value of each parameter field in the comprehensive control instruction to fill in and obtain the comprehensive control instruction; Accordingly, the program control parameters of the cleaning equipment are determined according to the comprehensive control instructions, including: The program control parameters of the cleaning equipment are obtained by parsing the filled values ​​of each parameter field in the comprehensive control instruction.

5. The multi-instruction program control method based on voice recognition according to claim 1, characterized in that: Determining a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority includes: If there are two conflicting control instructions among the first control instruction, the second control instruction and the third control instruction, the conflicting control instruction with a lower priority is determined as an invalid control instruction, and a comprehensive control instruction is determined according to the other control instructions.

6. The multi-instruction program control method based on voice recognition according to claim 1, characterized in that: After determining the program control parameters of the cleaning equipment according to the comprehensive control instruction, the method further includes: Generate prompt information according to the program control parameters, and display it on the cleaning device and / or a smart terminal associated with the cleaning device; If no instruction to modify the program control parameters is received within a preset time period, or if a confirmation instruction for the program control parameters is received within a preset time period, the cleaning operation is performed according to the program control parameters.

7. The multi-instruction program control method based on voice recognition according to claim 1, characterized in that: The method further comprises: It is identified whether the semantic feature includes a preset qualifier; if not, the preset default priority of each control instruction is read.

8. A multi-instruction program control device based on voice recognition, characterized in that: The device comprises: A feature extraction module, used to obtain the user's voice information and extract semantic features and voiceprint features from the voice information; A first control instruction generating module, used for generating a first control instruction according to the semantic feature; A second control instruction generating module, used for matching the user portrait according to the voiceprint feature, and determining the user preference according to the user portrait to obtain a second control instruction; A third control instruction generating module is used to obtain basic parameters of the object to be cleaned when the object to be cleaned is identified, and generate a third control instruction according to the basic parameters; A priority determination module, used to identify whether the semantic feature includes a preset qualifier; if included, determine the priority of each control instruction according to the preset qualifier; a comprehensive control instruction determination module, configured to determine a comprehensive control instruction according to the first control instruction, the second control instruction, the third control instruction and the priority; The program control parameter determination module is used to determine the program control parameters of the cleaning equipment according to the comprehensive control instructions.

9. A cleaning device, characterized in that: It includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor. When the program or instruction is executed by the processor, the steps of the multi-instruction program control method based on speech recognition as described in any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores programs or instructions, and when the programs or instructions are executed by the processor, the steps of the multi-instruction program control method based on speech recognition as described in any one of claims 1 to 7 are implemented.

Images