Household appliance control method and device and electronic equipment

Abstract

The embodiment of the invention belongs to the technical field of household appliances, and provides a household appliance control method and device and electronic equipment, and the method comprises the steps: obtaining the demand information of a user; according to the demand information of the user, a control instruction is sent to at least one household appliance, and the control instruction comprises target demand information corresponding to the household appliance, so that the household appliance generates a control strategy according to the target demand information; receiving at least one control strategy sent by the at least one household appliance, and performing feasibility verification on the at least one control strategy; and when the feasibility verification of the at least one control strategy is passed, sending verification passing information to the household appliance, so that the household appliance operates according to the control strategy. In this way, the at least one household appliance is controlled according to the requirements of the user, and the user experience can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of home appliance technology, and more specifically, to a home appliance control method, device, and electronic device. Background Art

[0002] As home appliances become smarter, users can control them through voice, for example, turning on or off lights.

[0003] Currently, users can control a home appliance in a targeted manner, and the control method is relatively simple, resulting in a poor user experience. Summary of the Invention

[0004] The embodiments of the present application provide a home appliance control method, device, and electronic device, which can accurately control at least one home appliance and improve user experience.

[0005] In a first aspect, an embodiment of the present application provides a method for controlling a household appliance, comprising:

[0006] Obtain user demand information;

[0007] Sending a control instruction to at least one home appliance according to user demand information, wherein the control instruction includes target demand information corresponding to the home appliance, so that the home appliance generates a control strategy according to the target demand information;

[0008] receiving at least one control strategy sent by the at least one household appliance, and performing feasibility verification on the at least one control strategy;

[0009] When the feasibility verification of the at least one control strategy is passed, verification pass information is sent to the home appliance, so that the home appliance operates according to the control strategy.

[0010] In this application, at least one home appliance that needs to be controlled is determined based on user needs. By sending control instructions to the at least one home appliance, each home appliance generates its own control strategy. The feasibility of each control strategy generated by each home appliance can be further verified. Only when the control strategy of each home appliance is determined to be feasible is the home appliance controlled to execute the control strategy. This increases the accuracy of the control strategy determined, enables control of at least one home appliance based on user needs, simplifies the process of user interaction with home appliances, and improves the user experience.

[0011] In some embodiments of the present application, sending a control instruction to at least one home appliance according to user demand information includes:

[0012] Obtain environmental information and user preference information;

[0013] According to the environment information and the user preference information, the demand information is split to obtain at least one target demand information;

[0014] A home appliance device corresponding to the target demand information is determined, and a control instruction corresponding to the home appliance device is generated;

[0015] The control instruction is sent to at least one home appliance device.

[0016] In the present application, at least one home appliance device is determined according to environment information, user preference information and user demand information, so that the determined home appliance device is more in line with the user's demand and has higher accuracy.

[0017] In some embodiments of the present application, the feasibility verification of the at least one control strategy comprises:

[0018] Constraint information between at least one home appliance device is obtained;

[0019] The feasibility of the at least one control strategy is verified according to the constraint information and the user preference information;

[0020] When the at least one control strategy meets the constraint information and the user preference information, it is determined that the at least one control strategy passes the feasibility verification.

[0021] In the present application, the feasibility of at least one control strategy is verified by constraint information and user preference information, so that the control strategy after the feasibility verification is more in line with the user's requirements and can improve the user experience.

[0022] In some embodiments of the present application, the method further comprises:

[0023] When there is a first control strategy in the at least one control strategy that does not meet the constraint information and / or the user preference information, the first control strategy in the at least one control strategy is adjusted according to the constraint information and the user preference information to obtain updated at least one control strategy.

[0024] In the present application, the control strategy that does not meet the constraint information and the user preference information is updated according to the constraint information and the user preference information, so that the updated control strategy meets the constraint information and the user preference information. The subsequent home appliance device is more in line with the user's demand, and the user experience is improved.

[0025] In some embodiments of the present application, the feasibility verification of the at least one control strategy comprises:

[0026] outputting the at least one control strategy to confirm whether the at least one control strategy meets the demand of the user;

[0027] if information that the user is satisfied with the at least one control strategy is received, determining that the at least one control strategy passes the feasibility verification.

[0028] In the present application, whether the at least one control strategy passes the feasibility verification is determined by inquiring whether the user is satisfied, so that the at least one control strategy that passes the feasibility verification is the control strategy that the user is satisfied with, and the user experience can be improved.

[0029] In some embodiments of the present application, the method further comprises:

[0030] if adjustment information of the user for the second control strategy is received, adjusting the second control strategy according to the adjustment information to obtain the at least one updated control strategy; the second control strategy is a control strategy in the at least one control strategy that does not meet the demand of the user.

[0031] In the present application, when the user is not satisfied with the second control strategy in the at least one control strategy, the second control strategy can be adjusted according to the adjustment information input by the user, so that the adjusted control strategy is a control strategy that meets the demand of the user, and the satisfaction of the user can be improved when the corresponding household appliance is controlled according to the control strategy subsequently, and the user experience can be improved.

[0032] In some embodiments of the present application, the control strategy is generated by the household appliance according to the target demand information, target preference information of the user for the household appliance and target environment information of the household appliance.

[0033] In the present application, the control strategy generated by the household appliance itself according to the demand of the user, the preference information of the user and the environment information is more in line with the demand of the user and has higher accuracy.

[0034] In some embodiments of the present application, the demand information of the user is obtained by:

[0035] The demand information of the user sent by a target household appliance in the at least one household appliance is obtained, and the demand information is information input by the user and received by the target household appliance.

[0036] In the present application, since the household appliance is in multiple positions in the home of the user, the demand information of the user is obtained by the household appliance, so that the demand information of the user can be obtained regardless of the position of the primary agent in the home, and the at least one household appliance can be controlled based on the demand information of the user, and the user experience can be improved.

[0037] In a second aspect, the present application provides a household appliance control device, comprising:

[0038] an acquisition module configured to acquire demand information of a user;

[0039] a control module configured to send a control instruction to at least one household appliance according to the demand information of the user, the control instruction comprising target demand information corresponding to the household appliance, so that the household appliance generates a control strategy according to the target demand information;

[0040] a processing module configured to receive at least one control strategy sent by the at least one household appliance and perform feasibility verification on the at least one control strategy;

[0041] The control module is further configured to send information of passing the feasibility verification to the household appliance when the feasibility verification of the at least one control strategy passes, so that the household appliance operates according to the control strategy.

[0042] In a third aspect, the present application provides an electronic device, comprising a memory and a processor.

[0043] The memory stores computer execution instructions.

[0044] The processor executes the computer execution instructions stored in the memory, so that the processor executes the method according to the first aspect and any one of the embodiments of the first aspect.

[0045] In a fourth aspect, the present application provides a computer readable storage medium, wherein the computer readable storage medium stores computer execution instructions, and the computer execution instructions are used to execute the method according to the first aspect and any one of the embodiments of the first aspect when executed by a computer.

[0046] The computer readable storage medium provided by the embodiments of the present application can execute the technical solutions in the above method embodiments, and has similar advantages, which will not be described here in detail.

[0047] In a fifth aspect, the present application provides a computer program product, comprising a computer program, and the computer program is used to execute the method according to the first aspect and any one of the embodiments of the first aspect when executed by a computer.

[0048] The computer program product provided by the embodiments of the present application can execute the technical solutions in the above method embodiments, and has similar advantages, which will not be described here in detail.

[0049] The embodiment of the present application provides a kind of household appliance control method, device and electronic equipment, comprising: obtaining the demand information of user;According to the demand information of user, at least one household appliance is sent control instruction, control instruction includes target demand information corresponding to household appliance, to make household appliance generate control strategy according to target demand information;At least one control strategy is received at least one household appliance sends, and the feasibility of at least one control strategy is verified;When the feasibility of at least one control strategy is verified, pass information is sent to household appliance, to make household appliance run according to control strategy.Such, by the control strategy of the household appliance to be controlled self-generation, make control strategy more conform to the actual situation of this household appliance, and by the feasibility of control strategy, make the accuracy of control strategy obtained finally higher, can improve user experience. BRIEF DESCRIPTION OF DRAWINGS

[0050] In order to more clearly illustrate the embodiments of the present application or the implementation manner in the related art, the drawings needed to be used in the embodiment or related art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art according to these drawings.

[0051] Figure 1 The scene schematic diagram of a household appliance control method according to some embodiments;

[0052] Figure 2 The flow schematic diagram of a household appliance control method according to some embodiments;

[0053] Figure 3 The flow schematic diagram of a control instruction generation method according to some embodiments;

[0054] Figure 4 The flow schematic diagram of a feasibility verification method according to some embodiments;

[0055] Figure 5 The flow schematic diagram of another control method according to some embodiments;

[0056] Figure 6 The distribution schematic diagram of an agent according to some embodiments;

[0057] Figure 7 The scene schematic diagram of another household appliance control method according to some embodiments;

[0058] Figure 8 The schematic diagram of terminal equipment reply to user according to some embodiments;

[0059] Figure 9A structural schematic diagram of a home appliance control device according to some embodiments;

[0060] Figure 10 A structural schematic diagram of an electronic device according to some embodiments. DETAILED DESCRIPTION

[0061] For the purpose of making the objects, implementations and advantages of the present application more clear, the following will combine the drawings in the exemplary embodiments of the present application to make a clear and complete description of the exemplary implementations of the present application. Obviously, the described exemplary embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application.

[0062] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0063] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not have to be limited to those components clearly listed, but can include other components not clearly listed or inherent to these products or devices.

[0064] The home appliance generally has a voice function, so that the user's voice can be received to control the home appliance. The existing home, home appliance has a voice function, but is mostly single control. For example, for the field of intelligent lighting, the user can say turn on the light, turn off the light, adjust the color of the light. For the intelligent voice air conditioner, the intelligent voice air conditioner can generate a corresponding air conditioner adjustment scheme according to the user's feeling or demand. For the intelligent voice washing machine, a corresponding washing and caring scheme can be generated according to the user's description, etc.

[0065] However, the existing control mode is for a single home appliance, when the user wants to control multiple home appliances, the user needs to say the demand one by one to the multiple home appliances, so that the multiple home appliances can be controlled according to the user's demand, the control mode is relatively cumbersome, and the user experience is poor.

[0066] Based on this, the application provides a household appliance control method, which can determine at least one household appliance to be controlled according to user demand, make each household appliance generate its own control strategy by sending a control instruction to the at least one household appliance, and further perform feasibility verification on the control strategy generated by each household appliance, and only when it is determined that the control strategies of the household appliances are all feasible, the household appliances are controlled to execute the control strategies. In this way, the accuracy of the determined control strategy is higher, and the at least one household appliance is controlled according to the user's demand, simplifying the process of user interaction with the household appliance and improving user experience.

[0067] The technical solutions of the application will be described in detail below in combination with specific embodiments. The following specific embodiments can be combined with each other or exist independently, and the same or similar concepts or processes can not be described in some embodiments. The embodiments of the application will be described below in combination with the drawings.

[0068] First, the use scenario of the application is described. Figure 1 A scene diagram of a household appliance control method according to some embodiments.

[0069] Figure 1 The system includes a primary agent and N secondary agents. The primary agent and the N secondary agents can interact with each other. The primary agent can receive information sent by the secondary agents and also control the secondary agents. The secondary agents can send information to the primary agent and also receive control instructions from the primary agent.

[0070] The primary agent can be an intelligent sound box, a terminal device, or other electronic devices that can interact with users. The embodiments of the application do not make specific limitations on the primary agent.

[0071] The secondary agent is a smart household appliance in the user's home, including but not limited to a smart lamp, an air conditioner, a refrigerator, a washing machine, an electric fan, etc. The embodiments of the application do not make specific limitations on the secondary agent.

[0072] As shown in FIG. 1, the system includes a primary agent 101 and N secondary agents 102. The primary agent 101 can be an intelligent sound box, a terminal device, or other electronic devices that can interact with users. The embodiments of the application do not make specific limitations on the primary agent. Figure 1As shown, the primary agent can receive the user's demand, determine the M secondary agents, i.e., the M home appliances, that the user wants to control according to the user's demand, and send control instructions to the M secondary agents. Any one of the M secondary agents generates a control strategy matching the user's demand based on the received control instructions, and sends the control strategy to the primary agent. In this way, the primary agent can receive the M control strategies, and the primary agent can further verify the feasibility of the M control strategies to ensure that mutual exclusion does not occur between the control strategies. When the feasibility verification is passed, the primary agent can send a message of passing the verification to the M secondary agents, so that the secondary agents operate according to the control strategies generated by themselves.

[0073] Next, the control method of the home appliance according to the present application is described, which can be specifically seen from Figure 2 as shown. Figure 2 A flowchart of a control method of a home appliance according to some embodiments.

[0074] It should be noted that the control method of the home appliance provided in the embodiments of the present application is applied to the primary agent as described above Figure 1 in the present application. The home appliance in the present application is the secondary agent as described above Figure 1 .

[0075] Figure 2 As shown, the control method of the home appliance can include the following steps:

[0076] S201, obtaining demand information of a user.

[0077] The demand information of the user can include the user's sensory demand, the user's demand for the functions provided by the home appliance, etc., and the embodiments of the present application do not limit the demand information of the user.

[0078] The demand information of the user can be voice, text or touch operation, etc., and the embodiments of the present application do not limit the form corresponding to the demand information.

[0079] In one possible implementation, the primary agent can directly receive the demand information input by the user. For example, the user speaks the voice corresponding to the demand information to the primary agent, so that the primary agent can directly obtain the demand information input by the user. Or, the user can input the text corresponding to the demand information on the terminal device, or perform touch interaction with the terminal device, so that the primary agent can obtain the demand information of the user.

[0080] For example, the primary agent can obtain the demand information of the user sent by the target home appliance in the at least one home appliance.

[0081] The demand information is information input by a user and received by the target home appliance.

[0082] Taking the target home appliance as an air conditioner, the voice module arranged in the air conditioner can receive the voice corresponding to the demand information of the user, and send the voice to the primary agent.

[0083] In this way, since the home appliances are arranged at multiple positions in the user's home, the demand information of the user is obtained through the home appliances, so that the primary agent can obtain the demand information of the user regardless of the position of the primary agent in the home, and control at least one home appliance based on the demand information of the user, thereby improving the user experience.

[0084] S202. According to the demand information of the user, a control instruction is sent to at least one home appliance, the control instruction including target demand information corresponding to the home appliance, so that the home appliance generates a control strategy according to the target demand information.

[0085] In the present application, at least one home appliance corresponding to the demand of the user can be determined according to the demand information of the user, and a control instruction is sent to the at least one home appliance.

[0086] For example, the demand information of the user is to turn on the light in the master bedroom, to lower the temperature of the air conditioner in the living room to 25℃, and to turn on the water heater. The home appliances determined by the primary agent according to the demand information include the light in the master bedroom, the air conditioner in the living room, and the water heater, and the primary agent sends a control instruction to the light in the master bedroom, the air conditioner in the living room, and the water heater. The control instruction received by the light in the master bedroom includes the demand of “turning on the light in the master bedroom”. The control instruction received by the air conditioner in the living room includes the demand of “lowering the temperature to 25℃”. The control instruction received by the water heater includes the demand of “turning on the water heater”. In this way, the light in the master bedroom, the air conditioner in the living room, and the water heater can generate a control strategy based on the received control instruction, respectively.

[0087] For example, when the demand information of the user obtained is a voice, the voice can be converted into corresponding text information, and the text information is analyzed to determine at least one home appliance.

[0088] For example, the keywords in the text information can be extracted, and at least one home appliance is determined according to the extracted keywords.

[0089] In the present application, when the home appliance receives the control instruction, the home appliance can generate a control strategy of the home appliance according to the target demand information carried in the control instruction, the target preference information of the user for the home appliance, and the target environment information of the home appliance, and send the generated control strategy to the primary agent.

[0090] In this way, the control strategy generated by the home appliance itself according to the user demand, the user preference information and the environment information is more in line with the user demand and has higher accuracy.

[0091] S203, receiving at least one control strategy sent by at least one home appliance and performing feasibility verification on the at least one control strategy.

[0092] The feasibility verification on the at least one control strategy can verify whether there is mutual exclusion between the at least one control strategy or whether it is in line with the user demand.

[0093] S204, when the feasibility verification of the at least one control strategy is passed, sending the passed information to the home appliance, so that the home appliance operates according to the control strategy.

[0094] When the feasibility verification of the at least one control strategy is passed, it can be determined that the at least one control strategy is a control strategy in line with the user demand.

[0095] In this way, the control strategy is autonomously generated by the home appliance to be controlled, so that the control strategy is more in line with the actual situation of the home appliance, and the accuracy of the finally obtained control strategy is higher through the feasibility verification on the control strategy, so that the user experience can be improved.

[0096] In the present application, after the first intelligent agent receives the user demand information, at least one home appliance can be determined according to the user demand information and a control instruction is generated, as shown in Figure 3 , a flowchart of a method for generating a control instruction according to some embodiments is shown. Figure 3

[0097] As shown in Figure 3 , the method can include:

[0098] S301, obtaining environment information and user preference information.

[0099] The environment information can include temperature in the room, temperature outside, weather conditions, season and the like, and the present application does not make specific limitation on the environment information.

[0100] The user preference information can be the preference of the user for the use of the home appliance in the home, for example, it can include the opening time, the closing time and the temperature of the air conditioner in the room, and the present application does not make specific limitation on the user preference information.

[0101] S302, according to the environment information and the user preference information, the demand information is split to obtain at least one target demand information.

[0102] ​The demand information is split, the corresponding text of the demand information is analyzed, and at least one target demand information is obtained.

[0103] S303, determining a home appliance corresponding to the target demand information, and generating a control instruction corresponding to the home appliance.

[0104] Each target demand information corresponds to one or more home appliances.

[0105] In this way, at least one home appliance is determined according to the environmental information, the user preference information and the user demand information, so that the determined home appliance is more in line with the user's demand and has higher accuracy.

[0106] Exemplarily, Figure 3 S302 and S303 shown can be implemented through a model, which can be a pre-trained model or a large model, and the embodiments of the present application do not limit this.

[0107] In the present application, the feasibility verification of the at least one control strategy can include the following two possible implementations:

[0108] One possible implementation is as follows, Figure 4 As shown, Figure 4 A method flow diagram for a feasibility verification according to some embodiments.

[0109] As shown, Figure 4 The method comprises:

[0110] S401, obtaining constraint information between at least one home appliance.

[0111] The constraint information between at least one home appliance can be generated according to the installation position of the home appliance, the operating relationship between the home appliances, etc., and can include linkage between the home appliances, mutual exclusion relationship between the home appliances, etc., and the embodiments of the present application do not limit the constraint information between the home appliances.

[0112] Exemplarily, the constraint information between the home appliances can be stored in a primary agent or in a cloud device. The embodiments of the present application do not limit this.

[0113] When the primary agent needs to verify the feasibility of the control strategy, the constraint information corresponding to the identifier of each home appliance in the at least one home appliance can be determined in the pre-stored multiple constraint information according to the identifier of each home appliance in the at least one home appliance. The identifier of the home appliance can be the name of the home appliance, for example, refrigerator, air conditioner, etc., and the embodiments of the present application do not limit this.

[0114] S402, according to the constraint information and the user preference information, verifying the feasibility of the at least one control strategy.

[0115] The user preference information is generated according to historical use records of the user.

[0116] For example, in an air conditioner, a high-end model has a direct-blow prevention function, which means that when the user is close, the air conditioner prevents blowing to the user by adjusting the air direction in the cooling state, thereby providing a more comfortable air conditioning use experience. There is also a humidification function, and only some models of air conditioners have a humidification function. The control strategy generated by the home appliance may generate some functions such as direct-blow prevention or humidification, which are not common but can meet the current user's needs, but the actual whole machine does not have this function. Therefore, the home appliance sends the function supported by the current whole machine to the primary intelligent agent for feasibility verification.

[0117] S403, when at least one control strategy meets the constraint information and the user preference information, it is determined that at least one control strategy passes the feasibility verification.

[0118] In this way, the feasibility of at least one control strategy is verified by the constraint information and the user preference information, so that the control strategy after the feasibility verification is more in line with the requirements of the user, and the user experience can be improved.

[0119] S404, when there is a first control strategy in at least one control strategy that does not meet the constraint information and / or the user preference information, the first control strategy in at least one control strategy is adjusted according to the constraint information and the user preference information, and an updated at least one control strategy is obtained.

[0120] Optionally, in order to further improve the matching degree of the obtained at least one control strategy and the user's demand, after obtaining the updated at least one control strategy, steps S401, S402 and S404 can be continuously executed until the final updated strategy passes the feasibility verification.

[0121] In this way, the control strategy that does not meet the constraint information and the user preference information is updated according to the constraint information and the user preference information, so that the updated control strategy meets the constraint information and the user preference information. The more updated control strategy of the subsequent home appliance is more in line with the user's demand, and the user experience is improved.

[0122] Another possible implementation is to output at least one control strategy to confirm with the user whether at least one control strategy meets the demand; if information that the user is satisfied with at least one control strategy is received, it is determined that at least one control strategy passes the feasibility verification.

[0123] A possible implementation is that when the primary intelligent agent is a smart speaker, the output manner of at least one control strategy can be to play the voice corresponding to at least one control strategy through the smart speaker. For example, will you open the bedroom light and adjust the air conditioner temperature to 26℃, are you satisfied with the solution.

[0124] When the user is satisfied with the solution, a voice expressing satisfaction with the solution can be spoken, and when the smart speaker receives the voice, it can be determined that the at least one control strategy passes the feasibility verification.

[0125] Another possible implementation, when the primary agent is a terminal device of the user, the manner of outputting the at least one control strategy can include playing a voice corresponding to the at least one control strategy through the terminal device, or displaying a prompt box including the at least one control strategy on the display screen of the terminal device.

[0126] When the user is satisfied with the solution, a voice expressing satisfaction with the solution can be spoken, or an instruction expressing satisfaction with the solution can be input in the prompt box. When the terminal device receives information that the user is satisfied with the at least one control strategy, it can be determined that the at least one control strategy passes the feasibility verification.

[0127] Of course, other output methods can also be included, and the embodiments of the present application do not limit the specific output method.

[0128] In this way, by asking the user whether he or she is satisfied, it is determined whether the at least one control strategy passes the feasibility verification, so that the at least one control strategy that passes the feasibility verification is a control strategy that the user is satisfied with, which can improve the user experience.

[0129] When the user is not satisfied with the at least one control strategy described above, adjustment information for the second control strategy can be input.

[0130] Further, when the primary agent receives the adjustment information for the second control strategy from the user, the second control strategy is adjusted according to the adjustment information to obtain an updated at least one control strategy; the second control strategy is a control strategy in the at least one control strategy that does not meet the user's demand.

[0131] In combination with the above implementation manner of the primary agent outputting the at least one control strategy, the adjustment information for the second control strategy from the user can include:

[0132] A possible implementation, when the primary agent is a smart speaker, the manner of outputting the at least one control strategy can be playing a voice corresponding to the at least one control strategy through the smart speaker, and when the user is not satisfied with the second control strategy therein, a voice adjusting the second control strategy can be spoken, i.e., the adjustment information for the second control strategy is input, so that the smart speaker can adjust the second control strategy according to the voice.

[0133] Another possible implementation: when the primary intelligent agent is the terminal device of the user, and the output of the at least one control strategy is to play the voice corresponding to the at least one control strategy through the terminal device, when the user is not satisfied with the second control strategy, the user can speak the voice of adjusting the second control strategy, that is, input the adjustment information for the second control strategy, so that the terminal device can adjust the second control strategy according to the voice.

[0134] When the primary intelligent agent is the terminal device of the user, and the output of the at least one control strategy is to display a prompt box including the at least one control strategy on the display screen of the terminal device, when the user is not satisfied with the second control strategy, the user can input the adjustment scheme for adjusting the second control strategy in the prompt box, that is, input the adjustment information for the second control strategy, so that the terminal device can adjust the second control strategy according to the adjustment scheme.

[0135] In this way, when the user is not satisfied with the second control strategy in the at least one control strategy, the second control strategy can be adjusted according to the adjustment information input by the user, so that the adjusted control strategy is a control strategy that meets the user's demand, and when the corresponding household appliance is controlled according to the control strategy subsequently, the user's satisfaction can be improved, and the user experience can be improved.

[0136] Next, taking the demand information of the user as the voice of the user, the voice content as the child having finished dinner, studying for half an hour, then taking a bath, and going to bed at 9 o'clock after taking a bath (assuming that the current time is 8 o'clock in the evening), and the household appliance as an example of the secondary intelligent agent, the control method of the household appliance is described.

[0137] The household appliance control method is as shown in Figure 5 . The flowchart of another control method according to some embodiments is shown in Figure 5 . The flowchart of another control method according to some embodiments is shown in

[0138] As shown in Figure 3 , the user inputs the voice demand, and the system converts the voice of the user into text by using the automatic speech recognition (ASR) technology to obtain the text demand.

[0139] The text demand of the user, the current environment information, and the historical behavior habits of the user are sent to the primary intelligent agent, the primary intelligent agent analyzes and disassembles the demand of the user according to the demand of the user, divides the task into multiple sub-tasks, selects one or more secondary intelligent agents, and assigns the task to the secondary intelligent agent, that is, sends the control instruction to the secondary intelligent agent.

[0140] The primary intelligent agent and the secondary intelligent agent can be seen from Figure 6 , The distribution diagram of an intelligent agent according to some embodiments is shown in Figure 6 . The distribution diagram of an intelligent agent according to some embodiments is shown in

[0141] like Figure 6 As shown, the first-level agent has the following second-level agents: lighting agent, water heater agent, refrigerator agent, TV agent, air conditioner agent, curtain agent, information search agent, knowledge question and answer agent, and course tutoring agent.

[0142] Assuming that the current time is 8 o'clock in the evening in summer, task analysis and decomposition may include: the first-level intelligent agent performs task analysis and decomposition. The child has finished his meal and needs to study. First, turn on the lighting system in the study. Since it is hot in summer, turn on the air conditioner in the study to cool down. After studying, he needs to take a bath, so the hot water needs to be turned on in advance and prepared. Turn off the water heater after the child finishes taking a bath. At the same time, the child goes to bed at 9 o'clock. The indoor temperature is hot in summer, so the air conditioner needs to be turned on. At the same time, close the curtains and lights when sleeping to provide a good sleeping environment for the child.

[0143] Figure 7 FIG. 1 is a schematic diagram of another household appliance control method according to some embodiments. Figure 7 As shown, the selection of secondary agents includes: the first-level agent is split according to the above tasks, and the first-level agent needs to select at least one secondary agent, namely lighting, hot water, air and curtains. Therefore, the selected secondary agents include: lighting agent, water heater agent, air conditioning agent, and curtain agent.

[0144] The first-level agent delegating tasks to the second-level agent for execution may include: delegating subtasks to the corresponding second-level agent based on the task decomposition results, that is, sending corresponding control instructions to the second-level agent. For example, in the above task analysis and decomposition, if the child is studying, the study lights need to be turned on and turned off after half an hour of study. If the child goes to bed at 9 o'clock, the bedroom lights need to be turned off. In this case, the above tasks need to be delegated to the corresponding lighting agent. If the child is studying, it is hot indoors in the summer, so the study air conditioner needs to be turned on immediately to cool down and provide a good learning environment for the child. If the child is sleeping, it is hot indoors in the summer, so the air conditioner needs to be turned on to help the child sleep more soundly. The above tasks are delegated to the air conditioning agent. Other agents are not mentioned in detail.

[0145] The secondary agent generates corresponding control strategies based on the assigned tasks.

[0146] For example, a lighting agent receives a task from a Level 1 agent and generates a control strategy based on its own device capabilities and intelligence level, combined with user behavior. The generated lighting plan might be to turn on the study lighting at 8:00 AM, in warm eye-protection mode, turn off the study lighting at 8:30 AM, and turn off the bedroom lighting at 9:00 AM. An air conditioning agent receives a task from a Level 1 agent and generates a control strategy based on the current environment and user behavior. The generated control strategy might include: turning on the study air conditioner at 8:00 AM, cooling to 27 degrees Celsius, with a silent fan speed; turning off the study air conditioner at 8:30 AM; turning on the bedroom air conditioner at 9:00 AM, switching it to sleep mode, and turning it off at 6:00 AM the next morning.

[0147] It should be noted that after the control strategy is generated, it is necessary to convert the control strategy into instructions that can be controlled and executed by the home appliance so that the generated control strategy can be sent to the home appliance for actual execution.

[0148] Furthermore, the second-level agent will feed back the generated control strategy to the first-level agent, which will conduct feasibility verification and summary. After receiving feedback from all the second-level agents that have been assigned tasks, the first-level agent will conduct feasibility verification to verify whether the control strategy generated by each second-level agent meets the requirements.

[0149] If the requirements are not met, the corresponding secondary agent can make adjustments and return the latest control strategy that meets the requirements. Alternatively, the primary agent can adjust the control strategy and generate a new control strategy, as described in the above embodiment, which will not be repeated here.

[0150] After receiving the control strategy feedback from the second-level agent, the first-level agent sequentially organizes and summarizes it, creating a comprehensive adjustment strategy that is more easily accepted by the user, and simultaneously generates a thoughtful, simple response. For example, in the example above, the first-level agent might respond to the user with, "Okay, your child is about to study. I'll turn on the study lamp and air conditioner in advance. The lamp will be set to eye protection mode, and the air conditioner will assist in cooling, allowing your child to study more efficiently. I'll also reserve hot water in advance so that he can take a shower after studying. After that, he can turn off the lights and go to bed. I'll also turn on the bedroom air conditioner in sleep mode to provide a quiet and comfortable environment for your child to sleep through the night. What do you think of this solution?"

[0151] Taking the first-level intelligent agent as the user's terminal device as an example, the terminal device responds to the user based on the received user's voice. Figure 8 As shown, Figure 8 A schematic diagram of a terminal device replying to a user according to some embodiments.

[0152] like Figure 8 As shown, the content of the reply can be displayed on the screen of the terminal device for the user to view.

[0153] After the user receives the adjustment strategy played by the first-level agent, the user needs to think whether the adjustment strategy meets the user's own needs. If it meets the user's needs, the user will reply with positive and positive words. If the user is not satisfied with the current adjustment strategy, the user may adjust the current adjustment strategy and tell the first-level agent. After the first-level agent receives the new demand, it will analyze again, select the second-level agent closely related to the adjustment, and assign the second-level agent to modify and feedback according to the user's latest demand. After the adjustment strategy of the second-level agent is adjusted, the first-level agent will verify and summarize, and feedback to the user, and finally let the user recognize and be satisfied.

[0154] In this way, the existing control method is: you need to say to the smart table lamp: turn on the table lamp, then run to the water heater and say to the water heater: please heat, and preheat the bath, then run to the air conditioner and say that the child will sleep at 9 o'clock, turn on the air conditioner, or repeat your needs on the unified mobile phone. With the intelligent agent, the intelligent agent will analyze and reason the user's demand to obtain a complete execution sequence and execution scheme. For example, in the above example, the intelligent agent may generate a solution: the table lamp in the study is turned on for half an hour, the air conditioner is turned on for half an hour, the water heater is turned on for preheating at 8 o'clock in the evening, and turned off at 9 o'clock, the air conditioner in the child's room will be turned on at 9 o'clock, and the sleep mode of the air conditioner will be turned on, and the lighting lamp and the curtain in the child's room will be turned off at 9 o'clock. If the TV is turned on, the TV volume will be turned down to ensure that the child has a good sleep environment. The control method of the home appliance device of the present application simplifies the control steps and improves the user experience compared with the existing method.

[0155] In combination with the above embodiment, the control system corresponding to the control method of the home appliance device is described below.

[0156] The composition of the system mainly includes the following parts: voice part, first-level agent, second-level agent, memory part, and home appliance device.

[0157] The voice part mainly completes the conversion between voice and text. After the user inputs, the user's various languages can be accurately converted into text. At the same time, after obtaining the text, the text can be converted into the user's favorite voice in real time.

[0158] The first-level agent receives the user's initial demand, analyzes and disassembles the user's demand, selects the second-level agent and assigns the subtask, verifies and summarizes the result of the second-level agent.

[0159] The memory part includes two levels: a primary agent memory and a secondary agent memory. The primary agent memory is based on the user's demand or scenario, and is more inclined to select and control which home appliances and how to adjust the appliances on a larger scale. The secondary agent memory is based on the user's demand or scenario, and is more inclined to select a more fine-grained device operation behavior habit, etc. For example, a user prefers to set the air conditioner to 26 degrees, which is obtained by analyzing the user's behavior habit. This form of memory is present in the secondary agent memory. The purpose of using memory is to recommend a solution that better fits the user and conforms to the user's behavior habit.

[0160] The memory mode mainly includes two modes: knowledge base and context. In the case of a large number of memories, the knowledge base mode is preferred. In this mode, each memory is stored in the vector library in the form of a vector. When the user's demand arrives, the relevant first three memories are searched in the knowledge base and returned to the agent. The agent analyzes or generates the extracted memory entries with a tendency. The context mode is mainly used when the number of memory entries is not large and closely related, such as the conversation record in the past few days or the summary of the recent conversation history. This is more suitable for presenting memories in the context mode.

[0161] In summary, when the user expresses his demand through voice, the primary agent can select one or more secondary agents to complete the task together. At the same time, according to the user's demand, the corresponding secondary agent is generated to perform the task, and the task is assigned to the corresponding secondary agent. After receiving the corresponding task, the secondary agent generates its own control strategy using the large model capability and feeds it back to the primary agent. The primary agent summarizes, verifies and summarizes the control strategy of the secondary agent, and forms the final solution and feeds it back to the user. In this process, the primary agent selects the secondary agent according to the user's demand, and instead of simply distributing the demand to the secondary agent for execution, it generates corresponding sub-tasks according to the user's demand and distributes them to one or more secondary agents for execution. The generated control strategy has a sequence, and the secondary agents coordinate with each other, better meeting the user's demand.

[0162] When the primary agent broadcasts the generated system solution to the user, the user considers whether the control strategy meets his demand. When the user is not satisfied with the control strategy, the user can directly propose to update or adjust the entire control strategy. At this time, the primary agent will re-analyze the user's adjustment of the solution and execute it. In this process, the primary agent has the ability of multi-round interaction with context, and can refer to the historical conversation to update and adjust the control strategy according to the user's demand.

[0163] Figure 9 FIG. 1 is a schematic diagram of a structure of a home appliance control device according to some embodiments. Figure 9 As shown, the apparatus may include: an acquisition module 901, a control module 902, and a processing module 903, wherein:

[0164] Acquisition module 901 is used to obtain user demand information.

[0165] The control module 902 is used to send a control instruction to at least one home appliance according to the user's demand information. The control instruction includes target demand information corresponding to the home appliance, so that the home appliance generates a control strategy according to the target demand information.

[0166] The processing module 903 is configured to receive at least one control strategy sent by at least one household appliance and perform feasibility verification on the at least one control strategy.

[0167] The control module 902 is further configured to send verification pass information to the home appliance when the feasibility verification of at least one control strategy is passed, so that the home appliance operates according to the control strategy.

[0168] Optionally, the control module 902 is specifically used to obtain environmental information and user preference information; split the demand information according to the environmental information and user preference information to obtain at least one target demand information; determine the home appliance corresponding to the target demand information, and generate control instructions corresponding to the home appliance; and send control instructions to at least one home appliance.

[0169] Optionally, the processing module 903 is specifically used to obtain constraint information between at least one household appliance; perform feasibility verification on at least one control strategy based on the constraint information and user preference information; when at least one control strategy satisfies the constraint information and user preference information, determine that at least one control strategy passes the feasibility verification.

[0170] Optionally, the processing module 903 is also used to adjust the first control strategy in at least one control strategy according to the constraint information and user preference information when there is a first control strategy in at least one control strategy that does not satisfy the constraint information and / or user preference information, so as to obtain at least one updated control strategy.

[0171] Optionally, the processing module 903 is specifically configured to output at least one control strategy to confirm to the user whether the at least one control strategy meets the requirements; if information is received that the user is satisfied with the at least one control strategy, it is determined that the at least one control strategy has passed the feasibility verification.

[0172] Optionally, the processing module 903 is further configured to, if the adjustment information of the user for the second control strategy is received, adjust the second control strategy according to the adjustment information to obtain an updated control strategy, wherein the second control strategy is a control strategy that does not meet the user demand in the at least one control strategy.

[0173] Optionally, the control strategy is generated by the household appliance according to the target demand information, the target preference information of the user for the household appliance, and the target environment information of the household appliance.

[0174] Optionally, the obtaining module 901 is specifically configured to obtain the demand information of the user sent by a target household appliance in the at least one household appliance, wherein the demand information is information input by the user and received by the target household appliance.

[0175] The household appliance control apparatus provided by the embodiment of the application can execute the household appliance control method in the method embodiment, and has similar implementation principles and technical effects, which will not be described here.

[0176] Figure 10 A structural schematic diagram of an electronic device according to some embodiments is shown in FIG. 1. As shown in FIG. 1, the electronic device 100 provided by the embodiment includes at least one processor 1001 and a memory 1002. Optionally, the device 100 further includes a communication component 1003. The processor 1001, the memory 1002, and the communication component 1003 are connected through a bus 1004. Figure 10

[0177] In the specific implementation process, the at least one processor 1001 executes the computer execution instructions stored in the memory 1002, so that the at least one processor 1001 executes the method described above.

[0178] The specific implementation process of the processor 1001 can refer to the method embodiment described above, and has similar implementation principles and technical effects, which will not be described here.

[0179] In the above embodiment, it should be understood that the processor can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the application can be directly embodied as execution completed by a hardware processor, or executed by a combination of hardware and software modules in the processor. ​

[0180] The memory can include a random access memory (RAM) and can also include a non-volatile memory (NVM), such as at least one disk memory.

[0181] The bus can be an industry standard architecture (ISA) bus, a peripheral component (PCI) bus, an extended industry standard architecture (EISA) bus, or the like. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, the bus in the drawings of the present application does not limit to only one bus or one type of bus.

[0182] The present application also provides a computer readable storage medium, which can include a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes, and the like. Specifically, the computer readable storage medium stores computer execution instructions, and the computer execution instructions are executed by a computer to implement the technical solutions shown in the above method embodiments.

[0183] The present application also provides a program product, which includes execution instructions stored in a readable storage medium. When the computer program is executed by a computer, the technical solutions shown in the above method embodiments are executed. The specific implementation manners and technical effects are similar, and will not be described here.

[0184] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the above embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0185] For the convenience of explanation, the above description has been made in connection with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific form disclosed. Various modifications and variations are possible in light of the above teachings. The embodiments are chosen and described in order to best explain the principles of the application and its practical application to thereby enable one skilled in the art to best use the application for various embodiments and with various modifications as are suited to the particular use contemplated.

[0186] In this application, "and / or", only describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. In addition, the character " / " in this paper represents that the associated objects before and after are an "or" relationship.

[0187] "at least one" or its similar expressions refer to any combination of these items, including any combination of single item or multiple items. For example, at least one of a, b or c, can represent a, b, c, a and b, a and c, b and c, or a, b and c, wherein each of a, b and c can be an element or a set containing one or more elements.

[0188] In this application, "at least one" means one or more. "Multiple" means two or more. The first, second, etc. description in the embodiments of the present application is only for demonstration and differentiation of the description objects, and there is no order difference, nor does it represent the special limitation of the number of devices in the embodiments of the present application, which cannot constitute any limitation on the embodiments of the present application. For example, the first threshold and the second threshold are only used to distinguish different thresholds, and do not represent the difference in size, priority or importance of the two thresholds.

[0189] In this application, "example", "in some embodiments", "in other embodiments" and the like are used to represent examples, illustrations or explanations. Any embodiment or design scheme described as "example" in this application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the word "example" is intended to present the concept in a specific way.

[0190] In this application, "of", "corresponding", "corresponding", "associated" can be used interchangeably sometimes. It should be pointed out that when the distinction is not emphasized, the meanings expressed are consistent. In the embodiments of the present application, communication and transmission can be used interchangeably sometimes. It should be pointed out that when the distinction is not emphasized, the meanings expressed are consistent. For example, transmission can include sending and / or receiving, and can be a noun or a verb.

[0191] In the present application, "equal to" can be used with "less than" or "greater than", but not both. When "equal to" is used with "less than", it applies to the technical solution adopted by "less than". When "equal to" is used with "greater than", it applies to the technical solution adopted by "greater than".

Claims

1. A method for controlling household appliances, characterized in that: include: Obtain user demand information; Sending a control instruction to at least one home appliance according to user demand information, wherein the control instruction includes target demand information corresponding to the home appliance, so that the home appliance generates a control strategy according to the target demand information; receiving at least one control strategy sent by the at least one household appliance, and performing feasibility verification on the at least one control strategy; When the feasibility verification of the at least one control strategy is passed, verification pass information is sent to the home appliance, so that the home appliance operates according to the control strategy.

2. The method according to claim 1, characterized in that The sending of a control instruction to at least one home appliance according to the user's demand information includes: Obtain environmental information and user preference information; Splitting the demand information according to the environment information and the user preference information to obtain at least one target demand information; Determining the home appliance corresponding to the target demand information, and generating a control instruction corresponding to the home appliance; The control instruction is sent to at least one household appliance.

3. The method according to claim 2, characterized in that The feasibility verification of the at least one control strategy includes: Obtaining constraint information between at least one home appliance; Performing feasibility verification on the at least one control strategy based on the constraint information and the user preference information; When the at least one control strategy satisfies the constraint information and the user preference information, it is determined that the at least one control strategy passes the feasibility verification.

4. The method according to claim 3, characterized in that The method further comprises: When there is a first control strategy in the at least one control strategy that does not satisfy the constraint information and / or the user preference information, the first control strategy in the at least one control strategy is adjusted according to the constraint information and the user preference information to obtain the updated at least one control strategy.

5. The method according to claim 2, characterized in that The feasibility verification of the at least one control strategy includes: Outputting the at least one control strategy to confirm to the user whether the at least one control strategy meets the requirements; If information is received that the user is satisfied with the at least one control strategy, it is determined that the at least one control strategy passes the feasibility verification.

6. The method according to claim 5, characterized in that The method further comprises: If adjustment information for the second control strategy from the user is received, the second control strategy is adjusted according to the adjustment information to obtain the updated at least one control strategy; the second control strategy is the control strategy that does not meet the user's needs among the at least one control strategy.

7. The method according to any one of claims 1 to 6, characterized in that The control strategy is generated by the home appliance according to the target demand information, the user's target preference information for the home appliance, and the target environment information of the home appliance.

8. The method according to claim 5, characterized in that The obtaining of user demand information includes: Obtain user demand information sent by a target home appliance among at least one home appliance, where the demand information is information input by the user and received by the target home appliance.

9. A home appliance control device, characterized in that: include: Acquisition module, used to obtain user demand information; a control module, configured to send a control instruction to at least one home appliance based on user demand information, wherein the control instruction includes target demand information corresponding to the home appliance, so that the home appliance generates a control strategy based on the target demand information; a processing module, configured to receive at least one control strategy sent by the at least one household appliance and perform feasibility verification on the at least one control strategy; The control module is further configured to send verification pass information to the home appliance when the feasibility verification of the at least one control strategy is passed, so that the home appliance operates according to the control strategy.

10. An electronic device, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 8.

Images