Control method and device for smart home system, and smart home system

Abstract

The invention relates to the technical field of smart home appliances, and discloses a control method and device for a smart home system, and the smart home system. The control method comprises the steps of obtaining user state data under the condition that a user instruction is received; determining a to-be-controlled target household appliance in the smart home system according to the user instruction; carrying out delay and operation gradual change processing on the user instruction, carrying out personification processing on the user instruction according to the user state data, and generating a personification control instruction; and sending the anthropomorphic control instruction to the target household appliance, so that the target household appliance acts according to the anthropomorphic control instruction. According to the invention, the abrupt feeling when the household appliance responds to the user instruction action can be reduced, and the user experience of the smart home system is improved.

Description

Technical Field

[0001] This application relates to the field of smart home appliance technology, such as a control method and device for a smart home system, and a smart home system. Background Technology

[0002] Currently, smart home systems have gradually become an important part of family life, enabling centralized control and intelligent linkage of various home appliances, greatly improving the convenience and comfort of family life.

[0003] In related technologies, the interactive control methods of smart home systems focus on the accurate recognition of commands and the rapid response of devices. After receiving a user command, the smart home system will parse the command and drive the target home appliance to perform corresponding switching, adjustment, and other actions within a very short time.

[0004] In the process of implementing the embodiments of this disclosure, it was found that the related technology has at least the following technical problems: While existing technologies enable home appliances to respond quickly to user commands, the actions of these appliances after responding to user commands often feel abrupt, easily causing discomfort or even disturbance to the user. For example, if a user, in a irritable state, issues the command "turn on the living room light," the light instantly reaches the preset brightness, which may be glaring and exacerbate the user's irritability, resulting in a poor user experience with the smart home system. Therefore, reducing the abruptness of home appliances' responses to user commands to improve the user experience of smart home systems has become an urgent technical problem to be solved.

[0005] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this application, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0006] To provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended as a general commentary, nor is it intended to identify key / important components or describe the scope of protection of these embodiments, but rather as a prelude to the detailed description that follows.

[0007] This disclosure provides a control method and device for a smart home system, which can reduce the abruptness of home appliances responding to user commands and improve the user experience of the smart home system.

[0008] In some embodiments, a control method for a smart home system includes: upon receiving a user instruction, acquiring user status data; determining a target home appliance to be controlled in the smart home system based on the user instruction; performing delay and operation gradation processing on the user instruction, and anthropomorphizing the user instruction based on the user status data to generate anthropomorphic control instructions; and sending the anthropomorphic control instructions to the target home appliance to cause the target home appliance to act according to the anthropomorphic control instructions.

[0009] Optionally, the user instruction is subject to delay and operation gradation processing, including: delaying the execution time of the user instruction by a set time; and performing a non-transient gradation process to change the output of some actions in the user instruction.

[0010] Optionally, user commands are anthropomorphized based on user status data, including: determining the user's emotional category based on the user status data; and adjusting the action output style in the user commands according to the action output style corresponding to the user's emotional category.

[0011] Optionally, user instructions are anthropomorphized based on user status data, including: determining the user's cognitive load level based on the user status data; and decomposing the user instruction into multiple sub-instructions when the user's cognitive load level reaches a set level.

[0012] Optionally, user status data includes the user's eye movement duration and operation duration; determining the user's cognitive load level based on the user status data includes: inputting the eye movement duration and operation duration into a pre-trained load assessment model to determine the user's comprehensive load index; and determining the user's cognitive load level according to the numerical range of the comprehensive load index.

[0013] Optionally, the user state data includes a user's facial image; the user's instructions are anthropomorphized based on the user state data, including: determining the current user's identity based on the user's facial image; determining the target action style corresponding to the current user's identity; and adjusting the action output style in the user's instructions to the target action style.

[0014] Optionally, before sending the anthropomorphic control command to the target home appliance, the control method further includes: acquiring smart home environment data when the target home appliance is multiple mobile robots in a smart home system; planning the motion trajectory of each mobile robot based on the smart home environment data; and simultaneously sending the motion trajectory when sending the anthropomorphic control command to the target home appliance.

[0015] In some embodiments, a control device for a smart home system includes: an acquisition module for acquiring user status data upon receiving a user instruction; a determination module for determining a target home appliance to be controlled in the smart home system based on the user instruction; a humanization processing module for performing delay and operation gradation processing on the user instruction, and performing humanization processing on the user instruction based on the user status data to generate humanization control instructions; and an interaction module for sending the humanization control instructions to the target home appliance so that the target home appliance can act according to the humanization control instructions.

[0016] In some embodiments, a control device for a smart home system includes a processor and a memory storing program instructions, the processor being configured to execute the control method for a smart home system as described above when running the program instructions.

[0017] In some embodiments, a smart home system includes: multiple home appliances; and a control device for a smart home system as described above, which is communicatively connected to the multiple home appliances.

[0018] The control method and apparatus for smart home systems and the smart home systems provided in this disclosure can achieve the following technical effects: In this embodiment, after receiving a user command, user status data is acquired. After determining the target home appliance to be controlled in the smart home system based on the user command, the target home appliance is not directly controlled to execute the user command. Instead, the user command is first delayed and its operation is gradually processed. Furthermore, the user command is anthropomorphized based on the user status data before being sent to the target home appliance for execution. This ensures a natural transition in the target home appliance's actions, adapting to the user's state. Therefore, this embodiment can reduce the abruptness of home appliances responding to user commands, improving the user experience of the smart home system.

[0019] The above general description and the description below are exemplary and illustrative only and are not intended to limit this application. Attached Figure Description

[0020] One or more embodiments are illustrated by way of example with reference to the accompanying drawings. These illustrations and drawings do not constitute a limitation on the embodiments. Elements having the same reference numerals in the drawings are shown as similar elements. The drawings are not to be scaled. And wherein: Figure 1 This is a schematic diagram of a smart home system provided in an embodiment of this disclosure; Figure 2 This is a schematic diagram of a control method for a smart home system provided in an embodiment of this disclosure; Figure 3This is a schematic diagram of another control method for a smart home system provided in an embodiment of this disclosure; Figure 4 This is a schematic diagram of another control method for a smart home system provided in an embodiment of this disclosure; Figure 5 This is a schematic diagram of a control device for a smart home system provided in an embodiment of this disclosure; Figure 6 This is a schematic diagram of another control device for a smart home system provided in an embodiment of this disclosure. Detailed Implementation

[0021] To provide a more detailed understanding of the features and technical content of the embodiments of this disclosure, the implementation of the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for illustrative purposes only and are not intended to limit the embodiments of this disclosure. In the following technical description, for ease of explanation, several details are used to provide a full understanding of the disclosed embodiments. However, one or more embodiments may still be implemented without these details. In other cases, well-known structures and devices may be simplified in their depiction to simplify the drawings.

[0022] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this disclosure described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0023] Unless otherwise stated, the term "multiple" means two or more.

[0024] In this embodiment of the disclosure, the character " / " indicates that the objects before and after it are in an "or" relationship. For example, the A / B feature means: A or B.

[0025] The term "and / or" describes an association between objects, and the feature indicates that there can be three relationships. For example, A and / or B, the feature indicates three relationships: A or B, or A and B.

[0026] The term "correspondence" can refer to an association or binding relationship. The correspondence between A and B means that there is an association or binding relationship between A and B.

[0027] It should be noted that, unless otherwise specified, the embodiments and features described in the present disclosure can be combined with each other.

[0028] Combination Figure 1As shown, this embodiment of the disclosure provides a smart home system 100, which includes: multiple home appliances 110 and a control device 500 (600) for the smart home system. The control device 500 (600) for the smart home system is communicatively connected to the multiple home appliances 110.

[0029] Optionally, the control device 600 for the smart home system includes a processor that can receive user status data upon receiving a user instruction. It can determine the target home appliance to be controlled in the smart home system based on the user instruction. The user instruction can be delayed and its operation gradually varied, and the user instruction can be anthropomorphized based on the user status data to generate anthropomorphic control instructions. The generated anthropomorphic control instructions can be sent to the target home appliance to cause it to act according to the anthropomorphic control instructions.

[0030] Optionally, the smart home system refers to a system within whole-house intelligent digital control application scenarios such as smart home, smart home appliances ecosystem, and intelligence house ecosystem.

[0031] Optionally, the control device for the smart home system is connected to multiple home appliances via network communication.

[0032] Optionally, the aforementioned network may include, but is not limited to, at least one of the following: a wired network and a wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: a wide area network (WAN), a metropolitan area network (MAN), and a local area network (LAN). The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity) and Bluetooth.

[0033] Optionally, the multiple home appliances in the smart home system may include, but are not limited to, smart range hoods, smart refrigerators, smart ovens, smart stoves, smart washing machines, smart water heaters, smart washing equipment, smart dishwashers, smart projectors, smart TVs, smart clothes racks, smart curtains, smart audio-visual systems, smart sockets, smart speakers, smart speakers, smart fresh air systems, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaners, smart window cleaning robots, smart mopping robots, smart air purifiers, smart steam ovens, smart microwave ovens, smart water heaters, smart air purifiers, smart water dispensers, smart door locks, etc.

[0034] In conjunction with the aforementioned smart home system, this disclosure provides a control method for a smart home system, wherein the processor described above can be the executing entity of this control method. Figure 2 As shown, the control method includes: S201, upon receiving a user instruction, the processor acquires user status data.

[0035] Specifically, some home appliances in a smart home system are equipped with voice acquisition devices or screen display devices, and the smart home system can communicate and connect with mobile terminals. The processor can obtain user commands based on the voice acquisition devices, screen display devices, and mobile terminals that communicate with the smart home system.

[0036] Specifically, user commands include control instructions, questions, or other interactive information that a user wants to convey to one or more home appliances in the smart home system.

[0037] Specifically, user status data can include physiological status data, behavioral status data, and environmental status data. Physiological status data includes physiological indicators such as heart rate, blood pressure, and body temperature, which can be obtained through devices such as smart bracelets or smartwatches worn by the user. Behavioral status data includes the user's location (e.g., living room or bedroom lights) and activity status (e.g., stationary, active). Environmental status data includes environmental parameters such as indoor temperature, humidity, and light intensity.

[0038] Specifically, some home appliances in smart home devices are equipped with various sensors, through which the processor can obtain user status data.

[0039] S202, the processor determines the target home appliances to be controlled in the smart home system based on user instructions.

[0040] Specifically, the user command will contain keywords related to the home appliance to be controlled. The processor can determine the target home appliance based on the keywords contained in the user command. For example, if the user command is "adjust the brightness of the bedroom light to 80%", and its keywords are "bedroom" and "light", then the target home appliance can be determined to be the bedroom light fixture.

[0041] Furthermore, when the target appliance cannot be directly identified based on the user's command, contextual analysis can be used to determine the target appliance. For example, if the user previously checked the bedroom temperature and then issued a command to "turn the temperature down," the bedroom air conditioner can be identified as the target appliance based on contextual analysis.

[0042] S203, the processor performs delay and operation gradation processing on user instructions, and anthropomorphizes user instructions based on user state data to generate anthropomorphic control instructions.

[0043] Specifically, delayed processing refers to not immediately controlling the target home appliance according to the user's command, but rather executing it after a certain delay. This delay can simulate the user's reaction time when performing an action, making the control process of the target home appliance more natural. For example, when a user issues the command "turn on the living room lights," the lights can be turned on after a delay of 0.5 to 1 second, giving the user a feeling that is more in line with human behavior.

[0044] Specifically, gradual operation processing refers to the process where, when executing control commands, the target home appliance does not immediately reach its final state, but rather achieves it through a gradual change. Taking lighting control as an example, gradual operation processing allows the light to gradually change from its current brightness to the user-specified brightness, rather than switching abruptly. Similarly, for air conditioner temperature adjustment, the temperature can be gradually increased or decreased, rather than directly setting the temperature to the target value. This gradual processing method avoids the discomfort caused to the user by abrupt changes in the target home appliance's state.

[0045] Specifically, the true intent and requirements of the same user command may differ depending on the user's state. Humanizing user commands based on user state data can make subsequent actions of target home appliances more accurately meet the user's true intent and requirements. For example, if user state data indicates it's late at night and the environment is quiet, when controlling a light fixture to "turn on the light," the humanized control command can extend the delay of turning on the light and significantly reduce the rate of brightness change to simulate the slow, gentle movements of a sleepy user. As another example, if user state data indicates the user is anxious, when controlling a robot to "tidy up the table," the humanized control command can be set to a faster movement speed and a more direct path. Furthermore, if user state data indicates the user is focused on work, when controlling an air conditioner to "lower the temperature," the humanized control command can make the fan speed change extremely smooth and avoid making any beeping sounds to reduce interference.

[0046] S204, the processor sends anthropomorphic control instructions to the target home appliance so that the target home appliance can act according to the anthropomorphic control instructions.

[0047] Specifically, the smart home system establishes communication connections with various home appliances. After determining the anthropomorphic control instructions, the processor sends the anthropomorphic control instructions to the target home appliance to achieve control over the target home appliance.

[0048] In this embodiment, after receiving a user command, user status data is acquired. After determining the target home appliance to be controlled in the smart home system based on the user command, the target home appliance is not directly controlled to execute the user command. Instead, the user command is first delayed and its operation is gradually processed. Furthermore, the user command is anthropomorphized based on the user status data before being sent to the target home appliance for execution. This ensures a natural transition in the target home appliance's actions, adapting to the user's state. Therefore, this embodiment can reduce the abruptness of home appliances responding to user commands, improving the user experience of the smart home system.

[0049] This disclosure provides another control method for smart home systems, such as... Figure 3 As shown, the control method includes: S301: Upon receiving a user instruction, the processor acquires user status data.

[0050] S302, the processor delays the execution time of user instructions by a set time, so that the changes in the output of some actions in the user instructions are completed in a non-transient gradual manner.

[0051] Specifically, by setting a time delay for the execution of user commands, the smart home system can prevent it from immediately controlling the target home appliance according to the command. Instead, it will wait for the set time before executing the command. This simulates the natural reaction delay that occurs when humans perform actions, making the control process of home appliances closer to actual human behavior and avoiding overly mechanical or abrupt responses.

[0052] Optionally, a random delay time within the range of 0.3 seconds to 1.2 seconds can be set.

[0053] Specifically, by using a non-transient, gradual approach to change some of the actions in user commands, the discomfort caused by sudden changes in the state of home appliances can be avoided, making the control of home appliances smoother and gentler, simulating the way humans operate home appliances when making detailed adjustments.

[0054] Alternatively, the gradual change can be achieved using pulse width modulation (PWM) technology, and / or by adjusting the frequency of the motor drive signal.

[0055] S303: The processor performs human-like processing on user instructions based on user status data, generating human-like control instructions.

[0056] S304, the processor identifies the user who inputs the voice interaction request and determines the current user's identity.

[0057] S305, the processor sends anthropomorphic control instructions to the target home appliance so that the target home appliance can act according to the anthropomorphic control instructions.

[0058] In this embodiment, upon receiving a user command, the execution time of the command is delayed by a set time, allowing some actions in the command to change gradually and non-instantaneously. This creates a natural transition in the subsequent actions of the target home appliance, reducing abruptness in the appliance's response to user commands and improving the user experience of the smart home system.

[0059] In some embodiments, user instructions are anthropomorphized based on user state data, including: determining the user's emotion category based on the user state data; and adjusting the action output style in the user instructions according to the action output style corresponding to the user's emotion category.

[0060] Specifically, user emotion category refers to the user's current emotional state, such as irritability, joy, tension, anger, etc.

[0061] Specifically, user status data includes user physiological status data and user facial expressions. Based on this data, the user's current emotional state can be analyzed. Therefore, the user's emotional category can be determined based on user status data.

[0062] Optionally, a pre-trained emotion category recognition model can be used to input user state data into the emotion category recognition model to determine the user's emotion category.

[0063] Specifically, users prefer different device action styles depending on their emotional state. For example, when a user is agitated, they might prefer the cleaning robot to perform actions more quickly according to commands; when a user is sad, they might prefer the cleaning robot to perform actions more gently according to commands. Therefore, the action output style in user commands can be adjusted according to the action output style corresponding to the user's emotional state.

[0064] In this embodiment, when anthropomorphizing user commands, the user's emotional category is determined based on user state data. The action output style in the user command is then adjusted according to the corresponding emotional category, ensuring that the subsequent actions of the target home appliance in executing the command are compatible with the user's emotional category. This helps reduce the abruptness and discomfort users experience when home appliances respond to user commands, improving the user experience of the smart home system.

[0065] In some embodiments, user instructions are anthropomorphized based on user status data, including: determining the user's cognitive load level based on the user status data; and decomposing the user instruction into multiple sub-instructions when the user's cognitive load level reaches a set level.

[0066] Understandably, some complex interactive tasks require repeated interactions between users and smart home systems. For such tasks, if the user needs a significant amount of time to recognize and understand the actions of the target appliance in executing the commands, the task will be executed slowly. Therefore, it is necessary to first determine the user's cognitive load level based on user status data.

[0067] Specifically, the user's cognitive load level can be used to determine their ability to understand the user command, i.e., whether they can respond to the target home appliance's action of executing the user command in a short period of time. If they cannot respond in a short time, the user command can be broken down into multiple sub-commands.

[0068] Optionally, user status data includes the user's eye movement duration and operation duration; determining the user's cognitive load level based on the user status data includes: inputting the eye movement duration and operation duration into a pre-trained load assessment model to determine the user's comprehensive load index; and determining the user's cognitive load level according to the numerical range of the comprehensive load index.

[0069] For example, as shown in Table 1 below, the correspondence between the comprehensive load index and the user's perceived load level is as follows: Table 1

[0070] Optionally, the load level can be set to medium load.

[0071] In this embodiment, when anthropomorphizing user commands based on user status data, the user's cognitive ability is taken into account to determine whether the user command should be broken down into multiple sub-commands that are more cognitively demanding on the user. This reduces the difficulty for the user to understand and operate the target home appliance after executing the command.

[0072] In some embodiments, user state data includes a user's facial image; anthropomorphizing user instructions based on the user state data includes: determining the current user's identity based on the user's facial image; determining a target action style corresponding to the current user's identity; and adjusting the action output style in the user instructions to the target action style.

[0073] In this embodiment, considering the different preferences and habits of different users, when anthropomorphizing user commands, the current user's identity is determined based on the user's facial image, and the action output style in the user command is adjusted to the target action style corresponding to the current user's identity. This allows the subsequent actions of the target home appliances to adapt to the user's preferences or habits. This helps reduce the abruptness and discomfort users experience when home appliances respond to user commands, improving the user experience of the smart home system.

[0074] This disclosure provides another control method for smart home systems, such as... Figure 4 As shown, the control method includes: S401: Upon receiving a user instruction, the processor acquires user status data.

[0075] S402, the processor determines the target home appliances to be controlled in the smart home system based on user instructions.

[0076] S403, the processor performs delay and operation gradation processing on user instructions, and anthropomorphizes user instructions based on user status data to generate anthropomorphic control instructions.

[0077] S404, the processor acquires smart home environment data when the target home appliances are multiple mobile robots in a smart home system.

[0078] Specifically, smart home environment data includes spatial layout data and environmental status data of the home environment.

[0079] Specifically, if the target home appliances to be controlled are multiple mobile robots, interference and collisions may occur when these robots execute commands. Smart home environment data can be used to analyze the risks of interference and collisions. Therefore, in this case, it is necessary to acquire smart home environment data.

[0080] The S405 processor plans the movement trajectories of each mobile robot based on smart home environment data.

[0081] Specifically, based on smart home environment data, it's possible to analyze whether interference or collisions will occur when multiple mobile robots move. This allows for the determination of the motion trajectory of each mobile robot's commands while avoiding collisions.

[0082] Optionally, a swarm cooperative scheduling algorithm (e.g., Dijkstra's algorithm or artificial potential field method) can be used for motion trajectory planning.

[0083] S406, the processor sends anthropomorphic control commands and motion trajectories to the corresponding mobile robot.

[0084] Specifically, anthropomorphic control commands include the specific actions and task requirements that the mobile robot needs to perform, such as the cleaning mode of a cleaning robot and the delivery speed of a food delivery robot. By synchronously sending the anthropomorphic control commands and motion trajectories to the corresponding mobile robots, the mobile robots can receive and parse this information and execute the anthropomorphic control commands according to the planned motion trajectory. This avoids interference or collisions between mobile robots when executing anthropomorphic control commands.

[0085] In this embodiment, before sending the anthropomorphic control command to the target home appliance, it is determined whether the target home appliance is one of multiple mobile robots in the smart home system. If it is one of multiple mobile robots, the movement trajectory of each mobile robot is planned based on the smart home environment data, and the movement trajectory is sent synchronously when the anthropomorphic control command is sent to the mobile robot. This avoids interference or collisions when multiple mobile robots execute the anthropomorphic control command.

[0086] Combination Figure 5 As shown in the figure, this disclosure provides a control device 500 for a smart home system, including: an acquisition module 501, a determination module 502, a humanization processing module 503, and an interaction module 504. The acquisition module 501 is used to acquire user status data upon receiving a user instruction. The determination module 502 is used to determine the target home appliance to be controlled in the smart home system based on the user instruction. The humanization processing module 503 is used to perform delay and operation gradation processing on the user instruction, and to humanize the user instruction based on the user status data to generate humanized control instructions. The interaction module 504 is used to send the humanized control instructions to the target home appliance so that the target home appliance can act according to the humanized control instructions.

[0087] Combination Figure 6 As shown, this disclosure provides a control device 600 for a smart home system, including a processor 601 and a memory 602. Optionally, the device may further include a communication interface 603 and a bus 604. The processor 601, communication interface 603, and memory 602 can communicate with each other via the bus 604. The communication interface 603 can be used for information transmission. The processor 601 can call logical instructions in the memory 602 to execute the control method for a smart home system described in the above embodiment.

[0088] Furthermore, the logic instructions in the aforementioned memory 602 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium.

[0089] The memory 602, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of this disclosure. The processor 601 executes functional applications and data processing by running the program instructions / modules stored in the memory 602, thereby implementing the control method for the smart home system described above.

[0090] The memory 602 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the terminal device. Furthermore, the memory 602 may include high-speed random access memory and may also include non-volatile memory.

[0091] This disclosure provides a computer-readable storage medium storing computer-executable instructions configured to perform the control method for a smart home system described above.

[0092] The technical solutions of this disclosure can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes one or more instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in this disclosure. The aforementioned storage medium can be a non-transitory storage medium, such as a USB flash drive, external hard drive, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk, etc., and other media capable of storing program code.

[0093] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this application is for describing embodiments only and is not intended to limit the claims. As used in the description of embodiments and claims, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or” as used in this application means including one or more of the associated listed items and all possible combinations thereof. Additionally, when used in this application, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0094] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0095] The methods and products disclosed in the embodiments herein (including but not limited to devices and equipment) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units may be merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to implement this embodiment according to actual needs. In addition, the functional units in the embodiments of this disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0096] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. Each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

Claims

1. A control method for a smart home system, characterized in that, include: Upon receiving a user instruction, retrieve user status data; The target home appliances to be controlled in the smart home system are determined according to user instructions. User commands are delayed and their operation is gradually changed. User commands are also anthropomorphized based on user status data to generate anthropomorphic control commands. Anthropomorphic control commands are sent to the target home appliances so that the target home appliances can act according to the anthropomorphic control commands.

2. The control method according to claim 1, characterized in that, Delaying and grading user commands, including: Set a delay time for the execution of user commands; The changes in some actions output in the user's instructions are completed using a non-instantaneous gradual change method.

3. The control method according to claim 1, characterized in that, The user commands are personified based on the user's status data, including: Determine the user's emotional category based on user status data; Adjust the action output style in user commands according to the action output style corresponding to the user's emotional category.

4. The control method according to claim 1, characterized in that, The user commands are personified based on the user's status data, including: Determine the user's cognitive load level based on user status data; When the user's cognitive load level reaches a set level, the user's instruction is broken down into multiple sub-instructions.

5. The control method according to claim 4, characterized in that, User status data includes the user's eye movement duration and operation duration; Determine the user's cognitive load level based on user status data, including: The eye-tracking duration and operation duration are input into the pre-trained workload assessment model to determine the user's comprehensive workload index; The user's perceived load level is determined based on the numerical range of the comprehensive load index.

6. The control method according to claim 1, characterized in that, User status data includes the user's facial image; user commands are anthropomorphized based on the user status data, including: The user's identity is determined based on their facial image; Determine the target action style corresponding to the current user's identity; Adjust the action output style in the user command to match the target action style.

7. The control method according to any one of claims 1 to 6, characterized in that, Before sending anthropomorphic control commands to the target home appliance, the control method also includes: In the case where the target home appliances are multiple mobile robots in a smart home system, acquire smart home environment data; Based on smart home environment data, plan the movement trajectories of each mobile robot; When sending anthropomorphic control commands to the target home appliance, the motion trajectory is sent simultaneously.

8. A control device for a smart home system, characterized in that, include: The acquisition module is used to acquire user status data upon receiving a user instruction. The determination module is used to determine the target home appliances to be controlled in the smart home system based on user instructions. The anthropomorphic processing module is used to delay and gradually change user commands, and to anthropomorphize user commands based on user status data to generate anthropomorphic control commands. The interaction module is used to send anthropomorphic control commands to the target home appliance so that the target home appliance can act according to the anthropomorphic control commands.

9. A control device for a smart home system, comprising a processor and a memory storing program instructions, characterized in that, The processor is configured to execute, when running the program instructions, the control method for a smart home system as described in any one of claims 1 to 7.

10. A smart home system, characterized in that, include: Multiple home appliances; The control device for a smart home system as described in claim 8 or 9 is communicatively connected to multiple home appliances.

Images