Method, device and equipment for controlling smart home system equipment, and storage medium

Abstract

The invention relates to the technical field of intelligent equipment, and discloses a method, a device and equipment for controlling intelligent home system equipment, and a storage medium. The method comprises the following steps: acquiring current linkage relationship information between devices from the devices of the smart home system; a current linkage relation graph matched with the current linkage relation information is displayed on the human-computer interaction interface, and the current linkage relation graph is a visual graph representing equipment linkage logic; and performing linkage control on the equipment according to the current linkage relation graph. Thus, by visually displaying and conveniently editing the equipment linkage relationship, a user can visually understand and easily adjust the intelligent home system, the operation difficulty is greatly reduced, the user can more rapidly enjoy the convenience and comfort brought by the intelligent home, and the intelligence of equipment control and the user experience are further improved.

Description

Technical Field

[0001] This application relates to the field of smart device technology, such as methods, apparatus, devices, and storage media for controlling devices in smart home systems. Background Technology

[0002] With the development of the smart home market, various brands and functions of smart home devices are constantly emerging. However, the technological development in areas such as device collaboration, scenario construction and expansion, and the rational allocation of resources is relatively lagging behind, making it difficult to meet users' needs for convenient, efficient, and personalized smart home systems.

[0003] In this case, device-to-device linkage requires setting linkage rules separately in the settings interface of each device, which is complex and the linkage relationship between devices is not intuitive. For example, to set an air conditioner to link with a humidifier based on temperature and humidity sensor data, you need to enter the control apps of the air conditioner, temperature and humidity sensor, and humidifier separately, and configure the conditions and actions in turn. This is difficult for many users to operate and makes it hard to clearly understand the overall linkage logic.

[0004] Creating similar smart home scenarios in different spaces requires manually resetting scenario parameters on each central control screen or device. For example, if a movie-watching mode scenario is set up in the living room, creating a similar scenario in the bedroom requires reconfiguring lighting brightness, curtain opening / closing, TV and speaker settings, etc., wasting a lot of time and effort.

[0005] Furthermore, the pre-defined functions of each brand's devices cannot be integrated. Additionally, each brand's devices execute tasks independently, lacking unified scheduling. Moreover, when multiple devices can complete the same task, the system randomly selects a device to execute the task. All of these factors can lead to low task completion efficiency and wasted resources.

[0006] It is evident that in current smart home scenarios, the process of device control is not intelligent enough, and the efficiency of task completion and resource conservation still need to be improved.

[0007] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this application, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0008] To provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended as a general commentary, nor is it intended to identify key / important components or describe the scope of protection of these embodiments, but rather as a prelude to the detailed description that follows.

[0009] This disclosure provides a method, apparatus, device, and storage medium for controlling devices in a smart home system, addressing technical issues such as the need to improve the intelligence of home device control.

[0010] In some embodiments, the method includes: Obtain information on the current interconnectivity between devices in the smart home system; On the human-computer interaction interface, a current linkage relationship graph matching the current linkage relationship information is displayed. The current linkage relationship graph is a visual graph representing the linkage logic of the devices. Based on the current linkage diagram, the equipment is controlled in a coordinated manner.

[0011] In this way, by obtaining the current linkage information between devices in the smart home system and displaying it in the form of a graph on the human-computer interaction interface, users can intuitively understand the linkage relationships between devices, improving the transparency of device control and the efficiency of user comprehension. Furthermore, by controlling devices based on this current linkage graph, more precise collaborative work between devices can be ensured, avoiding control errors caused by unclear device linkage relationships, and further improving the efficiency of device control.

[0012] In some embodiments, the method further includes: upon receiving a graph editing instruction corresponding to a user's operation on the human-computer interaction interface, updating the current linkage relationship information, obtaining the updated linkage relationship information, and displaying a linkage relationship graph that matches the updated linkage relationship information, wherein the operation includes: dragging, adding, or deleting.

[0013] This allows users to operate on the human-computer interaction interface, such as dragging, adding, and deleting, to update the linkage relationship between devices, greatly enhancing the flexibility of device control configuration. Users can quickly adjust the settings of the smart home system according to their own needs, and can update and display new linkage relationship diagrams in real time, thus improving the user experience.

[0014] In some embodiments, the method further includes: when it is determined that the conditions for scene reproduction are met, sending the scene control information corresponding to the current scene to the central control device corresponding to the scene to be reproduced via the NFC communication module for corresponding scene control.

[0015] In this way, the control information of the current scene can be quickly sent to the central control device corresponding to the scene to be reproduced through the NFC communication module, realizing the rapid reproduction of the scene and greatly improving the convenience of user experience and the practicality of the smart home system.

[0016] In one embodiment, it further includes: Based on a combined rule base, corresponding virtual devices are created according to the capability information of two or more devices in a smart home system. The combined rule base is built based on the complementarity and correlation of device functions. Based on the control interface information and functional implementation logic information of the virtual device, it is displayed in the linkage relationship diagram.

[0017] Therefore, by creating virtual devices based on a combined rule base and device capability information, the functions of different devices can be integrated to form more powerful comprehensive functional devices, expanding the system's functional scope. Furthermore, the control interfaces and functional implementation logic of virtual devices can be displayed in the linkage relationship graph, which not only enriches the information content of the graph but also allows users to directly understand the functional details of virtual devices, improving system usability and user trust in the system.

[0018] In some embodiments, creating the corresponding virtual device includes: Based on the combination rule base, the combination schemes for each capability corresponding to the current scenario are obtained; Based on the optimization algorithm, the optimal capability combination scheme is determined from the capability combination schemes, and control interface information and function implementation logic information are defined for the virtual device according to the optimal capability combination scheme.

[0019] It is evident that optimization algorithms can be used to determine the optimal solution from multiple capability combinations, ensuring that the functional combination of virtual devices is optimized, thereby improving resource utilization efficiency and overall system performance.

[0020] In some embodiments, it also includes: Natural language processing technology is used to parse the received task request for the current scene, obtain the key information of the current task, and determine the first current device corresponding to the key information of the current task. Based on the current status information of the first current device and the preset task priority, the optimal task allocation scheme is determined through a scheduling algorithm, and the corresponding first current device is controlled according to the optimal task allocation scheme.

[0021] In this way, through natural language processing technology and scheduling algorithms, the system can intelligently parse task requests and determine the optimal task allocation scheme, improving the efficiency and accuracy of task processing, and further enhancing the system's intelligence level and user satisfaction.

[0022] In some embodiments, it also includes: Identify each second current device corresponding to the task in the current scenario, and perform energy consumption and reliability analysis based on the capability information of the second current device and historical device information to obtain the corresponding comprehensive device score. The historical device information includes: historical energy consumption information, failure rate information, and maintenance record information. Based on the comprehensive equipment score, one or more second current devices are identified as the current execution devices, and corresponding control is performed on the current execution devices.

[0023] Therefore, by analyzing information such as historical energy consumption, failure rate, and maintenance records of the equipment, a comprehensive equipment score is calculated, providing users with a clear assessment of equipment performance. Prioritizing the selection of equipment with low energy consumption and high reliability to perform tasks not only reduces the system's operating costs but also improves the system's stability and reliability, and extends the equipment's service life.

[0024] In some embodiments, the apparatus includes a processor and a memory storing program instructions, wherein the processor is configured to execute the method described above for controlling smart home system devices when executing the program instructions.

[0025] In some embodiments, the device includes: a device body; The aforementioned device for controlling smart home system equipment is installed on the main body of the device.

[0026] In some embodiments, the storage medium stores program instructions that, when executed, perform the above-described method for controlling smart home system devices.

[0027] The method, system, and storage medium for controlling smart home system devices provided in this disclosure can achieve the following technical effects: By visually displaying and easily editing device linkage relationships, users can intuitively understand and easily adjust the smart home system, greatly reducing the difficulty of operation and enabling users to enjoy the convenience and comfort brought by smart homes more quickly, further improving the intelligence of device control and user experience.

[0028] The above general description and the description below are exemplary and illustrative only and are not intended to limit this application. Attached Figure Description

[0029] One or more embodiments are illustrated by way of example with reference to the accompanying drawings. These illustrations and drawings do not constitute a limitation on the embodiments. Elements having the same reference numerals in the drawings are shown as similar elements. The drawings are not to be scaled. And wherein: Figure 1 This is a schematic diagram of a control system for a smart home system provided in an embodiment of the present disclosure; Figure 2 This is a schematic flowchart of a method for controlling devices in a smart home system, provided in an embodiment of this disclosure. Figure 3This is a schematic flowchart of a method for controlling devices in a smart home system, provided in an embodiment of this disclosure. Figure 4 This is a schematic flowchart of a method for controlling devices in a smart home system, provided in an embodiment of this disclosure. Figure 5 This is a schematic flowchart of a method for controlling devices in a smart home system, provided in an embodiment of this disclosure. Figure 6 This is a schematic diagram of a device control apparatus for a smart home system provided in an embodiment of this disclosure; Figure 7 This is a schematic diagram of a device control apparatus for a smart home system provided in an embodiment of this disclosure; Figure 8 This is a schematic diagram of a device provided in an embodiment of this disclosure. Detailed Implementation

[0030] To provide a more detailed understanding of the features and technical content of the embodiments of this disclosure, the implementation of the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for illustrative purposes only and are not intended to limit the embodiments of this disclosure. In the following technical description, for ease of explanation, several details are used to provide a full understanding of the disclosed embodiments. However, one or more embodiments may still be implemented without these details. In other cases, well-known structures and devices may be simplified in their depiction to simplify the drawings.

[0031] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this disclosure described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0032] Unless otherwise stated, the term "multiple" means two or more.

[0033] In this embodiment of the disclosure, the character " / " indicates that the objects before and after it are in an "or" relationship. For example, A / B means: A or B.

[0034] The term "and / or" describes an association between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or A and B.

[0035] In this embodiment, through visual display and convenient editing of device linkage relationships, users can intuitively understand and easily adjust the smart home system. It supports users customizing and optimizing device linkage logic through simple operations (such as dragging, adding, and deleting). It also allows users to flexibly create virtual devices according to their needs, integrating the functions of different devices, enabling users to enjoy the convenience and comfort brought by smart homes more quickly, and improving the intelligence and practicality of the smart home system. Precise control is achieved through a device relationship graph, while natural language processing technology and scheduling algorithms intelligently analyze tasks and allocate resources to ensure efficient task execution. Furthermore, energy consumption and reliability analysis selects the optimal device to execute tasks, reducing energy consumption and extending device lifespan. Of course, NFC technology can also be used to quickly transmit scene control information, enabling rapid scene reproduction, further improving the intelligence and practicality of the smart home system, providing users with a more intelligent, convenient, and efficient living environment, and further enhancing the user experience.

[0036] Figure 1 This is a schematic diagram of a structure for a smart home system provided in an embodiment of this disclosure. Figure 1 As shown, the system includes a central control device 100 and home appliances 200. The central control device 100 can be a single device, such as a remote control, or a home appliance, such as a television, a smart speaker, etc. A smart home system can have only one central control device or multiple central control devices. For example, a smart home system may have only one central control device located in the living room, or each room may have one central control device.

[0037] Home appliances 200 may include: televisions, speakers, air conditioners, humidifiers, smart curtains, lights, robots, etc. Robots may include: robot vacuum cleaners, window cleaning robots, cooking robots, etc.

[0038] The central control device 100 can communicate with each home appliance 200, or the central control device 100 can communicate with each home appliance 200 within a set area, but the central control devices 100 can communicate with each other. In this way, the central control device 100 can obtain the status information of the corresponding home appliance 200, and can also send corresponding control commands to the home appliance 200 to control it to perform the corresponding operation.

[0039] In the smart home system of this embodiment, the central control device 100 can perform linkage control on the devices 200 in the system, and can also realize scene reproduction, as well as device scheduling and selection, etc. Figure 2 As shown, the process of controlling smart home system devices includes: Step 201: Obtain the current linkage information between devices from the smart home system.

[0040] In this embodiment of the disclosure, the central control device can communicate with the corresponding device, and can obtain information on the established linkage relationship between the devices through communication with the devices, such as which devices participate in the linkage, linkage conditions and actions, etc.

[0041] The central control device can store device registration information, recording basic information and corresponding linkage relationships of communicable devices. When a new device enters the smart home system, the central control device establishes corresponding communication with it (e.g., LAN, Wi-Fi, Bluetooth, Zigbee), and registers accordingly, recording device information such as device ID, type, communication protocol, linkage conditions, and linkage actions in the device registration information. Furthermore, the central control device can periodically send query requests to the corresponding devices to obtain the latest linkage relationship information and update the locally stored registration information. Alternatively, when a device's linkage relationship changes (e.g., adding, deleting, or modifying linkage conditions), it proactively sends an update notification to the central control device, which immediately updates its locally stored registration information upon receiving the notification.

[0042] Therefore, the central control equipment can obtain information on the linkage relationship between devices, and at the current moment, obtain information on the current linkage relationship between devices.

[0043] Step 202: On the human-computer interaction interface, display the current linkage relationship map that matches the current linkage relationship information. The current linkage relationship map is a visual map that represents the linkage logic of the devices.

[0044] In a smart home system, devices are virtually represented as nodes in the current interconnection graph, and the interconnections between devices are virtually represented as logical edges between nodes in the current interconnection graph.

[0045] The central control device will dynamically display the current linkage information it acquires in the form of a graph on the human-machine interface of the central control device, using graphics and lines to intuitively present the relationship between devices, such as the linkage between air conditioner and temperature and humidity sensor, humidifier.

[0046] In this system, the central control equipment can use a graphical layout algorithm to display devices as nodes, and the linkage relationships between devices as logical edges. That is, devices are virtually represented as nodes in a linkage graph, and the linkage relationships between devices are virtually represented as logical edges between nodes in the linkage graph. Force-directed layout algorithm is a graphical layout algorithm that can simulate the attractive and repulsive forces between nodes in a physical system, making the graphical layout more aesthetically pleasing and intuitive.

[0047] For example, a smart home system includes devices such as air conditioners, temperature and humidity sensors, humidifiers, and smart curtains. The central control device obtains current linkage information, including the linkage between the air conditioner and the humidifier based on temperature and humidity sensor data, and the linkage between the smart curtains and the light sensor data, where the air conditioner automatically opens and closes. Therefore, the central control device can use a force-directed layout algorithm to display each device node and its linkage logic on the central control screen. That is, the air conditioner, temperature and humidity sensor, humidifier, and smart curtains are virtually represented as nodes in the current linkage graph, and the node corresponding to the air conditioner is connected to the nodes corresponding to the temperature and humidity sensor and the humidifier, while the node corresponding to the smart curtains is connected to the node corresponding to the light sensor.

[0048] Step 203: Perform linkage control on the equipment according to the current linkage relationship diagram.

[0049] The central control device can parse the current linkage relationship graph, read the nodes and logical edges in the current linkage relationship graph, parse out each corresponding device, as well as the linkage conditions and actions of each device, and obtain the current device status of the corresponding device. When it is determined that the corresponding linkage conditions are met based on the current device status, the corresponding control command is generated according to the linkage action and sent to the corresponding device to enable the device to perform the corresponding operation.

[0050] For example, a smart home system may contain devices such as air conditioners, temperature and humidity sensors, humidifiers, and smart curtains. After obtaining the current linkage relationship map of the smart home system, the central control device analyzes the map. The analyzed devices include air conditioners, humidity sensors, and humidifiers. The humidity sensor monitors the humidity. If the current humidity value is less than the set value, it can be determined that the corresponding linkage condition is met. Then, a start command can be sent to the air conditioner and humidifier. Upon receiving the command, the air conditioner turns on, and the humidifier also starts working, increasing the humidity in the corresponding area.

[0051] As can be seen, in this embodiment of the disclosure, by obtaining the current linkage relationship information between devices in the smart home system and displaying it in the form of a graph on the human-computer interaction interface, users can intuitively understand the linkage relationship between devices, improving the transparency of device control and the user's understanding efficiency. Furthermore, by performing linkage control on the devices based on the current linkage relationship graph, it ensures that the devices work collaboratively according to the preset linkage relationship, realizing the automated and intelligent control of the smart home system. It also avoids control errors caused by unclear device linkage relationships, further improving the efficiency of device control.

[0052] Of course, the linkage relationship diagram displayed on the human-machine interface of the central control device is dynamic and can reflect changes in the device status in real time, such as the device's online / offline status and dynamic changes in linkage relationships. Furthermore, it can interact with the user; that is, the user can view detailed device information or adjust the device's position through interactive operations, and can also edit the diagram. In some embodiments, upon receiving a diagram editing command corresponding to a user's operation on the human-machine interface, the current linkage relationship information is updated to obtain the updated linkage relationship information, and a linkage relationship diagram matching the updated linkage relationship information is displayed. The operations include dragging, adding, or deleting.

[0053] For example, a smart home system might include devices like air conditioners, temperature and humidity sensors, humidifiers, and smart curtains. The linkage information might include a connection where the smart curtains automatically open and close based on light sensor data. However, in summer, users might find it more comfortable when the smart curtains open when the air conditioner is on. Therefore, users can modify the linkage graph displayed on the human-machine interface. For instance, clicking the "Add" button creates a new linkage rule with the condition that the air conditioner is on and the action that the smart curtains close. When the central control device receives the "Add" command, it updates the current linkage information and creates a virtual logical boundary between the smart curtains and the air conditioner. This allows it to monitor the air conditioner's operation, and once the air conditioner is turned on at a set time (summer), it sends an opening command to the smart curtains, causing them to open. Users can also drag and delete nodes and lines in the linkage graph on the central control device's human-machine interface, among other things. This allows users to easily customize the linkage relationships between smart home devices by editing the graph, further improving the user experience.

[0054] In a smart home system, there may be one, two, or more central control devices. Therefore, in some embodiments, the scene configuration of the source central control device can be quickly copied to the target central control device via NFC touch. This also includes: when the scene reproduction conditions are met, sending the scene control information corresponding to the current scene to the central control device corresponding to the scene to be reproduced via the NFC communication module for corresponding scene control.

[0055] In a smart home system, each central control device can display a diagram of the linkage relationships between devices. In this way, the central control device, i.e. the source central control device, can obtain the current device status information corresponding to each device in the current scene, such as the brightness of the smart light being 50%. It can also obtain the linkage rules, actions, etc. between devices. That is, the central control device can obtain the scene control information corresponding to the current scene, and can encode this control information and package it into a data packet according to the NFC communication protocol format.

[0056] Therefore, when the central control device corresponding to the scene to be reproduced and the target central control device make NFC contact with the source central control device, it can be determined that the scene reproduction conditions are met. Then, the source central control device can send the packaged data packet to the target central control device through the NFC communication module. After receiving the data packet, the target central control device performs corresponding decoding and verification to ensure the integrity and correctness of the data. Then, according to the parsed scene control information, it performs corresponding scene control. Of course, it can also update the saved linkage relationship information according to the device status information and linkage rule information included in the scene control information to obtain the updated linkage relationship information and display the linkage relationship map that matches the updated linkage relationship information.

[0057] For example, if the current scene in the living room is a relaxation mode, the scene control information obtained by the living room central control device includes: smart light brightness at 30%, curtains open, and soft music playing from the speaker. After the bedroom central control device touches the living room central control device via NFC, the bedroom central control device receives the corresponding scene control information and can perform corresponding scene control based on this information. This means controlling the bedroom smart light brightness to 30%, opening the bedroom curtains, and starting the bedroom music player to play soft music, thus quickly replicating the relaxation mode scene in the bedroom. Of course, the bedroom central control device can also display a diagram showing the interaction between the lights, curtains, music player, etc., on its screen.

[0058] As can be seen, the NFC communication module can quickly send the control information of the current scene to the central control device corresponding to the scene to be reproduced, realizing the rapid reproduction of the scene and greatly improving the convenience of user experience and the practicality of the smart home system.

[0059] A smart home system contains multiple devices, each with its own preset functions. For example, a robot vacuum cleaner has a cleaning function, and an air quality detector has an air quality detection function. In some embodiments of this disclosure, the capabilities of different brands of devices can be analyzed and combined to generate new virtual devices, thus fully exploring the potential of the devices and meeting users' needs for diverse and personalized functions. Therefore, the process of controlling devices in a smart home system also includes: creating corresponding virtual devices based on a combination rule base and the capability information of two or more devices in the smart home system. The combination rule base is constructed based on the complementarity and correlation of device functions; and displaying the virtual devices in a linkage relationship graph based on the control interface information and functional implementation logic information of the virtual devices.

[0060] The central control unit can acquire capability information from different devices and classify and label it. For example, the cleaning capability of a sweeper can be quantified into indicators such as cleaning area and cleaning efficiency, while the detection capability of an air quality monitoring device can be quantified into indicators such as detection accuracy and detection range. Then, a pre-set combination rule library is used to find compatible device capabilities. This rule library is built based on the complementarity and correlation of device functions. For example, the combination rule for a sweeper with air purification function is to combine the sweeper's cleaning function with the air quality monitoring device's detection function. Once compatible device capabilities are found, the corresponding virtual device can be created.

[0061] Among them, the composable device capabilities may be one set or multiple sets, and there may be multiple capability combination schemes. Therefore, in some embodiments, creating a corresponding virtual device includes: obtaining each capability combination scheme corresponding to the current scenario based on a combination rule base; determining the best capability combination scheme from the capability combination schemes based on an optimization algorithm; and defining control interface information and function implementation logic information for the virtual device according to the best capability combination scheme.

[0062] As can be seen, once the composable capabilities are found, that is, once the capability combination scheme is determined, optimization algorithms, such as genetic algorithms, can be used to optimize the combination scheme and determine the optimal capability combination method. Then, based on the optimal capability combination scheme, a virtual device is created, and a control interface and functional implementation logic are defined for the virtual device. Then, it can be displayed on the screen of the central control device, that is, the corresponding node of the virtual device is also in the linkage relationship diagram. Thus, the user can control the virtual device through the central control device.

[0063] For example, a smart home system may contain multiple devices, each with its own preset functions. A robotic vacuum cleaner has a cleaning function, while an air quality monitor has an air quality detection function. The central control device acquires the capability information of a robotic vacuum cleaner from brand A and an air quality monitor from brand B, performs quantification and standardization, and determines, based on a combination rule base, which can be used to combine the cleaning function of the robotic vacuum cleaner with the detection function of the air quality monitor. A genetic algorithm is used to optimize the combination scheme, determining that the optimal combination is the one where the air quality monitor detects air quality in real time, and the robotic vacuum cleaner focuses its cleaning on polluted areas based on air quality. This generates a virtual device called "Automatic Purification Robot," defines its control interface, and displays the linkage relationship diagram on the screen. Users can then start and stop this virtual device through the central control device, achieving virtual aggregation of device functions. It is evident that analyzing, combining, and optimizing device capabilities to generate new virtual devices expands the application scope of smart home systems and meets users' personalized functional needs.

[0064] In a smart home system, there may be two or more robotic devices, such as a robotic vacuum cleaner and a robotic window cleaner. For tasks requiring collaboration between two or more robotic devices, to reduce overlap in working areas and unreasonable task execution order, in some embodiments, the smart home system device control process further includes: parsing the received task request for the current scene using natural language processing technology to obtain key information about the current task and determine the first current device corresponding to that key information; determining the optimal task allocation scheme based on the current status information of the first current device and preset task priorities using a scheduling algorithm; and controlling the corresponding first current device according to the optimal task allocation scheme. There may be two or more first current devices, each with different functionalities. For example, the first current device could be a robotic vacuum cleaner or a robotic window cleaner.

[0065] Upon receiving a task request for the current scenario, which may involve collaboration among multiple robotic devices, natural language processing techniques (such as lexical analysis and syntactic analysis) can be used to parse the task request, extract the corresponding key information of the current task, and determine the first current device corresponding to the key information of the current task. For example, if the task request for the current scenario is a whole-house cleaning task request, then after parsing using natural language processing techniques, the key information of the current task can be obtained, including: cleaning, all room floors, and all windows. Thus, the corresponding first current devices can be determined to include: a robot vacuum cleaner and a window cleaning robot.

[0066] Obtain the current status information of the first current device, including: current working status, current battery level, current location information, etc. For example, obtain the current status information of the robotic vacuum cleaner and the window cleaning robot: robotic vacuum cleaner A has 80% battery and is located in the living room; robotic vacuum cleaner B has 60% battery and is located on the balcony; the window cleaning robot has 70% battery and is located in the storage room. Based on the current status information of the first current device and the preset task priorities, the optimal task allocation scheme is determined through a scheduling algorithm. This could include: robotic vacuum cleaner A cleaning the bedroom, robotic vacuum cleaner B cleaning the living room, and the window cleaning robot cleaning the living room windows after robotic vacuum cleaner B has finished cleaning the living room.

[0067] The scheduling algorithm may include: a heuristic scheduling algorithm, which may include: task allocation principles: allocating tasks based on the proximity of the device location and the task location to reduce device movement time; load balancing: balancing the workload of each device to avoid overloading some devices. For example, two robotic vacuum cleaners may clean different areas separately; task dependency handling: for tasks with dependencies, they may be allocated sequentially. For example, "wiping windows" should be done after "cleaning the floor".

[0068] It is evident that natural language processing can be used to parse tasks, and heuristic scheduling algorithms can be used to uniformly schedule multiple devices, thereby optimizing the task execution order and allocation, improving task completion efficiency, and reducing resource waste.

[0069] In a smart home system, one, two, or more devices can perform tasks in the current scenario. The optimal device can be dynamically selected based on factors such as energy consumption and reliability, reducing operating costs and improving device reliability. Specifically, in some embodiments, the device control process of the smart home system further includes: determining each second current device corresponding to the task in the current scenario; performing energy consumption and reliability analysis based on the capability information of the second current devices and historical device information to obtain a corresponding comprehensive device score. Historical device information includes historical energy consumption information, failure rate information, and maintenance record information. Based on the comprehensive device score, one or more second current devices are determined as the current execution devices, and corresponding control is applied to these devices. Each second current device may have shared functionalities. For example, a second current device could be a humidifier or an air conditioner with humidification function.

[0070] After the central control device identifies each secondary current device corresponding to the task in the current scenario, it can obtain the capability information of each secondary current device through the interface provided by the device, such as the humidification capacity and humidification speed of a humidifier. Then, based on the device capability information and historical energy consumption data, an energy consumption prediction model, such as a linear regression model, is established. The capability information of each secondary current device can be input into the model to predict the energy consumption of each secondary current device to complete the current task. Furthermore, by collecting device failure rate data and maintenance records, reliability assessment algorithms, such as Bayesian network algorithms, can be used to evaluate the reliability of each secondary current device. Historical device information includes historical energy consumption information, failure rate information, and maintenance record information. Based on the weights set for energy consumption and reliability, such as an energy consumption weight of 0.6 and a reliability weight of 0.4, a weighted summation method is used to calculate the comprehensive score of each device. Finally, the secondary current device with the highest comprehensive score is selected to execute the task. For example, in a humidification task, given humidifier A and humidifier B, a trained energy consumption prediction model predicts that humidifier A will consume 2 kWh and humidifier B will consume 3 kWh. Furthermore, the reliability of humidifier A is evaluated as 0.9 and that of humidifier B as 0.8. Therefore, the weighted calculation yields a comprehensive score of 0.76 for humidifier A and 0.32 for humidifier B. Finally, humidifier A can be selected to perform the humidification task.

[0071] It is evident that by establishing energy consumption prediction models, reliability assessment algorithms, and comprehensive evaluation mechanisms, the optimal equipment can be dynamically selected, thereby reducing operating costs and improving equipment reliability.

[0072] The following describes the operation process in a specific embodiment, illustrating the process for controlling smart home system devices provided by the embodiments of the present invention.

[0073] In this embodiment of the disclosure, the smart home system is as follows: Figure 1 As shown, the central control device can be a central control screen, and the equipment can include: television, air conditioner, curtains, lights, robot equipment, and various sensors, etc.

[0074] Figure 3 This is a flowchart illustrating a method for controlling devices in a smart home system, as provided in an embodiment of this disclosure. Figure 3 As shown, the process of controlling smart home system devices includes: Step 301: The central control screen obtains the current linkage information between devices.

[0075] Step 302: The central control screen determines and displays the current linkage relationship map corresponding to the current linkage relationship information based on the force-oriented layout algorithm.

[0076] In this context, devices in the smart home system are virtual nodes in the current linkage graph, and the linkage relationships between devices are virtual logical edges between nodes in the current linkage graph. In other words, the current linkage graph is a visual graph representing the linkage logic of devices.

[0077] Step 303: The central control screen performs linkage control on the devices based on the current linkage relationship diagram.

[0078] Step 304: Determine whether the graph editing command corresponding to the user's operation on the human-computer interaction interface has been received. If yes, proceed to step 305; otherwise, proceed to step 306.

[0079] Step 305: The central control screen updates the current linkage relationship information, obtains the updated linkage relationship information, confirms it as the current linkage relationship information, and returns to step 302.

[0080] Step 306: Has an NFC touch been made with the target central control screen? If yes, proceed to step 307; otherwise, return to step 303.

[0081] Step 307: The central control screen sends the scene control information corresponding to the current scene to the target central control screen corresponding to the scene to be reproduced through the NFC communication module, so that the target central control screen performs the corresponding scene control according to the scene control information and returns to step 303.

[0082] In this way, by acquiring information about the interconnected relationships between devices and displaying it in a graphical format, users can intuitively understand the collaborative working status of the devices. It also supports user-edited commands, allowing for real-time updates of the interconnected relationships and reflection in the graph and device control, greatly enhancing flexibility and real-time performance. Users can easily view device details, edit the graph, and adjust device positions, lowering the barrier to entry and improving the interactive experience. Furthermore, it improves device management efficiency, ensuring devices work accurately and collaboratively according to the latest interconnected relationships, increasing the adaptability and scalability of the smart home system, and easily handling different user needs and complex scenario changes. Of course, NFC technology can also be used to quickly recreate scenarios, enhancing convenience. This further optimizes the management and control experience of smart home devices.

[0083] Figure 4 This is a flowchart illustrating a method for controlling devices in a smart home system, as provided in an embodiment of this disclosure. Figure 4 As shown, the process of controlling smart home system devices includes: Step 401: The central control screen acquires the capability information of two or more devices in the smart home system.

[0084] Step 402: Based on the acquired capability information and the combination rule base, the central control screen obtains the capability combination scheme corresponding to each scenario.

[0085] The central control screen categorizes and labels the capability information of different devices. For example, the cleaning capability of a sweeper is quantified into indicators such as cleaning area and cleaning efficiency, while the detection capability of an air quality monitoring device is quantified into indicators such as detection accuracy and detection range. Then, through a preset combination rule library, it finds compatible device capability combination rules based on the complementarity and correlation of device functions.

[0086] Step 403: The central control screen uses a genetic algorithm to determine the optimal capability combination scheme from the capability combination schemes.

[0087] Step 404: The central control screen generates virtual devices based on the optimal capability combination scheme, including: defining control interface information and function implementation logic information for the virtual devices.

[0088] Step 405: The central control screen updates the linkage relationship information based on the control interface information and function implementation logic information of the virtual device, and displays a linkage relationship graph that matches the updated linkage relationship information on the screen.

[0089] Step 406: The central control screen performs linkage control on the equipment according to the linkage relationship diagram.

[0090] As can be seen, in this embodiment, the device capabilities are analyzed, combined, and optimized to generate new virtual devices, which expands the application scope of the smart home system, meets the personalized functional needs of users, and uses optimization algorithms to determine the best solution from multiple capability combination schemes, ensuring that the functional combination of the virtual device is optimal, improving resource utilization efficiency and the overall performance of the system.

[0091] Based on the linkage diagram displayed on the screen, different scenarios may occur during the linkage control of the devices, and the corresponding control processes will be different.

[0092] Figure 5 This is a flowchart illustrating a method for controlling devices in a smart home system, as provided in an embodiment of this disclosure. Figure 5 As shown, the process of controlling smart home system devices includes: Step 501: The central control screen uses natural language processing technology to parse the received task request for the current scene and obtain the corresponding key information of the current task.

[0093] Step 502: Based on the key information of the current task, determine whether the current scenario is a multi-tasking scenario. If yes, proceed to step 503; otherwise, proceed to step 507.

[0094] Step 503: The central control screen determines the first current device corresponding to the current scenario based on the key information of the current task.

[0095] The first current device includes: two or more devices, each with different functions, that is, different parts of the functions included, such as: robot vacuum cleaner, window cleaning robot, air purifier, etc.

[0096] Step 504: The central control screen obtains the current status information of each first current device.

[0097] Step 505: The central control screen determines the optimal task allocation scheme based on the current status information of the first current device and the preset task priority through a scheduling algorithm.

[0098] Step 506: The central control screen controls the corresponding first current device to execute the task of the current scene according to the optimal task allocation scheme.

[0099] Step 507: The central control screen determines the second current device corresponding to the current scene.

[0100] Each second current device can independently perform the task of the current scenario. For example, the second current devices are all devices that can humidify, such as humidifiers or air conditioners with humidification functions.

[0101] Step 508: The central control screen inputs the capability information of each second current device into the energy consumption prediction model to predict the energy consumption of each second current device in completing the task of the current scenario.

[0102] The energy consumption prediction model is obtained by training based on the equipment's capacity information and historical energy consumption information.

[0103] Step 509: The central control screen evaluates the reliability of each second device based on its failure rate information and maintenance record information using a Bayesian network algorithm.

[0104] Step 510: The central control screen calculates the overall score of each second current device by weighted summation based on the energy consumption, reliability, and corresponding weights of each second current device.

[0105] Step 511: The second device with the highest overall score on the central control screen executes the task for the current scenario.

[0106] As can be seen, this embodiment achieves efficient control of devices in the smart home system through natural language processing and intelligent algorithms. In multi-task scenarios, scheduling algorithms can optimize multi-device collaboration and improve task execution efficiency; in single-task scenarios, energy consumption prediction and reliability assessment can select the optimal device to execute the task, reducing energy consumption and improving reliability. The entire process logic is clear, adaptable to scenarios of varying complexity, and enhances the system's intelligence level and user experience.

[0107] Based on the above-mentioned method for controlling devices in a smart home system, a device for controlling devices in a smart home system can be constructed and applied to central control equipment, such as... Figure 6 As shown, it includes: a linkage acquisition module 610, a construction and display module 620, and a linkage control module 630.

[0108] The linkage acquisition module 610 is configured to acquire information on the current linkage relationship between devices from the devices in the smart home system.

[0109] The display module 620 is configured to display a current linkage relationship graph that matches the current linkage relationship information on the human-computer interaction interface. The current linkage relationship graph is a visual graph that represents the linkage logic of the devices.

[0110] The linkage control module 630 is configured to perform linkage control on the equipment based on the current linkage relationship diagram.

[0111] In some embodiments, the system further includes an editing and updating module, configured to update the current linkage relationship information, obtain the updated linkage relationship information, and display the linkage relationship graph that matches the updated linkage relationship information when a graph editing instruction corresponding to a user's operation action on the human-computer interaction interface is received. The operation action includes dragging, adding, or deleting.

[0112] In some embodiments, the system further includes a scene reproduction module, configured to, when the scene reproduction conditions are met, send the scene control information corresponding to the current scene to the central control device corresponding to the scene to be reproduced via the NFC communication module for corresponding scene control.

[0113] In some embodiments, it also includes: The virtual creation module is configured to create corresponding virtual devices based on a combined rule base and the capability information of two or more devices in the smart home system. The combined rule base is built based on the complementarity and correlation of device functions.

[0114] The virtual display module is configured to display information in the linkage diagram based on the control interface information and functional implementation logic information of the virtual device.

[0115] In some embodiments, the virtual creation module is specifically configured to obtain each capability combination scheme corresponding to the current scenario based on a combination rule base; determine the best capability combination scheme from the capability combination schemes based on an optimization algorithm; and define control interface information and function implementation logic information for the virtual device according to the best capability combination scheme.

[0116] In some embodiments, the system further includes: a scheduling and allocation module, configured to parse the received task request of the current scenario using natural language processing technology to obtain key information of the current task and determine the first current device corresponding to the key information of the current task; determine the optimal task allocation scheme through a scheduling algorithm based on the current status information of the first current device and a preset task priority, and control the corresponding first current device according to the optimal task allocation scheme.

[0117] In some embodiments, the system further includes: a capability bidding module, configured to determine each second current device corresponding to the task in the current scenario, and to perform energy consumption and reliability analysis based on the capability information of the second current device and historical device information to obtain a corresponding comprehensive device score, wherein the historical device information includes: historical energy consumption information, failure rate information, and maintenance record information; and to determine one or more second current devices as the current execution device based on the comprehensive device score, and to perform corresponding control on the current execution device.

[0118] As can be seen, in this embodiment, the device for controlling smart home system devices improves the intelligence and user experience of device control through visual display and convenient editing of device linkage relationships. It also allows for the flexible creation of virtual devices according to needs, integrating the functions of different devices, enabling users to enjoy the convenience and comfort brought by smart homes more quickly, and enhancing the intelligence and practicality of the smart home system. Precise control is achieved through a device relationship graph, while natural language processing technology and scheduling algorithms intelligently analyze tasks and allocate resources to ensure efficient task execution. Furthermore, energy consumption and reliability analysis selects the optimal device to execute tasks, reducing energy consumption and extending device lifespan. Of course, NFC technology can also be used to quickly transmit scene control information, enabling rapid scene reproduction, further improving the intelligence and practicality of the smart home system, providing users with a more intelligent, convenient, and efficient living environment, and further enhancing the user experience.

[0119] This disclosure provides a device 700 for controlling smart home system devices, the structure of which is as follows: Figure 7 As shown, it includes: The processor 1000 and memory 1001 may further include a communication interface 1002 and a bus 1003. The processor 1000, communication interface 1002, and memory 1001 can communicate with each other via the bus 1003. The communication interface 1002 can be used for information transmission. The processor 1000 can call logical instructions stored in the memory 1001 to execute the method for controlling smart home system devices described in the above embodiments.

[0120] Furthermore, the logic instructions in the aforementioned memory 1001 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium.

[0121] The memory 1001, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of this disclosure. The processor 1000 executes functional applications and data processing by running the program instructions / modules stored in the memory 1001, that is, it implements the method for controlling smart home system devices in the above method embodiments.

[0122] The memory 1001 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the terminal device. Furthermore, the memory 1001 may include high-speed random access memory and may also include non-volatile memory.

[0123] This disclosure provides a device for controlling smart home system devices, including: a processor and a memory storing program instructions, wherein the processor is configured to execute a method for controlling smart home system devices when executing the program instructions.

[0124] This disclosure provides a device, which can be a central control screen, a mobile terminal, or other central control device. Figure 8 As shown, the system includes: a device body 800, and the aforementioned device 600 (700) for controlling smart home system devices, which is installed in the device body 800. The installation relationship described herein is not limited to placement within the product, but also includes installation connections with other components of the product, including but not limited to physical connections, electrical connections, or signal transmission connections. Those skilled in the art will understand that the device 600 (700) for controlling smart home system devices can be adapted to suitable corresponding device bodies to achieve other feasible embodiments.

[0125] This disclosure provides a storage medium storing program instructions that, when executed, perform the method for controlling smart home system devices as described above.

[0126] This disclosure provides a computer program product, which includes a computer program stored on a storage medium. The computer program includes program instructions that, when executed by a computer, cause the computer to perform the data retrieval method described above.

[0127] The aforementioned storage medium can be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0128] The technical solutions of this disclosure can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes one or more instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in this disclosure. The aforementioned storage medium can be a non-transitory storage medium, including: a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and other media capable of storing program code; it can also be a transient storage medium.

[0129] The foregoing description and accompanying drawings fully illustrate embodiments of the present disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included or replace parts and features of other embodiments. The scope of the embodiments of this disclosure includes the entire scope of the claims and all available equivalents of the claims. While the terms “first,” “second,” etc., may be used in this application to describe elements, these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, a first element may be called a second element without changing the meaning of the description, and similarly, a second element may be called a first element, provided that all occurrences of “first element” are consistently renamed and all occurrences of “second element” are consistently renamed. First and second elements are both elements, but may not be the same element. Moreover, the terminology used in this application is only for describing embodiments and is not intended to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates otherwise, the singular forms “a,” “an,” and “the” are intended to also include the plural forms. Similarly, the term “and / or” as used herein means including one or more of the associated listed any and all possible combinations. Additionally, when used herein, the terms “comprise” and its variations “comprises” and / or “comprising” refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase “comprising an…” does not exclude the presence of additional identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0130] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0131] The methods and products disclosed in the embodiments herein (including but not limited to devices and equipment) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units may be merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to implement this embodiment according to actual needs. In addition, the functional units in the embodiments of this disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0132] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. Each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

Claims

1. A method for smart home system device control, characterized by, The method comprises the following steps: Obtaining current linkage relationship information between devices from devices of the smart home system; Displaying a current linkage relationship graph matching the current linkage relationship information on a man-machine interaction interface, wherein the current linkage relationship graph is a visual graph representing device linkage logic; Controlling the devices according to the current linkage relationship graph.

2. The method of claim 1, wherein, Further comprising: In the case of receiving a graph editing instruction corresponding to a user operation action on the man-machine interaction interface, updating the current linkage relationship information to obtain updated linkage relationship information, and displaying a linkage relationship graph matching the updated linkage relationship information, wherein the operation action includes dragging, adding, or deleting.

3. The method of claim 1, wherein, Further comprising: In the case of determining that the scene reproduction condition is met, sending scene control information corresponding to the current scene to a central control device corresponding to the scene to be reproduced through an NFC communication module to perform corresponding scene control.

4. The method of claim 1, wherein, Further comprising: Based on a combination rule library, creating a corresponding virtual device according to capability information of two or more devices in the smart home system, wherein the combination rule library is constructed based on the complementarity and relevance of device functions; Displaying the virtual device in the linkage relationship graph according to control interface information and function implementation logic information of the virtual device.

5. The method of claim 4, wherein, The creation of the corresponding virtual device comprises: Based on the combination rule library, obtaining each capability combination scheme corresponding to the current scene; Based on an optimization algorithm, determining an optimal capability combination scheme from the capability combination schemes, and defining control interface information and function implementation logic information for the virtual device according to the optimal capability combination scheme.

6. The method of claim 1, wherein, Further comprising: Analyzing a received task request of the current scene through natural language processing technology to obtain current task key information and determine a first current device corresponding to the current task key information; According to the current state information of the first current device and a preset task priority, determining an optimal task allocation scheme through a scheduling algorithm, and controlling the corresponding first current device according to the optimal task allocation scheme.

7. The method of claim 1, wherein, Further comprising: Determining each second current device corresponding to the task of the current scene, and performing energy consumption and reliability analysis according to capability information of the second current device and historical device information to obtain a corresponding device comprehensive score, wherein the historical device information includes historical energy consumption information, failure rate information, and maintenance record information; According to the device comprehensive score, determining one or more second current devices as current execution devices, and performing corresponding control on the current execution devices.

8. An apparatus for smart home system device control, the apparatus comprising a processor and a memory having stored therein program instructions, the apparatus characterized by: The processor is configured to execute the program instructions to perform the method for smart home system device control according to any one of claims 1-7.

9. An apparatus, comprising: The device for smart home system device control according to claim 8 is installed on the device body. The program instructions are executed to perform the method for smart home system device control according to any one of claims 1-7. ​ 10. A storage medium storing program instructions, characterized in that, ​

Images