Visual control method and device for household equipment

Abstract

The invention provides a visual control method and device for household equipment. The method comprises the following steps: acquiring spatial layout information of a target house and equipment information and distribution positions of equipment in the target house; generating a space model corresponding to the target house based on the space layout information; generating a device model and a control logic corresponding to the device based on the device information of each device; adding the equipment model corresponding to each equipment into the space model according to the distribution position of each equipment; detecting an operation of a user on the spatial model, and judging whether the operation triggers a control logic corresponding to each device or not; and when the control logic corresponding to any equipment is triggered, controlling the equipment based on the triggered control logic, and updating the state of the equipment on the equipment model corresponding to the equipment, so as to realize visual control of the equipment in the home environment. By adopting the technical means, the problems that in the prior art, different home devices cannot be controlled in a centralized mode, and control visualization cannot be achieved are solved.

Description

Technical Field

[0001] The present application relates to the field of device control technology, and in particular to a method and device for visual control of home appliances. Background Art

[0002] With the development of science and technology, people have higher and higher requirements for the intelligent level of family life. There are many devices that need to be controlled in the home environment. How to achieve convenient control of various devices and improve the level of home intelligence is a hot topic of current research. At present, the control of various devices in the home is independent of each other. Different devices have their own control software, and the control of the device remains at the command level. The location and status of the device cannot be reflected in the control of the device, and there is a lack of visualization of the device control. Summary of the invention

[0003] In view of this, the embodiments of the present application provide a method, device, electronic device and computer-readable storage medium for visual control of home appliances to solve the problem in the prior art that different home appliances cannot be centrally controlled and control visualization cannot be achieved.

[0004] According to a first aspect of an embodiment of the present application, a method for visual control of home appliances is provided, comprising: obtaining spatial layout information of a target house and device information and distribution positions of each device in the target house; generating a spatial model corresponding to the target house based on the spatial layout information; generating a device model and control logic corresponding to each device based on the device information of the device; adding the device model corresponding to each device to the spatial model according to the distribution position of each device; detecting a user's operation on the spatial model to determine whether the operation triggers the control logic corresponding to each device; when the control logic corresponding to any device is triggered, controlling the device based on the triggered control logic, and updating the status of the device on the device model corresponding to the device, so as to realize visual control of the devices in the home environment.

[0005] According to a second aspect of an embodiment of the present application, a device for visual control of home appliances is provided, comprising: an acquisition module configured to acquire spatial layout information of a target house and device information and distribution positions of each device in the target house; a first generation module configured to generate a spatial model corresponding to the target house based on the spatial layout information; a second generation module configured to generate a device model and control logic corresponding to each device based on the device information of each device; an adding module configured to add the device model corresponding to each device to the spatial model according to the distribution position of each device; a detection module configured to detect a user's operation on the spatial model and determine whether the operation triggers the control logic corresponding to each device; and a control module configured to control the device based on the triggered control logic when the control logic corresponding to any device is triggered, and to update the status of the device on the device model corresponding to the device, so as to realize visual control of the devices in the home environment.

[0006] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the computer program.

[0007] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0008] Compared with the prior art, the embodiments of the present application have the following beneficial effects: obtaining the spatial layout information of the target house and the device information and distribution position of each device in the target house; generating a spatial model corresponding to the target house based on the spatial layout information; generating a device model and control logic corresponding to each device based on the device information of each device; adding the device model corresponding to each device to the spatial model according to the distribution position of each device; detecting the user's operation on the spatial model to determine whether the operation triggers the control logic corresponding to each device; when the control logic corresponding to any device is triggered, the device is controlled based on the triggered control logic, and the status of the device is updated on the device model corresponding to the device, so as to realize the visual control of the device in the home environment. The above technical means can solve the problem that different home appliances cannot be centrally controlled and control visualization cannot be realized in the prior art, thereby improving the control efficiency of home appliances and enhancing the visualization level of control. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0010] Figure 1 It is a flowchart of a method for visual control of household appliances provided in an embodiment of the present application;

[0011] Figure 2 It is a flowchart of another method for visual control of home appliances provided in an embodiment of the present application;

[0012] Figure 3 It is a structural schematic diagram of a device for visual control of household appliances provided in an embodiment of the present application;

[0013] Figure 4 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0014] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0015] A method and device for visual control of home appliances according to an embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0016] Figure 1 It is a flowchart of a method for visual control of home appliances provided in an embodiment of the present application. Figure 1 The method for visual control of home appliances can be executed by a computer or a server, or software on the computer or the server. Figure 1 As shown, the method for visual control of home appliances includes:

[0017] S101, obtaining spatial layout information of a target house and device information and distribution location of each device in the target house;

[0018] S102, generating a space model corresponding to the target house based on the space layout information;

[0019] S103, generating a device model and control logic corresponding to each device based on the device information of the device;

[0020] S104, adding device models corresponding to each device to the space model according to the distribution location of each device;

[0021] S105, detecting the user's operation on the space model, and determining whether the operation triggers the control logic corresponding to each device;

[0022] S106, when the control logic corresponding to any device is triggered, the device is controlled based on the triggered control logic, and the state of the device is updated on the device model corresponding to the device, so as to realize visual control of the device in the home environment.

[0023] The spatial layout information of the target house includes the location, area, specific length, width and height of each room in the target house. The device information includes the name, type, and various functions that the device can achieve. The distribution location of the device is the location of the device in the target house. The various devices in the target house include: smart light bulbs, security alarms, smoke detectors and carbon monoxide detectors, smart window controllers, smart water dispensers, smart air purifiers, etc.

[0024] For example, if the target house has three bedrooms, a kitchen, two bathrooms and a living room, the space model will include three bedrooms, a kitchen, two bathrooms and a living room. Click on one of the rooms to see the space inside the room. The device model of a device is used to represent the device. It can be a model of the physical shape of the device or a symbol with an identification function. The control logic of the device is the control of the various functions of the device by the set operation. A device can have multiple control logics. For example, for an air conditioner, sliding left and right on the device model corresponding to the air conditioner represents adjusting the temperature, where sliding left represents lowering the temperature and sliding right represents raising the temperature; sliding up and down represents adjusting the humidity, where sliding down represents lowering the humidity and sliding up represents increasing the humidity, etc.

[0025] Add the device model corresponding to each device to the spatial model according to the distribution location of each device. In this way, even if the target house has multiple devices of the same type, multiple devices of the same type can be distinguished on the spatial model because the distribution locations of the devices are different. For example, both Room 1 and Room 2 of the target house are equipped with air conditioners, and these two air conditioners are distinguished on the spatial model. Detect whether the user's operation on the spatial model triggers the control logic corresponding to a certain device. When the control logic corresponding to a certain device is triggered, the device is controlled based on the triggered control logic. And update the status of the device on the device model corresponding to the device to realize the visual control of the device in the home environment. Through the spatial model, it is possible to control all devices inside the target house and realize the visualization of control and control effects.

[0026] According to the technical solution provided in the embodiment of the present application, the spatial layout information of the target house and the device information and distribution position of each device in the target house are obtained; the spatial model corresponding to the target house is generated based on the spatial layout information; the device model and control logic corresponding to each device are generated based on the device information of each device; the device model corresponding to each device is added to the spatial model according to the distribution position of each device; the user's operation on the spatial model is detected to determine whether the operation triggers the control logic corresponding to each device; when the control logic corresponding to any device is triggered, the device is controlled based on the triggered control logic, and the status of the device is updated on the device model corresponding to the device, so as to realize the visual control of the device in the home environment. The above-mentioned technical means can solve the problem that different home appliances cannot be centrally controlled and control visualization cannot be realized in the prior art, thereby improving the control efficiency of home appliances and enhancing the visualization level of control.

[0027] Furthermore, after adding the device models corresponding to each device to the space model according to the distribution positions of each device, the method also includes: obtaining the coordinates of the operation occurring on the space model, and determining the target device from the multiple devices on the space model based on the coordinates; judging whether the operation triggers the control logic corresponding to the target device; when triggered, controlling the target device based on the control logic corresponding to the target device, and updating the status of the target device on the device model corresponding to the target device, so as to realize visual control of the devices in the home environment.

[0028] The device at the coordinates where the operation occurs on the spatial model is taken as the target device. It is determined whether the operation triggers a certain control logic of the target device. When triggered, the target device is controlled based on the control logic, and the state of the target device is updated on the device model corresponding to the target device. For example, if the target device is an air conditioner, the air conditioner has two control logics. The first control logic is that sliding left and right on the device model corresponding to the air conditioner represents adjusting the temperature, and the second control logic is sliding up and down on the device model corresponding to the air conditioner represents adjusting the humidity. When the operation is sliding left and right on the device model corresponding to the air conditioner, the first control logic is triggered to adjust the set temperature on the air conditioner, and the state of the air conditioner is updated on the device model corresponding to the air conditioner. If the operation is neither sliding left and right on the device model corresponding to the air conditioner nor sliding up and down on the device model corresponding to the air conditioner, it is determined that the operation does not trigger the control logic corresponding to the target device, and the operation is not responded to.

[0029] Furthermore, controlling the device based on the triggered control logic includes: generating a control strategy corresponding to the triggered control logic in the main controller, and sending the control strategy to the sub-room controller to which the device belongs; and controlling the device through the sub-room controller based on the control strategy.

[0030] In order to control each device in the target house, a master controller is set in the target house to centrally manage all devices, and a sub-room controller is set in each room of the target house to manage the devices in each room. The triggered control logic is "swiping left and right on the device model corresponding to the air conditioner represents adjusting the temperature". The master controller recognizes the control logic, generates a control strategy for adjusting the temperature, and sends the control strategy to the sub-room controller to which the air conditioner belongs. The sub-room controller controls the air conditioner according to the control strategy.

[0031] Furthermore, after adding the device models corresponding to each device to the space model according to the distribution positions of each device, the method also includes: collecting environmental parameters in real time through various sensors arranged in the target house; and displaying the environmental parameters in real time on the space model or on the device model related to the environmental parameters.

[0032] Various sensors include temperature sensors, humidity sensors, sensors for measuring carbon monoxide concentration, etc. The corresponding environmental parameters include temperature, humidity, carbon monoxide concentration, etc. The environmental parameters can be displayed in real time at the set position of the space model, or they can be displayed on the device model related to the environmental parameters. For example, if the temperature and humidity of the target house are controlled by air conditioning, then the air conditioning is a device related to temperature and humidity, and the temperature and humidity are displayed on the device model corresponding to the air conditioning.

[0033] Figure 2 FIG. 1 is a flow chart of another method for visually controlling home appliances provided in an embodiment of the present application. Figure 2 As shown, the method includes:

[0034] S201, collecting environmental parameters in the target house and user information of the user;

[0035] S202, generating a linkage control strategy through a strategy model based on the environment parameters and the user information, wherein the strategy model has been trained to generate a linkage control strategy based on the environment parameters and the user information;

[0036] S203, controlling multiple devices simultaneously based on a linkage control strategy;

[0037] S204: Update the status of each device on the device model corresponding to the device.

[0038] The user information includes the user's body temperature, posture, location, behavior, etc. The strategy model may be a commonly used neural network model, which is used to analyze environmental parameters and user information to generate a linkage control strategy.

[0039] For example, the user information is that the user is sleeping in the bedroom, and the collected environmental parameters include indoor temperature and carbon dioxide concentration. The neural network model analyzes the indoor temperature, carbon dioxide concentration and user information, and believes that the air quality is poor and the indoor temperature is higher than the comfortable temperature corresponding to the user's sleep. Then, a linkage control strategy is generated to control the air purifier to purify the indoor air and control the air conditioner in the bedroom to lower the temperature.

[0040] Before generating a linkage control strategy through a strategy model based on environmental parameters and user information, the strategy model is trained: multiple training data are obtained, each training data contains environmental parameters and user information; a label is given to each training data; each training data is input into the strategy model to generate a linkage control strategy; the loss value between the linkage control strategy and the label is calculated through a cross entropy loss function; and the model parameters of the strategy model are optimized according to the loss value.

[0041] Before simultaneously controlling multiple devices based on the linkage control strategy, the method also includes: identifying the target scene in which the target house is located at the current moment; generating a linkage control strategy through a strategy model based on the target scene, environmental parameters and user information, wherein the strategy model has been trained and can generate a linkage control strategy suitable for the target scene based on environmental parameters and user information.

[0042] Different target scenarios have different requirements, so the generated linkage control strategies are also different. Generate linkage control strategies for target scenarios.

[0043] In an optional embodiment, the linkage control strategy is adjusted as the user information and the environmental parameters change. The changed user information and environmental parameters are input into the strategy model to generate a new linkage control strategy.

[0044] In an optional embodiment, after a plurality of devices are controlled simultaneously based on the linkage control strategy, user information and environmental parameters are collected, and model parameters of the strategy model are optimized based on the user information and environmental parameters.

[0045] For example, the linkage control strategy lowers the indoor temperature. If the user information shows that the user is shivering or the indoor temperature is too low, the linkage control strategy generated previously is considered inappropriate, and the model parameters of the strategy model can be optimized according to the reinforcement learning strategy.

[0046] Based on the target scenario, environmental parameters and user information, a linkage control strategy is generated through a policy model, wherein the policy model has been trained and can generate a linkage control strategy suitable for the target scenario based on environmental parameters and user information, including: based on energy-saving scenarios, environmental parameters and user information, an energy-saving linkage control strategy is generated through a policy model; based on security scenarios, environmental parameters and user information, a security linkage control strategy is generated through a policy model; in health scenarios, environmental parameters and user information, a health linkage control strategy is generated through a policy model.

[0047] The target scenarios include energy-saving scenarios, security scenarios, and health scenarios; the linkage control strategies include energy-saving linkage control strategies, security linkage control strategies, and health linkage control strategies. The energy-saving scenario primarily considers energy saving, the security scenario primarily considers security alarms, and the health scenario primarily considers user health.

[0048] The following examples illustrate: In the energy-saving scenario, the temperature and wind speed of the air conditioner can be automatically adjusted according to the user's work and rest time and indoor temperature to achieve energy saving. In the security scenario, alarms and notifications can be triggered according to the real-time status of the security equipment and the user's habits. In the health scenario, the working status of the air conditioner can be automatically adjusted according to the user's health data and environmental parameters to provide a healthier living environment.

[0049] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present application, which will not be described one by one here.

[0050] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0051] Figure 3 Schematic diagram of a device for visual control of household appliances provided in an embodiment of the present application. Figure 3 As shown, the device for visual control of home appliances includes:

[0052] An acquisition module 301 is configured to acquire spatial layout information of a target house and device information and distribution location of each device in the target house;

[0053] The first generating module 302 is configured to generate a space model corresponding to the target house based on the space layout information;

[0054] The second generating module 303 is configured to generate a device model and control logic corresponding to each device based on the device information of the device;

[0055] An adding module 304 is configured to add a device model corresponding to each device to the space model according to the distribution position of each device;

[0056] The detection module 305 is configured to detect the user's operation on the space model and determine whether the operation triggers the control logic corresponding to each device;

[0057] The control module 306 is configured to control any device based on the triggered control logic when the control logic corresponding to the device is triggered, and update the state of the device on the device model corresponding to the device to achieve visual control of the device in the home environment.

[0058] According to the technical solution provided in the embodiment of the present application, the spatial layout information of the target house and the device information and distribution position of each device in the target house are obtained; the spatial model corresponding to the target house is generated based on the spatial layout information; the device model and control logic corresponding to each device are generated based on the device information of each device; the device model corresponding to each device is added to the spatial model according to the distribution position of each device; the user's operation on the spatial model is detected to determine whether the operation triggers the control logic corresponding to each device; when the control logic corresponding to any device is triggered, the device is controlled based on the triggered control logic, and the status of the device is updated on the device model corresponding to the device, so as to realize the visual control of the device in the home environment. The above-mentioned technical means can solve the problem that different home appliances cannot be centrally controlled and control visualization cannot be realized in the prior art, thereby improving the control efficiency of home appliances and enhancing the visualization level of control.

[0059] In some embodiments, the detection module 305 is also configured to obtain the coordinates of the operation occurring on the spatial model, and determine the target device from multiple devices on the spatial model based on the coordinates; determine whether the operation triggers the control logic corresponding to the target device; when triggered, control the target device based on the control logic corresponding to the target device, and update the status of the target device on the device model corresponding to the target device, so as to realize visual control of the device in the home environment.

[0060] The device at the coordinates where the operation occurs on the spatial model is taken as the target device. It is determined whether the operation triggers a certain control logic of the target device. When triggered, the target device is controlled based on the control logic, and the state of the target device is updated on the device model corresponding to the target device. For example, if the target device is an air conditioner, the air conditioner has two control logics. The first control logic is that sliding left and right on the device model corresponding to the air conditioner represents adjusting the temperature, and the second control logic is sliding up and down on the device model corresponding to the air conditioner represents adjusting the humidity. When the operation is sliding left and right on the device model corresponding to the air conditioner, the first control logic is triggered to adjust the set temperature on the air conditioner, and the state of the air conditioner is updated on the device model corresponding to the air conditioner. If the operation is neither sliding left and right on the device model corresponding to the air conditioner nor sliding up and down on the device model corresponding to the air conditioner, it is determined that the operation does not trigger the control logic corresponding to the target device, and the operation is not responded to.

[0061] In some embodiments, the control module 306 is further configured to generate a control strategy corresponding to the triggered control logic in the main controller, and send the control strategy to the room controller to which the device belongs; based on the control strategy, the device is controlled by the room controller.

[0062] In order to control each device in the target house, a master controller is set in the target house to centrally manage all devices, and a sub-room controller is set in each room of the target house to manage the devices in each room. The triggered control logic is "swiping left and right on the device model corresponding to the air conditioner represents adjusting the temperature". The master controller recognizes the control logic, generates a control strategy for adjusting the temperature, and sends the control strategy to the sub-room controller to which the air conditioner belongs. The sub-room controller controls the air conditioner according to the control strategy.

[0063] In some embodiments, the adding module 304 is further configured to collect environmental parameters in real time through various sensors arranged in the target house; and display the environmental parameters in real time on the space model or on a device model related to the environmental parameters.

[0064] Various sensors include temperature sensors, humidity sensors, sensors for measuring carbon monoxide concentration, etc. The corresponding environmental parameters include temperature, humidity, carbon monoxide concentration, etc. The environmental parameters can be displayed in real time at the set position of the space model, or they can be displayed on the device model related to the environmental parameters. For example, if the temperature and humidity of the target house are controlled by air conditioning, then the air conditioning is a device related to temperature and humidity, and the temperature and humidity are displayed on the device model corresponding to the air conditioning.

[0065] In some embodiments, the control module 306 is also configured to collect environmental parameters and user information of the user in the target house; generate a linkage control strategy through a strategy model based on the environmental parameters and user information, wherein the strategy model has been trained and can generate a linkage control strategy based on the environmental parameters and user information; control multiple devices simultaneously based on the linkage control strategy; and update the status of each device on the device model corresponding to the device.

[0066] The user information includes the user's body temperature, posture, location, behavior, etc. The strategy model may be a commonly used neural network model, which is used to analyze environmental parameters and user information to generate a linkage control strategy.

[0067] For example, the user information is that the user is sleeping in the bedroom, and the collected environmental parameters include indoor temperature and carbon dioxide concentration. The neural network model analyzes the indoor temperature, carbon dioxide concentration and user information, and believes that the air quality is poor and the indoor temperature is higher than the comfortable temperature corresponding to the user's sleep. Then, a linkage control strategy is generated to control the air purifier to purify the indoor air and control the air conditioner in the bedroom to lower the temperature.

[0068] In some embodiments, the control module 306 is further configured to obtain multiple training data, each training data containing environmental parameters and user information; label each training data; input each training data into the strategy model to generate a linkage control strategy; calculate the loss value between the linkage control strategy and the label through the cross entropy loss function; and optimize the model parameters of the strategy model based on the loss value.

[0069] In some embodiments, the control module 306 is also configured to identify the target scene in which the target house is located at the current moment; based on the target scene, environmental parameters and user information, a linkage control strategy is generated through a strategy model, wherein the strategy model has been trained and can generate a linkage control strategy suitable for the target scene based on environmental parameters and user information.

[0070] Different target scenarios have different requirements, so the generated linkage control strategies are also different. Generate linkage control strategies for target scenarios.

[0071] In some embodiments, the control module 306 is further configured to adjust the linkage control strategy as the user information and the environmental parameters change, and input the changed user information and environmental parameters into the strategy model to generate a new linkage control strategy.

[0072] In some embodiments, the control module 306 is further configured to collect user information and environmental parameters after simultaneously controlling multiple devices based on the linkage control strategy, and optimize model parameters of the strategy model based on the user information and environmental parameters.

[0073] For example, the linkage control strategy lowers the indoor temperature. If the user information shows that the user is shivering or the indoor temperature is too low, the linkage control strategy generated previously is considered inappropriate, and the model parameters of the strategy model can be optimized according to the reinforcement learning strategy.

[0074] In some embodiments, the control module 306 is also configured to generate an energy-saving linkage control strategy through a strategy model based on energy-saving scenarios, environmental parameters and user information; to generate a security linkage control strategy through a strategy model based on security scenarios, environmental parameters and user information; and to generate a health linkage control strategy through a strategy model in a health scenario, environmental parameters and user information.

[0075] The target scenarios include energy-saving scenarios, security scenarios, and health scenarios; the linkage control strategies include energy-saving linkage control strategies, security linkage control strategies, and health linkage control strategies. The energy-saving scenario primarily considers energy saving, the security scenario primarily considers security alarms, and the health scenario primarily considers user health.

[0076] The following examples illustrate: In the energy-saving scenario, the temperature and wind speed of the air conditioner can be automatically adjusted according to the user's work and rest time and indoor temperature to achieve energy saving. In the security scenario, alarms and notifications can be triggered according to the real-time status of the security equipment and the user's habits. In the health scenario, the working status of the air conditioner can be automatically adjusted according to the user's health data and environmental parameters to provide a healthier living environment.

[0077] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0078] Figure 4 Schematic diagram of an electronic device 4 provided in an embodiment of the present application. Figure 4 As shown, the electronic device 4 of this embodiment includes: a processor 401, a memory 402, and a computer program 403 stored in the memory 402 and executable on the processor 401. When the processor 401 executes the computer program 403, the steps in the above-mentioned method embodiments are implemented. Alternatively, when the processor 401 executes the computer program 403, the functions of the modules / units in the above-mentioned device embodiments are implemented.

[0079] The electronic device 4 may be a desktop computer, a notebook, a PDA, a cloud server, or other electronic device. The electronic device 4 may include, but is not limited to, a processor 401 and a memory 402. Those skilled in the art will appreciate that Figure 4 The electronic device 4 is merely an example and does not limit the electronic device 4 , and may include more or less components than those shown in the figure, or different components.

[0080] The processor 401 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0081] The memory 402 may be an internal storage unit of the electronic device 4, for example, a hard disk or memory of the electronic device 4. The memory 402 may also be an external storage device of the electronic device 4, for example, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device 4. The memory 402 may also include both an internal storage unit and an external storage device of the electronic device 4. The memory 402 is used to store computer programs and other programs and data required by the electronic device.

[0082] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0083] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. The computer program may include computer program code, and the computer program code may be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electric carrier signals and telecommunication signals.

[0084] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical feature diagrams therein. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for visual control of household appliances, characterized in that: include: Acquire spatial layout information of a target house and device information and distribution location of each device in the target house; Generate a spatial model corresponding to the target house based on the spatial layout information; Generate a device model and control logic corresponding to each device based on the device information of the device; Adding device models corresponding to various devices to the spatial model according to the distribution positions of various devices; Detecting the user's operation on the space model, and determining whether the operation triggers the control logic corresponding to each device; When the control logic corresponding to any device is triggered, the device is controlled based on the triggered control logic, and the status of the device is updated on the device model corresponding to the device, so as to realize visual control of the device in the home environment.

2. The method according to claim 1, characterized in that After adding the device models corresponding to the devices to the space model according to the distribution positions of the devices, the method further includes: Acquire coordinates of the operation occurring on the space model, and determine a target device from a plurality of devices on the space model based on the coordinates; Determining whether the operation triggers the control logic corresponding to the target device; When triggered, the target device is controlled based on the control logic corresponding to the target device, and the state of the target device is updated on the device model corresponding to the target device, so as to realize visual control of the device in the home environment.

3. The method according to claim 1, characterized in that The trigger-based control logic controls the device, including: Generate a control strategy corresponding to the triggered control logic in the main controller, and send the control strategy to the sub-room controller to which the device belongs; Based on the control strategy, the device is controlled by the compartment controller.

4. The method according to claim 1, characterized in that After adding the device models corresponding to the devices to the space model according to the distribution positions of the devices, the method further includes: Collecting environmental parameters in real time through various sensors arranged in the target house; The environmental parameters are displayed in real time on the space model or on a device model related to the environmental parameters.

5. The method according to claim 1, characterized in that The method further comprises: Collecting environmental parameters in the target house and user information of the user; Based on the environmental parameters and the user information, generating a linkage control strategy through a strategy model, wherein the strategy model has been trained to generate the linkage control strategy based on the environmental parameters and the user information; Control multiple devices simultaneously based on the linkage control strategy; Update the status of each device on the device model corresponding to the device.

6. The method according to claim 5, characterized in that Before simultaneously controlling multiple devices based on the linkage control strategy, the method further includes: Identify the target scene where the target house is located at the current moment; Based on the target scenario, the environmental parameters and the user information, the linkage control strategy is generated through the strategy model, wherein the strategy model has been trained and can generate the linkage control strategy adapted to the target scenario based on the environmental parameters and the user information.

7. The method according to claim 6, characterized in that Based on the target scenario, the environmental parameters and the user information, the linkage control strategy is generated by the strategy model, wherein the strategy model has been trained to generate the linkage control strategy adapted to the target scenario based on the environmental parameters and the user information, including: Based on the energy-saving scenario, the environmental parameters and the user information, generating an energy-saving linkage control strategy through the strategy model; Based on the security scenario, the environmental parameters and the user information, generating a security linkage control strategy through the strategy model; In the health scenario, the environmental parameters and the user information generate a health linkage control strategy through the strategy model.

8. A device for visual control of household appliances, characterized in that: include: An acquisition module is configured to acquire spatial layout information of a target house and device information and distribution position of each device in the target house; A first generating module is configured to generate a space model corresponding to the target house based on the space layout information; A second generating module is configured to generate a device model and control logic corresponding to each device based on the device information of the device; An adding module is configured to add a device model corresponding to each device to the space model according to the distribution position of each device; A detection module is configured to detect the user's operation on the space model and determine whether the operation triggers the control logic corresponding to each device; The control module is configured to control the device based on the triggered control logic when the control logic corresponding to any device is triggered, and update the status of the device on the device model corresponding to the device to achieve visual control of the device in the home environment.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images