A smart home control method and terminal device based on floating window

Abstract

An embodiment of the present application relates to a smart home control method and terminal device based on a floating window, the method comprising: receiving a parameter setting instruction triggered based on a parameter setting interface; determining a smart display mode of the floating window according to the setting parameters corresponding to the parameter setting instruction, the smart display mode comprising a scene display mode and / or a sub-device display mode, the scene display mode being used to display at least one smart scene, the sub-device display mode being used to display at least one sub-device, and the smart scene being used to control at least one sub-device; in the scene display mode and / or the sub-device display mode, the smart scene and / or the sub-device are displayed in the floating window according to preset conditions based on historical usage records and current usage time, the historical usage records being obtained through self-learning operations. In an embodiment of the present application, the smart display mode is displayed by self-learning, and the user can directly control the smart scene and / or the sub-device on the floating window.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of smart home technology, and in particular to a smart home control method and terminal device based on a floating window. Background Art

[0002] With the development of smart homes, users are paying more and more attention to the control experience of smart home terminal devices. Currently, smart home terminal devices are basically controlled by users through terminal device apps. Therefore, when users are using the terminal device and are on other pages of the terminal device, it is very inconvenient to control the smart home.

[0003] The floating window is a system tool for computers or smart terminal devices. It floats a movable window on the surface of other applications to facilitate opening different applications. It allows users to control smart home applications without opening the APP.

[0004] However, existing smart home app control systems employ floating windows. These windows are used not only to control the smart home app but also to control multiple non-smart home apps, placing multiple applications such as instant messaging and video-related apps within the floating window. When using the floating window to control an app, users simply click on the smart home app from the floating window to control various smart home devices. This means that the floating window's control of the smart home is not highly intelligent. Summary of the Invention

[0005] The purpose of the embodiments of the present invention is to provide a smart home control method and terminal device based on a floating window, in which the user can set a smart display mode including a scene display mode and / or a sub-device display mode, and through self-learning, display the smart scene and / or sub-device in the floating window according to preset conditions. The user can directly control the smart scene and / or sub-device on the floating window, thereby effectively optimizing the user experience.

[0006] In a first aspect, an embodiment of the present invention provides a smart home control method based on a floating window, which is applied to a terminal device. The method includes:

[0007] Receive parameter setting instructions triggered based on the parameter setting interface;

[0008] Determine, according to the setting parameters corresponding to the parameter setting instruction, a smart display mode of the floating window, the smart display mode including a scene display mode and / or a sub-device display mode, the scene display mode being used to display at least one smart scene, the sub-device display mode being used to display at least one sub-device, and the smart scene being used to control at least one sub-device;

[0009] In the scene display mode and / or sub-device display mode, the smart scene and / or sub-device are displayed in the floating window according to preset conditions based on historical usage records and current usage time, and the historical usage records are obtained through self-learning operations;

[0010] The displaying of the smart scene and / or sub-device in the floating window according to the preset conditions includes:

[0011] When displaying sub-devices according to the preset conditions, sub-devices in the same location area or the same usage time period are placed in the first area;

[0012] placing sub-devices in different location areas or different usage time periods in the second area;

[0013] The first area and the second area are different display areas of the floating window.

[0014] In a second aspect, an embodiment of the present invention provides a terminal device, the terminal device comprising:

[0015] at least one processor, and

[0016] A memory is communicatively connected to the at least one processor, the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the above method.

[0017] In a third aspect, an embodiment of the present invention provides a non-volatile computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are executed by an upgrade device, the upgrade device executes the method described above.

[0018] In the smart home control method and terminal device based on the floating window of the embodiment of the present application, the user can select the setting parameters in the parameter setting interface of the floating window. When the terminal device receives the parameter setting instruction triggered based on the parameter setting interface, the smart display mode of the floating window is determined according to the setting parameters selected by the user. The smart display mode includes a scene display mode and / or a sub-device display mode. The user can directly control the smart scene and / or sub-device on the floating window. In addition, based on the historical usage records and the current usage time, the smart scene and / or sub-device are displayed in the floating window according to the preset conditions. The historical usage records are obtained through self-learning operations. Since they are based on the user's historical usage records and the current usage time, the smart scenes and / or sub-devices displayed to the user are more in line with the user's smart home control needs under the current usage time. The user can control the smart scene and / or sub-device on the floating window without entering the APP control, which effectively optimizes the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] One or more embodiments are exemplarily illustrated by pictures in the corresponding drawings. These exemplifications do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings are represented as similar elements. Unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0020] Figure 1 This is a schematic diagram of an application scenario of the smart home control method based on floating windows according to an embodiment of the present invention;

[0021] Figure 2 This is a flow chart of an embodiment of a smart home control method based on floating windows of the present invention;

[0022] Figure 3 This is a schematic diagram of a parameter setting interface of an embodiment of a smart home control method based on a floating window of the present invention;

[0023] Figure 4 This is a schematic diagram of quantity selection in an embodiment of a smart home control method based on floating windows of the present invention;

[0024] Figure 5 This is a schematic diagram of a floating window of a terminal device in which the user is a child according to an embodiment of the smart home control method based on a floating window of the present invention;

[0025] Figure 6 This is a schematic diagram of a floating window of a terminal device where the user is a male host according to an embodiment of a smart home control method based on a floating window of the present invention;

[0026] Figure 7 This is a label diagram of an embodiment of the smart home control method based on floating windows of the present invention;

[0027] Figure 8 This is a structural diagram of an embodiment of the smart home control method based on floating windows of the present invention, in which the sub-device is a collection device;

[0028] Figure 9 This is a structural diagram of amplifying a real-time image when the sub-device of an embodiment of the smart home control method based on floating windows of the present invention is a collection device;

[0029] Figure 10 This is a schematic diagram of window switching according to an embodiment of a smart home control method based on floating windows of the present invention;

[0030] Figure 11 1 is a schematic diagram of the hardware structure of a controller in an embodiment of the terminal device of the present invention. DETAILED DESCRIPTION

[0031] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0032] The following is an introduction to an application environment involved in this application.

[0033] See also Figure 1 , Figure 1 Schematic diagram of an application environment applicable to the embodiment of the present application. Figure 1 A smart home system 10 is provided, comprising a gateway device 100, home devices 200 connected to the gateway device 100, and a server 300 connected to the gateway device 100. There may be at least one gateway device 100, and at least one home device 200. Furthermore, when there are multiple gateway devices 100, different gateway devices 100 may be communicatively connected to each other.

[0034] In the embodiments of the present application, gateway device 100 may be an intelligent gateway for smart home control, capable of performing functions such as system information collection, information input and output, centralized control, remote control, and coordinated control. The gateway device may be responsible for specific security alarms, home appliance control, and electricity usage information collection. Gateway device 100 may also wirelessly exchange information with products such as intelligent interactive terminal devices. Gateway device 100 also features wireless routing capabilities, excellent wireless performance, network security, and good coverage.

[0035] In the embodiment of the present application, the home appliance 200 may include a variety of smart home appliances, sensing devices, and detection devices arranged in the indoor space, such as smart TVs, smart refrigerators, smart air conditioners, temperature and humidity sensors, pressure sensors, smoke sensors, human body sensors, door and window sensors, smart switches, sockets, electric lights, infrared transmitters, camera devices, etc. The home appliance 200 connected to the gateway device 100 can exchange information and instructions with the gateway device 100. The gateway device 100 and the home appliance 200 can be connected through communication methods such as Bluetooth, WiFi (Wireless-Fidelity), ZigBee (ZigBee technology), etc. Of course, the connection method between the gateway device 100 and the home appliance 200 is not limited in the embodiment of the present application.

[0036] In the embodiment of the present application, the server 300 can be a local server, a cloud server, or other server. The specific server type is not limited in the embodiment of the present application. The server 300 connected to the gateway device 100 can exchange information with the gateway device 100 wirelessly. Gateway devices 100 installed in different indoor spaces can communicate with the same server 300 through the network to exchange information between the server 300 and the gateway device 100.

[0037] Furthermore, the above-mentioned smart home system 10 may also include a terminal device 400. The terminal device 400 may include a personal computer (PC), a tablet computer, a smart phone, a personal digital assistant (PDA), etc., which are not limited here. The terminal device 400 can exchange information with the server 300 through wireless methods such as 2G / 3G / 4G / 5G / WiFi. Of course, the connection method between the terminal device 400 and the server 300 may not be used as a limitation in the embodiment of the present application. In some embodiments, the terminal device 400 can also be used to interact with users, so that users can communicate wirelessly with the gateway device 100 based on the router 500 through the terminal device 400. In addition, the user can add an account information to the gateway device 100 and the terminal device 400 at the same time, and realize information synchronization between the gateway device 100 and the terminal device 400 through the account information.

[0038] In some embodiments, the user can set different trigger scenarios or automation linkages through the application (Application, APP) of the terminal device 400. As a way, the terminal device 400 can upload the scene configuration information or automation scheme to the server 300, so that when the triggering condition of the triggering scene or automation is reached, the server 300 can find the device corresponding to the execution action in the scene configuration information or automation scheme based on the stored scene configuration information or automation scheme, so as to notify the device to perform the execution action to meet the execution result of the triggering scene or automation. As another way, the server 300 can also send the scene configuration information or automation scheme to the gateway device 100, and the gateway device 100 can find the device corresponding to the execution action in the scene configuration information or automation scheme based on the stored scene configuration information or automation scheme. At the same time, the gateway device 100 can feedback the execution status of the device to the server 300.

[0039] The various embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0040] The smart home control method and terminal device based on floating window provided by the embodiment of the present invention can be applied to Figure 1 The application scenario shown is shown in the figure. A floating window is provided on the terminal device 400, and the floating window is associated with the smart scene and sub-device in the APP. The sub-device can be the above-mentioned home device 200, and the smart scene can be a collection of multiple automation rules, including multiple or multiple sub-devices that cooperate with each other to provide users with a scene for comprehensive control of the smart home. In smart display mode, users can directly control the smart scene and / or sub-devices on the floating window; when the user double-clicks on the floating window, they can also enter the APP, thereby fully controlling the corresponding smart home.

[0041] It can be understood that the terminal device 400 is provided with a controller 13 as the main control center. The user can set the smart display mode including the scene display mode and / or the sub-device display mode, and through self-learning, display the smart scene and / or sub-device in the floating window according to the preset conditions, thereby effectively optimizing the user experience.

[0042] See also Figure 2 , Figure 2 The flowchart of the smart home control method based on the floating window provided by the embodiment of the present invention is as follows. The method can be executed by the controller 13 in the terminal device 400. Figure 2 As shown, the method includes:

[0043] 101: receiving a parameter setting instruction triggered based on a parameter setting interface.

[0044] The user can set parameters in the parameter setting interface of the floating window, and the terminal device receives a parameter setting instruction triggered by the parameter setting interface to set the parameters of the floating window.

[0045] like Figure 3 As shown, Figure 3 The following is a diagram of the parameter setting interface. The user can select the parameter settings for the floating window in the parameter setting interface, including whether to float on the desktop, whether to open the self-learning mode, whether to display smart scenes, whether to display sub-devices, and the single-page quantity limit. When the user clicks to open the single-page quantity limit, a quantity selection interface will pop up, giving the user a preset range of 1-10 options. Figure 4 As shown, the user can set a quantity limit to control the maximum number of smart scenes or sub-devices displayed on each page after the floating window is expanded. The quantity selection range can be between 1 and 10.

[0046] For example, if the user selects a single page limit of 4, then after the floating window is expanded, each page will display 4 smart scenes or sub-devices. A smart scene refers to a scene containing at least one sub-device. Optionally, a smart scene can include trigger conditions and execution actions. When the sub-device meets the trigger conditions, the corresponding action is executed. For example, a smart scene can be away from home mode, reading mode, entertainment mode, etc.

[0047] 102: Determine the intelligent display mode of the floating window according to the setting parameters corresponding to the parameter setting instruction, the intelligent display mode includes a scene display mode and / or a sub-device display mode, the scene display mode is used to display at least one intelligent scene, the sub-device display mode is used to display at least one sub-device, and the intelligent scene is used to control at least one sub-device.

[0048] Users can choose to turn on the smart display mode according to their own needs. They can turn on only the scene display mode, only the sub-device display mode, or both the scene display mode and the sub-device display mode. The scene display mode and the sub-device display mode are not mutually exclusive. When selecting the scene display mode, the smart scene can be turned on and off through the floating window; correspondingly, when selecting the sub-device display mode, all sub-devices can be controlled through the floating window. When neither smart display mode is selected by the user, the floating window is closed.

[0049] It can be understood that smart scenes can include scene modes such as sleep mode, outing mode, and reading mode. For example, in reading mode, related sub-devices include the lights in room A, the locks on the door, the air-conditioning equipment in room A, etc. to ensure that users have a higher level of comfort when reading. That is, a smart scene is a collection of multiple automation rules, including multiple or multiple sub-devices that cooperate with each other to provide users with a scene for comprehensive control of the smart home.

[0050] Correspondingly, the sub-device in the sub-device display mode is any sub-device in the smart home, including lights, door locks, air conditioners and other devices, and each sub-device will carry its own location information.

[0051] 103: In the scene display mode and / or sub-device display mode, the smart scene and / or sub-device are displayed in the floating window according to preset conditions based on historical usage records and current usage time, and the historical usage records are obtained through self-learning operations.

[0052] After determining the selected smart display mode, in the scene display mode and / or sub-device display mode, the terminal device background will perform self-learning operations on the historical usage records, and display the smart scenes and / or sub-devices in the floating window according to preset conditions based on the historical usage records and current usage time.

[0053] The specific self-learning operation is: every time the user uses the floating window to control the smart home, the terminal device background will record the time and frequency of each smart scene and / or sub-device used by the user as a historical usage record, and perform self-learning operations on the historical usage records to obtain historical usage parameters such as the usage time and frequency of each smart scene and / or sub-device.

[0054] In the scene display mode and / or sub-device display mode, the smart scene and / or sub-device can be displayed in the floating window according to preset conditions based on historical usage records and current usage time.

[0055] For example, if the usage frequency of a certain smart scene is greater than or equal to 4 times a week, it is determined that the usage frequency of the smart scene is high, and the maximum error in the time of opening and closing the smart scene each time does not exceed 10 minutes, then the result corresponding to the self-learning operation that the usage time of the smart scene is relatively fixed is obtained. When the user opens the floating window at the fixed time, if the self-learning mode is turned on, then the smart scene will be displayed preferentially in the floating window.

[0056] In some embodiments, displaying smart scenes and / or sub-devices in the floating window according to preset conditions includes:

[0057] When displaying sub-devices according to the preset conditions, sub-devices in the same location area or the same usage time period are placed in the first area;

[0058] placing sub-devices in different location areas or different usage time periods in the second area;

[0059] The first area and the second area are different display areas of the floating window.

[0060] Specifically, when displaying sub-devices, sub-devices in the same location area or the same usage time period can be placed in the first area. For example, sub-devices in the living room are placed in the first area, or sub-devices that are frequently used from 8 to 10 pm are placed in the first area.

[0061] Other sub-devices in different location areas or different usage time periods are placed in the second area, and the first area and the second area are different display areas of the floating window.

[0062] For example, the usage time period is usually the time period when the user is away from home. In this case, the sub-devices that need to be turned off during this time period are: air conditioner and light, and the sub-device that needs to be turned on is the automatic pet feeder. At this time, the air conditioner, light and automatic pet feeder are placed in the first area.

[0063] In some embodiments, the floating window includes at least one window page, and the setting parameters include a single-page limit; in the scene display mode, displaying the smart scene in the floating window according to preset conditions based on historical usage records and current usage time may include:

[0064] 31a. Determine the number of pages to be displayed based on the single-page limit and the number of smart scenes;

[0065] 31b. Obtain the time period in which the current usage time falls;

[0066] 31c. Obtaining the usage frequency of each smart scene within the time period based on historical usage records, where the historical usage records are obtained through self-learning operations;

[0067] 31d. Sort the smart scenes according to the usage frequency;

[0068] 31e. Display the smart scene on at least one window page in the sorted order according to the number of pages displayed.

[0069] Specifically, when the user only selects the scene display mode, the number of pages displayed can be determined based on the single-page limit number selected by the user and the number of smart scenes in the scene display mode. For example, if the single-page limit number selected by the user is 4 and the number of smart scenes is 16, then the number of pages displayed can be determined to be 4 pages.

[0070] Then, obtain the time period in which the current usage time is located, and according to the historical usage records, obtain the usage frequency of each smart scene in the time period. For example, the current time is 10 am, and the time period in which the current usage time is located is 9:30-10:30. Then, obtain the usage frequency of each smart scene in 9:30-10:30, such as the usage frequency of smart scene A is 3 times, the usage frequency of smart scene B is 2 times, the usage frequency of smart scene C is 1 time...

[0071] The smart scenes are sorted according to the usage frequency. For example, they can be arranged in descending order of usage frequency. According to the frequencies of the smart scenes AC, they can be arranged as smart scene A→smart scene B→smart scene C.

[0072] The smart scenes are displayed on at least one window page in the order of the sorting according to the page display quantity. For example, there are 10 smart scenes within a time period, and the usage frequency is arranged in descending order. However, since the single-page limit is 4 per page, when the smart scenes are displayed on the window page, the first page will display four smart scenes with higher usage frequencies, and correspondingly, the second page will display four smart scenes with slightly lower usage frequencies...

[0073] It is understandable that if the user selects a smart scene, the corresponding smart scene will be highlighted.

[0074] Because in a certain period of time, if the user uses the smart scene more frequently or at a relatively fixed time, then the user's usage habits of the smart scene can be recorded through self-learning operations, and the smart scenes that the user may use at the current time can be predicted and directly displayed in the floating window. The user can directly control the smart scene he may want to control through the floating window, which is more intelligent.

[0075] In some embodiments, the floating window includes at least one window page, and the setting parameters include a single-page limit; in the sub-device display mode, displaying the sub-device in the floating window according to preset conditions based on historical usage records and current usage time may include:

[0076] 32a. Determine the number of pages to be displayed based on the single-page limit and the number of sub-devices;

[0077] 32b. Obtain the time period in which the current usage time is located;

[0078] 32c. Obtaining the usage frequency of each of the sub-devices within the time period based on historical usage records, wherein the historical usage records are obtained through self-learning operations;

[0079] 32d. Sort the sub-devices according to the usage frequency;

[0080] 32e. Display the sub-devices in at least one window page according to the sorting order based on the page display quantity.

[0081] Specifically, when the user only selects the sub-device display mode, it is similar to the display of the smart scene. The number of page displays is first determined based on the single-page limit number selected by the user and the number of sub-devices in the sub-device display mode. Then, the time period in which the current usage time is located is obtained, and then the usage frequency of each sub-device in the time period is obtained based on the historical usage records obtained by the self-learning operation. The usage frequency can be sorted from high to low, and the sub-devices are displayed on at least one window page in the sorted order according to the number of page displays.

[0082] Similarly, if the user uses a sub-device frequently or at a fixed time during a certain period of time, the user's usage habits of the sub-device can be recorded through self-learning operations, and the sub-devices that the user may use at the current time can be predicted and displayed directly in a floating window. The user can directly control the sub-device he may want to control through the floating window, which is more intelligent.

[0083] It is understandable that when the user selects the scene display mode and the sub-device display mode at the same time, the usage frequency of the smart scenes and sub-devices can be sorted together, and the high-frequency smart scenes or sub-devices can be placed at the front of the window page. The user can directly control the smart scenes and sub-devices that they may want to control through the floating window, which is more intelligent.

[0084] In some embodiments, there are multiple terminal devices, and displaying the smart scene and / or sub-device in the floating window according to preset conditions includes:

[0085] When displaying sub-devices according to the preset conditions, obtaining user information corresponding to each of the terminal devices;

[0086] Sub-devices corresponding to the same user information are placed in the same display area, and sub-devices corresponding to different user information are placed in different display areas.

[0087] Specifically, when displaying sub-devices according to the preset conditions, user information corresponding to each of the terminal devices is obtained. For example, in a family, multiple users can control smart home devices through their respective terminal devices, and the user information corresponding to each user is distinguished according to the terminal device. When displaying sub-devices according to the preset conditions, the user information corresponding to the terminal device is obtained to determine which terminal device is in control. Then, sub-devices corresponding to the same user information are placed in the same display area, and sub-devices corresponding to different user information are placed in different display areas.

[0088] For example, in a smart home, there can be some automation settings for the terminal device whose user is a child. For example, the terminal device of the child mainly controls the sub-devices in the child's own room, such as turning on or off the lights in the room, and turning on or off the air conditioner. Therefore, when the terminal device corresponding to the user information is a child's terminal device, the sub-devices in the child's own room can be displayed in the first row. Figure 5 As shown, when the floating window of the child's terminal device is displayed, the lights and air conditioners in the child's room are placed in the first row.

[0089] There can also be some automation settings for users who are male and female hosts. For example, the male host usually controls the door lock, living room lights, living room air conditioner, etc. through the terminal device, and the female host usually controls the smart clothes drying rack, smart washing machine, etc. through the terminal device; there are some automation settings for users who are elderly people. For example, the elderly usually control the smart TV, the lights and air conditioner in their own room through the terminal device. After obtaining the user information of the terminal device, if it is detected that the user information is the male host's terminal device, then in the floating window of the male host's terminal device, the sub-devices corresponding to the male host's terminal device will be placed in the first row, the female host's in the second row, and the elderly / children's sub-devices in the third row. Figure 6 shown.

[0090] In some embodiments, displaying the smart scene and / or sub-device in the floating window according to preset conditions may include:

[0091] Obtaining location information of the sub-device in the window page;

[0092] The sub-devices whose sub-device location information belongs to the same location area are arranged in the same display area;

[0093] Each of the display areas is displayed in different areas.

[0094] Specifically, in sub-device display mode, a smart home scenario typically includes multiple sub-devices, such as sensors in multiple locations. To facilitate user control of sub-devices in the same location, the terminal device obtains the location information of the sub-devices in the window page, then places the sub-devices whose location information belongs to the same location area in the same display area, and displays each of the display areas in separate zones.

[0095] The regional display may include row display and column display, as long as different display areas can be distinguished.

[0096] For example, there are 4 sub-devices in the current window page, namely 4 LED lights, lights 1 to 3 are in the living room, and light 4 is in room 1. Then, Figure 4 As shown, lamps 1-3 are placed in the same display area in the upper row, and lamp 4 is placed in the display area in the lower row.

[0097] In addition, each sub-device has been arranged according to the frequency of use.

[0098] It is understandable that when the user selects a sub-device corresponding to a display area, it will be highlighted.

[0099] In some embodiments, displaying a smart scene and / or sub-device in the floating window according to preset conditions includes:

[0100] In the sub-device display mode, obtaining device information, location information and status information of the sub-device;

[0101] When displayed in the same line, a label is added to the sub-device on the floating window according to the device information, location information and status information of the sub-device, and the label corresponds to the location information and status information of the sub-device.

[0102] Specifically, when a sub-device is displayed on a floating window, the device information of the sub-device may be obtained first. For example, if the sub-device is an LED light, Figure 7 As shown, labels are used to distinguish the same type of devices with the same icons. The labels are hierarchical to represent device information, location information and status information: the first-level label represents location information, and its label is a shape, and its shape includes but is not limited to triangle, rectangle, and circle; the second-level label represents device information, and its label is color.

[0103] For example, suppose there are two rooms: a bedroom and a living room, with four LED lights: Light 1, Light 2, Light 3, and Light 4. Lights 1, 2, and 3 are in the living room, and Light 4 is in the bedroom. The triangle in the upper left corner of the display area represents the device's location. If the upper left corners of Lights 1, 2, and 3 all have triangles, this means they are all in the same room. By obtaining their location information, we can determine that they are all in the living room. When adding a device to a room, the background color of the current room is obtained. When generating a floating icon, the obtained background color is displayed as a triangle, so the color of the triangle corresponds to the room background color in the app. The color in the lower left corner represents different devices. Lights 1, 2, and 3 are in the same location and have the same upper left corner color. To distinguish different devices in the same room, the lower left corner uses a gradient color from the same color scheme.

[0104] It is understandable that devices in the same room have the same background color, which corresponds to the room background color in the app. Devices of the same type in the same room display their current status, such as LED lights displaying their current color temperature and brightness, to distinguish them. For devices without color temperature or brightness, such as sensors, the current sensor status, such as temperature and humidity, is displayed, allowing users to quickly identify the status of each sub-device.

[0105] In some embodiments, the method may further include:

[0106] Obtaining current location information of the terminal device;

[0107] The smart scene and / or the sub-device are determined according to the current location information of the terminal device.

[0108] Specifically, the display of the floating window can also be displayed according to the user's location. First, the current location information of the terminal device is obtained; then, the smart scene and / or the sub-device is determined according to the current location information of the terminal device.

[0109] For example, when the user is in the office, the floating window will automatically display the sub-devices and / or smart scenes (meeting, office, etc.) that need to be controlled in the office.

[0110] In some embodiments, the method further comprises:

[0111] Obtaining mode selection information corresponding to the parameter setting instruction to determine the start mode;

[0112] When the activation mode is the self-learning activation mode, the smart scene is activated in the floating window according to the historical usage records and the current usage time.

[0113] Specifically, there are two modes of smart start: manual start and self-learning start. Manual start is allowed by default. When manually started, the user clicks on the floating window to select the smart scene to be executed. When the floating window is detected to be clicked, the smart scene corresponding to the icon will be turned on. Figure 3 As shown, the user can also select the self-learning mode. When the self-learning mode is turned on, the opening mode is determined to be the self-learning mode, and then the smart scene is opened in the floating window according to the historical usage records and the current usage time.

[0114] The self-learning mode corresponds to the self-learning operation of the terminal device. The terminal device autonomously learns the user's historical usage records, and then recommends the corresponding smart scene to the user in the floating window based on the current usage time.

[0115] In some embodiments, activating the smart scene based on historical usage records and current usage time includes:

[0116] Obtain the time period in which the current usage time is located;

[0117] Obtaining the usage frequency of each smart scene within the time period based on historical usage records, wherein the historical usage records are obtained through self-learning operations;

[0118] At least one of the smart scenes that is used more frequently during the time period when the floating window is opened.

[0119] For example, the backend records the time and frequency of each smart scene used by the user. A usage frequency of four times a week or more is considered high, and a usage time of relatively regular duration is considered relatively regular, with a maximum error of no more than 10 minutes between each opening and closing of the smart scene. When self-learning mode is enabled, smart scenes with high frequency of use and relatively regular duration will automatically open and close during that time period.

[0120] In some embodiments, the method further comprises:

[0121] If the sub-device is a collection device, upon receiving a selection instruction triggered by a floating window corresponding to at least one of the sub-devices, real-time collection data of at least one of the collection devices is displayed.

[0122] Specifically, if Figure 8 As shown, when the sub-device is a collection device, when the user clicks to select a collection device, Figure 8 The shaded part is the display area corresponding to the acquisition device, which will display the real-time acquisition data of the acquisition device. When the user selects multiple acquisition devices at the same time, the display areas corresponding to the multiple acquisition devices will play the captured real-time images at the same time.

[0123] In some embodiments, after displaying the real-time collected data of at least one of the collection devices, the method further includes:

[0124] When a zoom-in instruction is received based on the floating window corresponding to the acquisition device, the real-time image is zoomed in.

[0125] like Figure 9 As shown, when the acquisition device is a camera, when the user wants to zoom in on the real-time image of a camera, he or she can zoom in on the display area corresponding to the camera with two fingers to zoom in on the real-time image.

[0126] It is understandable that when the floating window displays real-time collected data, such as when the data is a real-time picture, you can only view the real-time picture, but cannot operate the collection device. If the user needs to operate the collection device, you can double-click the floating window to enter the control interface of the collection device.

[0127] For special equipment such as acquisition devices, different display methods are used to facilitate user viewing, which is highly targeted and effectively improves the convenience of the floating window.

[0128] In some embodiments, in order to facilitate the user to use the floating window to control the smart home while using other applications, the method may further include setting the pop-up timing of the floating window:

[0129] Detecting the current interface of the terminal device;

[0130] If the current interface is an application program interface, the floating window is suspended on the application program interface; the application program includes a terminal device application program other than the smart home control program.

[0131] There are two options for when a floating window pops up: on the desktop and on the page. The default is to enable the floating window. If you choose to stay on the page, the system will detect whether the user is currently using an app. If it detects that the phone screen is displaying other pages such as videos or Moments, the floating window will be displayed. If it detects that the user's app is running in the background, the floating window will be hidden. If you choose to stay on the desktop, the floating window will remain on the phone screen regardless of whether the user is currently using an app.

[0132] In some embodiments, displaying the smart scene and / or sub-device in the floating window according to preset conditions includes:

[0133] When it is detected that the smart scene display button is turned on and the sub-device display button is turned off, an up and down switch button is displayed on the border of the floating window;

[0134] When it is detected that the display smart scene button is turned off and the sub-device button is turned on, left and right switching buttons are displayed on the border of the floating window;

[0135] When it is detected that the display smart scene and the sub-device button are turned on, an omnidirectional switching button is displayed on the border of the floating window.

[0136] Specifically, the floating window can be adjusted in position on the desktop by dragging. After the user clicks on the floating window, it is displayed in the middle of the screen as an independent non-full-screen window. The screen size depends on the single-page limit number set by the user in the floating window settings page.

[0137] like Figure 10 As shown, Figure 10 It is a floating window display. The displayed window shows the icons and names of the smart scenes or sub-devices set by the user. You can switch to the next page by clicking the arrow or sliding. The smart scene page switches up and down, and the sub-device page switches left and right.

[0138] If the user only chooses to display smart scenes and does not choose to display sub-devices, there will be no left and right switching arrows and you cannot slide left and right. Only up and down switching buttons will be displayed, and you can switch to the smart scene page by clicking the up and down arrows or swiping up and down; if the user only chooses to display sub-devices and does not choose to display smart scenes, there will be no up and down switching arrows and you cannot slide up and down. Left and right switching buttons will be displayed, and you can switch to the sub-device page by clicking the left and right arrows or swiping left and right; if the user chooses to display smart scenes and sub-devices at the same time, you can switch to both the scene page and the sub-device page. The switching rules remain unchanged, and all-round switching buttons are displayed around the display window, that is, four arrows appear.

[0139] In an embodiment of the present invention, a user can select setting parameters in the parameter setting interface of the floating window. When the terminal device receives the parameter setting instruction triggered based on the parameter setting interface, the intelligent display mode of the floating window is determined according to the setting parameters selected by the user. The intelligent display mode includes a scene display mode and / or a sub-device display mode. The user can directly control the intelligent scene and / or sub-device on the floating window. In addition, according to the historical usage records and the current usage time, the intelligent scene and / or sub-device are displayed in the floating window according to preset conditions. The historical usage records are obtained through self-learning operations. Since they are based on the user's historical usage records and the current usage time, the intelligent scenes and / or sub-devices displayed to the user are more in line with the user's smart home control needs under the user's current usage time. The user can control the intelligent scene and / or sub-device on the floating window without entering the APP control, which effectively optimizes the user experience.

[0140] Figure 11 FIG. 4 is a schematic diagram of the hardware structure of a controller in an embodiment of the terminal device 400. Figure 11 As shown, the controller 13 includes:

[0141] One or more processors 131 and memory 132 . Figure 11 In the figure, a processor 131 and a memory 132 are taken as an example.

[0142] The processor 131 and the memory 132 may be connected via a bus or other means. Figure 11 The bus connection is taken as an example.

[0143] Memory 132, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the floating window-based smart home control method in the embodiments of the present application. Processor 131 executes the non-volatile software programs, instructions, and modules stored in memory 132 to execute various controller functions and data processing, thereby implementing the floating window-based smart home control method in the above-mentioned method embodiment.

[0144] The memory 132 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and applications required for at least one function; the data storage area may store data created based on the use of the terminal device 400, etc. In addition, the memory 132 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 132 may optionally include a memory remotely located relative to the processor 131, and these remote memories may be connected to the upgrade device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0145] The one or more modules are stored in the memory 132, and when executed by the one or more processors 131, the smart home control method based on floating window in any of the above method embodiments is executed, for example, the smart home control method based on floating window described above is executed. Figure 2 Steps 101 to 103 of the method.

[0146] The above-mentioned product can execute the method provided in the embodiment of this application, and has the functional modules and beneficial effects corresponding to the execution method. For technical details not fully described in this embodiment, please refer to the method provided in the embodiment of this application.

[0147] The embodiment of the present application provides a non-volatile computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, for example Figure 11 A processor 131 in the embodiment of the present invention can enable the one or more processors to execute the smart home control method based on the floating window in any of the above method embodiments, for example, to execute the above described Figure 2 Steps 101 to 103 of the method.

[0148] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of this embodiment.

[0149] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and of course, can also be implemented by hardware. Those skilled in the art can understand that all or part of the processes in the above embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above methods. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0150] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Under the concept of the present invention, the technical features in the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations in different aspects of the present invention as described above. For the sake of simplicity, they are not provided in detail. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in this field should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A smart home control method based on floating window, characterized in that: Applied to a terminal device, the method includes: Receive parameter setting instructions triggered based on the parameter setting interface; Determine, according to the setting parameters corresponding to the parameter setting instruction, a smart display mode of the floating window, the smart display mode including a scene display mode and / or a sub-device display mode, the scene display mode being used to display at least one smart scene, the sub-device display mode being used to display at least one sub-device, and the smart scene being used to control at least one sub-device; In the scene display mode and / or sub-device display mode, based on the historical usage records and the current usage time, the smart scene and / or sub-device are displayed in the floating window according to preset conditions, so that when the sub-devices are displayed according to the preset conditions, the sub-devices in the same location area or the same usage time period are placed in the same sub-area, and the sub-devices in different location areas or different usage time periods are placed in different sub-areas. The historical usage records are obtained through self-learning operations.

2. The method according to claim 1, characterized in that The floating window includes at least one window page, and the setting parameters include a single-page limit; based on historical usage records and current usage time, smart scenes and / or sub-devices are displayed in the floating window according to preset conditions, and the historical usage records are obtained through self-learning operations, including: Determine the number of pages to be displayed based on the single-page limit and the number of smart scenes; Obtain the time period in which the current usage time is located; Obtaining the usage frequency of each smart scene within the time period based on historical usage records, wherein the historical usage records are obtained through self-learning operations; sorting the smart scenes according to the usage frequency; Displaying the smart scene on at least one window page in the sorted order according to the number of page displays; and / or, Determining the number of pages to be displayed based on the single-page limit and the number of sub-devices; Obtain the time period in which the current usage time is located; Obtaining the usage frequency of each of the sub-devices within the time period based on historical usage records, wherein the historical usage records are obtained through a self-learning operation; sorting the sub-devices according to the usage frequency; The sub-devices are displayed on at least one window page in the sorted order according to the page display quantity.

3. The method according to claim 1, characterized in that The terminal device has multiple users, and the displaying of the smart scene and / or sub-device in the floating window according to preset conditions includes: When displaying the sub-device according to the preset condition, obtaining user information corresponding to the terminal device; Sub-devices corresponding to the same user information are placed in the same display area, and sub-devices corresponding to different user information are placed in different display areas.

4. The method according to claim 2, characterized in that The displaying of the smart scene and / or sub-device in the floating window according to the preset conditions includes: Obtaining location information of the sub-device in the window page; The sub-devices whose sub-device location information belongs to the same location area are set in the same display area; wherein each of the display areas is displayed in different areas.

5. The method according to claim 1, wherein The displaying of the smart scene and / or sub-device in the floating window according to the preset conditions includes: In the sub-device display mode, obtaining device information, location information and status information of the sub-device; When displayed in the same line, a label is added to the sub-device on the floating window according to the device information, location information and status information of the sub-device, and the label corresponds to the device information and / or location information and / or status information of the sub-device.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Obtaining mode selection information corresponding to the parameter setting instruction to determine the start mode; When the activation mode is the self-learning activation mode, the smart scene is activated in the floating window according to the historical usage records and the current usage time.

7. The method according to claim 1, characterized in that The method further comprises: If the sub-device is a collection device, upon receiving a selection instruction triggered by a floating window corresponding to at least one of the sub-devices, real-time collection data of at least one of the collection devices is displayed.

8. The method according to claim 7, characterized in that After displaying the real-time collected data of at least one of the collection devices, the method further includes: When a zoom-in instruction is received based on the floating window corresponding to the acquisition device, the real-time image is zoomed in.

9. The method according to claim 1, characterized in that The displaying of the smart scene and / or sub-device in the floating window according to the preset conditions includes: When it is detected that the smart scene display button is turned on and the sub-device display button is turned off, an up and down switch button is displayed on the border of the floating window; When it is detected that the display smart scene button is turned off and the sub-device button is turned on, left and right switching buttons are displayed on the border of the floating window; When it is detected that the display smart scene and the sub-device button are turned on, an omnidirectional switching button is displayed on the border of the floating window.

10. The method according to claim 1, characterized in that The method further comprises: Obtaining current location information of the terminal device; The smart scene and / or the sub-device are determined according to the current location information of the terminal device.

11. A terminal device, characterized in that: The terminal device includes: at least one processor, and A memory, the memory being communicatively connected to the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1 to 10.

12. A non-volatile computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a terminal device, the terminal device is caused to execute the method according to any one of claims 1 to 10.

Images