Device interaction method and electronic device

Abstract

The present application relates to the technical field of devices. Disclosed are a device interaction method and an electronic device, which can realize switching between upper and lower hierarchical interfaces by means of amplifying interfaces. In the solution, the method comprises: an electronic device displaying a first interface, wherein the first interface comprises a first control and a second control, the first control indicating a first space, and the second control indicating a second space; and in response to a first operation on the first interface, amplifying and displaying the first control, and then switching to displaying a second interface corresponding to the first control, wherein the second interface comprises at least one control, such as m controls, m being a positive integer, and each control among the at least one control is configured to control at least one device in the first space or edit the status of the at least one device in the first space.

Description

Device interaction method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on December 15, 2023, with application number 202311739030X and application name “A device interaction method and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of device technology, and in particular to a device interaction method and an electronic device. Background Art

[0003] With the development of science and technology, smart homes are gradually becoming part of people's daily lives. Smart homes can use homes as a platform and utilize wireless local area networks, such as Wireless Fidelity (WiFi), to integrate and control smart devices in the home environment (such as smart TVs and smart air conditioners), thereby improving home safety, convenience, and comfort. Specifically, users can select the target device they want to control through the human-computer interaction interface provided by electronic devices such as control panels (such as central control screens) and mobile terminals (such as mobile phones and tablets) to achieve corresponding control of the target device.

[0004] To make it easier for users to find the target device they want to control, the home environment is currently divided into multiple spaces based on the room. Users can traditionally click to switch to the space where the target device is located within the main interface of the electronic device. For example, switching to the living room brings up the quick control interface for smart devices in that space, displaying all smart devices in the living room. This allows users to quickly find and control the target device. However, if the user needs to control a target device in another space, they must click the return control to return to the main interface for the space selection. The user then clicks again to switch to another space, accessing the quick control interface for smart devices in that space, and then find and control the target device. This entire process results in low interaction efficiency and limited intelligence for the electronic device. Furthermore, when there are many smart devices, finding the target device is difficult, requiring users to repeatedly click between different spaces.

[0005] Summary of the Invention

[0006] The present application provides a device interaction method and electronic device, which can improve the efficiency and intelligence of device interaction.

[0007] To achieve the above objectives, this application adopts the following technical solutions:

[0008] In a first aspect, a device interaction method is provided, which can be applied to an electronic device. The method comprises: displaying a first interface, the first interface comprising a first control and a second control, the first control indicating a first space, and the second control indicating a second space; in response to a first operation on the first interface, after magnifying the first control, switching to display a second interface corresponding to the first control, the second interface comprising at least one control, such as m controls, where m is a positive integer, each of the at least one control being used to control at least one device in the first space or edit the status of at least one device in the first space.

[0009] Among them, the first interface is a spatial hierarchical interface, which is used to distinguish and display the home environment in spatial dimensions. For example, the first interface displays a first control for indicating the first space, and a second control for indicating the second space. Of course, more controls for indicating more controls can also be displayed. Among them, the first space and the second space are different areas in the home environment. For example, the first space is the living room, and the second space is the master bedroom. The multi-space interface is shown in (b) of Figure 4.

[0010] Among them, the second interface is a device-level interface, which is used to distinguish and display the devices in a certain space. As a method, the second interface can be a device type-level interface, which is used to distinguish and display the smart devices in a space by the device type dimension. For example, the second interface displays a control indicating the main light group, through which the main light group can be turned on or off with one click, and the brightness, color temperature and other working states of the main light group can be edited with one click. The second interface can also display a control indicating a single air conditioner, through which a single air conditioner can be turned on or off with one click, and the temperature, wind direction and other working states of a single air conditioner can be edited with one click. As shown in the subsystem interface in (d) of Figure 4.

[0011] Alternatively, the second interface can be a single-device hierarchical interface, used to differentiate and display multiple smart devices of a certain type. For example, the second interface displays a control indicating Master Light 1 in a master light group, and another control indicating Master Light 2 in the same master light group. This control indicating Master Light 1 allows users to turn Master Light 1 on or off on a single device in the master light group with one click, or edit the brightness, color temperature, and other operating conditions of Master Light 1 on a single device in the master light group with one click. This is shown in the single-device interface in Figure 6 (b).

[0012] The solution provided by the first aspect above is that the electronic device can display a first interface of the space hierarchy to distinguish and display different spaces in the home environment with corresponding controls. The electronic device can also trigger the electronic device to display the enlarged control corresponding to a certain space in the first interface by detecting a specific operation such as the first operation performed by the user on the first interface, and realize the rapid switching of the device hierarchy interface under the certain space. Wherein, the device hierarchy interface under the certain space includes at least one control, such as the device hierarchy interface under the first space, which is the second interface. The user can control at least one device associated with the control in the space or edit the status of at least one device associated with the control in the space through one of the controls. In this way, by enlarging the control of a space on the first interface of the space hierarchy, you can quickly enter the device hierarchy interface under the space and realize the rapid control or device status editing of the device under the space. There is no need to control the electronic device to exit to the main interface to switch spaces and then search and control the device, which improves the efficiency and intelligence of device interaction while also being convenient and flexible to operate.

[0013] In one possible implementation, after displaying the second interface, the device interaction method further includes: returning to the first interface in response to a second operation on the second interface. Thus, by quickly entering the device-level interface of the first space, i.e., the second interface, by enlarging the first control on the first interface at the spatial level, the electronic device can also trigger a rapid return to the first interface at the spatial level by detecting a specific user operation on the second interface.

[0014] In one possible implementation, after displaying the second interface, the device interaction method also includes: in response to a second operation on the second interface, switching to display a third interface, the third interface includes a third control and a fourth control, the third control indicates the first space, and the fourth control indicates the second space.

[0015] Among them, the third interface is a spatial level interface, which is used to distinguish and display the home environment in spatial dimensions. The display style of the third interface may be different from that of the first interface. For example, although the third interface also displays a third control for indicating the first space and a fourth control for indicating the second space, the control color of the third control can be distinguished from other control displays to prompt the user that the user has previously entered the device level interface under the first space corresponding to the third control, that is, the second interface. In this way, by amplifying the display of the first control on the first interface and quickly entering the device level interface under the first space, that is, the second interface, the electronic device can also trigger the electronic device to quickly switch to the spatial level interface whose display style has changed, that is, the third interface, by detecting the user's specific operation on the second interface.

[0016] In one possible implementation, after returning to displaying the first interface, the device interaction method also includes: in response to a third operation on the first interface, after enlarging the display of the second control, switching to display the fourth interface corresponding to the second control, the fourth interface includes at least one control, such as n controls, where n is a positive integer, and each of the at least one control is used to control at least one device in the second space, or to edit the status of at least one device in the second space.

[0017] In this way, after returning to the first interface of the space level from the device-level interface under the first space, i.e., the second interface, the electronic device can continue to detect the user's specific operations on the first interface, such as the third operation, to trigger the electronic device to enlarge the display of the second control corresponding to the second space in the first interface, and realize the rapid switching of the device-level interface under the second space. Similarly, the device-level interface under the second space, i.e., the fourth interface, also includes at least one control. The user can control at least one device associated with the control in the second space, or edit the status of at least one device associated with the control in the second space through one of the controls. Therefore, on the first interface of the space level, the user can quickly switch to the device-level interface under different spaces by directly enlarging the controls corresponding to different spaces. There is no need to control the electronic device to exit to the main interface to switch spaces and then search and control the device. While improving the efficiency and intelligence of device interaction, the operation is convenient and flexible.

[0018] In one possible implementation, after switching to display the third interface, the device interaction method further includes: in response to a third operation on the third interface, after enlarging and displaying the fourth control, switching to display the fourth interface corresponding to the fourth control, the fourth interface includes at least one control, such as n controls, where n is a positive integer, and each of the at least one control is used to control at least one device in the second space, or to edit the status of at least one device in the second space. In this way, after switching from the device-level interface under the first space, i.e., the second interface, to the space-level interface whose display style has changed, i.e., the third interface, the electronic device can also continue to detect specific operations performed by the user on the third interface, such as the third operation, to trigger the electronic device to enlarge the display of the fourth control corresponding to the second space in the third interface, and to achieve rapid switching of the device-level interface under the second space.

[0019] In one possible implementation, the first operation is a multi-finger expansion operation. The multi-finger expansion operation is an expansion operation of at least two fingers. In this way, on the first interface of the space hierarchy, the user can use a flexible and simple multi-finger expansion (such as two-finger expansion) gesture operation to enlarge the control corresponding to a space in the first interface and quickly enter the device hierarchy interface under the space. This not only conforms to the operating habits of most users and is convenient for users to remember and operate, but also reflects the hierarchical relationship between the space and the devices under the space.

[0020] In one possible implementation, the first interface includes a first navigation bar, and the first operation is a first touch operation on the first navigation bar. The first touch operation can be any one of a first slide operation, a first single-click operation, a first double-click operation, or a first long-press operation. In this way, by simply operating the newly added navigation bar on the first interface of the space hierarchy, the user can trigger the electronic device to enlarge the control corresponding to a certain space in the first interface and enter the device-level interface under that space.

[0021] Optionally, the first navigation bar includes navigation point 1 and navigation point 2, where navigation point 1 indicates a spatial-level interface, such as the first interface described above, and navigation point 2 indicates a device-level interface, such as the second interface described above. The first touch operation may be a first sliding operation from navigation point 1 to navigation point 2, or may be any of a first single-click operation, a first double-click operation, and a first long-press operation on navigation point 2.

[0022] In one possible implementation, the second operation is a multi-finger pinch operation. A multi-finger pinch operation is a pinch operation of at least two fingers. Thus, on the second interface at the device level, the user can use a flexible and simple multi-finger pinch (such as a two-finger pinch) gesture to trigger the electronic device to quickly return to the first interface at the spatial level, or trigger the electronic device to quickly switch to an interface at the spatial level whose display style has changed, such as the third interface.

[0023] In one possible implementation, the second interface includes a second navigation bar, and the second operation is a second touch operation on the second navigation bar. The second touch operation can be any one of a second sliding operation, a second single-click operation, a second double-click operation, or a second long press operation. In this way, the user can trigger the electronic device to quickly return to the first interface of the spatial hierarchy by simply operating the newly added navigation bar on the second interface of the device level, or trigger the electronic device to quickly switch to an interface of the spatial hierarchy whose display style has changed, such as the third interface.

[0024] Optionally, the second navigation bar includes navigation point 3 and navigation point 4, where navigation point 3 indicates a spatial-level interface, such as the first or third interface described above, and navigation point 4 indicates a device-level interface, such as the second interface described above. The second touch operation may be a second sliding operation from navigation point 4 to navigation point 3, or may be any of a second single-click operation, a second double-click operation, and a second long-press operation on navigation point 3.

[0025] Optionally, the display styles of the first navigation bar and the second navigation bar may be the same. In this case, navigation point 1 and navigation point 3 are the same navigation point, and navigation point 2 and navigation point 4 are the same navigation point.

[0026] In one possible implementation, the device interaction method also includes: displaying a fifth interface, the fifth interface including a fifth control, a sixth control and a first area, the fifth control indicates the first space, the sixth control indicates the second space, the first area is used to display controls corresponding to the space to be combined to generate the smart scene, and the fifth control and the sixth control are located in the first area.

[0027] In this way, the electronic device can display a fifth interface for generating a cross-space smart scene. This fifth interface can distinguish and display different spaces in the home environment using corresponding controls. This fifth interface can include a first area. The electronic device can display controls corresponding to the spaces to be combined to generate the cross-space smart scene in the first area, helping the user intuitively understand which spaces will be combined to generate a smart scene.

[0028] Optionally, the first area may be expressed in the form of a viewfinder, or in other forms such as a rectangular frame, a circular frame, etc., which is not limited in this application.

[0029] In one possible implementation, after displaying the fifth interface, the device interaction method further includes: generating a first scene in response to a fourth operation on the fifth interface, the first scene being used to control multiple devices in the first space and the second space. In this way, the electronic device triggers the electronic device to combine the spaces corresponding to different controls in the first area of ​​the fifth interface by detecting a specific operation, such as the fourth operation, performed by the user on the fifth interface, so as to generate a cross-space smart scene with one click. When the user determines to execute the smart scene, the electronic device can control the devices in the spaces corresponding to the different controls in the first area to perform corresponding operations.

[0030] Optionally, the fifth interface includes a confirmation control, and the fourth operation is a touch operation on the confirmation control, so that the user can trigger the generation of the cross-space intelligent scene by clicking the corresponding control.

[0031] In one possible implementation, after displaying the fifth interface, the user can also voice-trigger the electronic device to combine the spaces corresponding to different controls in the first area of ​​the fifth interface to generate a cross-space smart scene with one click.

[0032] In one possible implementation, before displaying the fifth interface, the device interaction method further includes: displaying a sixth interface, the sixth interface including a plurality of controls located outside the first area, such as k controls, where k is an integer greater than 1, and the first area, the plurality of controls including a fifth control and a sixth control; in response to a user operation, in the sixth interface, moving the fifth control and the sixth control into the first area. In this way, the electronic device can display a sixth interface for adding spaces to a cross-space smart scene, and the sixth interface can distinguish and display different spaces in a home environment with corresponding controls, and display them outside the first area. The user can move a control into the first area to add the space corresponding to the control to the cross-space smart scene.

[0033] In one possible implementation, the first interface of the spatial hierarchy further includes a seventh control. After displaying the first interface, the device interaction method further includes: displaying a sixth interface in response to an operation on the seventh control. In this way, the electronic device can add a control for the cross-space smart scene service to the first interface of the spatial hierarchy, allowing the user to quickly access the sixth interface for adding spaces to the cross-space smart scene and customize the selection of multiple spaces to be added to the cross-space smart scene.

[0034] In one possible implementation, the second interface of the above-mentioned device level includes multiple controls, such as the above-mentioned m controls, where m is a positive integer, and at least one of the multiple controls is located in the second area of ​​the second interface. After displaying the second interface, the device interaction method also includes: when executing the first scene, controlling the device in the first space associated with at least one control in the second area to execute the first scene with preset parameters.

[0035] Among them, the second area is used to display the controls associated with the devices in the first space that are in the turned-on state. The shape of the second area can be circular, such as the area within the inner ring 106 shown in (d) in Figure 4, and it can also be rectangular, fan-shaped, etc., which is not limited in this application. That is to say, when there is a control located in the second area in the second interface of the device hierarchy, at least one device associated with the control in the first space is in the turned-on state. At this time, the user can use the control to edit the status of at least one device associated with the control in the first space. Optionally, the preset parameters are the corresponding working parameters of the device after the user edits the status of the device through the control, such as the brightness value and color temperature value of the light.

[0036] Optionally, the first scene may be a smart scene, which may be a smart scene generated in a single space, such as the first space, and capable of controlling at least one device in the first space to execute the smart scene. Alternatively, the first scene may be a cross-space smart scene generated by combining multiple spaces, such as a smart scene generated by combining the first space and the second space, and capable of controlling at least one device in the first space and the second space to execute the smart scene.

[0037] Thus, in the possible implementation described above, the electronic device can combine the controls in the second area of ​​the device hierarchy interface (second interface) in the first space to generate a related smart scene. Thus, when the electronic device executes the related smart scene, it can control the devices in the first space associated with the controls in the second area to execute the smart scene according to preset parameters.

[0038] Optionally, the electronic device can combine only the controls within the second area in the device hierarchy interface (second interface) of the first space to generate a related smart scene. Thus, when the electronic device executes the related smart scene, it can control only the devices in the first space associated with the controls within the second area, executing the smart scene with preset parameters.

[0039] Optionally, the electronic device can simultaneously combine the controls in the second area and the controls outside the second area in the device hierarchy interface (second interface) of the first space to generate a related smart scene. Thus, when the electronic device executes the related smart scene, it can control not only the devices in the first space associated with the controls in the second area, but also the devices in the first space associated with the controls outside the second area.

[0040] In one possible implementation, the second interface of the above-mentioned device level includes multiple controls, such as the above-mentioned m controls, where m is a positive integer, and at least one of the multiple controls is located outside the second area of ​​the second interface. After displaying the second interface, the device interaction method also includes: when executing the first scene, closing the device in the first space associated with at least one control outside the second area.

[0041] The area outside the second area is used to display controls associated with devices in the first space that are in a closed state. The closed state can be when the device is turned off, or when the device is turned on but in a suspended or dormant state.

[0042] Thus, in the possible implementation method described above, the electronic device can combine the controls in the second area and the controls outside the second area in the device hierarchy interface (second interface) of the first space to generate a related smart scene. Thus, when the electronic device executes the related smart scene, it can control the devices associated with the controls in the second area in the first space to execute the smart scene with preset parameters, and can also turn off the devices associated with at least one control outside the second area in the first space, such as saving the off state of the device associated with at least one control outside the second area in the first space, or switching the device associated with at least one control outside the second area in the first space from the on state to the off state.

[0043] In one possible implementation, the m controls in the second interface of the device level include an eighth control. After displaying the second interface, the device interaction method further includes: adjusting a parameter of at least one device associated with the eighth control in response to an operation on the eighth control. When the eighth control is associated with multiple devices, the multiple devices may be of the same device type. In this way, a user can directly adjust the operating parameters of one or more devices associated with a control by operating the control.

[0044] Optionally, in response to the operation on the eighth control, the electronic device may also pop up an adjustment interface, and the user can directly adjust the working parameters of one or more devices associated with the control on the adjustment interface.

[0045] In one possible implementation, the device interaction method further includes: in response to an operation on an eighth control, adjusting a display style of the eighth control to adjust parameters of a device associated with the eighth control. In this way, a user can directly adjust operating parameters of one or more devices associated with the control on the control.

[0046] In one possible implementation, the display style includes at least one of display content, control color, and control fill.

[0047] In one possible implementation, the first interface includes multiple controls, such as q controls, where q is an integer greater than 1, and the first control is located in the central area of ​​the area where the multiple controls are located. For example, in the first interface, the second controls are distributed on a circle centered on the first control. After displaying the first interface, the device interaction method further includes: in the first interface, moving the second control to the central area where the first control is located; in response to the fifth operation on the first interface, after magnifying and displaying the second control, switching to display the fourth interface corresponding to the second control, the fourth interface includes at least one control, such as n controls, where n is a positive integer. Each of the at least one control is used to control at least one device in the second space, or to edit the status of at least one device in the second space. In this way, the electronic device can only magnify and display the controls located in the central area, and realize quick switching of the device-level interface under the space corresponding to the control.

[0048] In one possible implementation, the m controls in the second interface of the above-mentioned device hierarchy include a ninth control, which indicates multiple devices of the first type in the first space. After displaying the second interface, the device interaction method further includes: in response to the sixth operation on the second interface, switching to display the seventh interface corresponding to the ninth control, the third interface includes multiple controls, the multiple controls correspond to multiple devices, and each of the multiple controls is used to control a device of the first type, or to edit the status of a device of the first type.

[0049] The second interface may be a device type level interface, which is used to differentiate and display smart devices in a space by device type. The seventh interface is a single device level interface, which is used to differentiate and display multiple smart devices of a certain type.

[0050] In this way, after the electronic device displays the device type hierarchical interface of the first space, i.e., the second interface, to distinguish and display the smart devices in the first space by the device type dimension, the electronic device can also trigger the electronic device to quickly switch to the single device hierarchical interface in the first space by detecting a specific operation, such as the sixth operation, performed by the user on the second interface. The single device hierarchical interface can distinguish and display different devices of the same type with corresponding controls. The user can control a corresponding device or edit the status of the device through one of the controls. In this way, the electronic device realizes rapid switching from the device type hierarchical interface to the single device hierarchical interface, and can also realize rapid control of a single device of a certain type or editing of the status of a single device.

[0051] In one possible implementation, before switching to displaying the seventh interface corresponding to the ninth control, the electronic device may also, in response to the sixth operation on the second interface, enlarge the second interface. In this way, the electronic device can quickly switch from the device type hierarchical interface to the single device hierarchical interface by enlarging the device type hierarchical interface.

[0052] In one possible implementation, after displaying the seventh interface at the single-device level, the device interaction method further includes: returning to displaying the second interface in response to a seventh operation on the seventh interface. Thus, after the electronic device quickly switches from the second interface at the device type level to the seventh interface at the single-device level, the electronic device can also trigger a rapid return to the second interface at the device type level by detecting a specific user operation on the seventh interface.

[0053] In one possible implementation, after displaying the seventh interface of a single device level, the device interaction method further includes: in response to a seventh operation on the seventh interface, switching to display an eighth interface, the eighth interface including at least one control, such as p controls, where p is a positive integer, and each of the at least one control is used to control at least one device in the first space, or to edit the status of at least one device in the first space.

[0054] Among them, the eighth interface is an interface at the device type level, which is used to distinguish and display smart devices in a space by device type dimension. The display style of the eighth interface can be different from the second interface. In this way, after the electronic device quickly switches from the second interface of the device type level to the seventh interface of the single device level, the electronic device can also trigger the electronic device to quickly switch to the interface of the device type level with a changed display style, that is, the eighth interface, by detecting a specific operation performed by the user on the seventh interface.

[0055] In one possible implementation, the m controls in the second interface of the device level also include a tenth control, which indicates multiple devices of the second type in the first space. After displaying the second interface, the device interaction method further includes: in response to a sixth operation on the second interface, switching to display a seventh interface corresponding to the ninth and tenth controls, the seventh interface including a third area and a fourth area, the multiple controls in the third area corresponding to multiple devices of the first type, and the multiple controls in the fourth area corresponding to multiple devices of the second type. In this way, the electronic device can display the controls corresponding to multiple single devices of the same type in the same area, making it easier for users to quickly understand whether each single device belongs to the same type through different areas.

[0056] In one possible implementation, before returning to the second interface or switching to the eighth interface, the device interaction method further includes: in response to a seventh operation on the seventh interface, reducing the display of the seventh interface. In this way, the electronic device can quickly switch from the single-device level interface to the device type level interface by reducing the display of the single-device level interface.

[0057] In one possible implementation, before returning to displaying the first interface or before switching to displaying the third interface, the device interaction method further includes: in response to a second operation on the second interface, reducing the display of the second interface. In this way, the electronic device can quickly switch from the device-level interface to the space-level interface by reducing the display of the device-level interface.

[0058] In a second aspect, a device interaction device is provided, which is included in an electronic device and has the function of implementing the above-mentioned first aspect or any possible design method thereof. The function can be implemented by hardware, or it can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above-mentioned functions. For example, the device interaction device may include a display module. The display module is used to: display a first interface, the first interface includes a first control and a second control, the first control indicates the first space, and the second control indicates the second space. The display module is also used to: in response to a first operation on the first interface, after enlarging the display of the first control, switch to displaying the second interface corresponding to the first control, the second interface includes at least one control, such as m controls, m is a positive integer, and each control of the at least one control is used to control at least one device in the first space, or edit the status of at least one device in the first space.

[0059] In a third aspect, an electronic device is provided, comprising a memory and one or more processors; the memory is used to store a program, and when the processor executes the program, the electronic device executes the device interaction method in any possible implementation of the first aspect above.

[0060] Optionally, the electronic device is a device with a display screen, such as a hub device, a mobile phone, or a tablet computer.

[0061] In a fourth aspect, a chip system is provided. The chip system includes one or more interface circuits and one or more processors. The interface circuits and processors are interconnected via a circuit. The interface circuits are configured to receive a signal from a memory of an electronic device and send the signal to the processor. The signal includes instructions stored in the memory. When the processor executes the instructions, the computing device performs the device interaction method according to any possible implementation of the first aspect.

[0062] In a fifth aspect, a readable storage medium is provided, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute the device interaction method in any possible implementation of the first aspect.

[0063] It can be understood that the beneficial effects that can be achieved by the above-mentioned device of the second aspect, the electronic device of the third aspect, the chip system of the fourth aspect, and the readable storage medium of the fifth aspect can be referred to the beneficial effects of the first aspect and any possible implementation thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] FIG1 is a first schematic diagram of a user interface provided in an embodiment of the present application;

[0065] FIG2 is a second schematic diagram of a user interface provided in an embodiment of the present application;

[0066] FIG3 is a third schematic diagram of a user interface provided in an embodiment of the present application;

[0067] FIG4 is a fourth diagram of a user interface provided in an embodiment of the present application;

[0068] FIG5 is a fifth schematic diagram of a user interface provided in an embodiment of the present application;

[0069] FIG6 is a sixth diagram of a user interface provided in an embodiment of the present application;

[0070] FIG7 is a seventh schematic diagram of a user interface provided in an embodiment of the present application;

[0071] FIG8 is a schematic diagram of an eighth user interface provided in an embodiment of the present application;

[0072] FIG9 is a ninth diagram of a user interface provided in an embodiment of the present application;

[0073] FIG10 is a schematic diagram of a user interface provided in an embodiment of the present application;

[0074] FIG11 is a schematic diagram of a user interface eleven provided in an embodiment of the present application;

[0075] FIG12 is a schematic diagram of a twelfth user interface provided in an embodiment of the present application;

[0076] FIG13 is a thirteenth schematic diagram of a user interface provided in an embodiment of the present application;

[0077] FIG14 is a schematic diagram of a user interface provided in an embodiment of the present application;

[0078] FIG15 is a schematic diagram of the fifteenth user interface provided in an embodiment of the present application;

[0079] FIG16 is a sixteenth schematic diagram of a user interface provided in an embodiment of the present application;

[0080] FIG17 is a schematic diagram of a user interface according to an embodiment of the present application;

[0081] FIG18 is a schematic diagram of the eighteenth user interface provided in an embodiment of the present application;

[0082] FIG19 is a diagram of a system architecture provided in an embodiment of the present application;

[0083] FIG20 is a flow chart of a device interaction method provided in an embodiment of the present application;

[0084] FIG21 is a flowchart of another device interaction method provided in an embodiment of the present application;

[0085] Figure 22 is a flowchart of another device interaction method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0086] Currently, control of smart devices in the home is typically achieved through human-computer interaction interfaces (HMIs) provided by electronic devices, such as control panels (e.g., central control screens) and mobile devices (e.g., mobile phones and tablets). Because smart devices are typically categorized by the space they belong to, such as living room lights or bedroom lights, the HMIs provided by electronic devices typically include control interfaces for each space, allowing users to centrally control smart devices in a specific space through the control interface of that space.

[0087] The following takes the central control screen as an example of an electronic device and introduces the technical solution provided by the embodiment of the present application in combination with the accompanying drawings.

[0088] As an example, as shown in (a) of Figure 1, the human-computer interaction interface displayed on the central control screen 100 may include a whole house option 101 and a living room option 102. Among them, the whole house option 101 is used to trigger the central control screen 100 to display the "whole house" control interface, and the user can use the "whole house" control interface to perform one-click control or single control of the smart devices in the whole house. For example, one-click control turns off all the lights in the whole house. The living room option 102 is used to trigger the central control screen 100 to display the "living room" control interface, and the user can use the "living room" control interface to perform one-click control or single control of the smart devices in the living room.

[0089] For example, when a user clicks on the whole house option 101, the central control screen 100 may respond to the click operation and display the "whole house" control interface as shown in (a) of Figure 1. The user can control all the lights in the house to turn off with one click by clicking on the "turn off all lights in the house" control 103 in the "whole house" control interface. Similarly, the user can also click on the living room option 102. In response to the click operation, the central control screen 100 may switch to display the "living room" control interface as shown in (b) of Figure 1. The user can control all the lights in the living room to turn off with one click by clicking on the "lights off" control 104 in the "living room" control interface.

[0090] In some scenarios, in addition to controlling the power on and off of smart devices in the "living room" space through click operations, you can also control the power on and off of smart devices in the "living room" space through drag gestures.

[0091] For example, as shown in FIG1(b), the "Living Room" control interface displayed on the central control screen 100 also includes a quick control 105. This quick control 105 is used to trigger the central control screen 100 to display the quick control interface for the smart devices in the current space. When the user clicks this quick control 105, the central control screen 100 responds by displaying the quick control interface for the smart devices in the "Living Room" space, as shown in FIG1(c). This quick control interface is displayed as a ring diagram, including an inner ring 106 and an outer ring 107, where the outer ring 107 can be displayed or hidden. Multiple spherical controls can be displayed within the inner ring 106 and on the outer ring 107. Each spherical control represents a specific type of smart device in the "Living Room" space. For example, the "Auxiliary Light" spherical control 108 shown in FIG1(c) represents auxiliary light-related smart devices in the "Living Room" space, such as auxiliary light 1 and auxiliary light 2. The shape of the spherical control can also be replaced with a rectangle, a sector, or other shapes, which are not limited here.

[0092] Optionally, to distinguish between the inner area of ​​inner ring 106 and the spherical controls on outer ring 107, the type identifier of the corresponding smart device may be displayed in each spherical control (or above or below the spherical control). The type identifier may be in the form of text, an icon, etc. For example, as shown in FIG1(c), the spherical controls displaying text labels such as "ceiling light," "purification," and "music" may correspond to a ceiling light smart device, an air purifier smart device, and a music player smart device in the "living room" space, respectively.

[0093] Among them, when the spherical control is located in the inner area of ​​the inner ring 106, it can indicate that the smart device of the type corresponding to the spherical control is in the turned-on state. As shown in (c) in Figure 1, the "humidification" spherical control is located in the inner area of ​​the inner ring 106, indicating that the smart device of the air humidification type in the living room is in the turned-on state. Optionally, the spherical control located in the inner area of ​​the inner ring 106 can be highlighted to remind the user that the corresponding type of smart device is turned on. Among them, the way to highlight the spherical control can be to enlarge the spherical control, fill the spherical control with a specified color (such as yellow, blue, etc.), mark the spherical control with a specified text (such as turned on, opened, etc.), etc., and this application is not limited to this. As shown in (c) in Figure 1, the spherical controls such as "music", "humidification", and "atmosphere light" in the inner area of ​​the inner ring 106 are highlighted in black.

[0094] When the spherical control is on the outer ring 107, that is, when the spherical control surrounds the periphery of the inner ring 106, it may indicate that the smart device of the type corresponding to the spherical control is in the off state. As shown in (c) in Figure 1, the "air conditioning" spherical control is located on the outer ring 107, indicating that the air conditioning type smart device in the living room is in the off state. Optionally, the spherical control located on the outer ring 107 can be unhighlighted to remind the user that the corresponding type of smart device is turned off. As shown in (c) in Figure 1, the spherical controls such as "air conditioning", "purification", and "water dispenser" on the outer ring 107 are displayed in white or transparent colors, and are not highlighted in black.

[0095] After the central control screen 100 displays the aforementioned quick control interface, the user can drag the spherical control on the outer ring 107 of the quick control interface to the inner area of ​​the inner ring 106, or directly click the spherical control on the outer ring 107 of the quick control interface to trigger the spherical control to automatically move to the inner area of ​​the inner ring 106, thereby quickly opening the corresponding type of smart device. The user can also drag the spherical control in the inner area of ​​the inner ring 106 to the periphery of the inner ring 106, such as the outer ring 107, or directly click the spherical control in the inner area of ​​the inner ring 106 to trigger the spherical control to automatically move to the periphery of the inner ring 106, such as the outer ring 107, thereby quickly closing the corresponding type of smart device.

[0096] For example, as shown in (c) of Figure 1, when the user drags the "auxiliary light" spherical control 108 on the outer ring 107 and approaches the inner ring area of ​​the inner ring 106, in response to the drag operation, the central control screen 100 can control the auxiliary light type smart device corresponding to the "auxiliary light" spherical control 108 in the "living room" space to turn on, and can display the quick control interface shown in (d) of Figure 1. In this quick control interface, the "auxiliary light" spherical control 108 moves to the inner ring area of ​​the inner ring 106 and is highlighted to remind the user that the auxiliary light type smart device in the living room has been turned on. Optionally, when the "auxiliary light" spherical control 108 moves to the inner ring area of ​​the inner ring 106, it can be adsorbed or attached to other spherical controls in the inner ring area of ​​the inner ring 106.

[0097] In one possible implementation, there is typically only one smart device of a certain type in the "living room" space, such as an air purifier for air purification, a humidifier for air humidification, a speaker for music playback, and an air conditioner. In this case, a single spherical control can represent that single smart device. For example, the "Purification" spherical control shown in (c) of Figure 1 can represent a single air purifier, the "Humidification" spherical control can represent a single humidifier, the "Music" spherical control can represent a single speaker, and the "Air Conditioning" spherical control can represent a single air conditioner.

[0098] In this case, the user can quickly turn on or off the single device corresponding to the spherical control by dragging the spherical control into or out of the area within the inner ring 106. For example, if the user drags the "Air Conditioning" spherical control on the outer ring 107 close to the area within the inner ring 106, the central control screen 100 can control the single device corresponding to the "Air Conditioning" spherical control in the "Living Room" space to turn on the air conditioner in response to the drag operation.

[0099] In one possible implementation, there are usually multiple, and sometimes only one, smart devices of a certain type in the "living room" space, such as ceiling lights, auxiliary lights, curtains, etc. The central control screen can group these smart devices into a device group. For example, smart devices of the ceiling light type, such as ceiling light 1, ceiling light 2, and ceiling light 3, can form a ceiling light device group, and smart devices of the curtain type, such as curtain 1 and curtain 2, can form a curtain device group. At this time, a spherical control can represent the device group. For example, the "ceiling light" spherical control shown in (c) of Figure 1 can represent the ceiling light device group, the "curtain" spherical control can represent the curtain device group, and the "auxiliary light" spherical control can represent the auxiliary light device group.

[0100] In this case, the user can quickly turn on or off the device group corresponding to the spherical control by dragging the spherical control into or out of the area within the inner ring 106. For example, if the user drags the "auxiliary light" spherical control 108 on the outer ring 107 close to the area within the inner ring 106, the central control screen 100 can control the auxiliary light device group corresponding to the "auxiliary light" spherical control 108 in the "living room" space to turn on in response to the drag operation.

[0101] However, after the user uses the above-mentioned drag gesture to achieve quick on / off control of at least one type of smart device in the "living room" space, if the user also needs to control the smart device in another space, he needs to control the central control screen to first exit the quick control interface of the current space to return to the main interface, and open the space selection interface to switch to another space, and then enter the quick control interface of the other space again to achieve quick on / off control of at least one type of smart device in the other space.

[0102] For example, as shown in (d) of Figure 1, the quick control interface for the "Living Room" space also includes an exit control 109 for exiting the quick control interface of the current space. When the user clicks exit control 109, in response to the click, the central control screen 100 exits the quick control interface for the "Living Room" space and displays the "Living Room" control interface (also referred to as the main interface or primary interface) shown in (b) of Figure 1. The "Living Room" control interface also includes a space switching control 110 for triggering the central control screen 100 to display the space selection interface.

[0103] Taking the example of the user also needing to control the smart device in the "master bedroom" space, after the user clicks on the space switching control 110, in response to the click operation, the central control screen 200 may display the space selection interface 111 as shown in (a) of Figure 2. The space selection interface 111 may include options for multiple spaces such as the master bedroom and the kitchen. After the user selects the master bedroom option 112, in response to the selection operation, the central control screen 100 may display the "master bedroom" control interface as shown in (b) of Figure 2. Similarly, the user can also enter the quick control interface of the smart device under the "master bedroom" space as shown in (c) of Figure 2 by clicking on the quick control control 105 in the "master bedroom" control interface. Then, the quick switch control of at least one type of smart device in the "master bedroom" space is achieved through drag gestures.

[0104] In other words, the current quick control interface is strictly divided according to space. It can only display the status of smart devices in the current space and can only quickly control smart devices in the current space. It cannot realize the quick control of smart devices across spaces. The operation is single and not flexible enough. In addition, the current quick control interface controls the smart devices in the current space based on the device type dimension. When smart devices of the same type form a device group, although one-click control of the device group can be achieved, it is impossible to perform fine control of a single smart device in the device group. As shown in (c) in Figure 1, the user can turn on the auxiliary light device group in the living room with one click by dragging the "auxiliary light" ball control 108 on the outer ring 107 to the inner area of ​​the inner ring 106, that is, turn on all auxiliary light-type smart devices in the living room such as auxiliary light 1, auxiliary light 2, and auxiliary light 3 with one click, but cannot perform fine control of a single auxiliary light 1.

[0105] Based on the above problems, the embodiment of the present application provides a device interaction method. On the basis of the original quick control interface, a multi-space level interface and a single device level interface are added, and the interface switching between the multiple levels of interfaces is realized through flexible and simple gestures. In this way, when the central control screen enters the quick control interface of the smart device in any space, it can respond to the user's specific gestures and display multiple levels of interfaces. The multiple levels of interfaces include a multi-space level interface, a device type level interface (similar to the original quick control interface) and a single device level interface. In this way, it can not only clearly express the hierarchical relationship between devices, that is, the environment contains multiple spaces, each space contains multiple types of smart devices, and when smart devices of the same type form a device group, each device group contains one or more single devices. It can also quickly find the target device to be controlled in any space through flexible and simple gesture operations. The user does not need to control the central control screen to exit the quick control interface of the current space, return to the main interface to switch spaces, and then search for devices, which improves the interaction efficiency and intelligence of the central control screen and makes the operation more convenient and flexible.

[0106] In addition, in order to meet the needs of users to control multiple smart devices at the same time, the central control screen also provides a smart scene generation function. Users can customize smart scenes through the central control screen, that is, manually set the execution actions of multiple devices to combine. For example, when leaving home, you can choose to turn off the lights, turn off the air conditioner, and turn off the TV. The central control screen can then display a corresponding function control (such as a button or card) to achieve the function of triggering the smart scene with one click. However, the current way of customizing smart scenes usually requires users to set the execution actions of each smart device in turn on the central control screen. The steps are very cumbersome and the operability is poor.

[0107] In some scenarios, to reduce the tedious steps involved in creating smart scenes, users can also quickly create a smart scene for the current space through the quick control interface. For example, as shown in (c) of Figure 1, the quick control interface for the "Living Room" space also includes a Create Scene control 113, which saves the currently configured actions for multiple devices as the newly created smart scene.

[0108] Optionally, after the user operates the central control screen 100 to enter the quick control interface of the smart device in the "living room" space, the user can drag the spherical control into or out of the inner ring area of ​​the inner ring 106 according to current needs to set the switch action required for the smart device corresponding to each spherical control. Then, as shown in (a) in Figure 3, the user can click on the generated scene control 113. As a way, in response to the click operation, the central control screen 100 saves the switch actions of the currently set smart devices as the newly created smart scene. For example, save the currently set smart devices corresponding to the spherical controls such as "music", "humidification", "atmosphere light", and "auxiliary light", and turn off the smart scenes corresponding to the spherical controls such as "air conditioning", "water dispenser", "curtain", "ceiling light", and "purification".

[0109] As another way, in response to the click operation, the central control screen 100 can also save the current quick control interface as a snapshot, and display the scene generation interface as shown in (b) in Figure 3, so that the user can select all or part of the switch action combinations of the smart devices just set from the switch actions of the smart devices to generate the current new smart scene.

[0110] As shown in Figure 3(b), a snapshot of the current quick control interface is displayed on the left side of the scene generation interface. This snapshot includes a circular diagram of the corresponding spherical controls after the on / off actions of each smart device have just been set. This allows users to quickly determine which smart devices are set to on by checking whether the spherical controls corresponding to each smart device in the snapshot are located within the inner ring area.

[0111] Generally, when multiple smart devices are installed in the same space, they can be categorized based on their functions. For example, smart devices that provide lighting functions, such as chandeliers, ceiling lights, and auxiliary lights, can be classified as lighting systems. Similarly, smart devices that provide air environment monitoring capabilities, such as air conditioners, air purifiers, humidifiers, and dehumidifiers, can be classified as cooling, heating, and fresh air systems. Similarly, smart devices that provide shading functions, such as curtains, gauze curtains, blinds, and awnings, can be classified as shading systems.

[0112] As shown in Figure 3(b), the central control screen also provides options 114, a confirmation control 115, and a cancel control for each system in the scene generation interface. This allows users to select or uncheck the options for at least one system to select the switch action combination of the smart devices in the corresponding system to generate a smart scene. Optionally, when the user unchecks the options for at least one system, the central control screen can also synchronously update the snapshot information on the left side of the scene generation interface.

[0113] For example, as shown in Figure 3 (c), the user can uncheck the options for systems like sunshade and home appliances, resulting in the final combined smart scene not having the on / off actions of the smart devices in the sunshade and home appliance systems. In this case, compared to the circular diagram shown in Figure 3 (b), the circular diagram in Figure 3 (c) has removed the "Curtain" spherical control for the sunshade system and the "Water Dispenser" spherical control for the home appliance system.

[0114] The user can then click the confirmation control 115. In response to this click, the central control screen 100 can display the scene naming interface shown in (d) of Figure 3. After the user enters a customized scene name such as "Leisure Scene" and clicks the confirmation control, the central control screen can complete the creation and saving of the smart scene.

[0115] Because the current quick control interface is strictly divided according to space, it can only quickly generate smart scenes for the current space, and cannot quickly generate smart scenes across spaces. The operation is simple and not flexible enough. To solve this problem, the embodiment of the present application provides an interface display method that adds a multi-space hierarchy interface to the quick control interface. Users can customize the selection of multiple spaces to be added to the smart scene in the multi-space hierarchy interface. This allows one-click generation of cross-space smart scenes for the selected multiple spaces.

[0116] The following will introduce the device interaction method provided in the embodiments of the present application with reference to several examples.

[0117] In an embodiment of the present application, the quick control interface is a multi-level interface consisting of a multi-space interface, a subsystem interface, and a single-device interface. Among them, the multi-space interface is the first-level interface of the quick control interface, which is used to differentiate and display the home environment by spatial dimension. The subsystem interface is the second-level interface of the quick control interface, that is, the next-level interface of the multi-space interface, which is used to differentiate and display the smart devices in a space by device type dimension. The single-device interface is the third-level interface of the quick control interface, that is, the next-level interface of the subsystem interface, which is used to independently display at least one smart device of the same type.

[0118] Users can trigger the central control screen to switch between multiple levels of interfaces in the quick control interface by performing multi-finger operations on the interface or operating the newly added navigation bar in the interface.

[0119] As an exemplary embodiment, FIG. 4 (a) to FIG. 12 (c) illustrate the function of the central control screen switching between multi-level interfaces in the quick control interface in response to multi-finger operations.

[0120] For example, as shown in (a) in Figure 4, the central control screen 100 currently displays the control interface of the "living room" space. When the user clicks the quick control control 105 in the control interface, in response to the click operation, the central control screen 100 can enter the quick control interface under the "living room" space. At this time, the central control screen 100 can display the first-level interface of the quick control interface as shown in (b) in Figure 4, that is, the multi-space interface. The multi-space interface contains multiple space balls. Each space ball represents a space in the home environment. For example, the "living room" space ball 116 represents the living room space in the home environment. Among them, the shape of the space ball is spherical or circular, and it can also be replaced by a rectangular, fan-shaped or other shape, which is not limited here.

[0121] Optionally, as shown in (b) of Figure 4, when the central control screen 100 arranges and displays the multiple space balls in the multi-space interface, the "living room" space ball 116 corresponding to the current space (i.e., the living room) can be placed in the center by default, and the space balls corresponding to other spaces can be surrounded by the "living room" space ball 116 corresponding to the current space.

[0122] Optionally, to distinguish the space balls, a corresponding space identifier is displayed within each space ball (or above or below the space ball). The space identifier can be in the form of text, an icon, or the like. For example, as shown in FIG4(b), the space balls display text identifiers such as "Living Room," "Master Bedroom," and "Kitchen." These space balls may represent the living room, master bedroom, and kitchen, respectively, within a home environment.

[0123] In the embodiment of the present application, in the above multi-space interface, the user can select the current space (i.e., the living room) to view or quickly control the related smart devices in the current space, or select other spaces to view or quickly control the related smart devices in other spaces. Therefore, in the quick control interface of the current space, space switching can be achieved, without having to control the central control screen 100 to exit the quick control interface of the current space, return to the main interface to achieve space switching, and then re-enter the quick control interface of another space to achieve quick control of the smart devices in the other space.

[0124] In the embodiment of the present application, a user can perform a multi-finger pinch-out operation 1, i.e., a pinch-out operation with at least two fingers, on the multi-space interface to trigger the central control screen 100 to enter the next-level interface, i.e., the subsystem interface. The multi-finger pinch-out operation can be any of the preset two-finger pinch-out operations, three-finger pinch-out operation, four-finger pinch-out operation, or five-finger pinch-out operation. In the following embodiments, the method of the embodiment of the present application is described using the multi-finger pinch-out operation 1 as an example.

[0125] As shown in (c) in Figure 4, after the user performs a two-finger expansion operation 1 on the multi-space interface, in response to the two-finger expansion operation 1, the central control screen 100 can switch to display the subsystem interface of the next level as shown in (d) in Figure 4. The subsystem interface is presented as a ring diagram, which may be similar to the quick control interface shown in (c) in Figure 1, including an inner ring 106 and an outer ring 107. A plurality of spherical controls can be displayed on the inner area of ​​the inner ring 106 and the outer ring 107, and the spherical controls can also be called subsystem balls. Each subsystem ball represents a certain type of smart device in the current space. As shown in (d) in Figure 4, the "atmosphere light" subsystem ball represents an atmosphere light type smart device in the "living room" space. Optionally, the shape of the spherical control can also be replaced with a rectangle, a fan, or the like, which is not limited here.

[0126] In some embodiments, a subsystem ball displayed in the subsystem interface may represent a device group. A device group is composed of a certain type of smart device, and there are usually multiple, or sometimes only one, smart device of this type in a space. For example, there are usually multiple auxiliary light devices in the living room space, such as auxiliary light 1, auxiliary light 2, and auxiliary light 3. These devices can form an auxiliary light device group. In this case, the "auxiliary light" subsystem ball in the subsystem interface shown in (d) of Figure 4 can correspond to the auxiliary light device group. For another example, there are usually multiple curtain devices in the living room space, such as curtain 1 and curtain 2. These devices can form a curtain device group. In this case, the "curtain" subsystem ball in the subsystem interface shown in (d) of Figure 4 can correspond to the curtain device group.

[0127] In other embodiments, a subsystem ball displayed in the subsystem interface may also represent a single smart device. For example, there is usually only one air conditioner in the living room. In this case, the "Air Conditioner" subsystem ball in the subsystem interface shown in FIG4(d) may correspond to the single air conditioner. For another example, there is usually only one air purification device, such as an air purifier, in the living room. In this case, the "Purification" subsystem ball in the subsystem interface shown in FIG4(d) may correspond to the single air purifier.

[0128] Generally, when there are many types of smart devices in the same space, the different types of smart devices in the space can also be differentiated according to their functions to form multiple device subsystems. For example, smart devices that provide lighting functions, such as the main light device group, the pendant light device group, the ceiling light device group, and the auxiliary light device group, can be divided into the lighting subsystem. Another example is that smart devices that provide sunshade functions, such as the curtain device group and the gauze curtain device group, can be divided into the sunshade subsystem. Another example is that smart devices that provide air environment monitoring functions, such as air conditioners and air purifiers, can be divided into the heating, cooling, and fresh air subsystem.

[0129] Optionally, the central control screen may also provide options for each subsystem in the subsystem interface to display the subsystem balls under the corresponding subsystem based on the option selected by the user. As shown in (d) in Figure 4, the central control screen 100 may display options for each subsystem on the right side of the subsystem interface, such as the "Lighting" option, the "Sunshade" option, the "Heating and Cooling Fresh Air" option, the "Audio and Video Entertainment" option, the "Home Appliances" option, etc., as well as the "All" option for displaying the subsystem balls under all subsystems. As shown in (d) in Figure 4, after the user clicks the "All" option, in response to the click operation, the central control screen 100 displays the subsystem balls under all subsystems in the ring diagram on the left side of the subsystem interface. Optionally, when the user clicks the "Lighting" option, in response to the click operation, the central control screen 100 only displays the subsystem balls under the lighting subsystem in the ring diagram on the left side of the subsystem interface, such as only displaying the subsystem balls such as "Auxiliary Light", "Top Light", and "Ambient Light".

[0130] Optionally, to distinguish the subsystem balls, a corresponding subsystem identifier is displayed in each subsystem ball (or above or below the subsystem ball). The subsystem identifier can be expressed in text, icons, etc. For example, as shown in (d) of Figure 4, a subsystem ball is displayed with text identifiers such as "air conditioning," "music," and "curtains." These subsystem balls can respectively represent the air conditioning subsystem (i.e., a single-device air conditioner), the music subsystem (i.e., a single-device speaker), and the curtain subsystem (i.e., a curtain device group) in the current space.

[0131] In an embodiment of the present application, a user can quickly control at least one subsystem in a space through the above-mentioned subsystem interface.

[0132] Optionally, the user can quickly turn the subsystem corresponding to the subsystem ball on or off by dragging it into or out of the inner ring 106. For an introduction to the annular diagram and subsystem balls, please refer to the introduction to the annular diagram and spherical controls shown in Figure 1 (c) above, and will not be repeated here.

[0133] Optionally, as shown in FIG4(d), the subsystem interface further includes a scene generation control 113 for saving the execution actions of multiple subsystems currently configured in the subsystem interface as a newly created smart scene in the current space. For example, the subsystems configured in FIG4(d) such as "auxiliary lights," "curtains," and "atmosphere lights" are saved as a newly created smart scene "leisure scene" in the living room space.

[0134] Optionally, after the user clicks the Create Scene control 113, in response to the click, the central control screen 100 can save the above subsystem interface as a snapshot and display the scene creation interface, allowing the user to select all or part of the subsystem switch actions from the newly set subsystem switch actions to generate the current new smart scene. The relevant introduction of the scene creation interface can be found in the introduction to the scene creation interface shown in Figure 3 above, and will not be repeated here.

[0135] Optionally, each space corresponds to a subsystem interface. Each subsystem interface may display a corresponding space identifier to indicate which subsystem interface in which space the central control screen 100 is currently entering. The space identifier may be expressed in the form of text, icons, etc. For example, in the subsystem interface shown in (d) of Figure 4, the area within the inner ring 106 displays the text identifier "Living Room" to indicate that the subsystem interface currently entered is in the Living Room space.

[0136] In the embodiment of the present application, after the user performs the two-finger pinch-out operation 1 on the multi-space interface, the central control screen 100 can be triggered to enter the subsystem interface of the target space.

[0137] In one possible implementation, the target space may be the space corresponding to the space ball located at the center of the multi-space interface. As shown in FIG4(c), when the user performs a pinch-out operation 1 on the multi-space interface, the "Living Room" space ball 116 is located at the center. Therefore, in response to the pinch-out operation 1, the central control screen 100 may display the subsystem interface for the "Living Room" space, as shown in FIG4(d).

[0138] Optionally, since the main interface displayed on the central control screen is the control interface of the "Living Room" space, when the user uses the quick control controls in the control interface of the "Living Room" space to control the central control screen to enter the quick control interface of the "Living Room" space, the "Living Room" space can be placed in the center position by default in the multi-space hierarchical interface of the quick control interface. Similarly, if the main interface displayed on the central control screen is the control interface of the "Kitchen" space, when the user uses the quick control controls in the control interface of the "Kitchen" space to control the central control screen to enter the quick control interface of the "Kitchen" space, the "Kitchen" space can be placed in the center position by default in the multi-space hierarchical interface of the quick control interface.

[0139] In one possible implementation, the target space may be the space corresponding to the space ball located by the touch point of the two-finger pinch-out operation 1 in the multi-space interface. As shown in FIG5(a), after the user performs the two-finger pinch-out operation 1 on the "Living Room" space ball 116 in the multi-space interface, the central control screen 100 may display the subsystem interface of the "Living Room" space, as shown in FIG5(d), in response to the two-finger pinch-out operation 1 on the "Living Room" space ball 116.

[0140] Optionally, when a user performs a two-finger pinch-out operation 1 on the multi-space interface, the central control screen 100 can follow the two-finger pinch-out operation 1, magnify the multi-space interface, and after magnification to a preset magnification A, switch to display the subsystem interface of the target space. This creates a visual effect of zooming in on the multi-space interface to switch to the next subsystem interface, providing the user with a smooth multi-level interface switching experience and reducing the abruptness of multi-level interface switching.

[0141] Optionally, the multi-space interface can be magnified by magnifying various elements within the multi-space interface, such as the space ball, icons, text, controls, and other elements. It should be noted that all elements within the multi-space interface can be magnified, or only a portion of the elements within the multi-space interface can be magnified. For example, only the space ball of the target space and the elements within the space ball can be magnified.

[0142] As one approach, as shown in Figures 5(a) and 5(b), when a user performs a two-finger pinch-out operation 1 on the "Living Room" space ball 116 in the multi-space interface, the central control screen 100 can follow the gradually expanding two fingers, gradually enlarging the multi-space interface. As the multi-space interface is enlarged, the "Living Room" space ball is also enlarged synchronously. Optionally, the central control screen can use the "Living Room" space ball as the center point to enlarge the multi-space interface, ensuring that the "Living Room" space ball is always displayed on the central control screen. This creates a visual effect of the "Living Room" space ball continuously enlarging.

[0143] Optionally, when the user completes the two-finger expansion operation 1 and the fingers leave the screen of the central control screen, the central control screen can stop enlarging the multi-space interface and directly switch to display the subsystem interface of the "living room" space as shown in (d) in Figure 5.

[0144] Optionally, after the user completes the two-finger pinch-out operation 1 and releases their fingers from the central control screen, as shown in Figure 5(c), the multi-space interface can continue to be enlarged to a preset magnification B due to inertia, and then the subsystem interface of the "Living Room" space, as shown in Figure 5(d), can be switched to display. Optionally, during the process of enlarging the multi-space interface, the display of the other space balls can be gradually weakened until they disappear, thereby focusing on the enlarged effect of the "Living Room" space ball.

[0145] In the embodiment of the present application, after the central control screen 100 enters the subsystem interface, the user can continue to perform the multi-finger expansion operation 2 on the subsystem interface to trigger the central control screen 100 to enter the next level interface, namely the single device interface, to achieve refined control of a single smart device in the subsystem. In the following embodiment, the method of the embodiment of the present application is described using the above-mentioned multi-finger expansion operation 2 being a two-finger expansion operation 2 as an example.

[0146] As shown in (a) of Figure 6, after the user performs a two-finger expansion operation 2 on the subsystem interface of the "living room" space, in response to the two-finger expansion operation 2, the central control screen 100 can switch to display the next-level single-device interface as shown in (b) of Figure 6. The single-device interface includes multiple device circles, each of which contains at least one device ball, and each device ball represents a smart device in the current space. For example, the "atmosphere light 1" device ball in the "atmosphere light" device circle 117 shown in (b) of Figure 6 can represent a single-device atmosphere light 1. Optionally, the shape of the device ball is spherical or circular, and it can also be replaced by a rectangular, fan-shaped or other shape, which is not limited here.

[0147] A device circle is used to display all smart devices of a certain type. Therefore, when one or more device balls are displayed in a device circle, the smart devices corresponding to these one or more device balls are all smart devices of that type. For example, the "Ambient Light" device circle 117 is used to display all smart devices of the ambient light category in the living room, that is, all smart devices in the ambient light device group. Therefore, the multiple device balls in the "Ambient Light" device circle 117, representing individual devices such as ambient light 1, ambient light 2, ambient light 3, ambient light 4, and ambient light 5, are all smart devices of the ambient light category, that is, all smart devices in the ambient light device group.

[0148] Optionally, a corresponding type identifier (i.e., a subsystem identifier) ​​is displayed in each device circle (or above or below the device circle) to indicate the type of smart device displayed in each device circle. The type identifier can be expressed in the form of text, icons, etc. For example, as shown in Figure 6 (b), the device circles displaying text identifiers such as "auxiliary light," "ambience light," and "curtain" may correspond to displaying all smart devices in the auxiliary light device group, all smart devices in the ambient light device group, and all smart devices in the curtain device group in the living room space, respectively.

[0149] Optionally, to distinguish the device balls, a corresponding device identifier is displayed in each device ball (or above or below the device ball). The device identifier can be in the form of text, an icon, etc. For example, as shown in FIG6(b), the device balls displaying text identifiers such as "Auxiliary Light 1," "Auxiliary Light 2," and "Auxiliary Light 3" may correspond to the single devices "Auxiliary Light 1," "Auxiliary Light 2," and "Auxiliary Light 3" in the auxiliary light device group, respectively.

[0150] In an embodiment of the present application, after the user performs the two-finger expansion operation 2 on the above-mentioned subsystem interface, the central control screen 100 can be triggered to enter the single device interface of the target type (ie, the target subsystem) in the current space.

[0151] In one possible implementation, the target subsystem may be the subsystem corresponding to the subsystem ball located within the inner ring 106 of the subsystem interface. As shown in FIG6(a), when a user performs a two-finger pinch-out operation 2 on the subsystem interface, the subsystem balls for "Auxiliary Light," "Curtain," and "Ambient Light" are located within the inner ring 106. Therefore, in response to this two-finger pinch-out operation 2, the central control screen 100 may display a single device interface, as shown in FIG6(b), comprising an "Ambient Light" device circle 117, a "Auxiliary Light" device circle, and a "Curtain" device circle. The "Ambient Light" device circle 117 displays all single-item smart devices under the Ambient Light device group, including Ambient Light 1, Ambient Light 2, Ambient Light 3, Ambient Light 4, and Ambient Light 5; the "Auxiliary Light" device circle displays all single-item smart devices under the Ambient Light device group, including Auxiliary Light 1, Auxiliary Light 2, Auxiliary Light 3, and Auxiliary Light 4; and the "Curtain" device circle displays all single-item smart devices under the Curtain device group, including Curtain 1 and Curtain 2.

[0152] In some scenarios, when a subsystem ball corresponding to a single smart device exists within the inner ring 106, the subsystem ball indicating the single smart device is already displayed on the subsystem interface, allowing for refined control of the single smart device directly within the subsystem interface, without having to navigate through the individual device interface. For example, a user can long-press the "Air Conditioning" subsystem ball to trigger the central control screen to display the refined device interface for the single air conditioner corresponding to the "Air Conditioning" subsystem ball. This allows the user to configure specific parameters for each dimension of the single air conditioner, such as temperature, wind direction, and mode, within this refined control interface.

[0153] In some scenarios, when there is a subsystem ball corresponding to a device group in the inner area of ​​the inner ring 106, since the subsystem ball indicating the device group is displayed on the subsystem interface, one-click control of the device group can be achieved on the subsystem interface, but fine-grained control of individual smart devices in the device group cannot be achieved, so it needs to be achieved through a single device interface.

[0154] That is, the target subsystem may be a subsystem composed of a device group in the inner region of the inner ring 106 .

[0155] As shown in (c) of Figure 6 , when the user performs a two-finger expansion operation 2 on the subsystem interface, although the subsystem balls such as "air conditioning", "music", "auxiliary lights", "curtains", and "atmosphere lights" are located in the inner area of ​​the inner ring 106, the subsystem balls such as "air conditioning" and "music" represent single smart devices, while the subsystem balls such as "auxiliary lights", "curtains", and "atmosphere lights" represent device groups. Therefore, in response to the two-finger expansion operation 2, the central control screen 100 can display a single device interface as shown in (d) of Figure 6 . The single device interface only contains the "auxiliary lights" device circle, the "curtains" device circle, and the "atmosphere lights" device circle corresponding to the subsystem balls such as "auxiliary lights", "curtains", and "atmosphere lights". The device circles corresponding to the subsystem balls such as "air conditioning" and "music" are not displayed in the single device interface.

[0156] In one possible implementation, the target subsystem may also be the subsystem corresponding to the subsystem ball on the subsystem interface where the touch point of the two-finger pinch-out operation 2 is located. As shown in FIG7(a), after the user performs the two-finger pinch-out operation 2 on the "atmosphere light" subsystem ball 118 in the subsystem interface, in response to the two-finger pinch-out operation 2 on the "atmosphere light" subsystem ball 118, the central control screen 100 may correspondingly display the single-device interface shown in FIG7(b), which only includes the "atmosphere light" device circle 117 corresponding to the "atmosphere light" subsystem ball 118.

[0157] Similarly, when the user performs the two-finger pinch-out operation 2 on the above-mentioned subsystem interface, the central control screen 100 can follow the two-finger pinch-out operation 2 to enlarge the subsystem interface. After the zoom reaches the preset magnification C, it switches to display the single-device interface of the target subsystem. This presents the user with a visual effect of smoothly switching from the enlarged subsystem interface to the next-level single-device interface, giving the user a smooth multi-level interface switching experience and reducing the abruptness of multi-level interface switching.

[0158] Optionally, the subsystem interface can be magnified by magnifying various elements included in the subsystem interface, such as the subsystem ball, icons, text, controls, etc. It should be noted that all elements included in the subsystem interface can be magnified, or only some elements included in the subsystem interface can be magnified. For example, only the elements included in the inner ring 106 and the area within the inner ring 106 can be magnified.

[0159] As a way, as shown in (c) and (d) in Figure 7, when the user performs the two-finger expansion operation 2 on the subsystem interface, the central control screen 100 can follow the gradually expanding two fingers and gradually enlarge the subsystem interface. Among them, when the subsystem interface is enlarged, the subsystem ball in the inner area of ​​the inner ring 106 will also be enlarged synchronously. Optionally, the central control screen can use the subsystem ball in the inner area of ​​the inner ring 106 as the center point to enlarge the subsystem interface to ensure that the central control screen always displays the subsystem ball in the inner area of ​​the inner ring 106. Thereby presenting the user with a visual effect of continuously enlarging the inner area of ​​the inner ring 106.

[0160] Optionally, when the user completes the two-finger pinch-out operation 2 and releases the fingers from the central control screen, the central control screen may stop enlarging the subsystem interface to directly switch to display a single device interface as shown in (b) in FIG6 .

[0161] Optionally, after the user completes the pinch-out operation 2 and releases their fingers from the central control screen, the subsystem interface may continue to be magnified to a preset magnification D due to inertia, and then the single-device interface shown in FIG6(b) may be switched to be displayed. Optionally, during the process of magnifying the subsystem interface, the display of the other subsystem balls outside the inner ring 106 may be gradually weakened until they disappear, thereby focusing on the magnification effect of the subsystem balls within the inner ring 106.

[0162] In some embodiments, the central control screen can present the device ball in different display states to remind the user that the single smart device corresponding to the device ball is in different working states.

[0163] Optionally, the central control screen can highlight the device ball to remind the user that the single smart device corresponding to the device ball is turned on. As shown in Figure 8 (a), the single device interface displayed on the central control screen 100 includes the "Ambient Light 2" device ball 119, which is highlighted in black to remind the user that the single device ambient light 2 is turned on.

[0164] Optionally, the central control screen can un-highlight the device ball to remind the user that the corresponding smart device is off. As shown in FIG8(a), the single-device interface displayed on the central control screen 100 includes a "Auxiliary Light 1" device ball 120. The "Auxiliary Light 1" device ball 120 is displayed in white or transparent color, not highlighted in black, to remind the user that the single device auxiliary light 1 is off.

[0165] Optionally, the central control screen can highlight different areas of the device ball to remind the user of the different working parameters of the single smart device corresponding to the device ball. As shown in (a) in Figure 8, the single device interface displayed on the central control screen 100 includes a "Curtain 1" device ball 121. Half of the sphere of the "Curtain 1" device ball 121 is highlighted in black to remind the user that the single device curtain 1 is in the open state and the curtain opening degree is 50%. Optionally, the central control screen can also display the corresponding parameter values ​​in the device ball (or above the device ball or below the device ball) to clearly present the working status of the corresponding single device.

[0166] In the embodiment of the present application, the user can achieve refined control of a single smart device in the subsystem through the above-mentioned single-device interface.

[0167] As an example, as shown in (a) of Figure 8, in the single-device interface displayed by the central control screen 100, the "atmosphere light 2" device ball 119 is highlighted in black, indicating that in the current space, i.e., the living room, the single-device atmosphere light 2 in the atmosphere light subsystem is on. When the user clicks the "atmosphere light 2" device ball 119, in response to the click operation, the central control screen can control the single-device atmosphere light 2 in the living room to turn off, and can display the single-device interface shown in (b) of Figure 8. In this single-device interface, the "atmosphere light 2" device ball 119 is unhighlighted, indicating that the single-device atmosphere light 2 in the living room has been turned off. In this way, the user can quickly turn off the single-device atmosphere light 2 in the atmosphere light subsystem by simply clicking the "atmosphere light 2" device ball 119.

[0168] As another example, as shown in FIG8(a), in the single-device interface displayed on the central control screen 100, the entire "Ambient Light 2" device ball 119 is highlighted in black, indicating that in the current space, i.e., the living room, the single-device ambient light 2 in the ambient light subsystem is on and at 100% brightness (or high brightness). When the user clicks the "Ambient Light 2" device ball 119 once, in response to this click, the central control screen can control the brightness of the single-device ambient light 2 in the living room to be reduced by one level, such as to 50% brightness (or to low brightness), and can display the single-device interface shown in FIG8(c). In this single-device interface, half of the "Ambient Light 2" device ball 119 is unhighlighted, indicating that the brightness of the single-device ambient light 2 in the living room has been reduced by one level. It is understood that the user can also click the "Ambient Light 2" device ball 119 again to quickly control the brightness of the single-device ambient light 2 in the living room to be reduced by another level, such as to 0% brightness, thus turning off the single-device ambient light 2. In this way, the user can adjust the parameter values ​​of the single device atmosphere light 2 in the atmosphere light subsystem by simply clicking the "atmosphere light 2" device ball 119.

[0169] As another example, as shown in Figure 8(c), in the single-device interface displayed on the central control screen 100, the "Auxiliary Light 1" device ball 120 is displayed in white or transparent color, and is not highlighted in black. This indicates that in the current space, namely the living room, the single-device auxiliary light 1 in the auxiliary light subsystem is off. When the user clicks the "Auxiliary Light 1" device ball 120, the central control screen can control the single-device auxiliary light 1 in the living room to turn on in response to the click, and the single-device interface shown in Figure 8(d) can be displayed. In this single-device interface, the "Auxiliary Light 1" device ball 120 is highlighted, indicating that the single-device auxiliary light 1 in the living room is turned on. In this way, the user can quickly turn on the single-device auxiliary light 1 in the auxiliary light subsystem by simply clicking the "Auxiliary Light 1" device ball 120. Similarly, the user can quickly increase the brightness of the single-device auxiliary light 1 in the living room by one level, for example, to 50%.

[0170] As another example, as shown in Figure 8 (a), the user can also click and hold the "Ambient Light 2" device ball 119 and then perform a downward swipe operation. In response to this operation, the central control screen can control the brightness of the single-device ambient light 2 in the living room to be reduced by one level, such as to 50% brightness (or to a weak brightness), and can display the single-device interface shown in Figure 8 (c). In this single-device interface, the "Ambient Light 2" device ball 119 is unhighlighted, indicating that the brightness of the single-device ambient light 2 in the living room has been reduced by one level. Thereafter, the user can also click and hold the "Ambient Light 2" device ball 119 and then perform an upward swipe operation. In response to this operation, the central control screen can control the brightness of the single-device ambient light 2 in the living room to be increased by one level, such as to 100% brightness (or to a strong brightness). In this way, the user can adjust the parameter values ​​of the single-device ambient light 2 in the ambient light subsystem by clicking the "Ambient Light 2" device ball 119 and then swiping the device ball up and down.

[0171] In one scenario, if a user drags a subsystem ball on the outer ring, such as the "Ambient Light" subsystem ball, into the inner ring area of ​​the inner ring in the subsystem interface, then in response to the drag operation, the central control screen 100 can control all the ambient lights in the ambient light subsystem in the living room to turn on, such as controlling ambient light 1, ambient light 2, ambient light 3, ambient light 4, ambient light 5, etc., and can display the subsystem interface shown in Figure 7 (c). In this subsystem interface, the "Ambient Light" subsystem ball moves to the inner ring area of ​​the inner ring and is highlighted to remind the user that the ambient light in the living room is turned on. At this time, when the user performs a two-finger pinch-out operation 2 on the subsystem interface, triggering the central control screen to enter the single device interface of the ambient light subsystem, as shown in Figure 8 (a), all the device balls in the "Ambient Light" device circle 117 in this single device interface are highlighted in black, indicating that all ambient lights in the ambient light subsystem are turned on.

[0172] In another scenario, if the user controls the switch of the smart device in the current space through other control interfaces instead of the above-mentioned quick control interface, the central control screen can also display the subsystem ball corresponding to the smart device in the inner ring area of ​​the inner ring in the subsystem interface.

[0173] As shown in Figure 9 (a), when the user returns the central control screen 100 to the main interface, the "Living Room" control interface, the user can click the lighting system card 121 in this "Living Room" control interface. In response to this click, the central control screen 100 displays the control interface for the living room lighting system, as shown in Figure 9 (b). This control interface shows that the auxiliary light subsystem is not turned on. If the user wishes to turn on a single-device auxiliary light 2 in the living room auxiliary light subsystem, the user can click the icon control 122 corresponding to the single-device auxiliary light 2 at the bottom of the control interface, triggering the central control screen 100 to enter the refined control interface for the single-device auxiliary light 2, as shown in Figure 9 (c). The user can then click the on / off control 123 in this refined control interface to trigger the central control screen to turn on the single-device auxiliary light 2 in the living room. As shown in Figure 9 (d), the user can also set parameters for the brightness, color temperature, and other parameters of the auxiliary light 2 in this refined control interface, so that the single-device auxiliary light in the living room operates according to the set parameters.

[0174] Since the single-device auxiliary light 2 in the living room is currently on, when the user uses the central control screen to enter the quick control interface under the "Living Room" space and then enters the second-level subsystem interface of the quick control interface, as shown in Figure 7 (c), the "Auxiliary Light" subsystem ball in this subsystem interface is directly displayed within the inner ring and highlighted, reminding the user that the auxiliary light in the living room is on. At this time, when the user performs the two-finger pinch-out operation 2 on the subsystem interface, triggering the central control screen to enter the single-device interface of the auxiliary light subsystem, as shown in Figure 8 (a), only the "Auxiliary Light 2" device ball in the "Auxiliary Light" device circle in this single-device interface is highlighted in black, indicating that only Auxiliary Light 2 is turned on in the living room auxiliary light subsystem. The user can quickly turn on other auxiliary lights in the living room from this single-device interface. In this way, the user can view which single devices in a particular subsystem are turned on and which are turned off through the single-device interface.

[0175] Alternatively, users can long-press a device ball in the single-device interface to trigger the central control screen to display the refined device interface for the corresponding smart device. Users can then configure specific operating parameters for the individual smart device in this refined control interface.

[0176] Optionally, as shown in (d) in FIG8 , the single-device interface further includes a scene generation control 113 for saving the execution actions of multiple single devices currently set in the single-device interface as a newly created smart scene in the current space. For example, the settings in (d) in FIG8 are as follows: turning on auxiliary light 1 and auxiliary light 2 with a brightness of 100%, turning on curtain 1 and curtain 2 with an opening degree of 50%, turning on all ambient lights and with the brightness of ambient light 2 at 50% and the brightness of the remaining ambient lights at 100%, are saved as a newly created smart scene “leisure scene” in the living room space.

[0177] Optionally, after the user clicks on the generate scene control 113, in response to the click operation, the central control screen 100 can also save the above-mentioned single device interface as a snapshot, and display the scene generation interface, so that the user can select all or part of the subsystem switch action combinations from the switch actions of each single device just set to generate the current new smart scene.

[0178] Optionally, the scene generation interface may display a snapshot of the current single-device interface, including the device circles formed by the corresponding device balls after the execution action of each single device has just been set. In this way, the user can quickly understand which single devices are set to be turned on by viewing the display status of the device balls in each device circle in the snapshot.

[0179] Optionally, the scene generation interface may provide options for each subsystem in the current space, allowing users to select or uncheck at least one subsystem option to combine the on / off actions of the corresponding devices in the corresponding subsystem to generate a smart scene. Optionally, when the user unchecks at least one subsystem option, the central control screen may also synchronously update the snapshot information in the scene generation interface. For example, the user may uncheck the option for the auxiliary light subsystem, so that the auxiliary light's on / off action does not exist in the final combined smart scene. At this point, the "auxiliary light" device circle is also unchecked in the snapshot of the single-device interface displayed in the scene generation interface.

[0180] For the relevant introduction of the scene generation interface, please refer to the above introduction of the scene generation interface shown in Figure 3, which will not be repeated here.

[0181] In the embodiment of the present application, after the central control screen 100 enters the single-device interface, the user can also perform a multi-finger pinch operation 1, i.e., a pinch operation using at least two fingers, on the single-device interface to trigger the central control screen 100 to return to the previous level interface, i.e., the above-mentioned subsystem interface. The multi-finger pinch operation can be any of the preset multi-finger pinch operations, such as a two-finger pinch operation, a three-finger pinch operation, a four-finger pinch operation, or a five-finger pinch operation. In the following embodiments, the method of the embodiment of the present application is described using the above-mentioned multi-finger pinch operation 1 as an example.

[0182] As shown in (a) of FIG10 , after the user performs a two-finger pinch operation 1 on a single device interface, in response to the two-finger pinch operation 1 , the central control screen 100 may switch to display the upper-level subsystem interface as shown in (b) of FIG10 .

[0183] Optionally, when the user performs a two-finger pinch operation 1 on the above-mentioned single-device interface, the central control screen 100 can follow the two-finger pinch operation 1, shrink the single-device interface, and after shrinking to a preset magnification E, switch to display the subsystem interface of the previous level. This presents the user with a visual effect of smoothly switching to the previous level interface by shrinking the interface, reducing the abruptness of switching between the upper and lower levels of the interface.

[0184] Optionally, the single-device interface can be scaled down by scaling down various elements within the single-device interface, such as the device ball, device circle, icons, text, and controls. It should be noted that scaling down can be applied to all elements within the single-device interface, or to a subset of elements within the single-device interface. For example, scaling down can be applied to only the device circle and the elements within it.

[0185] As one method, as shown in (a) and (c) of Figure 10, when a user performs a two-finger pinch operation 1 on a single device interface, the central control screen 100 can follow the gradually pinched two fingers and gradually reduce the display of the single device interface. When the single device interface is reduced, the device circle will also be reduced synchronously. Optionally, the device circle can be used as the center point to reduce the display of the single device interface to ensure that the device circle is always displayed on the central control screen. This presents the user with a visual effect of a continuously shrinking device circle.

[0186] Optionally, when the user completes the two-finger pinch operation 1 and releases their fingers from the central control screen, the central control screen may stop shrinking the single-device interface and directly switch to displaying the upper-level subsystem interface as shown in (b) of Figure 10. Optionally, when the user completes the two-finger pinch operation 1 and releases their fingers from the central control screen, the single-device interface may continue to shrink to a preset magnification F according to inertia, and then switch to displaying the upper-level subsystem interface as shown in (b) of Figure 10.

[0187] In the embodiment of the present application, after the central control screen 100 enters the subsystem interface, the user can also perform a multi-finger pinch operation 2 on the subsystem interface to trigger the central control screen 100 to return to the previous level interface, that is, the multi-space interface described above. In the following embodiment, the method of the embodiment of the present application is described using the multi-finger pinch operation 2 as an example.

[0188] As shown in (a) of Figure 11, after the user performs a two-finger pinch operation 2 on the subsystem interface, in response to the two-finger pinch operation 2, the central control screen 100 can switch to display the multi-space interface of the previous level as shown in (b) of Figure 11.

[0189] Optionally, when the user performs a two-finger pinch operation 2 on the above-mentioned subsystem interface, the central control screen 100 can follow the two-finger pinch operation 2, shrink the subsystem interface, and after shrinking to a preset multiple G, switch to display the multi-space interface of the previous level.

[0190] Optionally, the subsystem interface can be reduced in size by reducing various elements included in the subsystem interface, such as the subsystem ball, donut diagram, icons, text, controls, etc. It should be noted that all elements included in the subsystem interface can be reduced in size, or only some elements included in the subsystem interface can be reduced in size. For example, only the elements included in the inner ring and the area within the inner ring can be reduced in size.

[0191] As a way, as shown in (a) and (c) in Figure 11, when the user performs a two-finger pinch operation 2 on the subsystem interface, the central control screen 100 can follow the gradually pinched two fingers and gradually reduce the display of the subsystem interface. Among them, when the subsystem interface is reduced, the inner ring and the subsystem ball in the inner ring area of ​​the inner ring will also be reduced synchronously. Optionally, the inner ring can be used as the center point to reduce the display of the subsystem interface to ensure that the central control screen always displays the inner ring and the subsystem ball in the inner ring area of ​​the inner ring. Thereby presenting the user with a visual effect of continuously reducing the inner ring and the subsystem ball in the inner ring area of ​​the inner ring.

[0192] Optionally, when the user completes the two-finger pinch operation 2 and releases their fingers from the central control screen, the central control screen may stop shrinking the subsystem interface and directly switch to displaying the multi-space interface of the previous level as shown in (b) of Figure 11. Optionally, when the user completes the two-finger pinch operation 2 and releases their fingers from the central control screen, the subsystem interface may continue to shrink to a preset magnification H due to inertia, and then switch to displaying the multi-space interface of the previous level as shown in (b) of Figure 11.

[0193] It can be understood that after the user browses or quickly controls the smart devices in the current space through the subsystem interface or single device interface of the current space in the quick control interface, if the user still needs to browse or quickly control the smart devices in another space, the user can use a two-finger pinch operation to quickly return to the multi-space interface in the quick control interface, and quickly switch to other spaces directly in the multi-space interface to enter the subsystem interface or single device interface in other spaces to browse or quickly control the smart devices in other spaces.

[0194] As shown in Figure 12(a), after the central control screen 100 returns to the multi-space interface, if the user still needs to browse or quickly control the smart devices in the master bedroom space, as one way, the user can directly perform a two-finger pinch-out operation 1 on the "Master Bedroom" space ball 124 in the multi-space interface to instruct the central control screen 100 to enter the next-level subsystem interface, which is the subsystem interface corresponding to the "Master Bedroom" space ball 124 where the touch point is located. At this time, in response to the two-finger pinch-out operation 1 on the "Master Bedroom" space ball 124, the central control screen 100 can correspondingly display the subsystem interface of the "Master Bedroom" space, as shown in Figure 12(b).

[0195] Alternatively, the user can drag the "Master Bedroom" space ball 124 to the center of the multi-space interface and perform a two-finger pinch-out operation 1 on the multi-space interface to instruct the central control screen 100 to enter the next-level subsystem interface, corresponding to the subsystem interface of the centrally located "Master Bedroom" space ball 124. In response to the two-finger pinch-out operation 1, the central control screen 100 can display the subsystem interface of the "Master Bedroom" space, as shown in Figure 12(b).

[0196] Alternatively, the user can directly click on the "Master Bedroom" space ball 124 to instruct the central control screen 100 to enter the next-level subsystem interface, which corresponds to the subsystem interface of the clicked "Master Bedroom" space ball 124. In this case, in response to the click on the "Master Bedroom" space ball 124, the central control screen 100 may display the subsystem interface of the "Master Bedroom" space, as shown in Figure 12(b).

[0197] Similarly, after the central control screen 100 enters the subsystem interface of the "master bedroom" space, the user can quickly switch on and off the subsystem corresponding to the subsystem ball by dragging the subsystem ball in or out of the inner ring area.

[0198] Similarly, if the user needs to fine-tune control over a single smart device in a subsystem, as shown in Figure 12 (b), the user can continue to perform a two-finger pinch-out operation 2 on the subsystem interface to instruct the central control screen 100 to enter the next-level single-device interface. At this time, in response to the two-finger pinch-out operation 2, the central control screen 100 can correspondingly display the single-device interface shown in Figure 12 (c). This single-device interface can independently display all the single smart devices in a subsystem.

[0199] Optionally, the central control screen 100 can only enter the inner ring area of ​​the inner ring of the subsystem interface, which is a single device interface of the subsystem composed of a device group.

[0200] For example, although in the subsystem interface shown in (b) of Figure 12, the subsystem balls such as "air conditioning", "humidification", and "auxiliary lights" are located in the inner ring area of ​​the inner ring, the subsystem balls such as "air conditioning" and "humidification" represent single smart devices, while the subsystem ball of "auxiliary lights" represents a device group, which can include one or more auxiliary lights. Therefore, in response to the two-finger expansion operation 2, the central control screen 100 can display a single device interface as shown in (c) of Figure 12. The single device interface only contains the "auxiliary lights" device circle corresponding to the "auxiliary lights" subsystem ball, and the "auxiliary lights" device circle displays all the auxiliary lights in the master bedroom space, such as auxiliary light 1, auxiliary light 2, auxiliary light 3, auxiliary light 4, etc. At this time, the user can perform fine control of one of the auxiliary lights, such as auxiliary light 1.

[0201] Alternatively, the user can directly perform a two-finger pinch-out operation 2 on the "Auxiliary Light" subsystem ball in the subsystem interface to instruct the central control screen 100 to enter the next-level single-device interface. This single-device interface is the single-device interface corresponding to the "Auxiliary Light" subsystem ball where the touch point is located. At this time, in response to the two-finger pinch-out operation 2, the central control screen 100 can display the single-device interface shown in (c) of Figure 12. This single-device interface only contains the "Auxiliary Light" device circle corresponding to the "Auxiliary Light" subsystem ball.

[0202] As another exemplary embodiment, (a) to (14) in FIG. 13 illustrate the function of the central control screen switching between multi-level interfaces in the quick control interface in response to gesture operations applied to the navigation bar.

[0203] For example, as shown in (a) in Figure 13, the central control screen 100 currently displays the control interface of the "living room" space. When the user clicks the quick control control 105 in the control interface, in response to the click operation, the central control screen 100 can enter the quick control interface under the "living room" space. At this time, the central control screen 100 can display the first-level interface of the quick control interface as shown in (b) in Figure 13, that is, the multi-space interface. The multi-space interface includes multiple space balls and a navigation bar 125. Each space ball is used to represent a space in the home environment. The navigation bar 125 is used to quickly switch the multi-level interface in the quick control interface. For the relevant introduction of the space ball, please refer to the introduction of the space ball in the aforementioned implementation plan, which will not be repeated here.

[0204] As shown in (b) of FIG13 , the navigation bar 125 includes a first navigation point 1251, a second navigation point 1252, and a third navigation point 1253. The first navigation point 1251 corresponds to the first-level interface of the quick control interface, namely the multi-space interface, the second navigation point 1252 corresponds to the second-level interface of the quick control interface, namely the subsystem interface, and the third navigation point 1253 corresponds to the third-level interface of the quick control interface, namely the single-device interface. As shown in (b) of FIG13 , the navigation bar 125 can be expressed as an arc-shaped diagram formed by a plurality of small dots arranged in a curved shape, with the first navigation point 1251 and the third navigation point 1253 located at the two ends of the arc, respectively, and the second navigation point 1252 located in the middle of the arc. Users can switch interfaces of the corresponding levels by touching the corresponding navigation points on the navigation bar 125.

[0205] It is understood that the navigation bar 125 may also be presented in other forms, which are not limited here. For example, the navigation bar 125 is presented as a straight line graph formed by a plurality of small dots arranged in a straight line, with the first navigation point 1251 and the third navigation point 1253 located at the ends of the straight line, respectively, and the second navigation point 1252 located in the middle of the straight line.

[0206] Optionally, the central control screen can highlight the corresponding navigation point in the navigation bar according to the currently displayed interface level to remind the user which level of the interface is currently displayed. The method of highlighting the navigation point can be to enlarge or bold the navigation point, fill the navigation point with a specified color (such as green, blue, etc.), display a specified graphic (such as a small ball, diamond pattern, etc.) on the navigation point, etc., which is not limited in this application.

[0207] As shown in (b) in Figure 13, since the central control screen currently displays the first-level interface of the quick control interface, that is, the multi-space interface, the central control screen can synchronously display a white ball on the first navigation point 1251 in the navigation bar to remind the user that the first-level multi-space interface is currently being displayed.

[0208] In an embodiment of the present application, in the above-mentioned multi-space interface, the user can perform a sliding operation 1 on the navigation bar to trigger the central control screen 100 to enter the next level interface, that is, the subsystem interface. Among them, the sliding operation 1 can be a sliding operation from the first navigation point to the second navigation point. The sliding operation can be a preset single-finger sliding operation or a multi-finger sliding operation such as a two-finger sliding operation. This is not limited here. In the following embodiments, the method of the embodiment of the present application is introduced by taking the above-mentioned sliding operation as an example of a single-finger sliding operation.

[0209] After the user performs a sliding operation 1 from the first navigation point 1251 to the second navigation point 1252 on the navigation bar 125, in response to the sliding operation 1, the multi-space interface displayed on the central control screen 100 can be switched to the next-level subsystem interface as shown in (c) in Figure 13. The subsystem interface includes a ring diagram and the above-mentioned navigation bar 125. Among them, the relevant description of the ring diagram can refer to the description shown in the aforementioned implementation scheme, which is not repeated here. Optionally, as shown in (c) in Figure 13, at this time, since the central control screen currently displays the second-level interface of the quick control interface, that is, the subsystem interface, the central control screen can synchronously display a white ball on the second navigation point 1252 in the navigation bar to remind the user that the second-level subsystem interface is currently displayed.

[0210] In some scenarios, as shown in (b) in Figure 13, the user can also drag the white ball on the first navigation point 1251 on the navigation bar 125 along the arc trajectory of the navigation bar 125 to the second navigation point 1252. In response to the dragging operation, the multi-space interface displayed on the central control screen 100 can be switched to the next-level subsystem interface as shown in (c) in Figure 13.

[0211] In an embodiment of the present application, after the user performs a sliding operation 1 on the navigation bar in the multi-space interface, the central control screen responds to the sliding operation 1, and the next level interface entered may be the subsystem interface of the target space.

[0212] In one possible implementation, the target space may be the space corresponding to the space ball located at the center of the multi-space interface. When the user performs a swipe operation 1 on the navigation bar in the multi-space interface, the "Living Room" space ball 116 is located at the center. Therefore, in response to the swipe operation 1, the multi-space interface displayed on the central control screen 100 may switch to the subsystem interface of the "Living Room" space, as shown in Figure 13 (c).

[0213] In one possible implementation, the target space may be the space corresponding to the space ball selected by the user in the multi-space interface. The user may first click on the "Living Room" space ball 116 in the multi-space interface to select it. The central control screen 100 may highlight the "Living Room" space ball 116 in the multi-space interface. At this point, the user may continue to perform a swipe operation 1 on the navigation bar in the multi-space interface. Since the "Living Room" space ball 116 was already selected when the user performed the swipe operation 1 on the navigation bar in the multi-space interface, the central control screen 100 may display the subsystem interface for the "Living Room" space, as shown in FIG14 , in response to the swipe operation 1.

[0214] In one possible implementation, when a user clicks on the "Living Room" space ball 116 in the multi-space interface, the central control screen 100 can directly respond to the click and display the subsystem interface of the "Living Room" space, eliminating the need to scroll through the navigation bar and reducing cumbersome operations.

[0215] Similarly, when a user performs a swipe operation 1 on the navigation bar in the multi-space interface, the central control screen can also follow this swipe operation 1, zooming in on the multi-space interface. After zooming in to a preset magnification 1, it switches to displaying the subsystem interface of the target space. In this way, by displaying the transition animation between the upper and lower interfaces during the swiping of the navigation bar, the user is given the visual effect of zooming in on the multi-space interface and switching to the subsystem interface of the next level.

[0216] As one approach, when a user performs a sliding operation 1 on the navigation bar 125 in the multi-space interface, i.e., the user's finger starts from the first navigation point 1251 and slides downward along the arc of the navigation bar 125 to the second navigation point 1252, the central control screen 100 can follow the downward sliding finger, gradually magnifying the multi-space interface to a preset magnification 1, and then switching to display the subsystem interface of the "living room" space. When the user completes sliding operation 1, i.e., the finger has slid to the second navigation point 1252, the central control screen 100 has also successfully switched to displaying the subsystem interface of the "living room" space.

[0217] It can be understood that the relevant description of the central control screen enlarging the display of the multi-space interface can be found in the description of the aforementioned implementation plan, which will not be repeated here.

[0218] In this embodiment of the present application, after the central control screen 100 displays the subsystem interface, the user can continue to perform a sliding operation 2 on the navigation bar in the subsystem interface to trigger the central control screen 100 to enter the next level interface, namely the single device interface, to achieve refined control of a single smart device in the subsystem. The sliding operation 2 can be a sliding operation from the second navigation point to the third navigation point.

[0219] After the user performs a sliding operation 2 from the second navigation point 1252 to the third navigation point 1253 on the navigation bar 125 in the subsystem interface, in response to the sliding operation 2, the subsystem interface displayed on the central control screen 100 can be switched to the next-level single-device interface as shown in Figure 14. The single-device interface includes a device circle and the above-mentioned navigation bar 125. Among them, the relevant description of the device circle can refer to the description shown in the aforementioned implementation scheme, which will not be repeated here. Optionally, as shown in Figure 14, at this time, since the central control screen currently displays the third-level interface of the quick control interface, that is, the single-device interface, the central control screen can synchronously display a white ball on the third navigation point 1253 in the navigation bar to remind the user that the third-level single-device interface is currently displayed.

[0220] In some scenarios, the user can also drag the white ball on the second navigation point 1252 on the navigation bar 125 along the arc trajectory of the navigation bar 125 to the third navigation point 1253. In response to the dragging operation, the subsystem interface displayed on the central control screen 100 can be switched to the next-level single-device interface as shown in Figure 14.

[0221] In an embodiment of the present application, after the user performs a sliding operation 2 on the navigation bar in the subsystem interface, the central control screen responds to the sliding operation 2, and the next level interface entered may be a single device interface of the target subsystem.

[0222] In one possible implementation, the target subsystem may be the subsystem corresponding to the subsystem ball located in the inner ring area of ​​the inner ring in the subsystem interface. When the user performs a sliding operation 2 on the navigation bar in the subsystem interface, the subsystem balls such as "auxiliary lights", "curtains", and "atmosphere lights" are located in the inner ring area. Therefore, in response to the sliding operation 2, the subsystem interface displayed on the central control screen 100 can be switched to a single device interface as shown in FIG14. The single device interface corresponds to the "auxiliary lights" device circle, the "curtains" device circle, and the "atmosphere lights" device circle.

[0223] Similarly, since a subsystem ball indicates only a single smart device, it allows for fine-grained control of that single smart device directly within the subsystem interface, eliminating the need for the single-device interface. However, when a subsystem ball indicates a device group, the subsystem interface allows for one-touch control of the device group, but does not provide fine-grained control of individual smart devices within the group, requiring the single-device interface. Therefore, the target subsystem can also be a subsystem consisting of a device group within the inner ring area.

[0224] In one possible implementation, the target subsystem may also be the subsystem corresponding to the subsystem ball selected by the user in the subsystem interface. For example, the user may first double-click the "Ambient Light" subsystem ball in the subsystem interface to select it. The user then performs a swipe operation 2 on the navigation bar in the subsystem interface. In response to this swipe operation 2, the central control screen may display the single device interface corresponding to the selected "Ambient Light" subsystem ball.

[0225] In one possible implementation, if a user double-clicks the "Ambient Lighting" subsystem ball in the subsystem interface, the central control screen can directly respond to the double-click and display the single-device interface corresponding to the selected "Ambient Lighting" subsystem ball. This eliminates the need to scroll through the navigation bar, reducing cumbersome operations.

[0226] Similarly, when the user performs a swipe operation 2 on the navigation bar in a subsystem interface, the central control screen can also follow the swipe operation 2, magnifying the subsystem interface. After the magnification reaches a preset magnification factor J, it switches to displaying the single-device interface of the target subsystem. In this way, by displaying the transition animation when switching between the upper and lower interfaces during the swiping of the navigation bar, the user is given the visual effect of zooming in on the subsystem interface and switching to the single-device interface of the next level by swiping the navigation bar.

[0227] As one approach, when a user performs a sliding operation 2 on the navigation bar 125 in the subsystem interface, i.e., the user's finger starts from the second navigation point 1252 and slides downward along the arc-shaped trajectory of the navigation bar 125 to the third navigation point 1253, the central control screen 100 can follow the downward sliding finger, gradually magnifying the subsystem interface until it reaches a preset magnification J, and then switching to display the next level single device interface as shown in FIG14. When the user completes the sliding operation 2, i.e., the finger has slid to the third navigation point 1253, the central control screen 100 has successfully switched to displaying the single device interface as shown in FIG14.

[0228] It can be understood that the relevant description of the central control screen magnified display subsystem interface can be found in the description in the aforementioned implementation plan and will not be repeated here.

[0229] In the embodiment of the present application, after the central control screen 100 enters the single-device interface, the user can also perform a sliding operation 3 on the navigation bar in the single-device interface to trigger the central control screen 100 to return to the previous level interface, that is, the above-mentioned subsystem interface. The sliding operation 3 can be a sliding operation from the third navigation point to the second navigation point.

[0230] After the user performs a sliding operation 3 from the third navigation point 1253 to the second navigation point 1252 on the navigation bar 125 in the single-device interface, in response to the sliding operation 3, the single-device interface displayed on the central control screen 100 can be switched to the subsystem interface of the upper level.

[0231] In some scenarios, the user can also drag the white ball on the third navigation point 1253 on the navigation bar 125 along the arc trajectory of the navigation bar 125 to the second navigation point 1252. In response to the dragging operation, the subsystem interface displayed on the central control screen 100 can be switched to the subsystem interface of the previous level.

[0232] Similarly, when a user performs a swipe operation 3 on the navigation bar in a single-device interface, the central control screen can follow this swipe operation 3, shrinking the single-device interface. After shrinking to a preset magnification K, it switches to displaying the subsystem interface of the previous level. In this way, by displaying the transition animation when switching between the upper and lower interfaces during the swiping of the navigation bar, the user is presented with the visual effect of shrinking the single-device interface by sliding the navigation bar and returning to the subsystem interface of the previous level.

[0233] As one approach, when a user performs sliding operation 3 on the navigation bar 125 in the single-device interface, i.e., the user's finger starts from the third navigation point 1253 and slides upward along the arc-shaped trajectory of the navigation bar 125 to the second navigation point 1252, the central control screen 100 can follow the upward sliding finger, gradually reducing the display of the single-device interface to a preset magnification K, and then switching to display the subsystem interface of the "living room" space. When the user completes sliding operation 3, i.e., the finger has slid to the second navigation point 1252, the central control screen 100 has also successfully switched to displaying the subsystem interface of the "living room" space.

[0234] It can be understood that the relevant description of the central control screen shrinking to display a single device interface can be found in the description of the aforementioned implementation plan, which will not be repeated here.

[0235] In this embodiment of the present application, after the central control screen 100 returns to the subsystem interface, the user can continue to perform a sliding operation 4 on the navigation bar in the subsystem interface to trigger the central control screen 100 to return to the upper-level interface, that is, the multi-space interface described above. The sliding operation 4 can be a sliding operation from the second navigation point to the first navigation point.

[0236] After the user performs a sliding operation 4 from the second navigation point 1252 to the first navigation point 1251 on the navigation bar 125 in the subsystem interface, in response to the sliding operation 4, the subsystem interface displayed on the central control screen 100 can be switched to the multi-space interface of the upper level.

[0237] In some scenarios, the user can also drag the white ball on the second navigation point 1252 on the navigation bar 125 along the arc trajectory of the navigation bar 125 to the first navigation point 1251. In response to the dragging operation, the subsystem interface displayed on the central control screen 100 can be switched to the multi-space interface of the previous level.

[0238] Similarly, when the user performs a swipe operation 4 on the navigation bar in a subsystem interface, the central control screen can follow the swipe operation 4, zooming out the subsystem interface. After zooming out to a preset magnification L, it switches to displaying the multi-space interface of the previous level. In this way, by displaying the transition animation when switching between the upper and lower interfaces during the swiping of the navigation bar, the user is presented with the visual effect of zooming out the subsystem interface and returning to the multi-space interface of the previous level by sliding the navigation bar.

[0239] As one approach, when a user performs a sliding operation 4 on the navigation bar 125 in the subsystem interface, i.e., the user's finger starts from the second navigation point 1252 and slides upward along the arc-shaped trajectory of the navigation bar 125 to the first navigation point 1251, the central control screen 100 can follow the upward sliding finger, gradually reducing the subsystem interface to a preset magnification L, and then switching to display the multi-space interface. When the user completes sliding operation 4, i.e., the finger has slid to the first navigation point 1251, the central control screen 100 has also successfully switched to displaying the multi-space interface.

[0240] It can be understood that the relevant description of the central control screen's reduced display subsystem interface can be found in the description in the aforementioned implementation plan and will not be repeated here.

[0241] It can be understood that after the user browses or quickly controls the smart devices in the current space through the subsystem interface or single device interface of the current space in the quick control interface, if the user still needs to browse or quickly control the smart devices in another space, the user can quickly return to the multi-space interface in the quick control interface by sliding the navigation bar, and quickly switch to other spaces directly in the multi-space interface to enter the subsystem interface or single device interface in other spaces to browse or quickly control the smart devices in other spaces.

[0242] After the central control screen 100 returns to the multi-space interface, if the user still needs to browse or quickly control the smart devices in the master bedroom space, they can first drag the "Master Bedroom" space ball 124 to the center of the multi-space interface. Then, on the navigation bar 125, perform a swipe operation 1 from the first navigation point 1251 to the second navigation point 1252, instructing the central control screen 100 to enter the next subsystem interface, corresponding to the centrally located "Master Bedroom" space ball 124. In response to this swipe operation 1, the central control screen 100 will display the subsystem interface of the "Master Bedroom" space.

[0243] Alternatively, the user can first click on the "Master Bedroom" space ball 124 in the multi-space interface to select it. Then, perform a swipe operation 1 on the navigation bar 125 to instruct the central control screen 100 to enter the next subsystem interface. This subsystem interface corresponds to the subsystem interface corresponding to the "Master Bedroom" space ball 124 that was clicked and selected. In response to swipe operation 1, the central control screen 100 will display the subsystem interface for the "Master Bedroom" space.

[0244] Alternatively, the user can directly click on the "Master Bedroom" space ball 124 to instruct the central control screen 100 to enter the next-level subsystem interface, which corresponds to the subsystem interface of the clicked "Master Bedroom" space ball 124. In this case, in response to the click on the "Master Bedroom" space ball 124, the central control screen 100 can display the subsystem interface of the "Master Bedroom" space.

[0245] Similarly, after the central control screen 100 enters the subsystem interface of the "master bedroom" space, the user can quickly switch on and off the subsystem corresponding to the subsystem ball by dragging the subsystem ball in or out of the inner ring area.

[0246] Similarly, if the user requires refined control of a single smart device within a subsystem, they can continue to perform a swipe operation 2 on the navigation bar 125 within the subsystem interface, from the second navigation point 1252 to the third navigation point 1253, instructing the central control screen 100 to enter the next level of the single-device interface. In response to this swipe operation 2, the central control screen 100 can display the corresponding single-device interface. This single-device interface can independently display all the individual smart devices within a subsystem within the master bedroom space.

[0247] It can be understood that the relevant descriptions of the above-mentioned subsystem interface and single device interface can be found in the description of the aforementioned implementation plan and will not be repeated here.

[0248] In some scenarios, the user can also directly perform a click operation on a certain navigation point in the navigation bar to select the certain navigation point. At this time, the central control screen 100 can respond to the click operation on a certain navigation point, zoom the current level interface, and switch to display the level interface corresponding to the certain navigation point. For example, the user can directly perform a click operation on the second navigation point 1252 in the navigation bar. In response to the click operation, the central control screen can zoom the current level interface, such as the multi-space interface, and jump to display the second level interface corresponding to the second navigation point 1252, that is, the subsystem interface. For another example, the user can directly perform a click operation on the third navigation point 1253 in the navigation bar. In response to the click operation, the central control screen can zoom the current level interface, such as the subsystem interface, and jump to display the third level interface corresponding to the third navigation point 1253, that is, the single device interface.

[0249] In some scenarios, the user can also directly perform a sliding operation in the first direction on the navigation bar, such as sliding up, sliding to the left, etc. At this time, the central control screen 100 can respond to the sliding operation, zoom the current level interface, and switch to display the interface of the previous layer. The user can also directly perform a sliding operation in the second direction on the navigation bar, such as sliding down, sliding to the right, etc. At this time, the central control screen 100 can respond to the sliding operation, zoom the current level interface, and switch to display the interface of the next layer.

[0250] As another exemplary embodiment, FIG15(a) to FIG18(d) illustrate the function of generating a cross-space intelligent scene with one click on the central control screen.

[0251] For example, as shown in (a) of Figure 15, the central control screen 100 currently displays the control interface of the "living room" space. When the user clicks the quick control control 105 in the control interface, in response to the click operation, the central control screen 100 can enter the quick control interface under the "living room" space. At this time, the central control screen 100 can display the first-level interface of the quick control interface as shown in (b) of Figure 15, that is, the multi-space interface. The multi-space interface includes multiple space balls and a control 126 for generating cross-space scenes. The control 126 for generating cross-space scenes is used to trigger the central control screen to display a cross-space smart scene generation interface. Among them, the relevant introduction of the space ball can be found in the introduction of the space ball in the aforementioned implementation plan, which will not be repeated here.

[0252] In one scenario, after the user quickly controls smart devices in different spaces through the multi-level interface of the aforementioned quick control interface, the user can trigger the central control screen to return to the first-level interface of the quick control interface, namely the multi-space interface, by sliding the navigation bar, multi-finger operation, or clicking, so as to quickly generate cross-space smart scenes composed of different spaces in the multi-space interface. The central control screen can then display a corresponding function control (such as a button or card) to realize the function of triggering the cross-space smart scene with one click.

[0253] As an example, in the multi-space interface shown in Figure 15 (b), the user triggers the central control screen 100 to enter the subsystem interface corresponding to the "Living Room" space ball by sliding the navigation bar, pinching outward with two fingers, or clicking the second navigation point. The user can then complete the configuration of actions for at least one smart device in the living room within this subsystem interface or within the next-level single-device interface. As shown in Figure 6 (a), this turns on single-device auxiliary light 1 in the living room auxiliary light subsystem, all ambient lights in the living room ambient light subsystem, and all curtains in the living room curtain subsystem.

[0254] The user can then trigger the central control screen 100 to return to the multi-space interface of the quick control interface by sliding the navigation bar, pinching with two fingers, or clicking the first navigation point. In this multi-space interface, the user can reselect and trigger the subsystem interface corresponding to the "Master Bedroom" space ball. The user can complete the setting of the execution action for at least one smart device in the master bedroom in this subsystem interface or in the single device interface at the next level of the subsystem interface. As shown in Figures 12(b) and 12(c), the master bedroom air conditioner is turned on, the master bedroom humidifier is turned on, and auxiliary lights 1 and 2 in the master bedroom auxiliary light subsystem are turned on.

[0255] After setting the execution action for at least one smart device in the living room and master bedroom, the user can save the execution action of at least one smart device currently set in the living room and master bedroom as the newly created cross-space smart scene. The central control screen can then display a corresponding function control (such as a button or card), so that the user can subsequently trigger the function of the cross-space smart scene with one click, without having to enter the quick control interface of the living room and master bedroom space one by one to re-set the execution action of each smart device.

[0256] As shown in FIG15( b ), after the user has completed setting the execution action for at least one smart device in the living room and the master bedroom, the user can trigger the central control screen 100 to return to the multi-space interface of the quick control interface by sliding the navigation bar, multi-finger operation, or clicking. The user can then click the Generate Cross-Space Scene control 126 in the multi-space interface.

[0257] In response to clicking the "Generate Cross-Space Scene" control 126, the central control screen 100 may display a cross-space smart scene generation interface, as shown in FIG15(c), which includes multiple space balls and a "Generate Scene" control 127. The user may select the space balls to be added to the smart scene from the multiple space balls, and the central control screen may then generate a cross-space smart scene for the selected multiple space balls with one click.

[0258] Optionally, as shown in Figure 15(c), the cross-space smart scene generation interface includes a viewfinder 128, which contains multiple space balls. The viewfinder 127 is used to combine the spaces corresponding to the space balls contained within it to generate the corresponding cross-space smart scene. Therefore, if a user wants to generate a cross-space smart scene of a guest + bedroom, as shown in Figure 15(d), the user can drag the "guest" space ball and the "master bedroom" space ball into the viewfinder. The user can then click the generate scene control 127.

[0259] Optionally, in response to the operation of clicking to generate the scene control 127, the central control screen 100 can directly save the execution action of at least one smart device in the currently set living room and master bedroom as the currently created cross-space smart scene. For example, the currently set settings of turning on the single-device auxiliary light 1 in the living room auxiliary light subsystem, turning on all the atmosphere lights in the living room atmosphere light subsystem, turning on all the curtains in the living room curtain subsystem, turning on the master bedroom air conditioner, turning on the master bedroom humidifier, turning on the auxiliary lights 1 and 2 in the master bedroom auxiliary light subsystem, etc., are saved as a newly created customer + bedroom cross-space smart scene. The central control screen can then display the scene naming interface as shown in (a) in Figure 16. After the user enters a custom scene name such as "leisure scene of living room + master bedroom" and clicks the confirmation control, the central control screen can complete the creation and saving of the cross-space smart scene.

[0260] Optionally, in response to the operation of clicking to generate the scene control 127, the central control screen 100 can also save the above-mentioned cross-space smart scene generation interface in the form of a snapshot, and display a scene confirmation interface as shown in (b) in Figure 16, so that the user can select all or part of the space combination from the spaces just set to generate the current new cross-space smart scene.

[0261] The scene confirmation interface can also display a snapshot of the cross-space smart scene generation interface. As shown in Figure 16 (b), a snapshot of the cross-space smart scene generation interface is displayed on the left side of the scene confirmation interface. This allows users to quickly understand which spaces have been added to the cross-space smart scene by identifying which space balls are within the viewfinder in the snapshot.

[0262] As an alternative, as shown in FIG16(b), the central control screen may also provide options 129, a confirmation control 130, and a cancel control for each space in the scene confirmation interface. This allows the user to select or uncheck the options for at least one space to select a combination of switch actions for the smart devices configured in that space to generate a cross-space smart scene. Optionally, when the user unchecks the options for at least one space, the central control screen may also synchronously update the snapshot information displayed in the scene confirmation interface.

[0263] For example, in the cross-space smart scene generation interface above, after adding the living room and bedroom to the smart scene, if the user also needs to add the porch to the smart scene, as shown in Figure 16 (c), the user can newly check the option of the porch space, so that the final combined cross-space smart scene contains execution actions of smart devices in multiple spaces such as the living room, bedroom, and porch. At this time, compared with the snapshot shown in Figure 16 (b), in the snapshot shown in Figure 16 (c), the "porch" space ball has been synchronously moved into the viewfinder.

[0264] The user can then click the confirmation control 130. In response to this click, the central control screen 100 can display the scene naming interface shown in (a) of Figure 16. After the user enters the customized scene name and clicks the confirmation control, the central control screen can complete the creation and saving of the cross-space smart scene.

[0265] In some scenarios, the cross-space smart scene generation interface can also add a second-level subsystem interface and a third-level single-device interface, with the interface containing multiple space balls and a viewfinder being the first-level interface. This allows users to directly set the actions for the smart devices in each space within the viewfinder within the cross-space smart scene generation interface, which can then be saved on the central control screen and generate the corresponding cross-space smart scene.

[0266] Optionally, after the user drags the space ball corresponding to the space to be added to the smart scene into the viewfinder in the above-mentioned cross-space smart scene generation interface, the user can also trigger the central control screen to enter the next-level subsystem interface through the above-mentioned sliding navigation bar, multi-finger operation or click operation, so as to realize the setting of the execution actions of the smart devices under each space in the viewfinder in the subsystem interface.

[0267] For example, as shown in (a) in Figure 17, after the user drags the "customer" space ball and the "master bedroom" space ball into the viewfinder, the user can perform a two-finger expansion operation 1 to trigger the central control screen to enter the subsystem interface under the living room and master bedroom spaces.

[0268] Optionally, in response to the two-finger expansion operation 1, the central control screen 100 can switch to display the subsystem interface of the next level as shown in (b) in Figure 17. The subsystem interface may include a ring diagram of the living room and a ring diagram of the master bedroom. In the ring diagram of the living room, the user can set the switch execution action of the living room subsystem corresponding to the subsystem ball by dragging the subsystem ball of the living room into or out of the inner ring area of ​​the inner ring. In the ring diagram of the master bedroom, the user can also set the switch execution action of the master bedroom subsystem corresponding to the subsystem ball by dragging the subsystem ball of the master bedroom into or out of the inner ring area of ​​the inner ring. Among them, for the relevant description of realizing the rapid control of each subsystem through the subsystem interface, please refer to the description of the aforementioned implementation plan, which will not be repeated here.

[0269] Optionally, in response to the pinch-out operation 1, the central control screen 100 may switch to displaying the next-level subsystem interface, as shown in (c) of Figure 17. This subsystem interface displays the subsystem balls for the living room and master bedroom in a circular diagram. Within this circular diagram, the user can drag the subsystem balls for the living room and master bedroom into or out of the inner ring area to set the corresponding switch execution actions for the living room and master bedroom subsystems.

[0270] To distinguish the subsystem balls of different spaces, the subsystem balls of the living room and master bedroom are presented in different display styles. As shown in (c) of Figure 17, the bolded subsystem ball is the subsystem ball of the living room, and the unbolded subsystem ball is the subsystem ball of the master bedroom. Optionally, the subsystem balls of the living room and master bedroom can also be presented in different colors, such as blue for the subsystem ball of the living room and yellow for the subsystem ball of the master bedroom. Optionally, a corresponding space identifier can also be displayed in each subsystem ball (or above or below the subsystem ball). The space identifier can be expressed in the form of text, icons, etc. For example, if the text "Living Room - Auxiliary Light" is marked on the subsystem ball, it means that the subsystem ball is the auxiliary light subsystem of the living room.

[0271] Optionally, in response to the two-finger pinch-out operation 1, the central control screen 100 may switch to display the next-level subsystem interface as shown in (d) in Figure 17. This subsystem interface displays the subsystem balls for the living room in one "living room" device circle and the subsystem balls for the master bedroom in another "master bedroom" device circle, allowing the user to distinguish between the subsystem balls in different spaces. In the "living room" device circle, the user can click a subsystem ball to turn on the corresponding living room subsystem, or click the subsystem ball again to turn off the corresponding living room subsystem.

[0272] Optionally, the subsystem interface under the above-mentioned living room and master bedroom space also includes a scene generation control 127, which is used to save the execution actions of multiple subsystems in the living room and master bedroom currently set in the subsystem interface as the currently newly created "living room + master bedroom" cross-space intelligent scene.

[0273] Optionally, after the user clicks on the Create Scene control 127, in response to this click, the central control screen 100 can save the subsystem interfaces of the living room and master bedroom spaces as snapshots and display the scene naming interface shown in (a) of Figure 16. After the user enters a customized scene name and clicks the Confirm control, the central control screen completes the creation and saving of the cross-space smart scene. Optionally, snapshots of the subsystem interfaces of the living room and master bedroom spaces can also be displayed on the scene naming interface.

[0274] For example, as shown in FIG18( b ), the cross-space intelligent scene generation interface may further include a navigation bar 131. The navigation bar 131 includes a first navigation point 1311, a second navigation point 1312, and a third navigation point 1313. The first navigation point 1311 corresponds to the first-level interface including the multiple space balls and viewfinders, the second navigation point 1312 corresponds to the second-level interface, i.e., the subsystem interface, and the third navigation point 1253 corresponds to the third-level interface, i.e., the single-device interface.

[0275] As shown in FIG18(b), since the central control screen is currently displaying the aforementioned interface containing multiple space balls and a viewfinder, a small white ball may be displayed on the first navigation point 1311 in the navigation bar to remind the user that the first-level interface is currently displayed. In this interface, after the user drags the "Customer" space ball and the "Master Bedroom" space ball into the viewfinder, the user may perform a swipe operation 1 from the first navigation point 1311 to the second navigation point 1312 on the navigation bar 131. In response to this swipe operation 1, the central control screen 100 may switch to the next-level subsystem interface, as shown in FIG18(c). This subsystem interface is the subsystem interface for the living room and master bedroom spaces within the viewfinder. Since the central control screen is currently displaying a second-level subsystem interface, a small white ball may be displayed on the second navigation point 1312 in the navigation bar 131 to remind the user that the second-level subsystem interface is currently displayed. Among them, the relevant description of the subsystem interface can be found in the description shown in the aforementioned implementation plan, which will not be repeated here.

[0276] In some scenarios, users can also continue to use the above-mentioned sliding navigation bar, multi-finger operation or click operation on the above-mentioned subsystem interface to trigger the central control screen to enter the next-level single-device interface, so as to implement the setting of execution actions for individual smart devices in each space in the viewfinder in the single-device interface.

[0277] For example, as shown in (d) in FIG17 , the user may also continue to perform the two-finger expansion operation 2 on the above subsystem interface to trigger the central control screen to enter the single-device interface under the living room and master bedroom space.

[0278] Optionally, in response to the two-finger expansion operation 2, the central control screen 100 can switch to display the next-level single-device interface as shown in (a) in Figure 18. The single-device interface may include a device circle for the living room subsystem and a device circle for the master bedroom subsystem. In the device circle of the living room subsystem, the user can click on the device ball to set the switch execution action of the single device in the living room corresponding to the device ball. The user can also click on the device ball in the device circle of the master bedroom subsystem to set the switch execution action of the single device in the master bedroom corresponding to the device ball. Among them, for the relevant description of realizing the quick control of each single device through the single-device interface, please refer to the description of the aforementioned implementation plan and will not be repeated here.

[0279] To distinguish the device circles of different spaces, a corresponding space identifier can be displayed within each device circle (or above or below the device circle). This identifier can be in the form of text, an icon, or other representations. For example, if the text "Living Room - Auxiliary Lights" is marked on a device circle, it indicates that the device circle corresponds to the auxiliary lighting subsystem in the living room. Optionally, the device circles for the living room and master bedroom can be displayed in different colors, such as blue for the living room and yellow for the master bedroom.

[0280] Optionally, the single-device interface under the above-mentioned living room and master bedroom space also includes generating a scene control 127, which is used to save the execution actions of multiple single devices in the living room and master bedroom currently set in the single-device interface as the currently newly created "living room + master bedroom" cross-space smart scene.

[0281] Optionally, after the user clicks on the Create Scene control 127, in response to this click, the central control screen 100 can save the single-device interface in the living room and master bedroom spaces as a snapshot and display the scene naming interface shown in (a) of Figure 16. After the user enters a customized scene name and clicks the Confirm control, the central control screen completes the creation and saving of the cross-space smart scene. Optionally, the snapshots of the single-device interface in the living room and master bedroom spaces can also be displayed on the scene naming interface.

[0282] For example, as shown in (c) in FIG18 , the user may also continue to perform a sliding operation 2 from the second navigation point 1312 to the third navigation point 1313 on the navigation bar 131 in the above-mentioned subsystem interface. In response to the sliding operation 2, the central control screen 100 may switch to the next-level single-device interface as shown in (d) in FIG18 . The single-device interface includes a device circle for the living room subsystem and a device circle for the master bedroom subsystem. At this time, since the central control screen currently displays the single-device interface of the third-level interface, the central control screen may synchronously display a white ball on the third navigation point 1313 in the navigation bar 131 to remind the user that the third-level single-device interface is currently being displayed. For the relevant description of the single-device interface, please refer to the description shown in the aforementioned implementation scheme and will not be repeated here.

[0283] In some scenarios, after the user completes the execution action settings for the smart devices in the living room and master bedroom spaces in the above subsystem interface or single device interface, the user can also trigger the central control screen to return to the first-level interface containing multiple space balls and viewfinders, such as the interface shown in (d) of Figure 15, by sliding the navigation bar, multi-finger operation, or clicking. At this time, the user can click the Generate Scene control 127 to trigger the central control screen 100 to save the currently set execution action of at least one smart device in the living room and master bedroom as the newly created cross-space smart scene.

[0284] It is understood that the device interaction method provided in the embodiment of the present application is not limited to the applicable fields. For example, it can be applied to the Internet of Things field where everything is connected, such as smart home, industrial production, video surveillance, etc., and can also be applied to folder management and photo album (or gallery) management on the device desktop. The device interaction method provided in the embodiment of the present application is also not limited to the applicable devices. For example, it can be applied to the central control screen in the field of smart home, electronic devices (such as mobile phones) installed with smart home software, and electronic devices (such as mobile phones) that include functions such as desktop folders or photo albums (or galleries).

[0285] For example, taking the folder management on the mobile phone desktop as an example, the folders on the desktop can be displayed in the form of small folders or in the form of large folders. Among them, the small folders on the desktop (also called object collections) support merging multiple applications into a separate folder and becoming a separate icon. After the user clicks on the small folder on the desktop, the mobile phone will expand the folder and display the various application icons in the folder, and then the user can find the application they need in the folder. The large folder supports opening the application in the folder directly on the desktop without opening the folder. That is, when the user clicks on an application icon in the large folder directly on the desktop, the application corresponding to the application icon can be directly started. At this time, the electronic device can directly enter the interface of the application corresponding to the application icon without opening the large folder first.

[0286] Users can zoom in and out of folders on the desktop by performing multi-finger operations on them, allowing them to quickly switch between small folders, large folders, and full-screen folders. They can also zoom in and out of albums by performing multi-finger operations on the album list, allowing them to quickly switch between multiple levels of album interfaces.

[0287] It should be noted that the above implementation is only one implementation method of the embodiment of the present application. In actual application, other implementation methods may also be used, which are not limited here. This application will take the smart home field as an example to specifically illustrate the device interaction method provided in the embodiment of the present application.

[0288] As shown in Figure 19, an embodiment of the present application provides a schematic diagram of the architecture of a smart home system (also known as a device control system). The smart home system 1900 may include smart devices 1910 and a hub device 1920. Among them, smart devices can be all devices in the home that can access the communication network. Scenarios for smart devices to access the communication network may include scenarios where the smart devices directly access the communication network and scenarios where the smart devices rely on other devices to access the communication network.

[0289] Optionally, smart device 1910 may be a household appliance, such as a smart door lock, smart speaker, smart curtain, smart air conditioner, smart camera, robot vacuum, smart socket, smart desk lamp, etc. Optionally, smart device 1910 may also be a sensor device for sensing surrounding environmental information, such as a camera, infrared sensor, human motion sensor, air quality monitor, smoke alarm, etc.

[0290] Optionally, the smart devices 1910 can be interconnected through a communication network. The communication network can be a wired network or a wireless network. For example, the communication network can be a local area network (LAN) or a wide area network (WAN), such as the Internet. The communication network can be implemented using any known network communication protocol, which can be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), FireWire, global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth, Wi-Fi, NFC, voice over Internet protocol (VoIP), a communication protocol that supports network slicing architecture, or any other suitable communication protocol.

[0291] For example, the smart devices 1910 may establish a Wi-Fi connection through a Wi-Fi network. For another example, multiple smart devices 1910 may be connected to each other through one or more servers after logging into the same account.

[0292] Optionally, smart device 1910 may also be a network access device for connecting to a local area network (LAN) or the internet. Examples include routers and gateway devices. For example, one or more routers may be deployed throughout a home to form a LAN or access a LAN or the internet. Once one or more home devices are connected to a router, they can communicate with other devices within the LAN or the internet through the network channels provided by the router.

[0293] Optionally, smart device 1910 may also be a gateway sub-device, which does not have the ability to connect directly to the Internet and needs to rely on other devices to connect to the local area network or the Internet. Gateway sub-devices include Bluetooth sub-devices, Bluetooth low energy (BLE) sub-devices, power line communication (PLC) sub-devices, Zigbee sub-devices, etc.

[0294] Optionally, the multiple smart devices 610 can be divided into one or more device subsystems according to the functions of the smart devices 1910. The types of the device subsystems can include lighting subsystems, heating and cooling subsystems, sunshade subsystems, audio and video entertainment subsystems, home electronics systems, etc.

[0295] Optionally, the smart device 1910 can also be classified according to the spatial attributes of the smart device 1910. The spatial attributes of the above-mentioned smart device 1910 can indicate the location of the smart device 1910. For example, if the spatial attribute of the smart device 1910 is kitchen, it can be indicated that the smart device 1910 is located in the kitchen. According to the spatial attributes of the smart device 1910, multiple smart devices 1910 can be divided into spatial device systems corresponding to each space. Among them, a spatial device system can include multiple smart devices 1910 with the same spatial attributes. For example, smart devices such as smart table lamps, smart air conditioners, and smart curtains in the living room can serve as a living room device system.

[0296] The hub device 1920 is also called a hub, a central control system or a host. The hub device 1920 can be used to manage the various smart devices 1910 in the smart home system 1900. For example, the hub device 1920 can obtain the operating status of each smart device 1910, which includes an open state (or a power-on state), a closed state (or a power-off state), a working state, a sleep state, a low power state, a fault state, etc. For another example, the hub device 1920 can send corresponding control instructions to the smart device 1910 to control the smart device 1910 to implement the corresponding function. Optionally, each smart device 1910 can also send corresponding control instructions to the hub device 1920 to forward the control instructions to other smart devices via the hub device 1920.

[0297] Optionally, the hub device 1920 may include a display screen to provide a human-computer interaction interface. In this case, the hub device 1920 may execute the device interaction method provided in this application, so that the user can quickly control the smart devices in the home environment through the human-computer interaction interface provided by the hub device 1920.

[0298] Optionally, the entire house may be equipped with only one hub device 1920. In some scenarios, the entire house may also be equipped with multiple hub devices 1920. Each hub device 1920 manages multiple smart devices 1910 in the smart home system 1900. Optionally, each space in the house, such as each room, may be equipped with a hub device. Optionally, some rooms or areas may not need to be equipped with a hub device; that is, not all rooms or areas are equipped with a hub device.

[0299] In some scenarios, multiple hub devices throughout a home can be independent and communicate with the cloud separately. The cloud can be used to manage the various smart devices 1910 in the smart home system 1900 through the multiple hub devices. For example, the cloud can obtain the operating status of each smart device 1910 through the multiple hub devices 1920. For another example, the cloud can send corresponding control instructions to each hub device 1920 to control each hub device 1920 to perform corresponding functions.

[0300] In some scenarios, multiple hub devices throughout the house can also communicate with each other. Optionally, among the multiple hub devices in the house, there may be a hub device for unified management of the multiple hub devices. This hub device can be defined as the control center of the smart home system. In this way, other hub devices can send relevant information to the control center, which will make centralized decisions and management. The control center can also send corresponding control instructions to other hub devices to instruct other hub devices to control the corresponding smart devices to achieve corresponding functions.

[0301] Alternatively, the cloud may communicate only with the control center. For example, the cloud may send control instructions to the control center, which in turn sends corresponding control instructions to each hub device to control each hub device to implement corresponding functions.

[0302] Optionally, the hub device 1920 can act as an edge node to communicate with the cloud. The cloud can refer to a server cluster on the Internet. Alternatively, the cloud can be a server corresponding to a smart home platform. In some scenarios, the cloud can also serve as a control hub to control smart devices in the home environment.

[0303] In some scenarios, the smart home system 1900 also includes one or more input devices. These input devices can be electronic devices with display screens, such as control panels, mobile phones, and tablet computers. For example, the control panel can display the human-computer interface of the smart home system 1900. Users can use this interface to view connection information for each device in the smart home system 1900, operating information for smart devices 1910, and / or information about control of smart devices 1910 by the hub device 1920. Users can also use this interface to control devices in the smart home system 1900 by inputting control commands through tapping the screen or using voice commands. For example, a smart life application can be installed on a mobile phone. Launching this application on the mobile phone will display the human-computer interface of the smart home system 1900. Users can use this interface to view connection information for each device in the smart home system 1900, operating information for smart devices 1910, and / or information about control of smart devices 310 by the hub device 1920. Users can also use this interface to quickly control smart devices 1910.

[0304] Optionally, a control panel can be provided in each room or area of ​​the house. The control panel of each room or area can display a human-computer interaction interface for that room or area. The user can view the connection information of each device in the room or area, the operating information of the smart device 1910 in the room or area, and / or the control information of the hub device 1920 on the smart device 1910 on the human-computer interaction interface, etc., and can also quickly control the smart device 1910 on the human-computer interaction interface.

[0305] In some scenarios, the hub device 1920 can be a control panel. When there are multiple hub devices in the house, and there is a hub device (i.e., a control hub) for unified management of the multiple hub devices, the control hub for managing the multiple hub devices can be a central control panel (also called a central control screen).

[0306] It should be noted that the architecture of the smart home system shown in Figure 19 is only one implementation method of the embodiment of the present application. In actual applications, the smart home system can also include more or fewer devices, which is not limited here.

[0307] The following will introduce a device interaction method provided by an embodiment of the present application in conjunction with the accompanying drawings. Among them, the device interaction method can be applied to an electronic device, which includes a display screen to provide a human-computer interaction interface for a smart home system. Optionally, the electronic device can be the above-mentioned central device (central control screen) with a display screen, a control panel, a mobile phone, a tablet computer, etc., or other devices with a display screen, which are not limited at this time. The following will take the application of the device interaction method to an electronic device as an example to give a specific introduction.

[0308] Please refer to FIG. 20 , which provides a device interaction method provided by an embodiment of the present application. The device interaction method includes:

[0309] S2010. The electronic device displays a first interface, which includes a first control and a second control. The first control indicates a first space, and the second control indicates a second space.

[0310] In the embodiments of the present application, to control smart devices in a home environment, the electronic device may provide a multi-level interface, including a multi-space level interface, a device type level (including a device group level interface), and a single device level interface. The first interface described above is the first level interface in this multi-level interface, namely the multi-space level interface.

[0311] Optionally, the first interface is an interface for displaying the home environment in a differentiated manner by spatial dimension. The first interface may be a multi-space interface as shown in (b) of FIG4 .

[0312] The first interface may include multiple space controls, such as q space controls, where q is an integer greater than 1. Each space control represents a space in a home environment. Each space control may be spherical or circular, such as the space sphere shown in FIG4(b), or rectangular, fan-shaped, or other shapes. Corresponding space identifiers, such as text or icons, may be displayed within each space control, above the control, or below the control.

[0313] Among them, space can represent different areas in a home environment. For example, space can include a porch, living room, kitchen, master bedroom, second bedroom, study, balcony, bathroom, audio-visual room, wine cellar, etc. The embodiment of the present application does not limit the specific division method of different areas in a home environment. For example, it can also be divided into units of floors, such as the space in a house can include the first floor, second floor, third floor, etc. Each smart device can have a space attribute. The space attribute can be set for the smart device by the user when adding the smart device, or it can be automatically recognized by the electronic device after automatically detecting the location of the smart device.

[0314] This embodiment of the present application uses an example in which multiple space controls include a first control and a second control, where the first control represents a first space in a home environment and the second control represents a second space in the home environment. The first space and the second space are different. For example, the first space is a living room and the second space is a bedroom.

[0315] Optionally, multiple spatial controls can be displayed in a list format, arranged horizontally or vertically in the first interface, or arranged in a circular pattern around a center point in the first interface. For example, in the first interface, the first control is the center, and the second control and other controls are distributed on the circumference of the circle centered on the first control. For another example, in the first interface, the second control is the center, and the first control and other controls are distributed on the circumference of the circle centered on the second control.

[0316] S2020. The electronic device detects a first operation on the first interface.

[0317] If a user wants to view the devices in a certain space, the user can perform a first operation on the first interface. The first operation is used to enter the next level interface of the first interface, that is, the interface of the device type level mentioned above, which can display all smart devices in a space according to the device type dimension, such as the interface shown in (d) in Figure 4. Optionally, in addition to being used to enter the next level interface of the first interface, the first operation can also be used to enlarge the first interface.

[0318] In some embodiments, the first operation may be a multi-finger pinch-out operation applied to any location in the first interface, such as a two-finger pinch-out operation or a five-finger pinch-out operation. It may also be a multi-finger pinch-out operation applied to a first control in the first interface, or a single-click operation, a double-click operation, a long press operation, etc. applied to the first control in the first interface.

[0319] In some embodiments, the first interface further includes a navigation bar, such as the navigation bar 125 shown in FIG13( b). The navigation bar is used for quickly switching between the above-mentioned multi-level interfaces. In this case, the first operation may also be a first sliding operation on the navigation bar. The first sliding operation may be a sliding in a first direction.

[0320] Optionally, the navigation bar may include a first navigation point and a second navigation point. The first navigation point corresponds to the first level interface of the multi-level interface, i.e., the first interface, and the second navigation point corresponds to the second level interface of the multi-level interface, i.e., the next level interface of the first interface. The first sliding operation is a sliding from the first navigation point to the second navigation point, or it may be a downward sliding on the navigation bar.

[0321] S2030. The electronic device responds to the first operation, enlarges and displays the first control, and then switches to displaying a second interface corresponding to the first control, where the second interface includes m controls, each of the m controls is used to control at least one device in the first space, or edit the status of at least one device in the first space, where m is a positive integer.

[0322] Optionally, each space control in the first interface corresponds to a device-level interface, wherein the second interface is a device-level interface for distinguishing and displaying devices in a certain space.

[0323] As one approach, the second interface can be a device type hierarchical interface, used to differentiate and display smart devices in a space by device type. For example, the second interface displays a control indicating the main light group, which can be used to turn the main light group on or off with one click, and also to edit the main light group's brightness, color temperature, and other operating conditions with one click. The second interface can also display a control indicating a single air conditioner, which can be used to turn it on or off with one click, and also to edit the temperature, wind direction, and other operating conditions of the single air conditioner with one click. This is shown in the subsystem interface in (d) of Figure 4.

[0324] Alternatively, the second interface can be a single-device hierarchical interface, used to differentiate and display multiple smart devices of a certain type. For example, the second interface displays a control indicating Master Light 1 in a master light group, and another control indicating Master Light 2 in the same master light group. This control indicating Master Light 1 allows users to turn Master Light 1 on or off on a single device in the master light group with one click, or edit the brightness, color temperature, and other operating conditions of Master Light 1 on a single device in the master light group with one click. This is shown in the single-device interface in Figure 6 (b).

[0325] In an embodiment of the present application, the electronic device may trigger the electronic device to enter the second-level interface corresponding to the target space control in the first interface in response to the first operation.

[0326] As a method, when the first operation is a multi-finger expansion operation and a first sliding operation on the navigation bar, the target space control may be a space control located at a first position in the first interface.

[0327] Optionally, when multiple space controls are displayed in a list format, the target space control is the first space control. In this case, in the first interface, the first control is displayed first, and the second control is displayed after the first control.

[0328] Optionally, when multiple spatial controls are displayed in a circular arrangement, the target spatial control is the spatial control located at the center. In this case, in the first interface, the second control and other controls are distributed on the circumference of the circle centered on the first control.

[0329] Alternatively, when the first operation is a multi-finger pinch-out operation, a single-click operation, a double-click operation, or a long press operation, the target spatial control is the spatial control at the location of the touch point of the first operation. In this case, in the first interface, the first operation performed by the user is a multi-finger pinch-out operation on the first control.

[0330] As another approach, the first operation can also be a combination of multiple operations. For example, in the first interface, the user can first click the first control and then slide the navigation bar to the second navigation point. In this case, the first control clicked by the user is the target space control.

[0331] In an embodiment of the present application, in response to a first operation, the electronic device may first magnify the first interface, and after magnification to a preset magnification, switch to display the second interface corresponding to the first control. This creates a visual effect of switching to the next level of interface by magnifying the interface. In some embodiments, in response to the first operation, the electronic device may also directly switch to display the second interface corresponding to the first control, without presenting the transition effect when switching between the upper and lower level interfaces.

[0332] Optionally, when the second interface is a device type hierarchical interface, the second interface may include multiple subsystem controls, each of which represents a certain type of smart device in the first space. The shape of each subsystem control may be spherical or circular, such as the subsystem sphere shown in (d) of FIG4 , or may be rectangular, fan-shaped, or other shapes. The corresponding device type identifier, such as text or icon, may be displayed in, above, or below each subsystem control.

[0333] In some embodiments, when there are multiple smart devices of a certain type in the first space, a subsystem control can represent a device group. A device group consists of smart devices of the same type, and there are usually multiple, but sometimes only one, smart devices of that type in a space. For example, if there are two main lights, "Master Light 1" and "Master Light 2," these two lights can form a main light device group (also called a main light group). In this case, when the "Master Light" subsystem control representing a smart device of the master light type is displayed in the second interface, the "Master Light" subsystem control can represent the master light device group.

[0334] In some embodiments, when there is only one smart device of a certain type in the first space, a subsystem control can also represent a single smart device. For example, there is usually only one air conditioner device in the first space. In this case, when the "Air Conditioner" subsystem control representing this type of smart device is displayed in the second interface, the "Air Conditioner" subsystem control can represent the single air conditioner device.

[0335] This embodiment of the present application uses an example in which multiple subsystem controls include a ninth control, representing multiple devices of a first type in a first space, which may form a first device group. For example, the ninth control represents an auxiliary light device group in a living room, which may include auxiliary light 1 and auxiliary light 2.

[0336] Optionally, when the electronic device presents the ninth control in different display states, it may indicate that the smart device of the type corresponding to the ninth control is in different working states. For example, if the electronic device highlights the ninth control, it may indicate that the smart device of the type corresponding to the ninth control is in the on state, and if the electronic device unhighlights the ninth control, it may indicate that the smart device of the type corresponding to the ninth control is in the off state.

[0337] In some scenarios, the user can control at least one type of smart device in the first space through the second interface.

[0338] Optionally, the second interface includes a second area, and the second area is used to display the subsystem controls of the type corresponding to the smart device in the turned-on state. The shape of the second area can be circular, such as the area within the inner ring 106 shown in (d) in Figure 4, and it can also be rectangular, fan-shaped, etc., which is not limited this time. In this case, all subsystem controls located in the second area can be highlighted. Among them, at least one control of the m controls may be located in the second area, indicating that the smart device of the type corresponding to the at least one control is in the turned-on state.

[0339] Optionally, when executing the first scene, a device in the first space associated with at least one control in the second area is controlled to execute the first scene with preset parameters. The first scene is a smart scene associated with the first space.

[0340] Optionally, in the second interface, other subsystem controls may be distributed outside the second area, indicating that the smart devices of the types corresponding to the other subsystem controls are in a closed state. The other subsystem controls may be distributed around the second area.

[0341] Optionally, when executing the first scene, a device in the first space that is associated with at least one control outside the second area is turned off.

[0342] In some scenarios, the user can also click or drag other subsystem controls outside the first area to move other subsystem controls into the second area to quickly open the corresponding type of smart device.

[0343] Optionally, the m controls include an eighth control. In response to an operation on the eighth control, the electronic device may adjust a parameter of at least one device associated with the eighth control.

[0344] Optionally, in response to an operation on the eighth control, the electronic device may also adjust a display style of the eighth control to adjust parameters of at least one device associated with the eighth control, wherein the display style includes at least one of display content, control color, and control fill.

[0345] In an embodiment of the present application, in order to realize the control of smart devices in a home environment, the electronic device provides a multi-level interface in the human-computer interaction interface, including multiple space levels and device levels. And by enlarging the interface, the interface switching between multiple levels of interfaces is realized. Thereby, not only can the hierarchical relationship between devices be clearly expressed, that is, the environment contains multiple spaces, each space contains multiple types of smart devices, and when smart devices of the same type form a device group, each device group contains one or more single devices. It is also possible to quickly find the target device that you want to control in a certain space through flexible and simple zoom operations. The interaction efficiency and intelligence of electronic devices are improved, and the operation is also more convenient and flexible.

[0346] Please refer to FIG. 21 , which provides another device interaction method provided by an embodiment of the present application. The device interaction method includes:

[0347] S2110. The electronic device displays a first interface, where the first interface includes a first control and a second control.

[0348] S2120: The electronic device detects a first operation on the first interface.

[0349] S2130. The electronic device responds to the first operation, amplifies and displays the first control, and then switches to displaying a second interface corresponding to the first control, where the second interface includes a ninth control.

[0350] Among them, the ninth control indicates multiple devices of the first type in the first space.

[0351] S2140: The electronic device detects a sixth operation on the second interface.

[0352] If the user wants to view a single device in a device group, the user can perform the sixth operation on the second interface. This sixth operation is used to enter the next level interface of the second interface, that is, the interface of the single device level mentioned above, which can distinguish and display all single smart devices of the same type, such as the interface shown in (b) of Figure 6. Optionally, in addition to being used to enter the next level interface of the second interface, the sixth operation can also be used to zoom in on the second interface.

[0353] In some embodiments, the sixth operation may be a multi-finger pinch-out operation applied to any location in the second interface, such as a two-finger pinch-out operation or a five-finger pinch-out operation. It may also be a multi-finger pinch-out operation applied to a ninth control in the second interface, or a single-click operation, a double-click operation, a long press operation, etc., applied to the ninth control in the second interface.

[0354] In some embodiments, the second interface may also include a navigation bar, such as the navigation bar 125 shown in (c) of FIG13 . The navigation bar is used for fast switching between the above-mentioned multi-level interfaces. In this case, the sixth operation may also be a sliding operation acting on the navigation bar.

[0355] Optionally, the navigation bar may include a second navigation point and a third navigation point. The second navigation point corresponds to the second level of the multi-level interface, i.e., the second interface, and the third navigation point corresponds to the third level of the multi-level interface, i.e., the next level below the second interface. The sliding operation may be a sliding operation from the second navigation point to the third navigation point, or may be a downward sliding operation on the navigation bar.

[0356] S2150. The electronic device responds to the sixth operation, amplifies the display of the second interface, and then switches to displaying the seventh interface corresponding to the ninth control.

[0357] Optionally, when a subsystem control in the second interface represents a device group, the interface of the next level below the second interface, i.e., the third-level interface, can display all individual smart devices under the device group independently. For example, a ninth control represents multiple devices of the first type in the first space. When these multiple devices form the first device group, the third-level interface corresponding to the ninth control, i.e., the seventh interface, can display all individual smart devices in the first device group independently. The seventh interface can be a single-device interface as shown in (b) of Figure 7 .

[0358] In response to the sixth operation, the electronic device may trigger the electronic device to enter the third-level interface corresponding to the target subsystem control in the second interface.

[0359] As a method, when the sixth operation is a multi-finger pinch-to-zoom operation or a swipe operation on the navigation bar, the target subsystem control is the subsystem control located in the second area of ​​the second interface. In this way, all individual devices in the device group that are turned on can be displayed. There can be one or more subsystem controls in the second area.

[0360] Optionally, if a subsystem control indicating a single smart device exists within the second-first region, since the subsystem control indicating the single smart device is already displayed in the second interface, i.e., the second-level interface, refined control of the single smart device can be achieved directly in the second interface, without having to go through the next-level single-device interface, i.e., the third interface. Therefore, the target subsystem control can be all subsystem controls representing device groups within the second region.

[0361] Alternatively, when the sixth operation is a multi-finger pinch operation, a single-click operation, a double-click operation, or a long press operation, the target spatial control is the subsystem control at the location of the touch point of the second operation. In this case, in the first interface, the second operation performed by the user is a multi-finger pinch operation on the ninth control.

[0362] As another approach, the sixth operation can also be a combination of multiple operations. For example, in the first interface, the user can first click the ninth control and then slide the navigation bar to the third navigation point. In this case, the ninth control clicked by the user is the target subsystem control.

[0363] In an embodiment of the present application, in response to the sixth operation, the electronic device may first magnify the second interface, and after magnification to a preset magnification, switch to display the seventh interface corresponding to the ninth control. This creates a visual effect of switching to the next level of interface by magnifying the interface. In some embodiments, in response to the sixth operation, the electronic device may also directly switch to display the seventh interface corresponding to the ninth control, without presenting the transition effect when switching between the upper and lower level interfaces.

[0364] The seventh interface may include one or more device controls, each representing a single smart device. Each device control may be spherical or circular, such as the device ball shown in FIG6(b), or rectangular, fan-shaped, or other shapes. Each device control may display corresponding text, icons, or other device identifiers within, above, or below the control.

[0365] This embodiment of the present application uses the seventh interface including control 2, which represents the first device in the first device group, as an example to describe the solution of this embodiment of the present application. Control 2 is associated with the ninth control in the second interface. For example, if the ninth control in the second interface represents the auxiliary lighting device group in the living room, and the auxiliary lighting device group includes auxiliary light 1 and auxiliary light 2, the seventh interface can display auxiliary light 1 and auxiliary light 2 in the auxiliary lighting device group independently, and control 2 can be a device control representing auxiliary light 1.

[0366] Optionally, when the electronic device presents the control 2 in different display states, it may indicate that the single smart device corresponding to the control 2 is in different working states. For example, if the electronic device highlights the control 2, it may indicate that the first device corresponding to the control 2 is in the on state, and if the electronic device de-highlights the control 2, it may indicate that the first device corresponding to the control 2 is in the off state.

[0367] Optionally, the seventh interface includes a third area for displaying device controls for each device in the first device group. The shape of the third area can be circular, such as the device circle shown in FIG6(b), or rectangular, sector-shaped, etc., without limitation. Control 2 can be located within the third area, indicating that the first device corresponding to control 2 is a device in the first device group.

[0368] Optionally, the third interface may further include other areas, such as a fourth area, for displaying device controls for each device in another device group. For example, the m controls may further include a tenth control indicating multiple devices of the second type in the first space, which may constitute the second device group. The fourth area is used to display device controls for each device in the second device group.

[0369] In this way, all individual smart devices in each device group can be displayed in different areas, as shown in (b) in FIG6 .

[0370] In some scenarios, users can control a single smart device in a device group through the seventh interface.

[0371] As a method, the user can quickly turn on the corresponding single smart device by clicking control 2. The user can also quickly turn off the corresponding single smart device by clicking the control again.

[0372] Alternatively, users can click and hold Control 2, then slide it up or down to adjust the operating parameters of a single smart device. For example, if Control 2 represents Auxiliary Light 1, clicking and holding Control 2 and sliding it up will increase the brightness of Auxiliary Light 1; clicking and holding Control 2 and sliding it down will decrease the brightness of Auxiliary Light 1.

[0373] In some scenarios, the second interface also includes a tenth control, which represents the second device group in the first space. The tenth control is located outside the second area, indicating that the corresponding type of second device group is in a closed state. In the second interface, the user can click or drag the tenth control to move the tenth control to the second area, triggering the electronic device to control the second device group of the type corresponding to the tenth control to turn on. At this time, when the user controls the electronic device to enter the next level interface, since the second area includes the ninth and tenth controls, the interface of the next level can display all the individual smart devices under the corresponding first device group independently, or all the individual smart devices under the second device group independently. For example, the interface of the next level may include a third area and a fourth area, the third area is used to display the device options of each device in the first device group, and the fourth area is used to display the device options of each device in the second device group. The control 2 for representing the first device in the first device group is located in the third area, and the control for representing the device in the second device group is located in the fourth area.

[0374] S2160: The electronic device detects a seventh operation on a seventh interface.

[0375] After entering the seventh interface and viewing or controlling a single device in a device group, if the user wants to return to the previous interface, that is, the second interface, the user can perform the seventh operation on the seventh interface. The seventh operation is used to return to the previous interface of the seventh interface, that is, the interface of the device type level, which can display all smart devices in a space according to the device type dimension, such as the interface shown in (d) in Figure 4. Optionally, in addition to being used to return to the previous interface of the seventh interface, the seventh operation can also be used to shrink the seventh interface.

[0376] In some embodiments, the seventh operation may be a multi-finger pinch operation applied to any position in the seventh interface, such as a two-finger pinch operation, a five-finger pinch operation, etc.

[0377] In some embodiments, the seventh interface further includes a navigation bar, such as the navigation bar 125 shown in Figure 14. The navigation bar is used for fast switching between the above-mentioned multi-level interfaces. At this time, the seventh operation can also be a sliding operation acting on the navigation bar.

[0378] Optionally, the navigation bar may include a second navigation point and a third navigation point. The second navigation point corresponds to the second level interface of the multi-level interface, i.e., the second interface, and the third navigation point corresponds to the third level interface of the multi-level interface, i.e., the seventh interface. The sliding operation described above may be a sliding operation from the third navigation point to the second navigation point, or may be an upward sliding operation on the navigation bar.

[0379] S2170. The electronic device responds to the seventh operation, shrinks the display of the seventh interface, and then switches to displaying the second interface.

[0380] In an embodiment of the present application, in response to the seventh operation, the electronic device may first zoom out and display the seventh interface, and then return to displaying the second interface of the previous level after zooming out to a preset magnification. This creates a visual effect of returning to the previous level by zooming out. In some embodiments, in response to the seventh operation, the electronic device may also directly return to displaying the second interface, without presenting the transition effect between the upper and lower level interfaces.

[0381] S2180: The electronic device detects a second operation on the second interface.

[0382] After entering the second interface and viewing or controlling smart devices in a space, if the user wants to return to the previous interface, that is, the first interface mentioned above, the user can perform a second operation on the second interface. The second operation is used to return to the previous interface of the second interface, that is, the interface of the multi-space level mentioned above. Optionally, in addition to being used to return to the previous interface of the second interface, the second operation can also be used to shrink the second interface.

[0383] In some embodiments, the second operation may be a multi-finger pinch operation applied to any position in the second interface, such as a two-finger pinch operation, a five-finger pinch operation, etc.

[0384] In some embodiments, the second interface further includes a navigation bar, such as the navigation bar 125 described in (c) of FIG13 . The navigation bar is used for quickly switching between the above-mentioned multi-level interfaces. In this case, the second operation may also be a second sliding operation acting on the navigation bar. The second sliding operation may be a sliding in the second direction.

[0385] Optionally, the navigation bar may include a second navigation point and a first navigation point. The second navigation point corresponds to the second level interface of the multi-level interface, i.e., the second interface, and the first navigation point corresponds to the first level interface of the multi-level interface, i.e., the first interface. The second sliding operation is a sliding operation from the second navigation point to the first navigation point, or an upward sliding operation on the navigation bar.

[0386] S2190. The electronic device responds to the second operation, shrinks the display of the second interface, and then switches to displaying the first interface.

[0387] In an embodiment of the present application, in response to the second operation, the electronic device may first zoom out and display the second interface, and then return to displaying the first interface of the previous level after zooming out to a preset magnification. This creates a visual effect of returning to the previous level by zooming out. In some embodiments, in response to the second operation, the electronic device may also directly return to displaying the first interface, without presenting the transition effect between the upper and lower level interfaces.

[0388] In some scenarios, when users need to quickly control smart devices in other spaces, they can also quickly enter the second-level interface corresponding to another space control through the above-mentioned multi-finger expansion operation, single-click operation, double-click operation, long press operation, sliding operation on the navigation bar, etc. when returning to the first interface.

[0389] Taking entering the second-level interface corresponding to the second control, that is, the fourth interface as an example, the electronic device can detect a third operation on the first interface, and the third operation is used to trigger entering the next-level interface corresponding to the second control.

[0390] Among them, the third operation can be a multi-finger expansion operation on the second control, or a single-click operation, double-click operation, long press operation, etc. on the second control, or a combined operation of first clicking the second control and then sliding the navigation bar to the second navigation node.

[0391] In response to the third operation, the electronic device may magnify the second control and then switch to displaying a fourth interface corresponding to the second control. The fourth interface includes n controls, each of which is used to control at least one device in the second space or edit the status of at least one device in the second space, where n is a positive integer. For example, if the n controls include control 1, control 1 represents device group 1, indicating device type 1 in the second space. In the fourth interface, the user can view and control at least one type of smart device in the second space.

[0392] Optionally, after the electronic device switches to display the fourth interface, the electronic device may also detect an operation on the fourth interface, which is used to trigger entry into the next-level interface, that is, the single-device-level interface. The operation may be a multi-finger expand operation acting on any position in the fourth interface. It may also be a multi-finger expand operation acting on control 1 in the fourth interface, or a single-click operation, double-click operation, long-press operation, etc., acting on control 1 in the fourth interface. It may also be a sliding operation of sliding the navigation bar to the third navigation node.

[0393] In response to the above operation, the electronic device can zoom in on the fourth interface and then switch to displaying a single-device-level interface corresponding to control 1. This interface includes multiple controls, each representing multiple devices in device group 1. In the fifth interface, the user can view and control a single smart device in a device group in the second space.

[0394] In other scenarios, in the first interface, the first control is located in the center position, and the second control and other spatial controls are displayed around the first control. The user can also first drag the second control to the center position of the first control so that the second control is located in the center position, and then perform a multi-finger expansion operation or slide the navigation bar to the second navigation node to trigger entry into the next level interface corresponding to the second control.

[0395] For example, when the electronic device returns to displaying the first interface, the electronic device may detect an operation on the second control in the first interface. The operation may be an operation of dragging the second control toward the center of the first control. In this case, the electronic device may respond to the operation by moving the second control to the center of the first control in the first interface and distributing the first control and other spatial controls around the second control.

[0396] The electronic device may then detect a fifth operation on the first interface. This fifth operation may be a multi-finger pinch-out operation applied to any location in the first interface. It may also be a sliding operation of sliding the navigation bar to the second navigation node. In response to this fifth operation, the electronic device may zoom in on the second control and then switch to displaying the fourth interface corresponding to the second control.

[0397] Optionally, after the electronic device switches to display the fourth interface, the electronic device may also detect an operation on the fourth interface, which is used to trigger entry into the next level of interface, that is, the single-device level interface. The operation may be a multi-finger expansion operation acting on any position in the fourth interface. It may also be a multi-finger expansion operation acting on control 1 in the fourth interface, or a single-click operation, double-click operation, long press operation, etc. acting on control 1 in the fourth interface. It may also be a sliding operation of sliding the navigation bar to the third navigation node. In response to this operation, the electronic device may zoom in on the fourth interface and then switch to displaying the single-device level interface corresponding to control 1.

[0398] In an embodiment of the present application, in order to realize the control of smart devices in a home environment, the electronic device provides a multi-level interface in the human-computer interaction interface, including multiple space levels, device type levels (including device groups) and single device levels. And by zooming in and out of the interface, the interface switching between multiple levels of interfaces is realized. Thereby, not only can the hierarchical relationship between devices be clearly expressed, that is, the environment contains multiple spaces, each space contains multiple types of smart devices, and when smart devices of the same type form a device group, each device group contains one or more single devices. It is also possible to quickly find the target device that you want to control in a certain space through flexible and simple zoom operations. The interaction efficiency and intelligence of electronic devices are improved, and the operation is also more convenient and flexible.

[0399] Please refer to FIG. 22 , which provides another device interaction method provided by an embodiment of the present application. The device interaction method includes:

[0400] S2210. Display the fifth interface, which includes a fifth control, a sixth control, and a first area. The fifth control indicates the first space, the sixth control indicates the second space, and the first area is used to display controls corresponding to the spaces to be combined to generate the smart scene. The fifth control and the sixth control are located in the first area.

[0401] In an embodiment of the present application, the electronic device may also provide a one-click generation service for cross-space smart scenes. In this way, when a user combines actions performed by devices in multiple spaces, a cross-space smart scene can be generated with one click. The electronic device may display a fifth interface for combining actions performed by devices in at least two spaces to generate a cross-space smart scene.

[0402] Optionally, the fifth interface may include multiple space controls, each representing a space in the home environment. Each space control may be spherical or circular, such as the space sphere shown in Figure 15(c), or rectangular, fan-shaped, or other shapes. Each space control may display a corresponding space identifier, such as text or an icon, within, above, or below the control.

[0403] This embodiment of the present application uses an example in which multiple space controls include a fifth control and a sixth control, where the fifth control represents a first space in a home environment and the sixth control represents a second space in the home environment. The first space and the second space are different, for example, the first space is a living room and the second space is a bedroom.

[0404] Optionally, the fifth interface may further include a first area for displaying space controls for the spaces to be combined to generate the cross-space smart scene. The fifth and sixth controls are located in the fifth area, indicating that the cross-space smart scene to be generated is generated by combining the first and second spaces.

[0405] The first area can be represented as a viewfinder. Users can click or drag the spatial control to move it into the viewfinder to select the spatial options to be combined to generate a cross-space intelligent scene. It is understood that the fifth area can also be represented as a rectangular frame, a circular frame, or other forms, which are not limited at this time.

[0406] Other space controls outside the first area represent spaces that do not need to be added to the cross-space smart scene. Space controls outside the first area can be displayed differently from those within the first area, such as in different colors or sizes.

[0407] S2220: The electronic device detects a fourth operation on the fifth interface.

[0408] After the user has selected at least two spaces for generating a cross-space smart scene, that is, after moving the at least two spaces into the fifth area, if the user confirms that the cross-space smart scene can be generated, the user can perform a fourth operation. This fourth operation is used to generate the cross-space smart scene. Optionally, in addition to generating the cross-space smart scene, this fourth operation can also be used to display a scene naming interface for the user to name the newly created cross-space smart scene.

[0409] In some embodiments, the fifth interface includes a confirmation control, such as the generate scene control 127 shown in (d) of Figure 15. The fourth operation may be a touch operation acting on the confirmation control.

[0410] In some embodiments, the fourth operation may also be a gesture operation for indicating confirmation, such as a check mark √ gesture, a knuckle tapping gesture, etc.

[0411] S2230: In response to the fourth operation, generate a first scene, where the first scene is used to control multiple devices in the first space and the second space.

[0412] Optionally, in response to the fourth operation, the electronic device may save the device execution operations in the current first space and the second control, and generate corresponding control rules. The control rules include a first rule that the device in the first space needs to execute, and a second rule that the device in the second space needs to execute.

[0413] Optionally, when the electronic device generates the control rule in response to the fourth operation, it may further display a scene naming interface for the user to name the cross-space intelligent scene corresponding to the newly generated control rule.

[0414] Optionally, in response to the fourth operation, the electronic device may also save the fifth interface as a snapshot and display the snapshot in the scene naming interface.

[0415] Optionally, when the user successfully names the cross-space smart scene, the electronic device may also display a scene control corresponding to the cross-space smart scene on the main interface of the smart home system. The scene control may be a card, button, or other functional control. When the user clicks the scene control, the electronic device may respond to the click by controlling the device in the first space to perform an operation based on the first rule in the control rules, and controlling the device in the second space to perform an operation based on the second rule in the control rules. This allows the user to launch a cross-space smart scene with one click.

[0416] In some scenarios, after the user quickly controls smart devices in multiple spaces through the aforementioned multi-level interface, when the user needs to retain the execution actions of the devices in the multiple spaces, the user can quickly enter the cross-space smart scene generation interface, i.e., the above-mentioned fifth interface, from the first-level multi-space hierarchical interface, i.e., the above-mentioned first interface.

[0417] For example, the first interface also includes a tenth control indicating a service option for a cross-space smart scene service. When the user clicks the tenth control, the electronic device can directly display the fifth interface in response to the click operation, moving the space controls corresponding to the first and second spaces just controlled through the multi-level interface directly to the first area.

[0418] Optionally, in response to the click operation, the electronic device may also display a sixth interface, which includes the first area and multiple spatial controls located outside the first area, such as k spatial controls, where k is an integer greater than 1. Each spatial control represents a space. The multiple spatial controls include the fifth control and the sixth control.

[0419] The user can perform an operation on the fifth control on the sixth interface, such as dragging the fifth control into the fifth area. In this case, the electronic device can respond to the operation by moving the fifth control into the first area on the sixth interface. The user can also continue to perform an operation on the sixth control on the sixth interface, such as dragging the sixth control into the first area. In this case, the electronic device can respond to the operation by moving the sixth control into the first area on the sixth interface. As a result, the fifth and sixth controls can be displayed in the first area, and the electronic device now displays the fifth interface.

[0420] In the embodiments of the present application, to enable the generation of smart scenes in a home environment, the electronic device provides a human-computer interaction interface that includes a multi-space hierarchical interface. In this multi-space hierarchical interface, users can customize and select multiple spaces to be added to the smart scene. This allows for one-click generation of cross-space smart scenes for the selected multiple spaces. This improves the interaction efficiency and intelligence of the electronic device, making operation more convenient and flexible.

[0421] It is understood that while the above description uses a home user's home environment as an example, the above solution can obviously also be used to switch between other spaces throughout the house. For example, it can be used for rapid switching and device control between different spaces in scenarios such as office environments, hotel environments, or factory environments.

[0422] It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the steps of the various examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and software. Whether a function is executed in the form of hardware or software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application. In this embodiment, the first device can be divided into functional modules according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0423] The present application also provides a device interaction apparatus, which can be applied to the above-mentioned electronic device and is used to execute the functions or steps executed by the electronic device in the above-mentioned method embodiment.

[0424] The present application also provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected via a line. The interface circuit can read instructions stored in a memory and send the instructions to the processor. When the instructions are executed by the processor, the electronic device can perform the various functions or steps performed by the electronic device in the above method embodiment. Of course, the chip system can also include other discrete components, which are not specifically limited in the present application.

[0425] An embodiment of the present application further provides an electronic device, comprising a display screen. The electronic device is configured to perform the functions or steps performed by the electronic device in the aforementioned method embodiment. The electronic device may include a memory and one or more processors. The memory is configured to store a program, and when the processor executes the program, the electronic device is configured to perform the functions or steps performed by the electronic device in the aforementioned method embodiment.

[0426] The embodiment of the present application further provides a hub device, which includes a display screen and is used to execute the functions or steps executed by the electronic device in the above method embodiment.

[0427] An embodiment of the present application further provides a readable storage medium, which includes instructions. When the instructions are executed on the electronic device, the electronic device executes the functions or steps executed by the electronic device in the method embodiment.

[0428] An embodiment of the present application further provides a program product. When the program product is run on a first device, the first device is enabled to perform the functions or steps performed by the first device in the above method embodiment.

[0429] Among them, the equipment, devices, readable storage media, program products or chips provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0430] In the description of this application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, a and b and c, where a, b, and c can be single or multiple. In addition, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily mean different. In the embodiments of the present application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a concrete way for easy understanding. Some optional features in the embodiments of the present application can be implemented independently in some scenarios without relying on other features to solve corresponding technical problems and achieve corresponding effects. They can also be combined with other features according to needs in some scenarios. In this application, unless otherwise specified, the same or similar parts between the various embodiments can refer to each other. In the various embodiments of the present application, if there is no special explanation and logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced to each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships. The implementation methods of this application do not constitute a limitation on the scope of protection of this application.

[0431] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A device interaction method, characterized in that: The method comprises: Display a first interface, the first interface includes a first control and a second control, the first control indicates a first space, and the second control indicates a second space; In response to a first operation on the first interface, after the first control is enlarged and displayed, the second interface corresponding to the first control is switched to display, and the second interface includes m controls, each of the m controls is used to control at least one device in the first space, or to edit the status of at least one device in the first space, and m is a positive integer.

2. The method according to claim 1, characterized in that After displaying the second interface, the method further includes: In response to a second operation on the second interface, returning to displaying the first interface; or In response to a second operation on the second interface, the third interface is switched to be displayed, and the third interface includes a third control and a fourth control. The third control indicates the first space, and the fourth control indicates the second space.

3. The method according to claim 2, characterized in that After returning to displaying the first interface, the method further includes: In response to a third operation on the first interface, after the second control is displayed in an enlarged manner, a fourth interface corresponding to the second control is switched to display, the fourth interface includes n controls, each of the n controls is used to control at least one device in the second space, or edit the state of at least one device in the second space, and n is a positive integer; After switching to displaying the third interface, the method further includes: In response to the third operation on the third interface, after the fourth control is enlarged and displayed, the fourth interface corresponding to the fourth control is switched to display, and the fourth interface includes n controls, each of the n controls is used to control at least one device in the second space, or to edit the status of at least one device in the second space, and n is a positive integer.

4. The method according to any one of claims 1 to 3, characterized in that: The first operation is a multi-finger expand operation; or The first interface includes a first navigation bar, and the first operation is a first touch operation acting on the first navigation bar.

5. The method according to claim 2 or 3, characterized in that: The second operation is a multi-finger pinch operation; or The second interface includes a second navigation bar, and the second operation is a second touch operation acting on the second navigation bar.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: The fifth interface is displayed, and the fifth interface includes a fifth control, a sixth control and a first area, the fifth control indicates the first space, the sixth control indicates the second space, the first area is used to display controls corresponding to the spaces to be combined to generate smart scenes, and the fifth control and the sixth control are located in the first area.

7. The method according to claim 6, characterized in that After displaying the fifth interface, the method further includes: In response to a fourth operation on the fifth interface, a first scene is generated, where the first scene is used to control multiple devices in the first space and the second space.

8. The method according to claim 6 or 7, characterized in that: Before displaying the fifth interface, the method further includes: Displaying a sixth interface, the sixth interface including k controls located outside the first area and the first area, the k controls including the fifth control and the sixth control, where k is an integer greater than 1; In response to a user operation, in the sixth interface, the fifth control and the sixth control are moved into the first area.

9. The method according to claim 8, characterized in that The first interface further includes a seventh control. After displaying the first interface, the method further includes: In response to the operation on the seventh control, the sixth interface is displayed.

10. The method according to any one of claims 1 to 9, characterized in that: At least one of the m controls is located in a second area of ​​the second interface, and after displaying the second interface, the method further includes: When executing the first scene, the device in the first space associated with the at least one control in the second area is controlled to execute the first scene with preset parameters.

11. The method according to any one of claims 1 to 9, characterized in that: At least one of the m controls is located outside the second area of ​​the second interface, and after displaying the second interface, the method further includes: When executing the first scene, a device in the first space that is associated with the at least one control outside the second area is closed.

12. The method according to any one of claims 1 to 11, characterized in that: The m controls include an eighth control, and after displaying the second interface, the method further includes: In response to an operation on the eighth control, a parameter of at least one device associated with the eighth control is adjusted.

13. The method according to claim 12, characterized in that The method further comprises: In response to an operation on the eighth control, a display style of the eighth control is adjusted to adjust a parameter of at least one device associated with the eighth control.

14. The method according to claim 13, characterized in that The display style includes at least one of display content, control color, and control fill degree.

15. The method according to any one of claims 1 to 14, characterized in that: The first interface includes q controls, the q controls include the first control and the second control, the first control is located in the central area of ​​the area where the q controls are located, and q is an integer greater than 1; After displaying the first interface, the method further includes: In the first interface, move the second control to the central area where the first control is located; In response to the fifth operation on the first interface, after the second control is enlarged and displayed, the fourth interface corresponding to the second control is switched to display, and the fourth interface includes n controls, each of the n controls is used to control at least one device in the second space, or to edit the status of at least one device in the second space, and n is a positive integer.

16. The method according to any one of claims 1 to 15, characterized in that: The m controls include a ninth control, the ninth control indicating a plurality of devices of a first type in the first space, and after displaying the second interface, the method further includes: In response to the sixth operation on the second interface, the seventh interface corresponding to the ninth control is switched to be displayed, and the seventh interface includes multiple controls, and the multiple controls correspond to multiple devices of the first type. Each of the multiple controls is used to control a device of the first type, or to edit the status of a device of the first type.

17. The method according to claim 16, characterized in that After displaying the seventh interface, the method further includes: In response to the seventh operation on the seventh interface, returning to displaying the second interface; or In response to the seventh operation on the seventh interface, the eighth interface is switched to be displayed, and the eighth interface includes p controls, each of the p controls is used to control at least one device in the first space, or to edit the status of at least one device in the first space, and p is a positive integer.

18. The method according to claim 16 or 17, characterized in that The m controls further include a tenth control, the tenth control indicating a plurality of devices of a second type in the first space, and after displaying the second interface, the method further includes: In response to the sixth operation on the second interface, the seventh interface corresponding to the ninth control and the tenth control is switched to be displayed, and the seventh interface includes a third area and a fourth area, the multiple controls in the third area correspond to the multiple devices of the first type, and the multiple controls in the fourth area correspond to the multiple devices of the second type.

19. The method according to claim 17 or 18, characterized in that Before returning to displaying the second interface, or before switching to displaying the eighth interface, the method further includes: In response to a seventh operation on the seventh interface, the seventh interface is displayed in a reduced size.

20. The method according to any one of claims 2 to 19, characterized in that: Before returning to displaying the first interface, or before switching to displaying the third interface, the method further includes: In response to a second operation on the second interface, the second interface is displayed in a reduced size.

21. An electronic device, characterized in that: The electronic device comprises a memory and one or more processors; the memory is used to store a program, and when the processor executes the program, the electronic device executes the method as described in any one of claims 1-20.

22. A chip system, characterized in that: The chip system is applied to an electronic device; the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through lines; the interface circuit is used to receive a signal from a memory of the electronic device and send the signal to the processor, the signal including instructions stored in the memory; when the processor executes the instructions, the electronic device executes the method as described in any one of claims 1-20.

23. A readable storage medium, characterized in that: The invention comprises a program, and when the program is executed on an electronic device, the electronic device executes the method as claimed in any one of claims 1 to 20.

Images