Device control method and related apparatus

Abstract

Provided in the present application are a device control method and a related apparatus. In the method, when a user is viewing content displayed in a user interface 1 of an electronic device, such as a video playback picture, a video call picture and a karaoke interface, the user can quickly invoke a device control window. The electronic device can map buttons of a remote controller to control functions in corresponding scenarios on a one-to-one basis, and display, within the device control window and in the form of a button prompt, the control function that corresponds to each button. In this way, on the basis of button prompts, the user can know the control functions that respectively correspond to the buttons of the remote controller. In this way, the user can conveniently and quickly control the device by means of the remote controller, and the operation is simple. Moreover, during the process of controlling the device, the electronic device does not exit the user interface 1, such that the user can continue viewing the user interface 1. In this way, the user experience can be improved.

Description

Device control method and related device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on February 4, 2024, with application number 202410160443.0 and application name “A device control method and related devices”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to a device control method and related apparatus. Background Art

[0003] Currently, multiple smart devices used in the user's home can establish communication connections. Users can control multiple smart devices through the remote control that comes with the electronic device (for example, a smart screen) and the smart home application in the electronic device. For example, the user can use the remote control to select and enter the device control page in the electronic device. Then, select the target device from multiple smart devices for adjustment and control. However, the current operation of the remote control to control the target device is cumbersome, which will affect the user's normal use of the electronic device. Especially when the user uses an electronic device to watch a movie, if the user needs to control the target device through the remote control of the electronic device and the smart home application in the electronic device, the cumbersome operation process will affect the user's normal viewing. In this way, the user experience is poor.

[0004] Therefore, how to conveniently and quickly control a target device in an electronic device through a remote controller is an urgent problem to be solved. Summary of the Invention

[0005] The present application provides a device control method and related apparatus, through which, when an electronic device displays a first user interface (for example, a video playback interface), a user can conveniently and quickly control a target device in the electronic device through a remote control without affecting the user's viewing of the first user interface of the electronic device.

[0006] In a first aspect, the present application provides a device control method, which can be applied to a device control system, which may include an electronic device and a remote control device. The method may include: the electronic device displays a first user interface; the remote control device detects that a user presses a first button, and sends a first remote control signal to the electronic device; the electronic device receives and responds to the first remote control signal, and when a first scene is determined, a first window is displayed overlaid on the first user interface according to the first scene, the first window containing prompts corresponding to one or more buttons in the remote control device in the first scene, the prompts corresponding to the one or more buttons include a first prompt, and the first prompt is used to prompt a first function corresponding to a second button in the remote control device; the remote control device detects that a user presses a second button, and sends a second remote control signal to the electronic device; the electronic device receives and responds to the second remote control signal and executes the first function.

[0007] The first user interface may be a video playback interface.

[0008] Through the method provided in the first aspect above, when the electronic device displays the first user interface, the user can quickly call up the first window. The electronic device can map the buttons of the remote control device to the control functions in the corresponding scene one by one, and display the function corresponding to each button in the form of a button prompt in the first window. In this way, the user can know the functions corresponding to the buttons of the remote control device according to the button prompt. In this way, the user can control the device conveniently and quickly through the remote control device, and the operation is simple. Moreover, during the process of controlling the device, the electronic device will not jump out of the first user interface, and the user can continue to watch the first user interface, which can improve the user experience.

[0009] In combination with the first aspect, in a possible implementation, the method may further include: the electronic device receives and responds to a first remote control signal, and when a second scene is determined, displays a second window overlaid on the first user interface according to the second scene, the second window includes prompts corresponding to one or more buttons in the remote control device in the second scene, the prompts corresponding to the one or more buttons include a second prompt, and the second prompt is used to prompt a second function corresponding to the second button in the remote control device; the second function is different from the first function.

[0010] In this way, the functions corresponding to the buttons on the remote control device vary in different scenarios. Electronic devices can flexibly map the buttons on the remote control device to the device control functions in the current scenario based on the specific scenario. This allows for convenient and fast control of devices in different scenarios.

[0011] For example, the first scene may be a scene of controlling a first type of device (e.g., a desk lamp) in the user's location. The second scene may be a scene of controlling a second type of device (e.g., an air conditioner) in the user's location. Alternatively, the first scene may be a scene of controlling a first type of device in the user's first location. The second scene may also be a scene of controlling a first type of device in the user's second location. The embodiments of the present application do not specifically limit the first scene and the second scene.

[0012] In conjunction with the first aspect, in one possible implementation, before the electronic device receives and responds to the first remote control signal and displays the first window overlaying the first user interface, the method may further include: the remote control device detecting a user pressing a second button and transmitting a third remote control signal to the electronic device; and the electronic device receiving and responding to the third remote control signal and executing a third function, the third function being different from both the first and second functions. In this way, before the electronic device displays the first window, the user can control the electronic device normally using the remote control, for example, using the second button to switch programs, move a selection box, and so on.

[0013] In conjunction with the first aspect, in one possible implementation, the device control system may include a first device, wherein a first function is used to control the first device to turn on or off. The electronic device receives and responds to a second remote control signal to execute the first function, which may specifically include: the electronic device receives and responds to the second remote control signal and sends a first instruction to the first device, wherein the first instruction is used to instruct the first device to turn on or off. In this way, a user can directly control the first device to turn on or off using the second button.

[0014] In conjunction with the first aspect, in one possible implementation, the device control system may include a second device, and the second function is configured to control any one of turning the second device on or off, switching the operating mode of the second device, and increasing or decreasing the operating temperature of the second device. In this way, the user can directly use the second button of the remote control device to control any one of turning the second device on or off, switching the operating mode of the second device, and increasing or decreasing the operating temperature of the second device.

[0015] In conjunction with the first aspect, in one possible implementation, the electronic device receives and responds to a second remote control signal to execute a first function, specifically including: the electronic device obtains, based on the second remote control signal, the first function corresponding to a second button from a correspondence associated with a first scene, and executes the first function, wherein the correspondence associated with the first scene includes a correspondence between the second button and the first function. In this way, the electronic device can determine the function corresponding to the second button of the remote control device based on the first scene.

[0016] In conjunction with the first aspect, in one possible implementation, the electronic device receives and responds to the first remote control signal, and when determining a first scenario, overlays and displays a first window on the first user interface based on the first scenario. This may specifically include: the electronic device receives and responds to the first remote control signal, obtains a correspondence between the second button and the first function, and overlays and displays the first window on the first user interface. In this way, the electronic device can determine that, in the first scenario, the second button and the first function have a correspondence.

[0017] In conjunction with the first aspect, in one possible implementation, the electronic device receives and responds to a first remote control signal, and when determining a second scenario, overlays and displays a second window on the first user interface based on the second scenario. This may specifically include: the electronic device receives and responds to the first remote control signal, obtains a correspondence between a second button and a second function from a correspondence associated with the second scenario, and overlays and displays the second window on the first user interface, wherein the correspondence associated with the second scenario includes a correspondence between the second button and the second function. In this way, the electronic device can determine that, in the second scenario, the second button and the second function have a correspondence.

[0018] In combination with the first aspect, in one possible implementation, before the remote control device detects that a user presses a first button and sends a first remote control signal to the electronic device, the method may further include: the remote control device detects that a user presses a third button and sends a fourth remote control signal to the electronic device; the electronic device receives and responds to the fourth remote control signal, and displays a third window overlaid on the first user interface, wherein the third window includes a first option, and the first option is used to provide an entrance to the first window or the second window.

[0019] In conjunction with the first aspect, in one possible implementation, the first window or the second window is a transparent window. In this way, the first window or the second window does not block the first user interface, does not affect the user's continued viewing of the first user interface, and can improve the user experience.

[0020] In conjunction with the first aspect, in one possible implementation, the first window or the second window is overlaid on the first user interface in a semi-modal manner. The fact that the first window and the second window are overlaid on the first user interface in a semi-modal manner does not mean that the first window and the second window occupy half of the first user interface, but rather that the size of the first window or the second window is smaller than the size of the first user interface. In this way, the first window or the second window will not completely block the first user interface, and will not affect the user's continued viewing of the first user interface, thereby improving the user experience.

[0021] In a second aspect, a device control method is provided, which can be applied to an electronic device. The method may include: the electronic device displays a first user interface; the electronic device receives and responds to a first remote control signal, and when a first scene is determined, displays a first window overlaid on the first user interface according to the first scene, wherein the first remote control signal is sent to the electronic device after the remote control device detects that a user has pressed a first button, and the first window contains prompts corresponding to one or more buttons on the remote control device in the first scene, wherein the prompts corresponding to the one or more buttons include a first prompt, and the first prompt is used to indicate a first function corresponding to a second button on the remote control device; and the electronic device receives and responds to a second remote control signal to execute the first function, wherein the second remote control signal is sent to the electronic device after the remote control device detects that the user has pressed the second button.

[0022] The first user interface may be a video playback interface.

[0023] Through the method provided in the second aspect above, when the electronic device displays the first user interface, the user can quickly call up the first window. The electronic device can map the buttons of the remote control device to the control functions in the corresponding scene one by one, and display the function corresponding to each button in the form of a button prompt in the first window. In this way, the user can know the functions corresponding to the buttons of the remote control device according to the button prompt. In this way, the user can control the device conveniently and quickly through the remote control device, and the operation is simple. Moreover, during the process of controlling the device, the electronic device will not jump out of the first user interface, and the user can continue to watch the first user interface, which can improve the user experience.

[0024] In combination with the second aspect, in a possible implementation, the method may further include: the electronic device receives and responds to a first remote control signal, and when a second scene is determined, a second window is displayed overlaid on the first user interface according to the second scene, and the second window includes prompts corresponding to one or more buttons in the remote control device in the second scene, and the prompts corresponding to the one or more buttons include a second prompt, and the second prompt is used to prompt a second function corresponding to the second button in the remote control device; the second function is different from the first function.

[0025] In this way, the functions corresponding to the buttons on the remote control device vary in different scenarios. Electronic devices can flexibly map the buttons on the remote control device to the device control functions in the current scenario based on the specific scenario. This allows for convenient and fast control of devices in different scenarios.

[0026] For example, the first scene may be a scene of controlling a first type of device (e.g., a desk lamp) in the user's location. The second scene may be a scene of controlling a second type of device (e.g., an air conditioner) in the user's location. Alternatively, the first scene may be a scene of controlling a first type of device in the user's first location. The second scene may also be a scene of controlling a first type of device in the user's second location. The embodiments of the present application do not specifically limit the first scene and the second scene.

[0027] In conjunction with the second aspect, in one possible implementation, before the electronic device receives and responds to the first remote control signal and displays the first window overlaying the first user interface, the method may further include: the electronic device receiving and responding to a third remote control signal to execute a third function, the third function being different from both the first and second functions, and the third remote control signal being sent to the electronic device after the remote control device detects a user pressing a second button. In this way, before the electronic device displays the first window, the user can control the electronic device normally using the remote control, for example, using the second button to switch programs, move a selection box, and so on.

[0028] In conjunction with the second aspect, in one possible implementation, the device control system may include a first device, wherein the first function is to control the first device to turn on or off. The electronic device receives and responds to the second remote control signal to perform the first function, which may specifically include: the electronic device receives and responds to the second remote control signal and sends a first instruction to the first device, wherein the first instruction is to instruct the first device to turn on or off. In this way, the user can directly control the first device to turn on or off using the second button.

[0029] In conjunction with the second aspect, in one possible implementation, the device control system may include a second device, and the second function is configured to control any one of turning the second device on or off, switching the operating mode of the second device, and increasing or decreasing the operating temperature of the second device. In this way, the user can directly use the second button of the remote control device to control any one of turning the second device on or off, switching the operating mode of the second device, and increasing or decreasing the operating temperature of the second device.

[0030] In conjunction with the second aspect, in one possible implementation, the electronic device receives and responds to a second remote control signal to execute a first function, specifically including: the electronic device obtains, based on the second remote control signal, the first function corresponding to a second button from a correspondence associated with a first scene, and executes the first function, wherein the correspondence associated with the first scene includes a correspondence between the second button and the first function. In this way, the electronic device can determine the function corresponding to the second button of the remote control device based on the first scene.

[0031] In conjunction with the second aspect, in one possible implementation, the electronic device receives and responds to the first remote control signal, and when determining a first scenario, overlays and displays a first window on the first user interface based on the first scenario. This may specifically include: the electronic device receives and responds to the first remote control signal, obtains a correspondence between the second button and the first function, and overlays and displays the first window on the first user interface. In this way, the electronic device can determine that, in the first scenario, the second button and the first function have a correspondence.

[0032] In conjunction with the second aspect, in one possible implementation, the electronic device receives and responds to a first remote control signal, and when determining a second scenario, overlays and displays a second window on the first user interface based on the second scenario. This may specifically include: the electronic device receives and responds to the first remote control signal, obtains a correspondence between a second button and a second function from a correspondence associated with the second scenario, and overlays and displays the second window on the first user interface, wherein the correspondence associated with the second scenario includes a correspondence between the second button and the second function. In this way, the electronic device can determine that, in the second scenario, the second button and the second function have a correspondence.

[0033] In combination with the second aspect, in one possible implementation, before the electronic device receives and responds to the first remote control signal, the method may also include: the electronic device receives and responds to the fourth remote control signal, overlaying and displaying a third window on the first user interface, the third window including a first option, the first option being used to provide an entrance to the first window or the second window, and the fourth remote control signal is sent to the electronic device when the remote control device detects that the user presses the third button.

[0034] In conjunction with the second aspect, in one possible implementation, the first window or the second window is a transparent window. In this way, the first window or the second window will not block the first user interface, and will not affect the user's continued viewing of the first user interface, which can improve the user experience.

[0035] In conjunction with the second aspect, in one possible implementation, the first window or the second window is overlaid on the first user interface in a semi-modal manner. The fact that the first window and the second window are overlaid on the first user interface in a semi-modal manner does not mean that the first window and the second window occupy half of the first user interface, but rather that the size of the first window or the second window is smaller than the size of the first user interface. In this way, the first window or the second window will not completely block the first user interface, which will not affect the user's continued viewing of the first user interface, thereby improving the user experience.

[0036] In a third aspect, an electronic device is provided, which may include a display screen, one or more processors and one or more memories; wherein the display screen, the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the method involved in any possible implementation method of the first aspect.

[0037] In a fourth aspect, a chip system is provided, which is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute the method involved in any possible implementation method of the first aspect.

[0038] In a fifth aspect, a computer-readable storage medium is provided, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute the method involved in any possible implementation of the first aspect.

[0039] In a sixth aspect, a computer program product is provided. When the program product is run on an electronic device, the electronic device executes the method involved in any possible implementation manner of the first aspect.

[0040] It is understandable that the electronic device provided in the third aspect, the chip system provided in the fourth aspect, the computer storage medium provided in the fifth aspect, and the computer program product provided in the sixth aspect are all used to perform the methods provided in this application. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] FIG1 is a schematic diagram of a home scene provided in an embodiment of the present application;

[0042] FIG2 is a schematic diagram of buttons of a remote control 101 and a user interface of an electronic device 100 provided in an embodiment of the present application;

[0043] FIG3 is a schematic diagram of buttons of a remote control 101 and a user interface of an electronic device 100 provided in an embodiment of the present application;

[0044] FIG4 is a schematic diagram of a user interface of the electronic device 100 provided in an embodiment of the present application;

[0045] FIG5 is a schematic diagram of a user interface of the electronic device 100 provided in an embodiment of the present application;

[0046] FIG6 is a schematic diagram of a user interface of a mobile phone 600 provided in an embodiment of the present application;

[0047] FIG7 is a schematic diagram of a user interface of a control device 700 provided in an embodiment of the present application;

[0048] FIG8 is a schematic diagram of buttons of a remote controller 101 and a user interface of an electronic device 100 provided in an embodiment of the present application;

[0049] FIG9 is a schematic diagram of a user interface of an electronic device 100 provided in an embodiment of the present application;

[0050] FIG10 is a schematic diagram of buttons of a remote control 101 and a user interface of an electronic device 100 provided in an embodiment of the present application;

[0051] FIG11 is a schematic diagram of buttons of a remote control 101 and a user interface of an electronic device 100 provided in an embodiment of the present application;

[0052] FIG12 is a schematic diagram of buttons of a remote control 101 and a user interface of an electronic device 100 provided in an embodiment of the present application;

[0053] FIG13 is a schematic diagram of buttons of a remote control 101 and a user interface of an electronic device 100 provided in an embodiment of the present application;

[0054] FIG14 is a schematic diagram of a user interface of an electronic device 100 provided in an embodiment of the present application;

[0055] FIG15 is a schematic diagram of a user interface of an electronic device 100 provided in an embodiment of the present application;

[0056] FIG16 is an interactive diagram of a device control method provided by an embodiment of the present application;

[0057] FIG17 is an interactive diagram of a device control method provided by an embodiment of the present application;

[0058] FIG18 is a flow chart of a device control method provided in an embodiment of the present application;

[0059] FIG19 is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0061] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and appended claims of this application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless the context clearly indicates otherwise. The terms "first" and "second" are used for descriptive purposes only and are not to be understood as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. "First" and "second" etc. are used to distinguish different objects, rather than to describe a specific order of objects. For example, the first object and the second object are used to distinguish different objects, rather than to describe a specific order of objects.

[0062] In the description of the embodiments of this application, unless otherwise specified, "a plurality" means two or more. For example, a plurality of processing units refers to two or more processing units; a plurality of systems refers to two or more systems.

[0063] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0064] The term "and / or" in this application is simply a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0065] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0066] Currently, various devices in homes or offices can be built into smart home systems. One or more devices in a smart home system (for example, smart screens, mobile phones, tablets, etc.) can control other devices in the smart home system (for example, table lamps, air conditioners, etc.). The embodiments of this application are explained by taking various devices in a home (for example, smart screens, table lamps, etc.) to build a smart home system as an example.

[0067] The following first introduces a home scenario of device control provided by an embodiment of the present application.

[0068] Figure 1 exemplarily shows a schematic diagram of a home scene 10. As shown in Figure 1 , the home scene 10 may include an electronic device 100, a remote control 101, a desk lamp 102, a humidifier 103, a speaker 104, a treadmill 105, a desk lamp 106, an air conditioner 107, a camera 108, a desk lamp 109, an air conditioner 110, and a soymilk maker 111.

[0069] In this home scene 10, devices such as a desk lamp 102, a humidifier 103, a speaker 104, a treadmill 105, a desk lamp 106, an air conditioner 107, a camera 108, a desk lamp 109, an air conditioner 110, and a soybean milk machine 111 can establish a communication connection with the electronic device 100. Among them, devices such as the desk lamp 102, the humidifier 103, the speaker 104, the treadmill 105, the desk lamp 106, the air conditioner 107, the camera 108, the desk lamp 109, the air conditioner 110, and the soybean milk machine 111 can establish a communication connection with the electronic device 100 through Bluetooth, peer to peer (P2P), or logging in to the same account. The embodiment of the present application does not limit the manner in which devices such as the desk lamp 102, the humidifier 103, the speaker 104, the treadmill 105, the desk lamp 106, the air conditioner 107, the camera 108, the desk lamp 109, the air conditioner 110, and the soybean milk machine 111 establish a communication connection with the electronic device 100.

[0070] The remote control 101 can control the electronic device 100. Based on the control instructions of the remote control 101, the electronic device 100 can control and adjust devices such as the desk lamp 102, the humidifier 103, the audio 104, the treadmill 105, the desk lamp 106, the air conditioner 107, the camera 108, the desk lamp 109, the air conditioner 110 and the soymilk maker 111. For example, the electronic device 100 can control the desk lamp 102 to turn off based on the instruction of the remote control 101 to turn off the desk lamp 102. The electronic device 100 can turn on the desk lamp 102 based on the instruction of the remote control to turn on the desk lamp 102. Regarding how the electronic device 100 controls and adjusts other devices in the home scene 10, please refer to the description below, which will not be repeated here.

[0071] Optionally, in some instances, the home scene 10 may also include devices such as mobile phones, tablets, and computers. Users may also control and adjust devices such as a desk lamp 102, a humidifier 103, a speaker 104, a treadmill 105, a desk lamp 106, an air conditioner 107, a camera 108, a desk lamp 109, an air conditioner 110, and a soymilk maker 111 through any of the mobile phones, tablets, and computers.

[0072] It will be understood that the home scene 10 shown in the embodiment of the present application is merely an example, and the home scene 10 may include more or fewer devices than shown in FIG1 , and the embodiment of the present application does not limit this.

[0073] The electronic device 100 can be a television, a large-screen device, a smart screen, or the like. The embodiment of the present application does not limit the specific type of device of the electronic device 100.

[0074] The following describes how a user can control and adjust other devices through one device with reference to the accompanying drawings.

[0075] In a possible implementation, the user can call out the smart home control interface in the electronic device 100 through the remote controller 101. The user can select a target device in the smart home control interface to control and adjust it.

[0076] 2 to 4 show a set of user interface schematic diagrams for a user to control a desk lamp via the electronic device 100 .

[0077] As shown in FIG2 , the electronic device 100 can display a user interface 200. The user interface 200 can be a video playback interface. The remote control 101 can include a confirmation key 220, a right key 221, an up key 222, a left key 223, a down key 224, and a control center key 225. The remote control 101 can also include other keys, such as a return key, a power off key, and volume up / down keys, etc., which are not limited in this embodiment of the present application.

[0078] In some instances, the confirmation key 220 may also be referred to as the OK key 220. The right key 221 may also be referred to as the right direction key 221. The up key 222 may also be referred to as the up direction key 222. The left key 223 may also be referred to as the left direction key 223. The down key 224 may also be referred to as the down direction key 224. The embodiments of the present application do not limit the specific names of the keys in the remote control 101.

[0079] The user may press the control center key in the remote controller 101 . In response to the user operation, the remote controller 101 may send a command 1 to the electronic device 100 . In response to the command 1 , the electronic device 100 may display a user interface 300 .

[0080] As shown in FIG3 , the electronic device 100 may display a user interface 300. The user interface 300 may be a control interface in a smart home application. The control interface may be used to control and adjust devices that establish a communication connection with the electronic device 100, such as the table lamp 102, humidifier 103, speaker 104, treadmill 105, table lamp 106, air conditioner 107, camera 108, table lamp 109, air conditioner 110, and soymilk maker 111 in the aforementioned home scene 10.

[0081] As shown in Figure 3, the user interface 300 may include the name of the smart home location 301, air quality information 302, temperature information 303, air humidity information 304, controls 305, smart scene options 306, smart scene options 307, smart scene options 308, smart scene options 309, device control options 310, device control options 311, device control options 312, device control options 313, device control options 314, device control options 315, device control options 316 and device control options 317.

[0082] The smart home location name 301 may be used to indicate the location of multiple devices that the electronic device 100 can currently control and adjust. For example, as shown in FIG3 , the content of the smart home location name 301 may be "Flora's Home." This embodiment of the present application does not limit the content of the smart home location name 301.

[0083] Optionally, the smart home location name 301 may further include information about the number of devices in the current location and information about the number of smart scenes. For example, the number of devices may include "10 devices" and the number of smart scenes may include "4 smart scenes."

[0084] Among them, air quality information 302 can be used to indicate the air quality at the location of electronic device 100, for example, the air quality in the living room is excellent. Temperature information 303 can be used to indicate the temperature at the location of electronic device 100, for example, the temperature in the living room is 20°C. Air humidity information 304 can be used to indicate the air humidity at the location of electronic device 100, for example, the air humidity in the living room is 6%. It will be understood that the specific air quality, temperature, air humidity, etc. shown in user interface 300 are merely examples and are not limited to these in the embodiments of the present application.

[0085] Among them, control 305 can be used to provide more device control options.

[0086] Among them, when the user selects the smart scene option 306, the electronic device 100 can control all devices according to the scene of the user returning home, for example, turning on all lighting devices. When the user selects the smart scene option 307, the electronic device 100 can control all devices according to the scene of the user leaving home, for example, turning off all devices. When the user selects the smart scene option 308, the electronic device 100 can control all devices according to the scene of the user sleeping, for example, turning off all lighting devices. When the user selects the smart scene option 309, the electronic device 100 can control all devices according to the scene of the user watching a movie, for example, turning on the audio equipment, closing the curtains, turning off the living room lighting equipment, etc. The embodiment of the present application does not limit how to control all devices in different smart scenes.

[0087] Device control options 310 can be used to control and adjust desk lamp 102. Device control options 310 can include one or more of a device name 3101, device status and location information 3102, a device icon 3103, and controls 3104. Device name 3101 can specifically be "Desk lamp 102." Device status and location information 3102 can indicate that desk lamp 102 is on and located in the living room. Controls 3104 can be used to turn desk lamp 102 on or off.

[0088] Device control option 311 can be used to control and adjust the humidifier 103. Device control option 312 can be used to control and adjust the audio 104. Device control option 313 can be used to control and adjust the treadmill 105. Device control option 314 can be used to control and adjust the desk lamp 106. Device control option 315 can be used to control and adjust the air conditioner 107. Device control option 316 can be used to control and adjust the camera 108.

[0089] In one possible implementation, the user interface 300 may further include more device control options, for example, a device control option for controlling the air conditioner 110 and a device control option for controlling the soymilk maker 111. The user may view more device control options on the user interface 300 by pressing the down button 224 of the remote control 101.

[0090] The user interface 300 may include more or fewer interface elements, which is not limited in this embodiment of the present application.

[0091] Taking the control and adjustment of the desk lamp 102 as an example, the user can select the device control option 310 through the remote controller 101. In response to the user operation, the electronic device 100 can display a user interface 400 for controlling and adjusting the desk lamp 102.

[0092] As shown in Figure 4, a user interface 400 may be displayed in the electronic device 100. The user interface 400 may be used to control and adjust the desk lamp 102. The user interface 400 may include an option box 401. The option box 401 may include a power control option 402, a mode option 403, a brightness option 404, and a color option 405. The power control option 402 may be used to control whether the desk lamp 102 is turned on or off. The mode option 403 may be used to select the operating mode of the desk lamp 102. The operating modes of the desk lamp 102 are not limited to computer mode, reading mode, and writing mode. The brightness option 404 may be used to adjust the brightness of the desk lamp 102. The color option 405 may be used to set the light color of the desk lamp 102.

[0093] Optionally, the option box 401 may also include a prompt message 406. The prompt message 406 may prompt the user to control the desk lamp 102, all desk lamps in the user's location, or desk lamps in a specified area, etc., through voice commands. For example, the specific content of the prompt message 406 may include: "Try saying, 'Xiaoyi, Xiaoyi, turn on the lights,' 'Turn on all desk lamps,' 'Turn off the bedroom lights.'" This embodiment of the application does not limit the specific content of the prompt message 406.

[0094] The process of controlling other devices in the user's location through the electronic device 100 shown in Figures 2 to 4 is relatively cumbersome. Moreover, when the user is watching a movie on the electronic device 100, the electronic device 100 will switch from displaying the video playback interface to displaying the smart home control interface, which will affect the user's viewing experience.

[0095] In another possible implementation, the user can call out the smart home control window in the electronic device 100 through the remote control 101. The smart home control window is displayed on the video playback interface of the electronic device 100, and the smart home control window only covers a portion of the video playback interface.

[0096] For example, when the electronic device 100 displays the user interface 200 as shown in FIG. 2 , the user may press the control center key 225 in the remote controller 101 , and the electronic device 100 may display the control window 501 .

[0097] As shown in Figure 5, the electronic device 100 can overlay a control window 501 on the user interface 200. The user interface 200 is a video playback interface, and the user interface 200 displays a playback screen of a video (for example, episode 2 of the TV series xx). The control window 501 can be used to control devices in the user's location. The control window 501 may include common scene options 502, common scene options 503, common scene options 504, common scene options 505, common scene options 506, and common scene options 507. The user can control multiple devices in the user's location through the common scene options 502, common scene options 503, common scene options 504, common scene options 505, common scene options 506, and common scene options 507. Common scene options 502, common scene options 503, common scene options 504, common scene options 505, common scene options 506, and common scene options 507. The user can use common scene option 502 , common scene option 503 , common scene option 504 , common scene option 505 , common scene option 506 and common scene option 507 to combine and adjust and control multiple devices in the user's place according to preset scenes.

[0098] For example, when the user selects common scene option 502, the electronic device 100 can control devices in the user's location according to a movie-time scenario. For example, the electronic device 100 can close the curtains, turn off all lights in the living room, and turn on the stereo. When the user selects common scene option 503, the electronic device 100 can control devices in the user's location according to a party-time scenario. For example, the electronic device 100 can close the curtains, turn on all ambient lights and colored lights in the living room, and turn on the stereo. When the user selects common scene option 504, the electronic device 100 can control devices in the user's location according to a morning wake-up mode. For example, the electronic device 100 can open all curtains and turn on lights in the kitchen and bathroom. When the user selects common scene option 505, the electronic device 100 can set devices in the user's location according to a nighttime sleep mode. For example, the electronic device 100 can turn off all lights, close the curtains, turn off the stereo, and turn on the air conditioner. When the user selects common scene option 506, the electronic device 100 can set devices in the user's location according to a dinner mode. For example, the electronic device 100 can turn on the lights in the dining room and turn off the lights and air conditioner in the living room. When the user selects the common scene option 507, the electronic device 100 can set the devices in the user's place according to the away mode. For example, the electronic device 100 can turn off all lights, turn off all air conditioners, etc.

[0099] In this way, the user can control other devices in the room while watching a movie on the electronic device 100, without pausing the video playing on the electronic device 100. However, the electronic device 100 can only control multiple devices in the user's room in a combination of preset modes. The electronic device 100 cannot further adjust or control individual devices. For example, the user cannot individually turn the desk lamp 106 on or off.

[0100] In another possible implementation, while a user is watching a video played by electronic device 100, the user can control other devices in the user's location through other devices. For example, the user can control the devices in the user's location through mobile phone 600. Figure 6 exemplarily shows a user interface 601 of mobile phone 600. The user interface 601 may display device control options for controlling various devices. For another example, the user can also control the devices in the user's location through control device 700. Figure 7 exemplarily shows a user interface 701 of control device 700. The user interface 701 may display device control options for controlling various devices.

[0101] In this way, the user of electronic device 100 can control the devices in the room through other devices without exiting the video playback interface. However, when the user controls the devices in the room through other devices, the user's sight needs to shift from the video playback interface of electronic device 100 to the control interface of the other device, and the user cannot watch the video playing on electronic device 100 at the same time. This affects the user's viewing experience.

[0102] When a user is watching a movie, in order to reduce the impact of the user's control and adjustment of the devices in the user's location on the user's viewing experience, an embodiment of the present application provides a device control method. In the device control method, when a user is watching a video played by an electronic device 100, the user can quickly call up the device control interface in the electronic device 100 through a remote control, quickly adjust and control the target device through the remote control, and quickly return to the viewing scene.

[0103] The following describes, with reference to the accompanying drawings, how a user, in a device control method provided in an embodiment of the present application, instructs the electronic device 100 through the remote control 101 to control and adjust the target device while playing a video.

[0104] 8 to 15 exemplarily illustrate relevant user interface diagrams in which a user instructs the electronic device 100 to control and adjust a target device while playing a video through the remote control 101 .

[0105] For example, when the electronic device 100 displays the user interface 200 shown in FIG. 2 , the user may press the control center key 225 in the remote controller 101 , and the electronic device 100 may display a setting window on the video playback screen of the user interface 200 .

[0106] As shown in Figure 8, the user interface 200 displays a video playback screen (for example, "XX TV Series Episode 2"). The electronic device 100 can overlay a setting window 801 on the user interface 200. The setting window 801 may include smart life options 802. The setting window 801 may also include setting controls, brightness adjustment controls, search controls, notification message cards, music playback cards, etc., which are not described in detail in this application.

[0107] The user can select the smart life option 802 via the remote control 101 (e.g., by pressing one or more of the right button 221, the up button 222, the left button 223, and the down button 224), and then select the smart life control window via the remote control 101 (e.g., by pressing the confirmation button 220). In response to this user operation, the electronic device 100 can display the smart life control window 901.

[0108] As shown in FIG9 , the electronic device 100 may overlay a smart life control window 901 on the user interface 200. The smart life control window 901 may float on the video playback screen displayed in the user interface 200. The size of the smart life control window 901 may be smaller than the size of the user interface 200.

[0109] As shown in Figure 9, the smart life control window 901 may include common scene options 902, common scene options 903, common scene options 904, common scene options 905, device information prompt card 906, device control options 907, and device control options 908. When the user selects common scene option 902, the electronic device 100 can set the devices in the user's location according to the movie viewing scene. For example, the electronic device 100 can close the curtains, turn off all lights in the living room, and turn on the audio system. When the user selects common scene option 903, the electronic device 100 can set the devices in the user's location according to party entertainment mode. For example, the electronic device 100 can close the curtains, turn on all ambient lights and colored lights in the living room, and turn on the audio system. When the user selects common scene option 904, the electronic device 100 can set the devices in the user's location according to meeting mode. For example, the electronic device 100 can open the door, open the curtains, turn off the music, and so on. When the user selects common scene option 905, the electronic device 100 can display more common scene options.

[0110] Optionally, the user can customize the devices that need to be controlled and adjusted in different common scenarios in the smart life application of the electronic device 100 or other devices. That is, in different scenarios, the electronic device 100 needs to control which devices to adjust, and how to control and adjust the devices can be customized by the user. Alternatively, the electronic device 100 needs to control which devices to adjust, and how to control and adjust the devices in different scenarios can also be configured by the electronic device 100 system. This embodiment of the application is not limited to this.

[0111] Among them, the device information prompt card 906 can be used to prompt the device that is currently working. For example, the device information prompt card 906 may include a device name 9061, device information 9062, and a remaining working time 9063. Among them, the device name 9061 can be used to indicate the name of the device that is currently working, for example, the soymilk maker 111. The device information 9062 can be used to indicate the working mode and location of the device that is currently working. For example, the working mode of the soymilk maker 111 can be "soymilk mode", and the location of the soymilk maker 111 can be the kitchen. The remaining working time 9063 can be used to indicate the remaining working time of the device that is currently working. For example, the remaining working time of the soymilk maker 111 is "9:32 (i.e., 9 minutes and 32 seconds)". That is to say, after 9 minutes and 32 seconds, the soymilk maker 111 will finish making soymilk.

[0112] Among them, the device control option 907 can be used to provide an entry to the control and adjustment window of the air conditioner. The device control option 907 may include text information 9071. The text information 9071 can be used to indicate the status (e.g., turned on) of the air conditioner in the user's location (e.g., the living room). For example, the specific content of the text information 9071 may be "The living room air conditioner is turned on." The specific content of the text information 9071 is not limited in this embodiment of the application.

[0113] Among them, the device control option 908 can be used to provide access to the control and adjustment window of the lighting device (e.g., a desk lamp). The device control option 908 may include text information 9081. The text information 9081 can be used to indicate the status of the lighting device in the user's location (e.g., the living room). For example, the specific content of the text information 9081 may be "2 lights in the living room are turned on." The specific content of the text information 9081 is not limited in this embodiment of the application.

[0114] The device control options 907 and 908 displayed in the smart life control window 901 can be the two most frequently used device control options, or can be the most recently used device control options. Alternatively, the distance between the device control options 907 and 908 and the electronic device 100 is closer than the distance between other devices and the electronic device 100, which is not limited in this embodiment of the present application. The smart life control window 901 can include more or fewer interface elements, which is not limited in this embodiment of the present application.

[0115] For example, when the user wants to control and adjust the lighting device in the place where the user is located, the user can select the device control option 908. In response to the user operation, the electronic device 100 can display a control window for the lighting device in the video playback interface.

[0116] As shown in FIG10 , the electronic device 100 can overlay a lighting device control window 1001 on the video playback screen of the user interface 200. The lighting device control window 1001 may include a remote control image 1002. The remote control image 1002 may include key prompts corresponding to multiple buttons on the remote control 101 in lighting device control scene 1. For example, as shown in FIG10 , the remote control image 1002 may include a key prompt 1003 corresponding to the left button 223 of the remote control 101, a key prompt 1004 corresponding to the up button 222 of the remote control 101, a key prompt 1005 corresponding to the right button 223 of the remote control 101, and a key prompt 1006 corresponding to the confirm button 220 of the remote control 101.

[0117] The key prompt 1003 can be a prompt in text form, such as "desk lamp 106" and "turned on". The embodiment of the present application does not limit the specific text content contained in the key prompt 1003. The key prompt 1003 can be used to prompt the user that the desk lamp 106 can be turned on or off by the left key 223 of the remote control 101, as well as the current status of the desk lamp 106 (for example, turned on). Specifically, the user can press the left key 223. In response to the user operation, the remote control 101 can send a remote control signal 1 to the electronic device 100. After receiving the remote control signal 1, the electronic device 100 first determines that the remote control signal 1 is a signal for turning the desk lamp 106 on or off. Then, if the electronic device 100 determines that the current status of the desk lamp 106 is turned on, the electronic device 100 can turn off the desk lamp 106. If the electronic device 100 determines that the current status of the desk lamp 106 is turned off, the electronic device 100 can turn on the desk lamp 106.

[0118] The key prompt 1004 can be a prompt in text form, such as "desk lamp 102" and "turned on". The embodiment of the present application does not limit the specific text content contained in the key prompt 1004. The key prompt 1004 can be used to prompt the user that the desk lamp 102 can be turned on or off by using the upper key 222 of the remote control 101, as well as the current status of the desk lamp 102 (for example, turned on). Specifically, the user can press the upper key 222, and in response to the user operation, the remote control 101 can send a remote control signal 2 to the electronic device 100. After receiving the remote control signal 2, the electronic device 100 first determines that the remote control signal 2 is a signal for turning the desk lamp 102 on or off. Then, if the electronic device 100 determines that the current status of the desk lamp 102 is turned on, the electronic device 100 can turn off the desk lamp 102. If the electronic device 100 determines that the current status of the desk lamp 102 is turned off, the electronic device 100 can turn on the desk lamp 102.

[0119] The key prompt 1005 can be a prompt in text form, such as "desk lamp 109" and "turned off". The embodiment of the present application does not limit the specific text content contained in the key prompt 1005. The key prompt 1005 can be used to prompt the user that the desk lamp 109 can be turned on or off, and the current status of the desk lamp 109 (for example, turned off) through the right key 221 of the remote control 101. Specifically, the user can press the right key 221, and in response to the user operation, the remote control 101 can send a remote control signal 3 to the electronic device 100. After receiving the remote control signal 3, the electronic device 100 can first determine that the remote control signal 3 is a signal for turning the desk lamp 109 on or off. Then, if the electronic device 100 determines that the current status of the desk lamp 109 is turned off, the electronic device 100 can turn on the desk lamp 109. If the electronic device 100 determines that the current status of the desk lamp 109 is turned on, the electronic device 100 can turn off the desk lamp 109.

[0120] The key prompt 1006 may be a text-based prompt combined with an icon, such as "All Lights Off" and a power control icon. The present embodiment does not limit the specific text content or icon style (e.g., shape, size, color) of the key prompt 1006. The key prompt 1006 may be used to prompt the user that they can use the confirmation key 220 of the remote control 101 to turn all lighting devices in the user's location on or off, as well as the current control state of the confirmation key 220 (e.g., all lights off). When the current control state of the confirmation key 220 is all lights off, the user can use the confirmation key 220 to turn off all lighting devices in the user's location (e.g., table lamp 106, table lamp 102, and table lamp 109). When the current control state of the confirmation key 220 is all lights on, the user can use the confirmation key 220 to turn on all lighting devices in the user's location (e.g., table lamp 106, table lamp 102, and table lamp 109). Specifically, the user can press the confirmation key 220, and in response to the user's operation, the remote control 101 can send a remote control signal 4 to the electronic device 100. After receiving the remote control signal 4, the electronic device 100 may first determine that the remote control signal 4 is a signal for controlling all lighting devices. Then, if the electronic device 100 determines that the current control state of the confirmation key 220 is all lights off, the electronic device 100 may turn off all lighting devices in the user's location. If the electronic device 100 determines that the current control state of the confirmation key 220 is all lights on, the electronic device 100 may turn off all lighting devices in the user's location.

[0121] Optionally, in a possible implementation, the control window 1001 of the lighting device may be a transparent window. In this way, the user can also see the portion of the video playback screen covered by the control window 1001 of the lighting device.

[0122] Optionally, in a possible implementation, the remote control image 1002 may further include a signal prompt 1007. The signal prompt 1007 may be used to prompt the electronic device 100 that the electronic device 100 currently receives a remote control signal from the remote control 101.

[0123] For example, the lighting device control scene 1 is that there are three lighting devices in the user's place: table lamp 106, table lamp 102 and table lamp 109. The user's place can refer to the entire home (including the kitchen, living room and room) in the home scene 10 shown in Figure 1.

[0124] It is understandable that in different scenarios, the button prompts in the control window displayed by the electronic device 100 may be different.

[0125] For example, embodiments of the present application may also include lighting device control scenario 2. In lighting device control scenario 2, the user's location may also include four lighting devices. For example, a main light, a decorative light, a colored light, and a dining light. In a scenario where the user's location includes main lights, decorative lights, colored lights, and dining lights, when the user selects device control option 908, the electronic device 100 may display a lighting device control window 1101 in response to the user's operation.

[0126] As shown in FIG11 , the electronic device 100 may overlay a lighting device control window 1101 on the video playback screen of the user interface 200. The lighting device control window 1101 may include a remote control image 1102. The remote control image 1102 may include key prompts corresponding to multiple keys of the remote control 101 in the lighting device control scene 2. For example, as shown in FIG11 , the remote control image 1102 may include a key prompt 1103 corresponding to the left key 223 of the remote control 101, a key prompt 1104 corresponding to the up key 222 of the remote control 101, a key prompt 1105 corresponding to the right key 221 of the remote control 101, a key prompt 1106 corresponding to the confirm key 220 of the remote control 101, and a key prompt 1107 corresponding to the down key 224 of the remote control 101.

[0127] The key prompt 1103 can be a prompt in text form, such as "decorative lights" and "turned off". The embodiment of the present application does not limit the specific text content contained in the key prompt 1103. The key prompt 1103 can be used to prompt the user that the decorative lights can be turned on or off by the left key 223 of the remote control 101, as well as the current status of the decorative lights (for example, turned off). Specifically, the user can press the left key 223. In response to the user operation, the remote control 101 can send a remote control signal 1 to the electronic device 100. After receiving the remote control signal 1, the electronic device 100 first determines that the remote control signal 1 is a signal for controlling the decorative lights to be turned on or off. Then, if the electronic device 100 determines that the current status of the decorative lights is turned off, the electronic device 100 can turn on the decorative lights. If the electronic device 100 determines that the current status of the decorative lights is turned on, the electronic device 100 can turn off the decorative lights.

[0128] The button prompt 1104 can be a prompt in text form, such as "main light" and "turned on". The embodiment of the present application does not limit the specific text content contained in the button prompt 1104. The button prompt 1104 can be used to prompt the user that the main light can be turned on or off through the upper button 222 of the remote control 101, as well as the current status of the main light (for example, turned on). Specifically, the user can press the upper button 222, and in response to the user operation, the remote control 101 can send a remote control signal 2 to the electronic device 100. After receiving the remote control signal 2, the electronic device 100 first determines that the remote control signal 2 is a signal for controlling the main light to be turned on or off. Then, if the electronic device 100 determines that the current status of the main light is turned on, the electronic device 100 can turn off the main light. If the electronic device 100 determines that the current status of the main light is turned off, the electronic device 100 can turn on the main light.

[0129] The key prompt 1105 can be a prompt in text form, such as "colorful lights" and "turned off". The embodiment of the present application does not limit the specific text content contained in the key prompt 1105. The key prompt 1105 can be used to prompt the user that the color lights can be turned on or off, as well as the current status of the color lights (for example, turned off) through the right key 221 of the remote control 101. Specifically, the user can press the right key 221, and in response to the user operation, the remote control 101 can send a remote control signal 3 to the electronic device 100. After receiving the remote control signal 3, the electronic device 100 can first determine that the remote control signal 3 is a signal for controlling the color lights to be turned on or off. Then, if the electronic device 100 determines that the current status of the color lights is turned off, the electronic device 100 can turn on the color lights. If the electronic device 100 determines that the current status of the color lights is turned on, the electronic device 100 can turn off the color lights.

[0130] The key prompt 1106 can be a text-based prompt combined with an icon, such as "All Lights Off" and a power control icon. The present embodiment does not limit the specific text content or icon style (e.g., shape, size, color) of the key prompt 1106. The key prompt 1106 can be used to prompt the user that they can use the confirmation key 220 of the remote control 101 to turn all lighting devices in the user's location on or off, as well as the current control state of the confirmation key 220 (e.g., all lights off). When the current control state of the confirmation key 220 is all lights off, the user can use the confirmation key 220 to turn off all lighting devices in the user's location (e.g., main lights, decorative lights, colored lights, and dining lights). When the current control state of the confirmation key 220 is all lights on, the user can use the confirmation key 220 to turn on all lighting devices in the user's location (e.g., main lights, decorative lights, colored lights, and dining lights). Specifically, the user can press the confirmation key 220, and in response to the user's operation, the remote control 101 can send a remote control signal 4 to the electronic device 100. After receiving the remote control signal 4, the electronic device 100 may first determine that the remote control signal 4 is a signal for controlling all lighting devices. Then, if the electronic device 100 determines that the current control state of the confirmation key 220 is all lights off, the electronic device 100 may turn off all lighting devices in the user's location. If the electronic device 100 determines that the current control state of the confirmation key 220 is all lights on, the electronic device 100 may turn off all lighting devices in the user's location.

[0131] The button prompt 1107 can be a prompt in text form, such as "dining light" and "turned off". The embodiment of the present application does not limit the specific text content contained in the button prompt 1107. The button prompt 1107 can be used to prompt the user that the dining light can be turned on or off by the lower button 224 of the remote control 101, as well as the current status of the dining light (for example, turned off). Specifically, the user can press the lower button 224, and in response to the user operation, the remote control 101 can send a remote control signal 5 to the electronic device 100. After receiving the remote control signal 5, the electronic device 100 can first determine that the remote control signal 5 is a signal for controlling the dining light to be turned on or off. Then, if the electronic device 100 determines that the current status of the dining light is turned off, the electronic device 100 can turn on the dining light. If the electronic device 100 determines that the current status of the dining light is turned on, the electronic device 100 can turn off the dining light.

[0132] Optionally, in a possible implementation, the control window 1101 of the lighting device may be a transparent window. In this way, the user can also see the portion of the video playback screen covered by the control window 1101 of the lighting device.

[0133] Optionally, in a possible implementation, the remote control image 1102 may further include a signal prompt 1108. The signal prompt 1108 may be used to prompt the electronic device 100 that the remote control signal of the remote control 101 is currently received.

[0134] Optionally, in some scenarios, the user can also select the air conditioner in the smart life control window to adjust and control it. For example, when the user selects the device control option 907 in the smart life control window 901 shown in Figure 9 through the remote control 101, the electronic device 100 can display the air conditioner control window 1201 in response to the user operation.

[0135] As shown in FIG12 , the electronic device 100 may overlay an air conditioner control window 1201 on the video playback screen of the user interface 200. The air conditioner control window 1201 may include a remote control image 1202. The remote control image 1202 may include key prompts corresponding to multiple buttons of the remote control 101 in the air conditioner control scenario. For example, as shown in FIG12 , the remote control image 1202 may include a key prompt 1203 corresponding to the left button 223 of the remote control 101, a key prompt 1204 corresponding to the up button 222 of the remote control 101, a key prompt 1205 corresponding to the right button 221 of the remote control 101, a key prompt 1206 corresponding to the confirm button 220 of the remote control 101, and a key prompt 1207 corresponding to the down button 224 of the remote control 101.

[0136] The button prompt 1203 can be a prompt in text form, such as "mode" and "cooling". The embodiment of the present application does not limit the specific text content contained in the button prompt 1203. The button prompt 1103 can be used to prompt the user to adjust the mode of the air conditioner 107 and the current mode of the air conditioner 107 (for example, cooling) through the left button 223 of the remote control 101. Specifically, the user can press the left button 223. In response to the user operation, the remote control 101 can send a remote control signal 1 to the electronic device 100. After receiving the remote control signal 1, the electronic device 100 first determines that the remote control signal 1 is a signal for adjusting the mode of the air conditioner 107. Then, when the electronic device 100 determines that the current state of the air conditioner 107 is cooling, the electronic device 100 can switch the mode of the air conditioner 107. For example, the electronic device 100 can switch the mode of the air conditioner 107 from cooling mode to sleep mode.

[0137] The button prompt 1204 can be a prompt in the form of an icon, such as the icon for raising the operating temperature shown in Figure 12. The embodiment of the present application does not limit the specific icon style (for example, shape, size, color, etc.) of the button prompt 1204. The button prompt 1204 can be used to prompt the user to increase the operating temperature of the air conditioner 107 through the upper key 222 of the remote control 101. Specifically, the user can press the upper key 222, and in response to the user operation, the remote control 101 can send a remote control signal 2 to the electronic device 100. After receiving the remote control signal 2, the electronic device 100 first determines that the remote control signal 2 is a signal for raising the operating temperature of the air conditioner 107. Then, the electronic device 100 can increase the operating temperature of the air conditioner 107 by one degree Celsius.

[0138] The button prompt 1205 can be a prompt in text form, such as "wind speed" and "automatic". The embodiment of the present application does not limit the specific text content contained in the button prompt 1205. The button prompt 1205 can be used to prompt the user to adjust the wind speed of the air conditioner 107 and the current wind speed status of the air conditioner 107 (for example, automatic) through the right button 221 of the remote control 101. Specifically, the user can press the right button 221, and in response to the user operation, the remote control 101 can send a remote control signal 3 to the electronic device 100. After the electronic device 100 receives the remote control signal 3, it can first determine that the remote control signal 3 is a signal for adjusting the wind speed of the air conditioner 107. Then, the electronic device 100 can modulate the current wind speed of the air conditioner 107. For example, the electronic device 100 can adjust the wind speed of the air conditioner 107 from the automatic state to level 1 wind speed.

[0139] The key prompt 1206 can be a text-based prompt combined with an icon, such as "24°C" and a power control icon. The present embodiment does not limit the specific text content or icon style (e.g., shape, size, color) of the key prompt 1206. The key prompt 1206 can be used to prompt the user that the air conditioner 107 can be turned on or off using the confirmation key 220 of the remote control 101, as well as the current operating temperature of the air conditioner (e.g., 24°C). Specifically, the user can press the confirmation key 220. In response to the user operation, the remote control 101 can send a remote control signal 4 to the electronic device 100. After receiving the remote control signal 4, the electronic device 100 can first determine that the remote control signal 4 is a signal for turning the air conditioner 107 on or off. Then, if the electronic device 100 determines that the air conditioner 107 is currently on, the electronic device 100 can turn the air conditioner 107 off. If the electronic device 100 determines that the air conditioner 107 is currently off, the electronic device 100 can turn the air conditioner 107 off.

[0140] The key prompt 1207 can be a prompt in the form of an icon, such as the icon for lowering the operating temperature shown in Figure 12. The embodiment of the present application does not limit the specific icon style (for example, shape, size, color, etc.) of the key prompt 1207. The key prompt 1107 can be used to prompt the user that the operating temperature of the air conditioner 107 can be lowered by pressing the down key 224 of the remote control 101. Specifically, the user can press the down key 224, and in response to the user operation, the remote control 101 can send a remote control signal 5 to the electronic device 100. After receiving the remote control signal 5, the electronic device 100 can first determine that the remote control signal 5 is a signal for lowering the operating temperature of the air conditioner 107. Then, the electronic device 100 can lower the operating temperature of the air conditioner 107 by one degree Celsius.

[0141] Optionally, in a possible implementation, the control window 1201 of the lighting device may be a transparent window. In this way, the user can also see the portion of the video playback screen covered by the control window 1201 of the lighting device.

[0142] Optionally, in a possible implementation, the remote control image 1202 may further include a signal prompt 1208. The signal prompt 1208 may be used to prompt the electronic device 100 that the remote control signal of the remote control 101 is currently received.

[0143] In some feasible examples, the user can increase the operating temperature of the air conditioner 107 by pressing the up button 222. In response to this user operation, the electronic device 100 can increase the temperature of the air conditioner 107 and update the current operating temperature of the air conditioner 107 in the air conditioner control window 1201. As shown in Figure 13, the electronic device 100 can update the current operating temperature of the air conditioner in the key prompt 1206 from 24°C to 25°C.

[0144] In some feasible examples, the user can turn off the air conditioner 107 by pressing the confirmation button 220. In response to this user operation, the electronic device 100 can turn off the air conditioner 107 and update the air conditioner 107 to the key prompt 1206. As shown in Figure 14, the electronic device 100 can no longer display the current operating temperature of the air conditioner 107 in the key prompt 1206. This can be used to indicate that the air conditioner 107 is currently off.

[0145] In some feasible examples, when the electronic device 100 turns off the air conditioner 107, and / or the electronic device 100 does not receive a remote control signal from the remote controller 101 within a preset time period, the electronic device 100 may display a prompt message 1501 and a remaining time prompt 1502 for turning off the air conditioner control window 1201. For example, as shown in FIG15 , when the electronic device 100 turns off the air conditioner 107, and / or the electronic device 100 does not receive a remote control signal from the remote controller 101 within a preset time period, the electronic device 100 may display a prompt message 1501 and a remaining time prompt 1502 for turning off the air conditioner control window 1201.

[0146] The prompt message 1501 may be used to prompt the electronic device 100 that the air conditioner control window 1201 is about to be closed. As shown in FIG15 , the specific content of the prompt message 1501 may be "The air conditioner control window is about to be closed." It is understood that the specific content of the prompt message 1501 is not limited in this embodiment of the present application.

[0147] The remaining time prompt 1502 can be used to indicate the remaining time for the electronic device 100 to close the air conditioner control window 1201. As shown in FIG15 , the specific content of the remaining time prompt 1502 can be "15s." "s" represents the time unit in seconds. It is understood that the specific content of the remaining time prompt 1502 is not limited in this embodiment of the application.

[0148] When the time in the remaining time prompt 1502 becomes 0s, the electronic device 100 can close the air conditioner control window 1201. That is, the air conditioner control window 1201 is no longer covered on the video playback screen of the user interface 200.

[0149] Optionally, in other feasible examples, the air conditioner control window 1201 may further include a control for closing the air conditioner control window 1201. The user may select the control through the remote controller 101, and in response to the user operation, the electronic device 100 may close the air conditioner control window 1201.

[0150] Alternatively, in other feasible examples, when the electronic device 100 does not receive a remote control signal sent by the remote controller 101 within a preset time period, the electronic device 100 may collapse the air conditioner control window 1201. When the electronic device 100 receives any one of remote control signals 1, 2, 3, 4, and 5, the electronic device 100 may expand and display the air conditioner control window 1201 again.

[0151] Optionally, in some feasible examples, when the user wants to close the air conditioner control window 1201, the user may press the return key on the remote controller 101. In response to the user operation, the remote controller 101 may send a remote control signal 6 to the electronic device 100. After receiving the remote control signal 6, the electronic device 100 may close the air conditioner control window 1201.

[0152] It is understandable that the user can conveniently control any device in the user's place that joins the smart life system through the remote control 101. When controlling different devices, the electronic device 100 can display different button prompts (different number of button prompts / or different functions corresponding to the button prompts).

[0153] According to the relevant user interface diagrams of the control device in Figures 8 to 15 above, the user can quickly call up the device control window through the remote control. Then, the user can use the remote control in his hand to quickly and accurately control the core functions of the device. In this way, the interruption of the viewing experience of exiting the movie and entering the app on the electronic device 100 or looking for other interactive devices to control is eliminated. It also makes up for the inability to perform fine control of a single device by executing fixed functions with one click (for example, selecting the viewing time option with one click, and the electronic device 100 controls multiple devices in the place according to the viewing mode).

[0154] In conjunction with the above drawings, embodiments of the present application provide a device control method. The method may include: an electronic device 100 may display a user interface 1. When a user presses the control center button 225 of the remote control 101, the remote control 101 may send a remote control signal 10 to the electronic device 100. Based on the remote control signal 10 sent by the remote control 101, the electronic device 100 may overlay a settings window on top of the user interface 1. The settings window may include a smart life option. When the user selects the smart life option in the settings window using the remote control 101, in response to the user operation, the electronic device 100 may overlay a smart life control window on top of the user interface 1. The smart life control window may include one or more device control options. In response to the user selecting one or more device control options 1, the electronic device 100 may overlay the device control window on top of the user interface 1. The device control window may include key prompts corresponding to one or more buttons on the remote control 101. The key prompts corresponding to the one or more buttons may include a key prompt A, which may indicate the device control function corresponding to button 1 of the one or more buttons.

[0155] In one possible implementation, the user interface 1 may include but is not limited to a video playback interface, a karaoke interface, a video call interface, and the like.

[0156] In this way, the user can conveniently use the buttons on the remote control 101 to directly control the devices corresponding to different scenarios. Moreover, when the user selects to enter the device control window, the electronic device 100 continues to display the user interface 1 and does not exit the user interface 1. In this way, the user's viewing of the user interface 1 is not affected.

[0157] Figure 16 exemplarily shows an interactive diagram of a device control method in a scenario provided by an embodiment of the present application. As shown in Figure 16, the device control method provided by an embodiment of the present application may include the following steps:

[0158] S1601: The electronic device 100 displays a video playback interface.

[0159] The electronic device 100 can establish a communication connection with the desk lamp 102, the desk lamp 106, and the desk lamp 109. The electronic device 100 and the desk lamp 102, the desk lamp 106, and the desk lamp 109 can establish a communication connection by logging into the same account or connecting to the same local area network, etc., which is not limited in this embodiment of the application.

[0160] Electronic device 100, desk lamp 102, desk lamp 106, and desk lamp 109 can be devices in a user's smart life system (or smart home system). In this smart life system, electronic device 100 can be a control center device. That is, the user can control other devices in the smart life system through electronic device 100. It is understandable that the smart life system can also include more devices and more control center devices, and this embodiment of the application is not limited to this.

[0161] The electronic device 100 can play a video and display a video playback interface. For example, the video playback interface can be the user interface 200 shown in Figure 2. The embodiment of the present application does not limit the specific video playback screen displayed in the video playback interface.

[0162] The electronic device 100 may be equipped with a remote controller 101. The user may use the remote controller 101 to start playing a video, adjust the volume, or end playing a video.

[0163] S1602: The remote controller 101 detects that the user presses the control center button.

[0164] S1603 : The remote controller 101 sends a remote control signal 10 to the electronic device 100 .

[0165] When the remote controller 101 detects that the user presses the control center button, the remote controller 101 may send a remote control signal 10 to the electronic device 100. The remote controller 101 may include an infrared sensor, and each button on the remote controller 101 corresponds to an infrared signal. In other words, the remote control signal 10 may be an infrared signal.

[0166] S1604: The electronic device 100 displays a setting window overlaid on the video playback interface, where the setting window includes smart life options.

[0167] After receiving the remote control signal 10, the electronic device 100 may display a settings window overlaid on the video playback interface in response to the remote control signal 10. The settings window may include smart life options. The settings window can be shown in settings window 801 shown in Figure 8. The smart life options can be shown in smart life options 802 shown in Figure 8.

[0168] The setting window may also include a plurality of setting options for setting the electronic device 100 or a control for entering a function or service in the electronic device 100. The embodiment of the present application does not limit the type and number of interface elements included in the setting window.

[0169] The smart life option is used to provide an entry for controlling devices in the smart life system. The embodiment of the present application does not limit the name of the smart life option, the position of the smart life option in the setting window, and the style of the smart life option.

[0170] Alternatively, in one possible implementation, the settings window can be a transparent window. That is, the settings window is a transparent layer that covers the video playback interface but does not obstruct the video playback screen in the video playback interface. In this way, the user can still view the portion of the video playback screen covered by the settings window through the settings window.

[0171] S1605: After the user selects the smart life option by pressing the button on the remote control 101, the remote control 101 detects that the user presses the confirmation button.

[0172] The user can select the smart life option in the setting window through the buttons of the remote control 101 (for example, one or more of the directional keys such as the left button, up button, right button, and down button). When the user presses a button on the remote control 101, the remote control 101 can send a remote control signal to the electronic device 100. The electronic device 100 can move the cursor (or check box) once based on the remote control signal. Until the electronic device 100 moves the cursor (or check box) to the smart life option based on the user operation. When the user moves the cursor (or check box) to the smart life option through the remote control 101, it can be said that the user selects the smart life option through the remote control 101. For example, referring to Figure 8, the smart life option 802 shown in Figure 8 is selected. The embodiment of the present application does not limit the specific way in which the user operates the remote control 101 in the process of selecting the smart life option.

[0173] After the user selects the Smart Life option using the remote control 101, the user can enter the Smart Life control window by pressing the confirmation button on the remote control 101. The remote control 101 can detect that the user has pressed the confirmation button. For example, the confirmation button can be the confirmation button 220 shown in Figure 8.

[0174] S1606 : The remote controller 101 sends a remote control signal 11 to the electronic device 100 .

[0175] When detecting that the user presses the confirmation key, the remote controller 101 may send a remote control signal 11 to the electronic device 100 .

[0176] S1607. The electronic device 100 displays a smart life control window over the video playback interface, where the smart life control window includes a lighting device control option.

[0177] In response to the remote control signal 11, the electronic device 100 may overlay a smart life control window on the video playback interface. For example, the smart life control window may be smart life control window 901 shown in FIG. The smart life control window may include lighting device control options. For example, the lighting device control options may be device control options 908 shown in FIG.

[0178] The smart life control window may also include device control options corresponding to other scenarios, for example, device control options corresponding to the air conditioning control scenario, such as the device control option 907 shown in FIG. 9 .

[0179] In one possible implementation, the device control options corresponding to one or more scenarios shown in the smart life control window may be the device control options most frequently used by the user, or may be the device control options corresponding to the device that needs to be adjusted and controlled and is closest to the electronic device 100. This embodiment of the present application is not limited to this.

[0180] When there are a large number of device control options in the smart life control window, the user can also view the multiple device control options contained in the smart life control window through the direction keys of the remote control 101 (for example, the left key, right key, up key or down key).

[0181] S1608 : After the user selects the lighting device control option by pressing the button on the remote control 101 , the remote control 101 detects that the user presses the confirmation button.

[0182] When the user wants to control and adjust the lighting equipment in the place where he is, the user can select the lighting equipment control option by pressing the button of the remote control 101. For how the user selects the lighting equipment control option, please refer to the description of the user selecting the smart life control option above, which will not be repeated here.

[0183] After the user selects the lighting device control option, the user may press the confirmation key of the remote controller 101. The remote controller 101 may detect that the user has pressed the confirmation key.

[0184] S1609 : The remote controller 101 sends a remote control signal 11 to the electronic device 100 .

[0185] When the remote controller 101 detects that the user presses the confirmation key, the remote controller 101 may send a remote control signal 11 to the electronic device 100 .

[0186] S1610. The electronic device 100 displays a lighting device control window overlaid on the video playback interface. The lighting device control window includes a button prompt 1 corresponding to the left button in the remote control 101, a button prompt 2 corresponding to the upper button, a button prompt 3 corresponding to the right button, and a button prompt 4 corresponding to the confirmation button. The button prompt 1 is used to prompt the user to turn on or off the desk lamp 106 by the left button, the button prompt 2 is used to prompt the user to turn on or off the desk lamp 102 by the upper button, the button prompt 3 is used to prompt the user to turn on or off the desk lamp 109 by the right button, and the button prompt 4 is used to prompt the user to turn off or turn on all lighting devices in the place by the confirmation button.

[0187] The electronic device 100 may receive the remote control signal 11. In response to the remote control signal 11, the electronic device 100 may overlay a lighting device control window on the video playback interface. The lighting device control window includes a key prompt 1 corresponding to the left button of the remote control 101, a key prompt 2 corresponding to the up button, a key prompt 3 corresponding to the right button, and a key prompt 4 corresponding to the confirmation button. The key prompt 1 is used to prompt the user to turn on or off the desk lamp 106 by pressing the left button, the key prompt 2 is used to prompt the user to turn on or off the desk lamp 102 by pressing the up button, the key prompt 3 is used to prompt the user to turn on or off the desk lamp 109 by pressing the right button, and the key prompt 4 is used to prompt the user to turn off or on all lighting devices in the place by pressing the confirmation button.

[0188] For example, the lighting device control window may be lighting device control window 1001 shown in FIG10 . Key prompt 1 may be key prompt 1003 shown in FIG10 . Key prompt 2 may be key prompt 1004 shown in FIG10 . Key prompt 3 may be key prompt 1005 shown in FIG10 . Key prompt 4 may be key prompt 1006 shown in FIG10 .

[0189] It is understood that the user's location may be a home location in the home scene 10 shown in FIG1 , which only includes three table lamps. Table lamps 102 and 106 are in the living room, and table lamp 109 is in the bedroom. Therefore, electronic device 100 can map the left button of remote control 101 to turn table lamp 106 on or off, the up button to turn table lamp 102 on or off, and the right button to turn table lamp 109 on or off, and map the confirmation button to turn all table lamps 102, 106, and 109 on or off with one button.

[0190] Alternatively, the electronic device 100 may map the left button of the remote control 101 to turn the space lamp 102 on or off, the up button to turn the table lamp 109 on or off, and the right button to turn the table lamp 106 on or off. The electronic device 100 may also select any three of the four directional keys to control the table lamp 102, the table lamp 106, and the table lamp 109, respectively. In the embodiment of the present application, multiple mapping methods are possible, and the embodiment of the present application is not limited thereto.

[0191] Alternatively, in another possible implementation, the lighting device control window may also only include key prompts corresponding to the keys for controlling the desk lamp 102 and the table lamp 106. That is, the electronic device 100 may select the table lamp located in the living room like the electronic device 100 and map it to the keys of the remote control 101.

[0192] Optionally, in another possible implementation, the lighting device control window may also only include button prompts for controlling the lighting device closest to the electronic device 100 (e.g., the desk lamp 102). For example, the button prompts for the desk lamp 102 may include button prompts corresponding to the button for controlling the desk lamp 102 to turn on or off, button prompts corresponding to the button for adjusting the operating mode of the desk lamp 102, and button prompts corresponding to the button for adjusting the light color of the desk lamp 102, etc., which are not limited in this embodiment of the present application.

[0193] It is understood that when the electronic device 100 is only applicable to the case where the remote control 101 includes 5 keys, such as 4 direction keys and 1 confirmation key, each of which is mapped to a control function, the number of key prompts corresponding to the keys included in the lighting device control window displayed by the electronic device 100 is less than or equal to 5. When the key prompts corresponding to the current scene are key prompts for controlling multiple devices, the lighting device control window can contain a maximum of 4 key prompts for controlling the 4 devices separately, and 1 key prompt for controlling all 4 devices on or off at the same time. When the number of lighting devices to be controlled in the current scene is less than 4 (for example, 3), the electronic device 100 can select 3 keys from the 4 direction keys of the remote control 101 to map them to the control functions of controlling the turning on or off of different devices, and display the key prompts corresponding to the 3 keys. When the number of lighting devices to be controlled in the current scene is greater than 4, the electronic device 100 can select 4 devices from the lighting devices and then map the 4 direction keys of the remote control 101 to the control functions of controlling the turning on or off of the 4 lighting devices one by one. That is, one direction key is mapped to a control function for controlling the turning on or off of one of the four devices, and a key prompt corresponding to the direction key is displayed in the lighting device control window.

[0194] The electronic device 100 may select four lighting devices from the plurality of lighting devices by sorting them from near to far based on their distance from the electronic device 100 or by sorting them from high to low based on their usage frequency.

[0195] Similarly, when the electronic device 100 is only applicable to the remote control 101 including 5 keys such as 4 direction keys and 1 confirmation key, each of which is mapped to a control function, the number of key prompts corresponding to the keys contained in the lighting device control window displayed by the electronic device 100 is less than or equal to 5. In the case where the key prompts corresponding to the current scene are key prompts corresponding to different control functions of a device, taking the desk lamp 102 as an example, when the control functions of the desk lamp 102 are less than or equal to 5, the electronic device 100 can select any multiple keys from the 4 direction keys and 1 confirmation key to map them one by one to the control functions of the desk lamp 102. If the control functions of the desk lamp 102 are greater than 5, the electronic device 100 can map the 4 direction keys and 1 confirmation key one by one to the 5 control functions of the desk lamp 102 that are used more frequently.

[0196] Optionally, the electronic device 100 may also use more buttons in the remote controller 101 to map a control function respectively, and then display a button prompt corresponding to each button. This embodiment of the present application does not limit this.

[0197] S1611. The remote controller 101 detects that the user presses the confirmation button.

[0198] S1612 : The remote controller 101 sends a remote control signal 11 to the electronic device 100 .

[0199] When a user wants to turn off multiple lighting devices such as desk lamp 106, desk lamp 102, and desk lamp 109 with one click, the user can press the confirmation key of remote control 101. Remote control 101 can detect the user pressing the confirmation key and then send a remote control signal 11 to electronic device 100.

[0200] S1613: The electronic device 100 determines to control the table lamp 106, the desk lamp 102, and the desk lamp 109, and determines that the current state is that all lights are off.

[0201] The electronic device 100 may receive the remote control signal 11. The electronic device 100 may store a mapping relationship table, which may record one or more of the keys corresponding to the remote control signal 11, the control functions, the control status of the control functions, and the like. After receiving the remote control signal 11, the electronic device 100 may determine from the mapping relationship table that the control functions corresponding to the remote control signal 11 are the desk lamp 106, the desk lamp 102, and the desk lamp 109, and that the current status is that all lights are off.

[0202] S1614a: The electronic device 100 sends a control instruction 1 to the desk lamp 102.

[0203] S1614b: The electronic device 100 sends a control instruction 2 to the desk lamp 106.

[0204] S1614c: The electronic device 100 sends a control instruction 3 to the desk lamp 109.

[0205] S1615a, the desk lamp 102 is turned off.

[0206] S1615b: The desk lamp 106 is turned off.

[0207] S1615c, desk lamp 109 goes out.

[0208] Then, the electronic device 100 can send control instruction 1 to the desk lamp 102, and the control instruction 1 can be used to instruct the desk lamp 102 to turn off. The electronic device 100 can send control instruction 2 to the desk lamp 106, and the control instruction 2 can be used to instruct the desk lamp 106 to turn off. After receiving the control instruction 2, the desk lamp 106 can turn off the light. The electronic device 100 can also send control instruction 3 to the desk lamp 109, and the control instruction 3 can be used to instruct the desk lamp 109 to turn off. After receiving the control instruction 1, the desk lamp 102 can turn off the light. After receiving the control instruction 2, the desk lamp 106 can turn off the light. After receiving the control instruction 3, the desk lamp 109 can turn off the light.

[0209] Optionally, the electronic device 100 may further determine the device status of the lighting device before sending the control instruction to the lighting device. If the lighting device is in the on state, the electronic device 100 sends a control instruction for turning off the light to the lighting device. If the lighting device is in the off state, the electronic device 100 wirelessly sends a control instruction for turning off the light to the lighting device. For example, if the desk lamp 102 and the desk lamp 106 are in the on state, the electronic device 100 may execute the above steps S1614a and S1614b. If the desk lamp 109 is in the off state, the electronic device 100 does not need to send the control instruction 3 to the desk lamp 109, that is, the electronic device 100 may not execute the above step S1614c.

[0210] When the remote control 101 detects that the user has pressed the left button, it may send a remote control signal 12 to the electronic device 100. After receiving the remote control signal 12, the electronic device 100 may determine that the remote control signal 12 is used to control whether the desk lamp 106 is turned on or off. When the electronic device 100 determines that the desk lamp 106 is turned on, the electronic device 100 may send a control instruction 2 to the desk lamp 106 to instruct it to turn off. When the electronic device 100 determines that the desk lamp 106 is turned off, the electronic device 100 may send a control instruction 4 to the desk lamp 106 to instruct it to turn on.

[0211] When the remote control 101 detects that the user has pressed the up button, it may send a remote control signal 13 to the electronic device 100. After receiving the remote control signal 13, the electronic device 100 may determine that the remote control signal 13 is used to control whether the desk lamp 102 is turned on or off. When the electronic device 100 determines that the desk lamp 102 is turned on, the electronic device 100 may send a control instruction 1 to the desk lamp 102 to instruct it to turn off. When the electronic device 100 determines that the desk lamp 102 is turned off, the electronic device 100 may send a control instruction 5 to the desk lamp 102 to instruct it to turn on.

[0212] When the remote control 101 detects that the user has pressed the right button, it may send a remote control signal 14 to the electronic device 100. After receiving the remote control signal 14, the electronic device 100 may determine that the remote control signal 14 is used to control whether the desk lamp 109 is turned on or off. When the electronic device 100 determines that the desk lamp 109 is turned on, the electronic device 100 may send a control instruction 3 to the desk lamp 109 to instruct it to turn off. When the electronic device 100 determines that the desk lamp 109 is turned off, the electronic device 100 may send a control instruction 6 to the desk lamp 109 to instruct it to turn on.

[0213] In this way, the user can conveniently and easily control the turning on or off of any one of the multiple lighting devices, such as the desk lamp 102, the desk lamp 106, and the desk lamp 109, or turn all of the multiple lighting devices on or off through the remote control 101. This does not affect the user's ability to continue watching the video, thereby improving the user experience.

[0214] Figure 17 exemplarily shows an interactive diagram of a device control method in another scenario provided by an embodiment of the present application. As shown in Figure 17, the device control method provided by an embodiment of the present application may include the following steps:

[0215] S1701: The electronic device 100 displays a video playback interface.

[0216] S1702: The remote controller 101 detects that the user presses the control center button.

[0217] S1703 : The remote controller 101 sends a remote control signal 10 to the electronic device 100 .

[0218] S1704. The electronic device 100 displays a setting window overlaid on the video playback interface, where the setting window includes smart life options.

[0219] S1705: After the user selects the smart life option by pressing the button on the remote control 101, the remote control 101 detects that the user presses the confirmation button.

[0220] S1706 : The remote controller 101 sends a remote control signal 11 to the electronic device 100 .

[0221] Steps S1701 to S1706 may refer to the description of steps S1601 to S1606 above, which will not be repeated here.

[0222] S1707. The electronic device 100 displays a smart life control window over the video playback interface, where the smart life control window includes an air conditioning control option.

[0223] In response to the remote control signal 11, the electronic device 100 may overlay a smart life control window on the video playback interface. For example, the smart life control window may be the smart life control window 901 shown in FIG. The smart life control window may include air conditioning control options, such as the device control option 907 shown in FIG.

[0224] Step S1707 may refer to the description of step S1607 above and will not be repeated here.

[0225] S1708 : After the user selects the air conditioning control option by pressing the button on the remote controller 101 , the remote controller 101 detects that the user presses the confirmation button.

[0226] S1709 : The remote controller 101 sends a remote control signal 11 to the electronic device 100 .

[0227] When the user wants to control the air conditioner in the place where he is, the user can select the air conditioner control option by pressing the button of the remote control 101. For how the user selects the air conditioner control option, please refer to the description of the user selecting the smart life control option above, which will not be repeated here.

[0228] After the user selects the air conditioning control option, the user may press the confirmation button of the remote controller 101. The remote controller 101 may detect that the user has pressed the confirmation button and then send a remote control signal 11 to the electronic device 100.

[0229] S1710. The electronic device 100 displays an air conditioning control window overlaid on the video playback interface. The air conditioning control window includes a button prompt 5 corresponding to the left button of the remote control 101, a button prompt 6 corresponding to the up button, a button prompt 7 corresponding to the right button, a button prompt 8 corresponding to the confirmation button, and a button prompt 9 corresponding to the down button. The button prompt 5 is used to prompt the user to switch the mode of the air conditioner 107 by using the left button, the button prompt 6 is used to prompt the user to increase the working temperature of the air conditioner 107 by using the up button, the button prompt 7 is used to prompt the user to switch the wind speed mode of the air conditioner 107 by using the right button, the button prompt 8 is used to prompt the user to turn off or turn on the air conditioner 107 by using the confirmation button, and the button prompt 9 is used to prompt the user to lower the working temperature of the air conditioner 107 by using the down button.

[0230] The electronic device 100 can receive the remote control signal 11. In response to the remote control signal 11, the electronic device 100 can overlay and display the air conditioning control window on the video playback interface. The air conditioning control window includes a button prompt 5 corresponding to the left button in the remote control 101, a button prompt 6 corresponding to the up button, a button prompt 7 corresponding to the right button, a button prompt 8 corresponding to the confirmation button, and a button prompt 9 corresponding to the down button. The button prompt 5 is used to prompt the user to switch the mode of the air conditioner 107 by using the left button, the button prompt 6 is used to prompt the user to increase the working temperature of the air conditioner 107 by using the up button, the button prompt 7 is used to prompt the user to switch the wind speed mode of the air conditioner 107 by using the right button, the button prompt 8 is used to prompt the user to turn off or turn on the air conditioner 107 by using the confirmation button, and the button prompt 9 is used to prompt the user to lower the working temperature of the air conditioner 107 by using the down button.

[0231] For example, the air conditioner control window may be control window 1201 of air conditioner 107 shown in FIG12 . Key prompt 5 may be key prompt 1203 shown in FIG12 . Key prompt 6 may be key prompt 1204 shown in FIG12 . Key prompt 7 may be key prompt 1205 shown in FIG12 . Key prompt 8 may be key prompt 1206 shown in FIG12 . Key prompt 9 may be key prompt 1207 shown in FIG12 .

[0232] Since the air conditioner has multiple control functions, the number of multiple control functions is greater than the number of direction keys and confirmation keys in the remote control 101. Therefore, the electronic device 100 selects the control functions that are used more frequently in the air conditioner to map with the direction keys and confirmation keys in the remote control 101. For example, the electronic device 100 can map the left key to control the working mode of the air conditioner, map the up key to increase the working temperature of the air conditioner by one degree Celsius, map the right key to control the wind speed mode of the air conditioner, map the down key to lower the working temperature of the air conditioner by one degree Celsius, and map the confirmation key to control the air conditioner to turn on or off. In this embodiment of the present application, there can be multiple mapping methods between the buttons of the remote control 101 and the control functions of the air conditioner, and this embodiment of the present application is not limited to this.

[0233] S1711. The remote controller 101 detects that the user presses the left button.

[0234] S1712 , the remote controller 101 sends a remote control signal 12 to the electronic device 100 .

[0235] S1713 : The electronic device 100 determines to switch the mode of the air conditioner 107 .

[0236] S1714 , the electronic device 100 sends a control instruction 10 to the air conditioner 107 .

[0237] S1715: The air conditioner 107 switches to the next mode.

[0238] When a user wants to switch the operating mode of the air conditioner, they can press the left button on remote control 101. Remote control 101 can detect the user pressing the left button and send a remote control signal 12 to electronic device 100. Electronic device 100 can receive remote control signal 12 and, based on remote control signal 12, determine to switch the operating mode of air conditioner 107. Electronic device 100 can send control instruction 10 to the air conditioner. Air conditioner 107 can receive control instruction 10. In response to control instruction 10, air conditioner 107 can switch to the next operating mode. For example, air conditioner 107 can switch from cooling mode to sleep mode.

[0239] S1716: The remote controller 101 detects that the user presses the up button.

[0240] S1717 , the remote controller 101 sends a remote control signal 13 to the electronic device 100 .

[0241] S1718 : The electronic device 100 determines to increase the operating temperature of the air conditioner 107 .

[0242] S1719 , the electronic device 100 sends a control instruction 20 to the air conditioner 107 .

[0243] S1720, air conditioner 107 raises the operating temperature by one degree Celsius.

[0244] When a user wants to increase the operating temperature of the air conditioner, they can press the up button on remote control 101. Remote control 101 can detect the user pressing the up button and send a remote control signal 13 to electronic device 100. Electronic device 100 can receive remote control signal 13 and, based on remote control signal 13, determine to increase the operating temperature of air conditioner 107. Electronic device 100 can then send a control instruction 20 to the air conditioner. Air conditioner 107 can receive control instruction 20. In response to control instruction 20, air conditioner 107 can increase the operating temperature by one degree Celsius.

[0245] The embodiment of the present application does not limit the execution order of steps S1711-step S1715 and steps S1716-step S1720. That is, the user can first increase the temperature of the air conditioner by pressing the up key, and then switch the operating mode of the air conditioner by pressing the left key. That is, steps S1716-step S1720 can be executed first, and then steps S1711-step S1715 can be executed. Steps S1711-step S1715 and S1716-step S1720 can be executed multiple times. The embodiment of the present application does not limit this.

[0246] When a user wants to switch the air conditioner's wind speed mode, they can press the right button on remote control 101. Remote control 101 can detect the user pressing the right button and send a remote control signal 14 to electronic device 100. Electronic device 100 can receive remote control signal 14 and, based on remote control signal 14, determine to switch the wind speed mode of air conditioner 107. Electronic device 100 can send a control instruction 30 to the air conditioner. Air conditioner 107 can receive control instruction 30. In response to control instruction 30, air conditioner 107 can switch to the next wind speed mode. For example, air conditioner 107 can switch from automatic wind speed mode to level 1 wind speed mode.

[0247] When a user wants to lower the operating temperature of air conditioner 107, they can press the down button on remote control 101. Remote control 101 can detect the user pressing the down button and send a remote control signal 15 to electronic device 100. Electronic device 100 can receive remote control signal 15 and, based on remote control signal 15, determine to lower the operating temperature of air conditioner 107. Electronic device 100 can then send control instruction 40 to the air conditioner. Air conditioner 107 can receive control instruction 40. In response to control instruction 40, air conditioner 107 can lower the operating temperature by one degree Celsius.

[0248] When a user wants to turn air conditioner 107 on or off, they can press the confirmation button on remote control 101. Remote control 101 can detect that the user has pressed the confirmation button. Then, remote control 101 can send a remote control signal 11 to electronic device 100. Electronic device 100 can determine that remote control signal 11 is used to control air conditioner 107 to turn on or off. If air conditioner 107 is on, electronic device 100 can send a control instruction 50 to air conditioner 107. After receiving control instruction 50, air conditioner 107 can turn off. If air conditioner 107 is off, electronic device 100 can send a control instruction 60 to air conditioner 107. After receiving control instruction 60, air conditioner 107 can turn on.

[0249] In this way, the user can simply use the left button on the remote control 101 to control the operating mode of the air conditioner 107, the up button to increase the operating temperature of the air conditioner 107, the right button to control the fan speed mode of the air conditioner 107, the down button to decrease the operating temperature of the air conditioner 107, and the confirmation button to turn the air conditioner 107 on or off. Furthermore, the electronic device 100 can continue playing the video while the user is controlling the air conditioner 107, without exiting the video playback interface. This does not affect the user's viewing experience, which can improve the user experience.

[0250] FIG18 exemplarily shows a flow chart of a device control method provided in an embodiment of the present application. As shown in FIG18 , a device control method provided in an embodiment of the present application may include the following steps:

[0251] S1801. The electronic device 100 displays the user interface 1.

[0252] The electronic device 100 can display a user interface 1. The user interface 1 can be a video playback interface, a video call interface, a karaoke interface, etc. The embodiment of the present application is explained by taking the user interface 1 as an example of a video playback interface. For example, the user interface 1 can be the user interface 200 shown in Figure 2. The user interface 200 displays the video playback screen of "xx TV series Episode 2". The user interface 1 can also be a video call interface, and the video screen of the video call initiator and the video screen of the video call recipient can be displayed in the video call interface. The user interface 1 can also be a karaoke interface, and the video playback screen corresponding to song 1 and the lyrics information of song 1 can be displayed in the karaoke interface, etc. The user interface 1 can also be an interface displaying other content, and the embodiment of the present application does not limit the user interface 1.

[0253] S1802. After receiving the remote control signal 20, the electronic device 100 displays a setting window overlaid on the user interface 1. The setting window includes smart life options. The remote control signal 20 is sent to the electronic device 101 by the remote control 101 when the user presses the control center button on the remote control 101.

[0254] The user may press a control center key on the remote control 101, for example, the control center key 225 shown in FIG2 . The remote control 101 may detect the user's operation of pressing the control center key, and in response to the user operation, the remote control 101 may send a remote control signal 20 to the electronic device 100. The remote control signal 20 may be the remote control signal 10 mentioned above.

[0255] The electronic device 100 may receive the remote control signal 20 and, in response to the remote control signal 20, may overlay a settings window on the user interface 1, the settings window including smart life options. The settings window may be shown as settings window 801 in FIG. The smart life options may be shown as smart life options 802 in FIG.

[0256] For details about the settings window and smart life options, please refer to Figure 8 and the description in step S1604, which will not be repeated here.

[0257] S1803. Upon receiving the remote control signal 21, the electronic device 100 displays a smart life control window overlaid on the user interface 1. The smart life control window includes multiple device control options, each of which is used to provide an entry into the device control window corresponding to different scenarios. The multiple device control options include device control option 1, which is used to provide an entry into device control window 1 corresponding to scenario 1. The remote control signal 21 is sent to the electronic device 100 by the remote control 101 when the user selects the smart life option through the remote control 101 and presses the confirmation button on the remote control 101.

[0258] The user can select the smart life option in the setting window through the buttons of the remote control 101 (for example, one or more of the directional keys such as the left button, up button, right button, and down button). After the user selects the smart life option through the buttons of the remote control 101, the user can enter the smart life control window by pressing the confirmation button of the remote control 101. The remote control 101 can detect that the user presses the confirmation button. Exemplarily, the confirmation button can be the confirmation button 220 shown in Figure 8. When it is detected that the user presses the confirmation button, the remote control 101 can send a remote control signal 21 to the electronic device 100. The remote control signal 21 can be the remote control signal 11 mentioned above.

[0259] The electronic device 100 may receive a remote control signal 21. In response to the remote control signal 21, the electronic device 100 may overlay a smart life control window on the user interface 1. The smart life control window includes multiple device control options, each of which provides access to device control windows corresponding to different scenarios. The multiple device control options include device control option 1, which provides access to device control window 1 corresponding to scenario 1. For example, the smart life control window may be the smart life control window 901 shown in FIG. 9 .

[0260] For example, the device control option 1 may be the device control option 907 shown in Figure 9 or the device control option 908. This embodiment of the present application does not limit this.

[0261] When device control option 1 is device control option 908 shown in FIG9 , device control window 1 may be control window 1001 for the lighting device shown in FIG10 or control window 1101 for the lighting device shown in FIG11 . When device control option 1 is device control option 907 shown in FIG9 , device control window 1 may be control window 1201 for the air conditioner shown in FIG12 .

[0262] For the smart life control window, please refer to Figure 9 and the description in step S1607, which will not be repeated here.

[0263] S1804. Upon receiving the remote control signal 21, the electronic device 100 overlays the device control window 1 corresponding to the display scene 1 on the user interface 1. The device control window 1 includes key prompts corresponding to one or more keys in the remote control 101. The key prompts corresponding to the one or more keys may include a key prompt A, which may be used to prompt the function corresponding to key 1 among the one or more keys. The remote control signal 21 is sent to the electronic device 100 by the remote control 101 when the user selects the device control option 1 through the remote control 101 and presses the confirmation key in the remote control 101.

[0264] After selecting device control option 1 in the smart life control window via remote control 101, the user may press the confirmation button of remote control 101. Remote control 101 may detect the user's pressing operation and send a remote control signal 21 to electronic device 100 based on the pressing operation.

[0265] The electronic device 100 may receive a remote control signal 21. In response to the remote control signal 1, the electronic device 100 may overlay a device control window 1 corresponding to the display scene 1 on the user interface 1. The device control window 1 includes key prompts corresponding to one or more keys in the remote control 101. The key prompts corresponding to the one or more keys may include a key prompt A. The key prompt A may be used to prompt the function corresponding to key 1 of the one or more keys. For example, the device control window 1 may be any one of the control window 1001 for the lighting device shown in FIG10 , the control window 1101 for the lighting device shown in FIG11 , and the control window 1201 for the air conditioner shown in FIG12 . The device control window 1 may also be a control window corresponding to other types of devices. The embodiment of the present application does not limit what type of device the device control window 1 is specifically used to control.

[0266] For example, when device control window 1 is control window 1001 for a lighting device shown in FIG10 , key prompt A may be any one of key prompts 1003, 1004, 1005, and 1006 shown in FIG10 . When device control window 1 is control window 1101 for a lighting device shown in FIG11 , key prompt A may be any one of key prompts 1103, 1104, 1105, 1106, and 1107 shown in FIG11 . When device control window 1 is control window 1201 for an air conditioner shown in FIG12 , key prompt A may be any one of key prompts 1203, 1204, 1205, 1206, and 1207 shown in FIG12 . This embodiment of the present application does not specifically limit key prompt A.

[0267] In one possible implementation, after receiving the remote control signal 21, the electronic device 100 determines the type of device controlled by the device control option 1 and the number of devices of that type. If the electronic device 100 determines that there are multiple devices controlled by the device control option 1, and the primary control function for each of the multiple devices is to turn the device on or off, for example, a lighting device has a primary function of turning it on or off. For lighting devices, the electronic device 100 only needs to turn the lighting device on to meet the user's lighting needs. If the number of devices of that type is less than the number of directional keys on the remote control 101, for example, if there are three devices of that type (device 1, device 2, and device 3), the electronic device 100 can map any three of the directional keys on the remote control 101 to control device 1 on or off, device 2 on or off, and device 3 on or off, respectively (also referred to as establishing a corresponding relationship). That is, each of the three keys is used to control a device on or off. The electronic device 100 can map the confirmation key on the remote control 101 to the control function of turning all devices on or off.

[0268] Alternatively, in another possible implementation, if the number of devices of this type is greater than the directional keys of the remote control 101, the electronic device 100 may select, based on the distance between the device of this type and the electronic device 100, or based on the area where the device is located or the frequency of use of the device of this type, the device that is closest to the electronic device 100, the device that is in the same area as the electronic device 100 and closest to the electronic device 100, or the frequency of use, or based on the importance level of the device set by the system in the electronic device 100, or based on user-defined settings, four devices are determined from multiple devices, for example, device 1, device 2, device 3, and device 4. The electronic device 100 may map the four buttons on the directional keys of the remote control 101 to control device 1 on or off, control device 2 on or off, control device 3 on or off, and control device 4 on or off, respectively. The electronic device 100 may map the confirmation button of the remote control 101 to the control function of turning all devices on or off.

[0269] Alternatively, in another possible implementation, the electronic device 100 determines that there are multiple devices controlled by device control option 1, but this type of device has multiple primary control functions. For example, an air conditioner's primary functions include not only turning it on or off, but also switching operating modes, adjusting the operating temperature, and switching wind speed modes. When a user uses the air conditioner, they not only need to turn it on, but also need to set the operating mode, operating temperature, and wind speed mode to meet their needs. Therefore, when device control option 1 corresponds to a device in an air conditioning scenario, the electronic device 100 can select a device from multiple devices that is closest to the electronic device 100 or in the same area as the electronic device 100 (for example, if the electronic device 100 is in the living room, the electronic device 100 can select an air conditioner in the living room) and map the primary control functions of the device to the direction keys and confirmation key of the remote control 101. That is, each direction key and confirmation key of the remote control 101 corresponds to a control function of the device. The primary control function can be determined based on the frequency of use of the control function in this type of device, or determined by the importance level set by the system of the electronic device 100, or determined by user-defined settings. For example, the electronic device 100 may set one or more control functions of the air conditioner that are used more frequently as the main function of the air conditioner. Alternatively, the control function of turning the air conditioner on or off, the working mode switching function, the working temperature adjustment function, and the wind speed mode switching function set in the system of the electronic device 100 are the main control functions of the air conditioner. Alternatively, the main control function of the air conditioner may also be user-defined, and the user may set any one of the multiple control functions of the air conditioner as the main control function of the air conditioner according to their own usage needs. This embodiment of the present application is not limited to this.

[0270] After the electronic device 100 maps the buttons of the remote controller 101 with the corresponding control functions, the device control window 1 may be displayed, and a button prompt of the control function corresponding to each button may be displayed in the device control window 1 .

[0271] The device control window 1 and the key prompt A can refer to the description in Figures 10, 11, 12, step S1610, and step S1710 above, and will not be repeated here.

[0272] After the electronic device 100 displays the device control window 1, the user can follow the key prompts in the device control window 1 to implement the corresponding control functions through the corresponding keys on the remote control 101. For details on how the user uses the remote control 101 to control the corresponding device based on the key prompts, please refer to the descriptions in Figures 13-15, as well as the descriptions in steps S1611-S1615d and steps 1711-S1720 above, which will not be repeated here.

[0273] The device control method provided in the embodiment of the present application is that when the user is watching the content displayed in the user interface 1 of the electronic device 100, for example, a video playback screen, a video call screen, a karaoke interface, etc., the user can quickly call up the device control window. The electronic device 100 can map the buttons of the remote control 101 to the control functions in the corresponding scenes one by one, and display the control function corresponding to each button in the form of a button prompt in the device control window. In this way, the user can know the control functions corresponding to the buttons of the remote control 101 according to the button prompt. In this way, the user can control the device quickly and conveniently through the remote control 101, and the operation is simple. Moreover, in the process of controlling the device, the electronic device 100 will not jump out of the user interface 1, and the user can continue to watch the user interface 1, which can improve the user experience.

[0274] In the embodiment of the present application, the first user interface may be user interface 1 or user interface 200. The first window may be a lighting device control window, or may be lighting device control window 1001 or lighting device control window 1101. The second window may be an air conditioning control window, or may be control window 1201 for air conditioner 107. The first device may be any of desk lamp 102, desk lamp 106, and desk lamp 109. The first device may also be any of a main lamp, a dining lamp, a decorative lamp, or a colored lamp. The second device may be air conditioner 107.

[0275] FIG19 is a schematic structural diagram of the electronic device 100 provided in an embodiment of the application.

[0276] The following embodiments are described in detail using electronic device 100 as an example. It should be understood that electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in the figure may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.

[0277] The electronic device 100 may include: a processor 120, an external memory interface 130, a power module 140, an internal memory 150, a wireless communication module 160, an audio module 170, a speaker 170A, a microphone 170B, an infrared circuit 180, a display screen 190, a camera 191, and a communication interface 192, etc.

[0278] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0279] The processor 120 may include one or more processing units. For example, the processor 120 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0280] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0281] Processor 120 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 120 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 120. If processor 120 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 120 latency, and thus improves system efficiency.

[0282] In some embodiments, the processor 120 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and / or a universal serial bus (USB) interface.

[0283] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 120 may include multiple I2C bus lines. The processor 120 may be coupled to the touch sensor 180K, the charger, the flash, the camera 191, and the like via different I2C bus interfaces. For example, the processor 120 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 120 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the electronic device 100.

[0284] The I2S interface can be used for audio communication. In some embodiments, the processor 120 can include multiple I2S buses. The processor 120 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 120 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0285] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0286] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 120 and the wireless communication module 160. For example, the processor 120 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0287] The MIPI interface can be used to connect the processor 120 to peripheral devices such as the display 190 and the camera 191. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 120 and the camera 191 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 120 and the display 190 communicate via the DSI interface to implement the display function of the electronic device 100.

[0288] The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 120 to the camera 191, the display 190, the wireless communication module 160, the audio module 1700, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0289] A USB interface is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. USB interface 130 can be used to connect a charger to charge electronic device 100, or to transfer data between electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as AR devices.

[0290] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0291] The power module 140 can be used to receive power input and provide power to the processor 120, the internal memory 150, the external memory 130, the display screen 190, the camera 191, and the wireless communication module 160.

[0292] The wireless communication function of the electronic device 100 can be implemented through an antenna, a wireless communication module 160, etc. The wireless communication module 160 can provide wireless communication solutions including wireless local area network (WLAN) (for example, wireless fidelity (Wi-Fi)), frequency modulation (FM), Bluetooth or near field communication (NFC) applied on the electronic device 100. The wireless communication module 160 can be one or more periods integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 120. The wireless communication module 160 can also receive signals to be sent from the processor 120, frequency modulate and amplify them, and convert them into electromagnetic waves for radiation through the antenna.

[0293] In some embodiments, the wireless communication module 160 may be a Wi-Fi and / or Bluetooth chip. The electronic device 100 may be connected to a chip in another terminal device, such as a mobile phone, through this chip, thereby enabling wireless communication and service processing between the electronic device 100 and the other device. The Bluetooth chip may typically support Bluetooth low energy (BLE).

[0294] Electronic device 100 implements display functionality through a GPU, display screen 190, and an application processor. A GPU is a microprocessor for image processing that connects display screen 190 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 120 may include one or more GPUs that execute program instructions to generate or modify display information.

[0295] Display screen 190 is used to display images, videos, and the like. Display screen 190 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 190, where N is a positive integer greater than one.

[0296] The electronic device 100 can implement a shooting function through an ISP, a camera 191, a video codec, a GPU, a display screen 190, and an application processor.

[0297] The ISP processes data fed back by camera 191. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and color. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 191.

[0298] The camera 191 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 191, where N is a positive integer greater than 1.

[0299] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0300] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0301] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0302] The external memory interface 130 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 120 via the external memory interface 130 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0303] The internal memory 150 can be used to store computer executable program codes, which include instructions. The processor 120 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 150. The internal memory 150 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, applications required for at least one function (such as face recognition function, fingerprint recognition function, mobile payment function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as face information template data, fingerprint information template, etc.), etc. In addition, the internal memory 150 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0304] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the microphone 170B, and the application processor.

[0305] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 120, or some functional modules of the audio module 170 can be provided in the processor 120.

[0306] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0307] Microphone 170B, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170B to input the sound signal into the microphone 170B. The electronic device 100 can be provided with at least one microphone 170B. In other embodiments, the electronic device 100 can be provided with two microphones 170B, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170B to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0308] The infrared circuit 180 can be used to receive infrared remote control signals sent by devices such as the remote controller 101. The infrared remote control signals can operate various functions of the electronic device 100, for example, turning the electronic device 100 on and off, controlling other devices in the smart life system, and so on.

[0309] The communication interface 192 can be used to communicate with external devices such as a control device, a set-top box, a router, and a USB flash drive. The communication interface 192 can be any possible interface such as an Ethernet port or a USB port.

[0310] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0311] As used in the above embodiments, the term “when…” may be interpreted to mean “if…” or “after…” or “in response to determining…” or “in response to detecting…”, depending on the context. Similarly, the phrases “upon determining…” or “if (stated condition or event) is detected” may be interpreted to mean “if determining…” or “in response to determining…” or “upon detecting (stated condition or event)” or “in response to detecting (stated condition or event)”, depending on the context.

[0312] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk).

[0313] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A device control method, applied to a device control system, wherein the system includes an electronic device and a remote control device, characterized in that: The method comprises: The electronic device displays a first user interface; The remote control device detects that a user presses a first button, and sends a first remote control signal to the electronic device; The electronic device receives and responds to the first remote control signal, and when a first scene is determined, displays a first window overlaid on the first user interface according to the first scene, wherein the first window includes prompts corresponding to one or more buttons of the remote control device in the first scene, the prompts corresponding to the one or more buttons including a first prompt, and the first prompt is used to indicate a first function corresponding to a second button of the remote control device; The remote control device detects that the user presses the second button, and sends a second remote control signal to the electronic device; The electronic device receives and responds to the second remote control signal to execute the first function.

2. The method according to claim 1, characterized in that The method further comprises: The electronic device receives and responds to the first remote control signal. When a second scenario is determined, a second window is displayed overlaid on the first user interface according to the second scenario. The second window includes prompts corresponding to one or more buttons in the remote control device in the second scenario. The prompts corresponding to the one or more buttons include a second prompt. The second prompt is used to prompt a second function corresponding to a second button in the remote control device; the second function is different from the first function.

3. The method according to claim 2, wherein the electronic device receives and responds to the first remote control signal, and before overlaying and displaying the first window on the first user interface, the method further comprises: The remote control device detects that the user presses the second button, and sends a third remote control signal to the electronic device; The electronic device receives and responds to the third remote control signal to execute a third function, where the third function is different from both the first function and the second function.

4. The method according to claim 3, characterized in that The device control system includes a first device, and the first function is used to control the first device to be turned on or off; the electronic device receives and responds to the second remote control signal to perform the first function, specifically including: The electronic device receives and responds to the second remote control signal, and sends a first instruction to the first device, where the first instruction is used to instruct the first device to turn on or off.

5. The method according to any one of claims 2 to 4, characterized in that: The device control system includes a second device, and the second function is used to control the second device to turn on or off, control the second device to switch the working mode, and control the second device to increase or decrease the working temperature.

6. The method according to any one of claims 1 to 5, characterized in that The electronic device receives and responds to the second remote control signal to perform the first function, specifically including: The electronic device obtains the first function corresponding to the second button from the correspondence associated with the first scene according to the second remote control signal, and executes the first function, wherein the correspondence associated with the first scene includes the correspondence between the second button and the first function.

7. The method according to claim 6, characterized in that The electronic device receives and responds to the first remote control signal, and when a first scene is determined, displays a first window overlaid on the first user interface according to the first scene, specifically including: The electronic device receives and responds to the first remote control signal, obtains the correspondence between the second button and the first function, and displays a first window overlaid on the first user interface.

8. The method according to claim 2, characterized in that The electronic device receives and responds to the first remote control signal, and when a second scene is determined, displays a second window overlaid on the first user interface according to the second scene, specifically including: The electronic device receives and responds to the first remote control signal, obtains the correspondence between the second button and the second function from the correspondence associated with the second scene, and displays a second window overlaid on the first user interface, wherein the correspondence associated with the second scene includes the correspondence between the second button and the second function.

9. The method according to claim 8, characterized in that Before the remote control device detects that a user has pressed a first button and sends a first remote control signal to the electronic device, the method further includes: The remote control device detects that the user presses the third button, and sends a fourth remote control signal to the electronic device; The electronic device receives and responds to the fourth remote control signal, and displays a third window overlaid on the first user interface, where the third window includes a first option, and the first option is used to provide an entry to the first window or the second window.

10. The method according to any one of claims 7 to 9, wherein a video playback screen is displayed in the first user interface.

11. The method according to claim 10, characterized in that: The first window or the second window is a transparent window.

12. The method according to claim 11, characterized in that: The first window or the second window is overlaid on the first user interface in a semi-modal manner.

13. The method according to any one of claims 11 or 12, characterized in that The first scenario is a scenario of controlling a first type of device in a location where the user is located, and the second scenario is a scenario of controlling a second type of device in a location where the user is located; Alternatively, the first scenario is a scenario of controlling a first type of device in a first place, and the second scenario is a scenario of controlling the first type of device in a second place.

14. A device control method, characterized in that: Applied to electronic equipment, the method includes: The electronic device displays a first user interface; The electronic device receives and responds to a first remote control signal, and when a first scenario is determined, displays a first window overlaid on the first user interface according to the first scenario, wherein the first remote control signal is sent to the electronic device after the remote control device detects that a user has pressed a first button, and the first window includes prompts corresponding to one or more buttons of the remote control device in the first scenario, wherein the prompts corresponding to the one or more buttons include a first prompt, and the first prompt is used to indicate a first function corresponding to a second button of the remote control device; The electronic device receives and responds to the second remote control signal to execute the first function. The second remote control signal is sent to the electronic device after the remote control device detects that the user presses the second button.

15. The method according to claim 14, characterized in that The method further comprises: The electronic device receives and responds to the first remote control signal, and when a second scenario is determined, displays a second window overlaid on the first user interface according to the second scenario. The first remote control signal is sent to the electronic device after the remote control device detects that a user has pressed a first button. The second window includes prompts corresponding to one or more buttons in the remote control device in the second scenario. The prompts corresponding to the one or more buttons include a second prompt. The second prompt is used to indicate a second function corresponding to a second button in the remote control device; the second function is different from the first function.

16. The method according to claim 15, characterized in that Before the electronic device receives and responds to the first remote control signal and overlays and displays the first window on the first user interface, the method further includes: The electronic device receives and responds to a third remote control signal to execute a third function, where the third function is different from both the first function and the second function. The third remote control signal is sent to the electronic device after the remote control device detects that a user has pressed the second button.

17. The method according to claim 16, characterized in that The first function is used to control the first device to be turned on or off; the electronic device receives and responds to the second remote control signal, and performs the first function specifically including: The electronic device receives and responds to the second remote control signal, and sends a first instruction to the first device, where the first instruction is used to instruct the first device to turn on or off.

18. The method according to any one of claims 15 to 17, characterized in that: The second function is used to control the second device to turn on or off, control the second device to switch the working mode, and control the second device to increase or decrease the working temperature.

19. The method according to any one of claims 14 to 18, characterized in that: The electronic device receives and responds to the second remote control signal to execute the first function, specifically including: The electronic device obtains the first function corresponding to the second button from the correspondence associated with the first scene according to the second remote control signal, and executes the first function, wherein the correspondence associated with the first scene includes the correspondence between the second button and the first function.

20. The method according to claim 19, characterized in that The electronic device receives and responds to the first remote control signal, and when a first scene is determined, displays a first window overlaid on the first user interface according to the first scene, specifically including: The electronic device receives and responds to the first remote control signal, acquires the corresponding relationship between the second button and the first function, and displays a first window overlaid on the first user interface.

21. The method according to claim 15, characterized in that The electronic device receives and responds to the first remote control signal, and when a second scene is determined, displays a second window overlaid on the first user interface according to the second scene, specifically including: The electronic device receives and responds to the first remote control signal, obtains the correspondence between the second button and the second function from the correspondence associated with the second scene, and displays a second window overlaid on the first user interface, wherein the correspondence associated with the second scene includes the correspondence between the second button and the second function.

22. The method according to claim 14, wherein Before the electronic device receives and responds to the first remote control signal, the method further includes: The electronic device receives and responds to the fourth remote control signal, and displays a third window overlaid on the first user interface, where the third window includes a first option, and the first option is used to provide an entrance to the first window or the second window. The fourth remote control signal is sent to the electronic device when the remote control device detects that the user presses the third button.

23. The method according to any one of claims 14-22, wherein a video playback screen is displayed in the first user interface.

24. The method according to claim 23, wherein: The first window or the second window is a transparent window.

25. The method according to claim 24, characterized in that The first window or the second window is overlaid on the first user interface in a semi-modal manner.

26. The method according to any one of claims 24 or 25, characterized in that The first scenario is a scenario of controlling a first type of device in a location where the user is located, and the second scenario is a scenario of controlling a second type of device in a location where the user is located; Alternatively, the first scenario is a scenario of controlling a first type of device in a first place, and the second scenario is a scenario of controlling the first type of device in a second place.

27. An electronic device, characterized in that: It includes a display screen, one or more processors and one or more memories; wherein the display screen and the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the method as described in any one of claims 14 to 26 is executed.

28. A chip system, applied to electronic equipment, comprising one or more processors, characterized in that: The processor is configured to call computer instructions so as to execute the method according to any one of claims 14 to 26.

29. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the method according to any one of claims 14 to 26 is executed.

Images