Scene creating method and electronic equipment

Abstract

The embodiment of the invention provides a scene creating method, which comprises the following steps of: recording a plurality of operation tasks executed by a user through one or more of a central control screen, an application program and an entity key in a recording time period of a first scene; then, after a trigger event of a first scene is determined from the multiple operation tasks, first information is sent to the first device, the first information comprises information used for indicating one or more execution tasks and the trigger event, the first device generates the first scene according to the first information, and in the first scene, in response to the trigger event, the first scene is executed; the one or more execution tasks are automatically executed, and the multiple operation tasks are composed of trigger events and the one or more execution tasks. Through the method, when a user hopes to generate the target scene, the target scene can be automatically generated according to the recorded operation tasks only by executing the multiple operation tasks corresponding to the target scene once, the scene creation threshold can be greatly reduced, and the scene creation efficiency can be greatly improved.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of scene creation, and more specifically, to a method and electronic device for creating a scene. Background Art

[0002] Currently, creating multi-device linkage, multi-condition, and multi-task scenario events is a complex and challenging task. If you need to create a complex scenario, you need to carefully plan the scenario events and understand the traditional scenario creation methods of IFTTT (If This Then That, that is, if a certain event occurs, then a certain action is triggered) or ECA (If k events e1, e2, ..., e k When it is concurrent and condition C is met, the logic of action a) is executed, which has high requirements on the creator's logical thinking ability; the current scene creation is mainly created by suppliers and cannot match the emerging new scene demands of consumers. Summary of the Invention

[0003] The present application provides a method and electronic device for creating a scene. Through this method and electronic device, when a user wants to generate a target scene, he only needs to perform multiple operation tasks corresponding to the target scene once, and the target scene can be automatically generated according to the recorded operation tasks, which can greatly reduce the threshold for scene creation and improve the efficiency of scene creation.

[0004] In a first aspect, a method for creating a scene is provided, which is applied to a first device, and the method includes: receiving first information, the first information including information for indicating one or more execution tasks and information for indicating a triggering event, wherein the one or more execution tasks are other operation tasks among multiple operation tasks except the triggering event, and the multiple operation tasks are operation tasks recorded by the user during the recording period of the first scene, and the multiple operation tasks are implemented through one or more of a central control screen, an application, and a physical button; generating the first scene according to the first information, and in the first scene, in response to the triggering event, the one or more execution tasks are automatically executed.

[0005] In some embodiments, the first information received by the first device may come from a server, which may be, for example, a server of multiple devices in the same whole-house smart scene, where the multiple devices in the same whole-house smart scene include the first device.

[0006] In some further embodiments, the first information received by the first device may come from a central device, which may be, for example, one of the multiple devices in the same whole-house smart scene (for example, a central control screen), or a dedicated device (for example, a host of the multiple devices). The central device has the function of recording the operations of the multiple devices in the same whole-house smart scene, and the multiple devices in the same whole-house smart scene include the first device.

[0007] In some embodiments, the triggering event is the operating task that is most likely (has the highest probability) to be the triggering event among the multiple recorded operating tasks.

[0008] Specifically, after recording and completing multiple operation tasks, the probability of each of the multiple operation tasks being a triggering event can be determined according to a specific algorithm, or the probability can be calculated based on the user's historical habits of creating scenes, and then the operation task with the highest probability of being a triggering event among the multiple operation tasks can be determined as the triggering event of the first scene.

[0009] In some embodiments, the first device is a central control screen, or the first device is a device with a central control application installed.

[0010] In an embodiment of the present application, taking the whole-house smart scene as an example, by recording the user's operations on multiple devices in the whole-house smart scene within a certain period of time (for example, it may include operations on the central control screen, operations in applications installed on the terminal device, and one or more of the physical button operations on multiple devices in the scene), and then generating a corresponding scene based on the operation record, when the user wants to generate a target scene, he only needs to perform multiple tasks corresponding to the target scene once, and the target scene can be automatically generated according to the recorded operation record. This method greatly reduces the threshold for scene creation and improves the efficiency of scene creation.

[0011] In combination with the first aspect, in a possible implementation, before generating the first scene based on the first information, the method also includes: displaying a first interface on the screen of the first device based on the first information, the first interface including a first display area and a second display area, the first display area being used to display the trigger event, and the second display area being used to display the one or more execution tasks, the one or more execution tasks being arranged in the second display area in the order in which they were recorded, and the arrangement order of the one or more execution tasks in the second display area being the same as the execution order of the one or more execution tasks in the first scene.

[0012] In an embodiment of the present application, the user can preview the generated scene before saving and applying the generated scene, so that the user can see the actual effect of the generated scene more intuitively.

[0013] In combination with the first aspect, in a possible implementation, the first interface further includes a third display area, and the third display area is used to display the effective time interval corresponding to each execution task of the one or more execution tasks.

[0014] In an embodiment of the present application, before saving and applying the generated scene, the effective time intervals of multiple execution tasks in the generated scene can be previewed, so that the user can more intuitively see the actual effect of the generated target scene.

[0015] In combination with the first aspect, in a possible implementation, a preview control is further displayed in the first interface, and the preview control is used for the user to preview the first scene.

[0016] In an embodiment of the present application, the generated scene can be trial-executed before being saved and applied, so that the user can see the actual effect of the generated scene more intuitively.

[0017] In combination with the first aspect, in a possible implementation, the method further includes: in response to a user operation of dragging the first execution task displayed in the second display area to the first display area, switching the trigger event to the first execution task.

[0018] In an embodiment of the present application, the generated target scene can be previewed and adjusted before being saved and applied, so that the user can more intuitively see the actual effect of the generated target scene. The target scene can also be adjusted in a targeted manner based on the actual preview effect, for example, the trigger event can be modified, thereby achieving a scene effect that satisfies the user more quickly.

[0019] In combination with the first aspect, in a possible implementation, the method further includes: in response to a user's drag operation, adjusting the arrangement order of the one or more execution tasks in the second display area to adjust the execution order of the one or more execution tasks in the first scene.

[0020] In an embodiment of the present application, the generated target scene can be previewed and adjusted before being saved and applied, so that the user can more intuitively see the actual effect of the generated target scene. The target scene can also be adjusted in a targeted manner based on the actual preview effect. For example, the execution order of multiple execution tasks in the scene can be modified, thereby achieving a scene effect that satisfies the user more quickly.

[0021] In combination with the first aspect, in a possible implementation, the method further includes: in response to the user's operation of deleting the second execution task displayed in the second display area, canceling the display of the second execution task in the second display area so that the second execution task is removed from the first scene.

[0022] In an embodiment of the present application, the generated target scene can be previewed and adjusted before being saved and applied, so that the user can more intuitively see the actual effect of the generated target scene. The target scene can also be adjusted in a targeted manner based on the actual preview effect. For example, one or some of the multiple execution tasks in the scene can be deleted, thereby achieving a scene effect that satisfies the user more quickly.

[0023] In combination with the first aspect, in a possible implementation, the method further includes: in response to a user triggering an operation to replace the third execution task displayed in the second display area, displaying one or more tasks to be selected on the screen of the first device; in response to a user selecting a target replacement task from the one or more tasks to be selected, replacing the third execution task displayed in the second display area with the target replacement task.

[0024] In an embodiment of the present application, the generated target scene can be previewed and adjusted before being saved and applied, so that the user can more intuitively see the actual effect of the generated target scene. The target scene can also be adjusted in a targeted manner based on the actual preview effect. For example, one or some of the multiple execution tasks in the scene can be replaced, thereby achieving a scene effect that satisfies the user more quickly.

[0025] In combination with the first aspect, in a possible implementation, the method further includes: in response to the user triggering an operation to replace the third execution task displayed in the second display area, issuing a first prompt to the user, the first prompt being used to prompt the user to perform the target replacement task; when the user confirms that the target replacement task has been executed, receiving second information, the second information being used to indicate information about the target replacement task; and replacing the third execution task displayed in the second display area with the target replacement task.

[0026] In some embodiments, the second information received by the first device may come from a server, which may be, for example, a server of multiple devices in the same whole-house smart scene, where the multiple devices in the same whole-house smart scene include the first device.

[0027] In some further embodiments, the second information received by the first device may come from a central device, which may be, for example, one of multiple devices in the same whole-house smart scene, or a dedicated device. The central device has the function of recording the operations of multiple devices in the same whole-house smart scene, and the multiple devices in the same whole-house smart scene include the first device.

[0028] In an embodiment of the present application, the generated target scene can be previewed and adjusted before being saved and applied, so that the user can more intuitively see the actual effect of the generated target scene. The target scene can also be adjusted in a targeted manner based on the actual preview effect. For example, one or some of the multiple execution tasks in the scene can be replaced, thereby achieving a scene effect that satisfies the user more quickly.

[0029] In combination with the first aspect, in a possible implementation, the method also includes: in response to the user clicking on the effective time interval corresponding to the fourth execution task in the second display area in the third display area, displaying an effective time interval adjustment box corresponding to the fourth execution task on the screen of the first device; in response to the user adjusting the effective time interval of the fourth execution task from the first time interval to the second time interval through the effective time interval adjustment box, the effective time interval corresponding to the fourth execution task in the second display area is switched to the second time interval.

[0030] In an embodiment of the present application, the generated target scene can be previewed and adjusted before being saved and applied, so that the user can more intuitively see the actual effect of the generated target scene. The target scene can also be adjusted in a targeted manner based on the actual effect of the preview. For example, the effective time interval of one or some of the multiple execution tasks in the scene can be adjusted, thereby achieving a scene effect that satisfies the user more quickly.

[0031] In combination with the first aspect, in a possible implementation, before receiving the first information sent by the server, the method also includes: in response to the user's first operation, displaying a second interface on the screen of the first device, the second interface including a first control and / or a second control, the first control being used for the user to start recording the first scene in a timed recording manner, and the second control being used for the user to start recording the first scene in an unscheduled recording manner; in response to the user clicking the first control or clicking the second control, displaying a first capsule on the screen of the first device, the first capsule being used to indicate that the scene recording process is currently in progress, the first capsule including any one or more of the first area, the second area and the third area, the first area being used to display a third control, the third control being used for the user to end the recording of the first scene, the second area being used to display the recording duration in real time, and the third area being used to display a task icon when the operation task is successfully recorded.

[0032] In an embodiment of the present application, a method for triggering scene recording is provided, and a user can trigger the recording of a scene through a central control screen or a central control application installed on a terminal device, and can also view or end the recording process of the scene in real time.

[0033] In combination with the first aspect, in one possible implementation, when the user starts recording the first scene in a timed recording mode, the second area is used to display the countdown of the recording period of the first scene; when the user starts recording the first scene in an unscheduled recording mode, the second area is used to count the recording period of the first scene from 0.

[0034] In an embodiment of the present application, during the scene recording process, the user can view the duration of the scene recording in real time, or the user can set a fixed recording duration.

[0035] In a second aspect, a method for creating a scene is provided, the method comprising: recording multiple operation tasks performed by a user during a recording period of a first scene, the multiple operation tasks being implemented through one or more of a central control screen, an application, and physical buttons; determining a triggering event for the first scene from the multiple operation tasks; sending first information to a first device, the first information comprising information for indicating one or more execution tasks and information for indicating a triggering event for the first scene, so that the first device generates the first scene according to the first information, and in the first scene, in response to the triggering event, the one or more execution tasks are automatically executed, wherein the one or more execution tasks are other operation tasks in the multiple operation tasks except the operation task that serves as the triggering event.

[0036] In some embodiments, the first device is a central control screen, or the first device is a device with a central control application installed.

[0037] In one implementation, determining the triggering event of the first scenario from the multiple operation tasks includes: determining the probability of each operation task in the multiple operation tasks being a triggering event; and determining the operation task in the multiple operation tasks with the highest probability of being a triggering event as the triggering event of the first scenario.

[0038] In an embodiment of the present application, taking the whole-house smart scene as an example, by recording the user's operations on multiple devices in the whole-house smart scene within a certain period of time (for example, it may include operations on the central control screen, operations in applications installed on the terminal device, and one or more of the physical button operations on multiple devices in the scene), and then generating a corresponding scene based on the operation record, when the user wants to generate a target scene, he only needs to perform multiple tasks corresponding to the target scene once, and the target scene can be automatically generated according to the recorded operation record. This method greatly reduces the threshold for scene creation and improves the efficiency of scene creation.

[0039] In combination with the second aspect, in a possible implementation, the method further includes: after generating the first scenario, when it is detected that the user executes the trigger event, controlling the one or more execution tasks to be automatically executed.

[0040] In combination with the second aspect, in a possible implementation, the method also includes: recording the target replacement task during the recording period of the target replacement task, the target replacement task being used to replace the first execution task, and the one or more execution tasks including the first execution task; and sending second information to the first device, the second information being used to indicate information of the target replacement task.

[0041] In an embodiment of the present application, when the user performs a task replacement operation during the preview of the scene, the server can record the user's target replacement operation and send it to the device end, thereby completing the replacement of the execution task. The process is simple to operate, greatly reduces the threshold for scene creation, and improves the efficiency of scene creation.

[0042] In a third aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory is used to store computer program code, and the processor is used to execute the computer program code stored in the memory to implement the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0043] In a fourth aspect, a server is provided, comprising a memory and a processor, wherein the memory is used to store computer program code, and the processor is used to execute the computer program code stored in the memory to implement the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0044] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program or instruction. When the computer program or instruction is executed, it implements the method in the above-mentioned first aspect or any possible implementation of the first aspect, or implements the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0045] In a sixth aspect, a chip is provided, in which instructions are stored. When the chip is run on a device, the chip executes the method in the above-mentioned first aspect or any possible implementation of the first aspect, or executes the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0046] In the seventh aspect, a computer-readable storage medium is provided, which stores a computer program or instruction. When the computer program or instruction is executed, it implements the method in the above-mentioned first aspect or any possible implementation of the first aspect, or implements the method in the above-mentioned second aspect or any possible implementation of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 is a structural diagram of an electronic device provided in an embodiment of the present application;

[0048] Figure 2 is a software structure block diagram of the electronic device provided in an embodiment of the present application;

[0049] Figure 3 It is a schematic diagram of a method for creating a scene through electronic devices;

[0050] Figure 4 This is a flowchart of triggering scene recording provided by an embodiment of the present application;

[0051] Figure 5 This is another flowchart of triggering scene recording provided by an embodiment of the present application;

[0052] Figure 6 This is a schematic diagram of an operation of a scene recording process provided by an embodiment of the present application;

[0053] Figure 7 is a schematic diagram of a scene preview and adjustment interface provided in an embodiment of the present application;

[0054] Figure 8 This is a schematic diagram of an operation for adjusting a trigger event provided by an embodiment of the present application;

[0055] Figure 9 This is a schematic diagram of an operation of adjusting a task in a scenario provided by an embodiment of the present application;

[0056] Figure 10 This is another operational diagram of adjusting tasks in a scenario provided by an embodiment of the present application;

[0057] Figure 11 This is another operational diagram of adjusting tasks in a scenario provided by an embodiment of the present application;

[0058] Figure 12 This is an interactive schematic diagram corresponding to a scene recording process provided by an embodiment of the present application;

[0059] Figure 13 This is an operational diagram of a scene creation process provided by an embodiment of the present application;

[0060] Figure 14 This is another operational diagram of a scene creation process provided by an embodiment of the present application;

[0061] Figure 15 This is a schematic interactive flow chart of a method for creating a scene provided in an embodiment of the present application;

[0062] Figure 16 This is a schematic diagram of the functional modules of a system for creating a scene provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] The technical solutions of this application will be described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of this application, rather than all the embodiments.

[0064] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" or "multiple" refers to two or more than two.

[0065] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0066] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of this application and the appended claims, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0067] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "one embodiment," "some embodiments," "another embodiment," and "other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically stated. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically stated.

[0068] The method provided in the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0069] For example, Figure 1 : The figure shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0070] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0071] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0072] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0073] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0074] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0075] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.

[0076] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0077] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0078] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0079] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0080] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0081] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0082] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0083] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0084] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0085] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0086] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0087] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0088] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0089] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0090] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0091] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0092] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0093] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0094] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an App required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0095] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0096] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0097] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0098] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0099] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0100] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0101] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0102] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0103] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0104] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an embedded SIM (eSIM) card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0105] It should be understood that the phone card in the embodiments of the present application includes but is not limited to a SIM card, an eSIM card, a universal subscriber identity module (USIM), a universal integrated circuit card (UICC), and the like.

[0106] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0107] Figure 2This is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0108] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0109] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0110] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0111] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0112] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0113] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0114] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0115] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0116] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating electronic devices, or flashing indicator lights.

[0117] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0118] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0119] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0120] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0121] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0122] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0123] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0124] A 2D graphics engine is a drawing engine for 2D drawings.

[0125] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0126] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, Hongmeng and other systems.

[0127] The technical solutions of the embodiments of the present application can be applied to electronic devices with display and central control functions. For example, they can be applied to televisions, desktop computers, laptops, and car screens. They can also be applied to portable electronic devices such as mobile phones, folding screens, tablets, cameras, video cameras, video recorders, watches, and bracelets. They can also be applied to electronic devices in 5G networks or electronic devices in future public land mobile networks (PLMNs). The main application scenario can be multi-condition and multi-task scene creation, such as whole-house smart device control scenarios and cockpit equipment smart control scenarios.

[0128] With the increasing popularity of smart devices, users have an increasing demand for linkage and collaboration between multiple devices. For example, users hope to perform multi-condition and multi-task linkage control on smart home devices throughout the house. For example, when the user opens the door, a series of operations such as turning on the lights in the living room and closing the curtains in the whole house will be automatically executed. However, at present, creating multi-device linkage and collaboration multi-condition and multi-task scene events is a complex and difficult task. If a complex scene needs to be created, the creator needs to carefully plan the scene events and be able to understand the traditional scene creation methods such as IFTTT (If This Then That, that is, if a certain event occurs, a certain action is triggered) or ECA (If k events e1, e2,…, e k When it is concurrent and condition C is met, the logic of action a) is executed, which places high demands on the creator's logical thinking ability. In addition, the process of scene creation involves a large number of non-natural language habits (for example, programming languages), which is also an important reason that hinders consumers from independently creating scenes. Currently, scene creation is mainly done by suppliers and cannot meet the emerging new scene needs of consumers.

[0129] Take the scene creation of the whole house smart home as an example, Figure 3 A schematic diagram of a method for creating a scene using an electronic device is shown.

[0130] Take the mobile phone as an example, Figure 3 As shown in (a), the display screen of the electronic device 300 is located on the desktop, and the "Smart Life" application icon is displayed on the desktop. The user can click the "Smart Life" application icon to switch the display interface of the electronic device to the following example: Figure 3 In the display interface shown in (b), a list of scenes with historical creation can be displayed (not shown in the figure). When the user wants to create a new scene, the user can select Figure 3Click the "+" control in the interface shown in (b) to switch the display interface of the electronic device 300 to the following Figure 3 The display interface shown in (c) in FIG. 1 shows an editable area 301, a control 302 for adding scene conditions, and a control 303 for adding scene tasks. The user can enter a custom scene name in the interface by clicking 301. When the user clicks control 302 in the interface, the display interface of the electronic device 300 switches to the following: Figure 3 The condition adding interface shown in (d) in the figure displays multiple selectable trigger conditions. For example, the multiple selectable trigger conditions can be "when the light is turned on" or "when smoke is detected", "when automatic execution is turned on / off", or "when the scene card is manually clicked" (when the scene is created, it will be displayed in the following figure). Figure 3 The scene card is displayed under "My Scene" in the interface shown in (b) of FIG. The user can click on the scene card in the interface), and the trigger time can also be set, such as "8 o'clock every day"; when the user selects the trigger condition of "clicking the scene card", the display interface of the electronic device 300 switches to the following Figure 3 The display interface shown in (e) of FIG, that is, the display interface of the electronic device 300 returns to the scene creation interface, and the trigger condition "When clicking this scene card" selected by the user is displayed at the control 302 for adding scene conditions in the interface; when the user further clicks the control 303 for adding scene tasks in the interface, the display interface of the electronic device 300 switches to the following Figure 3 The task adding interface shown in (f) in the figure displays a variety of task types, such as tasks related to "smart device" control (such as "turn on the light", "turn off the air conditioner", etc.), tasks related to "control scenes" (such as "execute a scene", etc.), tasks related to "system function" control (such as "send message notification", etc.), tasks related to "audio and video entertainment" control (such as "play Huawei music", etc.), and tasks related to "reminder and voice" (such as "flash", etc.); when the user clicks "smart device" on the interface, the display interface of the electronic device 300 switches to the following: Figure 3 In the display interface shown in (g), multiple selectable smart devices are displayed, and the multiple selectable smart devices may be, for example, "curtains", "living room lights", "air conditioners", etc. When the user selects "smart device 1" in the interface, the display interface of the electronic device 300 switches to the following Figure 3In the interface shown in (h), take smart device 1 as a lamp as an example. In this interface, you can choose to turn on the lamp or turn off the lamp. After the user selects "Turn on the lamp", you can further click the completion control "√" on the interface to end the task adding process. At this time, the display interface of the electronic device 300 returns to the scene creation interface. At the control 303 for adding scene tasks in this interface, the task selected by the user "Turn on the lamp of smart device 1 when clicking this scene card" is displayed; in addition, the user can also add other tasks through similar operations, such as adding the task "Turn on smart device 2". At this time, the display interface of the electronic device 300 is as follows: Figure 3 As shown in (i) in the figure; the user can also expand the task management list by clicking the selection control ":" associated with the task, and the task management list may include, for example, operation options such as "additional conditions for effectiveness", "delayed execution", and "deletion". For example, the user can set the delay for opening the smart device 2 by clicking the "delayed execution" option. If the user sets the delay for opening the smart device 2 to 10s, the display interface of the electronic device 300 will switch to the following: Figure 3 As shown in (j), in this interface, if the user clicks the completion control "√", the display interface of the electronic device 300 returns to Figure 3 The interface shown in (b) is just the display interface at this time. Figure 3 Based on the interface shown in (b), the scene card created by the user is displayed. The user can trigger the operation of the scene card by clicking on the scene card in the interface. That is to say, when the user clicks on the scene card, the operation "turn on the light of smart device 1" will be executed, and the smart device will be turned on after 10 seconds.

[0131] In this method, when creating a scene, the user is first required to understand the associated logic between conditions and tasks, and the user is required to add conditions and tasks in sequence. Multi-task scenarios require the user to repeat the process of "selecting tasks-adjusting task parameters". The creation process is complicated and has certain requirements on the user's logical ability. In addition, the user cannot preview during the scene creation process, resulting in the user being unable to perceive whether the creation is successful or not. The description of the time-delay scenario of multiple tasks is not intuitive, and the user cannot perceive the real effect.

[0132] Therefore, the current method of creating scenes is cumbersome, requires high logical ability of users, and cannot preview the scene effects, making it difficult to quickly create a scene that satisfies the user.

[0133] In view of this, an embodiment of the present application provides a method and electronic device for creating a scene. Through this method and electronic device, a corresponding scene can be generated based on a recorded operation video. The user does not need to go through tedious operations to create the scene. Moreover, the created scene can be previewed before the scene creation is completed to help the user adjust the scene settings in a targeted manner, thereby quickly creating a scene that satisfies the user.

[0134] For example, taking a smart home scenario, the electronic device is a central control screen of a smart home device as an example. Figure 4 A schematic diagram of a process for triggering scene recording provided in an embodiment of the present application is shown.

[0135] like Figure 4 As shown in (a) of the figure, the scene setting interface of the central control screen 400 may display an entrance for recording and generating a scene. The entrance for recording and generating a scene may be, for example, an option box. Parallel to the option box, there may also be an entrance for quickly generating a scene or an entrance for customizing and creating a new scene (not shown in the figure); when the user wishes to create a new scene by recording the operation process, the user may click on the entrance for recording and generating a scene to switch the display interface of the central control screen 400 to the following example: Figure 4 The interface shown in (b) in the figure, for example, displays a prompt message, which is used to remind the user that after the recording starts, the user's operations on the central control screen and the user's actual operations in the room (for example, turning on the lights by voice, turning on the air conditioner by the switch button, etc.) will be recorded. The user can select the recording method in this interface. The recording methods available to the user may include, for example, "scheduled recording" and "start immediately".

[0136] It should be understood that the recording operation described in the embodiment of the present application actually refers to the recording of operation tasks by the upper-level control center (for example, hub, cloud, etc.) corresponding to multiple devices, wherein multiple devices belong to the same scene, such as a whole-house smart scene.

[0137] In one example, when the user selects the recording mode as "Start Immediately", the display interface of the central control screen 400 enters the following Figure 4The control interface shown in (c) in FIG. 4 shows a recording process capsule 401. The recording process capsule 401 is used to express the ongoing status of recording and to display recording process information. The recording process capsule 401 includes a control 402. The control 402 can be used by the user to terminate the recording process. At the same time, the recording process capsule 401 can specifically express the ongoing status of recording through the control 402. The recording process capsule 401 can also include a timing display area 403. The timing display area 403 displays the time of the scene recording process. Since the timing mode selected by the user in this embodiment is "Start immediately", the time displayed in the timing display area 403 is The timing mode is forward timing, that is, timing starts from 0 from the moment the recording process starts. The recording process capsule 401 can also include a hit task icon 404. The hit task icon 404 is used to display the icon of the hit task when the hit task is recorded during the recording process, so as to prompt the user that the hit task has been successfully recorded in this scene. The icon of the hit task shown in the hit task icon 404 is not static, but changes as the recording process progresses. Multiple devices connected to the central control screen 400 can be controlled through the control interface. For example, the multiple devices can be lighting equipment, curtains, air conditioners, smart speakers and other devices located in the same home scene.

[0138] In one example, after the user triggers the scene recording process through the central control screen 400, the display interface of the central control screen 400 switches to the control interface, in which a recording process capsule 401 is displayed. On this basis, the user starts to actually execute the target scene. For example, the user can first perform the "turn on the living room light" operation through the control interface of the central control screen 400. At this time, the task icon 404 is hit to display the light icon, and then the air-conditioning button is used to perform the "turn on the air conditioner for the whole house" operation. At this time, the task icon 404 is hit to display the air conditioner icon, and further the central control application (for example: smart life application) installed on the mobile phone held by the user is used to perform the "close the living room curtains" operation. At this time, the task icon 404 is hit to display the curtain icon, and then the user clicks the control 402 on the central control screen 400 to end the recording process. At this time, the recorded scene tasks include "turn on the living room light", "turn on the air conditioner for the whole house", and "close the living room curtains". These tasks are arranged in the order of the time when they were triggered.

[0139] Among them, when the user ends the recording process by clicking the control 402, the display interface of the central control screen 400 switches to the scene preview and adjustment interface. Among them, the scene preview and adjustment interface will be introduced in detail in subsequent embodiments.

[0140] It should be understood that: Figure 4The method of starting the scene recording process shown is only an example. For example, the scene recording process can also be started by using a shortcut key, by voice control, or by any other possible method. This application does not limit this.

[0141] It should also be understood that: Figure 4 The recording process capsule used to express the ongoing recording in the control interface shown in (c) is only an example. The recording process capsule can also be replaced by any other display element that can express that the recording is in progress, for example, it can be replaced by a text display or a card display. This application does not limit this.

[0142] Optionally, the above-mentioned central control screen can also be replaced by other devices with display screens and central control capabilities, for example, it can be replaced by devices with central control applications installed, such as mobile phones with "Smart Life" applications installed, tablets with "Smart Life" applications installed, laptops with "Smart Life" applications installed, large screens with "Smart Life" applications installed, and other devices.

[0143] It should be understood that when a user triggers a scene recording process through other electronic devices (for example, a mobile phone with a central control application installed), after the scene recording process is triggered, the above-mentioned recording process capsule can be displayed on the other electronic device. At the same time, the recording process capsule can be displayed on the corresponding central control screen or not.

[0144] For example, taking a smart home scenario, the electronic device is a central control screen of a smart home device as an example. Figure 5 A schematic diagram of another process of triggering scene recording provided in an embodiment of the present application is shown.

[0145] Depend on Figure 5 (a) Figure 5 (b) and Figure 5 As can be seen from (c) in this embodiment, Figure 4 Similar to the embodiment shown, this embodiment is Figure 4 The difference of the embodiment shown is that when the user Figure 5 When the recording mode selected in the interface shown in (b) is "timed recording", the display interface of the central control screen 400 switches to the following Figure 5The control interface shown in (c) in the figure, in which the time display area 403 in the recording process capsule 401 displays the time in a countdown manner, that is, the countdown starts from a certain duration (for example, 00:30) from the moment the recording process begins, and the user needs to perform all recording operations before the countdown ends. The user can end the recording process in advance by clicking the control 402 after performing the recording operation, or wait for the countdown to end after performing the recording operation, and the recording process will be automatically ended after the countdown ends. After the recording process ends, the display interface of the central control screen 400 switches to the scene preview and adjustment interface, wherein the scene preview and adjustment interface will be introduced in detail in subsequent embodiments.

[0146] Below, illustratively, in combination Figure 6 and Figure 7 , a detailed introduction is given to a flow chart of creating a scene provided in an embodiment of the present application.

[0147] For example, Figure 6 A schematic diagram of the operation of a scene recording process provided in an embodiment of the present application is shown.

[0148] When the user triggers the scene recording process through the central control screen 600a and selects the recording mode as "Start Immediately" during the process of triggering the scene recording process, the display interface of the central control screen 600a enters the following Figure 6The control interface shown in (a) in the figure, in which the timing display area 603 in the recording process capsule 601 starts timing from 0, and the control interface is used to control multiple devices connected to the central control screen. In one example, the control interface displays multiple executable tasks (task 1, task 2, task 3, task 4, task 5, task 6) corresponding to multiple devices in the living room. These executable tasks can be, for example, turning on or off the light 1 in the living room, turning on or off the light 2 in the living room, opening or closing the curtain 1 in the living room, and opening or closing the curtain 2 in the living room. Optionally, the multiple executable tasks can also be replaced by some optional scene modes (for example: "warm home" mode, "safe leaving home" mode, "game" mode, "guest mode", The control interface can also display a "lights on all" control, a "lights off all" control, a "curtains open" control or a "curtains closed" control, etc., for users to uniformly control all devices in the living room. The control interface can also display music-related service cards or air-conditioning control service cards, etc., for users to control the play / pause / switch of music in the living room, the operating mode / on / off / temperature of the air-conditioning in the living room, etc.; in addition, the user can switch the control task displayed on the control interface to one or more control tasks corresponding to the whole house by clicking the "Switch" control corresponding to the "Living Room" for unified control of all devices in the house, or switch to one or more tasks corresponding to other locations in the house, for example, it can switch to one or more tasks corresponding to the master bedroom for controlling devices in a local location.

[0149] Optionally, the central control screen 600a can also be replaced by a mobile phone, tablet, laptop computer, large screen or other device.

[0150] After entering the recording process, the timing display area 603 in the recording process capsule 601 displayed on the interface of the central control screen 600a starts counting from 0, and the user performs the following operations in sequence:

[0151] (1) Execute as Figure 6 The operation shown in (b) is: manually opening the door lock at the entrance, for example, by holding the door handle and turning it downward to manually open the door lock at the entrance. For example, the door lock at the entrance can also be opened by fingerprint recognition or face recognition. After the door lock is successfully opened, the hit task icon 604 in the recording process capsule 601 displays the door lock icon.

[0152] (2) Execute as Figure 6 The operation shown in (c) is: instructing the speaker to play music 1 through voice instructions. When the instruction is successfully executed, music 1 is played, and the hit task icon 604 in the recording process capsule 601 displays the music icon.

[0153] (3) Execute as Figure 6 The operation shown in (d) is: turning on the corridor light by pressing the corridor light switch button. When the corridor light is successfully turned on, the hit task icon 604 in the recording process capsule 601 displays a light icon.

[0154] (4) Figure 6 As shown in (e), the operation of closing the living room curtains is performed by clicking the "Curtain Close" control in the living room function area on the control interface of the central control screen 600a. When the operation is successfully performed, the hit task icon 604 in the recording process capsule 601 displays the curtain icon. It can be seen that the timing duration at this time can be 00:15.

[0155] (5) Figure 6 As shown in (f), the operation of "turning on the whole-house air conditioner" is executed on the control interface corresponding to the central control application of the mobile phone 600b. When the whole-house air conditioner is successfully turned on, the hit task icon 604 in the recording process capsule 601 displays the air conditioner icon.

[0156] In some embodiments, the recording progress capsule 601 may also be displayed on the display interface of the mobile phone 600b.

[0157] Optionally, the mobile phone 600b may also be replaced by a tablet, a laptop computer, a large screen or other device.

[0158] like Figure 6 As shown in (g), after performing the above operations, the user can end the scene recording process by clicking the control 602. When the user clicks the control 602, the scene recording process ends, and the display interface of the central control screen 600a switches to the following Figure 7 The scene preview and adjustment interface shown.

[0159] In some embodiments, when the user clicks the control 602, the display interface of the mobile phone 600b may also display the following: Figure 7 The scene preview and adjustment interface shown.

[0160] For example, Figure 7 Shown with Figure 6 A schematic diagram of a scene preview and adjustment interface corresponding to the illustrated embodiment.

[0161] will be as Figure 6 The recorded scene in the embodiment is recorded as the first scene. When the user performs the following steps during the recording process of the first scene: Figure 6 After the multiple recording operations described in the embodiment shown (opening the door lock at the entrance, playing music 1 in the living room, turning on the lights in the corridor, closing the curtains in the living room, and turning on the air conditioner in the whole house) are completed and the recording process of the first scene is ended, the display interface of the device 700 is displayed as follows Figure 7The preview and adjustment interface of the first scene shown includes a task display area 701 and a duration setting area 702, wherein the device 700 can be, for example, a central control device 600a or a mobile phone 600b.

[0162] Among them, the task display area 701 includes an "When" area and an "Execute" area. The "When" area is used to display the triggering event of the first scene. If, during the process of the user recording the first scene, it is identified that there is an action in the user's operation behavior that can trigger the first scene (for example, opening the door, etc.), the action will be automatically filled into the "When" area as the triggering event of the first scene; the "Execute" area is used to display the task cards corresponding to multiple tasks performed by the user in the recording process of the first scene. When the upper control center (for example, the hub or cloud) records the user's operation behavior during the user recording the first scene, the tasks corresponding to all the recorded operation behaviors will be automatically filled into the "Execute" area. The multiple tasks filled in the "Execute" area can be arranged in the "Execute" area in the form of cards according to the time sequence of the triggering, as shown in the following example. Figure 6 The multiple tasks corresponding to the scene recording process shown are: playing music in the living room 1, turning on the lights in the corridor, closing the curtains in the living room, and turning on the air conditioner in the whole house; in addition, the user can adjust the multiple tasks, for example: the user can adjust the order of occurrence of multiple tasks by dragging the task cards; the user can also remove certain tasks from the multiple tasks by sliding the task card upwards; the user can also trigger the editing list of the task card by long pressing the task card, and the editing list may include entries such as replacing the task card and deleting the task card; the user can also edit the trigger event of the first scene by clicking the "When" area, and the user can also drag the card in the "Execute" area to the "When" area to modify the trigger event.

[0163] It should be understood that when there are many task cards in the "Execution" area, the display screen of device 700 may not be able to display all task cards at the same time. The user can view and adjust all task cards by sliding left or right on the display screen of device 700.

[0164] The duration setting area 702 is used to display the effective time intervals of the multiple tasks displayed in the task display area 701. The effective time intervals between the multiple tasks can be, for example, 1 second, or 2 seconds, etc. An effective time interval is displayed below each of the multiple tasks displayed in the task display area 701. The effective time interval is the time interval between the current task and the previous task of the current task. The user can modify the effective time interval corresponding to the target task by clicking the effective time interval displayed below the target task. For example: Figure 7Based on the interface shown, the user can modify the time interval between the "turn on the corridor lights" task and the "play music 1 in the living room" task to 2 seconds by clicking on the effective time interval below the "turn on the corridor lights" task, and can further modify the time interval between the "play music 1 in the living room" task and the trigger event "open the door lock at the entrance" to 3 seconds by clicking on the effective time interval below the "play music 1 in the living room" task. Correspondingly, when the first scene is applied, when the user opens the entrance door lock, music 1 will be automatically played in the living room after an interval of 3 seconds, the corridor lights will be automatically turned on after an interval of 2 seconds, the living room curtains will be automatically closed after an interval of 2 seconds, and the air conditioner of the whole house will be automatically turned on after an interval of 1 second, and the air conditioner will be set to cooling mode at 24℃.

[0165] Optionally, the preview and adjustment interface of the first scene may also include a preview control 703. When the user clicks the preview control 703, the corresponding first scene created is executed (that is, when the user executes the trigger event in the "When" area, the task in the "Execution" area is automatically executed based on the effective time interval in the timing display area 702), so that the user can feel the actual execution effect of the first scene before formally saving or applying the first scene. When the user is not satisfied with the scene execution effect, he or she can modify and preview it again until the user is satisfied with the scene execution effect.

[0166] Optionally, the preview and adjustment interface of the first scene may also include an undo control 704 and a forward control 705, which are used to allow the user to undo the adjustment operation or restore the withdrawn adjustment operation during the process of adjusting multiple tasks displayed in the task display area 701 or adjusting the effective time interval of task execution, so that the user can try multiple adjustment schemes to facilitate the user to complete the adjustment of the first scene faster and better.

[0167] It should be noted that there is only one triggering event for the first scenario.

[0168] The task display area 701 can also be described as a timeline for executing tasks.

[0169] In some embodiments, the effectiveness conditions of the first scene can be added based on the triggering event of the "When" area, such as executing the task displayed in the task display area 701 when the door lock is open and at night; in addition, effectiveness conditions can be added for executing the tasks displayed in the task display area 701, such as adding the effectiveness condition of executing task 5 (for example, turning on the air conditioner) to be summer.

[0170] When the first scene is created and the user is satisfied with the scene effect, the user can save the first scene by clicking the "Save" control. After the first scene is enabled, the user only needs to execute the trigger event of the first scene, and multiple operations corresponding to the first scene will be automatically executed; in addition, the user can also click the "Cancel" control to cancel the creation of the first scene.

[0171] In an embodiment of the present application, taking the whole-house smart scene as an example, by recording the user's operations on multiple devices in the whole-house smart scene within a certain period of time (for example, it may include operations on the central control screen, operations in applications installed on the terminal device, and one or more of the physical button operations on multiple devices in the scene), a corresponding scene is generated based on the operation record. When the user wants to generate a target scene, he only needs to perform multiple tasks corresponding to the target scene once, and the target scene can be automatically generated according to the recorded operation record. This method greatly reduces the threshold for scene creation and improves the efficiency of scene creation; and, the user can also preview and adjust the generated target scene before saving and applying the target scene, so that the user can more intuitively see the actual effect of the generated target scene, and can also make targeted adjustments to the target scene based on the actual preview effect, so as to achieve a scene effect that satisfies the user more quickly.

[0172] For example, Figure 8 An operation diagram of adjusting a trigger event provided by an embodiment of the present application is shown.

[0173] like Figure 8As shown in (a) in the figure, the display interface of the electronic device 800 is located in the preview and adjustment interface of the first scene, which includes a task display area 801 and a duration setting area 802, wherein the task display area 801 includes a "when" area and an "execution" area. The "when" area displays a trigger event card 803, and the trigger event is "opening the door lock at the entrance". The "execution" area displays multiple task cards, and the tasks corresponding to the multiple task cards are "playing music 1 in the living room", "turning on the spotlights in the corridor", "closing the curtains in the living room", and "turning on the air conditioner in the whole house (cooling 24°C)". The duration setting area 802 displays the effective time interval corresponding to each task in the "execution" area. For example, the effective time interval corresponding to the task "Play music 1 in the living room" is 1 second, that is, after the trigger event "Open the door lock at the entrance" is executed, music 1 is played in the living room at an interval of 1 second; the effective time interval corresponding to the task "Turn on the spotlights in the corridor" is 1 second, that is, after playing music 1 in the living room, the spotlights in the corridor are turned on at an interval of 1 second; the effective time interval corresponding to the task "Close the curtains in the living room" is 2 seconds, that is, after turning on the spotlights in the corridor, the curtains in the living room are closed at an interval of 2 seconds; the effective time interval corresponding to the task "Turn on the air conditioner in the whole house (cooling to 24℃)" is 1 second, that is, after closing the curtains in the living room, the air conditioner in the whole house is turned on (cooling to 24℃) at an interval of 1 second.

[0174] When the user wants to set the task "turn on the spotlight in the corridor" corresponding to the task card 804 as a trigger event, the user can drag the card 804 to the "When" area. At this time, the display interface of the electronic device 800 is switched to the following: Figure 8 In the interface shown in (b), in this interface, the triggering event of the first scene is changed to the task "turn on the spotlight in the corridor" corresponding to card 804, and the card 803 corresponding to the original triggering event "open the door lock at the entrance" task is automatically added to the "execution" area. The card 803 can be added to the position of card 804 in the "execution" area, and can also be added to the corresponding position in the "execution" area in the chronological order of occurrence. For example, if the "open the door lock at the entrance" task occurs before the "play music 1 in the living room" task, then card 803 is added before the card corresponding to the "play music 1 in the living room" task.

[0175] After making the above adjustments, the user can try to execute the adjusted first scene by clicking the preview control 805. During the trial execution, after the user turns on the spotlight in the corridor, the multiple tasks included in the "execution area" will be automatically executed according to the arrangement order and effective time interval; in addition, the user can also withdraw the previous adjustment operation by clicking the undo control 806. After executing the undo operation, the user can restore to the scene before the withdrawal by clicking the forward control 807.

[0176] For example, Figure 9 A schematic diagram of an operation of adjusting a task in a scenario provided by an embodiment of the present application is shown.

[0177] About Figure 9 The preview and adjustment interface of the first scene shown in (a) is explained and Figure 8 The preview and adjustment interface of the first scene shown in (b) has the same explanation, and also includes the task display area 901, the "When" area and the "Execute" area in the task display area 901, and the duration setting area 902. For the sake of brevity, they will not be repeated here.

[0178] like Figure 9 As shown in (a) in the figure, the user can trigger the display of the option box 904 associated with the task card 903 by long pressing the task card 903 located in the "Execution" area. The option box 904 includes a "Remove" option, a "Replace" option and a "More" option, wherein the "Remove" option is used for the user to remove the card 903 from the "Execution" area, that is, to remove it from the first scene created. After removal, the task will not be executed in the first scene. The "Replace" option is used for the user to replace the "Open the door lock at the entrance" task corresponding to the task card 903 with other tasks. The "More" option is used to provide the user with an entry for more other adjustment operations; when the user wants to remove the "Open the door lock at the entrance" task corresponding to the task card 903 from the tasks of the first scene (that is, the user does not want to perform the "Open the door lock at the entrance" operation in the first scene), the user can click the "Remove" option. At this time, the display interface of the electronic device 900 switches to the following Figure 9 In the interface shown in (b), in this interface, the tasks corresponding to the "execution area" no longer include the "open the door lock at the entrance" task.

[0179] After making the above adjustments, the user can try to execute the adjusted first scene by clicking the preview control 905. During the trial execution, after the user turns on the spotlight in the corridor, the multiple tasks included in the "execution area" will be automatically executed according to the arrangement order and effective time interval. At this time, the "open the door lock at the entrance" task will not be executed in the scene; in addition, the user can also withdraw the previous adjustment operation by clicking the withdraw control 906. After executing the withdraw operation, the user can restore to the scene before the withdrawal by clicking the forward control 907.

[0180] For example, Figure 10 A schematic diagram of the operation of a task in another adjustment scenario provided by an embodiment of the present application is shown.

[0181] About Figure 10 The preview and adjustment interface of the first scene shown in (a) is explained and Figure 9The preview and adjustment interface of the first scene shown in (a) has the same explanation, and also includes the task display area 1001, the "When" area and the "Execute" area in the task display area 1001, and the duration setting area 1002. For the sake of brevity, they will not be repeated here.

[0182] like Figure 10 As shown in (a) in the figure, when the user wants to replace the task "open the door lock at the entrance" corresponding to the task card 1003 in the "execution" area with the task "turn on the main light in the living room", the user can click the "replace" option in the option box 1004 associated with the card 1003. At this time, the display interface of the electronic device 1000 is switched to the following Figure 10 In the interface shown in (b) of FIG, a prompt box 1008 is displayed, and the prompt box 1008 may include, for example, the prompt content "Task recording..., please perform the target replacement task". At this time, the user performs the target replacement task, for example: the user turns on the main light of the living room by voice instructions, or the user turns on the main light of the living room by pressing the switch button. After the user completes the target replacement task, the user can click the "Confirm Execution" control to complete the replacement. In addition, the user can also click the "Cancel" control to cancel the task replacement; Figure 10 As shown in (c), after the user clicks the "Confirm Execution" control, the display interface of the electronic device 1000 returns to the preview and adjustment interface of the first scene. In this interface, the task card 1003 in the "Execution" area is replaced by the task card 1009, which corresponds to the "Turn on the main light in the living room" task.

[0183] In some embodiments, the target replacement task may be multiple replacement tasks. That is, when a user replaces a task, the target replacement task may be replaced by a plurality of replacement tasks. Figure 10 When the interface shown in (b) is displayed, multiple tasks are executed as replacement tasks. When the replacement is completed, the original task will be replaced by multiple tasks, and the multiple tasks are arranged in the order of occurrence.

[0184] In one example, when the display interface of the electronic device 1000 is located at Figure 10In the interface shown in (b), the user turns on the main light in the living room by voice instructions, and then the user turns on the spotlight in the living room by pressing the switch button, and then the user clicks the "Confirm Execution" control. At this time, the display interface of the electronic device 1000 returns to the preview and adjustment interface of the first scene. In this interface, the task card 1003 in the "Execution" area is replaced by the task card corresponding to "Turn on the main light in the living room" and the task card corresponding to "Turn on the spotlight in the living room". The task card corresponding to "Turn on the main light in the living room" is arranged after the card corresponding to "Play music in the living room 1" and before the task card corresponding to "Turn on the spotlight in the living room". The task card corresponding to "Turn on the spotlight in the living room" is arranged after the card corresponding to "Turn on the main light in the living room" and before the task card corresponding to "Close the curtains in the living room".

[0185] After making the above adjustments, the user can try to execute the adjusted first scene by clicking the preview control 1005; in addition, the user can also undo the previous adjustment operation by clicking the undo control 1006. After performing the undo operation, the user can restore to the scene before the undo by clicking the forward control 1007.

[0186] In some embodiments, when the user wishes to replace the task "open the door lock at the entrance" corresponding to the task card 1003 in the "execution" area with the task "turn on the main light in the living room", the user can click the "replace" option in the option box 904 associated with the card 903. At this time, the display interface of the electronic device 1000 is not switched to the following example. Figure 10 Instead of the interface shown in (b) in the figure, one or more tasks to be selected (for example, a list of tasks to be selected, not shown in the figure) can be displayed on the current interface. For example, the one or more tasks to be selected include the task of "turning on the main light in the living room". The user can select the task of "turning on the main light in the living room" from the one or more tasks to be selected (for example, by clicking or other operations). After the user selects the task of "turning on the main light in the living room", the preview and adjustment interface of the first scene displayed on the display interface of the electronic device 1000 is updated as shown below. Figure 10 In the interface shown in (c), specifically, in this interface, the task card 1003 located in the "Execution" area is replaced by the task card 1009, and the task card 1009 corresponds to the task of "turning on the main light in the living room".

[0187] For example, Figure 11 A schematic diagram of the operation of a task in another adjustment scenario provided by an embodiment of the present application is shown.

[0188] About Figure 11 The preview and adjustment interface of the first scene shown in (a) is explained and Figure 8The preview and adjustment interface of the first scene shown in (b) is explained in the same way, and also includes the task display area 1101, the "When" area and the "Execute" area located in the task display area 1101, and the duration setting area 1102. For the sake of brevity, they will not be repeated here.

[0189] like Figure 11 As shown in (a) in the figure, the user can trigger the display of the time interval setting box by clicking the effective time interval corresponding to the target task card in the duration setting area 1102. The user can customize the effective time interval corresponding to the target task card through the time interval setting box. For example, when the user clicks the effective time interval area 1103 corresponding to the task card corresponding to the "Play music in the living room 1" task, the time interval setting box 1104 corresponding to the "Play music in the living room 1" task is displayed on the current interface of the electronic device 1100. The user changes the effective time interval from 00:01 to 00:03 through the time interval setting box 1104. After the setting is completed, the display interface of the electronic device 1100 switches to the following: Figure 11 In the interface shown in (b), in this interface, the effective time interval corresponding to the task "Play music 1 in the living room" is 00:03.

[0190] After making the above adjustments, the user can try to execute the adjusted first scene by clicking the preview control 1105. When the adjusted first scene is executed, after the user turns on the spotlight in the corridor, music 1 is automatically played in the living room at an interval of 3 seconds; in addition, the user can also withdraw the previous adjustment operation by clicking the undo control 1106. After executing the undo operation, the user can restore to the scene before the withdrawal by clicking the forward control 1107.

[0191] In an embodiment of the present application, after the corresponding scene is generated through a recording operation, the generated target scene can be previewed and adjusted before saving and applying the scene, so that the user can more intuitively see the actual effect of the generated target scene, and can also make targeted adjustments to the target scene based on the actual preview effect, thereby achieving a scene effect that satisfies the user more quickly.

[0192] In order to more clearly understand the recording process of tasks in the scene recording process, for example, Figure 12 An interactive schematic diagram corresponding to a scene recording process provided in an embodiment of the present application is shown.

[0193] like Figure 12 As shown, taking the scenario "When the first door lock is opened, turn on the corridor lights after an interval of ×× seconds, close the living room curtains after an interval of ×× seconds, and turn on the air conditioners in the whole house after an interval of ×× seconds" as an example, the interactive process of the scene recording process may include the following steps:

[0194] S1201: After the user triggers the recording process of the scene through the central control screen, the user manually performs the operation of "opening the first door lock", for example, the user can open the first door lock by holding the door handle and turning it downward.

[0195] S1202: After the first door lock is opened, the first door lock sends a first task message to the hub, where the first task message is used to notify the hub that the task of "opening the first door lock" has been executed.

[0196] S1203: Based on the received first task information, the hub records the task of "opening the first door lock".

[0197] S1204: The user turns on the corridor light by pressing the switch panel (first switch) for controlling the corridor light.

[0198] S1205: After the first switch executes the task of "turning on the corridor lights", it sends second task information to the hub, where the second task information is used to notify the hub that the task of "turning on the corridor lights" has been executed.

[0199] S1206: Based on the received second task information, the hub records the task of "turn on the corridor lights".

[0200] S1207: The user closes the living room curtains by clicking a target control on the control interface of the central control screen.

[0201] S1208: After the central control screen executes the task of "closing the living room curtains", it sends a third task information to the hub, and the third task information is used to notify the hub that the task of "closing the living room curtains" has been executed.

[0202] S1209: Based on the received third task information, the hub records the task of "close the living room curtains".

[0203] S12010: The user turns on the air conditioner in the whole house through the control interface of the central control application (for example, smart life application) installed on the first terminal.

[0204] S1211: After the central control screen executes the task of "turning on the air conditioner in the whole house", it sends the fourth task information to the hub, and the fourth task information is used to notify the hub that the task of "turning on the air conditioner in the whole house" has been executed.

[0205] S1212: Based on the fourth task information received, the hub records the task of "turning on the air conditioner in the whole house".

[0206] S1213: After the user finishes recording the current scene, the hub sends all recorded tasks to the central control screen, namely "open the first door lock", "turn on the corridor light", "close the living room curtains", and "turn on the air conditioner for the whole house".

[0207] S1214: Based on all recorded tasks, a scene preview and adjustment interface is displayed on the central control screen.

[0208] Among them, the explanation of the scene preview and adjustment interface is in Figures 7 to 11 The illustrated embodiment has been described in detail and will not be repeated here for the sake of brevity.

[0209] For example, Figure 13 An operational schematic diagram of a scene creation process provided by an embodiment of the present application is shown.

[0210] like Figure 13 As shown in (a) in the example, if a user wants to create a scenario where "when an office application is opened on the computer in the study, the curtains in the study are closed after an interval of ×× seconds, the lights in the study are turned on after an interval of ×× seconds, the air conditioner in the study is turned on after an interval of ×× seconds, and the music in the study is paused after an interval of ×× seconds", the user can perform the following operations in sequence:

[0211] (1) Start scene recording.

[0212] In some embodiments, scene recording is triggered through the central control screen; scene recording can also be triggered through the central control application installed on the terminal device; scene recording can also be triggered by voice instructions.

[0213] (2) Close the curtains in the study.

[0214] In some embodiments, the curtains of the study can be closed manually, by pressing the close control on the control panel, by voice instructions, by the control interface of the central control screen, or by the control interface of the central control application installed on the terminal device. In addition, the curtains of the study can also be closed by other means, which are not limited in this application.

[0215] (3) Turn on the light in the study.

[0216] In some embodiments, the study light can be turned on by pressing the power control on the control panel, by voice instructions, by the control interface of the central control screen, or by the control interface of the central control application installed on the terminal device. In addition, the study light can also be turned on by other methods, which are not limited in this application.

[0217] (4) Turn on the air conditioner in the study.

[0218] In some embodiments, the air conditioner in the study can be turned on by pressing the power control on the control panel, by voice instructions, by the control interface of the central control screen, or by the control interface of the central control application installed on the terminal device. In addition, the air conditioner in the study can also be turned on by other methods, which are not limited in this application.

[0219] (5) Pause the music in the study.

[0220] In some embodiments, the music in the study can be paused by pressing the pause control on the control panel, or by voice instructions, or by the control interface of the central control screen, or by the control interface of the central control application installed on the terminal device. In addition, the music in the study can be paused by other methods, which are not limited in this application.

[0221] (6) Open office applications on the study computer.

[0222] When the user opens an office application on the study computer, the study computer sends the task information of "opening the office application on the study computer" to the hub, which records it.

[0223] (7) End scene recording.

[0224] In some embodiments, the user can end the scene recording by clicking the end control in the recording process capsule, or the scene recording can be automatically ended after the recording countdown ends, or the user can end the scene recording through a shortcut key, or the user can end the scene recording through voice instructions. In addition, the scene recording can also be ended in other possible ways, which are not limited in this application.

[0225] After the above scene recording is finished, the electronic device 1300 displays the following Figure 13 The scene preview and adjustment interface shown in (b) includes a task display area 1301 and a duration setting area 1302, wherein the device 1300 can be, for example, a central control device or a terminal device.

[0226] Among them, the task display area 1301 includes the "When" area and the "Execute" area. The device 1300 determines the task that is most suitable as a trigger event among the multiple tasks recorded in the hub, and fills it into the "When" area. The "When" area displays the trigger event of the current scene "Open the office application on the study computer"; in the "Execute" area, the task card corresponding to the task of "Close the curtains in the study", the task card corresponding to the task of "Turn on the lights in the study", the task card corresponding to the task of "Turn on the air conditioner in the study", and the task card corresponding to the task of "Pause playing music in the study" are displayed in the order they were recorded.

[0227] The user can set the effective time interval corresponding to each task card through the duration setting area 1302; the user can also replace, remove, adjust the execution order of the above task cards, etc., wherein the operation diagram of replacing, removing, adjusting the execution order of the above task cards is shown in Figures 8 to 11 The embodiments shown are described in detail and will not be repeated here for the sake of brevity.

[0228] The user can try to execute the created scene by clicking the preview control 1303; in addition, during the process of adjusting the scene, the user can also undo the last adjustment operation by clicking the undo control 1304. After performing the undo operation, the user can restore to the scene before the undo by clicking the forward control 1305.

[0229] In an embodiment of the present application, when creating a scene, the operations that can be recorded can not only be operations on the central control screen, central control application, and physical buttons, but also operations on other applications installed on the terminal device, such as opening office applications, opening emails, opening memos, opening game applications, etc., which can realize the linkage between applications and Internet of Things devices (such as wearable devices, home appliances, medical equipment, transportation equipment, etc.), making the scene creation method provided in the embodiment of the present application more applicable, and truly realizing the linkage scene between all ecological devices.

[0230] For example, Figure 14 An operational schematic diagram of another scene creation process provided by an embodiment of the present application is shown.

[0231] like Figure 14 As shown in (a) of FIG, if a user wants to create a scenario where "when the 'Online Course' app is opened on the first computer, the 'Notebook' app is opened on the first tablet after an interval of ×× seconds, the music in the study is paused after an interval of ×× seconds, and a Bluetooth connection is established between the first headset and the first computer after an interval of ×× seconds", the user can perform the following operations in sequence:

[0232] (1) Start scene recording.

[0233] In some embodiments, scene recording is triggered through the central control screen; scene recording can also be triggered through the central control application installed on the terminal device; scene recording can also be triggered by voice instructions.

[0234] (2) Open the "Online Course" application on the first computer.

[0235] In some embodiments, the "Online Course" application can be opened manually, through voice instructions, or through shortcut keys. In addition, the "Online Course" application can be opened in other possible ways, which are not limited in this application.

[0236] (3) Open the "Notebook" application on the first tablet.

[0237] In some embodiments, the "Notebook" application can be opened manually, through voice instructions, or through shortcut keys. In addition, the "Notebook" application can be opened in other possible ways, which are not limited in this application.

[0238] (4) Pause the music in the study.

[0239] In some embodiments, the music in the study can be paused by pressing the pause control on the control panel, or by voice instructions, or by the control interface of the central control screen, or by the control interface of the central control application installed on the terminal device. In addition, the music in the study can be paused by other methods, which are not limited in this application.

[0240] (5) Establish a Bluetooth connection between the first headset and the first computer.

[0241] In some embodiments, the Bluetooth connection between the first headset and the first computer can be established by a "touch and tap" method, the Bluetooth connection between the first headset and the first computer can be established by voice instructions, the Bluetooth connection between the first headset and the first computer can be established by key pairing, and in addition, the Bluetooth connection between the first headset and the first computer can be established by other possible methods, which are not limited in this application.

[0242] (6) End scene recording.

[0243] In some embodiments, the user can end the scene recording by clicking the end control in the recording process capsule, or the scene recording can be automatically ended after the recording countdown ends, or the user can end the scene recording through a shortcut key, or the user can end the scene recording through voice instructions. In addition, the scene recording can also be ended in other possible ways, which are not limited in this application.

[0244] After the above scene recording is finished, the electronic device 1400 displays the following Figure 14 The scene preview and adjustment interface shown in (b) includes a task display area 1401 and a duration setting area 1402, wherein the device 1400 can be, for example, a central control device or a terminal device.

[0245] Among them, the task display area 1401 includes the "When" area and the "Execution" area. The device 1400 determines the task that is most suitable as a trigger event among the multiple tasks recorded in the hub, and fills it into the "When" area. The "When" area displays the trigger event of the current scene "Open the "Online Course" application on the first computer"; in the "Execution" area, the task card corresponding to the task of "Open the "Notebook" application on the first tablet", the task card corresponding to the task of "Pause playing music in the study", and the task card corresponding to the task of "Establishing a Bluetooth connection between the first headset and the first computer" are displayed in the order they were recorded.

[0246] The user can set the effective time interval corresponding to each task card through the duration setting area 1402; the user can also replace, remove, adjust the execution order of the above task cards, etc., wherein the operation diagram of replacing, removing, adjusting the execution order of the above task cards is shown in Figures 8 to 11 The embodiments shown are described in detail and will not be repeated here for the sake of brevity.

[0247] The user can try to execute the created scene by clicking the preview control 1403; in addition, during the process of adjusting the scene, the user can also undo the last adjustment operation by clicking the undo control 1404. After performing the undo operation, the user can restore to the scene before the undo by clicking the forward control 1405.

[0248] In an embodiment of the present application, when creating a scene, the operations that can be recorded can not only be operations on the central control screen, central control application, and physical buttons, but also operations on other applications installed on the terminal device, such as opening office applications, opening emails, opening memos, opening game applications, etc., which can realize the linkage between applications and applications, making the scene creation method provided in the embodiment of the present application more applicable, and truly realizing the linkage scene between all ecological devices.

[0249] In some embodiments, the hub can also record multiple operation steps for performing the same task. For example, the scene "When the first computer is turned on, open the first browser, open the first website in the first browser at an interval of ×× seconds, and then open the first web page in the first website at an interval of ×× seconds" can be recorded in the above manner. For example, the hub can record a series of operations to open a certain browser and generate a scene for opening the browser, so that the user can quickly access the browser page without having to manually execute it multiple times; for example: the scene "When the first switch in the first software is turned on, the first website corresponding to the first switch is automatically opened" can be recorded in the above manner.

[0250] In some embodiments, the hub can also record the operations of multiple applications installed on the same device. For example, the scene can be recorded in the above manner: "When the first computer is turned on, the email application is opened at an interval of ×× seconds, the chat application is opened at an interval of ×× seconds, and the memo application is opened at an interval of ×× seconds."

[0251] In some embodiments, the hub can also record tasks performed on the vehicle. For example, the scene "When the vehicle travels to a distance less than 500m from home, turn on the air conditioner in the living room at an interval of ×× seconds, close the curtains in the living room at an interval of ×× seconds, turn on the spotlights in the living room at an interval of ×× seconds, and play music in the study at an interval of ×× seconds" can be recorded in the above manner. For example, the scene "When the user goes out, start preheating the vehicle at an interval of ×× seconds" can also be recorded.

[0252] It should be understood that the embodiments of the present application only provide examples of creating linkage scenarios between any one or more devices in applications, IoT devices (for example, wearable devices, home appliances, medical devices, transportation equipment, etc.), and terminal devices, but this does not constitute any limitation on the scope of application of the embodiments of the present application. Any two or more applications, any two or more IoT devices, any two or more terminal devices, and any combination of applications, IoT devices, and terminal devices, as long as they are connected to the same upper-level control center (hub, cloud, etc.), can achieve scene linkage through the method provided in the embodiments of the present application.

[0253] For example, Figure 15 FIG1 shows a schematic interactive flow chart of a method 1500 for creating a scene provided by an embodiment of the present application. Figure 15 As shown, the method 1500 includes:

[0254] S1501: During a recording period of a first scene, the server records a plurality of operation tasks performed by a user.

[0255] The recording period of the first scene is timed from the moment when the user triggers the start of the scene recording process to the moment when the user ends the scene recording process. For example, the user triggers the start of the scene recording process. Figure 4 and Figure 5 In the description of the illustrated embodiment, the user ends the scene recording process, for example, by clicking the control 402 .

[0256] Among them, multiple operation tasks performed by the user can be implemented through one or more of the central control screen, application programs, and physical buttons.

[0257] In some examples, the multiple operational tasks performed by the user include one or more of the following operational tasks:

[0258] One or more operations performed by the user through the central control screen, such as turning on the bedroom air conditioner or closing the living room curtains through the central control screen;

[0259] One or more actions performed by the user through an application, such as opening an office document on a computer in the study, turning on the main lights in the living room through a central control app installed on a mobile phone, opening a game app on a tablet or computer, or opening a music app on a mobile phone;

[0260] One or more operations performed by the user through physical buttons, such as turning on the air conditioner in the living room through the air conditioner control panel, turning on the balcony light by pressing the balcony light switch panel, etc.

[0261] S1502: The server determines a triggering event of a first scenario from multiple operation tasks.

[0262] In some embodiments, based on the principle of probability, the operation task that is most likely to be used as a triggering event is screened out from multiple operation tasks, and is determined as the triggering event of the first scenario.

[0263] S1503: The server sends first information to the first device.

[0264] The first information includes information for indicating one or more execution tasks and information for indicating a triggering event of the first scenario, wherein the one or more execution tasks are other operation tasks other than the triggering event among the multiple operation tasks recorded by the above-mentioned server.

[0265] S1504: After receiving the first information sent by the server, the first device generates a first scene according to the first information.

[0266] In the first scenario, one or more execution tasks are automatically executed in response to a triggering event of the first scenario.

[0267] In some embodiments, before the first device generates a first scene based on the first information, a first interface can be displayed on the screen of the first device based on the first information. The first interface includes a first display area and a second display area. The first display area is used to display the triggering event of the first scene, and the second display area is used to display one or more execution tasks corresponding to the first scene. The one or more execution tasks are arranged in the second display area in the order in which they were recorded.

[0268] It should be understood that the arrangement order of the one or more execution tasks in the second display area is the same as the execution order of the one or more execution tasks in the first scene.

[0269] In some embodiments, the first interface also includes a third display area, which is used to display the effective time interval corresponding to each of the one or more execution tasks, wherein the effective time interval may refer to the effective time interval between the current execution task and the previous execution task.

[0270] In some embodiments, the first interface also displays a preview control, which is used for the user to preview the first scene. The user previews the first scene, which means that the user can try to execute the first scene after clicking the preview control. For details, please refer to Figure 7 Description of the illustrated embodiment.

[0271] In some embodiments, in response to the user dragging the first execution task displayed in the second display area to the first display area, the triggering event of the first scene is switched to the first execution task. For details, see Figure 8 Description of the illustrated embodiment.

[0272] In some embodiments, the user may adjust the arrangement order of the one or more execution tasks in the second display area by dragging, so as to adjust the execution order of the one or more execution tasks in the first scene.

[0273] In some embodiments, in response to the user's operation of deleting the second execution task displayed in the second display area, the second execution task is canceled in the second display area, so that the second execution task is removed from the first scene, wherein the user's operation of deleting the second execution task displayed in the second display area can refer to Figure 9 Description of the illustrated embodiment.

[0274] In some embodiments, in response to the user triggering the operation of replacing the third execution task displayed in the second display area, the server starts recording the target replacement task, and the first device sends a first prompt to the user, where the first prompt is used to prompt the user to perform the target replacement task; when the user confirms that the target replacement task has been completed, the server receives second information sent by the server, where the second information is used to indicate information about the target replacement task; the first device further replaces the third execution task displayed in the second display area with the target replacement task. For specific examples, please refer to Figure 10 Description of the illustrated embodiment.

[0275] In some embodiments, in response to the user clicking on the effective time interval corresponding to the fourth execution task in the second display area in the third display area, an effective time interval adjustment box corresponding to the fourth execution task is displayed on the screen of the first device; in response to the user adjusting the effective time interval of the fourth execution task from the first time interval to the second time interval through the effective time interval adjustment box, the effective time interval corresponding to the fourth execution task in the second display area is switched to the second time interval. For specific examples, please refer to Figure 11 Description of the illustrated embodiment.

[0276] Optionally, the series of operations performed by the above-mentioned server can also be performed by a central device, which can be, for example, one of the multiple devices located in the same whole-house smart scene, or an independently set device. The central device has the function of recording the operations performed by the multiple devices located in the same whole-house smart scene, and the multiple devices located in the same whole-house smart scene include the first device.

[0277] In an embodiment of the present application, by recording the user's operations on multiple devices in the whole-house smart scene within a certain period of time (for example, it may include one or more of the operations on the central control screen, the operations in the application installed on the terminal device, and the physical button operations on multiple devices in the scene), and then generating a corresponding scene based on the operation record, when the user wants to generate a target scene, he only needs to perform multiple tasks corresponding to the target scene once, and the target scene can be automatically generated according to the recorded operation record. This method greatly reduces the threshold for scene creation and improves the efficiency of scene creation; and the user can also preview and adjust the generated target scene before saving and applying the target scene, so that the user can more intuitively see the actual effect of the generated target scene, and can also make targeted adjustments to the target scene according to the actual preview effect, so as to achieve a scene effect that satisfies the user more quickly.

[0278] For example, Figure 16 FIG. 1 shows a functional module diagram of a system 1600 for creating a scene according to an embodiment of the present application. Figure 16 As shown, the system 1600 includes a server 1610 and a device 1620, wherein the server 1610 includes a recording module 1611, a determination module 1612, and a transceiver module 1613, and the device 1620 includes a transceiver module 1621 and a generation module 1622. Specifically:

[0279] The recording module 1611 is configured to record a plurality of operation tasks performed by the user during a recording period of the first scene.

[0280] The recording period of the first scene starts from the moment when the user triggers the start of the scene recording process and ends at the moment when the user ends the scene recording process.

[0281] Among them, multiple operation tasks performed by the user can be implemented through one or more of the central control screen, application programs, and physical buttons.

[0282] In some examples, the multiple operational tasks performed by the user include one or more of the following operational tasks:

[0283] One or more operations performed by the user through the central control screen, such as turning on the bedroom air conditioner or closing the living room curtains through the central control screen;

[0284] One or more actions performed by the user through an application, such as opening an office document on a computer in the study, turning on the main lights in the living room through a central control app installed on a mobile phone, opening a game app on a tablet or computer, or opening a music app on a mobile phone;

[0285] One or more operations performed by the user through physical buttons, such as turning on the air conditioner in the living room through the air conditioner control panel, turning on the balcony light by pressing the balcony light switch panel, etc.

[0286] The determination module 1612 is configured to determine a triggering event of the first scenario from a plurality of operation tasks.

[0287] In some embodiments, based on the principle of probability, the operation task that is most likely to be used as a triggering event is screened out from multiple operation tasks, and is determined as the triggering event of the first scenario.

[0288] The transceiver module 1613 is configured to send first information to the first device.

[0289] The first information includes information for indicating one or more execution tasks and information for indicating a triggering event of the first scenario, wherein the one or more execution tasks are other operation tasks other than the triggering event among the multiple operation tasks recorded by the above-mentioned server.

[0290] The transceiver module 1621 is configured for the first device to receive the first information.

[0291] The generating module 1622 is configured to generate a first scene according to the first information.

[0292] In the first scenario, one or more execution tasks are automatically executed in response to a triggering event of the first scenario.

[0293] In some embodiments, the device 1620 also includes a display module for displaying a first interface on the screen of the device 1620 based on the first information, the first interface including a first display area and a second display area, the first display area being used to display the triggering event of the first scene, and the second display area being used to display one or more execution tasks corresponding to the first scene, the one or more execution tasks being arranged in the second display area in the order in which they were recorded.

[0294] It should be understood that the arrangement order of the one or more execution tasks in the second display area is the same as the execution order of the one or more execution tasks in the first scene.

[0295] In some embodiments, the first interface also includes a third display area, which is used to display the effective time interval corresponding to each of the one or more execution tasks, wherein the effective time interval may refer to the effective time interval between the current execution task and the previous execution task.

[0296] In some embodiments, a preview control is also displayed in the first interface, and the preview control is used for the user to preview the first scene.

[0297] In an embodiment of the present application, by recording the user's operations on multiple devices in the whole-house smart scene within a certain period of time (for example, it may include one or more of the operations on the central control screen, the operations in the application installed on the terminal device, and the physical button operations on multiple devices in the scene), and then generating a corresponding scene based on the operation record, when the user wants to generate a target scene, he only needs to perform multiple tasks corresponding to the target scene once, and the target scene can be automatically generated according to the recorded operation record. This method greatly reduces the threshold for scene creation and improves the efficiency of scene creation; and the user can also preview and adjust the generated target scene before saving and applying the target scene, so that the user can more intuitively see the actual effect of the generated target scene, and can also make targeted adjustments to the target scene according to the actual preview effect, so as to achieve a scene effect that satisfies the user more quickly.

[0298] One or more of the modules or units described herein can be implemented in software, hardware, or a combination of the two. When any of the above modules or units is implemented in software, the software exists in the form of computer program instructions and is stored in a memory, and a processor can be used to execute the program instructions and implement the above method flow. The processor may include, but is not limited to, at least one of the following: a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a microcontroller (MCU), or an artificial intelligence processor, etc., a computing device that runs software, each computing device may include one or more cores for executing software instructions to perform operations or processing. The processor may be built into an SoC (system on chip) or an application specific integrated circuit (ASIC), or it may be an independent semiconductor chip. In addition to the core for executing software instructions to perform operations or processing within the processor, it may further include necessary hardware accelerators, such as a field programmable gate array (FPGA), a PLD (programmable logic device), or a logic circuit that implements dedicated logic operations.

[0299] When the modules or units described in this document are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a DSP, an MCU, an artificial intelligence processor, an ASIC, a SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator, or a non-integrated discrete device, which can run the necessary software or not rely on the software to execute the above method flow.

[0300] When the modules or units described herein are implemented using software, they can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0301] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0302] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0303] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0304] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0305] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0306] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0307] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for creating a scene, characterized in that: The method is applied to a first device, and includes: receiving first information, the first information including information indicating one or more execution tasks and information indicating a triggering event, wherein the one or more execution tasks are other operation tasks among a plurality of operation tasks except the operation task serving as the triggering event, the plurality of operation tasks are operation tasks recorded as performed by a user during a recording period of a first scene, and the plurality of operation tasks are implemented via one or more of a central control screen, an application, and a physical button; The first scenario is generated according to the first information, and in the first scenario, the one or more execution tasks are automatically executed in response to the triggering event.

2. The method according to claim 1, characterized in that Before generating the first scene according to the first information, the method further includes: A first interface is displayed on the screen of the first device according to the first information, the first interface including a first display area and a second display area, the first display area is used to display the trigger event, and the second display area is used to display the one or more execution tasks, the one or more execution tasks are arranged in the second display area in the order in which they are recorded, and the arrangement order of the one or more execution tasks in the second display area is the same as the execution order of the one or more execution tasks in the first scene.

3. The method according to claim 2, characterized in that The first interface further includes a third display area, and the third display area is used to display the effective time interval corresponding to each of the one or more execution tasks.

4. The method according to claim 2 or 3, characterized in that The first interface also displays a preview control, which is used for the user to preview the first scene.

5. The method according to any one of claims 2 to 4, characterized in that The method further comprises: In response to a user operation of dragging the first execution task displayed in the second display area to the first display area, the triggering event is switched to the first execution task.

6. The method according to any one of claims 2 to 5, characterized in that The method further comprises: In response to a drag operation by the user, an arrangement order of the one or more execution tasks in the second display area is adjusted to adjust an execution order of the one or more execution tasks in the first scene.

7. The method according to any one of claims 2 to 6, characterized in that The method further comprises: In response to a user operation of deleting the second execution task displayed in the second display area, the second execution task is undisplayed in the second display area, so that the second execution task is removed from the first scene.

8. The method according to any one of claims 2 to 7, characterized in that The method further comprises: In response to a user triggering an operation of replacing a third execution task displayed in the second display area, displaying one or more tasks to be selected on the screen of the first device; In response to a user operation of selecting a target replacement task from the one or more tasks to be selected, the third execution task displayed in the second display area is replaced with the target replacement task.

9. The method according to any one of claims 2 to 7, characterized in that The method further comprises: In response to a user triggering an operation of replacing a third execution task displayed in the second display area, issuing a first prompt to the user, wherein the first prompt is used to prompt the user to execute a target replacement task; When the user confirms that the target replacement task has been completed, receiving second information, where the second information is used to indicate information about the target replacement task; The third execution task displayed in the second display area is replaced with the target replacement task.

10. The method according to claim 3, characterized in that The method further comprises: In response to a user clicking on the effective time interval corresponding to the fourth execution task in the second display area in the third display area, displaying an effective time interval adjustment box corresponding to the fourth execution task on the screen of the first device; In response to the user adjusting the effective time interval of the fourth execution task from the first time interval to the second time interval through the effective time interval adjustment box, the effective time interval corresponding to the fourth execution task in the second display area is switched to the second time interval.

11. The method according to any one of claims 1 to 10, characterized in that Before receiving the first information, the method further includes: In response to a first operation by the user, displaying a second interface on the screen of the first device, the second interface including a first control and / or a second control, the first control being used for the user to start recording the first scene in a scheduled recording mode, and the second control being used for the user to start recording the first scene in an unscheduled recording mode; In response to the user clicking the first control or clicking the second control, a first capsule is displayed on the screen of the first device, and the first capsule is used to indicate that the scene recording process is currently in progress. The first capsule includes any one or more of the first area, the second area and the third area. The first area is used to display the third control, and the third control is used for the user to end the recording of the first scene. The second area is used to display the recording time in real time, and the third area is used to display the task icon when the operation task is successfully recorded.

12. The method according to claim 11, characterized in that When the user starts recording the first scene in a timed recording mode, the second area is used to display the countdown of the recording period of the first scene; when the user starts recording the first scene in an untimed recording mode, the second area is used to count the recording period of the first scene from 0.

13. The method according to any one of claims 1 to 12, characterized in that The first device is a central control screen, or the first device is a device with a central control application installed.

14. A method for creating a scene, characterized in that: The method comprises: During the recording period of the first scene, multiple operation tasks performed by the user are recorded, wherein the multiple operation tasks are implemented through one or more of the central control screen, application programs, and physical buttons; Determining a triggering event of the first scenario from the multiple operation tasks; Sending first information to a first device, the first information including information for indicating one or more execution tasks and information for indicating a triggering event of the first scenario, so that the first device generates the first scenario according to the first information, and in the first scenario, the one or more execution tasks are automatically executed in response to the triggering event, wherein the one or more execution tasks are other operation tasks among the multiple operation tasks except the operation task that serves as the triggering event.

15. The method according to claim 14, characterized in that The method further comprises: After the first scenario is generated, when it is detected that the user executes the trigger event, the one or more execution tasks are controlled to be automatically executed.

16. The method according to claim 14 or 15, characterized in that The method further comprises: Recording the target replacement task within a recording period of the target replacement task, where the target replacement task is used to replace a first execution task, and the one or more execution tasks include the first execution task; Second information is sent to the first device, where the second information is used to indicate information about the target replacement task.

17. The method according to any one of claims 14 to 16, characterized in that Determining the triggering event of the first scenario from the multiple operation tasks includes: determining a probability of each of the plurality of operation tasks serving as a triggering event; An operation task with the highest probability of being a trigger event among the multiple operation tasks is determined as the trigger event of the first scenario.

18. An electronic device, characterized in that: include: one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 1 to 13.

19. A server, characterized in that: include: one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the server to perform the method according to any one of claims 14 to 17.

20. A computer-readable storage medium, characterized in that The storage medium stores a program or instruction. When the program or instruction is executed, the method according to any one of claims 1 to 13 or the method according to any one of claims 14 to 17 is implemented.

21. A chip, characterized in that: The chip stores instructions, and when the instructions are executed, the method according to any one of claims 1 to 13 or the method according to any one of claims 14 to 17 is implemented.

22. A computer program product, characterized in that The computer program product stores a program or instructions, and when the program or instructions are executed, the method according to any one of claims 1 to 13 or the method according to any one of claims 14 to 17 is implemented.

Images