Device control method, device, and readable storage medium

Abstract

The present application relates to the technical field of terminals, and discloses a device control method, a device, and a readable storage medium, which can solve the problem of cumbersome and time-consuming operations during device control. In the present application, a first device may associate different control scenarios with different input events in advance on the basis of a user-defined setting, which supports the first device, when in a screen-off state or a screen-locked display state, in quickly and accurately determining a corresponding control scenario in response to a one-click operation of a user, and performing control of m second devices under the corresponding control scenario in the screen-off state or the screen-locked display state. The method does not require the user to perform complex operations, and can quickly and accurately identify an operation intention of the user and respond in a timely manner, thereby providing convenient, quick, and accurate device control experience. In addition, the present application can support multi-device control based on the one-click operation in a plurality of control scenarios, and can provide the user with a comprehensive and fully covered control-scenario use experience.

Description

Device control method, device and readable storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411100030.X, filed on August 9, 2024, and entitled "Device control method, device and readable storage medium", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminal, and in particular to a device control method, a device and a readable storage medium. BACKGROUND

[0003] At present, when a device such as a mobile phone or a tablet computer is in an off-screen state, if a user wants to perform interface operation, the user needs to turn on the screen of the device, unlock the screen, and open the interface before performing the interface operation. Alternatively, when the device is in a bright screen standby state, if the user wants to perform interface operation, the user needs to unlock the screen and open the interface before performing the interface operation. The above device control process is tedious and time-consuming for the user. SUMMARY

[0004] The present application provides a device control method, a device and a readable storage medium, which can solve the problem of tedious and time-consuming operation when controlling the device, and provide a more convenient, fast and accurate device control experience.

[0005] To achieve the above-mentioned purpose, the present application adopts the following technical solutions:

[0006] The first aspect provides a device control method, which is applied to a first device, wherein the first device stores a corresponding relationship between n control scenes and n input events, the n control scenes include a first control scene, and n is an integer not less than 1. The above-mentioned method can include: the first device receives a first operation in an off-screen state or a lock screen display state, and obtains operation information of the first operation; the first device determines a first input event acting on a first screen area according to the operation information of the first operation, the first screen area belongs to a touch screen of the first device; the first device determines whether the first input event corresponds to the first control scene according to the corresponding relationship; and when the first input event corresponds to the first control scene, the first device performs control on m second devices corresponding to the first control scene, m is an integer not less than 1.

[0007] With the solution of the first aspect, the first device can pre-associate different control scenes with different input events according to a user's customized settings, so as to support, when the first device is in a screen-off state or a lock screen display state, quick and accurate determination of a corresponding control scene according to an input event corresponding to a one-key operation of the user, and control of m second devices corresponding to the control scene in the screen-off state or the lock screen display state. This method can solve the problem of complicated and time-consuming device control process, and quickly and accurately identify the operation intention of the user and respond to the operation of the user in time, thereby providing a more convenient, fast and accurate device control experience.

[0008] As an example, the operation information of the first operation can include, but is not limited to, one or more of the following: an action position of the first operation, a touch force of the first operation, a touch area of the first operation, a touch duration of the first operation, and the like.

[0009] As a possible implementation, the n control scenes further include a second control scene, and the method further includes: receiving, by the first device in the screen-off state or the lock screen display state, a second operation, and obtaining operation information of the second operation; determining, by the first device, a second input event acting on a second screen region according to the operation information of the second operation, the second screen region belonging to a touch screen of the first device; determining, by the first device according to the correspondence relationship, whether the second input event corresponds to the second control scene; and when the second input event corresponds to the second control scene, performing control on k second devices corresponding to the second control scene, k being an integer not less than 1. As an example, the second screen region is different from the first screen region, and the second control scene is different from the first control scene. In this way, this method can support one-key operation-based control of a series of second devices in multiple control scenes, thereby providing the user with a full-range, control-scene-fully-covered device control experience.

[0010] As a possible implementation, the first control scene includes any one of the following: a smart home scene, a smart office scene, and a smart medical scene. In this way, this method can support one-key operation-based control of a series of second devices in multiple control scenes such as a smart home scene, a smart office scene, and a smart medical scene, thereby providing the user with a full-range, control-scene-fully-covered device control experience.

[0011] As a possible implementation, the first control scene or the second control scene includes any of the following scenes in a smart home scene: a leaving-home scene, a coming-home scene, a sleep scene, and a night-awakening scene. In this way, this method can support one-key operation-based device control in multiple smart home scenes, thereby providing the user with a convenient device control experience.

[0012] As an example, taking the control scenario as a smart home scenario, the first device can control one smart home device (i.e., the second device described above) or multiple smart home devices in each control scenario. For example, the away scenario can involve the first device turning off a television, a sound box, an air conditioner, a lamp, and the like; the home scenario can involve the first device turning on a television, a sound box, an air conditioner, a lamp, and the like; the sleep scenario can involve the first device turning off a television, a sound box, and the like, and turning on an air conditioner, a lamp, and the like; and the night scenario can involve the first device turning on a lamp and the like. The application does not limit what control operation is performed on the second device, which can be determined according to the function of the second device, the user's settings, and the like.

[0013] As a possible implementation, the first operation is a multi-point touch operation, and the first operation satisfies a preset condition, which can include one or more of the following: satisfying a total touch area threshold, satisfying a number of touch points threshold, satisfying a total touch pressure threshold, and each of the plurality of touch points satisfying a touch pressure threshold. In this way, the device can be prevented from being misoperated due to user's accidental touch, and user experience can be improved.

[0014] As a possible implementation, the first operation includes a long press operation or a single-point touch operation, and the first operation satisfies another preset condition, which can include but is not limited to one or more of the following: satisfying a touch area threshold, and satisfying a touch pressure threshold. In this way, the device can be prevented from being misoperated due to user's accidental touch, and user experience can be improved.

[0015] As a possible implementation, the first operation is a sliding operation, and the sliding operation satisfies a preset sliding track. In this way, the device can be prevented from being misoperated due to user's accidental touch, and user experience can be improved.

[0016] As a possible implementation, the method further includes: when the first input event does not correspond to any of the n control scenarios, and the first input event corresponds to a first operation instruction, executing the first operation instruction. In this way, the first device can normally respond to other operations except control operations in the control scenario when the first device is in an off-screen state or a lock screen display state. As an example, the first operation includes any of the following operations: a sliding operation, a long press operation, a drag operation, and a single-point touch operation.

[0017] As an example, the first operation instruction includes, but is not limited to, lighting the screen, displaying a lock screen password input interface, etc. As to what the first operation instruction is, the present application does not make any limitation, which can be determined according to the state of the first device, the function of the first device, the setting of the user, etc. For example, when the first device is in a screen-off state, assuming that the received first operation is a sliding operation or a single-point touch operation, the first device can light the screen. For another example, when the first device is in a lock screen display state, assuming that the received first operation is a sliding operation or a single-point touch operation, the first device can display a lock screen password input interface. For another example, when the first device displays a home interface, assuming that the received first operation is an operation of single-point touching an application icon on the home interface, the first device can run a corresponding application task and display an application interface.

[0018] The second aspect provides a device, which can include: a touch screen configured to receive a user operation; a memory configured to store one or more programs; and a processor configured to execute the one or more programs, so that the device implements the method in any possible implementation manner of the first aspect.

[0019] The third aspect provides a readable storage medium, which stores program instructions, and the program instructions, when executed by a device, can implement the method in any possible implementation manner of the first aspect.

[0020] The fourth aspect provides a program product containing instructions, which, when executed on a device, can cause the device to perform the method in any possible implementation manner of the first aspect.

[0021] The fifth aspect provides a chip system, which includes a processing circuit and a storage medium, and the storage medium stores program instructions; the program instructions, when executed by the processing circuit, can implement the method in any possible implementation manner of the first aspect. The chip system can be composed of a chip, or can include a chip and other discrete devices. BRIEF DESCRIPTION OF DRAWINGS

[0022] FIG. 1 is a process diagram of device control provided by two devices according to an embodiment of the present application;

[0023] FIG. 2 is a hardware structure diagram of a device according to an embodiment of the present application;

[0024] FIG. 3 is a software structure diagram of a device according to an embodiment of the present application;

[0025] FIG. 4 is a flowchart of a device control method according to an embodiment of the present application;

[0026] FIG. 5 is a distribution relationship diagram of a single-screen area according to an embodiment of the present application;

[0027] FIG. 6 is a schematic diagram of two operation scenarios provided by an embodiment of the present application;

[0028] FIG. 7 is a schematic diagram of two other operation scenarios provided by an embodiment of the present application;

[0029] FIG. 8 is a flowchart of another device control method provided by an embodiment of the present application;

[0030] FIG. 9 is an interaction diagram of a device control process provided by an embodiment of the present application. DETAILED DESCRIPTION

[0031] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; "and / or" in this document only represents the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0032] In the following, the terms "first", "second", etc. are only used to distinguish different description objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects. For example, the described object is "field", and the ordinal numbers before "field" in "first field" and "second field" do not limit the position or order between "fields", and "first" and "second" do not limit whether the "fields" they modify are in the same message or not, nor do they limit the order of "first field" and "second field". For example, the described object is "level", and the ordinal numbers before "level" in "first level" and "second level" do not limit the priority between "levels". For example, the quantity of the described object is not limited, which can be one or more. For example, "first device", where the quantity of "device" can be one or more. In addition, objects modified by different prefix words can be the same or different, for example, the described object is "device", and "first device" and "second device" can be the same type of device or different type of device, for example, the described object is "information", and "first information" and "second information" can be information of the same content or information of different content. In short, the use of ordinal numbers and other prefix words in the embodiments of the present application to distinguish the description objects does not limit the described objects, and the description of the described objects in the claims or embodiments should not be limited by the use of such prefix words.

[0033] Also, in embodiments of the present application, “connection” can be direct connection or indirect connection; in addition, it can refer to electrical connection or communication connection; for example, two electrical elements A and B are connected, which can refer to that A is directly connected with B, or can refer to that A and B are indirectly connected through other electrical elements or connection medium, or can refer to that A and B are indirectly connected through other communication devices or communication medium, as long as communication between A and B can be realized.

[0034] As described in the background, the conventional device control process is tedious and time-consuming for users. In particular, for more complex scenarios, such as smart home scenarios, smart office scenarios, smart medical scenarios, and other control scenarios involving multiple devices, if the conventional method is used for multi-device control, the operation complexity of the user and the time consumption of the device control process will be increased.

[0035] Taking the smart home scenario as an example, refer to FIG. 1, which takes a smart phone as an example, and shows the process of device control by two devices provided in embodiments of the present application.

[0036] As shown in (a) of FIG. 1, when the smart phone is in the screen-off state 101a shown in (a) of FIG. 1, if the user wants to perform the control operation of the smart home device, the device screen needs to be turned on to the lock screen display state 102a, the screen needs to be unlocked to the display state 103a, and the “smart life” application interface 104a needs to be opened before the interface operation can be performed, such as the related control of one or more smart home devices such as TV, sound box, air conditioner, and router.

[0037] As shown in (b) of FIG. 1, when the smart phone is in the lock screen display state 101b shown in (b) of FIG. 1, if the user wants to perform the control operation of the smart home device, the screen needs to be unlocked to the display state 102b, and the “smart life” application interface 103b needs to be opened before the interface operation can be performed, such as the related control of one or more smart home devices such as TV, sound box, air conditioner, and router.

[0038] As shown in the device control of (a) of FIG. 1 and (b) of FIG. 1, if the user wants to perform the control operation of the smart home device, a series of complex operations are required, which is not only tedious for the user, but also takes a long time to complete the entire smart home device control process.

[0039] To solve the problems existing in the device control process, the embodiments of the present application provide a device control method, which can associate a control scene with different input events, so as to support, when a device (hereinafter referred to as a "first device" in the embodiments) is in an off-screen state or a lock-screen display state, responding to the operation of a user, controlling one or more devices (hereinafter referred to as a "second device" in the embodiments) in a corresponding control scene according to the input event corresponding to the operation. The problems of complicated operation and long time consumption in the device control process are solved, and a more convenient, fast and accurate device control experience is provided.

[0040] Taking the control scene as an intelligent home scene, based on the embodiments of the present application, a device control method is provided. The first device can, when in an off-screen state, respond to the first operation of a user, control one or more intelligent home devices (i.e., the second device described above) corresponding to a first control scene according to a first input event corresponding to the first operation, and / or respond to the second operation of a user, control one or more intelligent home devices corresponding to a second control scene according to a second input event corresponding to the second operation, and / or respond to the third operation of a user, control one or more intelligent home devices corresponding to a third control scene according to a third input event corresponding to the third operation, and so on. In this way, the user only needs to perform an operation once when the first device is in an off-screen state, and can complete the control of a series of related devices in a certain control scene.

[0041] Exemplarily, the control scene of the intelligent home scene can include but is not limited to one or more of the following scenes: a leaving-home scene, a coming-home scene, a sleep scene, a night awakening scene, etc., without specific limitation.

[0042] Among them, the first device described in the embodiments of the present application can include but is not limited to a smart phone, a netbook, a tablet computer, a smart drawing board, a handwriting board, a smart watch, a smart bracelet, a phone watch, smart glasses, a smart camera, a palm computer, a vehicle-mounted computer, a personal computer, a personal digital assistant, a portable multimedia player, an augmented reality / virtual reality device, a smart switch, a smart central control screen, a device with a touch screen of other types or structures, which is not limited by the present application.

[0043] The second device described in the embodiments of the present application can include but is not limited to an intelligent home device (such as a television, a projection device, a sound box, an air conditioner, a router, a curtain, a lamp, etc.), an intelligent office device (such as a computer, a printer, an air conditioner, a router, a paper shredder, a lamp, etc.), a smart medical device, etc.

[0044] As an example, refer to FIG. 2, which shows a hardware structure schematic diagram of a device provided by the embodiments of the present application. The device shown in FIG. 2 can be a first device or a second device.

[0045] As shown in FIG. 2, the device can include a processor 210, a memory 220, and a communication module 230.

[0046] The processor 210 can include one or more processing units.

[0047] In some embodiments, the processor 210 can further include a memory for storing instructions and data. For example, the memory in the processor 210 is a cache memory. The memory can hold instructions or data that the processor 210 has just used or is using repeatedly. If the processor 210 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 210, thus improving the efficiency of the system.

[0048] Taking the device shown in FIG. 2 as an example, in some embodiments, the processor 210 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a flight controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0049] In some embodiments, the processor 210 can include one or more interfaces. The interface can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0050] The memory 220 can include an external memory interface and / or an internal memory.

[0051] The external memory interface can be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the device. The external memory card communicates with the processor 210 through the external memory interface to implement data storage functions.

[0052] The internal memory can be used to store executable program codes. Exemplarily, the programs can include an operating system program and application programs. The executable program codes include instructions. The processor 210 executes various functional applications and data processing of the device by running the instructions stored in the internal memory. The internal memory can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function, and the like. The data storage area can store data created during use of the device, and the like. In addition, the internal memory can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage, and the like. The processor 210 executes various functional applications and data processing of the device by running the instructions stored in the internal memory and / or the instructions stored in the memory disposed in the processor.

[0053] Taking the device shown in FIG. 2 as an example, in some embodiments, the internal memory can further store a correspondence between n control scenes and n input events, and control parameters of a second device corresponding to the n control scenes, respectively, where n is an integer not less than 1.

[0054] As an example, the correspondence between the n control scenes and the n input events can include one or more of the following: a correspondence between a first input event and a first control scene, a correspondence between a second input event and a second control scene, a correspondence between a third input event and a third control scene, a correspondence between a fourth input event and a fourth control scene, and the like.

[0055] As an example, the control of the second device can include, but is not limited to, turning on, turning off, increasing temperature, decreasing temperature, increasing volume, decreasing volume, adjusting working mode, connecting to a local area network, disconnecting from a local area network, and the like, without specific limitation, depending on the function of the second device, the needs of the user, and the like.

[0056] The communication module 230 is used to support the device to implement a communication function, such as a wired communication function or a wireless communication function.

[0057] As an example, the communication module 230 can communicate with other devices through a wired transmission line such as a coaxial cable, an optical fiber, a digital subscriber line, and the like.

[0058] As an example, the communication module 230 can include a mobile communication module and / or a wireless communication module, a modem processor, and a baseband processor.

[0059] The mobile communication module can provide a solution applied to a device including 2G / 3G / 4G / 5G wireless communication, etc. The mobile communication module can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module can receive electromagnetic waves, and perform filtering, amplification, etc. on the received electromagnetic waves, and transfer to the modem processor for demodulation.

[0060] The wireless communication module can provide a solution applied to a device including wireless local area networks (WLAN) (such as a Wi-Fi network), Bluetooth BT, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. wireless communication.

[0061] Taking the device shown in FIG. 2 as an example, the device can also include a sensor module 240 and a touch screen 250 in the embodiments of the present application. The sensor module 240 can include, but is not limited to, one or more of the following: a touch sensor 240A, a pressure sensor 240B.

[0062] The touch sensor 240A, also known as a "touch panel". The touch sensor 240A is disposed on the display panel, and the touch sensor 240A and the display panel form a touch screen (also known as a display screen). The touch sensor 240A is used to detect touch operations acting on or near it. The touch sensor can transmit the collected raw information representing the touch position, touch force, touch area, and touch duration, etc. to the processor for subsequent operation information acquisition, input event generation, and subsequent processing process. In some embodiments, the processor can provide visual output related to the touch operation through the touch screen 250.

[0063] The pressure sensor 240B is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 240B can also be disposed on the display panel. There are many types of pressure sensors, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. A capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor, the capacitance between the electrodes changes. The device determines the intensity of the pressure based on the change in capacitance. When a touch operation is performed on the touch screen 250, the device can detect the touch force, etc. of the touch operation through the pressure sensor. The device can also calculate the touch position based on the detection signal of the pressure sensor 240B. In some embodiments, the pressure sensor 240B can be used to detect the touch position, touch force, touch area, touch duration, etc. of a stylus.

[0064] In some embodiments, the sensor module 240 can further include one or more of a temperature sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, an ambient light sensor, a bone conduction sensor, etc.

[0065] It can be understood that the structure shown in FIG. 2 does not constitute a specific limitation on the device. In some other embodiments of the present application, the device can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0066] For example, taking the device shown in FIG. 2 as a first device, in some embodiments, the device can further include one or more of the following modules: a universal serial bus interface, a charging management module, a power management module, a battery, an antenna, an audio module, a speaker, a receiver, a microphone, an earphone interface, a key, a motor, an indicator, a camera, etc. For the introduction of each module, please refer to the conventional technology, and the embodiments of the present application are not limited.

[0067] As an example, please refer to FIG. 3, which shows a software structure diagram of a device according to an embodiment of the present application. As shown in FIG. 3, the software architecture of the device can include an application layer, a framework layer (FWK) and a kernel layer from top to bottom.

[0068] The application layer can include a series of applications, such as a "smart life" application, a "smart office" application, a "smart medical" application, and the like shown in FIG. 3. Of course, the applications in the application layer can include, but are not limited to, a mailbox, a camera, a gallery, a calendar, a call, a map, navigation, Bluetooth, music, and other applications. For the convenience of description, the applications are referred to as applications below. The above applications can be native applications (such as applications integrated in an operating system) or functions, or third-party applications (such as applications downloaded and installed by a user through an application store), and the embodiments of the present application are not limited thereto.

[0069] The framework layer is configured to provide an application programming interface (API) and a programming framework for the applications in the application layer. As shown in FIG. 3, the framework layer can provide a window management service (WMS), an activity management service (AMS), and an input flinger service.

[0070] The window management service is configured to provide window management, such as the creation of a window, the start of a window, the deletion of a window, the movement of a window, and the management of the position, size, and style of a window.

[0071] In the embodiments of the present application, the window management service can also be configured to manage window information. The window information can include, but is not limited to, a window identifier, a window level, an identifier of an interface displayed in a window, a virtual screen object corresponding to a window, and the like. Exemplarily, the virtual screen object corresponding to a window is a displayId of a virtual screen where the window is located. For example, the displayId can be an int type parameter.

[0072] The activity management service is configured to manage Activity, and is responsible for the start, switching, scheduling of components in the system, and the management and scheduling of applications, and the like. Specifically, the AMS defines data classes respectively used to save a process (Process), an activity (Activity), and a task (Task). The data class corresponding to the process can include process file information, memory state information of the process, and an Activity, a Service, and the like contained in the process. The Activity information can be saved in an ActivityStack. The ActivityStack is configured to uniformly schedule application Activity. The ActivityStack can save information of all running Activities. The ActivityStack can also save information of Activities that have been historically run.

[0073] In the embodiments of the present application, the AMS of the device can schedule the Activity corresponding to the target window to respond to the input event of the user according to the indication of the WMS.

[0074] The input synthesis service is used for collecting, processing and distributing the user operation information. Illustratively, the input synthesis service can include two classes: InputReader and InputDispatcher. Among them, InputReader is used to convert the operation information into specific input events; InputDispatcher is used to distribute the input events. For example, the InputDispatcher can send the input events to the WMS through the dedicated channel between the InputDispatcher and the WMS. After receiving the input events, the WMS can distribute the input events to the Activity corresponding to the target window in the Activity management service, and the target window is not limited, such as the smart home application window, the smart office application window, the smart medical application window, etc. Then, the Activity corresponding to the target window can report the input events to the target application in the application layer (FIG. 3 takes the “smart life” application as an example), so that the target application determines the control scene corresponding to the input event, and then responds to the input event, and controls one or more second devices (such as smart home devices) corresponding to the control scene through the communication module.

[0075] Of course, the framework layer can also be used to provide other management services, such as package management service, content providing service, telephone management service, resource management service, notification management service, location management service, and view system, etc. Among them, the package management service is used to be responsible for the program management in the system. The content providing service is used to support an application to access the data of another application (such as the contact database), or to share its own data with other applications. The resource management service is used to provide access to non-code resources, such as access to local strings, icons, pictures, graphics, video files or layout files, etc. The notification management service is used to provide the function of displaying custom prompt information in the status bar, which can be used to convey the type of message, which can automatically disappear after a short stay, without user interaction. The location management service is used to provide processing of geographic location related services. The view system can be used to build the display interface of the application. The view system includes visual controls, such as TextBox control, List control, Grid control, Button control, and embeddable Web browser control.

[0076] The kernel layer is a layer between hardware and software. The kernel layer can include display drivers, sensor drivers, communication drivers, and the like.

[0077] In the embodiments of the present application, the sensor driver can provide operation information to the input synthesis service after detecting the operation information of the user's touch operation according to the sensor (such as a touch sensor and / or a pressure sensor, etc.) arranged on the touch screen when the user performs a touch operation on the touch screen area. For example, in some embodiments of the present application, the touch operation received by the device can include but is not limited to a multi-point touch operation, a single-point touch operation, a long press operation, a sliding operation, a drag operation, and the like of the user on the touch screen by means of a finger or a stylus, a touch pen, a touch ball, and the like. The embodiments of the present application are not limited in this regard.

[0078] The hardware includes a touch screen, a sensor (such as a touch sensor and / or a pressure sensor, etc.), and a communication module, as shown in FIG. 3.

[0079] Of course, the embodiments of the present application do not limit the specific hardware included in the device. For example, the device can also include one or more hardware such as a camera, a memory, and a microphone, and correspondingly, the kernel layer of the device can also include one or more drivers such as a camera driver, a storage driver, and a microphone driver.

[0080] It should be noted that FIG. 3 is only an example of a software structure diagram of a device, in which only the levels and software modules related to the scheme of the present application are simply listed. In actual applications, the operating system of the device can also include other levels and each level can also include other software modules for implementing one or more functions or services. The embodiments of the present application do not limit this. In addition, the embodiments of the present application do not limit the specific level in which each software module is located.

[0081] The device control method provided by the embodiments of the present application will be introduced below.

[0082] As an example, please refer to FIG. 4, which shows a device control method flowchart provided by the embodiments of the present application. As shown in FIG. 4, the control of the second device by the first device can be implemented based on S401-S403:

[0083] S401: The first device receives a first operation in an off-screen state or a lock screen display state, and obtains operation information of the first operation.

[0084] As an example, the first operation can be a touch operation. The touch operation can include but is not limited to a single-point touch operation, a multi-point touch operation, a sliding operation, a long press operation, a drag operation, and the like. The sliding operation includes, for example, a down sliding operation, an up sliding operation, a left sliding operation, a right sliding operation, and the like.

[0085] It should be noted that the above-mentioned first operation of the above-mentioned several types is only an example, and the embodiments of the present application do not limit the specific operation type of the first operation. For example, the first operation can also be a voice instruction, a hovering gesture, a body movement, etc.

[0086] The operation information of the first operation can include, but is not limited to, one or more of the following: an action position of the first operation, a touch force of the first operation, a touch area of the first operation, a touch duration of the first operation, etc.

[0087] Taking the first operation as a multi-point touch operation as an example, the operation information of the first operation can include one or more of the following: an action position of each touch point of the multi-point touch operation, a touch force of each touch point of the multi-point touch operation, a touch area of each touch point of the multi-point touch operation, a touch duration of the multi-point touch operation, etc.

[0088] Taking the first operation as a single-point touch operation (i.e. a single-click operation) as an example, the operation information of the first operation can include one or more of the following: an action position of the single-click operation, a touch force of the single-click operation, a touch area of the single-click operation, a touch duration of the single-click operation, etc.

[0089] As a possible implementation manner, the sensor driver of the first device can detect the raw data of the first operation according to the sensor (such as a touch sensor and / or a pressure sensor) arranged on the touch screen when the user performs the first operation on the touch screen, and obtain the operation information of the first operation by processing the raw data of the first operation according to a preset processing algorithm.

[0090] S402: The first device determines a first control scene according to the operation information of the first operation.

[0091] In some embodiments, the first device is pre-configured with a corresponding relationship between n control scenes and n input events, and the corresponding relationship includes a corresponding relationship between the first input event and the first control scene. The first device can determine an input event such as the first input event according to the operation information of the first operation, and determine the first control scene corresponding to the first input event according to the above-mentioned corresponding relationship.

[0092] As an example, the pre-set correspondence between the n control scenarios and the n input events can include: a correspondence between a first control scenario and a multi-point touch event acting on a first screen region, the first screen region belonging to a touch screen of the first device. Optionally, the pre-set correspondence between the n control scenarios and the n input events can further include one or more of the following: a correspondence between a second control scenario and a multi-point touch event acting on a second screen region, a correspondence between a third control scenario and a multi-point touch event acting on a third screen region, a correspondence between a fourth control scenario and a multi-point touch event acting on a fourth screen region, etc., the second screen region, the third screen region, or the fourth screen region belonging to the touch screen of the first device.

[0093] As an example, any two of the first control scenario, the second control scenario, the third control scenario, and the fourth control scenario described in the embodiments of the present application can belong to control scenarios of the same application, or can belong to control scenarios of different applications, without specific limitation, depending on the application function, device function, user self-defined setting, etc. of the first device.

[0094] As a possible implementation, after obtaining the operation information of the first operation, the sensor driver of the first device can provide the operation information of the first operation to an InputFlinger service for processing of the operation information of the first operation and distribution of the input event by the InputFlinger service.

[0095] By way of example, the InputFlinger service can include two classes: InputReader and InputDispatcher. The InputReader is used to convert the operation information of the first operation into a specific input event, such as a first input event; and the InputDispatcher is used to distribute the input event. For example, the InputDispatcher can send the first input event to a Window Manager Service (WMS) through a dedicated channel between the InputDispatcher and the WMS. Upon receiving the first input event, the WMS can distribute the first input event to an Activity corresponding to a target window in an activity management service (AMS), such as a smart home application window, a smart office application window, a smart medical application window, etc., without limitation. Subsequently, the Activity corresponding to the target window can report the first input event to a target application in an application layer, so that the target application determines the first control scenario corresponding to the first input event according to the above correspondence, and then responds to the first input event.

[0096] For example, in the smart home scenario, as an example, it is assumed that the first operation is a multi-point touch operation on the first screen area, the first device determines a multi-point touch event on the first screen area according to the operation information of the first operation, and determines a first control scene corresponding to the multi-point touch event on the first screen area, such as a leaving home scene, according to the pre-set correspondence between the n control scenes and the n input events. It is assumed that the first operation is a multi-point touch operation on the second screen area, the first device determines a multi-point touch event on the second screen area according to the operation information of the first operation, and determines a first control scene corresponding to the multi-point touch event on the second screen area, such as a coming home scene, according to the pre-set correspondence between the n control scenes and the n input events. It is assumed that the first operation is a multi-point touch operation on the third screen area, the first device determines a multi-point touch event on the third screen area according to the operation information of the first operation, and determines a first control scene corresponding to the multi-point touch event on the third screen area, such as a sleep scene, according to the pre-set correspondence between the n control scenes and the n input events. It is assumed that the first operation is a multi-point touch operation on the fourth screen area, the first device determines a multi-point touch event on the fourth screen area according to the operation information of the first operation, and determines a first control scene corresponding to the multi-point touch event on the fourth screen area, such as a getting up at night scene, according to the pre-set correspondence between the n control scenes and the n input events.

[0097] For example, in the smart home scenario, as an example, it is assumed that the first operation is a multi-point touch operation on the first screen area, the first device determines a multi-point touch event on the first screen area according to the operation information of the first operation, and determines a first control scene corresponding to the multi-point touch event on the first screen area, such as a leaving home scene, according to the pre-set correspondence between the n control scenes and the n input events. It is assumed that the first operation is a multi-point touch operation on the second screen area, the first device determines a multi-point touch event on the second screen area according to the operation information of the first operation, and determines a first control scene corresponding to the multi-point touch event on the second screen area, such as a coming home scene, according to the pre-set correspondence between the n control scenes and the n input events. It is assumed that the first operation is a multi-point touch operation on the third screen area, the first device determines a multi-point touch event on the third screen area according to the operation information of the first operation, and determines a first control scene corresponding to the multi-point touch event on the third screen area, such as a sleep scene, according to the pre-set correspondence between the n control scenes and the n input events. It is assumed that the first operation is a multi-point touch operation on the fourth screen area, the first device determines a multi-point touch event on the fourth screen area according to the operation information of the first operation, and determines a first control scene corresponding to the multi-point touch event on the fourth screen area, such as a getting up at night scene, according to the pre-set correspondence between the n control scenes and the n input events.

[0098] As an example, the first screen area can be area 501 shown in (a) of FIG. 5, the second screen area can be area 502 shown in (a) of FIG. 5, the third screen area can be area 503 shown in (a) of FIG. 5, and the fourth screen area can be area 504 shown in (a) of FIG. 5.

[0099] It should be noted that the distribution relationship of the screen areas shown in (a) of FIG. 5 is only an example, and in actual application, the division manner of the touch screen of the first device is not limited, such as the number of screen areas, the shape and position of each screen area, and the like. For example, the touch screen of the first device can also be divided into area 505 and area 506 shown in (b) of FIG. 5; for another example, the touch screen of the first device can also be divided into area 507 and area 508 shown in (c) of FIG. 5.

[0100] S403: The first device performs control on the m second devices corresponding to the first control scenario, where m is an integer greater than or equal to 1.

[0101] In some embodiments, the first device is pre-configured with control parameters of the second devices corresponding to n control scenarios respectively, including the control parameters of the m second devices corresponding to the first control scenario; the first device can determine the control parameters of the m second devices corresponding to the first control scenario according to the control parameters of the second devices corresponding to the n control scenarios respectively, and send control instructions to the m second devices according to the control parameters to perform control on the m second devices.

[0102] In the embodiments of the present application, each control scenario can involve control on one second device, or can involve control on multiple second devices, which is not limited.

[0103] Taking the smart home scenario as an example, each control scenario can involve control of the first device on one smart home device (i.e., the second device described above), or can involve control on multiple smart home devices. For example, the away-from-home scenario can involve the first device turning off the smart home devices such as a television, a sound box, an air conditioner, and a lamp; the home-coming scenario can involve the first device turning on the smart home devices such as a television, a sound box, an air conditioner, and a lamp; the sleep scenario can involve the first device turning off the smart home devices such as a television and a sound box, and turning on the smart home devices such as an air conditioner and a lamp; and the wake-up scenario can involve the first device turning on the smart home devices such as a lamp. As to what control operation is performed on the second device, the embodiments of the present application are not limited, which can be determined according to the function of the second device, the user's settings, and the like.

[0104] Based on the device control method shown in FIG. 4, the first device can pre-associate different control scenarios with different input events according to the user's self-defined settings, so as to support, when the first device is in the screen-off state or the lock screen display state, quick and accurate determination of the corresponding control scenario according to the input event corresponding to the one-key operation of the user, and execution of the control on the m second devices corresponding to the control scenario in the screen-off state or the lock screen display state. This method can solve the problem of tedious and time-consuming operation in the conventional device control process, quickly and accurately identify the operation intention of the user and respond to the operation of the user in time, and provide a more convenient, fast and accurate device control experience. In addition, this method can support one-key operation for a series of second devices in a variety of control scenarios, thus providing the user with a full range of device control experience covering all control scenarios.

[0105] In some embodiments, the first device can also receive a second operation in the screen-off state or the lock screen display state, obtain operation information of the second operation, determine a second control scenario according to the operation information of the second operation, and perform control on k second devices corresponding to the second control scenario, where k is an integer not less than 1. The second operation is different from the screen area on which the first operation acts, such as the first operation acting on the first screen area and the second operation acting on the second screen area. The second control scenario is different from the first control scenario.

[0106] In some embodiments, in order to prevent misoperation caused by user's accidental touch, the first operation for triggering control on the m second devices corresponding to the first control scenario can be a user operation that is not prone to misoperation. For example, the first operation can meet a preset condition or a preset sliding track. By setting the first operation for triggering control on the m second devices corresponding to the first control scenario as a user operation that is not prone to misoperation, misoperation caused by user's accidental touch can be prevented, and user experience can be improved.

[0107] As an example, the first operation is a multi-point touch operation, and the first operation meets a preset condition, which can include but is not limited to one or more of the following: meeting a total touch area threshold, meeting a touch point quantity threshold, meeting a total touch pressure threshold, each of the plurality of touch points meeting a touch pressure threshold, etc.

[0108] As an example, the first operation includes a long press operation or a single-point touch operation, and the first operation meets another preset condition, which can include but is not limited to one or more of the following: meeting a touch area threshold, meeting a touch pressure threshold, etc.

[0109] As an example, the first operation is a sliding operation, and the first operation meets a preset sliding track.

[0110] For example, referring to (a) of FIG. 6, (a) of FIG. 6 shows a schematic diagram of an operation scenario provided by an embodiment of the present application. As shown in (a) of FIG. 6, assuming that the first device receives a five-finger touch operation (i.e., the first operation described above) of a user on the touch screen, the first device determines, by analyzing operation information of the five-finger touch operation, that operation information of four-finger touch acting on region 601 satisfies a preset condition, for example, the preset condition includes one or more of the following: satisfying a total touch area threshold, satisfying a touch point quantity threshold, satisfying a total touch pressure threshold, and each of the plurality of touch points satisfying a touch pressure threshold, and then determines a first control scenario corresponding to the four-finger touch operation, and further responds to the operation of the user. In addition, the first device determines, by analyzing operation information of the five-finger touch operation, that operation information of single-point touch acting on region 602 does not satisfy the preset condition, and then gives up subsequent analysis and processing based on the operation information of the single-point touch. In this example, assuming that the multi-point touch acting on region 601 and satisfying the preset condition corresponds to control scenario A, the first device responds to the first operation of the user to perform a device control operation corresponding to control scenario A.

[0111] Alternatively, for example, referring to (b) of FIG. 6, (b) of FIG. 6 shows another schematic diagram of an operation scenario provided by an embodiment of the present application. As shown in (b) of FIG. 6, assuming that the first device receives a five-finger touch operation (i.e., the first operation described above) of a user on the touch screen, the first device determines, by analyzing operation information of the five-finger touch operation, that operation information of four-finger touch acting on region 602 satisfies a preset condition, for example, the preset condition includes one or more of the following: satisfying a total touch area threshold, satisfying a touch point quantity threshold, satisfying a total touch pressure threshold, and each of the plurality of touch points satisfying a touch pressure threshold, and then determines a first control scenario corresponding to the four-finger touch operation, and further responds to the operation of the user. In addition, the first device determines, by analyzing operation information of the five-finger touch operation, that operation information of single-point touch acting on region 601 does not satisfy the preset condition, and then gives up subsequent analysis and processing based on the operation information of the single-point touch. In this example, assuming that the multi-point touch acting on region 602 and satisfying the preset condition corresponds to control scenario B, the first device responds to the first operation of the user to perform a device control operation corresponding to control scenario B.

[0112] It should be noted that FIG. 6(a) and FIG. 6(b) only take the first device receiving the first operation in the screen-off state as an example. In actual application, as shown in FIG. 7(a), if the first device receives the first operation in the lock screen display state, the operation information of the five-finger touch operation can be analyzed to determine whether the operation information of the four-finger touch on the region 701 and the single-point touch on the region 702 shown in FIG. 7(a) meets the preset condition, and the control scenario corresponding to the first operation, such as the control scenario A, is determined according to the analysis result, and the device control operation corresponding to the control scenario A is executed in response to the user's operation. In addition, the operation information of the five-finger touch operation can be analyzed to determine whether the operation information of the four-finger touch on the region 702 and the single-point touch on the region 701 shown in FIG. 7(b) meets the preset condition, and the control scenario corresponding to the first operation, such as the control scenario B, is determined according to the analysis result, and the device control operation corresponding to the control scenario B is executed in response to the user's operation.

[0113] In addition, the above embodiments only take the first device in the screen-off state or the lock screen display state as an example, and control the m second devices in the corresponding control scenario according to the first operation of the user. In actual application, the device control method provided by the embodiments of the present application can also be applied to the first device in the unlocked display state. For example, during the display of the interface (such as a desktop, an application interface, etc.) of the first device that has been unlocked, when the first operation is received, the first device can obtain the operation information of the first operation, determine the input event according to the operation information of the first operation, determine the control scenario corresponding to the input event according to the preset corresponding relationship between the n control scenarios and the n input events, and perform control on the m second devices corresponding to the control scenario.

[0114] FIG. 4 only takes the input event corresponding to the first operation of the user and the first control scenario as an example. In some embodiments, the input event corresponding to the first operation can have a corresponding relationship with the second control scenario. For this case, the first device can determine the second control scenario according to the operation information of the first operation, and perform control on the k second devices corresponding to the second control scenario. For related introduction of the first device determining the second control scenario according to the operation information of the first operation, and performing control on the k second devices corresponding to the second control scenario, reference can be made to the description of S402 and S403 above, which will not be repeated here.

[0115] In some embodiments, the input event corresponding to the first operation can have no corresponding relationship with the control scene, for example, the input event corresponding to the first operation does not correspond to any of the n control scenes described above. For example, as shown in S801 of FIG. 8, the first device determines, according to the operation information of the first operation, that the input event corresponding to the first operation corresponds to a first operation instruction. For this case, as shown in S802 of FIG. 8, the first device executes the first operation instruction.

[0116] For example, the first operation instruction can include, but is not limited to, turning on the screen, displaying a lock screen password input interface, etc. As to what the first operation instruction is, embodiments of the present application are not limited, which can be determined according to the state of the first device, the function of the first device, the user's settings, etc. For example, when the first device is in a screen-off state, assuming that the received first operation is a sliding operation or a single-point touch operation, the first device can turn on the screen. For another example, when the first device is in a lock screen display state, assuming that the received first operation is a sliding operation or a single-point touch operation, the first device can display a lock screen password input interface. For another example, when the first device displays a main interface, assuming that the received first operation is an operation of single-point touching an application icon on the main interface, the first device can run a corresponding application task and display an application interface.

[0117] In some embodiments, the priority of the input event corresponding to the control scene set by the user in advance can be higher than the priority of other input events. For example, taking a display interface of an unlocked first device as an example, the interface includes control A, when a touch operation of a user is received, assuming that the touch area corresponding to the touch operation includes a screen area where control A is located, since the priority of the multi-point touch event is higher than the priority of the single-point touch event, the first device first determines, according to the operation information of the touch operation, whether the touch operation is a multi-point touch operation that meets the preset condition, if yes, the first device responds to the touch operation and executes the control of the m second devices corresponding to the multi-point touch event in the control scene. If not, the first device determines, according to the operation information of the touch operation, whether the touch operation is another preset operation such as a sliding operation or a single-point touch operation, and responds to the touch operation according to the determination result.

[0118] In this example, by setting that the priority of the multi-point touch operation is higher than the priority of the single-point touch operation, not only the speed, reliability and accuracy of responding to the user operation in a complex control scene can be provided, but also the problem of incorrect response of the first device to the single-point touch operation can be avoided, and the user can not have a bad use experience.

[0119] As an example, refer to FIG. 9, in which the priority of the touch operation from high to low is: multi-point touch operation meeting preset condition > sliding operation > single-point touch operation. The multi-point touch operation meeting preset condition corresponds to control scene. As an example, a device control process interaction diagram provided by the embodiment of the present application is shown.

[0120] As shown in S901-S902 in FIG. 9, the first device can support the user to make related settings of n control scenes on the application interface displayed by the first device, such as the "smart life" application interface and the like, including but not limited to making settings of the trigger operation corresponding to each of the n control scenes, and making settings of the control operation of the second device corresponding to each of the n control scenes. The first device can generate the corresponding relationship between the n control scenes and the n input events according to the trigger operation of each of the n control scenes, and determine the control parameter of the second device corresponding to each of the n control scenes according to the control operation settings of the second device corresponding to each of the n control scenes set by the user.

[0121] As shown in S903 in FIG. 9, when the touch screen of the first device in the screen-off state detects that the user is close to the touch screen, the screen is turned on to display the lock screen interface.

[0122] As shown in S904 in FIG. 9, when the first device detects the first operation, it determines whether the first operation is a multi-point touch operation meeting preset condition according to the operation information of the first operation.

[0123] If the first device determines that the first operation is a multi-point touch operation meeting preset condition according to the operation information of the first operation, the first device performs the following S905, as shown in FIG. 9.

[0124] As shown in S905 in FIG. 9, the first device determines the corresponding control scene according to the operation area of the multi-point touch operation meeting preset condition, and instructs the host device (FIG. 9 takes host device 1 and host device 2 as an example) to perform device control operation according to the control parameter corresponding to the control scene. As an example, taking the smart home scene as an example, the host device 1 can be a programmable logic controller (PLC) host, and the host device 2 can be a control hub device. As shown in S905 in FIG. 9, the host device 1 and the host device 2 perform control on device A and device B respectively according to the control parameter. Wherein, device A and device B are the second device described above, the host device 1 is the control device of device A, and the host device 2 is the control device of device B.

[0125] FIG. 9 only takes the control scenario involving two second devices as an example, and the number of second devices involved in the control scenario is not limited in actual application. In addition, the example shown in FIG. 9 only takes the first device controlling the second device through the host device as an example, and the manner in which the first device controls the second device is not limited in actual application, for example, the first device can also directly control the second device according to the control parameter corresponding to the control scenario.

[0126] If the first device determines according to the operation information of the first operation that the first operation is not the multi-point touch operation satisfying the preset condition, the first device performs S906 as shown in FIG. 9.

[0127] As shown in S906 in FIG. 9, the first device determines that the first operation is a sliding operation, and performs an action corresponding to the sliding operation. For example, the action corresponding to the sliding operation is to display a lock screen password input interface as shown in S906 in FIG. 9.

[0128] If the first device determines according to the operation information of the first operation that the first operation is not the multi-point touch operation satisfying the preset condition, and is also not a sliding operation, the first device performs S907 as shown in FIG. 9.

[0129] As shown in S907 in FIG. 9, the first device determines that the first operation is a single-point touch operation, and performs an action corresponding to the single-point touch operation. For example, the action corresponding to the single-point touch operation is to start the device C as shown in S907 in FIG. 9.

[0130] FIG. 9 only takes the first device receiving the first operation of the user after the screen is on as an example, and the first device can also receive the first operation when the screen is off, such as the multi-point touch operation satisfying the preset condition, and perform the operations shown in S904-S907 in FIG. 9 when the screen is off, which is not limited.

[0131] It should be understood that the various schemes of the embodiments of the present application can be reasonably combined for use, and the explanation or description of each term appearing in the embodiments can be mutually referenced or explained in various embodiments, and this is not limited.

[0132] It should also be understood that in various embodiments of the present application, the size of the serial number of each process does not mean the order of execution, and the execution order of each process should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0133] It is understood that, in order to implement the functions of any one of the above embodiments, the device (e.g., the first device) comprises hardware structures and / or software modules corresponding to the respective functions. Those skilled in the art should easily understand that, in combination with the units and algorithm steps of the examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0134] It should also be understood that each module in the device (e.g., the first device) can be implemented in the form of software and / or hardware, and is not specifically limited. In other words, the device (e.g., the first device) is presented in the form of functional modules. The "module" herein can refer to an application specific integrated circuit (ASIC), a circuit, a processor and a memory executing one or more software or firmware programs, an integrated logic circuit, and / or other devices that can provide the above functions.

[0135] In an alternative manner, when data transmission is implemented using software, it can be implemented in the form of a program product (also referred to as a computer program product) in whole or in part. The program product comprises one or more program instructions. When the program instructions are loaded and executed on a device, the processes or functions described in the embodiments of the present application are implemented in whole or in part.

[0136] The steps of the methods or algorithms described in combination with the embodiments of the present application can be implemented in the form of hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in a random access memory, a flash memory, a read-only memory, an erasable programmable read-only memory, an electrically erasable read-only memory, a register, a hard disk, a mobile hard disk, a read-only optical drive, or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). In addition, the ASIC can be located in the device (e.g., the first device). Of course, the processor and the storage medium can also exist as discrete components.

[0137] Through the description of the above embodiments, those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional modules is exemplified, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

Claims

1. A device control method characterized by, The method is applied to a first device, the first device stores a correspondence between n control scenes and n input events, the n control scenes include a first control scene, n is an integer greater than or equal to 1, and the method includes the following steps. Receiving a first operation in a screen-off state or a lock screen display state, and obtaining operation information of the first operation; Determining a first input event acting on a first screen region according to the operation information of the first operation, the first screen region belonging to a touch screen of the first device; Determining whether the first input event corresponds to the first control scene according to the correspondence; When the first input event corresponds to the first control scene, performing control on m second devices corresponding to the first control scene, m being an integer greater than or equal to 1.

2. The method of claim 1, wherein, The n control scenes further include a second control scene, and the method further includes the following steps. Receiving a second operation in a screen-off state or a lock screen display state, and obtaining operation information of the second operation; Determining a second input event acting on a second screen region according to the operation information of the second operation, the second screen region belonging to the touch screen of the first device; Determining whether the second input event corresponds to the second control scene according to the correspondence; When the second input event corresponds to the second control scene, performing control on k second devices corresponding to the second control scene, k being an integer greater than or equal to 1.

3. The method according to claim 1 or 2, characterized in that, The first control scene includes any one of the following: a smart home scene, a smart office scene, and a smart medical scene.

4. The method according to claim 2 or 3, characterized in that, The first control scene or the second control scene includes any one of the following scenes in the smart home scene: a leaving home scene, a coming home scene, a sleep scene, and a night awakening scene.

5. The method according to any one of claims 1-4, characterized in that, The second screen region is different from the first screen region, and the second control scene is different from the first control scene.

6. The method of any one of claims 1-5, wherein The first operation is a multi-point touch operation, and the multi-point touch operation satisfies a preset condition, and the preset condition includes one or more of the following: satisfying a total touch area threshold, satisfying a touch point number threshold, satisfying a total touch pressure threshold, and each of the plurality of touch points satisfying a touch pressure threshold.

7. The method of claim 2, wherein, The method further includes the following steps. When the first input event does not correspond to any one of the n control scenes, and the first input event corresponds to a first operation instruction, performing the first operation instruction.

8. The method according to any one of claims 1-7, characterized in that, The first operation includes any one of the following operations: a sliding operation, a long-pressing operation, a dragging operation, and a single-point touch operation.

9. An apparatus, comprising: The device includes: a touch screen configured to receive a user operation; a memory configured to store one or more programs; a processor configured to execute the one or more programs, so that the device implements the method of any one of claims 1-8.

10. A readable storage medium, characterized by, The readable storage medium stores program instructions, and the program instructions are executed by a device to implement the method of any one of claims 1-8.

Images