Device control method and apparatus, storage medium, and electronic device

Abstract

The application discloses a device control method and device, a storage medium and an electronic device. The device control method can be applied to an electronic device including a touch display screen, and the method includes: receiving information of a first gesture; displaying at least one icon if the first gesture contains a preset trigger gesture, each icon being used for representing a window mode; obtaining a gesture end position of the first gesture; determining a window mode represented by a corresponding icon as a target window mode if it is detected that the gesture end position of the first gesture is located at a display position of the icon; obtaining information of a target application, and displaying the information of the target application in the target window mode, the target application being an application corresponding to information displayed by the touch display screen when the first gesture is received. The application can improve the operability of the electronic device.

Description

[0001] This application is a divisional application of the Chinese Patent Application No. 202010658123.X, filed on July 9, 2020, entitled "Device Control Method, Device, Storage Medium and Electronic Device", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application belongs to the technical field of electronic devices, and particularly relates to a device control method, device, storage medium and electronic device. BACKGROUND

[0003] With the development of technology, the ways of human-computer interaction are more and more diverse. For example, a user can interact with an electronic device through a touch operation on a display screen, or the user can interact with the electronic device through voice control, and so on. However, in the related art, the operability of the electronic device is still low during the interaction. SUMMARY

[0004] The embodiments of the present application provide a device control method, device, storage medium and electronic device, which can improve the operability of the electronic device.

[0005] In a first aspect, the embodiments of the present application provide a device control method applied to an electronic device, wherein the electronic device comprises a touch display screen, and the method comprises:

[0006] receiving information of a first gesture;

[0007] if the first gesture comprises a preset trigger gesture, displaying at least one icon, each icon being used to represent a window mode;

[0008] obtaining a gesture end position of the first gesture;

[0009] if it is detected that the gesture end position of the first gesture is located at a display position of an icon, determining a window mode represented by a corresponding icon as a target window mode;

[0010] obtaining information of a target application, and displaying the information of the target application in the target window mode, the target application being an application corresponding to information displayed by the touch display screen when the first gesture is received.

[0011] In a second aspect, the embodiments of the present application provide a device control device applied to an electronic device, wherein the electronic device comprises a touch display screen, and the device comprises:

[0012] a first receiving module configured to receive information of a first gesture;

[0013] The first display module is configured to display at least one icon if the first gesture comprises a preset trigger gesture, each of the icons representing a window mode.

[0014] The second receiving module is configured to acquire a gesture end position of the first gesture.

[0015] The determining module is configured to determine a window mode represented by a corresponding icon as a target window mode if the gesture end position of the first gesture is detected to be located at a display position of the icon.

[0016] The second display module is configured to acquire information of a target application, and display the information of the target application in the target window mode, the target application being an application corresponding to information displayed by the touch display screen when the first gesture is received.

[0017] In a third aspect, an embodiment of the present application provides a storage medium having a computer program stored thereon, and when the computer program is executed on a computer, the computer is caused to execute the flow of the device control method provided by the embodiment of the present application.

[0018] In a fourth aspect, an embodiment of the present application further provides an electronic device including a memory, a processor and a touch display screen, the processor being configured to execute the flow of the device control method provided by the embodiment of the present application by invoking a computer program stored in the memory.

[0019] In the embodiment of the present application, the electronic device can receive information of a first gesture, and if it is detected that the first gesture comprises a preset trigger gesture, the electronic device can display at least one icon, each of the icons representing a window mode. Then, the electronic device can acquire a gesture end position of the first gesture, and when the gesture end position of the first gesture is located at a display position of a certain icon, the electronic device can determine a window mode represented by the corresponding icon as a target window mode. Then, the electronic device can display information of a target application in the target window mode, the target application being an application corresponding to information displayed by the touch display screen when the first gesture is received. Since the embodiment of the present application can display information of a target application in a corresponding window mode when an electronic device receives a first gesture comprising a preset trigger gesture, the electronic device can quickly enter a certain window mode, that is, the embodiment of the present application can improve the operability of the electronic device. BRIEF DESCRIPTION OF DRAWINGS

[0020] The technical scheme and the beneficial effects of the present application will become apparent after a detailed description of the specific embodiments of the present application is made with reference to the accompanying drawings.

[0021] Figure 1 is a flowchart of the device control method provided by the embodiment of the present application.

[0022] Figure 2 This is another schematic flowchart of the device control method provided in the embodiments of this application.

[0023] Figures 3 to 12 These are schematic diagrams illustrating various scenarios of the device control method provided in the embodiments of this application.

[0024] Figure 13 This is a schematic diagram of the structure of the device control apparatus provided in the embodiments of this application.

[0025] Figure 14 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application.

[0026] Figure 15 This is another structural schematic diagram of the electronic device provided in the embodiments of this application. Detailed Implementation

[0027] Please refer to the illustrations, where the same component symbols represent the same components. The principles of this application are illustrated by example in a suitable computing environment. The following description is based on the specific embodiments of this application illustrated, and should not be construed as limiting other specific embodiments not detailed herein.

[0028] It is understood that the execution subject of the embodiments of this application may be an electronic device such as a smartphone or tablet computer.

[0029] Please see Figure 1 , Figure 1 This is a schematic flowchart of a device control method provided in an embodiment of this application. This device control method can be applied to an electronic device, which may include a touch screen. The process may include:

[0030] 101. Receive the information from the first gesture.

[0031] With the development of technology, the ways of human-computer interaction are becoming increasingly diverse. For example, users can interact with electronic devices by touching the screen or by using voice control, and so on. However, in these technologies, the operability of electronic devices during interaction remains relatively low.

[0032] In the embodiments of this application, for example, the electronic device can first receive a gesture from the user, for example, the gesture is denoted as the first gesture, that is, the electronic device can receive the information of the first gesture.

[0033] 102. If the first gesture includes a preset trigger gesture, then at least one icon is displayed, and each icon is used to represent a window mode.

[0034] For example, in the process of receiving the information of the first gesture, the electronic device can detect whether the first gesture contains a preset trigger gesture.

[0035] It should be noted that in this embodiment, the first gesture is a complete and continuous gesture. For example, the first gesture is a complete and continuous gesture, which can mean that the user's finger remains in contact with the touch display screen without leaving the touch display screen during the first gesture.

[0036] Then, the first gesture contains a preset trigger gesture can mean that, for example, if the first gesture is divided into multiple gestures, one of the gestures of the first gesture matches the preset trigger gesture. For example, if the first gesture is divided into two gestures, i.e. a previous gesture and a subsequent gesture, if the previous gesture matches the preset trigger gesture, the first gesture can be considered to contain the preset trigger gesture, and so on.

[0037] If the first gesture does not contain the preset trigger gesture, the electronic device can perform other operations.

[0038] If the first gesture contains the preset trigger gesture, the electronic device can trigger the touch display screen to display at least one icon, wherein each icon can be used to represent a window mode.

[0039] It should be noted that the window mode can mean that the electronic device can create a window on the display screen, and display the information that the user wants to display (such as the running interface of a user-specified application) or display the information of the currently running application (such as the foreground application) in the window, and so on.

[0040] 103, obtaining the gesture end position of the first gesture.

[0041] For example, after displaying the at least one icon, the electronic device can also obtain the gesture end position of the first gesture after detecting that the first gesture ends.

[0042] After obtaining the gesture end position of the first gesture, the electronic device can detect whether the gesture end position of the first gesture is located at the display position of a certain icon.

[0043] It should be noted that the gesture end position of the first gesture is located at the display position of the icon can mean that, for example, the display position of the icon is position A, and if the gesture end position of the first gesture is also position A, then the gesture end position of the first gesture is located at the display position of the icon. For example, the first gesture is a touch operation on the touch display screen, and the touch position of the last touch operation is the gesture end position of the first gesture. For example, the user's finger slides to position A of the touch display screen and then leaves the touch display screen, and the touch position of the last touch operation is position A. If the display position of the icon is also position A, then the gesture end position of the first gesture is located at the display position of the icon.

[0044] If it is detected that the gesture end position of the first gesture is not located at the display position of any icon, the electronic device can perform other operations.

[0045] If it is detected that the gesture end position of the first gesture is located at the display position of the icon, the flow entering 104 is entered.

[0046] 104. If it is detected that the gesture end position of the first gesture is located at the display position of the icon, the window mode represented by the corresponding icon is determined as the target window mode.

[0047] For example, if the electronic device detects that the gesture end position of the first gesture is located at the display position of the icon, the electronic device can determine the window mode represented by the corresponding icon as the target window mode.

[0048] For example, the electronic device displays two icons on the touch display screen, which are a first icon and a second icon. The electronic device detects that the gesture end position of the first gesture is located at the display position of the first icon, and the electronic device can determine the window mode represented by the first icon as the target window mode.

[0049] 105. Information of a target application is obtained, and the information of the target application is displayed in the target window mode, the target application being an application corresponding to the information displayed on the touch display screen when the first gesture is received.

[0050] For example, after the target window mode is determined, the electronic device can obtain information of a target application and display the information of the target application in the target window mode, the target application being an application corresponding to the information displayed on the touch display screen when the first gesture is received.

[0051] For example, if the running interface of a certain online car-hailing application Y is displayed on the touch display screen when the first gesture is received, after the target window mode is determined, the electronic device can display the information of the online car-hailing application Y in the target window mode.

[0052] In the embodiments of the present application, different window modes can be different in size, position, etc.

[0053] It can be understood that, in the embodiments of the present application, the electronic device can receive information of a first gesture, and if it is detected that the first gesture contains a preset trigger gesture, the electronic device can display at least one icon, each icon representing a window mode. Then, the electronic device can obtain a gesture end position of the first gesture, and when the gesture end position of the first gesture is located at the display position of a certain icon, the window mode represented by the corresponding icon is determined as a target window mode. Then, the electronic device can display information of a target application in the target window mode, the target application being an application corresponding to the information displayed on the display screen when the first gesture is received. Since the embodiments of the present application can display information of a target application in a corresponding window mode when the electronic device receives a first gesture containing a preset trigger gesture, the electronic device can quickly enter a certain window mode, i.e., the embodiments of the present application can improve the operability of the electronic device.

[0054] Please refer to Figure 2 , Figure 2 Another flowchart of a device control method provided by the embodiments of the present application is shown, which can be applied to an electronic device, which can include a touch display screen. The flowchart of the device control method can include:

[0055] 201. Receive information of a first gesture.

[0056] For example, the gesture in the embodiments of the present application includes a touch operation of a user on the touch display screen.

[0057] For example, the touch display screen of the electronic device currently displays a running interface of a web-based car-hailing application Y, as shown in Figure 3 At this time, the user sends a touch gesture operation to the touch display screen, i.e., the electronic device can receive information of a touch gesture from the user, which can be denoted as a first gesture.

[0058] In the process of receiving the first gesture, the electronic device can detect whether the first gesture contains a preset trigger gesture.

[0059] It should be noted that, in the embodiments of the present application, the first gesture is a complete and continuous gesture. Taking the touch operation on the touch display screen as an example, the complete and continuous gesture of the first gesture can mean that the user's finger remains in contact with the touch display screen without leaving the touch display screen during the first gesture.

[0060] So, the first gesture containing the preset trigger gesture can mean that, for example, if the first gesture is decomposed into multiple segments of gestures, one of the segments of the first gesture matches the preset trigger gesture.

[0061] For example, in one implementation, the first gesture is decomposed into a first segment of gesture and a second segment of gesture, the first segment of gesture occurs before the second segment of gesture, and the first segment of gesture and the second segment of gesture have continuous gesture trajectories.

[0062] So, the first gesture containing the preset trigger gesture can include that the first segment of gesture matches the preset trigger gesture.

[0063] If the first gesture does not contain the preset trigger gesture, the electronic device can perform other operations.

[0064] If the first gesture contains the preset trigger gesture, the flow of 202 can be entered.

[0065] 202. If the first gesture contains the preset trigger gesture, display a first icon and a second icon, wherein the first icon represents a first window mode including determining a first target area on the touch display screen and displaying a running interface of the target application that is scaled down in the first target area; and the second icon represents a second window mode including determining a second target area on the touch display screen and displaying customized information of the target application in the second target area, the area of the second target area being smaller than the area of the first target area; the target application is an application corresponding to the information displayed on the touch display screen when the first gesture is received.

[0066] For example, the preset trigger gesture is an upward sliding operation starting from the bottom of the touch display screen, and the sliding trajectory corresponding to the upward sliding operation reaches a preset first length. If the first segment of gesture of the first gesture received from the user is the upward sliding operation starting from the bottom of the touch display screen, and the sliding trajectory of the upward sliding operation reaches the preset first length, it can be determined that the received first gesture contains the preset trigger gesture, and at this time, the electronic device can be triggered to display two icons, i.e., a first icon and a second icon, on the display screen. The first icon represents a first window mode including determining a first target area on the touch display screen and displaying a running interface of the target application that is scaled down in the first target area. The second icon represents a second window mode including determining a second target area on the touch display screen and displaying customized information of the target application in the second target area, wherein the area of the second target area is smaller than the area of the first target area. The target application is an application corresponding to the information displayed on the touch display screen when the first gesture is received.

[0067] In one implementation, the customized information of the target application displayed in the second window mode can be the latest notification information of the target application or other information. For example, if the target application is an instant messaging application, then the latest notification information of the instant messaging application can be displayed in the second window mode. Or, if the target application is a map navigation application, then the user's current location information can be displayed in the second window mode. That is, the customized information can be determined according to the type of application or the user's needs, and this application embodiment does not specifically limit this.

[0068] For example, such as Figure 4 As shown, the current display shows the interface of ride-hailing application Y, which is the target application. On the interface of ride-hailing application Y, the user's finger slides from position B (the location of the black dot in the diagram) to position C (the location of the black dot in the diagram) on the touch screen. The distance d1 between positions B and C is equal to a preset first length. At this time, the electronic device determines that the received first gesture contains a preset trigger gesture and triggers the display of two icons on the screen, namely the first icon and the second icon. The first window mode represented by the first icon can be named the small window mode, and the second window mode represented by the second icon can be named the flash window mode. The small window mode can display a scaled-down version of the target application's interface in the first target area of ​​the display. The flash window mode can display customized information of the target application in the second target area of ​​the display. The window area in the flash window mode is smaller than the window area in the small window mode.

[0069] Of course, in other embodiments, the preset trigger gesture can also be other gestures. For example, the preset trigger gesture can be a swipe down operation starting from the top of the touch screen, and the swipe trajectory corresponding to the swipe down operation reaches a preset first length. Or, the preset trigger gesture can be a swipe right operation starting from the left edge of the touch screen, and the swipe trajectory corresponding to the swipe right operation reaches a preset first length. Or, the preset trigger gesture can be a swipe left operation starting from the right edge of the touch screen, and the swipe trajectory corresponding to the swipe left operation reaches a preset first length, and so on.

[0070] That is, in the embodiments of this application, when the first gesture is decomposed into a first segment gesture and a second segment gesture, matching the first segment gesture and the preset trigger gesture may include the first segment gesture and the preset trigger gesture having the same gesture action and the trajectory length of the first segment gesture being greater than or equal to a preset first length. The first segment gesture and the preset trigger gesture having the same gesture action can mean, for example, that the first segment gesture is an upward swipe operation and the preset trigger gesture is also an upward swipe operation; or that the first segment gesture is a downward swipe operation and the preset trigger gesture is also a downward swipe operation, and so on.

[0071] In an embodiment, the starting point of the preset trigger gesture can be located at an edge position of the touch display screen. For example, the starting point of the preset trigger gesture is located at the bottom edge or the top edge or the left edge or the right edge of the touch display screen. For example, the starting point of the preset trigger gesture is located at the bottom edge of the touch display screen, and the preset trigger gesture is an up sliding operation starting from the bottom edge of the touch display screen and the sliding distance is greater than or equal to the preset first length. For example, the starting point of the preset trigger gesture is located at the top edge of the touch display screen, and the preset trigger gesture is a down sliding operation starting from the top edge of the touch display screen and the sliding distance is greater than or equal to the preset first length, and so on.

[0072] 203、obtain the gesture end position of the first gesture.

[0073] 204、if it is detected that the gesture end position of the first gesture is located at the display position of an icon, determine the window mode represented by the corresponding icon as the target window mode.

[0074] 205、obtain the information of the target application, and display the information of the target application in the target window mode.

[0075] For example, 203, 204, and 205 can include:

[0076] After the first icon and the second icon are displayed, the user can continue the touch gesture operation on the touch display screen without the user's finger leaving the touch display screen.

[0077] After the first gesture is detected, the electronic device can obtain the gesture end position of the first gesture, and detect whether the gesture end position of the first gesture is located at the display position of an icon.

[0078] It should be noted that the gesture end position of the first gesture is located at the display position of an icon can mean that, for example, the display position of an icon is position A, and if the gesture end position of the first gesture is also position A, then the gesture end position of the first gesture is located at the display position of the icon. For example, the first gesture is a touch operation on the touch display screen, and the touch position of the last touch operation is the gesture end position of the first gesture. For example, the user's finger leaves the touch display screen after sliding to position A of the touch display screen, and the touch position of the last touch operation is position A. If the display position of an icon is also position A, then the gesture end position of the first gesture is located at the display position of the icon.

[0079] It should be noted that, in the case of decomposing the first gesture into the first segment gesture and the second segment gesture, the gesture end position of the first gesture is also the gesture end position of the second segment gesture.

[0080] If the device detects that the end position of the first gesture is not located in the display position of any icon, then the electronic device can perform other operations.

[0081] If the electronic device detects that the end position of the first gesture is located at the display position of an icon, then the electronic device can determine the window mode represented by that icon as the target window mode. Subsequently, the electronic device can acquire information about the target application and display that information in the target window mode.

[0082] For example, such as Figure 5 As shown, after sliding to position C, the user's finger does not leave the touchscreen but continues to slide to position D (see the position of the black dot in the figure). After sliding to position D, the user's finger leaves the touchscreen. That is, the ending position of the first gesture is position D. Since the sliding trajectory from position B through position C and finally ending at position D is continuous, and position D is located at the display position of the first icon, the electronic device can determine the small window mode represented by the first icon as the target window mode. Then, the electronic device can obtain the information of the current target application, i.e., the ride-hailing application Y, and display the information of the ride-hailing application Y in a small window mode. For example, as... Figure 6 As shown, the first target area determined by the electronic device on the touch screen is a region in the middle of the lower half of the screen. The electronic device can then display a scaled-down version of the ride-hailing application Y's interface within this first target area.

[0083] Of course, in other embodiments, the first target area can also be other areas of the display screen, such as the middle position of the upper half of the display screen, or the middle position of the left two-thirds of the display screen, or the middle position of the right two-thirds of the display screen, etc. This application embodiment does not specifically limit this.

[0084] It should be noted that, as Figure 5 As shown, the first gesture is a continuous sliding trajectory starting from position B, passing through position C, and finally ending at position D. In this embodiment, the first gesture can be decomposed into a first segment gesture and a second segment gesture. The first segment gesture can be the gesture from position B to position C, and the second segment gesture can be the gesture from position C to position D, as shown below. Figure 5 As shown, the first and second gestures have a continuous sliding trajectory, meaning that the user's finger never leaves the touch screen during the process of making the first and second gestures.

[0085] For example, such as Figure 7As shown, after sliding to position C, the user's finger does not leave the touchscreen but continues to slide to position E (see the position of the black dot in the figure). After sliding to position E, the user's finger leaves the touchscreen. That is, the ending position of the first gesture is position E. Since the sliding trajectory from position B through position C and finally ending at position E is continuous, and position E is located at the display position of the second icon, the electronic device can determine the flash window mode represented by the second icon as the target window mode. Afterwards, the electronic device can obtain information about the current target application, i.e., the ride-hailing application Y, and display the latest notification information of the ride-hailing application Y in flash window mode. For example, as... Figure 8 As shown, the second target area determined by the electronic device on the touch screen is an area in the upper right corner of the screen. The electronic device can then display the latest notification information from the ride-hailing application Y within this second target area.

[0086] Of course, in other embodiments, the second target area can also be other areas of the display screen, such as the upper left corner of the display screen, or the lower left corner of the display screen, or the lower right corner of the display screen, etc. This application embodiment does not specifically limit this.

[0087] It should be noted that, as Figure 7 As shown, the first gesture is a continuous sliding trajectory starting from position B, passing through position C, and ending at position E. In this embodiment, the first gesture can be decomposed into a first segment gesture and a second segment gesture. The first segment gesture can be the gesture from position B to position C, and the second segment gesture can be the gesture from position C to position E, as shown below. Figure 7 As shown, the first and second gestures have a continuous sliding trajectory, meaning that the user's finger never leaves the touch screen during the process of making the first and second gestures.

[0088] Furthermore, in the embodiments of this application, the position of the window in both the small window mode and the flash window mode can be readjusted by the user. For example, after selecting a window, the user can drag the window to another position, and so on.

[0089] In another implementation, besides touch operations on the touchscreen, the first gesture can also be an air gesture. For example, if the first gesture is broken down into a first segment gesture and a second segment gesture, then both the first and second segment gestures can be air gestures. The second segment gesture and the first segment gesture have a continuous gesture trajectory, which can include: the second segment gesture and the first segment gesture have a continuous air gesture trajectory. That is, the air gesture made by the user is also a continuous gesture.

[0090] In this embodiment of the application, the following process may also be included:

[0091] From the beginning of receiving the first gesture to the end of the first gesture, the running interface of the displayed target application is gradually reduced.

[0092] For example, the preset trigger gesture is an up sliding operation starting from the bottom of the display screen and the length of the sliding track is greater than or equal to a preset first length. Then, as shown in Figure 5 , during the process that the user's finger slides up from the B position at the bottom of the display screen to the C position and then slides left to the D position, the running interface of the online car-hailing application Y displayed by the electronic device can be gradually reduced, for example, the change process of the gradually reduced running interface of the online car-hailing application Y can be as shown in Figure 9 , for example, as shown in Figure 9 , during the process that the user's finger slides up from the B position at the bottom of the display screen, passes the F position (see the position of the black dot in the figure), the C position, and then slides left to the D position, the running interface of the online car-hailing application Y displayed by the electronic device can be gradually reduced.

[0093] In an embodiment, the process of gradually reducing the running interface of the displayed target application by the electronic device can include: the electronic device gradually reduces the running interface of the displayed target application to a preset size, that is, when reduced to the preset size, the electronic device can no longer reduce the running interface of the target application.

[0094] In an embodiment, as shown in Figure 9 , while reducing the running interface of the target application, the gradually reduced running interface can move in a preset direction. For example, in the case that the preset trigger gesture is an up sliding operation starting from the bottom of the display screen and the length of the sliding track is greater than or equal to a preset first length, the gradually reduced running interface can move in the direction of the upper half of the display screen. For another example, in the case that the preset trigger gesture is a down sliding operation starting from the top of the display screen and the length of the sliding track is greater than or equal to a preset first length, the gradually reduced running interface can move in the direction of the lower half of the display screen, and so on.

[0095] In an embodiment, the embodiments of the present application can further include the following flow:

[0096] Before the end of the first gesture, if the gesture pause position is located at the display position of the icon, the electronic device displays a preview effect of the window mode represented by the corresponding icon at a preset position of the touch display screen.

[0097] For example, in the case that the user's finger slides to the D position and stays but the user's finger has not left the touch display screen, the electronic device can display a preview effect of the first window mode represented by the first icon at a preset position of the touch display screen. For example, as shown inFigure 10 As shown in FIG. 6, the electronic device can display the preview effect of displaying the running interface of the online car-hailing application Y in the small-window mode at the middle position (i.e., the preset position) of the upper half of the display screen.

[0098] For example, as shown in FIG. 7, the electronic device can display the preview effect of displaying the second window mode represented by the second icon at the preset position of the touch display screen when the user's finger slides from the D position to the E position and stays but the user's finger still does not leave the touch display screen. Figure 11 As shown in FIG. 8, the electronic device can display the preview effect of displaying the latest notification information of the online car-hailing application Y in the flash-window mode at the middle position (i.e., the preset position) of the upper half of the display screen.

[0099] It should be noted that, in the case that the first gesture is a touch operation on the touch display screen, the end of the first gesture can mean that the electronic device detects the event that the user's finger leaves the touch display screen. For example, as shown in FIG. 9, the user's finger slides on the touch display screen from position B to position C, and leaves the touch display screen when sliding to position D. When the electronic device detects that the user's finger leaves the touch display screen from position D, the electronic device detects the end of the first gesture. Figure 5 As shown in FIG. 9, the user's finger slides on the touch display screen from position B to position C, and leaves the touch display screen when sliding to position D. When the electronic device detects that the user's finger leaves the touch display screen from position D, the electronic device detects the end of the first gesture.

[0100] In the case that the first gesture is a gesture in the air, taking the technology of detecting the palm action of the user by using the camera to realize the gesture recognition in the air as an example, the technology of detecting the gesture in the air generally includes four parts: gesture image capture, gesture segmentation, gesture feature extraction, and gesture detection. Then, the end of the first gesture can mean that the electronic device captures the action of the user's palm putting down by the camera. For example, when making a gesture in the air, the user's palm needs to be raised and make a gesture action. When the action of the user's palm putting down is captured, it can be considered that the gesture in the air ends.

[0101] It can be understood that, as shown in FIGS. 6, 7, and 8, the whole process of the electronic device entering the small-window mode (corresponding to the gesture operation starting from position B, passing through position C, and ending at position D) or the flash-window mode (corresponding to the gesture operation starting from position B, passing through position C, and ending at position E) is a one-step operation, that is, only one step operation is needed to switch to the corresponding window mode, which is high in operation efficiency and good in user experience. Figure 5 Figure 7 As shown in FIG. 6, the electronic device can display the preview effect of displaying the running interface of the online car-hailing application Y in the small-window mode at the middle position (i.e., the preset position) of the upper half of the display screen.

[0102] In an embodiment, the electronic device can further include the following flow:

[0103] receiving information of a second gesture;

[0104] ​If the second gesture has the same gesture action as the preset trigger gesture and the length of the trajectory of the second gesture is less than the preset first length and greater than the preset second length, the electronic device enters the multitask management interface.

[0105] For example, the preset trigger gesture is an upswipe operation starting from the bottom of the touch display screen and the length of the swipe trajectory is greater than or equal to the preset first length. If the second gesture received by the electronic device is also an upswipe operation (i.e., the second gesture has the same gesture action as the preset trigger gesture), but the length of the trajectory of the second gesture is less than the preset first length but greater than the preset second length, for example, the length of the trajectory corresponding to the upswipe operation of the user's finger is between the preset second length and the preset first length, and then the user's finger leaves the touch display screen, the electronic device can enter the multitask management interface.

[0106] For example, the preset trigger gesture is an upswipe operation starting from the bottom of the touch display screen and the length of the swipe trajectory is greater than or equal to the preset first length. As shown in Figure 12 , the user's finger performs an upswipe operation starting from position B at the bottom of the touch display screen and upswipes to position G, but the length of the swipe trajectory between position B and position G is between the preset second length and the preset first length. After swiping to position G, the user's finger leaves the touch display screen, and the electronic device can enter the multitask management interface.

[0107] It can be understood that the above manner can realize multi-segment response of the same gesture. That is, for the same gesture action, the electronic device can perform different responses when the length of the gesture trajectory is different. For example, for the same upswipe gesture, when the length of the upswipe gesture trajectory is greater than or equal to the preset first length, the electronic device can display the first icon and the second icon. When the length of the upswipe gesture trajectory is less than the preset first length but greater than or equal to the preset second length, the electronic device can enter the multitask management interface.

[0108] In an implementation, after the electronic device displays the information of the target application in the target window mode, the electronic device can return to the desktop. For example, in Figure 6 , after the electronic device displays the running interface of the online car-hailing application Y in the small window mode, the electronic device displays the interface of the desktop in the area of the touch display screen other than the small window. For another example, in Figure 8 , after the electronic device displays the latest notification information of the online car-hailing application Y in the flash window mode, the electronic device displays the interface of the desktop in the area of the touch display screen other than the flash window.

[0109] Please refer to Figure 13 , Figure 13The device control apparatus provided by the embodiment of the present application is shown in a structural schematic diagram. The device control apparatus can be applied to an electronic device, which can include a touch display screen. The device control apparatus 300 can include a first receiving module 301, a first display module 302, a second receiving module 303, a determining module 304, and a second display module 305.

[0110] The first receiving module 301 is configured to receive information of a first gesture.

[0111] The first display module 302 is configured to display at least one icon if the first gesture contains a preset trigger gesture, each of the icons being used to represent a window mode.

[0112] The second receiving module 303 is configured to obtain a gesture end position of the first gesture.

[0113] The determining module 304 is configured to determine a target window mode represented by a corresponding icon if the gesture end position of the first gesture is detected to be located at a display position of the icon.

[0114] The second display module 305 is configured to obtain information of a target application and display the information of the target application in the target window mode, the target application being an application corresponding to information displayed by the touch display screen when the first gesture is received.

[0115] In an embodiment, the first gesture includes a first segment gesture and a second segment gesture, the first segment gesture occurring before the second segment gesture, and the first segment gesture and the second segment gesture having a continuous gesture track.

[0116] Then, the first gesture containing the preset trigger gesture can include that the first segment gesture matches the preset trigger gesture.

[0117] In an embodiment, the icons displayed by the electronic device include at least a first icon, and the first window mode represented by the first icon includes determining a first target area on the touch display screen and displaying a running interface of the target application that is shrunk in the first target area.

[0118] In an embodiment, the icons displayed by the electronic device include at least a second icon, and the second window mode represented by the second icon includes determining a second target area on the touch display screen and displaying information of the target application in the second target area, the area of the second target area being smaller than the area of the first target area.

[0119] In an embodiment, the second window mode represented by the second icon comprises determining a second target area on the touch display screen, and displaying customized information of the target application in the second target area.

[0120] In an embodiment, the first gesture comprises the first segment gesture and the second segment gesture comprising a touch operation on the touch display screen.

[0121] In an embodiment, the second segment gesture and the first segment gesture have a continuous gesture track, which can comprise that the second segment gesture and the first segment gesture have a continuous touch track on the touch display screen.

[0122] In an embodiment, the first gesture comprises the first segment gesture and the second segment gesture comprising an air gesture.

[0123] In an embodiment, the second segment gesture and the first segment gesture have a continuous gesture track, which can comprise that the second segment gesture and the first segment gesture have a continuous air gesture track.

[0124] In an embodiment, the first display module 302 can be configured to determine that the first segment gesture matches a preset trigger gesture, and display at least one icon, if the gesture action of the first segment gesture is the same as that of the preset trigger gesture and the track length of the first segment gesture is greater than or equal to a preset first length.

[0125] In an embodiment, the starting point of the preset trigger gesture is located at an edge position of the touch display screen.

[0126] In an embodiment, the second display module 305 can be further configured to gradually reduce the running interface of the target application to a preset size from the time when the first gesture is received to the time when the first gesture ends.

[0127] In an embodiment, the second display module 305 can be further configured to move the running interface of the target application which is gradually reduced to a preset direction.

[0128] In an embodiment, the second display module 305 can be further configured to display a preview effect of a window mode represented by a corresponding icon at a preset position of the touch display screen, if the gesture pause position is located at the display position of the icon before the first gesture ends.

[0129] In an embodiment, the second display module 305 can be further configured to receive information of a second gesture, and enter a multi-task management interface, if the gesture action of the second gesture is the same as that of a preset trigger gesture and the track length of the second gesture is less than the preset first length and greater than a preset second length.

[0130] The embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the computer program causes a computer to execute the flow in the device control method when the computer program is executed on the computer.

[0131] The embodiment of the present application also provides an electronic device, which comprises a memory and a processor, and the processor is configured to execute the flow in the device control method by calling the computer program stored in the memory.

[0132] For example, the electronic device can be a mobile terminal such as a tablet computer or a smart phone. Figure 14 , Figure 14 The electronic device provided by the embodiment of the present application is shown in a structural schematic diagram.

[0133] The electronic device 400 can comprise a touch display screen 401, a memory 402, a processor 403 and the like. Those skilled in the art can understand that the electronic device structure shown in the embodiment of the present application is not limited to the electronic device, and the electronic device can comprise more or less components than those shown in the figure, or some components can be combined, or different components can be arranged. Figure 14

[0134] The touch display screen 401 can be used to display information such as text, images and the like, and the touch display screen 401 can also be used to receive touch operations and the like issued by a user.

[0135] The memory 402 can be used to store application programs and data. The application programs stored in the memory 402 comprise executable codes. The application programs can constitute various functional modules. The processor 403 executes various functional applications and data processing by running the application programs stored in the memory 402.

[0136] The processor 403 is the control center of the electronic device, and connects all parts of the electronic device through various interfaces and lines. The processor 403 executes various functions and processes data of the electronic device by running or executing the application programs stored in the memory 402 and calling the data stored in the memory 402, thereby monitoring the whole electronic device.

[0137] In the embodiment, the processor 403 in the electronic device loads the executable code corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and executes the application programs stored in the memory 402 by the processor 403, thereby executing the following functions:

[0138] receiving information of a first gesture;

[0139] ​If the first gesture comprises a preset trigger gesture, at least one icon is displayed, each of the icons representing a window mode;

[0140] A gesture end position of the first gesture is acquired;

[0141] If the gesture end position of the first gesture is detected to be located at a display position of an icon, a window mode represented by the corresponding icon is determined as a target window mode;

[0142] Information of a target application is acquired, and the information of the target application is displayed in the target window mode, the target application being an application corresponding to the information displayed by the touch display screen when the first gesture is received.

[0143] Referring to Figure 15 , the electronic device 400 can include a touch display screen 401, a memory 402, a processor 403, a battery 404, a speaker 405, a microphone 406, and the like.

[0144] The touch display screen 401 can be used to display information such as text, images, and the like, and the touch display screen 401 can also be used to receive touch operations and the like issued by a user.

[0145] The memory 402 can be used to store application programs and data. The application programs stored in the memory 402 include executable codes. The application programs can constitute various functional modules. The processor 403 executes various functional applications and data processing by running the application programs stored in the memory 402.

[0146] The processor 403 is the control center of the electronic device, and connects various parts of the electronic device through various interfaces and lines. The processor 403 executes various functions and processes data of the electronic device by running or executing the application programs stored in the memory 402 and calling the data stored in the memory 402, thereby monitoring the entire electronic device.

[0147] The battery 404 can provide power support for various components and modules of the electronic device, thereby ensuring the normal operation of the various components and modules.

[0148] The speaker 405 can be used to play sound signals, for example, the speaker 405 plays sound signals in multimedia images.

[0149] The microphone 406 can be used to collect sound signals in the surrounding environment, for example, the microphone 406 can be used to collect voice issued by a user and convert the collected voice into corresponding voice signals.

[0150] In the embodiment, the processor 403 in the electronic device loads executable code corresponding to the process of one or more applications into the memory 402 according to the following instructions, and runs the application stored in the memory 402 by the processor 403, so as to perform the following steps:

[0151] receiving information of the first gesture;

[0152] if the first gesture comprises a preset trigger gesture, displaying at least one icon, each of the icons representing a window mode;

[0153] obtaining a gesture end position of the first gesture;

[0154] if the gesture end position of the first gesture is detected to be located at the display position of the icon, determining the window mode represented by the corresponding icon as a target window mode;

[0155] obtaining information of a target application, and displaying the information of the target application in the target window mode, the target application being an application corresponding to the information displayed on the touch display screen when the first gesture is received.

[0156] In an embodiment, the first gesture comprises a first segment gesture and a second segment gesture, the first segment gesture occurring before the second segment gesture, and the first segment gesture and the second segment gesture having a continuous gesture track.

[0157] The first gesture comprising a preset trigger gesture can comprise that the first segment gesture matches the preset trigger gesture.

[0158] In an embodiment, the icons displayed by the electronic device at least comprise a first icon, and the first window mode represented by the first icon comprises determining a first target area on the touch display screen, and displaying a reduced running interface of the target application in the first target area.

[0159] In an embodiment, the icons displayed by the electronic device at least further comprise a second icon, and the second window mode represented by the second icon comprises determining a second target area on the touch display screen, and displaying information of the target application in the second target area, the area of the second target area being smaller than the area of the first target area.

[0160] In an embodiment, the second window mode represented by the second icon comprises determining a second target area on the touch display screen, and displaying customized information of the target application in the second target area.

[0161] In an embodiment, the first gesture includes the first gesture segment and the second gesture segment, and the first gesture segment and the second gesture segment include a touch operation on the touch display screen.

[0162] In this case, the second gesture segment and the first gesture segment have a continuous gesture track, which can include that the second gesture segment and the first gesture segment have a continuous touch track on the touch display screen.

[0163] In an embodiment, the first gesture includes the first gesture segment and the second gesture segment, and the first gesture segment and the second gesture segment include an air gesture.

[0164] In this case, the second gesture segment and the first gesture segment have a continuous gesture track, which can include that the second gesture segment and the first gesture segment have a continuous air gesture track.

[0165] In an embodiment, when the processor 403 performs the displaying of the at least one icon if the first gesture segment matches a preset trigger gesture, it can perform the following: if the gesture action of the first gesture segment is the same as that of the preset trigger gesture and the track length of the first gesture segment is greater than or equal to a preset first length, it is determined that the first gesture segment matches the preset trigger gesture, and the at least one icon is displayed.

[0166] In an embodiment, the starting point of the preset trigger gesture is located at an edge position of the touch display screen.

[0167] In an embodiment, the processor 403 can further perform the following: from the reception of the first gesture to the end of the first gesture, the running interface of the target application displayed is gradually reduced to a preset size.

[0168] In an embodiment, the processor 403 can further perform the following: the running interface of the target application that is gradually reduced is moved in a preset direction.

[0169] In an embodiment, the processor 403 can further perform the following: before the end of the first gesture, if the gesture pause position is located at the display position of an icon, a preview effect of a window mode represented by the corresponding icon is displayed at a preset position of the touch display screen.

[0170] In an embodiment, the processor 403 can further perform the following: information of a second gesture is received; if the gesture action of the second gesture is the same as that of a preset trigger gesture and the track length of the second gesture is less than the preset first length and greater than a preset second length, a multitask management interface is entered.

[0171] In the above embodiments, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the detailed description of the device control method above, which will not be repeated here.

[0172] The device control apparatus provided by the embodiments of the present application belongs to the same concept as the device control method in the above embodiments, and any method provided in the device control method embodiments can be run on the device control apparatus. The specific implementation process is described in detail in the device control method embodiments, which will not be repeated here.

[0173] It should be noted that, for the device control method of the embodiments of the present application, those skilled in the art can understand that all or part of the processes of the device control method of the embodiments of the present application can be completed by a computer program controlling related hardware. The computer program can be stored in a computer readable storage medium, such as a memory, and executed by at least one processor. In the execution process, it can include processes such as the embodiments of the device control method. The storage medium can be a magnetic disc, an optical disc, a read-only memory (ROM), a random access memory (RAM), etc.

[0174] For the device control apparatus of the embodiments of the present application, each functional module can be integrated in one processing chip, or each module can exist physically alone, or two or more modules can be integrated in one module. The integrated module can be realized in the form of hardware or in the form of software functional module. If the integrated module is realized in the form of software functional module and sold or used as an independent product, it can also be stored in a computer readable storage medium, such as a read-only memory, a magnetic disc or an optical disc, etc.

[0175] The above describes in detail the device control method, apparatus, storage medium and electronic device provided by the embodiments of the present application. The principle and implementation mode of the present application are described by applying specific examples. The above embodiment description is only used to help understand the method and its core idea of the present application. Meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range can be changed. In summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A device control method, applied to electronic equipment, characterized in that, The electronic device includes a touch screen, and the method includes: Receive the first gesture; If the first gesture includes a preset trigger gesture, then at least one icon is displayed, each icon representing a window mode, wherein the first gesture includes a first segment gesture and a second segment gesture, the first segment gesture occurring before the second segment gesture, and the first segment gesture and the second segment gesture having a continuous gesture trajectory; the first gesture including a preset trigger gesture includes: the first segment gesture matching the preset trigger gesture; If the end position of the first gesture is located at the display position of the icon, the information of the target application is displayed in the target window mode. The target application is the application corresponding to the information displayed on the touch screen when the first gesture is received, and the target window mode is the window mode represented by the icon displayed at the end position of the first gesture. From the moment the first gesture is received until the gesture ends, the running interface of the target application will be gradually shrunk to a preset size.

2. The equipment control method according to claim 1, characterized in that, The icons displayed by the electronic device include at least a first icon, and the first window mode represented by the first icon includes displaying information of the target application in a first target area on the touch screen.

3. The equipment control method according to claim 2, characterized in that, The icon displayed by the electronic device includes at least a second icon, the second icon representing a second window mode including displaying information of the target application in a second target area on the touch screen, the area of ​​the second target area being smaller than the area of ​​the first target area.

4. The equipment control method according to claim 1, characterized in that, The method further includes: The target application's interface, which is gradually shrinking, is moved in a preset direction.

5. The equipment control method according to claim 1, characterized in that, The method further includes: Before the first gesture ends, if the gesture pauses at the display position of the icon, a preview of the window mode represented by the corresponding icon is displayed at a preset position on the touch screen.

6. A device control apparatus, applied to electronic equipment, characterized in that, The electronic device includes a touch screen, and the device includes: The first receiving module is used to receive the first gesture; A first display module is configured to display at least one icon if the first gesture includes a preset trigger gesture, each icon representing a window mode, wherein the first gesture includes a first segment gesture and a second segment gesture, the first segment gesture occurring before the second segment gesture, and the first segment gesture and the second segment gesture having a continuous gesture trajectory; the first gesture including a preset trigger gesture includes: the first segment gesture matching the preset trigger gesture; The determining module is used to display information of a target application in a target window mode if the end position of the first gesture is located at the display position of an icon. The target application is the application corresponding to the information displayed on the touch screen when the first gesture is received, and the target window mode is the window mode represented by the icon displayed at the end position of the first gesture. The second display module is used to gradually shrink the running interface of the target application to a preset size from the moment the first gesture is received until the first gesture ends.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed on a computer, it causes the computer to perform the method as described in any one of claims 1 to 5.

8. An electronic device, comprising a memory, a processor, and a touch display screen, characterized in that, The processor executes the method as described in any one of claims 1 to 5 by invoking a computer program stored in the memory.

Images