Device control method, device, storage medium and electronic device

Abstract

The present application discloses a device control method, apparatus, storage medium and electronic device. The device control method comprises: when displaying information of an application in a first window mode, receiving information of a first gesture; if the first gesture includes a preset trigger gesture, displaying at least one icon, each of which is used to represent a processing operation performed on the first window mode; obtaining the gesture end position of the first gesture; if it is detected that the gesture end position of the first gesture is located at the display position of the icon, determining the processing operation represented by the corresponding icon as the target processing operation; and executing the target processing operation. The present application can improve the operability of electronic devices.

Description

[0001] This application is a divisional application submitted to the China Patent Office on July 9, 2020, with application number 2020106592018, and invention name “Device control method, device, storage medium and electronic device”, all contents of which are incorporated by reference in this application. Technical Field

[0002] The present application belongs to the field of interactive technology, and in particular, relates to a device control method, device, storage medium and electronic device. Background Art

[0003] With the development of technology, the ways of human-computer interaction are becoming more and more diverse. For example, users can interact with electronic devices by touching the display screen, or users can interact with electronic devices by voice control, etc. However, in the related art, the operability of electronic devices is still low during the interaction process. Summary of the invention

[0004] The embodiments of the present application provide a device control method, apparatus, storage medium and electronic device, which can improve the operability of the electronic device.

[0005] In a first aspect, an embodiment of the present application provides a device control method, the method comprising:

[0006] When displaying information of the application in the first window mode, receiving information of the first gesture;

[0007] If the first gesture includes a preset trigger gesture, displaying at least one icon, each of the icons being used to represent a processing operation performed on the first window mode;

[0008] Obtaining the gesture end position of the first gesture;

[0009] If the gesture end position of the first gesture is located at the display position of the icon, determining the processing operation represented by the corresponding icon as the target processing operation;

[0010] The target processing operation is executed.

[0011] In a second aspect, an embodiment of the present application provides a device control apparatus, the apparatus comprising:

[0012] A first receiving module, configured to receive information of a first gesture when displaying information of an application in a first window mode;

[0013] A display module, configured to display at least one icon if the first gesture includes a preset trigger gesture, each of the icons being used to represent a processing operation performed on the first window mode;

[0014] A second receiving module, used for acquiring a gesture end position of the first gesture;

[0015] a determination module, configured to determine, if the gesture end position of the first gesture is located at the display position of the icon, a processing operation represented by the corresponding icon as a target processing operation;

[0016] An execution module is used to execute the target processing operation.

[0017] In a third aspect, an embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the process in the device control method provided by the embodiment of the present application.

[0018] In a fourth aspect, an embodiment of the present application further provides an electronic device, comprising a memory and a processor, wherein the processor is used to execute the process in the device control method provided in the embodiment of the present application by calling a computer program stored in the memory.

[0019] In an embodiment of the present application, when the information of the application is displayed in the first window mode, if the electronic device receives a first gesture including a preset trigger gesture, the electronic device can display at least one icon, each icon being used to represent a processing operation performed on the first window mode. Afterwards, the electronic device can obtain the gesture end position of the first gesture, and when it is detected that the gesture end position of the first gesture is located at the display position of a certain icon, the processing operation represented by the corresponding icon is determined as the target processing operation and the target processing operation is executed. Since the embodiment of the present application can perform corresponding processing operations on the first window mode when the electronic device receives a gesture including a trigger gesture, the electronic device can quickly perform corresponding processing operations on the first window mode, that is, the embodiment of the present application can improve the operability of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The technical solution and beneficial effects of the present application will be made apparent by describing in detail the specific implementation methods of the present application in conjunction with the accompanying drawings.

[0021] Figure 1 It is a flow chart of the device control method provided in the embodiment of the present application.

[0022] Figure 2 It is another flow chart of the device control method provided in an embodiment of the present application.

[0023] Figures 3 to 12 It is a schematic diagram of various scenarios of the device control method provided in the embodiments of the present application.

[0024] Fig.13This is another operation diagram of the first window mode provided in an embodiment of the present application.

[0025] Fig.14 It is a structural schematic diagram of the equipment control device provided in an embodiment of the present application.

[0026] Fig.15 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0027] Fig.16 It is another structural schematic diagram of the electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] Please refer to the drawings, where the same component symbols represent the same components. The principle of the present application is illustrated by implementing it in an appropriate computing environment. The following description is based on the illustrated specific embodiments of the present application, which should not be considered as limiting other specific embodiments of the present application that are not described in detail herein.

[0029] It is understandable that the execution subject of the embodiments of the present application may be an electronic device such as a smart phone or a tablet computer.

[0030] See also Figure 1 , Figure 1 : is a flow chart of a device control method provided in an embodiment of the present application, and the flow chart may include:

[0031] 101. When displaying application information in a first window mode, receive information of a first gesture.

[0032] With the development of technology, the ways of human-computer interaction are becoming more and more diverse. For example, users can interact with electronic devices by touching the display screen, or users can interact with electronic devices by voice control, etc. However, in the related art, the operability of electronic devices is still low during the interaction process.

[0033] In the embodiment of the present application, for example, when the electronic device displays information of a certain application in the first window mode, the electronic device may receive a gesture from the user, for example, the gesture is recorded as the first gesture. That is, the electronic device may receive information of the first gesture.

[0034] It should be noted that window mode may mean that the electronic device can create a window on the display screen and display the information the user wants to display (such as the running interface of an application specified by the user) in the window or display the information of the currently running application (such as the foreground application) in the window.

[0035] In the process of receiving the information of the first gesture, the electronic device may detect whether the first gesture includes a preset trigger gesture.

[0036] It should be noted that, in this embodiment, the first gesture is a complete and coherent gesture. Taking the first gesture as a touch operation on a touch display screen as an example, the first gesture being a complete and coherent gesture may mean that during the process of making the first gesture, the user's finger always keeps in contact with the touch display screen and does not leave the touch display screen.

[0037] Then, the first gesture includes the preset trigger gesture may mean: for example, if the first gesture is decomposed into multiple gestures, then one of the gestures of the first gesture matches the preset trigger gesture. For example, if the first gesture is decomposed into two gestures, namely the first gesture and the second gesture, then if the first gesture matches the preset trigger gesture, then it can be considered that the first gesture includes the preset trigger gesture, and so on.

[0038] If the first gesture does not include a preset trigger gesture, the electronic device may perform other operations.

[0039] If the first gesture includes a preset trigger gesture, the process of step 102 may be entered.

[0040] 102. If the first gesture includes a preset trigger gesture, at least one icon is displayed, each icon being used to represent a processing operation performed on the first window mode.

[0041] For example, if the electronic device detects that the first gesture includes a preset trigger gesture, the electronic device may be triggered to display at least one icon on the touch display screen, wherein each icon is used to represent a processing operation performed on the first window mode.

[0042] 103. Obtain the gesture end position of the first gesture.

[0043] For example, after displaying at least one icon, the electronic device may also obtain the gesture end position of the first gesture after detecting that the first gesture ends.

[0044] After acquiring the gesture end position of the first gesture, the electronic device may detect whether the gesture end position of the first gesture is located at the display position of a certain icon.

[0045] The gesture end position of the first gesture being located at the display position of a certain icon may mean: for example, if the display position of a certain icon is position A, then if the gesture end position of the first gesture is also position A, then the gesture end position of the first gesture is located at the display position of the icon. For example, the first gesture is a touch operation on a touch display screen, then the touch position of the last touch operation is the gesture end position of the first gesture. For example, the user's finger leaves the touch display screen after sliding to position A of the touch display screen, then the touch position of the last touch operation is position A. If the display position of a certain icon is also position A, then the gesture end position of the first gesture is located at the display position of the icon.

[0046] If it is detected that the gesture end position of the first gesture is not located at the display position of any icon, the electronic device can perform other operations.

[0047] If it is detected that the gesture end position of the first gesture is located at the display position of a certain icon, then the process enters step 104 .

[0048] 104. If the gesture end position of the first gesture is located at the display position of the icon, the processing operation represented by the corresponding icon is determined as the target processing operation.

[0049] 105. Execute target processing operations.

[0050] For example, if the electronic device detects that the gesture end position of the first gesture is located at the display position of a certain icon, the electronic device can determine the processing operation represented by the corresponding icon as the target processing operation and execute the target processing operation.

[0051] For example, when it is detected that the first gesture includes a preset trigger gesture, the electronic device displays three icons on the touch display screen, namely, the second icon, the third icon and the fourth icon, wherein the second icon is used to represent the second processing operation on the first window mode, the third icon is used to represent the third processing operation on the first window mode, and the fourth icon is used to represent the fourth processing operation on the first window mode. Afterwards, the electronic device obtains the gesture end position of the first gesture, and detects that the gesture end position of the first gesture is located at the display position of the second icon, then the electronic device can determine the second processing operation represented by the second icon as the target processing operation, and execute the second processing operation.

[0052] It is understandable that in an embodiment of the present application, when the information of the application is displayed in the first window mode, if the electronic device receives a first gesture including a preset trigger gesture, then the electronic device can display at least one icon, each icon being used to represent a processing operation performed on the first window mode. Afterwards, the electronic device can obtain the gesture end position of the first gesture, and when it is detected that the gesture end position of the first gesture is located at the display position of a certain icon, the processing operation represented by the corresponding icon is determined as the target processing operation and the target processing operation is executed. Since the embodiment of the present application can perform corresponding processing operations on the first window mode when the electronic device receives a gesture including a trigger gesture, the electronic device can quickly perform corresponding processing operations on the first window mode, that is, the embodiment of the present application can improve the operability of the electronic device.

[0053] See also Figure 2 , Figure 2 Another schematic diagram of a process flow of a device control method provided in an embodiment of the present application, the process flow may include:

[0054] 201. When displaying application information in a first window mode, receive information of a first gesture.

[0055] For example, when the electronic device displays information of a certain application in the first window mode, the electronic device may receive a gesture from the user, for example, the gesture is recorded as the first gesture. That is, the electronic device may receive information of the first gesture.

[0056] It should be noted that window mode may mean that the electronic device can create a window on the display screen and display the information the user wants to display (such as the running interface of an application specified by the user) in the window or display the information of the currently running application (such as the foreground application) in the window.

[0057] In the process of receiving the information of the first gesture, the electronic device may detect whether the first gesture includes a preset trigger gesture.

[0058] In one embodiment, the preset trigger gesture may be a pressing operation performed on the window corresponding to the first window mode, and the pressing duration of the pressing operation may be greater than or equal to the preset duration threshold, that is, the preset trigger gesture may be a long press operation performed by the user on the window corresponding to the first window mode. For example, when the pressing duration of the pressing operation performed by the user on the window is greater than or equal to 0.5 seconds or 1 second, it can be considered a long press operation. Alternatively, the pressing pressure value of the pressing operation may be greater than or equal to the preset pressure threshold, that is, the preset trigger gesture may be a hard press operation performed by the user on the window corresponding to the first window mode. For example, when the pressing pressure value of the pressing operation performed by the user on the window is greater than or equal to 5N or 4N, it can be considered a hard press operation, and so on.

[0059] In one embodiment, the window corresponding to the first window mode may include a preset control. Then, the preset trigger gesture includes a pressing operation performed at the location where the preset control is located. For example, the preset trigger gesture may be a long press operation or a heavy press operation performed at the location where the preset control is located. Figure 3 As shown, the window shown in the figure is a window corresponding to the first window mode, and a preset control is set at the middle position of the upper edge of the window. The preset trigger gesture can be a long press of the preset control. For example, when the user presses the preset control and the pressing time is greater than or equal to the preset time threshold, the electronic device can determine that the preset trigger gesture is received. Alternatively, the preset trigger gesture can also be a heavy press of the preset control. For example, when the user presses the preset control and the pressing pressure value applied to the touch display screen is greater than or equal to the preset pressure threshold, the electronic device can determine that the preset trigger gesture is received, and so on.

[0060] It should be noted that, in this embodiment, the first gesture is a complete and coherent gesture. Taking the first gesture as a touch operation on a touch display screen as an example, the first gesture being a complete and coherent gesture may mean that during the process of making the first gesture, the user's finger always keeps in contact with the touch display screen and does not leave the touch display screen.

[0061] Then, the first gesture including the preset trigger gesture may mean: for example, the first gesture is decomposed into multiple gesture segments, and then one of the gesture segments of the first gesture matches the preset trigger gesture.

[0062] For example, in one implementation, the first gesture is decomposed into a first gesture segment and a second gesture segment, the first gesture segment occurs before the second gesture segment, and the first gesture segment and the second gesture segment have a continuous gesture trajectory.

[0063] Then, the first gesture includes a preset trigger gesture, which may include: the first gesture matches the preset trigger gesture.

[0064] If the first gesture does not include a preset trigger gesture, the electronic device may perform other operations.

[0065] If the first gesture includes a preset trigger gesture match, the process may enter step 202 .

[0066] 202. If the first gesture includes a preset trigger gesture, a second icon, a third icon, and a fourth icon are displayed, wherein the processing operation represented by the second icon includes switching to a second window mode, and the window area of ​​the second window mode is larger than the window area of ​​the first window mode; the processing operation represented by the third icon includes switching to a third window mode, and the window area of ​​the third window mode is smaller than the window area of ​​the first window mode; the processing operation represented by the fourth icon includes closing the first window mode.

[0067] For example, if the electronic device detects that the first gesture includes a preset trigger gesture, the electronic device may be triggered to display at least one icon on the touch display screen, wherein each icon is used to represent a processing operation performed on the first window mode.

[0068] For example, in this embodiment, the electronic device may display a second icon, a third icon, and a fourth icon. Among them, the processing operation represented by the second icon may be switching to a second window mode, the window area of ​​the second window mode being larger than the window area of ​​the first window mode. That is, switching from the first window mode to the second window mode represents switching from the current window to a larger window. The processing operation represented by the third icon may be switching to a third window mode, the window area of ​​the third window mode being smaller than the window area of ​​the first window mode. That is, switching from the first window mode to the third window mode represents switching from the current window to a smaller window. The processing operation represented by the fourth icon may be closing the first window mode.

[0069] For example, Figure 4 As shown, when the information of the application is displayed in the first window mode, the first gesture received by the electronic device includes a preset trigger gesture, and the electronic device can display a second icon R, a third icon S, and a fourth icon T on the display screen. Among them, the processing operation represented by the second icon R can be switching to the second window mode, and the window area of ​​the second window mode is larger than the window area of ​​the first window mode. The processing operation represented by the third icon S can be switching to the third window mode, and the window area of ​​the third window mode is smaller than the window area of ​​the first window mode. The processing operation represented by the fourth icon T can be closing the first window mode.

[0070] In this embodiment, the first window mode may include displaying the running interface of the application in the window, the second window mode may include displaying the running interface of the application in full screen, and the third window mode may include displaying customized information of the application in the window.

[0071] In one embodiment, the customized information of the application displayed in the third window mode may be the latest notification information or other information of the application. For example, if the target application is an instant messaging application, then the latest notification information of the instant messaging application may be displayed in the third window mode. Or, if the application is a map navigation application, then the user's current location information may be displayed in the third window mode. That is, the customized information may determine what information of the application is displayed according to the type of application or the needs of the user, and the embodiments of the present application do not specifically limit this.

[0072] 203. Before the first gesture ends, the window in the window mode moves along the trajectory of the first gesture.

[0073] For example, in this embodiment, before the first gesture ends, the window in the window mode can move along the gesture trajectory of the first gesture.

[0074] For example, Figure 5 As shown, the electronic device displays information of the online car-hailing application Y in the first window mode. The window corresponding to the first window mode includes a preset control, and the position of the preset control is B. The user performs a long press operation on the preset control, and the electronic device determines that the preset trigger gesture is received, and displays the second icon R, the third icon S, and the fourth icon T on the display screen. After that, the user's finger keeps contact with the touch display screen and slides from position B to position C. The sliding track is shown as follows: Figure 5 The curve between position B and position C in the figure. When the user's finger slides from position B to position C, the electronic device can control the window to move synchronously from position B to position C following the gesture trajectory. Afterwards, for example, the user's finger still keeps contact with the touch display screen without leaving the touch display screen, and slides from position C to position D. The sliding trajectory is as follows: Figure 5 The curve between position C and position D in the figure. When the user's finger slides from position C to position D, the electronic device can control the window to move synchronously from position C to position D following the gesture trajectory.

[0075] 204. Obtain a gesture end position of the first gesture.

[0076] 205. If it is detected that the gesture end position of the first gesture is located at the display position of the icon, the processing operation represented by the corresponding icon is determined as the target processing operation.

[0077] 206. Execute target processing operation.

[0078] For example, 204, 205, and 206 may include:

[0079] For example, after displaying the second icon, the third icon, and the fourth icon, if the user's finger does not leave the touch screen, the user can continue to perform touch gesture operations on the touch screen, that is, the electronic device can continue to receive information about the first gesture from the user.

[0080] While continuing to receive the information of the first gesture, the electronic device can detect whether the first gesture is ended.

[0081] It should be noted that, in the case where the first gesture is a touch operation performed on a touch display screen, the end of the first gesture may refer to an event in which the electronic device detects that the user's finger leaves the touch display screen. Figure 5 As shown, the user's finger starts sliding on the touch screen from position B, passes position C, and leaves the touch screen when sliding to position D. When the electronic device detects that the user's finger leaves the touch screen from position D, it detects that the first gesture ends.

[0082] If it is detected that the first gesture has not ended, the electronic device can control the window in the window mode to move synchronously along the continuous gesture trajectory.

[0083] If it is detected that the first gesture ends, the electronic device may obtain the gesture end position of the first gesture, and detect whether the gesture end position of the first gesture is located at the display position of a certain icon.

[0084] The gesture end position of the first gesture being located at the display position of a certain icon may mean: for example, if the display position of a certain icon is position A, then if the gesture end position of the first gesture is also position A, then the gesture end position of the first gesture is located at the display position of the icon. For example, the first gesture is a touch operation on a touch display screen, then the touch position of the last touch operation is the gesture end position of the first gesture. For example, the user's finger leaves the touch display screen after sliding to position A of the touch display screen, then the touch position of the last touch operation is position A. If the display position of a certain icon is also position A, then the gesture end position of the first gesture is located at the display position of the icon.

[0085] It should be noted that, when the first gesture is decomposed into a first gesture and a second gesture, the gesture end position of the first gesture is also the gesture end position of the second gesture.

[0086] If it is detected that the gesture end position of the first gesture is not located at the display position of any icon, the electronic device can perform other operations.

[0087] If it is detected that the gesture end position of the first gesture is located at the display position of a certain icon, the electronic device can determine the processing operation represented by the corresponding icon as the target processing operation and execute the target processing operation.

[0088] For example, Figure 5 As shown, after the user's finger slides to position D and leaves the touch display screen, the electronic device can detect that the first gesture ends, and the gesture end position of the first gesture is D. Since position D is located at the display position of the third icon S, the electronic device can determine the processing operation represented by the third icon S as the target processing operation, that is, the electronic device can determine switching to the third window mode as the target processing operation, and execute the operation of switching to the third window mode. For example, since the window area of ​​the third window mode is smaller than the window area of ​​the first window mode, the electronic device can use a smaller window to display the information of the online car-hailing application Y. For example, as Figure 6 As shown, switching to the third window mode means that the electronic device displays the latest notification information of the online car-hailing application Y in a smaller window in the upper right corner of the display screen.

[0089] In one implementation, the present application embodiment may also include the following process:

[0090] Before the first gesture ends, if the gesture pause position is located at the display position of the icon, a preview effect of the processing operation represented by the corresponding icon is displayed.

[0091] For example, Figure 5 As shown, the user's finger slides from position B to position C and then to position D. For example, the moment when the user's finger slides to position D is t1, and the user's finger does not leave the touch screen immediately at this time. That is, the user's finger stays at position D at this time, so the gesture pause position of the first gesture is position D. Since position D is located at the display position of the third icon S, in this case, the electronic device can display a preview effect of the window after switching to the third window mode. For example, the electronic device can display a preview effect of the area size of the window after switching to the third window mode, as shown in FIG. Figure 7 shown.

[0092] See also Figures 8 to 14 , Figures 8 to 14 A schematic diagram of a scenario of a device control method provided in an embodiment of the present application.

[0093] For example, the electronic device currently displays the operation interface of the online car-hailing application Y in the first window mode. In this embodiment, the first window mode can be named as the small window mode. Figure 3As shown, the electronic device displays the operating interface of the online car-hailing application Y in a small window mode. A preset control is provided in the middle of the upper edge of the small window. The user presses the preset control with a finger. At this time, the electronic device can determine that a preset trigger gesture has been received.

[0094] After receiving the preset trigger gesture, the electronic device may display three icons above the small window, such as Figure 4 As shown, the three icons displayed are icon R, icon S and icon T. Among them, the processing operation represented by icon R can be switching to the running interface of the full-screen display application (full-screen mode can be considered as a special window mode). The processing operation represented by icon S can be switching to the flash window mode, and the window area in the flash window mode is smaller than the window area in the small window mode. The processing operation represented by icon T can be closing the small window mode.

[0095] After displaying icons R, S, and T, the electronic device can continue to receive gestures from the user. For example, after the user's finger long presses position B where the preset control is located, the user does not leave the touch display screen but continues to slide to position C. Figure 8 After sliding to position C, the user's finger leaves the touch display screen. At this time, the electronic device detects that the sliding track from position B to position C is continuous, and position C is located at the display position of icon R. In this case, the electronic device can switch to displaying the running interface of the online car-hailing application Y in full screen. Fig. 9 shown.

[0096] It should be noted that if Figure 8 As shown, the first gesture is a gesture with a continuous sliding track starting from position B and ending at position C. In this embodiment, the first gesture can be decomposed into a first gesture segment and a second gesture segment. The first gesture segment can be a long press operation at position B, and the second gesture segment can be the gesture segment from position B to position C. Figure 8 As shown, the first gesture and the second gesture have a continuous sliding track, that is, the user's fingers never leave the touch screen during the process of performing the first gesture and the second gesture.

[0097] For another example, after displaying icons R, S, and T, the electronic device can continue to receive gestures from the user. For example, after the user's finger long presses the position B where the preset control is located, it does not leave the touch display screen but continues to slide to position E. The trajectory can be as follows: Fig.10 After sliding to position E, the user's finger leaves the touch display screen. At this time, the electronic device detects that the sliding track from position B to position E is continuous, and position E is located at the display position of icon S. In this case, the electronic device can switch to displaying the latest notification information of online car-hailing application Y in a flash window mode, such as Figure 6 shown.

[0098] It should be noted that if Fig.10 As shown, the first gesture is a gesture with a continuous sliding track starting from position B and ending at position E. In this embodiment, the first gesture can be decomposed into a first gesture segment and a second gesture segment. The first gesture segment can be a long press operation at position B, and the second gesture segment can be the gesture segment from position B to position E. Fig.10 As shown, the first gesture and the second gesture have a continuous sliding track, that is, the user's fingers never leave the touch screen during the process of performing the first gesture and the second gesture.

[0099] For another example, after displaying icons R, S, and T, the electronic device can continue to receive gestures from the user. For example, after the user's finger long presses the position B where the preset control is located, it does not leave the touch display screen but continues to slide to position F. The sliding track is as follows: Fig.11 After sliding to position F, the user's finger leaves the touch display screen. At this time, the electronic device detects that the sliding track from position B to position F is continuous, and position F is located at the display position of icon T. In this case, the electronic device can close the small window mode and return to the desktop, as shown in FIG. Fig.12 shown.

[0100] It should be noted that if Fig.11 As shown, the first gesture is a gesture with a continuous sliding track starting from position B and ending at position F. In this embodiment, the first gesture can be decomposed into a first gesture and a second gesture. The first gesture can be a long press operation at position B, and the second gesture can be the gesture from position B to position F. Figure 8 As shown, the first gesture and the second gesture have a continuous sliding track, that is, the user's fingers never leave the touch screen during the process of performing the first gesture and the second gesture.

[0101] It is understandable that in the embodiments of the present application, Figure 8 and Fig.14 As shown, the entire process of the electronic device entering the full screen mode from the small window mode (corresponding to the gesture operation starting from position B and ending at position C) or entering the flash window mode from the small window mode (corresponding to the gesture operation starting from position B and ending at position E) or closing the small window mode is done in one go, that is, only one step is required to switch to other window modes or close the window mode, with high operating efficiency and good user experience.

[0102] In another embodiment, the position of each icon displayed on the display screen can be adjusted by the user. For example, by default, icons R, S, and T are displayed from left to right. The user can also adjust the position of the icons, for example, the icons displayed from left to right after adjustment are R, T, S, and so on. Of course, the electronic device can also use machine learning to learn the user's user habits, and adjust the display position of the icon according to the user's habits, and so on.

[0103] In another implementation, the embodiment of the present application may also include the following process:

[0104] When displaying information of the application in the first window mode, receiving information of a second gesture, the second gesture comprising moving the selected window to an edge of the display screen after selecting the window corresponding to the first window mode;

[0105] According to the information of the second gesture, the window corresponding to the first window mode is hidden at the edge of the display screen, and the position of the hidden window is indicated by an icon.

[0106] For example, when the information of the application is displayed in the first window mode, the user can also select the window (for example, press and hold the edge of the small window) and drag it to the edge of the screen to collapse the window at the edge of the screen, and use an icon (such as a circular icon) to show the location of the collapsed window (i.e., the hidden window). The schematic diagram of the whole process can be as follows: Fig.13 When the user clicks the circular icon, the application information can be restored to be displayed in the first window mode.

[0107] Alternatively, when the application information is displayed in the first window mode, the user can also select a window (for example, by pressing the edge of the small window) and drag it to the edge of the screen and hold it for a certain period of time (for example, 0.5 seconds or 1 second) to collapse the window at the edge of the screen, and use an icon (such as a circular icon) to show the location of the collapsed window. When the user clicks the circular icon, the application information can be restored to be displayed in the first window mode.

[0108] See also Fig.14 , Fig.14 The schematic diagram of the structure of the device control device provided in the embodiment of the present application is as follows: The device control device 300 may include: a first receiving module 301 , a display module 302 , a second receiving module 303 , a determination module 304 , and an execution module 305 .

[0109] The first receiving module 301 is configured to receive information of a first gesture when displaying information of an application in a first window mode.

[0110] The display module 302 is configured to display at least one icon if the first gesture includes a preset trigger gesture, each of the icons being used to represent a processing operation performed on the first window mode.

[0111] The second receiving module 303 is used to obtain the gesture end position of the first gesture.

[0112] The determination module 304 is configured to determine the processing operation represented by the corresponding icon as the target processing operation if the gesture end position of the first gesture is located at the display position of the icon.

[0113] The execution module 305 is used to execute the target processing operation.

[0114] In one embodiment, the first gesture includes a first gesture section and a second gesture section, the first gesture section occurs before the second gesture section, and the first gesture section and the second gesture section have a continuous gesture trajectory.

[0115] The first gesture includes a preset trigger gesture, including: the first gesture matches the preset trigger gesture.

[0116] In one embodiment, the preset trigger gesture includes a pressing operation on the window corresponding to the first window mode, the pressing duration of the pressing operation is greater than or equal to a preset duration threshold, or the pressing pressure value of the pressing operation is greater than or equal to a preset pressure threshold.

[0117] In one embodiment, the window corresponding to the first window mode includes a preset control. The preset trigger gesture includes a pressing operation performed at a location where the preset control is located.

[0118] In one embodiment, the displayed icons include a second icon, and the processing operation represented by the second icon includes switching to a second window mode, and the window area of ​​the second window mode is larger than the window area of ​​the first window mode.

[0119] In one embodiment, the displayed icons further include a third icon, and the processing operation represented by the third icon includes switching to a third window mode, and the window area of ​​the third window mode is smaller than the window area of ​​the first window mode.

[0120] In one implementation, the displayed icons further include a fourth icon, and the processing operation represented by the fourth icon includes closing the first window mode.

[0121] In one embodiment, the first window mode includes displaying the running interface of the application in a window, the second window mode includes displaying the running interface of the application in full screen, and the third window mode includes displaying customized information of the application in a window.

[0122] In one implementation, the execution module 305 may also be configured to: before the first gesture ends, if the gesture pause position is located at the display position of the icon, display a preview effect of the processing operation represented by the corresponding icon.

[0123] In one implementation, the execution module 305 may also be used to return to the desktop after closing the first window mode.

[0124] In one implementation, the execution module 305 may also be configured to: before the first gesture ends, the window in the window mode moves along the trajectory of the first gesture.

[0125] In one embodiment, the execution module 305 can also be used to: when displaying application information in a first window mode, receive information of a second gesture, the second gesture including selecting a window corresponding to the first window mode and moving the selected window to the edge of the display screen; based on the information of the second gesture, hide the window corresponding to the first window mode at the edge of the display screen, and indicate the location of the hidden window in the form of an icon.

[0126] An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the process in the method provided in this embodiment.

[0127] An embodiment of the present application also provides an electronic device, including a memory and a processor, wherein the processor is used to execute the process in the device control method provided in this embodiment by calling a computer program stored in the memory.

[0128] For example, the electronic device may be a mobile terminal such as a tablet computer or a smart phone. Fig.15 , Fig.15 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0129] The electronic device 400 may include a touch screen 401, a memory 402, a processor 403 and other components. Those skilled in the art will appreciate that Fig.15 The electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0130] The touch display screen 401 can be used to display information such as text, images, etc., and can also be used to receive user touch operations, etc.

[0131] The memory 402 may be used to store applications and data. The applications stored in the memory 402 include executable codes. The applications may be composed of various functional modules. The processor 403 executes various functional applications and data processing by running the applications stored in the memory 402.

[0132] The processor 403 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device and processes data by running or executing applications stored in the memory 402 and calling data stored in the memory 402, thereby monitoring the electronic device as a whole.

[0133] In this embodiment, the processor 403 in the electronic device will load the executable code corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 403 will run the application program stored in the memory 402 to execute:

[0134] When displaying information of the application in the first window mode, receiving information of the first gesture;

[0135] If the first gesture includes a preset trigger gesture, displaying at least one icon, each of the icons being used to represent a processing operation performed on the first window mode;

[0136] Obtaining the gesture end position of the first gesture;

[0137] If the gesture end position of the first gesture is located at the display position of the icon, determining the processing operation represented by the corresponding icon as the target processing operation;

[0138] The target processing operation is executed.

[0139] See also Fig.16 The electronic device 400 may include components such as a touch display screen 401, a memory 402, a processor 403, a battery 404, a microphone 405, and a speaker 406.

[0140] The touch display screen 401 can be used to display information such as text, images, etc., and can also be used to receive user touch operations, etc.

[0141] The memory 402 may be used to store applications and data. The applications stored in the memory 402 include executable codes. The applications may be composed of various functional modules. The processor 403 executes various functional applications and data processing by running the applications stored in the memory 402.

[0142] The processor 403 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device and processes data by running or executing applications stored in the memory 402 and calling data stored in the memory 402, thereby monitoring the electronic device as a whole.

[0143] The battery 404 may be used to provide power support for various components and modules of the electronic device, thereby ensuring the normal operation of the various components and modules.

[0144] The microphone 405 may be used to collect sound signals in the surrounding environment, such as collecting the user's voice.

[0145] The speaker 406 can be used to play sound signals.

[0146] In this embodiment, the processor 403 in the electronic device will load the executable code corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 403 will run the application program stored in the memory 402 to execute:

[0147] When displaying information of the application in the first window mode, receiving information of the first gesture;

[0148] If the first gesture includes a preset trigger gesture, displaying at least one icon, each of the icons being used to represent a processing operation performed on the first window mode;

[0149] Obtaining the gesture end position of the first gesture;

[0150] If the gesture end position of the first gesture is located at the display position of the icon, determining the processing operation represented by the corresponding icon as the target processing operation;

[0151] The target processing operation is executed.

[0152] In one embodiment, the first gesture includes a first gesture section and a second gesture section, the first gesture section occurs before the second gesture section, and the first gesture section and the second gesture section have a continuous gesture trajectory.

[0153] Then, the first gesture includes a preset trigger gesture, including: the first gesture matches the preset trigger gesture.

[0154] In one embodiment, the preset trigger gesture includes a pressing operation on the window corresponding to the first window mode, the pressing duration of the pressing operation is greater than or equal to a preset duration threshold, or the pressing pressure value of the pressing operation is greater than or equal to a preset pressure threshold.

[0155] In one implementation, the window corresponding to the first window mode includes a preset control; and the preset trigger gesture includes a pressing operation performed at a location where the preset control is located.

[0156] In one embodiment, the displayed icons include a second icon, and the processing operation represented by the second icon includes switching to a second window mode, and the window area of ​​the second window mode is larger than the window area of ​​the first window mode.

[0157] In one embodiment, the displayed icons further include a third icon, and the processing operation represented by the third icon includes switching to a third window mode, and the window area of ​​the third window mode is smaller than the window area of ​​the first window mode.

[0158] In one implementation, the displayed icons further include a fourth icon, and the processing operation represented by the fourth icon includes closing the first window mode.

[0159] In one embodiment, the first window mode includes displaying the running interface of the application in a window, the second window mode includes displaying the running interface of the application in full screen, and the third window mode includes displaying customized information of the application in a window.

[0160] In one implementation, the processor 403 may further execute: before the first gesture ends, if the gesture pause position is located at the display position of the icon, displaying a preview effect of the processing operation represented by the corresponding icon.

[0161] In one implementation, the processor 403 may further execute: returning to the desktop after closing the first window mode.

[0162] In one implementation, the processor 403 may further execute: before the first gesture ends, the window in the window mode moves along the trajectory of the first gesture.

[0163] In one embodiment, the processor 403 may also execute: when displaying application information in a first window mode, receiving information of a second gesture, the second gesture comprising selecting a window corresponding to the first window mode and moving the selected window to an edge of the display screen; based on the information of the second gesture, hiding the window corresponding to the first window mode at an edge of the display screen, and indicating the location of the hidden window as an icon.

[0164] In the above embodiments, the description of each embodiment has its own focus. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the device control method above, and will not be repeated here.

[0165] The device control apparatus provided in the embodiment of the present application belongs to the same concept as the device control method in the above embodiment. Any method provided in the device control method embodiment can be run on the device control apparatus. The specific implementation process is detailed in the device control method embodiment and will not be repeated here.

[0166] It should be noted that, for the device control method described in the embodiment of the present application, a person of ordinary skill in the art can understand that all or part of the process of implementing the device control method described in the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor, and the execution process may include the process of the embodiment of the device control method. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.

[0167] For the device control device of the embodiment of the present application, each functional module can be integrated into a processing chip, or each module can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk or an optical disk.

[0168] The above is a detailed introduction to a device control method, apparatus, storage medium and electronic device provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A device control method, characterized in that: The method comprises: When displaying information of the application in a first window mode, receiving information of a first gesture, the first window mode comprising displaying a running interface of the application in a window, and the window corresponding to the first window mode comprising a preset control; If the first gesture includes a preset trigger gesture, at least one icon is displayed, the preset trigger gesture includes a pressing operation performed at the location where the preset control is located, the pressing duration of the pressing operation is greater than or equal to the preset duration threshold, or the pressing pressure value of the pressing operation is greater than or equal to the preset pressure threshold, each of the icons is used to represent a processing operation performed on the first window mode, the at least one icon includes a second icon and a third icon, the processing operation represented by the second icon includes switching to a second window mode, the second window mode includes displaying the running interface of the application in full screen, the window area of ​​the second window mode is larger than the window area of ​​the first window mode, the processing operation represented by the third icon includes switching to a third window mode, the third window mode includes displaying customized information of the application in a window, and the window area of ​​the third window mode is smaller than the window area of ​​the first window mode; Before the first gesture ends, the window in the window mode moves synchronously following the trajectory of the first gesture; If the gesture end position of the first gesture is located at the display position of any of the icons, the processing operation represented by the icon is executed.

2. The device control method according to claim 1, characterized in that: The first gesture includes a first gesture section and a second gesture section, the first gesture section occurs before the second gesture section, and the first gesture section and the second gesture section have a continuous gesture trajectory; The first gesture includes a preset trigger gesture, including: the first gesture matches the preset trigger gesture.

3. The device control method according to claim 1, characterized in that: The displayed icons further include a fourth icon, and the processing operation represented by the fourth icon includes closing the first window mode.

4. The device control method according to claim 1, characterized in that: The method further comprises: Before the first gesture ends, if the gesture pause position is located at the display position of the icon, a preview effect of the processing operation represented by the corresponding icon is displayed.

5. The device control method according to claim 4, characterized in that: The method further comprises: Return to the desktop after closing the first window mode.

6. The device control method according to claim 1, characterized in that: The method further comprises: When displaying information of the application in the first window mode, receiving information of a second gesture, wherein the second gesture includes selecting a window corresponding to the first window mode and moving the selected window to an edge of the display screen; The window corresponding to the first window mode is hidden at the edge of the display screen, and the position of the hidden window is indicated by an icon.

7. A device control device, characterized in that: The device comprises: A first receiving module, configured to receive information of a first gesture when information of an application is displayed in a first window mode, wherein the first window mode includes displaying a running interface of the application in a window, and the window corresponding to the first window mode includes a preset control; a display module, configured to display at least one icon if the first gesture includes a preset trigger gesture, the preset trigger gesture including a pressing operation performed at a location where the preset control is located, the pressing duration of the pressing operation being greater than or equal to a preset duration threshold, or the pressing pressure value of the pressing operation being greater than or equal to a preset pressure threshold, each of the icons being used to represent a processing operation performed on the first window mode, the at least one icon including a second icon and a third icon, the processing operation represented by the second icon including switching to a second window mode, the second window mode including displaying a running interface of the application in full screen, the window area of ​​the second window mode being greater than the window area of ​​the first window mode, the processing operation represented by the third icon including switching to a third window mode, the third window mode including displaying customized information of the application in a window, and the window area of ​​the third window mode being smaller than the window area of ​​the first window mode; An execution module is used to cause the window in window mode to move synchronously following the trajectory of the first gesture before the first gesture ends, and if the gesture end position of the first gesture is located at the display position of any of the icons, execute the processing operation represented by the icon.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 6.

9. An electronic device, comprising a memory and a processor, characterized in that: The processor executes the method according to any one of claims 1 to 6 by calling the computer program stored in the memory.

Images