Control method, device, program product, and electronic device

Abstract

The present disclosure provides a control method, device, program product and electronic device, and relates to the technical field of computers. The control method provides a touchable graphical user interface by a terminal device, the graphical user interface includes a main interface and one or more sub-interfaces; wherein, the main interface and the sub-interfaces display interfaces of different application programs; or, the main interface displays a system interface, and the sub-interfaces display interfaces of application programs. The method comprises: in response to a first touch operation, determining a target sub-interface in the one or more sub-interfaces according to the first touch operation; the first touch operation acts on a region of the target sub-interface; in response to a first interaction operation, controlling the target sub-interface according to the first interaction operation; and an operation period of the first interaction operation is a subset of an operation period of the first touch operation. The present disclosure improves the control efficiency of the sub-interface and improves the user experience.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a control method, control device, computer program product, and electronic device. Background Technology

[0002] When using a terminal device, users often need to view multiple sub-interfaces simultaneously. Therefore, many applications support displaying sub-interfaces in the form of floating windows on the terminal device, so that when the user exits the application's full-screen display state, they can continue to view the application in the form of floating windows.

[0003] The sub-interface control methods provided in related technologies are relatively complex, resulting in a high learning cost for users during the control process. This makes the operation of the sub-interface control methods less convenient, and users are prone to making mistakes when controlling the sub-interface, thus leading to low efficiency of the sub-interface control methods. Summary of the Invention

[0004] This disclosure provides a control method, control device, computer program product, and electronic device, thereby improving, at least to some extent, the problem of low efficiency in sub-interface control methods.

[0005] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0006] According to a first aspect of this disclosure, a control method is provided, which provides a touch-sensitive graphical user interface (GUI) via a terminal device, the GUI including a main interface and one or more sub-interfaces; wherein the main interface and the sub-interfaces display interfaces of different applications; or, the main interface displays a system interface, and the sub-interfaces display interfaces of applications; the method includes: in response to a first touch operation, determining a target sub-interface in the one or more sub-interfaces according to the first touch operation; the first touch operation is applied to an area of ​​the target sub-interface; in response to a first interaction operation, controlling the target sub-interface according to the first interaction operation; the operation period of the first interaction operation is a subset of the operation period of the first touch operation.

[0007] According to a second aspect of this disclosure, a control device is provided that provides a touch-sensitive graphical user interface via a terminal device, the graphical user interface including a main interface and one or more sub-interfaces; wherein the main interface and the sub-interfaces display interfaces of different applications; or, the main interface displays a system interface and the sub-interfaces display interfaces of applications; the device includes: a target sub-interface determination module configured to determine a target sub-interface in the one or more sub-interfaces in response to a first touch operation; the first touch operation is applied to an area of ​​the target sub-interface; and an interaction module configured to control the target sub-interface in response to a first interaction operation; wherein the operation period of the first interaction operation is a subset of the operation period of the first touch operation.

[0008] According to a third aspect of this disclosure, a computer program is provided that, when executed by a processor, implements the control method of the first aspect and its possible implementations.

[0009] According to a fourth aspect of this disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor. The processor is configured to perform the control method of the first aspect and its possible implementations thereof by executing the executable instructions.

[0010] The technical solution disclosed herein has the following beneficial effects:

[0011] On the one hand, the first touch operation applied to the target sub-interface area determines the sub-interface to be controlled, and the target sub-interface is controlled according to the first interactive operation. This allows users to control the target sub-interface with simple two-finger operations, reducing the complexity of the sub-interface control process, lowering the learning cost for users, improving the ease of operation of the target sub-interface, and effectively improving the control efficiency of the sub-interface. On the other hand, the operation period of the first interactive operation is a subset of the operation period of the first touch operation. In other words, users can perform the first interactive operation while performing the first touch operation, reducing the possibility of accidental control of other sub-interfaces due to accidental touches, improving the accuracy of the sub-interface control process. Furthermore, the first touch operation and the first interactive operation can be triggered simultaneously by two fingers, effectively reducing the time cost of the target sub-interface control process and further improving the control efficiency of the target sub-interface.

[0012] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0013] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0014] Figure 1 This illustrates the system operating architecture of this exemplary embodiment;

[0015] Figure 2 A flowchart of a control method in this exemplary embodiment is shown;

[0016] Figure 3 This diagram illustrates a working area of ​​the first interactive operation in this exemplary embodiment.

[0017] Figure 4 A schematic diagram showing another area of ​​action of the first interactive operation in this exemplary embodiment;

[0018] Figure 5 This diagram illustrates the orientation of the terminal device screen in this exemplary embodiment.

[0019] Figure 6 A flowchart illustrating a method for controlling a target sub-interface via a movement trajectory of a first interactive operation in this exemplary embodiment is shown.

[0020] Figure 7 A schematic diagram showing the radiation range of the first interactive operation in this exemplary embodiment is provided.

[0021] Figure 8A This diagram illustrates how a target sub-interface is determined via a first touch operation in this exemplary embodiment.

[0022] Figure 8B This diagram illustrates how the volume of the target sub-interface is determined through a first interactive operation in this exemplary embodiment.

[0023] Figure 8C This diagram illustrates how the transparency of the target sub-interface is determined through a first interactive operation in this exemplary embodiment.

[0024] Figure 8D This diagram illustrates another method of determining the volume of a target sub-interface through a first interactive operation in this exemplary embodiment.

[0025] Figure 8E This diagram illustrates another method for determining the transparency of a target sub-interface through a first interactive operation in this exemplary embodiment.

[0026] Figure 9 This diagram illustrates the structure of a control device according to this exemplary embodiment.

[0027] Figure 10 A schematic diagram of the structure of an electronic device in this exemplary embodiment is shown. Detailed Implementation

[0028] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided to make this disclosure more comprehensive and complete, and to fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced with one or more specific details omitted, or other methods, components, apparatus, steps, etc., can be employed. In other instances, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0029] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0030] The sub-interface control methods provided in related technologies result in a high learning cost for users during the control process, which easily leads to low ease of operation of the sub-interface control methods. Furthermore, users are prone to making mistakes when controlling the sub-interface, resulting in low efficiency of the sub-interface control methods.

[0031] In view of one or more of the above-mentioned problems, this disclosure first provides a control method through exemplary embodiments. The following describes a method in conjunction with... Figure 1 The system architecture of the operating environment for this exemplary embodiment will be described.

[0032] refer to Figure 1As shown, system architecture 100 may include terminal device 110 and server 120. Terminal device 110 may be an electronic device such as a smartphone or tablet. Terminal device 110 can be used to provide a touch-sensitive graphical user interface, which includes a main interface and one or more sub-interfaces. Sub-interfaces may be small windows that float on the main interface, for example, when a player exits a video application or game, they are not completely closed, but float on the screen of a mobile phone or tablet for small-screen playback / idle operation. This disclosure does not specifically limit the triggering method and specific form of sub-interfaces.

[0033] The control method in this exemplary embodiment can be executed by the terminal device 110. In one embodiment, the graphical user interface provided by the terminal device 110 may include a main interface and one or more sub-interfaces, and the main interface and sub-interfaces display interfaces of different applications; or, the main interface displays the system interface and the sub-interfaces display the application interface; in response to a first touch operation, a target sub-interface can be determined in one or more sub-interfaces according to the first touch operation, and the first touch operation acts on the area of ​​the target sub-interface; in response to a first interaction operation, the target sub-interface can be controlled according to the first interaction operation, and the operation period of the first interaction operation is a subset of the operation period of the first touch operation.

[0034] As can be seen from the above, the control method in this exemplary embodiment can be executed by the terminal device 110.

[0035] The following is combined Figure 2 The control methods are explained. Figure 2 An exemplary flow of the control method is shown, including the following steps S210 to S220:

[0036] Step S210: In response to the first touch operation, determine the target sub-interface in one or more sub-interfaces based on the first touch operation; the first touch operation is applied to the area of ​​the target sub-interface.

[0037] Step S220: In response to the first interactive operation, control the target sub-interface according to the first interactive operation; the operation period of the first interactive operation is a subset of the operation period of the first touch operation.

[0038] Based on the above method, on the one hand, the sub-interface to be controlled is determined by the first touch operation applied to the target sub-interface area, and the target sub-interface is controlled according to the first interactive operation. This allows users to control the target sub-interface with simple two-finger operations, reducing the complexity of the sub-interface control process, lowering the learning cost for users, improving the ease of operation of the target sub-interface, and effectively improving the control efficiency of the sub-interface. On the other hand, the operation period of the first interactive operation is a subset of the operation period of the first touch operation. That is to say, users can perform the first interactive operation while performing the first touch operation, reducing the possibility of accidental control of other sub-interfaces due to accidental touches, improving the accuracy of the sub-interface control process. Moreover, the first touch operation and the first interactive operation can be triggered simultaneously by two fingers, effectively reducing the time cost of the target sub-interface control process and further improving the control efficiency of the target sub-interface.

[0039] The following is about Figure 2 Each step in the process will be explained in detail.

[0040] refer to Figure 2 In step S210, in response to the first touch operation, a target sub-interface is determined in one or more sub-interfaces based on the first touch operation; the first touch operation is applied to the area of ​​the target sub-interface.

[0041] The first touch operation can be used to determine a target sub-interface within one or more sub-interfaces of a graphical user interface (GUI). The GUI is a touch-enabled interface provided by a terminal device, including a main interface and one or more sub-interfaces. The main interface and sub-interfaces display interfaces of different applications; alternatively, the main interface displays the system interface, and the sub-interfaces display the application interfaces. For example, the first touch operation can include a long-press touch operation applied to an area of ​​the target sub-interface. The area of ​​the target sub-interface can include the display area of ​​the target sub-interface within the GUI.

[0042] The user's first touch operation on the target sub-interface area through an operating medium (such as the user's finger) can determine the target sub-interface to be controlled in one or more sub-interfaces in the graphical user interface, so that the subsequent first interactive operation's control process on the target sub-interface can be applied to the target sub-interface.

[0043] After determining the target sub-interface, continue to refer to... Figure 2 In step S220, in response to the first interactive operation, the target sub-interface is controlled according to the first interactive operation; the operation period of the first interactive operation is a subset of the operation period of the first touch operation.

[0044] Because the operation period of the first interactive operation is limited to a subset of the operation period of the first touch operation, the user can perform the first interactive operation on the outer area of ​​the target sub-interface within the operation period of the first touch operation to control the target sub-interface. For example, the user can control the target sub-interface by pressing and holding one finger (i.e., the first touch operation) and performing the first interactive operation with another finger. The start time of the first touch operation performed by the finger pressing and holding the target sub-interface is no later than the start time of the first interactive operation performed by the other finger, and the end time of the first touch operation is no earlier than the end time of the first interactive operation performed by the other finger. In other words, the first interactive operation is not responded to before the first touch operation is detected; and the first interactive operation is not responded to after the first touch operation is detected to have ended.

[0045] The first interactive operation is an operation used to control the target sub-interface and is applied to the outer area of ​​the target sub-interface. This disclosure does not impose any special limitation on the operation method of the first interactive operation. For example, the first interactive operation may include sliding touch operation, pressing touch operation, gesture touch operation, long press touch operation, click touch operation, drag touch operation, air gesture operation, double-click operation, drag operation, key input, floating touch operation, etc.

[0046] Since the first interactive operation can include touch operation and air gesture operation, the effective area of ​​the first interactive operation is further defined:

[0047] When the first interactive operation is a touch operation, in one embodiment, the first interactive operation is applied to an area outside the target sub-interface in the graphical user interface.

[0048] For example, refer to Figure 3 As shown, Figure 3 The graphical user interface provided by the terminal device shown includes a main interface and target sub-interfaces 311 and 312. The first interactive operation's active area may include... Figure 3 The gray shaded area in the image.

[0049] By limiting the scope of the first interactive operation to an area outside the target sub-interface in the graphical user interface, accidental operation on the target sub-interface by the first interactive operation can be effectively avoided.

[0050] Furthermore, in order to avoid the first interactive operation causing misoperation to the sub-interface 312, in one embodiment, the first interactive operation is applied to areas outside the sub-interfaces in the graphical user interface.

[0051] In other words, the first interactive operation can be applied to areas outside all sub-interfaces of the graphical user interface. For example, refer to... Figure 4 As shown, Figure 4 The graphical user interface provided by the terminal device shown includes a main interface and target sub-interfaces 411 and 412. The effective area of ​​the first interactive operation includes... Figure 4 The gray shaded area in the image.

[0052] By further limiting the scope of the first interactive operation to an area outside all sub-interfaces in the graphical user interface, the erroneous operations caused by the first interactive operation to each sub-interface can be reduced to some extent.

[0053] When the touch display screen of the terminal device is small, the area of ​​action of the first interactive operation is not limited to the target sub-interface or the area outside the sub-interface in the graphical user interface (that is, the entire graphical user interface can be the area of ​​action of the first interactive operation), as long as the first touch operation and the first interactive operation acting on the sub-interface at the same time do not conflict with other multi-touch operations on the sub-interface.

[0054] To balance preventing accidental touches and making full use of the limited screen size, the area of ​​effect of the first interactive operation can be limited to an area outside the target sub-interface in the graphical user interface. Subsequent touch points are not limited to areas outside the target sub-interface in the graphical user interface; they can also be located within the target sub-interface. In this way, the first interactive operation can be distinguished from other multi-touch operations applied to the sub-interface, while also making full use of the display area of ​​the terminal device's touch screen.

[0055] Since the first interactive operation may also include air gesture operation, in one embodiment, the first interactive operation is applied to an area within a preset distance range in front of the terminal device screen.

[0056] In other words, the first interactive operation can also be applied to a three-dimensional spatial area within the air gesture range corresponding to the terminal device. That is, the user's finger does not need to touch the terminal to control the target sub-interface through the first interactive operation. The aforementioned preset distance range can be the air gesture range of the terminal device. The preset distance can be used to indicate the upper limit of the air gesture distance that the terminal device can detect. That is, when the first interactive operation is an air gesture operation, the distance between the operation medium (such as the user's finger) and the screen of the terminal device is greater than 0 and less than or equal to the preset distance. This disclosure does not make any special limitation on the specific value of the preset distance. The preset distance is usually determined according to the maximum distance value that the screen sensor used by the terminal device can detect. For example, the maximum distance value that the screen sensor can detect can be 10cm, 15cm, etc.

[0057] For example, refer to Figure 5 As shown, Figure 5The graphical user interface provided by the terminal device shown includes a main interface and target sub-interfaces 511 and 512. Figure 5 In the coordinate system shown, the plane containing the x-axis and y-axis can be the plane containing the screen of the terminal device. The front of the screen refers to the direction pointed to by the z-axis. The preset distance range can be in the three-dimensional space pointed to by the z-axis (excluding the plane containing the x-axis and y-axis).

[0058] By limiting the effective area of ​​the first interactive operation to a preset distance range in front of the terminal device screen, the problem of misoperation during the control process of the target sub-interface can be reduced to a certain extent, thereby improving the control efficiency of the target sub-interface.

[0059] To increase the user's freedom in controlling the sub-interface, in one implementation, the effective area of ​​the first interactive operation can be determined based on the user's interactive operation settings.

[0060] The interactive operation settings information can be used to indicate the area of ​​effect of the first interactive operation. For example, the interactive operation settings information can be used to determine that the area of ​​effect of the first interactive operation includes the area outside the sub-areas in the graphical user interface.

[0061] By defining the scope of the first interactive operation through interactive operation settings, users can customize the scope of the first interactive operation according to their own operating habits, thereby increasing the user's freedom in the control process and further improving the user experience.

[0062] The above describes the scope of the first interactive operation. The following describes the control process of the target sub-interface through the first interactive operation.

[0063] In one implementation, controlling the target sub-interface according to the first interactive operation may include the following steps:

[0064] The target sub-interface is controlled based on the movement trajectory of the first interactive operation.

[0065] The aforementioned movement trajectory includes the movement direction and movement distance. The target sub-interface controls the movement trajectory based on the first interactive operation, referencing... Figure 6 As shown, steps S610 to S620 may be included:

[0066] Step S610: Determine the target multimedia control parameters from the multimedia control parameters according to the direction of movement;

[0067] Wherein, the movement direction is used to represent the sliding direction of the first interactive operation. This disclosure does not specifically limit the process of determining the movement direction. For example, it can be determined according to the first interactive operation for a certain direction (such as...). Figure 5 The direction of movement can be determined by the angle range of the deviation angle (pointed to by the y-axis of the coordinate system). Alternatively, the radiation range of the first interactive operation can be defined as a circular or spherical area with the starting position of the first interactive operation as the center and the movement distance of the first interactive operation as the radius. This radiation range can be divided into multiple sub-regions, each corresponding to a different direction of movement. The direction of movement of the first interactive operation is determined based on the sub-region to which its movement trajectory belongs. For example, if the first interactive operation is a sliding operation acting on an area outside the target sub-interface in the graphical user interface, then the radiation range of the first interactive operation can be as follows: Figure 7 As shown in 710, point A is the starting position of the first interactive operation in the graphical user interface. The radiation range 710 can include sub-regions 711 to 714, where sub-region 711 corresponds to movement direction 1, sub-region 712 corresponds to movement direction 2, sub-region 713 corresponds to movement direction 3, and sub-region 714 corresponds to movement direction 4. When the movement trajectory of the first interactive operation falls in sub-region 711, it can be determined that the movement direction of the first interactive operation is movement direction 1.

[0068] Multimedia control parameters may include settings parameters of sub-interfaces. In one embodiment, the multimedia control parameters include one or more of display attribute parameters, sound control parameters, and playback parameters.

[0069] The display attribute parameters can be used to set the display effect of the sub-interface. For example, the display attribute parameters can include transparency, brightness, etc.; the sound control parameters can be used to adjust the sound of the sub-interface. For example, the sound control parameters can include volume, etc.; the playback parameters can be used to set the video or audio playback of the sub-interface. For example, the playback parameters can include the playback speed, playback progress, etc.

[0070] By adding one or more of the following parameters to the multimedia control parameters: display attribute parameters, sound control parameters, and playback parameters, users can customize the transparency, volume, etc. of the target sub-interface based on the first interactive operation, thereby ensuring that users can customize a variety of entertainment experiences on the same terminal device.

[0071] In one embodiment, determining the target multimedia control parameter from the multimedia control parameters based on the direction of movement may include:

[0072] The target multimedia control parameters are determined based on the preset mapping relationship between the direction of movement and the multimedia control parameters.

[0073] The aforementioned preset mapping relationship can be used to determine the target multimedia control parameters by the direction of movement. This disclosure does not impose any special limitations on the method of determining the preset mapping relationship. For example, the preset mapping relationship can be specified by the developer or customized by the user.

[0074] For example, if the movement direction includes movement direction 1 (horizontal direction of the terminal device) and movement direction 2 (vertical direction of the terminal device), the preset mapping relationship can include transparency in the display attribute parameter corresponding to movement direction 1 and volume in the sound control parameter corresponding to movement direction 2. If the movement direction is determined to be movement direction 1, the target multimedia control parameter can be determined to be transparency according to the preset mapping relationship.

[0075] By determining the target multimedia control parameters corresponding to the movement direction of the first interactive operation through a preset mapping relationship, the complexity of determining the target multimedia control parameters can be reduced, thereby effectively improving the efficiency of determining the target multimedia control parameters and further improving the control efficiency of the target sub-interface.

[0076] In one embodiment, after determining the target multimedia control parameters from the multimedia control parameters based on the direction of movement, the method may further include the following steps:

[0077] Display the target multimedia control controls corresponding to the target multimedia control parameters in the graphical user interface.

[0078] Among them, the target multimedia control is the identifier corresponding to the target multimedia control parameter. For example, if the target multimedia control parameter is volume, then a volume control can be used. The display position of the control can be set according to specific needs. To indicate to the user the target sub-interface currently being controlled, the control can be displayed in or next to the target sub-interface; to facilitate user operation, it can also be displayed near the touch position of the first interactive operation; to avoid obscuring the target sub-interface, it can also be displayed in an area outside the target sub-interface.

[0079] After determining the target multimedia control parameters, the target multimedia control control control corresponding to the target multimedia control parameters is displayed, which allows users to clearly understand which multimedia control parameters are currently being controlled, thereby improving the user experience.

[0080] After determining the target multimedia control parameters, continue to refer to Figure 6 In step S620, the target multimedia control parameters are adjusted based on the movement distance to control the target sub-interface.

[0081] In other words, the target multimedia control parameters can be adjusted by moving the distance of the first interactive operation, thereby controlling the transparency, volume, or video playback speed of the target sub-interface.

[0082] For example, refer to Figure 8A As shown, the terminal device provides a touch-enabled graphical user interface, which includes a main interface, and sub-interfaces 811 and 812. The user selects sub-interface 811 as the target sub-interface by long-pressing (first touch operation) sub-interface 811. The shaded area 821 is the contact area between the user's finger and the graphical user interface. After triggering the first touch operation, the user can apply a highlighting effect to the target sub-interface 811 (such as increasing the display size, highlighting the border of the target sub-interface, etc.) so that the user can clearly see the currently selected target sub-interface.

[0083] After determining the target sub-interface, it can be controlled based on the first interactive operation. The methods for controlling the target sub-interface based on the first interactive operation can be divided into the following categories:

[0084] (1) Taking the first interactive operation as a sliding touch operation as an example, refer to Figure 8B and Figure 8C As shown, the shaded area 822 is the contact area between the user's finger and the graphical user interface when the user performs the first interactive operation; Reference Figure 8B As shown, the dashed arrow 841 indicates the direction of movement for the first interactive operation. Based on the direction of movement, the corresponding target multimedia control parameter is determined to be volume. Therefore, the target multimedia control control 831 corresponding to the volume is displayed. And based on the distance the user moves in the direction of movement, the volume of the target sub-interface is adjusted from 20 to 70 to achieve sound control of the target sub-interface 811. (Reference) Figure 8C As shown, when the user's first interactive operation is detected to be moving in the direction indicated by arrow 842, the target multimedia control parameter can be determined to be transparency based on the movement direction, and the target multimedia control control 832 corresponding to the transparency can be displayed; at the same time, based on the user's movement distance in the movement direction, the transparency of the target sub-interface is adjusted from 70 to 20, so that the adjusted target sub-interface 811 is displayed with a transparency of 20.

[0085] (2) Taking the first interactive operation as an example, which is an air swipe operation, refer to Figure 8D As shown, arrow 851 can be used to indicate the direction of movement for the air-sliding operation. Based on this direction, the corresponding target multimedia control parameter can be determined to be volume, and the target multimedia control control 831 corresponding to the volume is displayed. Based on the distance the user moves in the direction of movement, the volume of the target sub-interface is adjusted from 20 to 70 to achieve sound control of the target sub-interface 811. (Reference) Figure 8EAs shown, arrow 852 can be used to indicate the direction of movement of the air swipe operation. Based on the direction of movement, the corresponding target multimedia control parameter can be determined to be transparency. Then, the target multimedia control control 832 corresponding to the transparency is displayed. Based on the distance the user moves in the direction of movement, the transparency of the target sub-interface is adjusted from 70 to 20 so that the adjusted target sub-interface 811 is displayed with a transparency of 20.

[0086] based on Figure 6 The proposed method allows control of the target sub-interface via the movement trajectory of the first interactive operation. Compared to existing technologies, this simplifies the control of the target sub-interface and effectively improves its control efficiency.

[0087] Furthermore, since the first interactive operation can include not only swiping operations but also long-press or hover operations, an example of controlling the target sub-interface through long-press or hover operations is provided: taking a long-press touch operation with a finger outside the target sub-interface, or a hover operation with a finger at a certain position in the area outside the target sub-interface within a preset distance range in front of the screen as an example, when the user's long-press touch operation or hover operation meets preset conditions (such as the duration of the long-press touch operation or the duration of the hover operation being greater than a preset duration), the target multimedia control control corresponding to the speed adjustment can be displayed, and the playback speed of the content on the target sub-interface, such as video playback speed adjustment, can be controlled according to the operation duration of the long-press touch operation or hover operation.

[0088] In one implementation, the operation mode of the first interactive operation and the multimedia control parameters controlled by the first interactive operation can also be determined based on the user's interactive operation settings information.

[0089] In other words, users can customize the area of ​​effect, operation method (such as long press touch operation, air swipe operation, etc.) of the first interactive operation according to their own operating habits, as well as the multimedia control operation controlled by the operation method in the area of ​​effect, thereby further enhancing the user's freedom in the control process of the target sub-interface and enriching the user's entertainment experience.

[0090] Based on the above methods, the learning cost for users to control the sub-interface is reduced, the ease of operation of the target sub-interface is improved, and the control efficiency of the sub-interface is effectively enhanced.

[0091] Exemplary embodiments of this disclosure also provide a control device that provides a touch-sensitive graphical user interface (GUI) via a terminal device. The GUI includes a main interface and one or more sub-interfaces; wherein the main interface and sub-interfaces display interfaces of different applications; or, the main interface displays a system interface, and the sub-interfaces display interfaces of applications. For example... Figure 9As shown, the control device 900 may include:

[0092] The target sub-interface determination module 910 is configured to respond to a first touch operation and determine a target sub-interface in one or more sub-interfaces based on the first touch operation; the first touch operation is applied to the area of ​​the target sub-interface.

[0093] The interaction module 920 is configured to respond to a first interaction operation and control a target sub-interface according to the first interaction operation; the operation period of the first interaction operation is a subset of the operation period of the first touch operation.

[0094] In one implementation, the first interactive operation described above acts on an area outside the target sub-interface in the graphical user interface.

[0095] In one implementation, the initial touch point of the first interactive operation is located in an area outside the target sub-interface in the graphical user interface.

[0096] In one embodiment, the first interactive operation is performed on an area within a preset distance range in front of the terminal device screen.

[0097] In one implementation, the above-mentioned control of the target sub-interface according to the first interactive operation may include:

[0098] The target sub-interface is controlled based on the movement trajectory of the first interactive operation.

[0099] In one embodiment, the movement trajectory includes a movement direction and a movement distance, and the target sub-interface controlled by the movement trajectory according to the first interactive operation may include:

[0100] Determine the target multimedia control parameters from the multimedia control parameters based on the direction of movement;

[0101] The target multimedia control parameters are adjusted based on the movement distance to control the target sub-interface.

[0102] In one embodiment, after determining the target multimedia control parameters from the multimedia control parameters based on the direction of movement, the above-mentioned device may further include:

[0103] Display the target multimedia control controls corresponding to the target multimedia control parameters in the graphical user interface.

[0104] In one embodiment, the multimedia control parameters may include one or more of display attribute parameters, sound control parameters, and playback parameters.

[0105] The specific details of each part of the above-mentioned device have been described in detail in the method section of the implementation, and therefore will not be repeated here.

[0106] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to exemplary embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0107] Exemplary embodiments of this disclosure also provide a computer program product, which includes a computer program that, when executed by a processor, implements the above-described control method.

[0108] Computer programs for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The computer program can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0109] In one implementation, the computer program product can be an intangible product containing a computer program. For example, the computer program product can be implemented as a virtual digital product, such as an executable file, installation package, or other digital file storing the computer program.

[0110] Computer program code can be written in one or more programming languages. Examples of programming languages ​​include C, Java, and C++. Program code can execute entirely on the user's computing device, partially on the user's computing device, or as a standalone software package. It can also execute partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, such as a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via an internet connection provided by a mobile network operator).

[0111] Computer programs can be carried or transmitted via signals such as electricity, magnetism, light, electromagnetic fields, and infrared radiation. Electronic devices can convert signals carrying computer programs into digital signals, thereby running the computer programs. When a computer program runs on an electronic device, its code is used to cause the electronic device to execute (more specifically, the processor of the electronic device to execute) the method steps of various exemplary embodiments of this disclosure. For example, the control method described above can be executed, which provides a touch-sensitive graphical user interface through a terminal device. The graphical user interface includes a main interface and one or more sub-interfaces; wherein the main interface and the sub-interfaces display interfaces of different applications; or, the main interface displays a system interface, and the sub-interfaces display interfaces of applications, which may include the following steps: responding to a first touch operation, determining a target sub-interface in one or more sub-interfaces according to the first touch operation; the first touch operation is applied to an area of ​​the target sub-interface;

[0112] In response to a first interactive operation, the target sub-interface is controlled according to the first interactive operation; the operation period of the first interactive operation is a subset of the operation period of the first touch operation.

[0113] By executing the above method steps through a computer program, on the one hand, the sub-interface to be controlled is determined by a first touch operation applied to the target sub-interface area, and the target sub-interface is controlled according to a first interactive operation. This allows users to control the target sub-interface with simple two-finger operations, reducing the complexity of the sub-interface control process, lowering the learning cost for users, improving the ease of operation of the target sub-interface, and effectively improving the control efficiency of the sub-interface. On the other hand, the operation period of the first interactive operation is a subset of the operation period of the first touch operation. That is to say, users can perform the first interactive operation while performing the first touch operation, reducing the possibility of accidental control of other sub-interfaces due to accidental touches, improving the accuracy of the sub-interface control process. Furthermore, the first touch operation and the first interactive operation can be triggered simultaneously by two fingers, effectively reducing the time cost of the target sub-interface control process and further improving the control efficiency of the target sub-interface.

[0114] Exemplary embodiments of this disclosure also provide an electronic device, such as the terminal device 110 or server 120 described above. The electronic device may include a processor and a memory. The memory stores executable instructions for the processor, such as computer programs. The processor executes these executable instructions to perform the method steps of various exemplary embodiments of this disclosure.

[0115] The following is for reference. Figure 10 The electronic device is illustrated by way of a general-purpose computing device. It should be understood that... Figure 10 The electronic device 1000 shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0116] like Figure 10 As shown, the electronic device 1000 may include: a processor 1010, a memory 1020, a bus 1030, an I / O (input / output) interface 1040, and a network adapter 1050.

[0117] The processor 1010 may include one or more processing units, such as an AP (Application Processor), a modem processor, a GPU (Graphics Processing Unit), an ISP (Image Signal Processor), a controller, an encoder, a decoder, a DSP (Digital Signal Processor), a baseband processor, and / or an NPU (Neural-Network Processing Unit).

[0118] The processor 1010 can be used to execute executable instructions stored in the memory 1020, such as executing the control method described above. It provides a touch-sensitive graphical user interface (GUI) through a terminal device. The GUI includes a main interface and one or more sub-interfaces. The main interface and sub-interfaces display interfaces of different applications; or, the main interface displays a system interface, and the sub-interfaces display interfaces of applications. This can include the following steps: in response to a first touch operation, determining a target sub-interface in one or more sub-interfaces based on the first touch operation; the first touch operation acting on an area of ​​the target sub-interface; in response to a first interaction operation, controlling the target sub-interface based on the first interaction operation; the operation period of the first interaction operation is a subset of the operation period of the first touch operation.

[0119] Implementing the above method through a computer program, on the one hand, the sub-interface to be controlled is determined by a first touch operation applied to the target sub-interface area, and the target sub-interface is controlled according to a first interactive operation. This allows users to control the target sub-interface with simple two-finger operations, reducing the complexity of the sub-interface control process, lowering the learning cost for users, improving the ease of operation of the target sub-interface, and effectively improving the control efficiency of the sub-interface. On the other hand, the operation period of the first interactive operation is a subset of the operation period of the first touch operation. That is to say, users can perform the first interactive operation while performing the first touch operation, reducing the possibility of accidental control of other sub-interfaces due to accidental touches, improving the accuracy of the sub-interface control process. Furthermore, the first touch operation and the first interactive operation can be triggered simultaneously by two fingers, effectively reducing the time cost of the target sub-interface control process and further improving the control efficiency of the target sub-interface.

[0120] The memory 1020 may include volatile memory, such as RAM 1021 and cache unit 1022, and may also include non-volatile memory, such as ROM 1023. The memory 1020 may also include one or more program modules 1024, such program modules 1024 including, but not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. For example, program module 1024 may include the modules in the aforementioned device 900.

[0121] Bus 1030 is used to connect different components of electronic device 1000, and may include data bus, address bus and control bus.

[0122] Electronic device 1000 can communicate with one or more external devices 1100 (such as keyboard, mouse, external controller, etc.) through I / O interface 1040.

[0123] Electronic device 1000 can communicate with one or more networks via network adapter 1050. For example, network adapter 1050 can provide mobile communication solutions such as 3G / 4G / 5G, or wireless communication solutions such as wireless LAN, Bluetooth, and near-field communication. Network adapter 1050 can communicate with other modules of electronic device 1000 via bus 1030.

[0124] although Figure 10 Other hardware and / or software modules, including but not limited to: displays, microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, may also be configured in the electronic device 1000.

[0125] As can be seen from the above, the technical solutions disclosed herein can be implemented as methods, apparatus, systems, computer program products, electronic devices, etc. Those skilled in the art will understand that various aspects of this disclosure can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be referred to as "circuit," "module," or "system," respectively.

[0126] It should be understood that this disclosure is not limited to the specific methods, steps, or structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. Those skilled in the art will readily conceive of other embodiments based on the specific implementations provided in this disclosure. Therefore, the specific implementations provided in this disclosure are merely exemplary, and the scope and spirit of this disclosure are indicated by the claims, and should cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary technical means in the art not disclosed in this disclosure.

Claims

1. A control method, characterized in that, A touch-sensitive graphical user interface is provided through a terminal device, the graphical user interface including a main interface and one or more sub-interfaces; wherein the main interface and the sub-interfaces display interfaces of different applications; or, the main interface displays a system interface, and the sub-interfaces display interfaces of applications; the method includes: In response to a first touch operation, a target sub-interface is determined in one or more sub-interfaces based on the first touch operation; the first touch operation is applied to an area of ​​the target sub-interface. In response to a first interactive operation, the target sub-interface is controlled according to the first interactive operation; the operation period of the first interactive operation is a subset of the operation period of the first touch operation, the start time of the first touch operation is not later than the start time of the first interactive operation, and the end time of the first touch operation is not earlier than the end time of the first interactive operation.

2. The method according to claim 1, characterized in that, The first interactive operation is performed on an area outside the target sub-interface in the graphical user interface.

3. The method according to claim 2, characterized in that, The initial touch point of the first interactive operation is located in an area outside the target sub-interface in the graphical user interface.

4. The method according to claim 1, characterized in that, The first interactive operation is performed on an area within a preset distance range in front of the terminal device screen.

5. The method according to claim 1, characterized in that, The step of controlling the target sub-interface according to the first interactive operation includes: The target sub-interface is controlled based on the movement trajectory of the first interactive operation.

6. The method according to claim 5, characterized in that, The movement trajectory includes the movement direction and movement distance, and controlling the target sub-interface based on the movement trajectory of the first interactive operation includes: The target multimedia control parameters are determined from the multimedia control parameters based on the direction of movement. The target multimedia control parameters are adjusted based on the travel distance to control the target sub-interface.

7. The method according to claim 6, characterized in that, After determining the target multimedia control parameters in the multimedia control parameters based on the movement direction, the method further includes: The target multimedia control control corresponding to the target multimedia control parameter is displayed in the graphical user interface.

8. The method according to claim 6, characterized in that, The multimedia control parameters include one or more of the following: display attribute parameters, sound control parameters, and playback parameters.

9. A control device, characterized in that, A touch-sensitive graphical user interface is provided through a terminal device, the graphical user interface including a main interface and one or more sub-interfaces; wherein the main interface and the sub-interfaces display interfaces of different applications; or, the main interface displays a system interface, and the sub-interfaces display interfaces of applications; the device includes: A target sub-interface determination module is configured to respond to a first touch operation and determine a target sub-interface in one or more sub-interfaces based on the first touch operation; the first touch operation is applied to an area of ​​the target sub-interface. An interaction module is configured to respond to a first interaction operation and control the target sub-interface according to the first interaction operation; the operation period of the first interaction operation is a subset of the operation period of the first touch operation, the start time of the first touch operation is not later than the start time of the first interaction operation, and the end time of the first touch operation is not earlier than the end time of the first interaction operation.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1 to 8.

11. An electronic device, characterized in that, include: processor; Memory for storing the executable instructions of the processor; The processor is configured to execute the method of any one of claims 1 to 8 by executing the executable instructions.

Images