Method, device, equipment and program for controlling interface display

Abstract

This application discloses a method, device, apparatus, and storage medium for controlling interface display, and relates to the technical field of interface display. The method includes: when a first game application is executed, displaying a first game interface and first virtual keys on a main user interface in full-screen mode; and when a switching mode is triggered, generating a first sub-interface and a first touch interface, the first touch interface being used to display virtual keys for controlling the first game application, and then reducing the first game interface before displaying it on the first sub-interface and displaying the first virtual keys on the first touch interface. This method eliminates the need for users to frequently switch interfaces, allowing users to continue playing games while simultaneously performing other tasks on a mobile terminal and simplifying user operations.

Description

[Technical Field]

[0001] This application claims priority from a Chinese patent application bearing application number 202011062334.3 and entitled "Method, device, apparatus and storage medium for controlling interface display," filed with the China Patent Office on September 30, 2020, the entire contents of which are incorporated herein by reference.

[0002] TECHNICAL FIELD This application relates to the technical field of interface display, and more particularly to controlling interface display. [Background technology]

[0003] With the continuous development of Internet technology, the types of application programs are becoming more and more diverse, and users' needs for the display functions of mobile devices are increasing day by day. Mobile devices play a very important role in people's daily communication, work, and entertainment.

[0004] Currently, games that can be run on mobile terminals mainly include stand-alone games and network games (also known as online games). Users can play games on their mobile terminals by downloading game applications. Usually, the game interface is displayed on the mobile terminal in full-screen mode, and users can operate the game on the display interface of the mobile terminal.

[0005] However, the functions of a mobile terminal not only provide game services but also many other tasks (services). If a user needs to perform other tasks while playing a game, the user must pause the game or switch the game to run in the background. If the user needs to resume the game, the user must launch the game application again. Therefore, the entire operation process is complicated, requiring frequent human-machine interactions, which may consume a large amount of processing resources of the mobile terminal. Summary of the Invention [Problem to be solved by the invention]

[0006] The embodiments of the present application aim to provide at least a method, device, equipment, and storage medium for controlling the display of an interface, which allows the user to continue playing the game while operating other tasks on the mobile terminal without having to frequently switch interfaces, and simplifies the user's operations, reduces the number of human-machine interactions, and reduces the consumption of processing resources on the mobile terminal. [Means for solving the problem]

[0007] According to one aspect of the present application, there is provided a method for controlling display of an interface, the method being applied to a mobile terminal, the method comprising: When the first game application is executed, displaying a first game interface and first virtual keys (also referred to as buttons) on the main user interface in full screen mode, the first virtual keys being used to control the first game application; and When the switching mode is triggered, the method includes performing a shrinking process on the first game interface and then displaying it on a first sub-interface, and displaying a first virtual key on a first touch interface, wherein the first sub-interface and the first touch interface are generated on the main user interface when the switching mode is triggered, and the first touch interface is used to display virtual keys for controlling the first game application.

[0008] According to another aspect of the present application, there is provided an apparatus for controlling display of an interface, the apparatus being deployed in a mobile terminal, the apparatus including: a display module; the display module is used to display a first game interface and a first virtual key on the main user interface in a full screen mode when the first game application is executed, and the first virtual key is used to control the first game application; The display module is further used to, when a switching mode is triggered, perform a shrinking process on the first game interface and then display it on a first sub-interface, and to display a first virtual key on a first touch interface, wherein the first sub-interface and the first touch interface are generated on the main user interface when the switching mode is triggered, and the first touch interface is used to display virtual keys for controlling the first game application.

[0009] According to another aspect of the present application, there is provided a mobile terminal, which includes a memory and a processor, wherein the memory is used to store a program, the processor is used to execute the program stored in the memory, and the processor is used to perform the method according to the above aspect in accordance with instructions in the program.

[0010] According to another aspect of the present application, a computer-readable storage medium is provided having instructions stored thereon that, when executed on a computer, cause the computer to perform the method described in the above aspect.

[0011] According to another aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored on a computer-readable storage medium, the computer instructions being read by a processor of a computing device from the computer-readable storage medium and executed by the processor to cause the computing device to perform a method according to the previous aspect. [Effects of the Invention]

[0012] The technical solutions provided by the embodiments of the present application at least have the following advantageous effects:

[0013] In an embodiment of the present application, a method for controlling interface display is provided, in which when a first game application is executed, a mobile terminal displays a first game interface and a first virtual key on a main user interface in full-screen mode; when a switching mode is satisfied, a first sub-interface and a first touch interface are generated on the main user interface, the first touch interface is used to display virtual keys for controlling the first game application, and the first game interface is reduced and then displayed on the first sub-interface, and the first virtual key is displayed on the first touch interface. In this manner, one sub-interface for displaying the game interface and one touch interface for controlling the game are generated on the main user interface, so that the user does not need to frequently switch interfaces, and the user can continue playing the game while operating other tasks on the mobile terminal. This simplifies the user's operation, reduces the number of human-machine interactions, and reduces the consumption of processing resources of the mobile terminal. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is a diagram illustrating an environment for controlling an interface display in an embodiment of the present application. [Figure 2] 1 is a flowchart of a method for controlling interface display in an embodiment of the present application; [Figure 3] FIG. 10 is a diagram illustrating an example of a method for controlling an interface display in an embodiment of the present application. [Figure 4] FIG. 10 is a diagram illustrating the display of a first game interface in full screen mode in an embodiment of the present application. [Figure 5] FIG. 10 is a diagram illustrating generating a first sub-interface and a first touch interface in an embodiment of the present application. [Figure 6] FIG. 10 illustrates switching to the main user interface in an embodiment of the present application. [Figure 7] FIG. 10 is a diagram illustrating another embodiment of a method for controlling interface display in an embodiment of the present application. [Figure 8] FIG. 10 is a diagram illustrating switching to a first game interface in an embodiment of the present application. [Figure 9] FIG. 10 is a diagram illustrating triggering a click operation on the first game interface in an embodiment of the present application. [Figure 10] FIG. 10 is a diagram illustrating triggering a pressing operation on the first game interface in an embodiment of the present application. [Figure 11] FIG. 10 is a diagram illustrating triggering a slide operation on the first game interface in an embodiment of the present application. [Figure 12] FIG. 10 is a diagram illustrating triggering a double-click operation on the first game interface in an embodiment of the present application. [Figure 13] FIG. 10 is a diagram illustrating triggering a multi-touch operation on a first game interface in an embodiment of the present application. [Figure 14] FIG. 10 is a diagram illustrating triggering a multi-touch operation on the first sub-interface in an embodiment of the present application. [Figure 15] FIG. 1 is a diagram showing an example of switching the device usage state in an embodiment of the present application. [Figure 16] FIG. 10 is a diagram illustrating another example of switching the device usage state in the embodiment of the present application. [Figure 17] FIG. 2 is a diagram showing the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal in an embodiment of the present application; [Figure 18]FIG. 1 is a diagram illustrating how interface switching is achieved based on face (human face) recognition in an embodiment of the present application. [Figure 19] FIG. 1 illustrates the implementation of revertive operation of an interface based on face recognition in an embodiment of the present application. [Figure 20] FIG. 10 is a diagram illustrating the implementation of interface switching based on call reminders in an embodiment of the present application. [Figure 21] FIG. 10 is a diagram illustrating how to determine the display of an interface based on an embedded interface in an embodiment of the present application. [Figure 22] FIG. 10 is a diagram illustrating the determination to realize the display of an interface based on a floating interface in an embodiment of the present application. [Figure 23] FIG. 10 is a diagram illustrating a drag operation on the first sub-interface in an embodiment of the present application. [Figure 24] FIG. 10 is a diagram illustrating a drag operation on the first sub-interface in an embodiment of the present application. [Figure 25] FIG. 2 is a diagram illustrating an embodiment of a first touch interface in an embodiment of the present application. [Figure 26] FIG. 10 is a diagram illustrating an example of selecting parameters of a first touch interface in an embodiment of the present application. [Figure 27] FIG. 10 is a diagram illustrating another embodiment of a method for controlling interface display in an embodiment of the present application. [Figure 28] FIG. 10 is a diagram illustrating another embodiment of a method for controlling interface display in an embodiment of the present application. [Figure 29] FIG. 10 is a diagram illustrating another embodiment of a method for controlling interface display in an embodiment of the present application. [Figure 30] FIG. 2 is a diagram illustrating an example of a display control device for an interface in an embodiment of the present application. [Figure 31]FIG. 2 is a diagram illustrating the configuration of a mobile terminal according to an embodiment of the present application. DETAILED DESCRIPTION OF THE INVENTION

[0015] The embodiments of the present application provide at least a method, a device, an apparatus, and a storage medium for controlling the display of an interface, which allows the user to continue playing the game without having to frequently switch interfaces, while still operating other tasks on the mobile terminal, simplifying the user's operations, reducing the number of human-machine interactions, and reducing the consumption of processing resources on the mobile terminal.

[0016] The terms "first," "second," "third," "fourth," etc. (when present) in the specification, claims, and drawings of this application are used to distinguish between similar objects and do not represent a particular order or chronological order. It should be understood that the data used in this manner may be interchanged where appropriate to cause the embodiments of the application described herein to be performed, for example, according to an order other than that illustrated or described herein. Furthermore, the terms "comprising" and "corresponding to" and any variations thereof are intended to cover a non-exclusive inclusiveness; for example, a process, method, system, product, or apparatus comprising a series of steps or units includes not only the explicitly listed steps or units, but also steps or units not explicitly listed, or other steps or units inherent in such a process, method, system, product, or apparatus.

[0017] With the continuous development of Internet technology, the types of application programs are becoming increasingly diverse, and game applications running on mobile terminals have become one of the most popular applications. To achieve better game effects, game interfaces are usually displayed on mobile terminals in full-screen mode, allowing users to operate the game on the display interface of the mobile terminal. However, considering the various types of tasks provided by mobile terminals, if a user needs to perform other tasks while playing a game, the user must pause the game or switch the game to the background, which may make the entire operation process cumbersome. Based on this, this application provides a method for controlling the display of an interface, which allows the user to operate other tasks on the mobile terminal while continuing to play the game without the user having to frequently switch interfaces, and simplifies the user's operation.

[0018] For example, a game application may be used as an example. When a user plays a game using a mobile terminal, the game interface may be displayed in full-screen mode on the mobile terminal. When the user needs to perform other tasks while playing the game, a sub-interface and a touch interface may be generated on the main user interface. The game interface may be reduced and then displayed on the sub-interface. Virtual keys may be displayed on the touch interface, allowing the user to control the game application using the virtual keys. This eliminates the need for the user to frequently switch interfaces, allowing the user to perform other tasks on the mobile terminal while continuing to play the game. This simplifies the user's operations, improves the user experience, reduces the number of human-machine interactions, and reduces the consumption of processing resources on the mobile terminal.

[0019] For clarity, please refer to FIG. 1, which is a diagram illustrating an environment for an interface display control method in an embodiment of the present application. As shown in FIG. 1, a game interface display control system includes a mobile terminal, and an application program, e.g., a game application, is deployed on the mobile terminal. The mobile terminal in the present application may be, but is not limited to, a smartphone, a tablet computer, a palmtop computer, etc. In the present application, the game application is taken as an example of a first game application, and A1 is used to indicate a first game interface in full-screen mode, A2 is used to indicate a first sub-interface, A3 is used to indicate a first game interface displayed on the first sub-interface, A4 is used to indicate a first touch interface, and A5 is used to indicate a first virtual key. When the mobile terminal runs the first game application, the first game interface and the first virtual key are displayed on the main user interface in full-screen mode. When the switching mode is triggered, the mobile terminal generates a first sub-interface and a first touch interface on the main user interface, thereby performing a reduction process on the first game interface and displaying it on the first sub-interface, and displays a first virtual key on the first touch interface, where the first virtual key is used to control the first game application. When the revertive mode is triggered, the mobile terminal displays the first game interface and the first virtual key on the main user interface in full-screen mode.

[0020] This application will be explained using the display of a game application interface as an example. When a game engine renders an image on a mobile device's display interface, it must be displayed using a surface view (SurfaceView). Because a surface view has an independent drawing surface, i.e., it does not share the same drawing surface as its host window, the user interface (UI) of the surface view can be drawn in an independent thread. Because a surface view does not occupy main thread resources, a complex and efficient UI can be realized, providing timely responses to user operations. In this application, a surface view can be realized in picture-in-picture mode or floating window mode. Picture-in-picture mode is a screen display method that simultaneously displays one screen on a mobile device and another screen in a small area within the screen. In floating window mode, a movable window is displayed floating on the surface of the application. It should be understood that the mobile terminal may need to obtain authorization from the system when using the floating window mode.

[0021] For ease of understanding based on the above description, please refer to FIG. 2, which is a flowchart of a method for controlling the display of an interface in an embodiment of the present application.

[0022] As shown in FIG. 2, in step S1, the mobile terminal initiates an authorization (permission) request (request) from the user, where the authorization request may include the authorization to display at the top of the window, the authorization to take pictures with the front camera head, the authorization to sense gravity, the authorization to monitor incoming calls, etc.

[0023] In step S2, the mobile terminal determines in real time whether a switching mode is currently triggered, and if the switching mode is triggered, executes step S3, where the switching mode includes, but is not limited to, the user clicking a virtual button in the game interface, the screen rotating, a phone call being received, the user's face direction being aligned with the smartphone screen direction, etc.

[0024] In step S3, the mobile terminal generates a sub-interface and a touch area on its corresponding main user interface, and the sub-interface and the touch area may be in a floating window mode or a picture-in-picture mode, but is not limited thereto herein.

[0025] In step S4, the mobile terminal renders the game interface on the sub-interface and switches the game to background execution.

[0026] In step S5, the user can drag or operate the sub-interface and control the game process through the touch area.

[0027] In step S6, the mobile terminal determines in real time whether the revertive mode is currently triggered, and if the revertive mode is triggered, the game interface returns to running in the foreground, the touch area disappears, and the game interface is displayed in full-screen mode.

[0028] In conjunction with the above description, the process of switching from the first game interface to the first sub-interface will be described below. Referring to Figure 3, Figure 3 is a diagram illustrating an embodiment of a method for controlling interface display in an embodiment of the present application. An embodiment of controlling interface display in an embodiment of the present application includes the following steps:

[0029] 101: When the mobile terminal runs a first game application, the mobile terminal displays a first game interface and a first virtual key on the main user interface in full screen mode, and the first virtual key is used to control the first game application.

[0030] In this embodiment, when the mobile terminal runs the first game application, it can display the first game interface and the first virtual key on the main user interface in full-screen mode, where the full-screen mode can be such that the mobile terminal displays the first game interface in the entire displayable area of ​​the screen, or such that the mobile terminal displays the first game interface in most of the displayable area of ​​the screen, for example, the mobile terminal displays a status column (e.g., information about the operator, time, remaining battery power, etc.) in a small displayable area at the top of the screen, and displays the first game interface in the other part of the screen.

[0031] For ease of understanding, please refer to Fig. 4, which is a diagram illustrating displaying a first game interface in full screen mode in an embodiment of the present application. As shown in Fig. 4, Fig. 4(A) illustrates displaying the first game interface in most of the displayable area of ​​the screen of the mobile terminal, and Fig. 4(B) illustrates displaying the first game interface in the entire displayable area of ​​the screen of the mobile terminal.

[0032] 102: When a switching mode is triggered, a first game interface is reduced and then displayed on a first sub-interface, and a first virtual key is displayed on a first touch interface, where the first sub-interface and the first touch interface are generated on the main user interface when the switching mode is triggered, and the first touch interface is used to display virtual keys for controlling a first game application.

[0033] In this embodiment, when the switching mode is triggered, the mobile terminal can generate a first sub-interface and a first touch interface on the main user interface, where the main user interface represents the first user interface that is visible (appears) after the mobile terminal is started, and usually includes commonly used application icons, time, battery level information, operator information, etc.

[0034] For ease of understanding, please refer to FIG. 5, which is a diagram illustrating the generation of a first sub-interface and a first touch interface in an embodiment of the present application. As shown in FIG. 5, B1 is used to indicate the main user interface, B2 is used to indicate the first sub-interface, and B3 is used to indicate the first touch interface. It should be understood that the example shown in FIG. 5 is only for understanding the technical solution. The first sub-interface and the first touch interface may also be circular, triangular, square, etc., and may also be located at other positions, such as directly above or directly below the main user interface. The shapes of the first sub-interface and the first touch interface and their display positions within the main user interface may be adjusted according to actual circumstances. For example, the first touch interface may be located at a display position independent of the first sub-interface in the main user interface, or at the same display position as the first sub-interface, but this is not limited thereto.

[0035] Based on this, the mobile terminal can perform a reduction process on the first game interface and then display it on the first sub-interface, and since the first virtual key is a virtual key for controlling the first game application, the mobile terminal can display the first virtual key on the first touch interface. Note that the first virtual key displayed on the first touch interface and the first virtual key displayed in full-screen mode are both used to control the first game application, and the first virtual key displayed on the first touch interface and the first virtual key displayed in full-screen mode may be the same or different in the number of keys and key outline (shape), but this is not limited herein.

[0036] Therefore, when the user performs operations on other tasks on the mobile terminal, the user can continue to progress in the first game application by controlling the first game application with the first virtual key displayed on the first touch interface.

[0037] For clarity, please refer to FIG. 6, which is a diagram illustrating switching to the main user interface in an embodiment of the present application. As shown in FIG. 6, (A) in FIG. 6 shows the first game interface before reduction, (B) in FIG. 6 shows the first game interface after reduction, and (C) in FIG. 6 shows the main user interface, where C1 is used to indicate the first sub-interface, C2 is used to indicate the first touch interface, and C3 is used to indicate the first virtual key on the first touch interface. The first game interface after reduction is displayed on the first sub-interface, and the first virtual key is displayed on the first touch interface. It should be understood that the example shown in FIG. 6 is only for understanding the technical solution, and the size of the first game interface after reduction should be determined based on the size of the first sub-interface, and the key shape and key type of the first virtual key can both be adjusted.

[0038] In an embodiment of the present application, a method for controlling the display of an interface is provided. By using the above method, a sub-interface for displaying a game interface on the main user interface and a touch interface for controlling the game are generated. This eliminates the need for the user to frequently switch interfaces, allowing the user to continue playing the game while operating other tasks on the mobile terminal. This simplifies the user's operation, reduces the number of human-machine interactions, and reduces the consumption of processing resources of the mobile terminal.

[0039] In conjunction with the above description, the process of switching the first sub-interface to the first game interface (revertive process) will be described below. Referring to Figure 7, Figure 7 is a diagram showing another embodiment of a method for controlling the display of an interface in an embodiment of the present application. One embodiment of controlling the display of an interface in an embodiment of the present application includes the following steps:

[0040] 201: When the mobile terminal runs a first game application, the mobile terminal displays a first game interface and a first virtual key on the main user interface in full screen mode, and the first virtual key is used to control the first game application.

[0041] 202: When the switching mode is triggered, the mobile terminal performs a shrinking process on the first game interface and then displays it on a first sub-interface, and also displays a first virtual key on a first touch interface, where the first sub-interface and the first touch interface are generated on the main user interface when the switching mode is triggered, and the first touch interface is used to display virtual keys for controlling the first game application.

[0042] In this embodiment, steps 201 and 202 are similar to steps 101 and 102, and therefore a detailed description thereof will be omitted here.

[0043] 203: When the revertive mode is triggered, display the first game interface and the first virtual key on the main user interface in full screen mode.

[0044] In this embodiment, when the revertive mode is triggered, the mobile terminal switches to a full-screen mode to display a first game interface and a first virtual key corresponding to a first game application, and does not display the first touch area separately.

[0045] For clarity, please refer to FIG. 8, which is a diagram illustrating switching to the first game interface in an embodiment of the present application. As shown in FIG. 8, (A) in FIG. 8 shows the main user interface, and (B) in FIG. 8 shows the first game interface in full-screen mode, where D1 is used to indicate the first sub-interface, D2 is used to indicate the first touch interface, and D3 is used to indicate the first virtual key. While operating other applications, the user can check the game interface of the first game application through the first sub-interface and control the first game application through the first virtual key displayed on the first touch interface. If the user wants to return to the game interface in full-screen mode, he or she can switch to (B) in FIG. 8 by, for example, holding the mobile terminal horizontally and clicking the second virtual button on the first sub-interface.

[0046] In the embodiments of the present application, another method for controlling the display of an interface is provided. By using the above method, a sub-interface for displaying a game interface on the main user interface and a touch interface for controlling the game are generated. This eliminates the need for the user to frequently switch interfaces, allowing the user to continue playing the game while operating other tasks on the mobile terminal, and simplifies the user's operation. In addition, the sub-interface can be switched to full-screen mode, and the game can continue to play during the switching process. This satisfies the user's needs, further simplifies the user's operation, reduces the number of human-machine interactions, and reduces the consumption of processing resources of the mobile terminal.

[0047] In one possible implementation manner, in another optional embodiment provided by the embodiments of the present application based on the embodiment corresponding to Figure 3 above, after the mobile terminal displays the first game interface and the first virtual key on the main user interface in full screen mode, the following steps are further included:

[0048] If a predetermined switching operation is triggered, the mobile terminal determines that a switching mode is triggered, where the predetermined switching operation includes at least one of a click operation, a press operation, a slide operation, a double-click operation, and a multi-touch operation.

[0049] In this embodiment, a method for determining that a switching mode has been triggered by a predetermined switching operation is described. After the mobile terminal displays a first game interface and a first virtual key on the main user interface in full-screen mode, if the user needs to operate another application (e.g., a video application, an instant communication application, a photo application, an ordering application, etc.), the user can perform a predetermined switching operation on the first game interface on the touch panel. Therefore, the mobile terminal determines that a switching mode has been triggered when it detects a predetermined switching operation performed on the first game interface by a touch object on the touch panel. Note that the touch object may be, but is not limited to, a user's finger, knuckle, or other touchable object.

[0050] If the switching mode is satisfied, a first sub-interface and a first touch interface can be generated on the main user interface, and the method for generating the first sub-interface and the first touch interface has already been described in step 102, so a detailed description thereof will be omitted here. It should be understood that the predetermined switching operation includes, but is not limited to, a click operation, a press operation, a slide operation, a double-click operation, a multi-touch operation, etc.

[0051] In the embodiments of the present application, a method is provided for determining that a switching mode is triggered by a predetermined switching operation. In the above manner, the user can adopt a predetermined switching operation to realize interface switching, which can improve the feasibility of the technical solution; in addition, the predetermined switching operation can be at least one of multiple operations, and the user can perform the operation according to their needs, which can improve the flexibility of the technical solution.

[0052] In one possible implementation manner, in another alternative embodiment provided by the embodiments of the present application based on the embodiment corresponding to Figure 3 above, when a predetermined switching operation is triggered, determining by the mobile terminal that a switching mode has been triggered may include the following steps:

[0053] When a click operation is triggered on a first virtual button in the first game interface, the mobile terminal determines that a switching mode is triggered; or When a pressing operation is triggered for the first game interface, the mobile terminal determines that a switching mode is triggered, in which the pressing time of the pressing operation is equal to or greater than a first time threshold; or When a sliding operation is triggered for the first game interface, the mobile terminal determines that a switching mode is triggered, in which a sliding trajectory of the sliding operation is generated according to a start position of the touch object and an end position of the touch object; or When a double-click operation is triggered for the first game interface, the mobile terminal determines that a switching mode is triggered, wherein the double-click time interval of the double-click operation is less than or equal to a second time threshold; or When a multi-touch operation is triggered for the first game interface, the mobile terminal determines that a switching mode is triggered, in which the multi-touch operation is generated based on the inward proximity of at least two touch points.

[0054] In this embodiment, several methods for triggering the predetermined switching operation are described, and different types of predetermined switching operations will be described below with specific examples.

[0055] The first method is a click operation. When a user clicks a first virtual button in the first game interface, a click operation is triggered. To facilitate understanding of the click operation, please refer to FIG. 9, which is a diagram illustrating the triggering of a click operation for the first game interface in an embodiment of the present application. As shown in FIG. 9, (A) in FIG. 9 shows the first game interface, and E1 is used to indicate the first virtual button. When a user clicks the first virtual button, the mobile terminal detects a click operation on the first virtual button on the touch panel and determines that the switching mode has been triggered, and then proceeds to (B) in FIG. 9 accordingly. (B) in FIG. 9 shows the main user interface, including a first sub-interface and a first touch interface. Note that the example shown in FIG. 9 is only for purposes of understanding the technical solution. In actual applications, the first virtual button may also be circular, oval, triangular, pentagram, etc., and the position of the first virtual button may be located at any position in the first game interface. Based on this, the specific shape and position of the first virtual button can be flexibly determined according to actual circumstances.

[0056] The second method is a pressing operation. When the user presses the first game interface for a pressing time equal to or greater than a first time threshold, the pressing operation is triggered. The first time threshold may be set according to actual needs, such as 2 seconds, 3 seconds, etc., but is not limited thereto. To easily understand the pressing operation, please refer to FIG. 10, which illustrates a pressing operation triggered for the first game interface in an embodiment of the present application. As shown in FIG. 10, (A) in FIG. 10 illustrates the first game interface. When the user performs a pressing operation on the touch panel and the pressing time is equal to or greater than the first time threshold, the mobile terminal can determine that the switching mode has been triggered and proceed to (B) in FIG. 10 accordingly. (B) in FIG. 10 illustrates a main user interface including a first sub-interface and a first touch interface.

[0057] The third method is a sliding operation. When a user performs a sliding operation on the first game interface and a sliding trajectory is generated based on the start position and end position of the touch object, the sliding operation is triggered. In practical applications, the sliding operation may also be triggered by the mobile terminal activating a camera head to capture the sliding operation performed by the touch object (e.g., a hand or a stylus) in the air, which does not need to contact the touch panel. To facilitate understanding of the sliding operation, the explanation will be given by taking an example in which the touch object is a finger. Referring to FIG. 11, FIG. 11 is a diagram illustrating the triggering of a sliding operation on the first game interface in an embodiment of the present application. As shown in FIG. 11, the first game interface is shown in (A), where F1 is used to indicate the start position of the finger on the touch panel, F2 is used to indicate the end position of the finger on the touch panel, and F3 is used to indicate the sliding trajectory of the sliding operation. When the user's finger slides from the start position to the end position on the touch panel and forms a sliding trajectory, the mobile terminal can determine that the switching mode is triggered, and based on this, proceed to Figure 11 (B). Shown in Figure 11 (B) is a main user interface including a first sub-interface and a first touch interface.

[0058] The fourth method is a double-click operation. When the time interval between two consecutive clicks by the user on the first game interface is equal to or less than a second time threshold, the double-click operation is triggered. The second time threshold can be set according to actual needs, such as 0.5 seconds, 1 second, etc., but is not limited thereto. To easily understand the double-click operation, please refer to FIG. 12, which illustrates triggering a double-click operation for the first game interface in an embodiment of the present application. As shown in FIG. 12, (A) in FIG. 12 illustrates the first game interface. When the user double-clicks on the touch panel and the double-click time interval is equal to or less than the second time threshold, the mobile terminal can detect the switching mode and proceed to (B) in FIG. 12 accordingly. (B) in FIG. 12 illustrates the main user interface, including the first sub-interface and the first touch interface.

[0059] The fifth method is multi-touch operation. When a user simultaneously moves at least two fingers inward on the first game interface, the multi-touch operation is triggered. To easily understand the multi-touch operation, please refer to FIG. 13, which is a diagram illustrating triggering a multi-touch operation for the first game interface in an embodiment of the present application. As shown in FIG. 13, the first game interface is shown in FIG. 13 (A), where G1 is used to indicate touch point A and G2 is used to indicate touch point B. When a user touches touch point A and touch point B on the touch panel and the two fingers move inward (as indicated by the two arrows in FIG. 13 (A)), the mobile terminal can determine that the switching mode has been triggered and proceed to FIG. 13 (B) based on this. The main user interface, including the first sub-interface and the first touch interface, is shown in FIG. 13 (B).

[0060] In the embodiments of the present application, multiple methods are provided for triggering a predetermined switching operation, and in the above manner, the predetermined switching operation includes multiple different operations, based on which users can perform different predetermined switching operations according to their needs, thereby further enhancing the flexibility of the technical solution.

[0061] In another optional embodiment provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 7, after the mobile terminal performs a reduction process on the first game interface and then displays it on the first sub-interface, and after the first virtual key is displayed on the first touch interface, the following steps are further included:

[0062] When a predetermined revertive operation is triggered on the first sub-interface, the mobile terminal determines that the revertive mode is triggered, where the predetermined revertive operation includes at least one of a click operation, a press operation, a slide operation, a double-click operation, and a multi-touch operation.

[0063] In this embodiment, a method for determining that a revertive mode has been triggered by a predetermined switching operation is described. After the mobile terminal performs a shrinking process on the first game interface and displays it on the first sub-interface, and after the first virtual key is displayed on the first touch-sensitive interface, if the user wants to return to full-screen mode to play the game, the user can perform a predetermined revertive operation on the first sub-interface on the touch panel. Therefore, the mobile terminal determines that the predetermined revertive operation has been triggered when it detects that a touch object has performed a predetermined revertive operation on the first sub-interface on the touch panel. Note that the touch object may be, but is not limited to, a user's finger, a knuckle, or other touchable object.

[0064] When the revertive mode is triggered, the first game interface can be displayed in full-screen mode. The manner of displaying the first game interface in full-screen mode has already been described in step 204, and therefore will not be described in detail here. It should be understood that the predetermined revertive operation may include, but is not limited to, a click operation, a press operation, a slide operation, a double-click operation, a multi-touch operation, etc.

[0065] In the embodiments of the present application, a method is provided for determining that a revertive mode is triggered by a predetermined switching operation. In the above manner, the user can adopt a predetermined revertive operation to realize interface switching, which can improve the feasibility of the technical solution; in addition, the predetermined revertive operation can be at least one of multiple operations, and the user can perform the operation according to their needs, which can improve the flexibility of the technical solution.

[0066] In another alternative embodiment provided by an embodiment of the present application based on the embodiment corresponding to Figure 7 above, when a predetermined revertive operation is triggered for the first sub-interface, determining by the mobile terminal that the revertive mode has been triggered may include:

[0067] When a click operation is triggered on a second virtual button on the first sub-interface, the mobile terminal determines that a revertive mode is triggered; or When a pressing operation is triggered on the first sub-interface, the mobile terminal determines that the revertive mode is triggered, wherein the pressing time of the pressing operation is equal to or greater than a first time threshold; or When a sliding operation is triggered on the first sub-interface, the mobile terminal determines that a revertive mode is triggered, in which a sliding trajectory of the sliding operation is generated based on a start position of the touch object and an end position of the touch object; or When a double-click operation is triggered for the first sub-interface, the mobile terminal determines that the revertive mode is triggered, wherein the double-click time interval of the double-click operation is less than or equal to a second time threshold; or If a multi-touch operation is triggered on the first sub-interface, the mobile terminal determines that a revertive mode is triggered, in which the multi-touch operation is generated after at least two touch points are extended outward.

[0068] In this embodiment, several methods for triggering the predetermined revertive operation are described. Different types of predetermined revertive operations will be described below with specific examples.

[0069] The first method is a click operation. When a user clicks the second virtual button in the first sub-interface on the touch panel, the mobile terminal can detect the click operation. The click operation is similar to the example described with reference to FIG. 9, so a detailed description thereof will be omitted here.

[0070] The second method is a pressing operation. When a user performs a pressing operation on the first sub-interface and the pressing time of the pressing operation is equal to or longer than a first time threshold, the mobile terminal can detect the pressing operation. The first time threshold can be set according to actual needs, for example, 2 seconds, 3 seconds, etc., but is not limited thereto. The pressing operation is similar to the example shown in Figure 10, so a detailed description thereof will be omitted here.

[0071] The third method is a sliding operation. When a user performs a sliding operation on the first sub-interface and a sliding trajectory of the sliding operation is generated based on the start position of the touch object and the end position of the touch object, the mobile terminal can detect the sliding operation. The specific pressing operation is similar to the example shown in FIG. 11, and therefore, a detailed description thereof will be omitted here.

[0072] The fourth method is double-clicking. When the user double-clicks on the first sub-interface and the double-click time interval is less than or equal to a second time threshold, the mobile terminal can detect the double-click. The second time threshold can be set according to actual needs, such as 1 second, 2 seconds, etc., and detailed description thereof is omitted here. The specific pressing operation is similar to the example shown in Figure 12, and detailed description thereof is omitted here.

[0073] The fifth method is multi-touch operation. When a user uses at least two fingers on the first sub-interface to simultaneously extend outward, the multi-touch operation is triggered. At this time, the mobile terminal can detect the multi-touch operation. To easily understand the multi-touch operation, please refer to FIG. 14, which is a diagram illustrating triggering a multi-touch operation for the first sub-interface in an embodiment of the present application. As shown in FIG. 14, (A) in FIG. 14 shows the main user interface, where H1 is used to indicate the first sub-interface, H2 is used to indicate touch point A, and H3 is used to indicate touch point B. When a user touches touch point A and touch point B on the touch panel and the two fingers move apart outward (as indicated by the two arrows in (A) in FIG. 14), the mobile terminal can determine that the revertive mode has been triggered and proceed to (B) in FIG. 14. (B) in FIG. 14 shows displaying the first game interface in full-screen mode.

[0074] In the embodiments of the present application, multiple methods are provided for triggering a predetermined revertive operation, and in the above manner, the predetermined revertive operation includes multiple different operations, based on which users can perform different predetermined revertive operations according to their needs, thereby further enhancing the flexibility of the technical solution.

[0075] In another optional embodiment provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 3, after the mobile terminal displays the first game interface and the first virtual key on the main user interface in full-screen mode, the following steps are further included:

[0076] The mobile terminal acquires a device usage state through a gravity sensor, in which the device usage state is used to represent the posture of the mobile terminal when the mobile terminal is held; and If the device usage state indicates that the mobile terminal is in a portrait screen usage state, the mobile terminal determines that a switching mode has been triggered.

[0077] In this embodiment, a method for determining whether a switching mode has been triggered based on a device usage state is described. After the mobile terminal displays a first game interface and a first virtual key on the main user interface in full-screen mode, the device usage state can be obtained by a gravity sensor. The device usage state is used to represent the orientation of the mobile terminal when it is held. The device usage state mainly includes a portrait screen usage state and a landscape screen usage state. When the first game interface is displayed in full-screen mode, the mobile terminal is usually in the landscape screen usage state. Therefore, it can be determined that the switching mode has been triggered when the mobile terminal is in the portrait screen usage state.

[0078] For example, a gravity sensor can measure the magnitude of two orthogonal components of gravity on a mobile device to determine the mobile device's location, i.e., obtain the device usage status. In practical applications, the device usage status can be obtained using a gyroscope built into the mobile device. The rotation axis of a high-speed rotor tends to become vertical under the action of an external force that changes its direction. When the rotor tilts sideways, gravity may act in a direction that increases the tilt, causing the axis to move vertically, resulting in a nodding motion (i.e., precession). Therefore, when the gyro axis of a gyroscope rotates on the horizontal axis, it receives a vertical rotational force due to the Earth's rotation, causing the gyroscope rotor to precess in the meridian direction in the horizontal plane, thereby obtaining the device usage status.

[0079] For ease of understanding, please refer to FIG. 15, which is a diagram illustrating an example of switching device usage states in an embodiment of the present application. As shown in FIG. 15, (A) in FIG. 15 illustrates a first game interface displayed in full-screen mode in a landscape screen usage state. When a user rotates the mobile terminal from landscape screen to portrait screen, the state becomes as shown in (B) in FIG. 15, where (B) in FIG. 15 illustrates a first game interface displayed in full-screen mode in a portrait screen usage state. At this time, the mobile terminal determines that the switching mode has been triggered and proceeds to (C) in FIG. 15 based on this. (C) in FIG. 15 illustrates a main user interface including a first sub-interface and a first touch interface.

[0080] In the embodiments of the present application, a method is provided for determining that a switching mode is triggered based on the device usage status. In the above manner, when a user adjusts the device usage status, the user may need to perform operations on other applications or may have other requirements. Therefore, determining that a switching mode is triggered based on the device usage status can further clarify the specific switching mode and improve the feasibility of the technical solution.

[0081] In another optional embodiment provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 7, after the mobile terminal performs a reduction process on the first game interface and then displays it on the first sub-interface, and after the first virtual key is displayed on the first touch interface, the following steps are further included:

[0082] The mobile terminal acquires a device usage state through a gravity sensor, and the device usage state is used to represent the posture of the mobile terminal when it is held; and If the device usage state indicates that the mobile terminal is in a landscape screen usage state, the mobile terminal determines that the revertive mode has been triggered.

[0083] In this embodiment, a method for determining whether the revertive mode has been triggered based on a device usage state is described. After the mobile terminal performs a reduction process on the first game interface and displays it on the first sub-interface, and after displaying the first virtual key on the first touch interface, the device usage state can be obtained by a gravity sensor. The device usage state is used to represent the orientation of the mobile terminal when it is held, and the device usage state mainly includes a portrait screen usage state and a landscape screen usage state. Since the first sub-interface and the first virtual key are usually displayed in the portrait screen usage state, it can be determined that the revertive mode has been triggered when the mobile terminal is in the landscape screen usage state.

[0084] For ease of understanding, please refer to FIG. 16, which is a diagram illustrating another example of switching device usage states in an embodiment of the present application. As shown in FIG. 16, (A) in FIG. 16 illustrates a main user interface including a first sub-interface and a first touch interface. When a user rotates the mobile terminal from a portrait screen to a landscape screen, the state becomes as shown in (B) in FIG. 16, which illustrates a main user interface including the first sub-interface and the first touch interface in the landscape screen usage state. At this time, the mobile terminal determines that the revertive mode has been triggered and proceeds to (C) in FIG. 16. (C) in FIG. 16 illustrates a first game interface displayed in full-screen mode in the landscape screen usage state.

[0085] In the embodiments of the present application, a method is provided for determining whether the revertive mode is triggered based on the device usage state. According to the above method, when a user adjusts the device usage state, if the device is in landscape mode, the user will want to display the first game interface in full-screen mode. Therefore, by determining whether the revertive mode is triggered based on the device usage state, the specific revertive mode can be more clearly defined and the feasibility of the technical solution can be improved.

[0086] In another optional embodiment provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 3, after the mobile terminal displays the first game interface and the first virtual key on the main user interface in full-screen mode, the following steps are further included:

[0087] The mobile terminal acquires a face image through a front camera head; The mobile terminal determines a left eye coordinate corresponding to the left eye and a right eye coordinate corresponding to the right eye based on the face image; The mobile terminal determines a binocular coordinate connection line (i.e., a straight line passing through the binocular coordinates) based on the left eye coordinates and the right eye coordinates; and If the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal is less than or equal to an angle threshold, the mobile terminal determines that the switching mode is triggered, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in a portrait screen usage state.

[0088] This embodiment describes a method for triggering a switching mode based on facial recognition. After the mobile terminal displays a first game interface and a first virtual key on the main user interface in full-screen mode, it uses a front camera head to capture a facial image in real time, determines the coordinates of the left eye and the right eye from the facial image, and generates a binocular coordinate connecting line based on the left eye coordinate and the right eye coordinate. It is determined that the switching mode has been triggered if the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal is less than or equal to an angle threshold. The horizontal direction of the mobile terminal refers to the horizontal direction when the mobile terminal is in portrait mode. The angle threshold can be determined according to actual needs, for example, 30°. However, in actual applications, the angle threshold can be set to other angles such as 45°, 20°, etc., but this is not limited thereto.

[0089] For ease of understanding, please refer to Figure 17, which is a diagram illustrating the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal in an embodiment of the present application. As shown in Figure 17, (A) in Figure 17 shows a mobile terminal in portrait screen use mode, and (B) in Figure 17 shows a mobile terminal in landscape screen use mode, where I1 is used to indicate the horizontal direction of the mobile terminal, I2 is used to indicate the left eye, and I3 is used to indicate the right eye. As can be seen from (A) in Figure 17, the connecting line between the left eye and the right eye is parallel to the horizontal direction of the mobile terminal, that is, the included angle between the binocular coordinate connecting line between the left eye coordinate corresponding to the left eye and the right eye coordinate corresponding to the right eye and the horizontal direction of the mobile terminal is 0°. As can be seen from (B) in Figure 17, the left eye and right eye are perpendicular to the horizontal direction of the mobile terminal, that is, the angle between the binocular coordinate connection line between the left eye coordinate corresponding to the left eye and the right eye coordinate corresponding to the right eye and the horizontal direction of the mobile terminal is 90°.

[0090] Taking the angle threshold of 30° as an example, reference is made to FIG. 18, which illustrates an embodiment of the present application that realizes interface switching based on face recognition. As shown in FIG. 18, (A) in FIG. 18 illustrates a mobile terminal, where J1 is used to indicate the horizontal direction of the mobile terminal, J2 is used to indicate the left eye, J3 is used to indicate the right eye, and J4 is used to indicate the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal. As can be seen from (A) in FIG. 18, there is an included angle between the binocular coordinate connecting line between the left eye coordinate and the right eye coordinate and the horizontal direction of the mobile terminal. When the included angle is 20°, the included angle is smaller than the angle threshold of 30°, so the switching mode is satisfied, and the (B) in FIG. 18 can be obtained. (B) in FIG. 18 illustrates a main user interface including a first sub-interface and a first touch interface.

[0091] In the embodiments of the present application, a method for triggering a switching mode based on face recognition is provided. In the above-mentioned manner, the left eye coordinates and right eye coordinates are determined based on a face image, and a binocular coordinate connecting line is further determined. Whether the switching mode is triggered is determined based on the included angle relationship between the binocular coordinate connecting line and the horizontal direction of the mobile terminal. This makes the specific switching mode clearer, and does not require the user to perform any voluntary operation. Whether the switching mode is triggered can be determined by simply obtaining a face image, thereby simplifying the user's operation.

[0092] In another optional embodiment provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 7, after the mobile terminal performs a reduction process on the first game interface and then displays it on the first sub-interface, and after the first virtual key is displayed on the first touch interface, the following steps are further included:

[0093] The mobile terminal acquires a face image through a front camera head; The mobile terminal determines a left eye coordinate corresponding to the left eye and a right eye coordinate corresponding to the right eye based on the face image; The mobile terminal determines a binocular coordinate connecting line based on the left eye coordinate and the right eye coordinate; and If the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal is greater than an angle threshold, the mobile terminal determines that the revertive mode is triggered, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in a portrait screen usage state.

[0094] In this embodiment, a method for determining whether revertive mode has been triggered is described based on facial recognition. After the mobile terminal performs a scaling process on the first game interface and displays it on the first sub-interface, and after displaying the first virtual key on the first touch interface, it uses the front camera head to capture a facial image in real time, determines the coordinates of the left eye and the right eye from the facial image, and generates a binocular coordinate connecting line based on the left eye coordinate and the right eye coordinate. If the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal is greater than an angle threshold, it is determined that revertive mode has been triggered. The horizontal direction of the mobile terminal refers to the horizontal direction when the mobile terminal is in portrait mode. The angle threshold can be set according to actual needs, for example, 30°. However, in practical applications, the angle threshold can also be set to other angles, such as 45°, 20°, etc., but this is not a limitation.

[0095] For ease of understanding, an example where the angle threshold is 30° will be used. Referring to FIG. 19, FIG. 19 illustrates the implementation of revertive operation of an interface based on face recognition in an embodiment of the present application. As shown in FIG. 19, (A) in FIG. 19 illustrates a mobile terminal, where K1 is used to indicate the horizontal direction of the mobile terminal, K2 is used to indicate the left eye, K3 is used to indicate the right eye, and K4 is used to indicate the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal. As can be seen from (A) in FIG. 19, there is an included angle between the binocular coordinate connecting line between the left eye coordinate and the right eye coordinate and the horizontal direction of the mobile terminal. When the included angle is 45°, the included angle is greater than the angle threshold of 30°, triggering the revertive mode, and the image shown in FIG. 19 (B) can be obtained. The image shown in (B) in FIG. 19 illustrates a first game interface displayed in full-screen mode.

[0096] In an embodiment of the present application, a method for determining whether revertive mode is triggered based on face recognition is provided. In the above-mentioned manner, the left eye coordinates and right eye coordinates are determined based on the face image, and the binocular coordinate connecting line is further determined. Whether revertive mode is triggered is determined based on the included angle relationship between the binocular coordinate connecting line and the horizontal direction of the mobile terminal. This does not require the user to perform any voluntary operation, and only requires the face image to determine whether revertive mode is triggered, thereby simplifying the user's operation.

[0097] In another optional embodiment provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 3, after the mobile terminal displays the first game interface and the first virtual key on the main user interface in full-screen mode, the following steps are further included:

[0098] The mobile terminal monitors call reminders; and When an answer command for a call reminder is triggered, the mobile terminal determines that a switching mode is triggered.

[0099] In this embodiment, a method for determining whether a switching mode is triggered based on an incoming call is described. The mobile terminal can monitor a call reminder in real time. When a call reminder exists, if the user selects to answer the incoming call, the mobile terminal can detect an answer command for the call reminder, and can determine that a switching mode is triggered. The answer operation by the user to select to answer the incoming call can be an answer button click operation.

[0100] For ease of understanding, please refer to Figure 20, which is a diagram illustrating the implementation of interface switching based on a call reminder in an embodiment of the present application. As shown in Figure 20, Figure (A) in Figure 20 shows a first game interface displayed in full-screen mode. When the mobile terminal displays a call reminder, if the user wants to choose to answer, they can click the answer button. Thus, when the mobile terminal detects an answer command for the call reminder, it can determine that the switching mode has been triggered, and based on this, proceed to Figure (B) in Figure 20. Figure (B) in Figure 20 shows a main user interface, including a first sub-interface and a first touch interface.

[0101] In the embodiments of the present application, a method is provided for determining that a switching mode is triggered based on an incoming call. In the above manner, when a user chooses to answer an incoming call, the interface can be automatically switched, which simplifies the user's operation and improves the feasibility of the technical solution.

[0102] In another optional embodiment provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 3, after the mobile terminal displays the first game interface and the first virtual key on the main user interface in full-screen mode, the following steps are further included:

[0103] The mobile terminal acquires the detected speech by a microphone; and If the to-be-detected speech is successfully matched with the first predetermined speech, the mobile terminal determines that a switching mode has been triggered.

[0104] In this embodiment, a method for determining whether a switching mode has been triggered based on speech sounds is described. After the mobile terminal displays a first game interface and a first virtual key on the main user interface in full-screen mode, the mobile terminal acquires speech sounds to be detected in real time through the microphone. When the speech sounds to be detected are successfully matched with a first predetermined speech sound, the mobile terminal can determine that the switching mode has been triggered. For example, assuming that the first predetermined speech sound is "switch interface," when the user says "switch interface" into the microphone (i.e., when "switch interface" is the speech sound to be detected), the mobile terminal matches the speech sounds to be detected with the first predetermined speech sound. If the match is successful, the mobile terminal determines that the switching mode has been triggered. It should be understood that this example is merely for the purpose of understanding the technical solution, and the first predetermined speech sound may be further set according to actual circumstances.

[0105] In the embodiments of the present application, a method is provided for determining whether a switching mode is triggered based on speech sounds. In the above manner, the user can switch interfaces based on speech sounds, which simplifies the user's operation and increases the flexibility of the application of the technical solution.

[0106] In another optional embodiment provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 7, after the mobile terminal performs a reduction process on the first game interface and then displays it on the first sub-interface, and after the first virtual key is displayed on the first touch interface, the following steps are further included:

[0107] The mobile terminal acquires the speech to be detected by the microphone; and If the to-be-detected speech is successfully matched with the second predetermined speech, the mobile terminal determines that the revertive mode has been triggered.

[0108] In this embodiment, a method for determining whether a revertive mode has been triggered based on speech sounds is described. After the mobile terminal performs a reduction process on the first game interface and displays it on the first sub-interface, and after displaying the first virtual key on the first touch interface, the mobile terminal can obtain a to-be-detected speech sound in real time through the microphone. When the to-be-detected speech sound matches a second predetermined speech sound, the mobile terminal determines that a revertive mode has been triggered. For example, assume that the second predetermined speech sound is "return to interface." When the user says "return to interface" into the microphone (i.e., when "return to interface" is the to-be-detected speech sound), the mobile terminal matches the to-be-detected speech sound with the second predetermined speech sound. If the matching is successful, the mobile terminal determines that a revertive mode has been triggered. It should be understood that this example is merely for the purpose of understanding the technical solution, and the second predetermined speech sound may be further set according to actual circumstances.

[0109] In the embodiments of the present application, a method is provided for determining whether the revertive mode is triggered based on speech sounds. In this manner, the user can perform revertive operation of the interface based on speech sounds, which simplifies the user's operation and improves the application flexibility of the technical solution.

[0110] In another alternative embodiment provided by the embodiments of the present application based on the embodiments corresponding to the above-mentioned FIGS. 3 and 7, the first sub-interface and the first touch interface both belong to the embedded interface.

[0111] The mobile terminal may perform a reduction process on the first game interface and then display it on the first sub-interface, and also display the first virtual key on the first touch interface, including the following steps:

[0112] The mobile terminal generates a first sub-interface in a first predetermined area of ​​the main user interface, where the first predetermined area is a fixed area in the main user interface; The mobile terminal generates a first touch interface in a second predetermined area of ​​the main user interface, where the first touch interface is another fixed area of ​​the main user interface; and The mobile terminal performs a reduction process on the first game interface in the picture-in-picture mode and then displays it on the first sub-interface, and also displays a first virtual key on the first touch interface in the picture-in-picture mode.

[0113] In this embodiment, a method for displaying an interface based on an embedded interface is described. At least one of the first sub-interface and the first touch interface may be an embedded interface. Because the embedded interface is a fixed interface, the mobile terminal can generate the first sub-interface in a first predetermined area of ​​the main user interface, where the first predetermined area is a fixed area on the main user interface. The mobile terminal can also generate a first touch interface in a second predetermined area of ​​the main user interface, where the second predetermined area is another fixed area on the main user interface. Based on this, the mobile terminal can perform a shrinking process on the first game interface in picture-in-picture mode and then display it on the first sub-interface, and can also display a first virtual key on the first touch interface in picture-in-picture mode.

[0114] For ease of understanding, the mobile terminal will be described as a smartphone. Refer to FIG. 21, which illustrates how an embodiment of the present application determines how to display an interface based on an embedded interface. As shown in FIG. 21, L1 indicates the main user interface, L2 indicates the first predetermined area, L3 indicates the second predetermined area, L4 indicates the first sub-interface, L5 indicates the first game interface after the reduction process, L6 indicates the first touch interface, and L7 indicates the first virtual key. The first predetermined area and the second predetermined area in FIG. 21(A) are both fixed areas on the main user interface. Therefore, in FIG. 21(B), the first sub-interface is generated in the first predetermined area, and the first touch interface is generated in the second predetermined area L3. Then, similar to the above-described embodiment, the first game interface is reduced, and the reduced first game interface is displayed over the first sub-interface, and the first virtual key can be displayed on the first touch interface.

[0115] In the embodiments of the present application, a method for realizing interface display based on an embedded interface is provided. By using the above method, a sub-interface for displaying a game interface in a fixed predetermined area on the main user interface and a touch interface for controlling the game are generated. This allows the user to continue playing the game while performing other operations on the mobile terminal without having to frequently switch interfaces, thereby simplifying the user's operations.

[0116] In another alternative embodiment provided by the embodiments of the present application based on the embodiments corresponding to the above-mentioned Figures 3 and 7, both the first sub-interface and the first touch interface belong to a floating window type interface.

[0117] The mobile terminal's shrinking process for the first game interface and then displaying it on the first sub-interface and displaying the first virtual key on the first touch interface may include the following steps:

[0118] The mobile terminal creates a first sub-interface in a layer above the main user interface; The mobile terminal generates a first touch interface in a layer above the main user interface; and The mobile terminal performs a shrinking process on the first game interface in a floating window mode and then displays it on a first sub-interface, and also displays a first virtual key on the first touch interface in a floating window mode.

[0119] In this embodiment, a method for controlling interface display based on a floating window interface is described. At least one of the first sub-interface and the first touch interface may be a floating window interface. Because the floating window interface is not a fixed interface, the mobile terminal generates the first sub-interface on a layer above the main user interface, generates a first touch interface on a layer above the main user interface, and displays the first game interface on the first sub-interface after performing a shrinking process on the first game interface in floating window mode. Also, the first virtual key can be displayed on the first touch interface in floating window mode. The floating window interface may be an opaque interface or a translucent interface, but this is not limited thereto.

[0120] For ease of understanding, the mobile terminal will be described as a smartphone. Refer to FIG. 22, which illustrates the determination of an interface display based on a floating interface in an embodiment of the present application. As shown in FIG. 22, M1 is used to indicate the main user interface, M2 is used to indicate the first sub-interface, M3 is used to indicate the first touch interface, M4 is used to indicate the first game interface after reduction processing, and M5 is used to indicate the first virtual key. The first sub-interface and the first touch interface are both located on a layer above the main user interface. After reduction processing is performed on the first game interface, it is displayed on the first sub-interface, and the first virtual key is displayed on the first touch interface. Based on this, the interface shown in FIG. 22 (B) can be obtained.

[0121] In an embodiment of the present application, a method for controlling the display of an interface based on a floating window interface is provided. By using the above method, a sub-interface for displaying a game interface on a layer above the main user interface and a touch interface for controlling the game are generated. This eliminates the need for the user to frequently switch interfaces, allowing the user to continue playing the game while operating other tasks on the mobile terminal, thereby further simplifying the user's operations.

[0122] In another alternative embodiment provided by the embodiment of the present application based on the embodiments corresponding to the above-mentioned FIGS. 3 and 7, the following steps are further included:

[0123] When a drag operation is triggered on the first sub-interface, the mobile terminal controls the first sub-interface to move along a drag trajectory corresponding to the drag operation; When a drag operation is triggered on the first touch interface, the mobile terminal controls the first touch interface to move along a drag trajectory corresponding to the drag operation; When a scaling operation is triggered for the first sub-interface, the mobile terminal controls the first sub-interface to be expanded or contracted according to the scaling operation; and When a scaling operation is triggered on the first touch interface, the mobile terminal controls the first touch interface to be enlarged or reduced according to the scaling operation.

[0124] In this embodiment, a method for adjusting the position and size of a floating window is described. For a floating window interface, the user can further perform drag and zoom operations. Referring to FIG. 23, FIG. 23 is a diagram illustrating a drag operation on the first sub-interface in an embodiment of the present application. As shown in FIG. 23, N1 is used to indicate the first sub-interface, N2 is used to indicate the starting position, and N3 is used to indicate the ending position. (A) in FIG. 23 shows the user dragging from the starting position to the ending position, with the drag trajectory extending from the starting position to the ending position. Therefore, the mobile terminal can control the first sub-interface to move from the starting position to the ending position, resulting in the (B) diagram shown in FIG. 23. Note that the description of the drag operation on the first touch interface is omitted here.

[0125] The user can also perform a scaling operation on the first sub-interface, for example, enlarging or reducing the first sub-interface. The scaling operation includes a shrinking operation and an enlarging operation, where a shrinking operation is performed by at least two touch points moving inward, and an enlarging operation is performed by at least two touch points moving outward. Referring to FIG. 24, FIG. 24 illustrates a drag operation on the first sub-interface in an embodiment of the present application. As shown in FIG. 24, O1 is used to indicate the first sub-interface, O2 is used to indicate the first sub-interface after shrinking, and O3 is used to indicate the first sub-interface after expanding. (A) in FIG. 24 shows a finger moving inward on the touch panel of the mobile terminal, which triggers a shrinking operation on the first sub-interface, thereby obtaining (B) as shown in FIG. 24, where the first sub-interface has already been reduced. The (C) diagram in Figure 24 shows that the fingers of the hand are stretched outward on the touch panel of the mobile terminal, that is, triggering the zoom operation on the first sub-interface, thereby obtaining the (D) diagram shown in Figure 24, where the first sub-interface has already been zoomed in. Note that here, the explanation of performing the zoom operation on the first touch interface is omitted.

[0126] In the embodiments of the present application, a method for adjusting the position and size of a floating window is provided. Through the above-mentioned method, the position and size of the first sub-interface and the first touch interface can be adjusted according to the user's needs for the floating window type interface, thereby improving the flexibility of the technical solution.

[0127] In another optional embodiment provided by the embodiments of the present application based on the embodiments corresponding to Figures 3 and 7 above, before the mobile terminal generates the first sub-interface and the first touch interface on the main user interface, the following steps are further included:

[0128] The mobile terminal acquires a game type of the first game application; and The mobile terminal determines a first touch interface from at least one generatable touch interface according to a game type of the first game application, where each generatable touch interface displays a corresponding virtual key.

[0129] In this embodiment, a method for adjusting a touch interface based on a game type is described. Since different game types correspond to different creatable touch interfaces, a first game interface is reduced and then displayed on a first sub-interface. Before displaying a first virtual key on the first touch interface, the mobile terminal obtains the game type of a first game application, and determines a first touch interface from at least one creatable touch interface based on the game type of the first game application, so as to display a virtual key corresponding to the game type.

[0130] The game type may be a competitive sports game, a casual game, a role-playing game (RPG), etc. For example, a touch interface corresponding to a competitive sports game may include virtual keys such as "jump" and "squat." For example, a touch interface corresponding to a casual game may include virtual keys such as "left," "right," and "shoot." For example, a touch interface corresponding to an RPG may include virtual directional keys. In practical applications, a user may further define parameters of the first touch interface, including, but not limited to, interface transparency, interface background color, interface design, interface text, virtual key shape and size, etc.

[0131] For clarity, please refer to FIG. 25, which illustrates an example of a first touch interface in an embodiment of the present application. In FIG. 25, (A) shows a main user interface corresponding to a role-playing game (RPG). In FIG. 25, (B) shows a main user interface corresponding to a competitive sports game. In FIG. 25, (C) shows a main user interface corresponding to a casual game. As shown in FIG. 25, P1 is used to indicate the first touch interface, P11 in FIG. 25A is used to indicate the virtual direction keys, P12 is used to indicate the "Confirm" virtual function key, and P13 is used to indicate the "Cancel" virtual function key. In FIG. 25B, P21 is used to indicate the "Jump" virtual function key, and P22 is used to indicate the "Squat" virtual function key. In FIG. 25C, P31 is used to indicate the "Move Left" virtual key, P32 is used to indicate the "Move Right" virtual key, and P33 is used to indicate the "Shoot" virtual function key.

[0132] For example, the parameters of the first touch interface include the transparency and color of the interface. Referring to FIG. 26, FIG. 26 is a diagram illustrating an example of selecting parameters of the first touch interface in an embodiment of the present application. As shown in FIG. 26, Q1 is used to indicate the first touch interface, Q2 is used to indicate the interface color selection area, and Q3 is used to indicate the transparency selection area. Users can select the interface color and adjust the transparency according to their needs.

[0133] In the embodiments of the present application, a method for adjusting a touch interface based on a game type is provided. In the above-mentioned manner, different touch interfaces can be set for different game types, thereby realizing control for different types of games. In addition, the parameters of the first touch interface can be adjusted according to user needs, thereby improving the flexibility of the technical solution.

[0134] In another alternative embodiment provided by the embodiment of the present application based on the embodiments corresponding to the above-mentioned FIGS. 3 and 7, the following steps are further included:

[0135] When the mobile terminal runs the second game application, displaying a second game interface corresponding to the second game application in a full-screen mode; and When the switching mode is triggered, the mobile terminal performs a shrinking process on the second game interface and then displays it on the second sub-interface, and also displays a second virtual key on the second touch interface, of which the second virtual key is used to control the second game application, and both the second sub-interface and the second touch interface are displayed on the main user interface.

[0136] In this embodiment, a method for simultaneously displaying multiple game interfaces is described. The mobile terminal can further run a second game application and display a second game interface corresponding to the second game application in full-screen mode. When a switching mode is satisfied, a second sub-interface and a second touch-sensitive interface can be generated on the main user interface, and the second game interface can be reduced and then displayed on the second sub-interface. A second virtual key can also be displayed on the second touch-sensitive interface, and the second virtual key can be used to control the second game application. The manner of triggering the switching mode is similar to that of the previous embodiment, and therefore a detailed description thereof will be omitted here.

[0137] For ease of understanding, please refer to Figure 27, which is a diagram illustrating another embodiment of a method for controlling interface display in an embodiment of the present application. As shown in Figure 27, R1 is used to indicate the first sub-interface, R2 is used to indicate the first touch interface, R3 is used to indicate the second sub-interface, and R4 is used to indicate the second touch interface. In the main user interface, the first sub-interface displays a reduced first game interface, the second sub-interface displays a reduced second game interface, the first touch interface displays a first virtual key corresponding to the first game application, and the second touch interface displays a second virtual key corresponding to the second game application. It should be understood that the example shown in Figure 27 is only for purposes of understanding the technical solution, and the display positions and sizes of the second sub-interface and the second touch interface can be flexibly configured according to user needs.

[0138] In the embodiments of the present application, a method for simultaneously displaying multiple game interfaces is provided. Through the above-mentioned method, a mobile terminal can display multiple game applications on the main user interface, allowing the progress of two games to continue while operating other tasks on the mobile terminal, thereby improving the convenience of operation.

[0139] In another alternative embodiment provided by the embodiment of the present application based on the embodiments corresponding to the above-mentioned FIGS. 3 and 7, the following steps are further included.

[0140] When the mobile terminal executes a video application, displaying a video application interface corresponding to the video application on the main user interface; and When the switching mode is triggered, the mobile terminal performs a shrinking process on the video application interface and then displays it on a third sub-interface, where the third sub-interface is displayed on the main user interface.

[0141] In this embodiment, a method for simultaneously displaying a game interface and a video interface is described. Since the mobile terminal can also run a video application, a video application interface corresponding to the video application can be displayed on the main user interface. When a switching mode is triggered, a third sub-interface is generated on the main user interface, and the video application interface is reduced and then displayed on the third sub-interface. Note that the manner of triggering the switching mode and the manner of generating the third sub-interface are similar to those in the previous embodiment, and therefore, detailed descriptions thereof will be omitted here.

[0142] For ease of understanding, please refer to Figure 28, which is a diagram illustrating another embodiment of a method for controlling interface display in an embodiment of the present application. As shown in Figure 28, T1 is used to indicate the first sub-interface, T2 is used to indicate the first touch interface, and T3 is used to indicate the third sub-interface. In the main user interface, the first sub-interface displays the first game interface after reduction processing, the first touch interface displays the first virtual key, and the third sub-interface displays the video application interface after reduction processing. It should be understood that the example shown in Figure 28 is only for understanding the technical solution, and the position and size of the third sub-interface can be flexibly set according to user needs.

[0143] In the embodiments of the present application, a method for simultaneously displaying a game interface and a video interface is provided. Through the above-mentioned method, a mobile terminal can not only display a game application on the main user interface, but also display a video application on the main user interface, and can also realize user operations for other tasks on the mobile terminal, thereby meeting the various needs of users and further simplifying user operations.

[0144] In another optional embodiment provided by the embodiments of the present application based on the embodiments corresponding to the above-mentioned Figures 3 and 7, after the mobile terminal performs a reduction process on the first game interface and then displays it on the first sub-interface, and after the first virtual key is displayed on the first touch interface, the following steps are further included:

[0145] When the mobile terminal executes the target application, it displays an application interface corresponding to the target application in full screen mode on the main user interface, and also displays a first sub-interface and a first touch interface on the main user interface, where the target application includes at least one of an instant communication application, an entertainment application, and a tool application.

[0146] In this embodiment, a method for simultaneously displaying a game interface and an information interface is provided, in which the mobile terminal performs a shrinking process on a first game interface and then displays it on a first sub-interface, and after displaying a first virtual key on a first touch interface, when a target application is executed, the mobile terminal can further display an application interface of the target application in full screen mode on the main user interface, and the first sub-interface and the first touch interface can continue to be displayed on the main user interface, and the target application can include, but is not limited to, an instant communication application, an entertainment application, and a tool application.

[0147] Among these, communication applications include, but are not limited to, instant communication applications such as chat, social networking sites, email, and communities. Entertainment applications include, but are not limited to, applications such as music, ringtones, players, live broadcasts, entertainment, and horoscopes. Tool applications include, but are not limited to, applications such as life services, food services, weather forecasts, calendars, utility tools, flashlights, memos, office tools, network storage, and office software. When a user operates a target application on the main user interface, the application interface can be displayed in full-screen mode. For example, replying to messages, checking emails, ordering takeout, listening to music, browsing Weibo, surfing the Internet, taking photos, and configuring the system can all be displayed in full-screen mode, and the user can perform these operations while continuing to play the game.

[0148] For ease of understanding, the target application will be described as a tool application. Referring to FIG. 29, FIG. 29 illustrates another embodiment of a method for controlling interface display in an embodiment of the present application. As shown in FIG. 29, U1 is used to indicate the first sub-interface, U2 is used to indicate the first touch interface, and U3 is used to indicate the tool application interface. Therefore, in the main user interface, the first game interface after reduction processing is displayed on the first sub-interface, the first virtual key is displayed on the first touch interface, and the tool application interface corresponding to the tool application is displayed in full-screen mode.

[0149] In the embodiments of the present application, a method for simultaneously displaying a game interface and an information interface is provided. In the above manner, a mobile terminal can display multiple applications on the main user interface, allowing the user to continue playing the game while operating other applications, thereby enabling the user to operate multiple application tasks on the mobile terminal and meeting the diverse needs of users.

[0150] The device for controlling the display of an interface in the present application will be described in detail below. Referring to Figure 30, Figure 30 is a diagram showing one embodiment of the device for controlling the display of an interface in the embodiment of the present application, where the device 30 for controlling the display of an interface includes:

[0151] Display module 301: Used to display a first game interface and a first virtual key on the main user interface in full screen mode when a first game application is executed, and the first virtual key is used to control the first game application.

[0152] The display module 301 is further used to, when the switching mode is triggered, perform a shrinking process on the first game interface and then display it on a first sub-interface, and to display a first virtual key on a first touch interface, of which the first sub-interface and the first touch interface are generated on the main user interface when the switching mode is triggered, and the first touch interface is used to display virtual keys for controlling the first game application.

[0153] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned Figure 30, the display module 301 is further used to perform a reduction process on the first game interface and then display it on the first sub-interface, and after displaying the first virtual key on the first touch interface, if the revertive mode is triggered, to display the first game interface and the first virtual key on the main user interface in full-screen mode.

[0154] In one possible implementation manner, in another embodiment of the device 30 for controlling interface display provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned Fig. 30, the device 30 for controlling interface display further includes a determination module 302. The determination module 302 determines that a switching mode has been triggered when a predetermined switching operation is triggered, where the predetermined switching operation includes at least one of a click operation, a press operation, a slide operation, a double-click operation, and a multi-touch operation.

[0155] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 30, the determination module 302 is specifically used as follows: determining that a switching mode is triggered when a click operation is triggered on a first virtual button in the first game interface; or When a pressing operation is triggered on the first game interface, it is determined that the switching mode is triggered, wherein the pressing time of the pressing operation is equal to or greater than a first time threshold; or When a sliding operation is triggered for the first game interface, determining that a switching mode is triggered, in which a sliding trajectory of the sliding operation is generated according to a start position of the touch object and an end position of the touch object; or Determine that a switching mode is triggered when a double-click operation is triggered for the first game interface, wherein the double-click time interval of the double-click operation is less than or equal to a second time threshold; or When a multi-touch operation is triggered for the first game interface, it is determined that the switching mode is triggered, wherein the multi-touch operation is generated after at least two touch points approach each other inward.

[0156] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by an embodiment of the present application based on the embodiment corresponding to Figure 30 above, the determination module 302 is further used to determine that the revertive mode is triggered when a predetermined revertive operation is triggered for the first sub-interface, among which the predetermined revertive operation includes at least one of a click operation, a press operation, a slide operation, a double-click operation and a multi-touch operation.

[0157] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned FIG. 30, the determination module 302 is specifically used as follows: determining that a revertive mode is triggered when a click operation is triggered on a second virtual button in the first sub-interface; or When a pressing operation is triggered on the first sub-interface, it is determined that the revertive mode is triggered, wherein the pressing time of the pressing operation is equal to or greater than a first time threshold; or When a sliding operation is triggered on the first sub-interface, it is determined that a revertive mode is triggered, in which a sliding trajectory of the sliding operation is generated according to a start position of the touch object and an end position of the touch object; or Determine that the revertive mode is triggered when a double-click operation is triggered for the first sub-interface, wherein the double-click time interval of the double-click operation is less than or equal to a second time threshold; or If a multi-touch operation is triggered for the first sub-interface, it is determined that the revertive mode is triggered, where the multi-touch operation is generated after at least two touch points are extended outward.

[0158] In one possible implementation manner, in another embodiment of the device 30 for controlling interface display provided by the embodiment of the present application based on the embodiment corresponding to Figure 30 above, the device 30 for controlling interface display further includes an acquisition module 303, which is used to obtain the device usage state through a gravity sensor after the display module 301 displays the first game interface and the first virtual key on the main user interface in full-screen mode, wherein the device usage state is used to represent the attitude of the mobile terminal when it is held.

[0159] The determination module 302 is further used for determining that the switching mode is triggered when the device usage state indicates that the mobile terminal is in a portrait screen usage state.

[0160] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to Figure 30 above, the acquisition module 303 is further used to display the first game interface on the first sub-interface after the display module 301 performs a reduction process on the first game interface, and to obtain the device usage state through a gravity sensor after displaying the first virtual key on the first touch interface, in which the device usage state is used to represent the posture of the mobile terminal when it is held.

[0161] The determination module 302 is further used to determine that the revertive mode is triggered when the device usage state indicates that the mobile terminal is in a landscape screen usage state.

[0162] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by an embodiment of the present application based on the embodiment corresponding to Figure 30 above, the acquisition module 303 is further used to obtain a facial image by the front camera head after the display module 301 displays the first game interface and the first virtual key on the main user interface in full screen mode.

[0163] The determination module 302 is further used to obtain a left eye coordinate corresponding to the left eye and a right eye coordinate corresponding to the right eye based on the face image.

[0164] The determination module 302 is further used to determine a binocular coordinate connecting line based on the left eye coordinate and the right eye coordinate.

[0165] The determination module 302 is further used to determine that the switching mode is triggered when the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal is less than or equal to an angle threshold, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in a portrait screen usage state.

[0166] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to the above-mentioned Figure 30, the acquisition module 303 is further used to display the first game interface on the first sub-interface after the display module performs a reduction process on it, and to obtain a facial image by the front camera head after displaying the first virtual key on the first touch interface.

[0167] The determination module 302 is further used to obtain a left eye coordinate corresponding to the left eye and a right eye coordinate corresponding to the right eye based on the face image.

[0168] The determination module 302 is further used to determine a binocular coordinate connecting line based on the left eye coordinate and the right eye coordinate.

[0169] The determination module 302 is further used to determine that the revertive mode is triggered when the included angle between the binocular coordinate connecting line and the horizontal direction of the mobile terminal is greater than an angle threshold, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in a portrait screen usage state.

[0170] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by an embodiment of the present application based on the embodiment corresponding to Figure 30 above, the device 30 for controlling the display of an interface further includes a monitoring module 304.

[0171] The monitoring module 304 is used to monitor the call reminder after the display module 301 displays the first game interface and the first virtual key on the main user interface in full screen mode.

[0172] The determination module 302 is further used to determine that the switching mode is triggered if the answer instruction for the call reminder is triggered.

[0173] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to Figure 30 above, the acquisition module 303 is further used to obtain speech sounds to be detected by the microphone after the display module displays the first game interface and the first virtual key on the main user interface in full screen mode.

[0174] The determination module 302 is further used for determining that the switching mode is triggered if the to-be-detected speech sound is successfully matched with the first predetermined speech sound.

[0175] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to Figure 30 above, the acquisition module 303 is further used to display the first game interface on the first sub-interface after the display module performs a reduction process on it, and to obtain speech sounds to be detected by the microphone after the first virtual key is displayed on the first touch interface.

[0176] The determination module 302 is further used to determine that the revertive mode is triggered if the to-be-detected speech sound is successfully matched with the second predetermined speech sound.

[0177] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by an embodiment of the present application based on the embodiment corresponding to Figure 30 above, the first sub-interface and the first touch interface both belong to an embedded interface.

[0178] The display module 301 is specifically used to generate a first sub-interface in a first predetermined area of ​​the main user interface, where the first predetermined area is a fixed area in the main user interface, and to control a first touch interface in a second predetermined area of ​​the main user interface, where the first touch interface is another fixed area in the main user interface, and to reduce the first game interface in picture-in-picture mode and then display it on the first sub-interface, and to display a first virtual key on the first touch interface in picture-in-picture mode.

[0179] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by an embodiment of the present application based on the embodiment corresponding to Figure 30 above, the first sub-interface and the first touch interface both belong to a floating window type interface.

[0180] The display module 301 is specifically used to generate a first sub-interface on a layer above the main user interface, generate a first touch interface on a layer above the main user interface, and display the first game interface on the first sub-interface after performing a shrinking process on the first game interface in a floating window mode, and display a first virtual key on the first touch interface in a floating window mode.

[0181] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to Figure 30 above, the device 30 for controlling the display of an interface further includes a control module 305.

[0182] The control module 305 is used to control the first sub-interface to move along a drag trajectory corresponding to the drag operation when a drag operation is triggered on the first sub-interface.

[0183] The control module 305 is further used for controlling the first touch interface to move along a drag trajectory corresponding to the drag operation when a drag operation is triggered on the first touch interface.

[0184] The control module 305 is further used for controlling, when a scaling operation is triggered for the first sub-interface, the first sub-interface to be expanded or contracted according to the scaling operation.

[0185] The control module 305 is further used for controlling the first touch interface to be enlarged or reduced according to the scaling operation when a scaling operation is triggered on the first touch interface.

[0186] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to Figure 30 above, the acquisition module 303 is further used to obtain the game type of the first game application before the display module performs a reduction process on the first game interface and displays it on the first sub-interface, and before the display module displays the first virtual key on the first touch interface.

[0187] The determination module 302 is further used to determine a first touch interface from at least one generatable touch interface according to a game type of the first game application, where each generatable touch interface displays a corresponding virtual key.

[0188] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to Figure 30 above, the display module 301 is further used to perform a shrinking process on the second game interface and then display it on a second sub-interface when the switching mode is triggered, and to display a second virtual key on the second touch interface, wherein the second virtual key is used to control the second game application, and both the second sub-interface and the second touch interface are displayed on the main user interface.

[0189] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by an embodiment of the present application based on the embodiment corresponding to Figure 30 above, the display module 301 is further used to display a video application interface corresponding to the video application on the main user interface when the video application is executed.

[0190] The display module 301 is further used to, when the switching mode is triggered, perform a shrinking process on the video application interface and then display it on a third sub-interface, wherein the third sub-interface is displayed on the main user interface.

[0191] In one possible implementation manner, in another embodiment of the device 30 for controlling the display of an interface provided by the embodiment of the present application based on the embodiment corresponding to Figure 30 above, the display module 301 is further used to perform a shrinking process on the first game interface and then display it on the first sub-interface, and after displaying the first virtual key on the first touch interface, display an application interface corresponding to the target application in full-screen mode on the main user interface when the target application is executed, and also display the first sub-interface and the first touch interface on the main user interface, wherein the target application includes at least one of an instant communication application, an entertainment application, and a tool application.

[0192] In the embodiment of the present application, another interface display control device is further provided, and as shown in Figure 31, for convenience, only the parts related to the embodiment of the present application are shown, and specific technical details are not described. For this, please refer to the method part of the embodiment of the present application. In the embodiment of the present application, the mobile terminal is described as a smartphone.

[0193] 31 is a block diagram of a part of the configuration of a smartphone related to a mobile terminal provided by an embodiment of the present application. As shown in FIG. 31, the smartphone is Frequency) circuit 410, memory 420, input unit 430, display unit 440, sensor 450, audio circuit 460, WiFi (Wireless 31 includes components such as a Bluetooth® (Bluetooth Fidelity) module 470, a processor 480, and a power supply 490. The input unit 430 may include a touch panel 431 and other input devices 432, the display unit 440 may include a display panel 441, and the audio circuit 460 may include a speaker 461 and a microphone 462. It should be understood by those skilled in the art that the configuration of the smartphone shown in FIG. 31 is not used to limit the smartphone, and that the smartphone may include more or fewer components than those shown, or may combine some components, or may have a different component layout.

[0194] Below, each component of the smartphone will be specifically explained in conjunction with FIG.

[0195] The processor 480 is the control center of the smartphone, connecting various components of the smartphone using various interfaces and circuits, executing software programs and / or modules stored in the memory 420, retrieving data stored in the memory 420, and performing various functions and processing various data, thereby enabling overall monitoring and control of the smartphone. Optionally, the processor 480 may include one or more processing units. Preferably, the processor 480 may integrate an application processor and a modulation / demodulation processor, where the application processor mainly processes the operating system (OS), user interface, application programs, etc., and the modulation / demodulation processor mainly processes wireless communications. However, such a modulation / demodulation processor need not be integrated into the processor 480.

[0196] Although not shown, the smartphone may further include a camera head, a Bluetooth (registered trademark) module, etc., but detailed description thereof will be omitted here.

[0197] In the embodiment of the present application, the processor 480 included in the terminal may perform the functions in the embodiments corresponding to any one of the above-mentioned Figures 3 to 29, and detailed descriptions thereof will be omitted here.

[0198] In an embodiment of the present application, a computer-readable storage medium is further provided, which stores a computer program that, when executed on a computer, causes the computer to perform the method described in each of the above embodiments.

[0199] In an embodiment of the present application, a computer program product is further provided, which when executed on a computer causes the computer to perform the methods described in each of the above embodiments.

[0200] It should be understood by those skilled in the art that for convenience, the specific working processes of the above-mentioned systems, devices and units can refer to the corresponding processes in the above-mentioned method embodiments, and therefore, detailed descriptions thereof will be omitted here.

[0201] Although the preferred embodiment of the present application has been described above, the present application is not limited to this embodiment, and any modification to the present application falls within the technical scope of the present application as long as it does not depart from the spirit of the present application.

Claims

1. 1. A method for controlling the display of an interface, executed by a mobile terminal, comprising: When running a first game application, displaying a first game interface and a first virtual key on the main user interface in a full screen mode, the first virtual key being used to control the first game application; and When a switching mode is triggered, performing a shrinking process on the first game interface and then displaying the first virtual key on a first touch interface, wherein the first sub-interface and the first touch interface are generated on the main user interface when the switching mode is triggered, and the first touch interface is used to display virtual keys for controlling the first game application; The step of reducing the first game interface and then displaying it on a first sub-interface and displaying the first virtual key on a first touch interface includes: generating the first sub-interface in a layer above the main user interface; generating the first touch interface in a layer above the main user interface; and The first game interface is displayed on the first sub-interface after being reduced in a floating window mode, so as to realize a user's operation for other services on the mobile terminal in the main user interface, and the first virtual key is displayed on the first touch interface in a floating window mode; the first sub-interface is movable and / or scalable (enlarged or reduced); The method, wherein the first touch interface is movable and / or scalable (growing or shrinking).

2. 10. The method of claim 1, After the step of reducing the first game interface and displaying it on a first sub-interface, and displaying the first virtual key on a first touch interface, the method further comprises: If a revertive mode is triggered, the method includes displaying the first game interface and the first virtual key over the main user interface in a full screen mode.

3. 10. The method of claim 1, After the step of displaying a first game interface and a first virtual key on the main user interface in the full screen mode, the method further comprises: determining that the switching mode has been triggered when a predetermined switching operation is triggered, the predetermined switching operation including at least one of a click operation, a press operation, a slide operation, a double-click operation, and a multi-touch operation.

4. 4. The method of claim 3, The step of determining that the switching mode is triggered when the predetermined switching operation is triggered includes: determining that the switching mode is triggered when a click operation is triggered on a first virtual button in the first game interface; or determining that the switching mode is triggered when a pressing operation is triggered on the first game interface, and the pressing time of the pressing operation is equal to or greater than a first time threshold; or When a slide operation is triggered on the first game interface, it is determined that the switching mode is triggered, and a slide trajectory of the slide operation is generated based on a start position of a touch object and an end position of the touch object; or Determine that the switching mode is triggered when a double-click operation is triggered on the first game interface, and a double-click time interval of the double-click operation is less than or equal to a second time threshold; or The method includes determining that the switching mode is triggered when a multi-touch operation is triggered on the first game interface, and the multi-touch operation is generated after at least two touch points approach each other inward.

5. 3. The method of claim 2, After the step of reducing the first game interface and displaying it on a first sub-interface, and displaying the first virtual key on a first touch interface, the method further comprises: determining that the revertive mode is triggered when a touch object triggers a predetermined revertive operation on the first sub-interface on a touch panel, the predetermined revertive operation including at least one of a click operation, a press operation, a slide operation, a double-click operation, and a multi-touch operation.

6. 10. The method of claim 1, After the step of displaying a first game interface and a first virtual key on the main user interface in the full screen mode, the method further comprises: obtaining a device usage state using a gravity sensor, the device usage state being used to represent the orientation of the mobile terminal when held; and determining that the switching mode has been triggered if the device usage state indicates that the mobile terminal is in a portrait screen usage state.

7. 3. The method of claim 2, After the step of reducing the first game interface and displaying it on a first sub-interface, and displaying the first virtual key on a first touch interface, the method further comprises: obtaining a device usage state using a gravity sensor, the device usage state being used to represent the orientation of the mobile terminal when held; and determining that the revertive mode is triggered if the device usage state indicates that the mobile terminal is in a landscape screen usage state.

8. 10. The method of claim 1, After the step of displaying a first game interface and a first virtual key on the main user interface in the full screen mode, the method further comprises: obtaining a facial image with a front camera head; determining a left eye coordinate corresponding to a left eye and a right eye coordinate corresponding to a right eye based on the face image; determining a binocular coordinate connecting line based on the left eye coordinate and the right eye coordinate; and The method includes a step of determining that the switching mode is triggered when the included angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is less than or equal to an angle threshold, wherein the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in a portrait screen usage state.

9. 3. The method of claim 2, After the step of reducing the first game interface and displaying it on a first sub-interface, and displaying the first virtual key on a first touch interface, the method further comprises: obtaining a facial image with a front camera head; determining a left eye coordinate corresponding to a left eye and a right eye coordinate corresponding to a right eye based on the face image; determining a binocular coordinate connecting line based on the left eye coordinate and the right eye coordinate; and The method includes a step of determining that the revertive mode is triggered if the included angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is greater than an angle threshold, wherein the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in a portrait screen usage state.

10. 10. The method of claim 1, After the step of displaying a first game interface and a first virtual key on the main user interface in the full screen mode, the method further comprises: monitoring call reminders; and The method includes determining that the switching mode is triggered if an answer instruction for the call reminder is triggered.

11. 1. A device for controlling the display of an interface, comprising: the device is located in a mobile terminal, the device includes a display module; the display module is used to display a first game interface and a first virtual key on a main user interface in a full screen mode when a first game application is executed, and the first virtual key is used to control the first game application; the display module is further used to, when a switching mode is triggered, perform a shrinking process on the first game interface and then display the first virtual key on a first touch interface, the first sub-interface and the first touch interface are generated in the main user interface when the switching mode is triggered, and the first touch interface is used to display virtual keys for controlling the first game application; The first game interface is reduced and then displayed on a first sub-interface, and the first virtual key is displayed on a first touch interface. generating the first sub-interface in a layer above the main user interface; generating the first touch interface in a layer above the main user interface; and The first game interface is displayed on the first sub-interface after being reduced in a floating window mode, so as to realize a user's operation for other services on the mobile terminal in the main user interface, and the first virtual key is displayed on the first touch interface in a floating window mode; the first sub-interface is movable and / or scalable (enlarged or reduced); The device, wherein the first touch interface is movable and / or scalable (growing or shrinking).

12. a memory; and a mobile terminal including a processor connected to the storage device, The storage device stores a computer program, A mobile terminal, wherein the processor is configured to execute the computer program to implement the method of any one of claims 1 to 10.

13. a memory; and a computing device including a processor coupled to the storage device, The storage device stores a computer program, A computing device, wherein the processor is configured to execute the computer program to implement the method according to any one of claims 1 to 10.

14. A program for causing a computer to execute the method according to any one of claims 1 to 10.

Images