A method, apparatus, device, and storage medium for controlling interface display

Abstract

The present application discloses a method, apparatus, device, and storage medium for controlling interface display, which are used in the technical field of interface display. The method of the present application includes: when a first game application is running, displaying a first game interface and a first virtual button on the user's main interface in full-screen mode; if a mode switch is triggered, the first game interface is reduced and then displayed on a first sub-interface, and the first virtual button is displayed on a first touch interface. The method provided by the present application can, while maintaining the game progress, enable the user to operate other services on the mobile terminal without the user frequently switching interfaces, thereby simplifying the user operation.

Description

Technical Field

[0001] The present application relates to the field of interface display technology, and in particular to a method, device, equipment and storage medium for controlling interface display. Background Art

[0002] With the continuous development of Internet technology, the types of applications are becoming more and more diverse, and users' demand for mobile terminal display functions is increasing day by day. Whether in people's daily communication or in work and entertainment, mobile terminals play a very important role.

[0003] At present, the games running on mobile terminals mainly include stand-alone games and online games. After users download the game application, they can play the game on the mobile terminal. Usually, the game screen is displayed in full screen on the mobile terminal, and the user can operate the game on the display interface of the mobile terminal.

[0004] However, the function of mobile terminals is not only to provide game services, but also to provide many other services. If the user needs to perform other services during the game, the game needs to be paused or switched to the background. If the game needs to be resumed, the user needs to start the game application again, which makes the whole operation process more cumbersome. Summary of the invention

[0005] The embodiments of the present application provide a method, apparatus, device and storage medium for controlling interface display, so that the user can operate other services on the mobile terminal while continuing the game progress, without the user having to frequently switch interfaces, thereby simplifying user operations.

[0006] In view of this, the present application provides a method for controlling interface display, comprising:

[0007] When the first game application is running, the first game interface and the first virtual button are displayed on the user main interface in full screen mode;

[0008] If the switching mode is triggered, the first game interface will be reduced in size and displayed on the first sub-interface, and the first virtual button will be displayed on the first touch interface, wherein the first virtual button is used to control the first game application, and the first sub-interface and the first touch interface are both displayed on the user main interface.

[0009] Another aspect of the present application provides an interface display control device, comprising:

[0010] A display module, configured to display the first game interface and the first virtual button on the user main interface in full screen mode when the first game application is running;

[0011] The display module is further configured to, if a switching mode is triggered, shrink the first game interface and then display it on the first sub-interface, and display the first virtual button on the first touch interface, where the first virtual button is used to control the first game application, and both the first sub-interface and the first touch interface are displayed on the user main interface.

[0012] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0013] The display module is further configured to, after shrinking the first game interface and displaying it on the first sub-interface and displaying the first virtual button on the first touch interface, if a back-switching mode is triggered, display the first game interface and the first virtual button on the user main interface in full-screen mode.

[0014] In a possible design, in another implementation manner of another aspect of the embodiments of the present application, the interface display control device further includes a determination module;

[0015] The determination module is configured to determine that a switching mode is triggered if a preset switching operation is triggered, where the preset switching operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

[0016] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0017] The determination module is specifically configured to determine that a switching mode is triggered if a click operation is triggered on the first virtual button in the first game interface;

[0018] Or,

[0019] If a press operation is triggered on the first game interface, determine that a switching mode is triggered, where the pressing time of the press operation is greater than or equal to a first time threshold;

[0020] Or,

[0021] If a swipe operation is triggered on the first game interface, determine that a switching mode is triggered, where the swipe trajectory of the swipe operation is generated based on the starting position and the ending position of the touch object;

[0022] Or,

[0023] If a double-click operation is triggered on the first game interface, determine that a switching mode is triggered, where the double-click time interval of the double-click operation is less than or equal to a second time threshold;

[0024] Or,

[0025] If a multi-touch point operation is triggered for the first game interface, it is determined that a switching mode is triggered, where the multi-touch point operation is generated based on at least two touch points approaching inward.

[0026] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0027] The determining module is further configured to, if a preset back-cut operation is triggered for the first sub-interface, determine that a back-cut mode is triggered, where the preset back-cut operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

[0028] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0029] The determining module, specifically, if a click operation is triggered for the second virtual button in the first sub-interface, determines that a back-cut mode is triggered;

[0030] Or,

[0031] If a press operation is triggered for the first sub-interface, it is determined that a back-cut mode is triggered, where the pressing time of the press operation is greater than or equal to a first time threshold;

[0032] Or,

[0033] If a swipe operation is triggered for the first sub-interface, it is determined that a back-cut mode is triggered, where the swipe trajectory of the swipe operation is generated based on the starting position and the ending position of the touch object;

[0034] Or,

[0035] If a double-click operation is triggered for the first sub-interface, it is determined that a back-cut mode is triggered, where the double-click time interval of the double-click operation is less than or equal to a second time threshold;

[0036] Or,

[0037] If a multi-touch point operation is triggered for the first sub-interface, it is determined that a back-cut mode is triggered, where the multi-touch point operation is generated based on at least two touch points extending outward.

[0038] In a possible design, in another implementation manner of another aspect of the embodiments of the present application, the interface display control device further includes an acquisition module;

[0039] The acquisition module is configured to, after the display module displays the first game interface and the first virtual button on the user's main interface in full-screen mode, acquire the device usage state through a gravity sensor, where the device usage state is used to describe the posture of the mobile terminal when it is held.

[0040] The determining module is further configured to determine to trigger a switching mode if the device usage status indicates that the mobile terminal is in the portrait usage state.

[0041] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0042] The obtaining module is further configured to, after the display module reduces the size of the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, obtain the device usage status through a gravity sensor, where the device usage status is used to describe the posture of the mobile terminal when it is held.

[0043] The determining module is further configured to determine to trigger a back-switching mode if the device usage status indicates that the mobile terminal is in the landscape usage state.

[0044] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0045] The obtaining module is further configured to, after the display module displays the first game interface and the first virtual button on the user's main interface in full-screen mode, obtain a face image through a front camera.

[0046] The determining module is further configured to determine a left-eye coordinate point corresponding to the left eye and a right-eye coordinate point corresponding to the right eye according to the face image.

[0047] The determining module is further configured to determine a binocular coordinate connection line according to the left-eye coordinate point and the right-eye coordinate point.

[0048] The determining module is further configured to determine to trigger a switching mode if the included angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is less than or equal to an angle threshold, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the portrait usage state.

[0049] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0050] The obtaining module is further configured to, after the display module reduces the size of the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, obtain a face image through a front camera.

[0051] The determining module is further configured to determine a left-eye coordinate point corresponding to the left eye and a right-eye coordinate point corresponding to the right eye according to the face image.

[0052] The determining module is further configured to determine a binocular coordinate connection line according to the left-eye coordinate point and the right-eye coordinate point.

[0053] The determining module is further configured to determine to trigger the back - cut mode if the included angle between the line connecting the binocular coordinates and the horizontal direction of the mobile terminal is greater than the angle threshold, where the horizontal direction of the mobile terminal refers to the horizontal direction when the mobile terminal is in the vertical - screen usage state.

[0054] In a possible design, in another implementation manner of another aspect of the embodiments of the present application, the interface display control device further includes a listening module;

[0055] The listening module is configured to listen for an incoming call reminder after the display module displays the first game interface and the first virtual button on the user's main interface in full - screen mode;

[0056] The determining module is further configured to determine to trigger the switching mode if an answering instruction for the incoming call reminder is triggered.

[0057] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0058] The obtaining module is further configured to obtain the voice to be detected through the microphone after the display module displays the first game interface and the first virtual button on the user's main interface in full - screen mode;

[0059] The determining module is further configured to determine to trigger the switching mode if the voice to be detected matches the first preset voice successfully.

[0060] In a possible design, in another implementation manner of another aspect of the embodiments of the present application,

[0061] The obtaining module is further configured to obtain the voice to be detected through the microphone after the display module reduces the size of the first game interface and displays it on the first sub - interface, and displays the first virtual button on the first touch interface;

[0062] The determining module is further configured to determine to trigger the back - cut mode if the voice to be detected matches the second preset voice successfully.

[0063] In a possible design, in another implementation manner of another aspect of the embodiments of the present application, both the first sub - interface and the first touch interface belong to embedded interfaces;

[0064] The display module is specifically configured to create a first sub - interface in a first preset area on the user's main interface, where the first preset area is a fixed area in the user's main interface;

[0065] Create a first touch interface in a second preset area on the user's main interface, where the first touch interface is another fixed area in the user's main interface;

[0066] Shrink the first game interface in the picture-in-picture mode and display it on the first sub-interface, and display the first virtual button on the first touch interface in the picture-in-picture mode.

[0067] In a possible design, in another implementation of another aspect of the embodiment of the present application, both the first sub-interface and the first touch interface belong to the floating window interface;

[0068] The display module is specifically configured to create a first sub-interface on the upper layer of the user main interface;

[0069] Create a first touch interface on the upper layer of the user main interface;

[0070] Shrink the first game interface in the floating window mode and display it on the first sub-interface, and display the first virtual button on the first touch interface in the floating window mode.

[0071] In a possible design, in another implementation of another aspect of the embodiment of the present application, the interface display control device further includes a control module;

[0072] The control module is configured to, if a drag operation is triggered for the first sub-interface, control the first sub-interface to move along the drag trajectory corresponding to the drag operation;

[0073] The control module is further configured to, if a drag operation is triggered for the first touch interface, control the first touch interface to move along the drag trajectory corresponding to the drag operation;

[0074] The control module is further configured to, if a zoom operation is triggered for the first sub-interface, control the first sub-interface to be enlarged or shrunk according to the zoom operation;

[0075] The control module is further configured to, if a zoom operation is triggered for the first touch interface, control the first touch interface to be enlarged or shrunk according to the zoom operation.

[0076] In a possible design, in another implementation of another aspect of the embodiment of the present application,

[0077] The acquisition module is further configured to, before the display module shrinks the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, acquire the game type of the first game application;

[0078] The determination module is further configured to determine the first touch interface from at least one creatable touch interface according to the game type of the first game application, where each creatable touch interface displays a corresponding virtual button.

[0079] In a possible design, in another implementation of another aspect of the embodiment of the present application,

[0080] The display module is further configured to, when the second game application is running, display the second game interface corresponding to the second game application in full-screen mode;

[0081] The display module is further configured to, if the switching mode is triggered, display the second game interface on the second sub-interface after reducing its size, and display the second virtual key on the second touch interface, where the second virtual key is used to control the second game application, and both the second sub-interface and the second touch interface are displayed on the user main interface.

[0082] In a possible design, in another implementation of another aspect of the embodiments of the present application,

[0083] The display module is further configured to, when the video application is running, display the video application interface corresponding to the video application on the user main interface;

[0084] The display module is further configured to, if the switching mode is triggered, display the video application interface on the third sub-interface after reducing its size, where the third sub-interface is displayed on the user main interface.

[0085] In a possible design, in another implementation of another aspect of the embodiments of the present application,

[0086] After the display module reduces the size of the first game interface and displays it on the first sub-interface and displays the first virtual key on the first touch interface, when the target application is running, it displays the application interface corresponding to the target application on the user main interface in full-screen mode, and displays the first sub-interface and the first touch interface on the user main interface, where the target application includes at least one of instant messaging applications, entertainment applications, and tool applications.

[0087] Another aspect of the present application provides a mobile terminal, which may include: a memory and a processor; wherein, the memory is used to store a program; the processor is used to execute the program in the memory, and the processor is used to execute the methods in the above aspects according to the instructions in the program.

[0088] Another aspect of the present application provides a computer-readable storage medium, in which instructions are stored, and when they run on a computer, the computer is caused to execute the methods in the above aspects.

[0089] Another aspect of the present application provides a computer program product or a computer program, the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above aspects.

[0090] As can be seen from the above technical solutions, the embodiments of the present application have the following advantages:

[0091] In the embodiments of the present application, a method for controlling interface display is provided. When a first game application is running, the mobile terminal displays a first game interface and a first virtual key in full-screen mode on the user's main interface. If the switching mode is satisfied, the first game interface is reduced and then displayed on a first sub-interface, and the first virtual key is displayed on a first touch interface. By the above method, a sub-interface for displaying the game interface and a touch interface for controlling the game are created on the user's main interface, so that while the game progress is continued, the user can operate other services on the mobile terminal without the user frequently switching interfaces, thus simplifying the user operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0092] Figure 1 It is an environmental schematic diagram of the method for controlling interface display in the embodiments of the present application;

[0093] Figure 2 It is a flowchart schematic diagram of the method for controlling interface display in the embodiments of the present application;

[0094] Figure 3 It is an embodiment schematic diagram of the method for controlling interface display in the embodiments of the present application;

[0095] Figure 4 It is a schematic diagram of displaying the first game interface in full-screen mode in the embodiments of the present application;

[0096] Figure 5 It is a schematic diagram of creating the first sub-interface and the first touch interface in the embodiments of the present application;

[0097] Figure 6 It is a schematic diagram of switching to the user's main interface in the embodiments of the present application;

[0098] Figure 7 It is another embodiment schematic diagram of the method for controlling interface display in the embodiments of the present application;

[0099] Figure 8 It is a schematic diagram of switching to the first game interface in the embodiments of the present application;

[0100] Figure 9 It is a schematic diagram of triggering a click operation on the first game interface in the embodiments of the present application;

[0101] Figure 10 It is a schematic diagram of triggering a press operation on the first game interface in the embodiments of the present application;

[0102] Figure 11 A schematic diagram for triggering a swiping operation on the first game interface in an embodiment of this application;

[0103] Figure 12 A schematic diagram for triggering a double - click operation on the first game interface in an embodiment of this application;

[0104] Figure 13 A schematic diagram for triggering a multi - touch - point operation on the first game interface in an embodiment of this application;

[0105] Figure 14 A schematic diagram for triggering a multi - touch - point operation on the first sub - interface in an embodiment of this application;

[0106] Figure 15 A schematic diagram of an embodiment for switching the usage state of a device in an embodiment of this application;

[0107] Figure 16 Another schematic diagram of an embodiment for switching the usage state of a device in an embodiment of this application;

[0108] Figure 17 A schematic diagram of the angle between the line connecting the binocular coordinates and the horizontal direction of the mobile terminal in an embodiment of this application;

[0109] Figure 18 A schematic diagram for realizing interface switching based on face recognition in an embodiment of this application;

[0110] Figure 19 A schematic diagram for realizing interface re - switching based on face recognition in an embodiment of this application;

[0111] Figure 20 A schematic diagram for realizing interface switching based on incoming call reminder in an embodiment of this application;

[0112] Figure 21 A schematic diagram for determining interface display based on an embedded interface in an embodiment of this application;

[0113] Figure 22 A schematic diagram for determining interface display based on a floating interface in an embodiment of this application;

[0114] Figure 23 A schematic diagram for performing a dragging operation on the first sub - interface in an embodiment of this application;

[0115] Figure 24 A schematic diagram for performing a dragging operation on the first sub - interface in an embodiment of this application;

[0116] Figure 25 A schematic diagram of an embodiment of the first touch interface in an embodiment of this application;

[0117] Figure 26 Schematic diagram of an embodiment for selecting parameters of the first touch interface in an embodiment of the present application;

[0118] Figure 27 Schematic diagram of another embodiment of the control interface display method in an embodiment of the present application;

[0119] Figure 28 Schematic diagram of another embodiment of the control interface display method in an embodiment of the present application;

[0120] Figure 29 Schematic diagram of another embodiment of the control interface display method in an embodiment of the present application;

[0121] Figure 30 Schematic diagram of an embodiment of the interface display control device in an embodiment of the present application;

[0122] Figure 31 Schematic diagram of a structure of a mobile terminal in an embodiment of the present application. Detailed implementation manners

[0123] The embodiments of the present application provide a method, a device, a device and a storage medium for controlling interface display, which are used to realize the operation of other services on the mobile terminal by the user while maintaining the continuous game progress, without the user frequently switching interfaces, thereby simplifying the user operation.

[0124] Terms such as "first", "second", "third", "fourth", etc. (if any) in the specification, claims and the above-mentioned drawings of the present application are used to distinguish similar objects, and do not have to be used to describe a specific order or sequence. It should be understood that such used data can be interchanged under appropriate circumstances, so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "include" and "correspond to" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or units does not have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0125] With the continuous development of Internet technology, the types of application programs are becoming more and more diverse, and game applications running on mobile terminals have become one of the most popular applications. In order to achieve better game effects, usually, the game screen is displayed in full-screen form on the mobile terminal, and users can operate the game on the display interface of the mobile terminal. However, considering that there are various types of services provided by mobile terminals, if a user needs to perform other services during the game, the game needs to be paused or switched to the background, resulting in a rather cumbersome operation process. Based on this, the present application provides a method for controlling interface display, which can enable users to operate other services on the mobile terminal while maintaining the game progress, without the need for users to frequently switch interfaces, thus simplifying the user operation.

[0126] Exemplarily, taking the game application as an example for illustration, when a user uses a mobile terminal to play a game, the game screen will be displayed in full-screen form on the mobile terminal. When the user needs to perform other services during the game, a sub-interface and a touch interface can be created on the user's main interface, and the game interface is reduced and then displayed on the sub-interface. At the same time, virtual buttons are displayed on the touch interface, and the user can control the game application through the virtual buttons. Based on this, the user can operate other services on the mobile terminal while maintaining the game progress, without the need for the user to frequently switch interfaces, simplifying the user operation and thus enhancing the user experience.

[0127] For ease of understanding, please refer to Figure 1 , Figure 1 FIG. is an environmental schematic diagram of the method for controlling interface display in an embodiment of the present application. As shown in the figure, the game interface display control system includes a mobile terminal, and the application program is deployed on the mobile terminal. The mobile terminal involved in the present application may be a smart phone, a tablet computer, a handheld computer, etc., but is not limited thereto. Specifically, A1 is used to indicate the first game interface in full-screen mode, A2 is used to indicate the first sub-interface, A3 is used to indicate the first game interface displayed on the first sub-interface, A4 is used to indicate the first touch interface, and A5 is used to indicate the first virtual button. When the first game application is running on the mobile terminal, the first game interface and the first virtual button are displayed in full-screen mode on the user's main interface. When the switching mode is satisfied, the mobile terminal creates the first sub-interface and the first touch interface on the user's main interface. Thus, the first game interface is reduced and then displayed on the first sub-interface, and the first virtual button is displayed on the first touch interface. The first virtual button is used to control the first game application. When the back-switching mode is triggered, the mobile terminal displays the first game interface and the first virtual button in full-screen mode on the user's main interface.

[0128] Taking the application in the game application interface display as an example, since the game engine needs to present the image to the display interface of the mobile terminal through the surface view (SurfaceView), and since SurfaceView has an independent drawing surface, that is, it does not share the same drawing surface with its host window, the user interface (UI) of SurfaceView can be drawn in an independent thread. In addition, SurfaceView does not occupy the main thread resources, so SurfaceView can implement a complex and efficient UI, and will not cause the user's operation to fail to respond in time. In this application, SurfaceView can be implemented in picture-in-picture mode or floating window mode. Among them, the picture-in-picture mode is a screen presentation method. The picture-in-picture mode refers to broadcasting another screen on a small area of ​​the screen while the mobile terminal displays a screen. The floating window mode suspends a movable window on the surface of the application. It should be understood that the mobile terminal may also need to obtain system authorization to use the floating window mode.

[0129] Based on the above introduction, for ease of understanding, please refer to Figure 2 , Figure 2 This is a flow chart of a method for controlling the display of an interface in an embodiment of the present application, as shown in the figure, specifically:

[0130] In step S1, the mobile terminal initiates an authorization request to the user, wherein the permissions included in the permission request may be window top-level display permission, front camera shooting permission, gravity sensing permission, and call monitoring permission, etc.

[0131] In step S2, the mobile terminal determines in real time whether a switching mode is currently triggered. If the switching mode is triggered, step S3 is executed. The switching mode includes but is not limited to the user clicking a virtual button in the game interface, the screen rotating, an incoming call, the user's face direction being consistent with the direction of the smartphone screen, etc.

[0132] In step S3, the mobile terminal creates a sub-interface and a touch area on its corresponding user main interface. The sub-interface and the touch area may be in a floating window mode or a picture-in-picture mode, which is not limited here.

[0133] In step S4, the mobile terminal renders the game screen to the sub-interface and switches the game to the background for execution.

[0134] In step S5, the user may drag the sub-interface, or operate the sub-interface, and control the game process through the touch area.

[0135] In step S6, the mobile terminal determines in real time whether the back - switching mode is triggered. If the back - switching mode is triggered, the game screen resumes execution in the foreground, the touch area disappears, and the game interface is displayed in full - screen mode.

[0136] Combined with the above introduction, the process of switching from the first game interface to the first sub - interface will be introduced below. Please refer to Figure 3 , Figure 3 FIG.

[0137] 101. When the mobile terminal runs the first game application, the mobile terminal displays the first game interface and the first virtual key in full - screen mode on the user's main interface.

[0138] In this embodiment, when the mobile terminal runs the first game application, it will display the first game interface and the first virtual key in full - screen mode on the user's main interface. Among them, the full - screen mode can be that the mobile terminal displays the first game interface in the entire displayable area of its screen, or the mobile terminal displays the first game interface in most of the displayable area of its screen. For example, the mobile terminal displays the status bar (such as operator, time, and battery power information, etc.) in a small part of the displayable area at the top of the screen, and displays the first game interface in the rest of the screen.

[0139] For easy understanding, please refer to Figure 4 , Figure 4 FIG. Figure 4 shows a schematic diagram of displaying the first game interface in full - screen mode in an embodiment of the present application. As shown in the figure, Figure 4 in (A) of

[0140] shows the first game interface being displayed in most of the displayable area of the mobile terminal screen,

[0141] in (B) of

[0142] shows the first game interface being displayed in the entire displayable area of the mobile terminal screen. Figure 5 ,Figure 5 This is a schematic diagram for creating a first sub - interface and a first touch interface in an embodiment of the present application. As shown in the figure, B1 is used to indicate the user main interface, B2 is used to indicate the first sub - interface, and B3 is used to indicate the first touch interface. It should be understood that Figure 5 the examples of

[0143] are only for understanding this solution. The first sub - interface and the first touch interface can also be circular, triangular, square, etc., and the first sub - interface and the first touch interface can also be located at other positions such as directly above or directly below the user main interface. The shapes of the first sub - interface and the first touch interface and their display positions in the user main interface can be adjusted according to actual situations and are not limited here.

[0144] Based on this, the mobile terminal can display the first game interface on the first sub - interface after shrinking it, and then display the first virtual button on the first touch interface. It should be noted that the first virtual button displayed on the first touch interface and the first virtual button displayed in the full - screen mode are both used to control the first game application. Among them, the first virtual button displayed on the first touch interface and the first virtual button displayed in the full - screen mode can be the same or different in terms of the number of buttons and the shape of the buttons, and are not limited here.

[0145] For easy understanding, please refer to Figure 6 , Figure 6 This is a schematic diagram for switching to the user main interface in an embodiment of the present application. As shown in the figure, Figure 6 in (A) of Figure 6 shows the first game interface without shrinking processing, Figure 6 in (B) of Figure 6 shows the first game interface after shrinking processing,

[0146] In an embodiment of the present application, a method for controlling interface display is provided. Through the above method, a sub-interface for displaying a game interface and a touch interface for controlling the game are created on the user's main interface, so that while maintaining the game progress, the user can operate other services on the mobile terminal without frequently switching interfaces, thus simplifying the user operation.

[0147] Combined with the above introduction, the process of switching back from the first sub-interface to the first game interface will be introduced below. Please refer to Figure 7 , Figure 7 FIG. is a schematic diagram of another embodiment of the method for controlling interface display in an embodiment of the present application. An embodiment of the method for controlling interface display in an embodiment of the present application includes:

[0148] 201. When the mobile terminal runs the first game application, the mobile terminal displays the first game interface and the first virtual key on the user's main interface in full-screen mode;

[0149] 202. If the switching mode is triggered, the mobile terminal reduces the size of the first game interface and then displays it on the first sub-interface, and displays the first virtual key on the first touch interface, where the first virtual key is used to control the first game application, and both the first sub-interface and the first touch interface are displayed on the user's main interface;

[0150] In this embodiment, the content described in steps 201 to 202 is similar to that described in steps 101 to 102, so it will not be elaborated here.

[0151] 203. If the back-switching mode is triggered, the first game interface and the first virtual key are displayed on the user's main interface in full-screen mode.

[0152] In this embodiment, when the back-switching mode is triggered, the mobile terminal switches to full-screen mode to display the first game interface and the first virtual key corresponding to the first game application, and no longer separately displays the first touch area.

[0153] For easy understanding, please refer to Figure 8 , Figure 8 FIG. is a schematic diagram of switching to the first game interface in an embodiment of the present application. As shown in the figure, Figure 8 in (A) shows the user's main interface, Figure 8The first game interface in full-screen mode is shown in Figure (B). D1 is used to indicate the first sub-interface, D2 is used to indicate the first touch interface, and D3 is used to indicate the first virtual button. While the user is operating other applications, the user can also view the game screen of the first game application through the first sub-interface and control the first game application through the first virtual button displayed on the first touch interface. If the user wishes to return to the game screen in full-screen mode, the mobile terminal can be held horizontally, or the second virtual button in the first sub-interface can be clicked, etc., thereby switching to Figure (B) as shown in Figure 8 shown.

[0154] In an embodiment of the present application, another method for controlling interface display is provided. Through the above method, a sub-interface for displaying a game interface and a touch interface for controlling the game are created on the user's main interface, so that while maintaining the game progress, the user can operate other services on the mobile terminal without the user frequently switching interfaces, thereby simplifying the user operation. Secondly, when switching back from the sub-interface to the full-screen mode, the switching process can also maintain the game progress. Therefore, on the basis of meeting the user's needs, the user operation is further simplified.

[0155] Optionally, on the basis of the above Figure 3 corresponding embodiment, in another optional embodiment provided by the embodiment of the present application, after the mobile terminal displays the first game interface and the first virtual button on the user's main interface in full-screen mode, the following steps are further included:

[0156] If a preset switching operation is triggered, the mobile terminal determines that the switching mode is triggered, where the preset switching operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

[0157] In this embodiment, a method for determining the triggered switching mode through a preset switching operation is introduced. After the mobile terminal displays the first game interface and the first virtual button on the user's main interface in full-screen mode, if the user needs to operate other applications (for example, a video application, an instant messaging application, a shooting application, or a food ordering application, etc.), a preset switching operation can be performed on the first game interface on the touch screen. Therefore, when the mobile terminal detects a preset switching operation of the touch object on the touch screen for the first game interface, it determines that the switching mode is triggered. It should be noted that the touch object can be the user's finger, knuckle, or other touchable objects, and specific details are not limited here.

[0158] When the switching mode is satisfied, a first sub-interface and a first touch interface can be created on the user main interface. The method of creating the first sub-interface and the first touch interface has been introduced in step 102, so it will not be elaborated here. It can be understood that the preset switching operation includes but is not limited to click operation, press operation, swipe operation, double-click operation, and multi-touch point operation, etc.

[0159] In an embodiment of the present application, a method for determining the triggering of the switching mode through a preset switching operation is provided. Through the above method, the user realizes interface switching by using the preset switching operation. Thus, the feasibility of the solution implementation is improved. Secondly, since the preset switching operation can be at least one of multiple operations, the user can operate according to needs, thereby increasing the flexibility of the solution.

[0160] Optionally, based on the above Figure 3 corresponding embodiment, in another optional embodiment provided by the embodiment of the present application, if the preset switching operation is triggered, the mobile terminal determines that the switching mode is triggered, which specifically includes the following steps:

[0161] If a click operation is triggered for the first virtual button in the first game interface, the mobile terminal determines that the switching mode is triggered;

[0162] Or,

[0163] If a press operation is triggered for the first game interface, the mobile terminal determines that the switching mode is triggered, where the pressing time of the press operation is greater than or equal to the first time threshold;

[0164] Or,

[0165] If a swipe operation is triggered for the first game interface, the mobile terminal determines that the switching mode is triggered, where the swipe trajectory of the swipe operation is generated based on the starting position and the ending position of the touch object;

[0166] Or,

[0167] If a double-click operation is triggered for the first game interface, the mobile terminal determines that the switching mode is triggered, where the double-click time interval of the double-click operation is less than or equal to the second time threshold;

[0168] Or,

[0169] If a multi-touch point operation is triggered for the first game interface, the mobile terminal determines that the switching mode is triggered, where the multi-touch point operation is generated after at least two touch points move closer to each other.

[0170] In this embodiment, multiple methods for triggering the preset switching operation are introduced. Next, different types of preset switching operations will be introduced in combination with specific examples.

[0171] The first way is a click operation. If the user clicks on the first virtual button in the first game interface, the click operation is triggered. Specifically, for the convenience of understanding the click operation, please refer to Figure 9 , Figure 9 which is a schematic diagram for triggering the click operation on the first game interface in the embodiments of the present application. As shown in the figure, Figure 9 in (A) of the figure shows the first game interface. E1 is used to indicate the first virtual button. When the user clicks on the first virtual button, the mobile terminal can detect the click operation on the first virtual button on the touch screen and determine to trigger the switching mode. Based on this, it enters Figure 9 the figure (B) of Figure 9 In (B) of the figure shows the user main interface including the first sub-interface and the first touch interface. It should be noted that Figure 9 the example of

[0172] is only for understanding the present solution. In actual applications, the first virtual button can also be circular, oval, triangular, pentagonal, etc. The position of the first virtual button can be located at any position in the first game interface. Based on this, the specific shape and position of the first virtual button can be flexibly determined according to the actual situation. Figure 10 , Figure 10 which is a schematic diagram for triggering the press operation on the first game interface in the embodiments of the present application. As shown in the figure, Figure 10 in (A) of the figure shows the first game interface. When the user performs a press operation on the touch screen and the press time is greater than or equal to the first time threshold, the mobile terminal can determine to trigger the switching mode. Based on this, it enters Figure 10 the figure (B) of Figure 10 In (B) of the figure shows the user main interface including the first sub-interface and the first touch interface.

[0173] The third way is a swipe operation. If the user performs a swipe operation on the first game interface and the swipe trajectory is generated based on the starting position and the ending position of the touch object, the swipe operation is triggered. In actual applications, the way to trigger the swipe operation can also be that the mobile terminal starts the camera to capture the touch object (such as a hand or a stylus) performing a swipe operation in the air, and this operation does not need to contact the touch screen. Specifically, for the convenience of understanding the swipe operation, taking the touch object as a finger as an example for introduction, please refer to Figure 11 , Figure 11This is a schematic diagram for triggering a swiping operation on the first game interface in an embodiment of the present application. As shown in the figure, Figure 11 Figure (A) shows the first game interface. F1 is used to indicate the starting position of the finger on the touch screen, F2 is used to indicate the ending position of the finger on the touch screen, and F3 is used to indicate the swiping trajectory of the swiping operation. When the user's finger swipes from the starting position to the ending position on the touch screen and forms a swiping trajectory, the mobile terminal can determine to trigger the switching mode. Based on this, it enters Figure 11 Figure (B) in Figure 11 Figure (B) shows the user main interface including the first sub-interface and the first touch interface.

[0174] The fourth method is a double-tap operation. If the time interval between two consecutive clicks by the user on the first game interface is less than or equal to the second time threshold, the double-tap operation is triggered. It should be noted that the second time threshold can be 0.5 seconds, 1 second, etc., and is not limited here. Specifically, for the convenience of understanding the double-tap operation, please refer to Figure 12 , Figure 12 This is a schematic diagram for triggering a double-tap operation on the first game interface in an embodiment of the present application. As shown in the figure, Figure 12 Figure (A) shows the first game interface. When the user double-clicks on the touch screen and the double-click time interval is less than or equal to the second time threshold, the mobile terminal can detect the switching mode. Based on this, it enters Figure 12 Figure (B) in Figure 12 Figure (B) shows the user main interface including the first sub-interface and the first touch interface.

[0175] The fifth method is a multi-touch point operation. If the user uses at least two fingers to converge inward simultaneously on the first game interface, the multi-touch point operation is triggered. Specifically, for the convenience of understanding the multi-touch point operation, please refer to Figure 13 , Figure 13 This is a schematic diagram for triggering a multi-touch point operation on the first game interface in an embodiment of the present application. As shown in the figure, Figure 13 Figure (A) shows the first game interface. G1 is used to indicate touch point A, and G2 is used to indicate touch point B. When the user touches touch point A and touch point B on the touch screen and the fingers move closer inward, the mobile terminal can determine to trigger the switching mode. Based on this, it enters Figure 13 Figure (B) in Figure 13 Figure (B) shows the user main interface including the first sub-interface and the first touch interface.

[0176] In the embodiments of the present application, a variety of methods for triggering a preset switching operation are provided. Through the above methods, the preset switching operation includes a variety of different operations. Based on this, users can perform different preset switching operations according to their needs, thereby further improving the flexibility of the solution.

[0177] Optionally, on the basis of the above Figure 7 In another optional embodiment provided by the embodiments of the present application based on the corresponding embodiment, after the mobile terminal shrinks the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, the following steps are further included:

[0178] If a preset back-cut operation is triggered for the first sub-interface, the mobile terminal determines to trigger the back-cut mode, where the preset back-cut operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

[0179] In this embodiment, a method for determining to trigger the back-cut mode through a preset switching operation is introduced. After the mobile terminal shrinks the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, if the user hopes to resume playing the game in full-screen mode, a preset back-cut operation can be performed on the first sub-interface on the touch screen. Therefore, when the mobile terminal detects a preset back-cut operation of the touch object on the touch screen for the first sub-interface, it determines to trigger the preset back-cut operation. It should be noted that the touch object can be the user's finger, knuckle or other touchable object, and no specific limitation is made here.

[0180] In the case of triggering the back-cut mode, the first game interface will be displayed in full-screen mode. The method of displaying the first game interface in full-screen mode has been introduced in step 204, so it will not be elaborated here. It can be understood that the preset back-cut operation includes but is not limited to a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation, etc.

[0181] In the embodiments of the present application, a method for determining to trigger the back-cut mode through a preset switching operation is provided. Through the above methods, users can realize interface switching by using the preset back-cut operation, thereby improving the feasibility of the solution. Secondly, since the preset back-cut operation can be at least one of a variety of operations, users can perform operations according to their needs, thereby increasing the flexibility of the solution.

[0182] Optionally, on the basis of the above Figure 7 In another optional embodiment provided by the embodiments of the present application based on the corresponding embodiment, if a preset back-cut operation is triggered for the first sub-interface, the mobile terminal determines to trigger the back-cut mode, which specifically includes the following steps:

[0183] If a click operation is triggered on the second virtual button in the first sub-interface, the mobile terminal determines that the back-cut mode is triggered;

[0184] Or,

[0185] If a pressing operation is triggered on the first sub-interface, the mobile terminal determines that the back-cut mode is triggered, where the pressing time of the pressing operation is greater than or equal to the first time threshold;

[0186] Or,

[0187] If a swiping operation is triggered on the first sub-interface, the mobile terminal determines that the back-cut mode is triggered, where the swiping trajectory of the swiping operation is generated based on the starting position and the ending position of the touch object;

[0188] Or,

[0189] If a double-click operation is triggered on the first sub-interface, the mobile terminal determines that the back-cut mode is triggered, where the double-click time interval of the double-click operation is less than or equal to the second time threshold;

[0190] Or,

[0191] If a multi-touch point operation is triggered on the first sub-interface, the mobile terminal determines that the back-cut mode is triggered, where the multi-touch point operation is generated based on at least two touch points extending outward.

[0192] In this embodiment, multiple methods for triggering a preset back-cut operation are introduced. Different types of preset back-cut operations will be introduced below in combination with specific examples.

[0193] The first method is a click operation. The user can perform a click operation on the second virtual button in the first sub-interface on the touch screen, and the mobile terminal can detect the click operation. The click operation is similar to the Figure 9 example introduced, and will not be elaborated here.

[0194] The second method is a pressing operation. The user can perform a pressing operation on the first sub-interface, and when the pressing time of the pressing operation is greater than or equal to the first time threshold, the mobile terminal can detect the pressing operation. Among them, the first time threshold can be 2 seconds or 3 seconds, etc., and is not limited here. The pressing operation is similar to the Figure 10 example, and will not be elaborated here.

[0195] The third method is a swiping operation. The user can perform a swiping operation on the first sub-interface, and when the swiping trajectory of the swiping operation is generated based on the starting position and the ending position of the touch object, the mobile terminal can detect the swiping operation. The specific pressing operation is similar to the Figure 11 example, and will not be elaborated here.

[0196] The fourth method is a double - click operation. The user can perform a double - click operation on the first sub - interface, and the double - click time interval of the double - click operation is less than or equal to the second time threshold. At this time, the mobile terminal can detect the double - click operation. The second time threshold can be 1 second, 2 seconds, etc., and is not limited here. The specific pressing operation is similar to the Figure 12 example and will not be elaborated here.

[0197] The fifth method is a multi - touch - point operation. The user can use at least two fingers to swipe outwards simultaneously on the first sub - interface, which triggers the multi - touch - point operation. At this time, the mobile terminal can detect the multi - touch - point operation. Specifically, for the convenience of understanding the multi - touch - point operation, please refer to Figure 14 , Figure 14 which is a schematic diagram of triggering a multi - touch - point operation for the first sub - interface in an embodiment of the present application. As shown in the figure, Figure 14 in (A) of the figure shows the user main interface. H1 is used to indicate the first sub - interface, H2 is used to indicate touch point A, and H3 is used to indicate touch point B. When the user touches touch point A and touch point B on the touch screen and the fingers disperse outwards, the mobile terminal can determine to trigger the back - cut mode. Based on this, it enters Figure 14 the figure (B). Figure 14 In (B) of the figure, the first game interface is displayed in full - screen mode.

[0198] In an embodiment of the present application, multiple methods for triggering a preset back - cut operation are provided. Through the above - mentioned methods, the preset back - cut operation includes various different operations. Based on this, the user can perform different preset back - cut operations according to needs, thereby further improving the flexibility of the solution.

[0199] Optionally, on the basis of the above - mentioned Figure 3 corresponding embodiment, in another optional embodiment provided by the embodiment of the present application, after the mobile terminal displays the first game interface and the first virtual button on the user main interface in full - screen mode, the following steps are further included:

[0200] The mobile terminal obtains the device usage status through the gravity sensor, where the device usage status is used to describe the posture of the mobile terminal when it is held.

[0201] If the device usage status indicates that the mobile terminal is in the portrait usage state, the mobile terminal determines to trigger the switching mode.

[0202] In this embodiment, a method for determining a trigger switching mode based on the device usage state is introduced. After the mobile terminal displays the first game interface and the first virtual keys on the user main interface in full-screen mode, the device usage state can be obtained through the gravity sensor. The device usage state is used to describe the posture of the mobile terminal when it is held. The device usage state mainly includes the portrait usage state and the landscape usage state. Since the first game interface is usually displayed in landscape mode in full-screen mode, when the mobile terminal is in the portrait usage state, it can be determined to trigger the switching mode.

[0203] Specifically, the gravity sensor can determine the state of the mobile terminal by measuring the magnitudes of the component forces in two orthogonal directions of the gravity of the mobile terminal, that is, obtain the device usage state. In practical applications, the device usage state can also be obtained through the built-in gyroscope in the mobile terminal. Since the axis of rotation of a high-speed rotating object has a tendency to be perpendicular to the external force acting on it to change its direction, and when the rotating object is tilted horizontally, gravity acts in the direction of increasing tilt, and the axis moves in the vertical direction, resulting in a nodding motion (i.e., precession motion). Therefore, when the gyro axis of the gyroscope rotates around the horizontal axis, due to the rotation of the earth, it is subjected to a vertical rotation force, and the rotating body of the gyro undergoes precession motion in the direction of the meridian in the horizontal plane, and thus the device usage state can be obtained.

[0204] For ease of understanding, please refer to Figure 15 , Figure 15 which is a schematic diagram of an embodiment for switching the device usage state in the embodiment of the present application. As shown in the figure, Figure 15 Figure (A) shows the first game interface displayed in full-screen mode in the landscape usage state. When the user turns the mobile terminal from landscape to portrait, that is, as shown in Figure 15 Figure (B) in Figure 15 Figure (B) shows the first game interface displayed in full-screen mode in the portrait usage state. At this time, the mobile terminal determines to trigger the switching mode. Based on this, it enters Figure 15 Figure (C) in Figure 15 Figure (C) shows the user main interface including the first sub-interface and the first touch interface.

[0205] In the embodiment of the present application, a method for determining a trigger switching mode based on the device usage state is provided. Through the above method, when the user adjusts the device usage state, they may need to operate other applications or have other requirements. Therefore, determining the trigger switching mode through the device usage state further clarifies the specific switching mode, thereby improving the feasibility of this solution.

[0206] Optionally, in the above Figure 7Based on the corresponding embodiments, in another optional embodiment provided by the embodiments of the present application, after the mobile terminal reduces the size of the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, the following steps are further included:

[0207] The mobile terminal obtains the device usage status through the gravity sensor, where the device usage status is used to describe the posture of the mobile terminal when it is held.

[0208] If the device usage status indicates that the mobile terminal is in the landscape usage state, the mobile terminal determines to trigger the back-switching mode.

[0209] In this embodiment, a method for determining to trigger the back-switching mode based on the device usage status is introduced. After the mobile terminal reduces the size of the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, the device usage status can be obtained through the gravity sensor. The device usage status is used to describe the posture of the mobile terminal when it is held, and the device usage status mainly includes the portrait usage state and the landscape usage state. Since the display of the first sub-interface and the first virtual button is usually in the portrait usage state, when the mobile terminal is in the landscape usage state, it can be determined to trigger the back-switching mode.

[0210] For ease of understanding, please refer to Figure 16 , Figure 16 which is another schematic diagram of an embodiment for switching the device usage status in the embodiments of the present application. As shown in the figure, Figure 16 Figure (A) shows the user main interface including the first sub-interface and the first touch interface. When the user turns the mobile terminal from the portrait orientation to the landscape orientation, that is, as shown in Figure 16 Figure (B) in Figure 16 Figure (B) shows the user main interface including the first sub-interface and the first touch interface in the landscape usage state. At this time, the mobile terminal determines to trigger the back-switching mode. Based on this, it enters Figure 16 Figure (C) in Figure 16 Figure (C) shows the first game interface displayed in full-screen mode in the landscape usage state.

[0211] In the embodiments of the present application, a method for determining to trigger the back-switching mode based on the device usage status is provided. Through the above method, usually when the user adjusts the device usage status and is in the landscape usage state, the user usually hopes to display the first game interface in full-screen mode. Therefore, the back-switching mode can be determined through the device usage status, further clarifying the specific back-switching mode, thereby improving the feasibility of this solution.

[0212] Optionally, in the above Figure 3Based on the corresponding embodiments, in another alternative embodiment provided by the embodiments of the present application, after the mobile terminal displays the first game interface and the first virtual keys on the user main interface in full-screen mode, the following steps are further included:

[0213] The mobile terminal acquires a face image through the front camera;

[0214] The mobile terminal determines the left-eye coordinate point corresponding to the left eye and the right-eye coordinate point corresponding to the right eye according to the face image;

[0215] The mobile terminal determines the binocular coordinate connection line according to the left-eye coordinate point and the right-eye coordinate point;

[0216] If the included angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is less than or equal to the angle threshold, the mobile terminal determines that the switching mode is triggered, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the vertical screen usage state.

[0217] In this embodiment, a method for triggering the switching mode based on the face recognition situation is introduced. After the mobile terminal displays the first game interface and the first virtual keys on the user main interface in full-screen mode, it can also capture the face image in real time through the front camera, determine the coordinate points of the left eye and the right eye from the face image, and then generate the binocular coordinate connection line according to the left-eye coordinate point and the right-eye coordinate point. If the included angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is less than or equal to the angle threshold, it is determined that the switching mode is triggered. Wherein, the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the vertical screen usage state. It should be noted that the angle threshold can be 30°, and in practical applications, the angle threshold can also be set to other angles such as 45° or 20°, which is not limited here.

[0218] For ease of understanding, please refer to Figure 17 , Figure 17 is a schematic diagram of the included angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal in the embodiments of the present application. As shown in the figure, Figure 17 in (A) shows the mobile terminal in the vertical screen usage state, Figure 17 in (B) shows the mobile terminal in the horizontal screen usage state. I1 is used to indicate the horizontal direction of the mobile terminal, I2 is used to indicate the left eye, and I3 is used to indicate the right eye. As can be seen from Figure 17 in (A) figure, the connection line between the left eye and the right eye is parallel to the horizontal direction of the mobile terminal, that is, the included angle between the binocular coordinate connection line of the left-eye coordinate point corresponding to the left eye and the right-eye coordinate point corresponding to the right eye and the horizontal direction of the mobile terminal is 0°. As can be seen from Figure 17As can be seen from Figure (B), the left eye and the right eye are perpendicular to the horizontal direction of the mobile terminal, that is, the angle between the binocular coordinate connection line of the left eye coordinate point corresponding to the left eye and the right eye coordinate point corresponding to the right eye and the horizontal direction of the mobile terminal is 90°.

[0219] Specifically, taking the angle threshold of 30° as an example for illustration, please refer to Figure 18 , Figure 18 which is a schematic diagram for realizing interface switching based on face recognition in the embodiments of the present application. As shown in the figure, Figure 18 Figure (A) shows the mobile terminal. J1 is used to indicate the horizontal direction of the mobile terminal, J2 is used to indicate the left eye, J3 is used to indicate the right eye, and J4 is used to indicate the angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal. As Figure 18 can be seen from Figure (A), there is an angle between the binocular coordinate connection line of the left eye coordinate point and the right eye coordinate point and the horizontal direction of the mobile terminal. If this angle is 20°, then this angle is less than the angle threshold of 30°. Therefore, the switching mode is satisfied, and thus Figure 18 Figure (B) is obtained. Figure 18 Figure (B) shows the user main interface including the first sub-interface and the first touch interface.

[0220] In the embodiments of the present application, a method for triggering a switching mode based on the face recognition situation is provided. Through the above method, the left eye coordinate point and the right eye coordinate point are determined based on the face image, and further the binocular coordinate connection line is determined. According to the relationship between the binocular coordinate connection line and the horizontal direction of the mobile terminal, it is judged whether to trigger the switching mode, and the specific switching mode is clarified. Without the need for the user to perform an active operation, it is only necessary to obtain the face image to determine whether to trigger the switching mode, thereby simplifying the user operation.

[0221] Optionally, on the basis of the above Figure 7 corresponding embodiment, in another optional embodiment provided by the embodiments of the present application, after the mobile terminal reduces the first game interface and displays it on the first sub-interface and displays the first virtual button on the first touch interface, the following steps are further included:

[0222] The mobile terminal obtains a face image through the front camera;

[0223] The mobile terminal determines the left eye coordinate point corresponding to the left eye and the right eye coordinate point corresponding to the right eye according to the face image;

[0224] The mobile terminal determines the binocular coordinate connection line according to the left eye coordinate point and the right eye coordinate point;

[0225] If the angle between the line connecting the binocular coordinates and the horizontal direction of the mobile terminal is greater than the angle threshold, the mobile terminal determines that the back - cut mode is triggered, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the portrait - using state.

[0226] In this embodiment, a method for determining the trigger of the back - cut mode based on the face recognition situation is introduced. After the mobile terminal reduces the first game interface and displays it on the first sub - interface, and displays the first virtual button on the first touch interface, it can also capture the face image in real - time through the front - facing camera, determine the coordinate points of the left eye and the right eye from the face image, and then generate the line connecting the binocular coordinates according to the coordinate points of the left eye and the right eye. If the angle between the line connecting the binocular coordinates and the horizontal direction of the mobile terminal is greater than the angle threshold, it is determined that the back - cut mode is triggered. Wherein, the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the portrait - using state. It should be noted that the angle threshold can be 30°, and in practical applications, the angle threshold can also be set to other angles such as 45° or 20°, which is not limited here.

[0227] For the sake of easy understanding, taking the angle threshold of 30° as an example for illustration, please refer to Figure 19 , Figure 19 is a schematic diagram of realizing interface back - cut based on face recognition in the embodiment of the present application. As shown in the figure, Figure 19 in (A) of the figure shows the mobile terminal. K1 is used to indicate the horizontal direction of the mobile terminal, K2 is used to indicate the left eye, K3 is used to indicate the right eye, and K4 is used to indicate the angle between the line connecting the binocular coordinates and the horizontal direction of the mobile terminal. As can be seen from Figure 19 in (A) of the figure, there is an angle between the line connecting the binocular coordinates of the left - eye coordinate point and the right - eye coordinate point and the horizontal direction of the mobile terminal. If this angle is 45°, then this angle is greater than the angle threshold of 30°. Therefore, the back - cut mode is triggered, and thus Figure 19 in (B) of the figure is obtained. Figure 19 in (B) of the figure shows the first game interface displayed in the full - screen mode.

[0228] In the embodiment of the present application, a method for determining the trigger of the back - cut mode based on the face recognition situation is provided. Through the above - mentioned method, the coordinate points of the left eye and the right eye are determined based on the face image, and further the line connecting the binocular coordinates is determined. According to the relationship between the angle between the line connecting the binocular coordinates and the horizontal direction of the mobile terminal, it is judged whether the back - cut mode is triggered. Without the need for the user to perform active operations, it can be determined whether the back - cut mode is triggered only by obtaining the face image, thus simplifying the user operation.

[0229] Optionally, in the above Figure 3Based on the corresponding embodiment, in another alternative embodiment provided by the embodiments of the present application, after the mobile terminal displays the first game interface and the first virtual button on the user main interface in full-screen mode, the following steps are further included:

[0230] The mobile terminal monitors the incoming call reminder;

[0231] If an answer instruction for the incoming call reminder is triggered, the mobile terminal determines that the switching mode is triggered.

[0232] In this embodiment, a method for determining the trigger of the switching mode based on the incoming call situation is introduced. The mobile terminal can monitor the incoming call reminder in real time. When there is an incoming call reminder, if the user selects to answer the incoming call, the mobile terminal can detect the answer instruction for the incoming call reminder, and thus determine that the switching mode is triggered. Among them, the answering operation can be an operation of clicking the answer button.

[0233] For ease of understanding, please refer to Figure 20 , Figure 20 which is a schematic diagram for realizing interface switching based on the incoming call reminder in the embodiments of the present application. As shown in the figure, Figure 20 Figure (A) in shows the first game interface displayed in full-screen mode. When the mobile terminal displays the incoming call reminder, if the user selects to answer, the answer button can be clicked. Thus, when the mobile terminal detects the answer instruction for the incoming call reminder, it can determine that the switching mode is triggered. Based on this, it enters Figure 20 Figure (B) in. Figure 20 Figure (B) in shows the user main interface including the first sub-interface and the first touch interface.

[0234] In the embodiments of the present application, a method for determining the trigger of the switching mode based on the incoming call situation is provided. Through the above method, if the user selects to answer the incoming call, the interface switching is automatically realized, thereby simplifying the user operation and improving the feasibility of the solution.

[0235] Optionally, based on the corresponding embodiment above, in another alternative embodiment provided by the embodiments of the present application, after the mobile terminal displays the first game interface and the first virtual button on the user main interface in full-screen mode, the following steps are further included: Figure 3 Based on the corresponding embodiment, in another alternative embodiment provided by the embodiments of the present application, after the mobile terminal displays the first game interface and the first virtual button on the user main interface in full-screen mode, the following steps are further included:

[0236] The mobile terminal obtains the voice to be detected through the microphone;

[0237] If the voice to be detected matches the first preset voice successfully, the mobile terminal determines that the switching mode is triggered.

[0238] In this embodiment, a method for determining a trigger to switch modes based on voice is introduced. After the mobile terminal displays a first game interface and a first virtual button on the user main interface in full-screen mode, it can also obtain the voice to be detected in real time through the microphone. If the voice to be detected matches the first preset voice successfully, then it is determined to trigger the switching mode. Exemplarily, assuming the first preset voice is "interface switching", if the user says "interface switching" to the microphone (i.e., "interface switching" is the voice to be detected), the mobile terminal matches the voice to be detected with the first preset voice, and in the case of successful matching, it can be determined to trigger the switching mode. It should be understood that the foregoing example is only for understanding this solution, and the first preset voice can also be set according to the actual selection situation.

[0239] In an embodiment of the present application, a method for determining a trigger to switch modes based on voice is provided. Through the above method, the user can switch the interface by voice, thereby simplifying the user operation and increasing the flexibility of the application of the solution.

[0240] Optionally, based on the above Figure 7 corresponding embodiment, in another optional embodiment provided by the embodiment of the present application, after the mobile terminal reduces the size of the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, the following steps are further included:

[0241] The mobile terminal obtains the voice to be detected through the microphone;

[0242] If the voice to be detected matches the second preset voice successfully, the mobile terminal determines to trigger the back-switching mode.

[0243] In this embodiment, a method for determining a trigger to switch back modes based on voice is introduced. After the mobile terminal reduces the size of the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, it can also obtain the voice to be detected in real time through the microphone. If the voice to be detected matches the second preset voice successfully, then it is determined to trigger the back-switching mode. Exemplarily, assuming the second preset voice is "interface back-switching", if the user says "interface back-switching" to the microphone (i.e., "interface back-switching" is the voice to be detected), the mobile terminal matches the voice to be detected with the second preset voice, and in the case of successful matching, it can be determined to trigger the back-switching mode. It should be understood that the foregoing example is only for understanding this solution, and the second preset voice can also be set according to the actual selection situation.

[0244] In an embodiment of the present application, a method for determining a trigger to switch back modes based on voice is provided. Through the above method, the user can switch the interface back by voice, thereby simplifying the user operation and increasing the flexibility of the application of the solution.

[0245] Optionally, based on the above Figure 3 and Figure 7 In another optional embodiment provided by the embodiments of the present application, on the basis of the corresponding respective embodiments, both the first sub-interface and the first touch interface are embedded interfaces;

[0246] The mobile terminal reduces the size of the first game interface and then displays it on the first sub-interface, and displays the first virtual button on the first touch interface. The specific steps are as follows:

[0247] The mobile terminal creates a first sub-interface in a first preset area of the user main interface, where the first preset area is a fixed area in the user main interface;

[0248] The mobile terminal creates a first touch interface in a second preset area of the user main interface, where the first touch interface is another fixed area in the user main interface;

[0249] The mobile terminal reduces the size of the first game interface in a picture-in-picture mode and then displays it on the first sub-interface, and displays the first virtual button on the first touch interface in a picture-in-picture mode.

[0250] In this embodiment, a method for implementing interface display based on an embedded interface is introduced. At least one of the first sub-interface and the first touch interface can be an embedded interface. Since the embedded interface is a fixed interface, the mobile terminal can create a first sub-interface in the first preset area of the user main interface, and the first preset area is a fixed area on the user main interface. In addition, a first touch interface can also be created in the second preset area of the user main interface, and the second preset area is another fixed area on the user main interface. Based on this, the mobile terminal reduces the size of the first game interface in a picture-in-picture mode and then displays it on the first sub-interface, and displays the first virtual button on the first touch interface in a picture-in-picture mode.

[0251] For ease of understanding, a smartphone is taken as an example of the mobile terminal for illustration. Please refer to Figure 21 , Figure 21 is a schematic diagram for determining interface display based on an embedded interface in the embodiments of the present application. As shown in the figure, L1 is used to indicate the user main interface, L2 is used to indicate the first preset area, L3 is used to indicate the second preset area, L4 is used to indicate the first sub-interface, L5 is used to indicate the first game interface after size reduction, L6 is used to indicate the first touch interface, and L7 is used to indicate the first virtual button. Figure 21 Both the first preset area and the second preset area in FIG. (A) are fixed areas on the user main interface. Therefore, Figure 21The first sub-interface in Figure (B) is created on the first preset area, while the first touch interface is created on the second preset area L3. In a similar manner to the foregoing embodiments, the first game interface is scaled down, and then the scaled-down first game interface is overlaid on the first sub-interface for display, and the first virtual button is displayed on the first touch interface.

[0252] In the embodiments of the present application, a method for implementing interface display based on an embedded interface is provided. By the above method, a sub-interface for displaying a game interface and a touch interface for controlling the game are created on a preset area fixed on the user's main interface, enabling the user to operate other services on the mobile terminal while maintaining the game progress, without the need for the user to frequently switch interfaces, thus simplifying the user operation.

[0253] Optionally, on the basis of the above Figure 3 and Figure 7 corresponding embodiments, in another optional embodiment provided by the embodiments of the present application, both the first sub-interface and the first touch interface belong to the floating window interface;

[0254] After the mobile terminal scales down the first game interface, it is displayed on the first sub-interface, and the first virtual button is displayed on the first touch interface, which specifically includes the following steps:

[0255] The mobile terminal creates the first sub-interface on the upper layer of the user's main interface;

[0256] The mobile terminal creates the first touch interface on the upper layer of the user's main interface;

[0257] The mobile terminal scales down the first game interface in floating window mode and then displays it on the first sub-interface, and displays the first virtual button on the first touch interface in floating window mode.

[0258] In this embodiment, a method for controlling interface display based on the floating window interface is introduced. At least one of the first sub-interface and the first touch interface can be a floating window interface. Since the floating window interface is not a fixed interface, the mobile terminal can create the first sub-interface on the upper layer of the user's main interface and create the first touch interface on the upper layer of the user's main interface. Then, the first game interface is scaled down in floating window mode and displayed on the first sub-interface, and the first virtual button can also be displayed on the first touch interface in floating window mode. Among them, the floating window interface can be a non-transparent interface or a semi-transparent interface, which is not limited herein.

[0259] For ease of understanding, a smartphone is used as an example of the mobile terminal for illustration. Please refer to Figure 22 , Figure 22This is a schematic diagram for determining interface display based on a floating interface in an embodiment of the present application. As shown in the figure, M1 is used to indicate the user main interface, M2 is used to indicate the first sub-interface, M3 is used to indicate the first touch interface, M4 is used to indicate the first game interface after being scaled down, and M5 is used to indicate the first virtual button. Both the first sub-interface and the first touch interface are on the upper layer of the user main interface. After scaling down the first game interface, it is then displayed on the first sub-interface, and the first virtual button is displayed on the first touch interface. Based on this, the interface shown in Figure 22 Figure (B) in

[0260] In an embodiment of the present application, a method for controlling interface display based on a floating window interface is provided. Through the above method, a sub-interface for displaying a game interface and a touch interface for controlling the game are created on the upper layer of the user main interface, enabling the user to operate other services on the mobile terminal while maintaining the game progress, without the user having to frequently switch interfaces, further simplifying the user operation.

[0261] Optionally, based on the above Figure 3 and Figure 7 corresponding embodiments, in another optional embodiment provided by the embodiments of the present application, the following steps are further included:

[0262] If a drag operation is triggered on the first sub-interface, the mobile terminal controls the first sub-interface to move along the drag trajectory corresponding to the drag operation;

[0263] If a drag operation is triggered on the first touch interface, the mobile terminal controls the first touch interface to move along the drag trajectory corresponding to the drag operation;

[0264] If a scaling operation is triggered on the first sub-interface, the mobile terminal controls the first sub-interface to be enlarged or reduced according to the scaling operation;

[0265] If a scaling operation is triggered on the first touch interface, the mobile terminal controls the first touch interface to be enlarged or reduced according to the scaling operation.

[0266] In this embodiment, a method for adjusting the position and size of the floating window is introduced. For the floating window interface, the user can also perform drag operations and scaling operations. Specifically, please refer to Figure 23 , Figure 23 This is a schematic diagram for performing a drag operation on the first sub-interface in an embodiment of the present application. As shown in the figure, N1 is used to indicate the first sub-interface, N2 is used to indicate the starting position, and N3 is used to indicate the ending position. Figure 23As shown in Figure (A), the user drags from the starting position to the ending position, and the dragging trajectory is from the starting position to the ending position. Thus, the mobile terminal can control the first sub-interface to move from the starting position to the ending position, that is, to obtain Figure (B) as shown in Figure 23 It is understandable that the dragging operation on the first touch interface will not be elaborated here.

[0267] The user can also perform a zoom operation on the first sub-interface. For example, the user can zoom in or out the first sub-interface. Among them, the zoom operation includes a zoom-out operation and a zoom-in operation. The zoom-out operation is that at least two touch points contract inward, and the zoom-in operation is that at least two touch points extend outward. Specifically, please refer to Figure 24 , Figure 24 Figure 9 is a schematic diagram of the dragging operation on the first sub-interface in an embodiment of the present application. As shown in the figure, O1 is used to indicate the first sub-interface, O2 is used to indicate the first sub-interface after zooming out, and O3 is used to indicate the first sub-interface after zooming in. Figure 24 As shown in Figure (A), the fingers contract inward on the touch screen of the mobile terminal, that is, triggering the zoom-out operation on the first sub-interface. Thus, Figure (B) as shown in Figure 24 is obtained, and the first sub-interface has been zoomed out. Figure 24 As shown in Figure (C), the fingers extend outward on the touch screen of the mobile terminal, that is, triggering the zoom-in operation on the first sub-interface. Thus, Figure (D) as shown in Figure 24 is obtained, and the first sub-interface has been zoomed in. It is understandable that the zoom operation on the first touch interface will not be elaborated here.

[0268] In an embodiment of the present application, a method for adjusting the position and size of a floating window is provided. Through the above method, for the floating window interface, the position and size of the first sub-interface and the first touch interface can also be adjusted according to user needs, thereby improving the flexibility of the solution.

[0269] Optionally, based on the above Figure 3 and Figure 7 corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, before the mobile terminal creates the first sub-interface and the first touch interface on the user main interface, the following steps are further included:

[0270] The mobile terminal obtains the game type of the first game application;

[0271] The mobile terminal determines the first touch interface from at least one creatable touch interface according to the game type of the first game application, where each creatable touch interface displays corresponding virtual buttons.

[0272] In this embodiment, a method for adjusting a touch interface based on a game type is introduced. Since different game types correspond to different creatable touch interfaces, a mobile terminal can determine a first touch interface from at least one creatable touch interface according to the game type of a first game application.

[0273] It should be noted that the game type can be a sports competition game, a casual game, and a role-playing game (RPG, etc.). For example, the touch interface corresponding to a sports competition game may include virtual buttons such as "jump" and "squat". For example, the touch interface corresponding to a casual game may include virtual buttons such as "left", "right", and "shoot". For another example, the touch interface corresponding to an RPG may include virtual buttons of the direction type. In practical applications, the user can also customize the parameters of the first touch interface, and the parameters include but are not limited to interface transparency, interface background color, interface pattern, interface text, and the shape and size of virtual buttons, etc., which are not limited here.

[0274] For ease of understanding, please refer to Figure 25 , Figure 25 is a schematic diagram of an embodiment of the first touch interface in the embodiment of the present application. As shown in the figure, P1 is used to indicate the first touch interface, P11 is used to indicate the virtual button of the direction type, P12 is used to indicate the virtual button of the "confirm" function, and P13 is used to indicate the virtual button of the "cancel" function. P21 is used to indicate the virtual button of the "jump" function, and P22 is used to indicate the virtual button of the "squat" function. P31 is used to indicate the virtual button of "move left", P32 is used to indicate the virtual button of "move right", and P33 is used to indicate the virtual button of the "shoot" function. It can be seen that Figure 25 the user main interface shown in (A) in Figure 25 corresponds to an RPG. Figure 25 the user main interface shown in (B) in

[0275] Taking the parameters of the first touch interface including interface transparency and interface color as an example for introduction, please refer to Figure 26 , Figure 26 is a schematic diagram of an embodiment of selecting the parameters of the first touch interface in the embodiment of the present application. As shown in the figure, Q1 is used to indicate the first touch interface, Q2 is used to indicate the interface color selection area, and Q3 is used to indicate the transparency selection area. The user can adjust the interface color and the transparency according to the needs.

[0276] In an embodiment of the present application, a method for adjusting a touch interface based on a game type is provided. Through the above method, different touch interfaces can be set for different game types, so as to facilitate the control of different types of games. In addition, the first touch interface can also adjust parameters according to user needs, thereby increasing the flexibility of the solution.

[0277] Optionally, based on the above Figure 3 and Figure 7 corresponding respective embodiments, in another optional embodiment provided by the embodiment of the present application, the following steps are further included:

[0278] When the mobile terminal runs a second game application, the second game interface corresponding to the second game application is displayed in full-screen mode;

[0279] If the switching mode is triggered, the mobile terminal shrinks the second game interface and then displays it on the second sub-interface, and displays the second virtual button on the second touch interface, where the second virtual button is used to control the second game application, and both the second sub-interface and the second touch interface are displayed on the user's main interface.

[0280] In this embodiment, a method for simultaneously displaying multiple game interfaces is introduced. The mobile terminal can also run a second game application, and display the second game interface corresponding to the second game application in full-screen mode. When the switching mode is satisfied, a second sub-interface and a second touch interface can be created on the user's main interface, and the second game interface is shrunk and then displayed on the second sub-interface, and the second virtual button is displayed on the second touch interface, and the second virtual button is used to control the second game application. The way to trigger the switching mode is similar to the foregoing embodiment and will not be elaborated here.

[0281] For easy understanding, please refer to Figure 27 , Figure 27 which is another schematic diagram of an embodiment of the control interface display method in the embodiment of the present application. As shown in the figure, R1 is used to indicate the first sub-interface, R2 is used to indicate the first touch interface, R3 is used to indicate the second sub-interface, and R4 is used to indicate the second touch interface. On this user's main interface, the shrunk first game interface is displayed on the first sub-interface, the shrunk second game interface is displayed on the second sub-interface, the first virtual button corresponding to the first game application is displayed on the first touch interface, and the second virtual button corresponding to the second game application is displayed on the second touch interface. It should be understood that Figure 27 the example of

[0282] In the embodiments of the present application, a method for simultaneously displaying multiple game interfaces is provided. Through the above method, the mobile terminal can display multiple game applications on the user main interface, and while maintaining two game progressions, it can also perform operations on other services on the mobile terminal, thereby increasing the convenience of operation.

[0283] Optionally, based on the above Figure 3 and Figure 7 corresponding embodiments, in another optional embodiment provided by the embodiments of the present application, the following steps are further included:

[0284] When the mobile terminal runs a video application, a video application interface corresponding to the video application is displayed on the user main interface;

[0285] If the switching mode is triggered, the mobile terminal shrinks the video application interface and then displays it on the third sub-interface, where the third sub-interface is displayed above the user main interface.

[0286] In this embodiment, a method for simultaneously displaying a game interface and a video interface is introduced. The mobile terminal can also run a video application, and thus a video application interface corresponding to the video application is displayed on the user main interface. When the switching mode is triggered, a third sub-interface is created on the user main interface, and then the video application interface is shrunk and displayed on the third sub-interface. It should be noted that the way to trigger the switching mode and the way to create the third sub-interface are similar to those in the foregoing embodiments and will not be elaborated here.

[0287] For ease of understanding, please refer to Figure 28 , Figure 28 which is another schematic diagram of an embodiment of the method for controlling interface display in the embodiments of the present application. As shown in the figure, T1 is used to indicate the first sub-interface, T2 is used to indicate the first touch interface, and T3 is used to indicate the third sub-interface. On this user main interface, a shrunk first game interface is displayed on the first sub-interface, a first virtual button is displayed on the first touch interface, and a shrunk video application interface is displayed on the third sub-interface. It should be understood that Figure 28 the example of

[0288] In the embodiments of the present application, a method for simultaneously displaying a game interface and a video interface is provided. Through the above method, the mobile terminal can not only display game applications on the user main interface, but also simultaneously display video applications on the user main interface, and realize the user's operations on other services on the mobile terminal, meet the diversified needs of users, and further simplify the user operation.

[0289] Optionally, based on the above Figure 3 andFigure 7 Based on the corresponding embodiments, in another alternative embodiment provided by the embodiments of the present application, after the mobile terminal shrinks the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, the following steps are further included:

[0290] When the mobile terminal runs the target application, the application interface corresponding to the target application is displayed in full-screen mode on the user main interface, and the first sub-interface and the first touch interface are displayed on the user main interface, where the target application includes at least one of instant messaging applications, entertainment applications, and tool applications.

[0291] In this embodiment, a method for simultaneously displaying a game interface and an information interface is introduced. After the mobile terminal shrinks the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, if the target application is running, the application interface of the target application can also be displayed in full-screen mode on the user main interface. At the same time, the first sub-interface and the first touch interface are continuously displayed on the user main interface. The target application includes but is not limited to instant messaging applications, entertainment applications, and tool applications.

[0292] Specifically, communication applications include but are not limited to media instant messaging applications such as chat, social, email, and community. Entertainment applications include but are not limited to applications such as music, ringtones, players, live broadcasts, entertainment, and constellation horoscopes. Tool applications include but are not limited to applications such as life services, food, weather, calendar, utility tools, flashlights, notes, office tools, cloud storage, and office software. When the user operates the target application on the user main interface, the application interface can be displayed in full-screen mode. For example, replying to messages, checking emails, ordering takeout, listening to music, using Weibo, surfing the Internet, taking pictures, setting the system, etc. can all be displayed in full-screen mode. The user can perform these operations while maintaining the game progress.

[0293] For the sake of easy understanding, taking the target application as a tool application as an example for illustration, please refer to Figure 29 , Figure 29 is another schematic diagram of the control interface display method in the embodiments of the present application. As shown in the figure, U1 is used to indicate the first sub-interface, U2 is used to indicate the first touch interface, and U3 is used to indicate the tool application interface. Therefore, on this user main interface, the shrunk first game interface is displayed on the first sub-interface, the first virtual button is displayed on the first touch interface, and the tool application interface corresponding to the tool application is displayed in full-screen mode.

[0294] In an embodiment of the present application, a method for simultaneously displaying a game interface and an information interface is provided. Through the above method, a mobile terminal displays multiple applications on the user's main interface, which can not only continue the game progress but also operate other applications, thereby enabling the user to operate multiple application services on the mobile terminal, thereby meeting the diversified needs of users.

[0295] The following is a detailed description of the interface display control device in this application. Figure 30 , Figure 30 This is a schematic diagram of an embodiment of an interface display control device in an embodiment of the present application. The interface display control device 30 includes:

[0296] The display module 301 is used to display the first game interface and the first virtual button on the user main interface in full screen mode when the first game application is running;

[0297] The display module 301 is also used to shrink the first game interface and display it on the first sub-interface if the switching mode is triggered, and display the first virtual button on the first touch interface, wherein the first virtual button is used to control the first game application, and the first sub-interface and the first touch interface are both displayed on the user main interface.

[0298] Optionally, in the above Figure 30 On the basis of the corresponding embodiment, in another embodiment of the interface display control device 30 provided in the embodiment of the present application,

[0299] The display module 301 is also used to shrink the first game interface and display it on the first sub-interface, and display the first virtual button on the first touch interface. If the switchback mode is triggered, the first game interface and the first virtual button are displayed in full-screen mode on the user main interface.

[0300] Optionally, in the above Figure 30 On the basis of the corresponding embodiment, in another embodiment of the interface display control device 30 provided in the embodiment of the present application, the interface display control device 30 further includes a determination module 302;

[0301] The determination module 302 is used to determine the trigger switching mode if a preset switching operation is triggered, wherein the preset switching operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

[0302] Optionally, in the above Figure 30 On the basis of the corresponding embodiment, in another embodiment of the interface display control device 30 provided in the embodiment of the present application,

[0303] A determination module 302, specifically configured to determine that a switching mode is triggered if a click operation is triggered on a first virtual button in the first game interface;

[0304] Or,

[0305] If a pressing operation is triggered on the first game interface, it is determined that the switching mode is triggered, where the pressing time of the pressing operation is greater than or equal to a first time threshold;

[0306] Or,

[0307] If a swiping operation is triggered on the first game interface, it is determined that the switching mode is triggered, where the swiping trajectory of the swiping operation is generated based on the starting position and the ending position of the touch object;

[0308] Or,

[0309] If a double-click operation is triggered on the first game interface, it is determined that the switching mode is triggered, where the double-click time interval of the double-click operation is less than or equal to a second time threshold;

[0310] Or,

[0311] If a multi-touch point operation is triggered on the first game interface, it is determined that the switching mode is triggered, where the multi-touch point operation is generated after at least two touch points move closer to each other.

[0312] Optionally, based on the corresponding embodiment above, in another embodiment of the interface display control device 30 provided by the embodiments of the present application, Figure 30 the determination module 302 is further configured to determine that a back-cutting mode is triggered if a preset back-cutting operation is triggered on the first sub-interface, where the preset back-cutting operation includes at least one of a click operation, a pressing operation, a swiping operation, a double-click operation, and a multi-touch point operation.

[0313] Optionally, based on the corresponding embodiment above, in another embodiment of the interface display control device 30 provided by the embodiments of the present application,

[0314] the determination module 302, specifically, if a click operation is triggered on a second virtual button in the first sub-interface, it is determined that the back-cutting mode is triggered; Figure 30 Optionally, based on the corresponding embodiment above, in another embodiment of the interface display control device 30 provided by the embodiments of the present application,

[0315] If a pressing operation is triggered on the first sub-interface, it is determined that the back-cutting mode is triggered, where the pressing time of the pressing operation is greater than or equal to a first time threshold;

[0316] Or,

[0317] If a pressing operation is triggered on the first sub-interface, it is determined that the back-cutting mode is triggered, where the pressing time of the pressing operation is greater than or equal to a first time threshold;

[0318] Or,

[0319] If a swiping operation is triggered for the first sub-interface, a back-cut mode is determined, where the swiping trajectory of the swiping operation is generated based on the starting position and the ending position of the touch object;

[0320] Or,

[0321] If a double-tap operation is triggered for the first sub-interface, a back-cut mode is determined, where the double-tap time interval of the double-tap operation is less than or equal to a second time threshold;

[0322] Or,

[0323] If a multi-touch-point operation is triggered for the first sub-interface, a back-cut mode is determined, where the multi-touch-point operation is generated based on at least two touch points extending outward.

[0324] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application, the interface display control device 30 further includes an acquisition module 303;

[0325] The acquisition module 303 is configured to, after the display module 301 displays the first game interface and the first virtual button on the user's main interface in full-screen mode, acquire the device usage state through a gravity sensor, where the device usage state is used to describe the posture when the mobile terminal is held;

[0326] The determination module 302 is further configured to determine to trigger a switching mode if the device usage state indicates that the mobile terminal is in a portrait usage state.

[0327] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application,

[0328] The acquisition module 303 is further configured to, after the display module 301 reduces the size of the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, acquire the device usage state through a gravity sensor, where the device usage state is used to describe the posture when the mobile terminal is held;

[0329] The determination module 302 is further configured to determine to trigger a back-cut mode if the device usage state indicates that the mobile terminal is in a landscape usage state.

[0330] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application,

[0331] The obtaining module 303 is further configured to obtain a face image through a front camera after the display module 301 displays the first game interface and the first virtual button on the user's main interface in full-screen mode;

[0332] The determining module 302 is further configured to determine a left-eye coordinate point corresponding to the left eye and a right-eye coordinate point corresponding to the right eye according to the face image;

[0333] The determining module 302 is further configured to determine a binocular coordinate connection line according to the left-eye coordinate point and the right-eye coordinate point;

[0334] The determining module 302 is further configured to determine that a switching mode is triggered if an angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is less than or equal to an angle threshold, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the vertical screen usage state.

[0335] Optionally, based on the embodiment corresponding to the above Figure 30 In another embodiment of the interface display control device 30 provided by the embodiment of the present application,

[0336] The obtaining module 303 is further configured to obtain a face image through a front camera after the display module shrinks the first game interface and displays it on the first sub-interface and displays the first virtual button on the first touch interface;

[0337] The determining module 302 is further configured to determine a left-eye coordinate point corresponding to the left eye and a right-eye coordinate point corresponding to the right eye according to the face image;

[0338] The determining module 302 is further configured to determine a binocular coordinate connection line according to the left-eye coordinate point and the right-eye coordinate point;

[0339] The determining module 302 is further configured to determine that a back-switching mode is triggered if an angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is greater than the angle threshold, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the vertical screen usage state.

[0340] Optionally, based on the embodiment corresponding to the above Figure 30 In another embodiment of the interface display control device 30 provided by the embodiment of the present application, the interface display control device 30 further includes a listening module 304;

[0341] The listening module 304 is configured to listen for an incoming call reminder after the display module 301 displays the first game interface and the first virtual button on the user's main interface in full-screen mode;

[0342] The determining module 302 is further configured to determine that a switching mode is triggered if an answer instruction for the incoming call reminder is triggered.

[0343] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application,

[0344] The obtaining module 303 is further configured to obtain the voice to be detected through the microphone after the display module displays the first game interface and the first virtual button on the user's main interface in full-screen mode;

[0345] The determining module 302 is further configured to determine that the switching mode is triggered if the voice to be detected matches the first preset voice successfully.

[0346] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application,

[0347] The obtaining module 303 is further configured to obtain the voice to be detected through the microphone after the display module reduces the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface;

[0348] The determining module 302 is further configured to determine that the back-switching mode is triggered if the voice to be detected matches the second preset voice successfully.

[0349] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application, both the first sub-interface and the first touch interface belong to the embedded interface;

[0350] The display module 301 is specifically configured to create a first sub-interface in a first preset area on the user's main interface, where the first preset area is a fixed area in the user's main interface;

[0351] Create a first touch interface in a second preset area on the user's main interface, where the first touch interface is another fixed area in the user's main interface;

[0352] Reduce the first game interface and display it on the first sub-interface in the picture-in-picture mode, and display the first virtual button on the first touch interface in the picture-in-picture mode.

[0353] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application, both the first sub-interface and the first touch interface belong to the floating window interface;

[0354] The display module 301 is specifically configured to create a first sub-interface on the upper layer of the user's main interface;

[0355] Create a first touch interface on top of the user's main interface;

[0356] Shrink the first game interface in floating window mode and display it on the first sub - interface, and display the first virtual button on the first touch interface in floating window mode.

[0357] Optionally, based on the above - mentioned Figure 30 In another embodiment of the interface display control device 30 provided by the embodiments of the present application, on the basis of the corresponding embodiment, the interface display control device 30 further includes a control module 305;

[0358] The control module 305 is used to control the first sub - interface to move along the dragging trajectory corresponding to the dragging operation if a dragging operation is triggered for the first sub - interface;

[0359] The control module 305 is further used to control the first touch interface to move along the dragging trajectory corresponding to the dragging operation if a dragging operation is triggered for the first touch interface;

[0360] The control module 305 is further used to control the first sub - interface to be enlarged or shrunk according to the scaling operation if a scaling operation is triggered for the first sub - interface;

[0361] The control module 305 is further used to control the first touch interface to be enlarged or shrunk according to the scaling operation if a scaling operation is triggered for the first touch interface.

[0362] Optionally, based on the above - mentioned Figure 30 In another embodiment of the interface display control device 30 provided by the embodiments of the present application, on the basis of the corresponding embodiment,

[0363] The obtaining module 303 is further used to obtain the game type of the first game application before the display module shrinks the first game interface and displays it on the first sub - interface, and displays the first virtual button on the first touch interface;

[0364] The determining module 302 is further used to determine the first touch interface from at least one creatable touch interface according to the game type of the first game application, where each creatable touch interface displays corresponding virtual buttons.

[0365] Optionally, based on the above - mentioned Figure 30 In another embodiment of the interface display control device 30 provided by the embodiments of the present application, on the basis of the corresponding embodiment,

[0366] The display module 301 is further configured to, if a switching mode is triggered, reduce the second game interface and then display it on the second sub-interface, and display the second virtual key on the second touch interface, where the second virtual key is used to control the second game application, and both the second sub-interface and the second touch interface are displayed on the user main interface.

[0367] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application,

[0368] The display module 301 is further configured to, when a video application is running, display a video application interface corresponding to the video application on the user main interface;

[0369] The display module 301 is further configured to, if a switching mode is triggered, reduce the video application interface and then display it on the third sub-interface, where the third sub-interface is displayed on the user main interface.

[0370] Optionally, based on the above Figure 30 corresponding embodiment, in another embodiment of the interface display control device 30 provided by the embodiments of the present application,

[0371] After the display module 301 reduces the first game interface and displays it on the first sub-interface and displays the first virtual key on the first touch interface, when a target application is running, it displays the application interface corresponding to the target application in full-screen mode on the user main interface, and displays the first sub-interface and the first touch interface on the user main interface, where the target application includes at least one of instant messaging applications, entertainment applications, and tool applications.

[0372] The embodiments of the present application also provide another interface display control device. As Figure 31 shown, for the sake of convenience of description, only parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiments of the present application. In the embodiments of the present application, a smart phone is used as an example of a mobile terminal for illustration:

[0373] Figure 31 The block diagram of a part of the structure of a smart phone related to the mobile terminal provided by the embodiments of the present application is shown. Referring to Figure 31 , the smart phone includes: a radio frequency (RF) circuit 410, a memory 420, an input unit 430, a display unit 440, a sensor 450, an audio circuit 460, a wireless fidelity (WiFi) module 470, a processor 480, and a power supply 490, etc. Those skilled in the art can understand, Figure 31The smartphone structure shown does not limit the smartphone, and it may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0374] The following will specifically introduce each component of the smartphone in conjunction with Figure 31 :

[0375] The RF circuit 410 can be used for receiving and transmitting information or signals during a call. Specifically, after receiving the downlink information from the base station, it is given to the processor 480 for processing; in addition, it sends the designed uplink data to the base station. Generally, the RF circuit 410 includes but is not limited to antennas, at least one amplifier, a transceiver, a coupler, a low-noise amplifier (LNA), a duplexer, etc. In addition, the RF circuit 410 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to the Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.

[0376] The memory 420 can be used to store software programs and modules. The processor 480 executes various functional applications and data processing of the smartphone by running the software programs and modules stored in the memory 420. The memory 420 mainly includes a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.); the data storage area can store data created according to the use of the smartphone (such as audio data, phone book, etc.). In addition, the memory 420 can include high-speed random access memory and can also include non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices.

[0377] The input unit 430 can be used to receive input numeric or character information and generate key signal inputs related to the user settings and function controls of the smart phone. Specifically, the input unit 430 can include a touch panel 431 and other input devices 432. The touch panel 431, also known as a touch screen, can collect touch operations of the user thereon or nearby (such as operations of the user using any suitable object or accessory such as a finger, a stylus, etc. on or near the touch panel 431), and drive corresponding connection devices according to a preset program. Optionally, the touch panel 431 can include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the touch position of the user, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 480, and can receive and execute commands sent by the processor 480. In addition, various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch panel 431. In addition to the touch panel 431, the input unit 430 can also include other input devices 432. Specifically, the other input devices 432 include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, a joystick, etc.

[0378] The display unit 440 can be used to display information input by the user or information provided to the user and various menus of the smart phone. The display unit 440 can include a display panel 441. Optionally, the display panel 441 can be configured in forms such as a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel 431 can cover the display panel 441. When the touch panel 431 detects a touch operation thereon or nearby, it is transmitted to the processor 480 to determine the type of touch event. Subsequently, the processor 480 provides corresponding visual output on the display panel 441 according to the type of touch event. Although in Figure 31 it, the touch panel 431 and the display panel 441 are implemented as two independent components to realize the input and input functions of the smart phone, but in some embodiments, the touch panel 431 and the display panel 441 can be integrated to realize the input and output functions of the smart phone.

[0379] The smart phone may further include at least one sensor 450, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor may adjust the brightness of the display panel 441 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 441 and / or the backlight when the smart phone is moved close to the ear. As a kind of motion sensor, the accelerometer sensor may detect the magnitude of acceleration in all directions (generally three axes), and may detect the magnitude and direction of gravity when stationary, and can be used for applications that identify the posture of the smart phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. As for other sensors that the smart phone may also be configured with, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be elaborated here.

[0380] The audio circuit 460, the speaker 461, and the microphone 462 may provide an audio interface between the user and the smart phone. The audio circuit 460 may transmit the electrical signal converted from the received audio data to the speaker 461, and the speaker 461 converts it into a sound signal for output; on the other hand, the microphone 462 converts the collected sound signal into an electrical signal, which is received by the audio circuit 460 and then converted into audio data. After the audio data is output to the processor 480 for processing, it is sent through the RF circuit 410 to, for example, another smart phone, or the audio data is output to the memory 420 for further processing.

[0381] WiFi belongs to short - range wireless transmission technology. The smart phone can help users send and receive emails, browse the web, and access streaming media through the WiFi module 470, which provides users with wireless broadband Internet access. Although Figure 31 the WiFi module 470 is shown, it can be understood that it does not belong to an essential component of the smart phone.

[0382] The processor 480 is the control center of the smart phone, connecting various parts of the entire smart phone using various interfaces and lines. By running or executing software programs and / or modules stored in the memory 420, and by calling data stored in the memory 420, it executes various functions of the smart phone and processes data. Optionally, the processor 480 may include one or more processing units; preferably, the processor 480 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above - mentioned modem processor may not be integrated into the processor 480 either.

[0383] The smart phone further includes a power source 490 (such as a battery) for supplying power to each component. Preferably, the power source can be logically connected to the processor 480 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system.

[0384] Although not shown, the smart phone may further include a camera, a Bluetooth module, etc., which will not be elaborated herein.

[0385] In the embodiments of the present application, the processor 480 included in the terminal can execute the functions in any corresponding embodiment described above, which will not be elaborated herein. Figures 3 to 29 Any corresponding embodiment described above, which will not be elaborated herein.

[0386] The embodiments of the present application further provide a computer-readable storage medium, in which a computer program is stored. When the computer program runs on a computer, the computer is enabled to execute the methods described in the foregoing various embodiments.

[0387] The embodiments of the present application further provide a computer program product including a program. When the computer program product runs on a computer, the computer is enabled to execute the methods described in the foregoing various embodiments.

[0388] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, which will not be elaborated herein.

[0389] In several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of devices or units can be in electrical, mechanical, or other forms.

[0390] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0391] In addition, in each embodiment of the present application, each functional unit may be integrated into one processing unit, may exist physically alone for each unit, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0392] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present application. The foregoing storage medium includes: various media that can store programs, such as USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs.

[0393] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of each embodiment of the present application.

Claims

1. A method for controlling interface display, characterized in that, Including: When the first game application is running, display the first game interface and the first virtual button in full-screen mode on the user's main interface; If the switching mode is triggered, shrink the first game interface and display it on the first sub-interface, and display the first virtual button on the first touch interface, where the first virtual button is used to control the first game application, and both the first sub-interface and the first touch interface are displayed on the user's main interface; If it is detected that the mobile terminal is in the landscape usage state, trigger the back-switching mode, and display the first game interface and the first virtual button in full-screen mode on the user's main interface.

2. The method according to claim 1, wherein After displaying the first game interface and the first virtual button in full-screen mode on the user's main interface, the method further includes: If a preset switching operation is triggered, it is determined that the switching mode is triggered, where the preset switching operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

3. The method according to claim 2, characterized in that The step of, if a preset switching operation is triggered, determining that the switching mode is triggered, includes: If a click operation is triggered on the first virtual button in the first game interface, it is determined that the switching mode is triggered; Or, If a press operation is triggered on the first game interface, it is determined that the switching mode is triggered, where the pressing time of the press operation is greater than or equal to the first time threshold; Or, If a swipe operation is triggered on the first game interface, it is determined that the switching mode is triggered, where the swipe trajectory of the swipe operation is generated based on the starting position and the ending position of the touch object; Or, If a double-click operation is triggered on the first game interface, it is determined that the switching mode is triggered, where the double-click time interval of the double-click operation is less than or equal to the second time threshold; Or, If a multi-touch point operation is triggered on the first game interface, it is determined that the switching mode is triggered, where the multi-touch point operation is generated after at least two touch points move closer to each other.

4. The method according to claim 1, wherein After shrinking the first game interface and displaying it on the first sub-interface, and displaying the first virtual button on the first touch interface, the method further includes: If a touch object triggers a preset back-switching operation on the first sub-interface on the touch screen, it is determined that the back-switching mode is triggered, where the preset back-switching operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

5. The method according to claim 1, characterized in that, After displaying the first game interface and the first virtual button in full-screen mode on the user's main interface, the method further includes: Obtain the device usage state through a gravity sensor, where the device usage state is used to describe the posture of the mobile terminal when it is held; If the device usage state indicates that the mobile terminal is in the portrait usage state, it is determined that the switching mode is triggered.

6. The method according to claim 1, characterized in that The step of, if it is detected that the mobile terminal is in the landscape usage state, triggering the back-switching mode, includes: Obtain the device usage state through a gravity sensor, where the device usage state is used to describe the posture of the mobile terminal when it is held; If the usage status of the device indicates that the mobile terminal is in the landscape usage state, determine to trigger the back - cut mode.

7. The method according to claim 1, characterized in that, After displaying the first game interface and the first virtual button on the user main interface in full - screen mode, the method further includes: Obtain a face image through the front - facing camera; Determine the left - eye coordinate point corresponding to the left eye and the right - eye coordinate point corresponding to the right eye according to the face image; Determine the connection line of the binocular coordinates according to the left - eye coordinate point and the right - eye coordinate point; If the included angle between the connection line of the binocular coordinates and the horizontal direction of the mobile terminal is less than or equal to the angle threshold, determine to trigger the switching mode, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the portrait usage state.

8. The method according to claim 1, wherein After shrinking the first game interface and displaying it on the first sub - interface, and displaying the first virtual button on the first touch interface, the method further includes: Obtain a face image through the front - facing camera; Determine the left - eye coordinate point corresponding to the left eye and the right - eye coordinate point corresponding to the right eye according to the face image; Determine the connection line of the binocular coordinates according to the left - eye coordinate point and the right - eye coordinate point; If the included angle between the connection line of the binocular coordinates and the horizontal direction of the mobile terminal is greater than the angle threshold, determine to trigger the back - cut mode, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the portrait usage state.

9. The method according to claim 1, characterized in that, After displaying the first game interface and the first virtual button on the user main interface in full - screen mode, the method further includes: Monitor the incoming call reminder; If the answering instruction for the incoming call reminder is triggered, determine to trigger the switching mode.

10. The method according to claim 1, characterized in that Both the first sub - interface and the first touch interface belong to the embedded interface; Shrinking the first game interface and displaying it on the first sub - interface, and displaying the first virtual button on the first touch interface includes: Create the first sub - interface in the first preset area of the user main interface, where the first preset area is a fixed area in the user main interface; Create the first touch interface in the second preset area of the user main interface, where the first touch interface is another fixed area in the user main interface; Shrink the first game interface in the picture - in - picture mode and display it on the first sub - interface, and display the first virtual button in the picture - in - picture mode on the first touch interface.

11. The method according to claim 1, wherein Both the first sub - interface and the first touch interface belong to the floating - window interface; Shrinking the first game interface and displaying it on the first sub - interface, and displaying the first virtual button on the first touch interface includes: Create the first sub - interface on the upper layer of the user main interface; Create the first touch interface on the upper layer of the user main interface; Shrink the first game interface in the floating - window mode and display it on the first sub - interface, and display the first virtual button in the floating - window mode on the first touch interface.

12. An interface display control device, characterized in that, Includes: A display module, configured to display a first game interface and a first virtual button on the user main interface in full - screen mode when running a first game application; The display module is further configured to, if a switching mode is triggered, shrink the first game interface and then display it on the first sub-interface, and display the first virtual button on the first touch interface, where the first virtual button is used to control the first game application, and both the first sub-interface and the first touch interface are displayed on the user main interface; if it is detected that the mobile terminal is in a landscape usage state, trigger a back-switching mode, and display the first game interface and the first virtual button on the user main interface in the full-screen mode.

13. The device according to claim 12, characterized in that, The device further includes a determination module; The determination module is configured to determine that the switching mode is triggered if a preset switching operation is triggered, where the preset switching operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

14. The device according to claim 13, wherein Specifically, the determination module is configured to determine that the switching mode is triggered if a click operation is triggered on the first virtual button in the first game interface; Or, if a press operation is triggered on the first game interface, determine that the switching mode is triggered, where the pressing time of the press operation is greater than or equal to a first time threshold; Or, if a swipe operation is triggered on the first game interface, determine that the switching mode is triggered, where the swipe trajectory of the swipe operation is generated based on the starting position and the ending position of the touch object; Or, if a double-click operation is triggered on the first game interface, determine that the switching mode is triggered, where the double-click time interval of the double-click operation is less than or equal to a second time threshold; Or, if a multi-touch point operation is triggered on the first game interface, determine that the switching mode is triggered, where the multi-touch point operation is generated after at least two touch points move closer to each other.

15. The device according to claim 13, characterized in that, The determination module is further configured to determine that the back-switching mode is triggered if a preset back-switching operation is triggered on the first sub-interface by a touch object on the touch screen, where the preset back-switching operation includes at least one of a click operation, a press operation, a swipe operation, a double-click operation, and a multi-touch point operation.

16. The device according to claim 13, wherein The device further includes an acquisition module; The acquisition module is configured to, after the display module displays the first game interface and the first virtual button on the user main interface in the full-screen mode, acquire the device usage state through a gravity sensor, where the device usage state is used to describe the posture of the mobile terminal when it is held. The determination module is further configured to determine that the back-switching mode is triggered if the device usage state indicates that the mobile terminal is in a landscape usage state.

17. The device according to claim 13, characterized in that, It further includes an acquisition module, and the acquisition module is configured to, after the display module shrinks the first game interface and displays it on the first sub-interface, and displays the first virtual button on the first touch interface, acquire the device usage state through a gravity sensor, where the device usage state is used to describe the posture of the mobile terminal when it is held; The determination module is further configured to determine that the back-switching mode is triggered if the device usage state indicates that the mobile terminal is in a landscape usage state.

18. The device according to claim 13, characterized in that, It further includes an acquisition module, which is used to acquire a face image through a front camera after the display module displays a first game interface and a first virtual button on the user's main interface in full-screen mode; The determination module is further used to determine a left-eye coordinate point corresponding to the left eye and a right-eye coordinate point corresponding to the right eye according to the face image; The determination module is further used to determine a binocular coordinate connection line according to the left-eye coordinate point and the right-eye coordinate point; The determination module is further used to determine that a switching mode is triggered if the included angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is less than or equal to an angle threshold, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the portrait usage state.

19. The device according to claim 13, characterized in that, It further includes an acquisition module, which is used to acquire a face image through a front camera after the display module reduces the size of the first game interface and displays it on a first sub-interface, and displays the first virtual button on a first touch interface; The determination module is further used to determine a left-eye coordinate point corresponding to the left eye and a right-eye coordinate point corresponding to the right eye according to the face image; The determination module is further used to determine a binocular coordinate connection line according to the left-eye coordinate point and the right-eye coordinate point; The determination module is further used to determine that a back-switching mode is triggered if the included angle between the binocular coordinate connection line and the horizontal direction of the mobile terminal is greater than the angle threshold, where the horizontal direction of the mobile terminal represents the horizontal direction when the mobile terminal is in the portrait usage state.

20. The device according to claim 13, characterized in that, The device further includes a monitoring module; The monitoring module is used to monitor an incoming call reminder after the display module displays a first game interface and a first virtual button on the user's main interface in full-screen mode; The determination module is further used to determine that a switching mode is triggered if an answering instruction for the incoming call reminder is triggered.

21. The device according to claim 12, characterized in that, Both the first sub-interface and the first touch interface belong to embedded interfaces. The display module is specifically used to create the first sub-interface in a first preset area on the user's main interface, where the first preset area is a fixed area in the user's main interface; Create the first touch interface in a second preset area on the user's main interface, where the first touch interface is another fixed area in the user's main interface; Reduce the size of the first game interface and display it on the first sub-interface in a picture-in-picture mode, and display the first virtual button on the first touch interface in a picture-in-picture mode.

22. The device according to claim 12, characterized in that, Both the first sub-interface and the first touch interface belong to floating window interfaces; The display module is specifically used to create the first sub-interface on the upper layer of the user's main interface; Create the first touch interface on the upper layer of the user's main interface; Reduce the size of the first game interface and display it on the first sub-interface in a floating window mode, and display the first virtual button on the first touch interface in a floating window mode.

23. A mobile terminal, characterized in that, It includes: A memory and a processor; Wherein, the memory is used to store programs; The processor is configured to execute the program in the memory, and the processor is configured to execute the method according to any one of claims 1 to 11 based on the instructions in the program.

24. A computer-readable storage medium comprising instructions that, when run on a computer, cause the computer to execute the method according to any one of claims 1 to 11.

25. A computer program product, characterized in that, The computer program product comprises instructions that, when run on a computer device, cause the computer device to execute the method according to any one of claims 1 to 11.

Images